From patchwork Wed Oct 26 17:41:46 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Punit Agrawal X-Patchwork-Id: 9397961 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 48AFA600BA for ; Wed, 26 Oct 2016 17:46:07 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id D3B8E29BAF for ; Wed, 26 Oct 2016 17:46:06 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id C8AC229BD2; Wed, 26 Oct 2016 17:46:06 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=2.0 tests=BAYES_00, RCVD_IN_DNSWL_MED autolearn=unavailable version=3.3.1 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.9]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 4598429BAF for ; Wed, 26 Oct 2016 17:46:06 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.85_2 #1 (Red Hat Linux)) id 1bzSFh-0007hn-BV; Wed, 26 Oct 2016 17:44:37 +0000 Received: from foss.arm.com ([217.140.101.70]) by bombadil.infradead.org with esmtp (Exim 4.85_2 #1 (Red Hat Linux)) id 1bzSEG-0006ap-6U for linux-arm-kernel@lists.infradead.org; Wed, 26 Oct 2016 17:43:11 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 24CF61517; Wed, 26 Oct 2016 10:42:48 -0700 (PDT) Received: from localhost (e105922-lin.cambridge.arm.com [10.1.195.25]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id EA3B23F487; Wed, 26 Oct 2016 10:42:47 -0700 (PDT) From: Punit Agrawal To: linux-kernel@vger.kernel.org, kvm@vger.kernel.org, kvmarm@lists.cs.columbia.edu, linux-arm-kernel@lists.infradead.org Subject: [PATCH v2 6/8] arm: KVM: Handle trappable TLB instructions Date: Wed, 26 Oct 2016 18:41:46 +0100 Message-Id: <20161026174148.17172-7-punit.agrawal@arm.com> X-Mailer: git-send-email 2.9.3 In-Reply-To: <20161026174148.17172-1-punit.agrawal@arm.com> References: <20161026174148.17172-1-punit.agrawal@arm.com> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20161026_104308_379699_C6671872 X-CRM114-Status: GOOD ( 11.52 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Marc Zyngier , Punit Agrawal , Will Deacon , Steven Rostedt , Ingo Molnar , Christoffer Dall MIME-Version: 1.0 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+patchwork-linux-arm=patchwork.kernel.org@lists.infradead.org X-Virus-Scanned: ClamAV using ClamSMTP It is possible to enable selective trapping of guest TLB maintenance instructions executed in lower privilege levels to HYP mode. This feature can be used to monitor guest TLB operations. Add support to emulate the TLB instructions when their execution traps to hyp mode. Signed-off-by: Punit Agrawal Cc: Christoffer Dall Cc: Marc Zyngier --- arch/arm/include/asm/kvm_asm.h | 1 + arch/arm/kvm/coproc.c | 55 ++++++++++++++++++++++++++++++++++++++++++ arch/arm/kvm/hyp/tlb.c | 33 +++++++++++++++++++++++++ 3 files changed, 89 insertions(+) diff --git a/arch/arm/include/asm/kvm_asm.h b/arch/arm/include/asm/kvm_asm.h index d7ea6bc..00a6511 100644 --- a/arch/arm/include/asm/kvm_asm.h +++ b/arch/arm/include/asm/kvm_asm.h @@ -66,6 +66,7 @@ extern char __kvm_hyp_vector[]; extern void __kvm_flush_vm_context(void); extern void __kvm_tlb_flush_vmid_ipa(struct kvm *kvm, phys_addr_t ipa); extern void __kvm_tlb_flush_vmid(struct kvm *kvm); +extern void __kvm_emulate_tlb_invalidate(struct kvm *kvm, u32 opcode, u64 regval); extern int __kvm_vcpu_run(struct kvm_vcpu *vcpu); diff --git a/arch/arm/kvm/coproc.c b/arch/arm/kvm/coproc.c index 3e5e419..593edeb 100644 --- a/arch/arm/kvm/coproc.c +++ b/arch/arm/kvm/coproc.c @@ -205,6 +205,23 @@ static bool access_dcsw(struct kvm_vcpu *vcpu, return true; } +static bool emulate_tlb_invalidate(struct kvm_vcpu *vcpu, + const struct coproc_params *p, + const struct coproc_reg *r) +{ + /* + * Based on system register encoding from ARM v8 ARM + * (DDI 0487A.k F5.1.103) + */ + u32 opcode = p->Op1 << 21 | p->CRn << 16 | p->Op2 << 5 | p->CRm << 0; + + kvm_call_hyp(__kvm_emulate_tlb_invalidate, + vcpu->kvm, opcode, p->Rt1); + trace_kvm_tlb_invalidate(*vcpu_pc(vcpu), opcode); + + return true; +} + /* * Generic accessor for VM registers. Only called as long as HCR_TVM * is set. If the guest enables the MMU, we stop trapping the VM @@ -354,6 +371,44 @@ static const struct coproc_reg cp15_regs[] = { { CRn( 7), CRm( 6), Op1( 0), Op2( 2), is32, access_dcsw}, { CRn( 7), CRm(10), Op1( 0), Op2( 2), is32, access_dcsw}, { CRn( 7), CRm(14), Op1( 0), Op2( 2), is32, access_dcsw}, + + /* TLBIALLIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* TLBIMVAIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* TLBIASIDIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* TLBIMVAAIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 3), is32, emulate_tlb_invalidate}, + /* TLBIMVALIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 5), is32, emulate_tlb_invalidate}, + /* TLBIMVAALIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 7), is32, emulate_tlb_invalidate}, + /* ITLBIALL */ + { CRn( 8), CRm( 5), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* ITLBIMVA */ + { CRn( 8), CRm( 5), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* ITLBIASID */ + { CRn( 8), CRm( 5), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* DTLBIALL */ + { CRn( 8), CRm( 6), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* DTLBIMVA */ + { CRn( 8), CRm( 6), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* DTLBIASID */ + { CRn( 8), CRm( 6), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* TLBIALL */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* TLBIMVA */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* TLBIASID */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* TLBIMVAA */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 3), is32, emulate_tlb_invalidate}, + /* TLBIMVAL */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 5), is32, emulate_tlb_invalidate}, + /* TLBIMVAAL */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 7), is32, emulate_tlb_invalidate}, + /* * L2CTLR access (guest wants to know #CPUs). */ diff --git a/arch/arm/kvm/hyp/tlb.c b/arch/arm/kvm/hyp/tlb.c index 7296528..cfa7cf6 100644 --- a/arch/arm/kvm/hyp/tlb.c +++ b/arch/arm/kvm/hyp/tlb.c @@ -61,3 +61,36 @@ void __hyp_text __kvm_flush_vm_context(void) write_sysreg(0, ICIALLUIS); dsb(ish); } + +static void __hyp_text __switch_to_guest_regime(struct kvm *kvm) +{ + write_sysreg(kvm->arch.vttbr, VTTBR); + isb(); +} + +static void __hyp_text __switch_to_host_regime(void) +{ + write_sysreg(0, VTTBR); +} + +void __hyp_text +__kvm_emulate_tlb_invalidate(struct kvm *kvm, u32 opcode, u64 regval) +{ + kvm = kern_hyp_va(kvm); + + __switch_to_guest_regime(kvm); + + /* + * TLB maintenance operations are broadcast to + * inner-shareable domain when HCR_FB is set (default for + * KVM). + * + * Nuke all Stage 1 TLB entries for the VM. This will kill + * performance but it's always safe to do as we don't leave + * behind any strays in the TLB + */ + write_sysreg(0, TLBIALLIS); + isb(); + + __switch_to_host_regime(); +}