From patchwork Tue Jan 31 17:16:24 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Punit Agrawal X-Patchwork-Id: 9547815 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id D09436016C for ; Tue, 31 Jan 2017 17:18:40 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id C0C9A283E1 for ; Tue, 31 Jan 2017 17:18:40 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id B513428408; Tue, 31 Jan 2017 17:18:40 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=2.0 tests=BAYES_00 autolearn=ham version=3.3.1 Received: from bombadil.infradead.org (bombadil.infradead.org [65.50.211.133]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 2D4BC283E1 for ; Tue, 31 Jan 2017 17:18:40 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.87 #1 (Red Hat Linux)) id 1cYc4i-0003Zl-B1; Tue, 31 Jan 2017 17:18:36 +0000 Received: from foss.arm.com ([217.140.101.70]) by bombadil.infradead.org with esmtp (Exim 4.87 #1 (Red Hat Linux)) id 1cYc3q-0002Pe-Qi for linux-arm-kernel@lists.infradead.org; Tue, 31 Jan 2017 17:17:47 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 736A314F6; Tue, 31 Jan 2017 09:17:25 -0800 (PST) Received: from localhost (e105922-lin.cambridge.arm.com [10.1.195.25]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 447F33F24D; Tue, 31 Jan 2017 09:17:25 -0800 (PST) From: Punit Agrawal To: kvmarm@lists.cs.columbia.edu, linux-arm-kernel@lists.infradead.org Subject: [PATCH v4 3/9] arm: KVM: Handle trappable TLB instructions Date: Tue, 31 Jan 2017 17:16:24 +0000 Message-Id: <20170131171630.26898-4-punit.agrawal@arm.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20170131171630.26898-1-punit.agrawal@arm.com> References: <20170131171630.26898-1-punit.agrawal@arm.com> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20170131_091743_333308_33F6A742 X-CRM114-Status: GOOD ( 11.75 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Mark Rutland , kvm@vger.kernel.org, Marc Zyngier , Punit Agrawal , Will Deacon , linux-kernel@vger.kernel.org, Christoffer Dall MIME-Version: 1.0 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+patchwork-linux-arm=patchwork.kernel.org@lists.infradead.org X-Virus-Scanned: ClamAV using ClamSMTP It is possible to enable selective trapping of guest TLB maintenance instructions executed in lower privilege levels to HYP mode. This feature can be used to monitor guest TLB operations. Add support to emulate the TLB instructions when their execution traps to hyp mode. Also keep track of the number of emulated operations. Signed-off-by: Punit Agrawal Cc: Christoffer Dall Cc: Marc Zyngier --- arch/arm/include/asm/kvm_asm.h | 2 ++ arch/arm/include/asm/kvm_host.h | 1 + arch/arm/kvm/coproc.c | 56 +++++++++++++++++++++++++++++++++++++++++ arch/arm/kvm/hyp/tlb.c | 33 ++++++++++++++++++++++++ 4 files changed, 92 insertions(+) diff --git a/arch/arm/include/asm/kvm_asm.h b/arch/arm/include/asm/kvm_asm.h index 8ef05381984b..782034a5a3c3 100644 --- a/arch/arm/include/asm/kvm_asm.h +++ b/arch/arm/include/asm/kvm_asm.h @@ -67,6 +67,8 @@ extern void __kvm_flush_vm_context(void); extern void __kvm_tlb_flush_vmid_ipa(struct kvm *kvm, phys_addr_t ipa); extern void __kvm_tlb_flush_vmid(struct kvm *kvm); extern void __kvm_tlb_flush_local_vmid(struct kvm_vcpu *vcpu); +extern void __kvm_emulate_tlb_invalidate(struct kvm *kvm, u32 opcode, + u64 regval); extern int __kvm_vcpu_run(struct kvm_vcpu *vcpu); diff --git a/arch/arm/include/asm/kvm_host.h b/arch/arm/include/asm/kvm_host.h index d5423ab15ed5..26f0c8a0b790 100644 --- a/arch/arm/include/asm/kvm_host.h +++ b/arch/arm/include/asm/kvm_host.h @@ -205,6 +205,7 @@ struct kvm_vcpu_stat { u64 mmio_exit_user; u64 mmio_exit_kernel; u64 exits; + u64 tlb_invalidate; }; #define vcpu_cp15(v,r) (v)->arch.ctxt.cp15[r] diff --git a/arch/arm/kvm/coproc.c b/arch/arm/kvm/coproc.c index 3e5e4194ef86..b978b0bf211e 100644 --- a/arch/arm/kvm/coproc.c +++ b/arch/arm/kvm/coproc.c @@ -205,6 +205,24 @@ static bool access_dcsw(struct kvm_vcpu *vcpu, return true; } +static bool emulate_tlb_invalidate(struct kvm_vcpu *vcpu, + const struct coproc_params *p, + const struct coproc_reg *r) +{ + /* + * Based on system register encoding from ARM v8 ARM + * (DDI 0487A.k F5.1.103) + */ + u32 opcode = p->Op1 << 21 | p->CRn << 16 | p->Op2 << 5 | p->CRm << 0; + + kvm_call_hyp(__kvm_emulate_tlb_invalidate, + vcpu->kvm, opcode, p->Rt1); + trace_kvm_tlb_invalidate(*vcpu_pc(vcpu), opcode); + ++vcpu->stat.tlb_invalidate; + + return true; +} + /* * Generic accessor for VM registers. Only called as long as HCR_TVM * is set. If the guest enables the MMU, we stop trapping the VM @@ -354,6 +372,44 @@ static const struct coproc_reg cp15_regs[] = { { CRn( 7), CRm( 6), Op1( 0), Op2( 2), is32, access_dcsw}, { CRn( 7), CRm(10), Op1( 0), Op2( 2), is32, access_dcsw}, { CRn( 7), CRm(14), Op1( 0), Op2( 2), is32, access_dcsw}, + + /* TLBIALLIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* TLBIMVAIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* TLBIASIDIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* TLBIMVAAIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 3), is32, emulate_tlb_invalidate}, + /* TLBIMVALIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 5), is32, emulate_tlb_invalidate}, + /* TLBIMVAALIS */ + { CRn( 8), CRm( 3), Op1( 0), Op2( 7), is32, emulate_tlb_invalidate}, + /* ITLBIALL */ + { CRn( 8), CRm( 5), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* ITLBIMVA */ + { CRn( 8), CRm( 5), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* ITLBIASID */ + { CRn( 8), CRm( 5), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* DTLBIALL */ + { CRn( 8), CRm( 6), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* DTLBIMVA */ + { CRn( 8), CRm( 6), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* DTLBIASID */ + { CRn( 8), CRm( 6), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* TLBIALL */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 0), is32, emulate_tlb_invalidate}, + /* TLBIMVA */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 1), is32, emulate_tlb_invalidate}, + /* TLBIASID */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 2), is32, emulate_tlb_invalidate}, + /* TLBIMVAA */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 3), is32, emulate_tlb_invalidate}, + /* TLBIMVAL */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 5), is32, emulate_tlb_invalidate}, + /* TLBIMVAAL */ + { CRn( 8), CRm( 7), Op1( 0), Op2( 7), is32, emulate_tlb_invalidate}, + /* * L2CTLR access (guest wants to know #CPUs). */ diff --git a/arch/arm/kvm/hyp/tlb.c b/arch/arm/kvm/hyp/tlb.c index 6d810af2d9fd..d2b86100d1bb 100644 --- a/arch/arm/kvm/hyp/tlb.c +++ b/arch/arm/kvm/hyp/tlb.c @@ -76,3 +76,36 @@ void __hyp_text __kvm_flush_vm_context(void) write_sysreg(0, ICIALLUIS); dsb(ish); } + +static void __hyp_text __switch_to_guest_regime(struct kvm *kvm) +{ + write_sysreg(kvm->arch.vttbr, VTTBR); + isb(); +} + +static void __hyp_text __switch_to_host_regime(void) +{ + write_sysreg(0, VTTBR); +} + +void __hyp_text +__kvm_emulate_tlb_invalidate(struct kvm *kvm, u32 opcode, u64 regval) +{ + kvm = kern_hyp_va(kvm); + + __switch_to_guest_regime(kvm); + + /* + * TLB maintenance operations are broadcast to + * inner-shareable domain when HCR_FB is set (default for + * KVM). + * + * Nuke all Stage 1 TLB entries for the VM. This will kill + * performance but it's always safe to do as we don't leave + * behind any strays in the TLB + */ + write_sysreg(0, TLBIALLIS); + isb(); + + __switch_to_host_regime(); +}