From patchwork Wed Jan 6 00:22:58 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: David Woodhouse X-Patchwork-Id: 12000613 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E0CCCC433E0 for ; Wed, 6 Jan 2021 00:25:19 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id ADC1B22D74 for ; Wed, 6 Jan 2021 00:25:19 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726677AbhAFAZS (ORCPT ); Tue, 5 Jan 2021 19:25:18 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37464 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726328AbhAFAZS (ORCPT ); Tue, 5 Jan 2021 19:25:18 -0500 Received: from casper.infradead.org (casper.infradead.org [IPv6:2001:8b0:10b:1236::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 0E7DDC061793 for ; Tue, 5 Jan 2021 16:24:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:MIME-Version:Message-Id:Date:Subject:Cc:To:From:Reply-To: Content-ID:Content-Description:In-Reply-To:References; bh=lUen2KjqNOUACjCPDLFaUqf5FgyBXKrzDGaKMoO5pmc=; b=VabqpZ0ruiaudFJShhhwk1GTKU Dh/VPUyT5mlIJz9hQbREN09xitjt2fKL8eAGQzQXEGCgqJuz4RpdUD7L/lzOn5job2YDYGnxWkcB7 kn8Sgq0Q7EGh4R64zALZF58ZJtOpfujScDHE2Bme03L0b0u0VLHTSniGHTFx9Iv4YNPVcW/OMnfvu qF8871U45c3CzIG8TyHPX8roAAtCfvvoaVV0fBdgGkEd6jGQytJHYjcNG7MMPoricC6pjnXt/fAv7 XCZgP1bukeko4r5+BCxjEsRK38HE6QA5W6IP50WGkbSQysE6n81LLfd2yz48/mbxWBsK8QeUMdvxc wMPoyEVw==; Received: from i7.infradead.org ([2001:8b0:10b:1:21e:67ff:fecb:7a92]) by casper.infradead.org with esmtpsa (Exim 4.94 #2 (Red Hat Linux)) id 1kwwbh-001pA3-L9; Wed, 06 Jan 2021 00:23:36 +0000 Received: from dwoodhou by i7.infradead.org with local (Exim 4.94 #2 (Red Hat Linux)) id 1kwwbh-001Nil-8o; Wed, 06 Jan 2021 00:23:21 +0000 From: David Woodhouse To: kvm@vger.kernel.org Cc: Paolo Bonzini , Ankur Arora , Joao Martins , Boris Ostrovsky , Sean Christopherson , graf@amazon.com, iaslan@amazon.de, pdurrant@amazon.com, aagch@amazon.com, fandree@amazon.com, hch@infradead.org Subject: [PATCH v4 00/16] KVM: Add minimal support for Xen HVM guests Date: Wed, 6 Jan 2021 00:22:58 +0000 Message-Id: <20210106002314.328380-1-dwmw2@infradead.org> X-Mailer: git-send-email 2.29.2 MIME-Version: 1.0 Sender: David Woodhouse X-SRS-Rewrite: SMTP reverse-path rewritten from by casper.infradead.org. See http://www.infradead.org/rpr.html Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org This patch set provides enough kernel support to allow hosting Xen HVM guests in KVM. It allows hypercalls to be trapped to userspace for handling, uses the existing KVM functions for writing system clock and pvclock information to Xen shared pages, and adds Xen runstate info and event channel upcall vector delivery. It's based on the first section of a patch set that Joao posted as RFC last year^W^W in 2019: https://lore.kernel.org/kvm/20190220201609.28290-1-joao.m.martins@oracle.com/ I've updated and reworked the original a bit, including (in my v1): • Support for 32-bit guests • 64-bit second support in wallclock • Time counters for runnable/blocked states in runstate support • Self-tests • Fixed Viridian coexistence • No new KVM_CAP_XEN_xxx, just more bits returned by KVM_CAP_XEN_HVM v2: • Remember the RCU read-critical sections on using the shared info pages • Fix 32-bit build of compat structures (which we use there too) • Use RUNSTATE_blocked as initial state not RUNSTATE_runnable • Include documentation, add cosmetic KVM_XEN_HVM_CONFIG_HYPERCALL_MSR v3: • Stop mapping the shared pages; use kvm_guest_write_cached() instead. • Use kvm_setup_pvclock_page() for Xen pvclock writes too. • Fix CPU numbering confusion and update documentation accordingly. • Support HVMIRQ_callback_vector delivery based on evtchn_upcall_pending. v4: • Rebase on top of the KVM changes merged into 5.11-rc1. • Drop the kvm_{un,}map_gfn() cleanup as it isn't used since v2 anyway. • Trivial cosmetic cleanup (superfluous parens, remove declaration of a function removed in v3, etc.) With the addition in v3 of the callback vector support, we can now successfully boot Linux guests. Other callback types can be handled entirely from userspace, but the vector injection needs kernel support because it doesn't quite work to inject it as ExtINT. We will work on a little bit more event channel offload in future patches, as discussed, but those are purely optimisations. There's a bunch of work for us to do in userspace before those get to the top of our list, and this patch set should be functionally complete as it is. We're working on pushing out rust-vmm support to make use of this, and Joao's qemu patches from last year should still also work with minor tweaks where I've "improved" the KVM←→userspace ABI. David Woodhouse (7): KVM: x86/xen: Fix coexistence of Xen and Hyper-V hypercalls KVM: x86/xen: latch long_mode when hypercall page is set up KVM: x86/xen: add definitions of compat_shared_info, compat_vcpu_info xen: add wc_sec_hi to struct shared_info KVM: x86: declare Xen HVM shared info capability and add test case KVM: Add documentation for Xen hypercall and shared_info updates KVM: x86/xen: Add event channel interrupt vector upcall Joao Martins (9): KVM: x86/xen: fix Xen hypercall page msr handling KVM: x86/xen: intercept xen hypercalls if enabled KVM: x86/xen: add KVM_XEN_HVM_SET_ATTR/KVM_XEN_HVM_GET_ATTR KVM: x86/xen: register shared_info page KVM: x86/xen: update wallclock region KVM: x86/xen: register vcpu info KVM: x86/xen: setup pvclock updates KVM: x86/xen: register vcpu time info region KVM: x86/xen: register runstate info Documentation/virt/kvm/api.rst | 124 +++++- arch/x86/include/asm/kvm_host.h | 24 + arch/x86/include/asm/xen/interface.h | 3 + arch/x86/kvm/Makefile | 2 +- arch/x86/kvm/hyperv.c | 40 +- arch/x86/kvm/irq.c | 7 + arch/x86/kvm/trace.h | 36 ++ arch/x86/kvm/x86.c | 134 ++++-- arch/x86/kvm/x86.h | 1 + arch/x86/kvm/xen.c | 495 +++++++++++++++++++++ arch/x86/kvm/xen.h | 68 +++ include/linux/kvm_host.h | 30 +- include/uapi/linux/kvm.h | 50 +++ include/xen/interface/xen.h | 4 +- tools/testing/selftests/kvm/Makefile | 3 + tools/testing/selftests/kvm/lib/kvm_util.c | 1 + .../testing/selftests/kvm/x86_64/xen_shinfo_test.c | 194 ++++++++ .../testing/selftests/kvm/x86_64/xen_vmcall_test.c | 150 +++++++ 18 files changed, 1288 insertions(+), 78 deletions(-)