From patchwork Sat Jul 14 17:05:39 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Christoffer Dall X-Patchwork-Id: 10524781 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id C8CA0601C2 for ; Sat, 14 Jul 2018 17:06:28 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id B271828A0D for ; Sat, 14 Jul 2018 17:06:28 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id A4E8828A39; Sat, 14 Jul 2018 17:06:28 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID, MAILING_LIST_MULTI, RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 193A528A0D for ; Sat, 14 Jul 2018 17:06:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729637AbeGNR0E (ORCPT ); Sat, 14 Jul 2018 13:26:04 -0400 Received: from mail-vi1eur04hn0207.outbound.protection.outlook.com ([104.47.14.207]:15817 "EHLO EUR04-VI1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1729849AbeGNR0E (ORCPT ); Sat, 14 Jul 2018 13:26:04 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector1-arm-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=k6cRyG/eGtQnF0mX6xxc9aExjPRhB86I/A926uNs62o=; b=Zzn1GR18dyPKeZPZ/SKu+Zxaipk19iYk0uSV0FBGEe+iKVyiT7UhTdgCK+CASI6oxn1IWDCwP0Myrc6U+JjeNmRgU1n54HuLhjgfAxHGWClN0mNDih31XlGOeQP2rZEPFWJ2kiFrt8ztkPOdGX00OgZe8hTcUbSFoDRyAkH1kM0= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Christoffer.Dall@arm.com; Received: from localhost (217.140.96.140) by AM5PR0801MB2034.eurprd08.prod.outlook.com (2603:10a6:203:4c::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.952.17; Sat, 14 Jul 2018 17:06:20 +0000 From: Christoffer Dall To: kvmarm@lists.cs.columbia.edu, linux-arm-kernel@lists.infradead.org Cc: kvm@vger.kernel.org, Marc Zyngier , Eric Auger , Andre Przywara , Peter Maydell , Christoffer Dall Subject: [PATCH v3 8/9] KVM: arm/arm64: vgic: Let userspace opt-in to writable v2 IGROUPR Date: Sat, 14 Jul 2018 19:05:39 +0200 Message-Id: <1531587940-2490-9-git-send-email-christoffer.dall@arm.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1531587940-2490-1-git-send-email-christoffer.dall@arm.com> References: <1531587940-2490-1-git-send-email-christoffer.dall@arm.com> MIME-Version: 1.0 X-Originating-IP: [217.140.96.140] X-ClientProxiedBy: CWLP265CA0209.GBRP265.PROD.OUTLOOK.COM (2603:10a6:401:4e::29) To AM5PR0801MB2034.eurprd08.prod.outlook.com (2603:10a6:203:4c::8) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: d2055a1b-506f-4292-0f93-08d5e9ac1ec5 X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989117)(48565401081)(5600053)(711020)(4534165)(4627221)(201703031133081)(201702281549075)(8990107)(2017052603328)(7153060)(7193020); SRVR:AM5PR0801MB2034; X-Microsoft-Exchange-Diagnostics: 1; AM5PR0801MB2034; 3:j9/ir9Ee0gT+4qPauxXY5Wp36XGudpunGPHCP+s7GJQJAwVIo+ZqVpZSkACNpl+YEjDzzRfjwqW1K/RjsECY2n1/uPEkMiC6rxGmysUYmMpoibFhLxb/j6KsKaiMwmxcqo0co/cpQFnJdS5/5x4TfxFEv51Z+bIC823CsQk+X2yn5R3C7GcpQC9lN0G5/F8H0SfoxwjrEg4f7+pNqWc7l7FaHbgsJnF5eDDr6+TpyAnSj0H3WWJSaso4Muxf3eS5; 25:F5SX6lp7CF4dkfIhzDmbrKmC2n8g3t5kEbSBugutKNcbWPPoA6ErWbFVlUFjxokVoi0EMuVzGzKnFOaX6ccHVnPL00KPt+xz+uibHqVg9XeKAOOxSlCbBJHR5C3spVz7h11U4huWN5bAvWCo1dcFEOFrdF9ScdYJb5vX7ewguQNRV38ukastuFacLE3CBZquqkv581fck5rU95HKEuUpts3JGWd6eIfBTLCrmdXd/o/Guu3S8uO+Pm2+xIt9W+YMxbYLKN6qCTrcT0vfRRt/MSd3hCtWrK1YOtDlSWG2pYygva3YS9PvoVEnBjUjK6HkjQiiv2dDdFaAt9bzKs2Vew==; 31:xTWxxYJSUtQr6ATUkwgjdJCAhpTxwzTzLTAvE1DF5ornThT6zckS/CNJeJK7tvVDySuqUr9ZeCaehVfOQjUJPB6FghBrogxkYJPJVn9rF050MGasyixgCr7lEfQ0VaxphMXLbghYSd5ebNXE6T1ioSXRxR66npV4j5lVv50TgQDCWkn5QcI5lJJ2cl85Ve6QP9J1cLYeW5YoVmB3h7mFvtw6PfATLuNcfUV8+ZkmILo= X-MS-TrafficTypeDiagnostic: AM5PR0801MB2034: X-Microsoft-Exchange-Diagnostics: 1; AM5PR0801MB2034; 20:evVRmdLO1Oj/PjQzrcvxtVYdARlpeTNL86ZlZg9p+lcwXoY+lC5vIDo+eyzIpM3250SmGeQ71GAWZN3EqSaN1pdLVueX3zOJs2yEEMwu44d1pEk5lq0hs4aAo7yTcsqHzclX4R0M54XqtjNgLqnppXgvB7uqMAUsY5Q+9s/7rzxxD7MkgPLzdI1Z/1TKzfy9v4OoHSG5CciJAr0OVQnkR0BLvs3Jxl7+VX+1zZqLx9u999jvW+ZbouF7jXnFQYtKEFqMBFVJqG/lj77vO6T5kXQt7HuP7M9dfN30I6a8p/O39M6i1euagG/HmBGKRdWuU1p9zgFekWACSkSSvFuGvnRAGi772vs66K4UArIdXDtjhwM9IB455UhZbzKoSNSOrCfxiYiUA2VWFy0LXCgy5X83+w3V1EcuO6LksLW46I0JkWvEiLsVlWRxpjd+BVmfImWYD5E1j9wejMOVde7Rk/Tf93i7248lU1E6Yl4t7B/Xi38Z59Fkmmot4mrQXrKn; 4:5QECuMXF/f1P9oqhCo+iFlyEcHyhKuLl1wMNagUXoejs/q4yTt67cyz0QVs6pGodSJrKsnXHvoK/g5WpL/V4h4FpKNxjVpZkLjGZKpHrkijnrv+x8xblT3utQk+ZKoK9rHwHuAnJ9PX0vlwd9+2c3WGn62hTVAv2fZ1GZYYG5gb+pdxonBGgKr0BSmNzh3ce8CSriqFiQNyZR2xIOH30NuELwyl/ilF6sr/mYIqbyIKju/M1pHa9rDHHcmB33aO9ut9PFpajy8AWNvlMP6206vP8Z5fnXK1QHuzKScqXQzVZ2/gV9QrHWkjwOqMFzSEr4q5+5KNCTSUht+1+WbbQFMLX0D4hpLy2qnyexwBR52lJpFqNvbOk7LX4TcrdqfnRYfgibtinUruRddWwiFi2wd5HUkwtsabm/1sS D4P4UZ4= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(190756311086443)(180628864354917)(223705240517415)(211171220733660); X-MS-Exchange-SenderADCheck: 1 X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(10201501046)(3002001)(3231311)(944501410)(52105095)(93006095)(93001095)(6055026)(149027)(150027)(6041310)(20161123564045)(20161123558120)(20161123562045)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011)(7699016); SRVR:AM5PR0801MB2034; BCL:0; PCL:0; RULEID:; SRVR:AM5PR0801MB2034; X-Forefront-PRVS: 07334CBCCD X-Forefront-Antispam-Report: SFV:SPM; SFS:(10009020)(6069001)(396003)(346002)(39850400004)(136003)(366004)(376002)(199004)(189003)(40434004)(25786009)(50226002)(81156014)(8676002)(8746002)(53936002)(8936002)(5660300001)(81166006)(4326008)(2171002)(76506005)(316002)(97736004)(54906003)(14444005)(5024004)(106356001)(105586002)(72206003)(68736007)(47776003)(478600001)(66066001)(6486002)(51416003)(386003)(16526019)(6496006)(186003)(26005)(6666003)(76176011)(86362001)(575784001)(305945005)(7736002)(52116002)(48376002)(50466002)(36756003)(956004)(11346002)(446003)(486006)(44832011)(476003)(2616005)(6116002)(3846002)(2906002)(23200700001); DIR:OUT; SFP:1501; SCL:5; SRVR:AM5PR0801MB2034; H:localhost; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; Received-SPF: None (protection.outlook.com: arm.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; AM5PR0801MB2034; 23:cCmvUVroiAhl1sPNeQ/ruv6khcrNbO8QakhVGWW?= =?us-ascii?Q?Jto+z0GUPo+Tl+wFP7nFfhVkyi6Nkppi464q0eCmZrGJp6y4LAUAr2IRnJur?= =?us-ascii?Q?dMXIJwZ4BLD9mfIRLH/X9wxHTpZQdW3wlzuPvXx6PxRcUOkwIiUs/YZ/yPjR?= =?us-ascii?Q?yUBfbnNrYvrTxGxskWewaOpK9CN4IZn2WOrzLzy5zZZPgg1cShq1ExU0LESV?= =?us-ascii?Q?xqwRJx8s9cPt/JJ25bR84fJBsyG6inqgTMGmH5XJCGVjA5FFUfNM0i7NbNUj?= =?us-ascii?Q?yeT4uCDRxLUB0bL4pDBrRCHLXYuKVirfz6bTLfS5y5Zb0fudb3vFkkPeEpgi?= =?us-ascii?Q?Wd1p1YIrV5ZlDbhJ0aozYAOk6kMd32u09N+U3O/P+u7MfrmncIcrWGugBSlo?= =?us-ascii?Q?VHqj2UDmtEZuf0FOg0kFy3NElHa1MlQ+OoQ8wV8R49fRGlFuxOLZlXYO2j99?= =?us-ascii?Q?XOi2Ejy1DlVC5tVVHzUWZQ+H8pTwDLJ3B069CBxMb60+UIQSmEEd/IYVZ+u0?= =?us-ascii?Q?+Kv3O04eUActAqG1qNXx0vSBxs+QcRw3B/sEryjjTqY93ujZ7LLrREQGtpTv?= =?us-ascii?Q?TjyMIbVj3yELAKBLVNadTsLL2u/j/R5tm95cyRAjZxKG1g+ngr9+apXltj5B?= =?us-ascii?Q?7DC2dG/9/W2nMuVp/gVjlT3eGZoWY0OZtmACjl5JhzH6D3LPGfo2KXKNMIvZ?= =?us-ascii?Q?MBgCOMWTczvx/jPknAaBuvxfn5gcBSmbaY0ethPr4sb3i1+rJx0wPm5bCHyI?= =?us-ascii?Q?zlaZQMw8DMD6/l5n51Zw5/XanbT6NmXW90+5NvQTefsPWpSUceG3p07lBKL0?= =?us-ascii?Q?SCaJR3V2GRHN8OIvPS7MHmQta/hNp1AYaa33oe1zWo+mzGMKqTpuAUG4o8PG?= =?us-ascii?Q?0ZxqiVIj1VR2KvSFQQHt1+HFrXJL8zfMUKq3/AOORjyvkbupGn0jHTJA2PTK?= =?us-ascii?Q?NlWB89m82sxwwVu9cvWbraMVOAgD0y26fxEZiOP0R2zl07yUoS4CONjoqdIr?= =?us-ascii?Q?kmfgVlGWdF6PsqqV1DRJvxbYLTIfpU9ogYwyYNRqcnBLBFY04WUfUNAFSN38?= =?us-ascii?Q?NspC48RBvjEpt2ugeWhkMHjfXo2JH9PhlvWVao8ndY1KN13Mjk2ENocZ/Av1?= =?us-ascii?Q?mrO0IYB2bsr9i19Vn+gcDzlgqzEl/w9vNywKU9hvb7LtzjYdXSoWXhSiKvfk?= =?us-ascii?Q?hWE69XkT9iBkW5+QZww4iLnRqBStFGqX5lC/A/LMjt1x2VBVlqrqtZBdqerT?= =?us-ascii?Q?ftA5w7CMI2uQhVq9SbiUFrmDjy6HAKVtr9pjCFlyMIpMXnf1tHs7hxD078uP?= =?us-ascii?Q?+IYXHy5onDKeVqJtEobqs7mpsqyvSvPCOlQGuBlHh95uE34oCes7kzomF5qO?= =?us-ascii?Q?vJ6fFfJYINPYGBBhi0fVFEMuSfLl2aRznV8SZCx/Tw6D8VLPm?= X-Microsoft-Antispam-Message-Info: ozaKyy8areRd5RCJp2ge6+PQ7K24mPIU94vF5DDh38U8EvrREeYK2YMzqbjoHPKF1UB+z0D/IlFvPABF5f8zhq1ycVCleEXVwRTqBa+Ju80QHZxQOULxcK2kybLFiOTXw1QHVX5BSRbfEfOaOhXCH9tpEfeM517LJnUWhdoeL4416c9o8iIb4SpM8sniIdvJIUGAakuEy13elbYo0huAqF79fdycAYuuLTiokN6XeLr0ILZByJA8qGFBvDrNkuygBq4psxc40xNN3++QIdHtwDEaHRjTsZbB21JXrzOr4TFUNp0RhUO4X9tBxUJhLEFHkE8xf5ACBo+5/og30zs32LoqHIJER9UZzZiDmd3REhcbgJdYfHWeY1Zu2dy9VXhpEXiy8bksbF4rdhc/DR3TDP2PhAyEBwcDUPNBs+Zv/9qGt3S6eBZLDZ4wnb48aqkIyLZGTBHMuRaH4o5+dSTt42GPNfrpncClljJceD9ZNIxD2Sh1Z9UCTI+1grr4xRDzUeNEOgNqnZwWsRF/MkZzgQaU+oFR5bVnDA9JkAFgn07INvjIOvKJG4vmfOWjoeaUoCPlMClfEVtY/YzyyudCQw== X-Microsoft-Exchange-Diagnostics: 1; AM5PR0801MB2034; 6:ZVOIRXrzOI+UpstlyJTL8YnIQLettiWTxPzEmSovoaam6LprcB82nmxV8LkPFYmIKPR9EVp0TE+vSI/nHANYndHTLnI/0ggEq+qd8sfxRqVB8xyzTbAB80gOngxVDjTSTowPxIL9v8ZIzdP3LbaXuXF4tpjFSGe1DqbpYK2FWrR8pNm+6Yx18Lc4svPlzLLOir9Ce+q8B5zX6czYCWY6J/z922EvsQ+VR0E4dgny4zsSuRfIb6tCbcve+OQsTYkXRgIhq0EUKbTwKwwQSn2jfd9BO2hdzr1JIjVURd2LlAiDs1c5xLt6XyG4oSpouPXm2Lb137VX61S2Xf1e2uXLlXcMhNsTaG6W5EY1LZTRd9TMdnl10kERboeDNPFX0AnBy4CFZkxoW+m5kwVtIluw44PJt43m8z0r3n74UgqrxwmnUUC8hZyKILY53tKDvLXmT0JnvkBMvkVvc/qox4l+udg1T1lQUHGvQYVu/vuCDc6pmjWvu6Igg9X4g3bXLHyb; 5:OGcK5j4csvjeQLPm/StqZTsl6pv2RpECgSIxnWHgoDwQSdinWQTmsSUcDoL6Pl0IxsqUzZsNdHomdL4AArMEXtaUpxBwmKQem0YLSvW6fcQgalY/YrqAPK6cGl2eOyQVE78kLRwi5wwBpJh5ThoncM4r4sOjUxdHvnwQdMjGHF0=; 24:uucb2Yq5P3OpVVuwINbS5WeQjB7Eo1IJc7R7NqTJvxrP3pQSEB+QZtO/bkYIQLpl2dnHFbS7qIJgmLJML1MgrQ== SpamDiagnosticOutput: 1:22 X-Microsoft-Exchange-Diagnostics: 1; AM5PR0801MB2034; 7:NmTvWGPZMMtPuwEdpGBrewO81nGiGsiC6GaXnX29b+l7c9hPGZBgt+xIEzO3OB7+c7CHGEMiAFhURFylvQOVJaUWpmj1qbcPbAfrY1ILP2wYOBXEKyYXzlDxCJinu0xmdKzmDYtHiPE/3gG5/g9PAjAamjr1/jDeKHrKw69mdx3eJF+qEkxONiO2Z2vZK8ui31KXUrE02Ict8YKbW0WToQo38KjVgcvT1WERc4igFMJweuiEBL7yq57imZL+e9Tn X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Jul 2018 17:06:20.0809 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: d2055a1b-506f-4292-0f93-08d5e9ac1ec5 X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0801MB2034 Sender: kvm-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Simply letting IGROUPR be writable from userspace would break migration from old kernels to newer kernels, because old kernels incorrectly report interrupt groups as group 1. This would not be a big problem if userspace wrote GICD_IIDR as read from the kernel, because we could detect the incompatibility and return an error to userspace. Unfortunately, this is not the case with current userspace implementations and simply letting IGROUPR be writable from userspace for an emulated GICv2 silently breaks migration and causes the destination VM to no longer run after migration. We now encourage userspace to write the read and expected value of GICD_IIDR as the first part of a GIC register restore, and if we observe a write to GICD_IIDR we know that userspace has been updated and has had a chance to cope with older kernels (VGICv2 IIDR.Revision == 0) incorrectly reporting interrupts as group 1, and therefore we now allow groups to be user writable. Signed-off-by: Christoffer Dall --- include/kvm/arm_vgic.h | 3 +++ virt/kvm/arm/vgic/vgic-mmio-v2.c | 15 ++++++++++++++- 2 files changed, 17 insertions(+), 1 deletion(-) -- 2.7.4 IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. diff --git a/include/kvm/arm_vgic.h b/include/kvm/arm_vgic.h index c661d0e..c134790 100644 --- a/include/kvm/arm_vgic.h +++ b/include/kvm/arm_vgic.h @@ -221,6 +221,9 @@ struct vgic_dist { /* Implementation revision as reported in the GICD_IIDR */ u32 implementation_rev; + /* Userspace can write to GICv2 IGROUPR */ + bool v2_groups_user_writable; + /* Do injected MSIs require an additional device ID? */ bool msis_require_devid; diff --git a/virt/kvm/arm/vgic/vgic-mmio-v2.c b/virt/kvm/arm/vgic/vgic-mmio-v2.c index b79de42..9b6b758 100644 --- a/virt/kvm/arm/vgic/vgic-mmio-v2.c +++ b/virt/kvm/arm/vgic/vgic-mmio-v2.c @@ -85,6 +85,17 @@ static int vgic_mmio_uaccess_write_v2_misc(struct kvm_vcpu *vcpu, case GIC_DIST_IIDR: if (val != vgic_mmio_read_v2_misc(vcpu, addr, len)) return -EINVAL; + + /* + * If we observe a write to GICD_IIDR we know that userspace + * has been updated and has had a chance to cope with older + * kernels (VGICv2 IIDR.Revision == 0) incorrectly reporting + * interrupts as group 1, and therefore we now allow gruops to + * be user writable. Doing this by default would break + * migration from old kernels to new kernels with legacy + * userspace. + */ + vcpu->kvm->arch.vgic.v2_groups_user_writable = true; } vgic_mmio_write_v2_misc(vcpu, addr, len, val); @@ -95,7 +106,9 @@ static int vgic_mmio_uaccess_write_v2_group(struct kvm_vcpu *vcpu, gpa_t addr, unsigned int len, unsigned long val) { - /* Ignore writes from userspace */ + if (vcpu->kvm->arch.vgic.v2_groups_user_writable) + vgic_mmio_write_group(vcpu, addr, len, val); + return 0; }