From patchwork Fri Feb 3 07:18:37 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Nicholas Piggin X-Patchwork-Id: 13127093 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 697DEC61DA4 for ; Fri, 3 Feb 2023 07:19:26 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EB8436B007B; Fri, 3 Feb 2023 02:19:25 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id E66B26B007D; Fri, 3 Feb 2023 02:19:25 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D60096B007E; Fri, 3 Feb 2023 02:19:25 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id C50F46B007B for ; Fri, 3 Feb 2023 02:19:25 -0500 (EST) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id E425F1402AA for ; Fri, 3 Feb 2023 07:19:24 +0000 (UTC) X-FDA: 80425129848.30.24655EA Received: from mail-pj1-f44.google.com (mail-pj1-f44.google.com [209.85.216.44]) by imf13.hostedemail.com (Postfix) with ESMTP id 25F1D2000C for ; Fri, 3 Feb 2023 07:19:22 +0000 (UTC) Authentication-Results: imf13.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=h7nAnXYf; spf=pass (imf13.hostedemail.com: domain of npiggin@gmail.com designates 209.85.216.44 as permitted sender) smtp.mailfrom=npiggin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1675408763; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=x14kRrZZe2kdSbgJ1PJqUMQQfgWflSMZWL5LFkwvByE=; b=NMDMLkMsAB8XnHvoj2nH/iMXZPvVn7StzqxTjV3QglHtLlJJZIf+TrySuSF6Rx4F/n/IAi w8OIvuoHXmskPRrgBiLswQVT5YWvFZMTi0pIxyz027ANUc/HqOLzHmOPF3pAeZfzVYUkjQ vFVBNlv3WE0VxBO+rz0y2NCSEU4NmN0= ARC-Authentication-Results: i=1; imf13.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=h7nAnXYf; spf=pass (imf13.hostedemail.com: domain of npiggin@gmail.com designates 209.85.216.44 as permitted sender) smtp.mailfrom=npiggin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1675408763; a=rsa-sha256; cv=none; b=aUOTYvyTMR7zMKhcOIZ+b5Jg81abe37PrLtS01rZJmRAtSTMHoQHihdu8kv7vVEdlkxrOH 99KR2tQFhxR/38DkBqg6H3PUgzehqpX9Ll9u38aCF7j56NMQ3s1cdvxs6DhuiZRdvUnCKG QvB+VPpojv6R70sQl3d21afYZ4OXtas= Received: by mail-pj1-f44.google.com with SMTP id m11so4239233pji.0 for ; Thu, 02 Feb 2023 23:19:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=x14kRrZZe2kdSbgJ1PJqUMQQfgWflSMZWL5LFkwvByE=; b=h7nAnXYffJkXAeKtJ4+Pb47ZmdkwzoIxpzRgCBuRqFSEuDy+TP7MF7IO/iVxeE9h3P aG7Esd2gb18pAjYT42bsVp7oBg2AItWYJWILKrT1Rv1wljyPlzKVe3HEajToWCRcZVtL zy4qIqHGZ3aoBW3DgCSA/Vp7o+H66URuFiIddPmq0wydnig1tvUkwDog28Na9VCQmXCY VaSnJ2jOszZ6JD6S3Lt/kqQ/A4667tSOoYJbLAZ3Dg/8Mt+fnJ7poqcB8fdgDCdZgr9h DFZ/UDXahTH+Bf05/C7Y+Y3gm5kj6MbI54iJLvql0E7GMYErZm9nVGNUKj5tyaG4S5jq 3YEA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=x14kRrZZe2kdSbgJ1PJqUMQQfgWflSMZWL5LFkwvByE=; b=dIUqEOnJIK+WXSMIG6h+h+vZ78VliBly5D6UaZ7p5D7clMXKmC59Arj2Fib11w6Jey fsA0ormqQV1t4AseS+8HQ9k8wuweGCyuNCfq26wyEN7PcAxArmEMVeDuHLMZ4PvO5yD/ NjTMb1YYgVOLvxtxhSfU91Njx8xFYxLU4AikOG0G1zvYhmS/ErHW8LWNJYy33yWZpJZ2 E6v84gKCRUEHS5Hh1iiPNsMhNqYV5XMO693dAzmhNX3qVrADjdGkwZtB3lyJXFuiJJRm fKTIT4NnpIw1FRbvkFlllA0iQClnEnkqASHWeyaaeTfTsSRNl1M/ZKUPPRNQ3zAqZJFF oFbg== X-Gm-Message-State: AO0yUKUlkR5p38KLjcCRiKn8/rP+L2Iq37lfG85E/fvpOYpi5jbqQ+ax MewvdJDxReJLPHO9TA3yS4J70CNzgGE= X-Google-Smtp-Source: AK7set/pN1qkE5vW6sEUJPLmtT3NU/AerHL7q01jFwtmVHRhEkUBx1PKvOIigiSi96c+JcvQpUaLgA== X-Received: by 2002:a17:90a:11:b0:22c:8dfe:d6a6 with SMTP id 17-20020a17090a001100b0022c8dfed6a6mr9294792pja.4.1675408762194; Thu, 02 Feb 2023 23:19:22 -0800 (PST) Received: from bobo.ibm.com (193-116-117-77.tpgi.com.au. [193.116.117.77]) by smtp.gmail.com with ESMTPSA id f20-20020a637554000000b004df4ba1ebfesm877558pgn.66.2023.02.02.23.19.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 02 Feb 2023 23:19:21 -0800 (PST) From: Nicholas Piggin To: Andrew Morton Cc: Nicholas Piggin , Linus Torvalds , Nadav Amit , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Catalin Marinas , Will Deacon , Rik van Riel , linux-arch@vger.kernel.org, linux-mm@kvack.org, linuxppc-dev@lists.ozlabs.org Subject: [PATCH v7 5/5] powerpc/64s: enable MMU_LAZY_TLB_SHOOTDOWN Date: Fri, 3 Feb 2023 17:18:37 +1000 Message-Id: <20230203071837.1136453-6-npiggin@gmail.com> X-Mailer: git-send-email 2.37.2 In-Reply-To: <20230203071837.1136453-1-npiggin@gmail.com> References: <20230203071837.1136453-1-npiggin@gmail.com> MIME-Version: 1.0 X-Rspam-User: X-Rspamd-Server: rspam03 X-Stat-Signature: hhk3j18rua548arwxytk1dyag41b7btp X-Rspamd-Queue-Id: 25F1D2000C X-HE-Tag: 1675408762-727050 X-HE-Meta: U2FsdGVkX19LGLx7uK0GfimiFdM2OeptKrviT9ryXa16SA4ntBlwXnvHhtltCCfKVi5GKJ8+okUhnxJ5JpkVXviSswHuRXSBjJd+XSdQ9SNzmakDk3qBsOrK4FK0nA1tV59g9PAClhKTpeOd1HfkQRz3sTJOVpG/9aGule7bfudCdYVLVsSuhpaMBLbiXM+FdbNcD3ldVgBSW5hQNIMD0NV0CE41AxsTmXCyjhzjFYxB/lXL8cvMQVDnqEFDnCheKXjzZkbHhQsSMoVX/MjgWetDnq8kpqq6HlD/RM3zavsAXPEo0uohHDtT2sC6dgRQ+ciFsRxEuUzpLOPi3fCvksZ1+BraxCf15miBPS3MFMLMur1PZ3gfE/BgV2G81WJvDONAh7P1zWtKBQY3v7s61twblHGtkZAoE7KGwWY1T7X4UlZBeCGoCzmbaohr6oI6aRI8jY+XJJhBa+qm5nh6F1kvXRVdoRxN/coA7bUImi5CqvOpDphDYQ6/KZLP/tPNvwUUToRxuOHmbPFSrK4A6ILRq4M++UxjwuXmNr4RWdeln1Il7ZhYSybF1XE+pF1PnIoccPyyWq7zmH1TIdnyuir+4rqYpfHvz1fjSYLPrnJyrQ0OcwtLw1kZvT61ES1X3qv7YLrpYIJNVa0w/i24bhRxc/Z22iE/OLWSfVAvm1fgGAjyMaebuXJGSlOLhr17JbG+WtdYBtTYBdCUS6XFEZwBHbL3Fj2xu0ARLsRnMaVMm8fw7ks/JfJtDP5VykyBQL9N8Qz9i4ycy8dYyDPrX+NQJUq246Wr7rJ3HdEDhZayl3504dAqbgqEI/diu4LUNW3FvW+13AiovY5v1qiay36AKUzXObNw5cyotM9I0sqGjYu3kzK4JIH78iBJCts5ZctgHh29Ze0hdkE8DtJoDBwGR/9MUKzgSP6JZs7hSfhU83xogtC3g0K8nwCenweNMhD8Pa12WIGTzJTOR9a /WaO+a5K 14iwq5gav8jamU2pRMkaQGG3bITc82jSPOZH2/WjdbUDnkjYLeays0BLeweC3jib+59SrG3MW1RmBn0nUf8rZIQrYY3Tza1GISsZjXaLqwp4sYlgb8Vmr2YF0nrmCbD+UlXsDUpQGkI4r5KCGDk+3unSh8+qwVKtjBqarEYbz3PN1nDyZYQJdfOcKNXj/1Cz6ONKB/8cOCuJpgz7X0gfGjdGClHkQwLZFQkfzHrwdqQxZP/BS6kNHtmvsdx6WqQG6vpJZ4yj2p6B6ti3LA3uag9GJYMovxGt29tGB8W+Myave3Uqlk4WR6vXvMajvVaXc9mobaaLs/euTWJErpWVlHxKsQF6BoK2Z5LRc/uOZ/HCqZJ+dQgPMDO0UPaozUQ5rcpQaEf34H6lJPCxL86c9Cq3R16dRu2cts5aQHO129QMrn/SYIAZvo0+9mYz8SbBC/zdHVP1C3MJAvcK1/XHj6+cCSNPodv78HzGaAwgTjO9CtkKhXnKiEut3sdvWiYfIHe4x7jnzyq9P7VDQXiaE9/87hOrAPhBRCNP2Kx1a6Hrgayfk79Y1RoFwbHQZJ/YFjjYKnqEQzn++J+7ykyDRQ1cUXg+da68+vPtJ X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On a 16-socket 192-core POWER8 system, the context_switch1_threads benchmark from will-it-scale (see earlier changelog), upstream can achieve a rate of about 1 million context switches per second, due to contention on the mm refcount. 64s meets the prerequisites for CONFIG_MMU_LAZY_TLB_SHOOTDOWN, so enable the option. This increases the above benchmark to 118 million context switches per second. This generates 314 additional IPI interrupts on a 144 CPU system doing a kernel compile, which is in the noise in terms of kernel cycles. Acked-by: Linus Torvalds Signed-off-by: Nicholas Piggin --- arch/powerpc/Kconfig | 1 + 1 file changed, 1 insertion(+) diff --git a/arch/powerpc/Kconfig b/arch/powerpc/Kconfig index b8c4ac56bddc..600ace5a7f1a 100644 --- a/arch/powerpc/Kconfig +++ b/arch/powerpc/Kconfig @@ -265,6 +265,7 @@ config PPC select MMU_GATHER_PAGE_SIZE select MMU_GATHER_RCU_TABLE_FREE select MMU_GATHER_MERGE_VMAS + select MMU_LAZY_TLB_SHOOTDOWN if PPC_BOOK3S_64 select MODULES_USE_ELF_RELA select NEED_DMA_MAP_STATE if PPC64 || NOT_COHERENT_CACHE select NEED_PER_CPU_EMBED_FIRST_CHUNK if PPC64