From patchwork Mon Dec 4 10:20:25 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ryan Roberts X-Patchwork-Id: 13478092 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 73F61C4167B for ; Mon, 4 Dec 2023 10:21:19 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0D8156B028E; Mon, 4 Dec 2023 05:21:19 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id F2B2A6B028F; Mon, 4 Dec 2023 05:21:18 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D5A666B0290; Mon, 4 Dec 2023 05:21:18 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id B85DE6B028E for ; Mon, 4 Dec 2023 05:21:18 -0500 (EST) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id 99B0D160177 for ; Mon, 4 Dec 2023 10:21:18 +0000 (UTC) X-FDA: 81528743436.11.BB7CB9E Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by imf04.hostedemail.com (Postfix) with ESMTP id E1FD440002 for ; Mon, 4 Dec 2023 10:21:16 +0000 (UTC) Authentication-Results: imf04.hostedemail.com; dkim=none; spf=pass (imf04.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com; dmarc=pass (policy=none) header.from=arm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1701685277; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ArE55voEAAirb827JHk6rROdwqF1broiASM2equObb4=; b=v2ci2FtIhQPA/DiAIdvB2yE6e+dOO+GBurfRhPJtO5wAJN6BvKUcXJ8pVWKgYJZK22Isj4 KrxY3NPx1cJcy1xASCV3lAEiyjR6Fxm3lM+Ec7FN4SLaPbdCjFi6kBs26/XXv1U0yGqLFH mMmSzR92LkkZYW5NKwCQbzN+mk6Q1wE= ARC-Authentication-Results: i=1; imf04.hostedemail.com; dkim=none; spf=pass (imf04.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com; dmarc=pass (policy=none) header.from=arm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1701685277; a=rsa-sha256; cv=none; b=FLNSsz6AHXJLSKZZfHrzJxt6ivE9SrKZtRJUajHt4uWUPawJvFRAOEdj9Ya5lf+10Jyq8c ULBFLnlzO2dEsB3fiD9wyBS8d4Hte6VJodBXN2r69x4ZPExu1JGxN9F9JqmuXSGzTaQUsK DoNcQhO2QjlyZvA/Jp31rl3mGxERMGo= Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 81DC8169C; Mon, 4 Dec 2023 02:22:03 -0800 (PST) Received: from e125769.cambridge.arm.com (e125769.cambridge.arm.com [10.1.196.26]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 6A9563F6C4; Mon, 4 Dec 2023 02:21:13 -0800 (PST) From: Ryan Roberts To: Andrew Morton , Matthew Wilcox , Yin Fengwei , David Hildenbrand , Yu Zhao , Catalin Marinas , Anshuman Khandual , Yang Shi , "Huang, Ying" , Zi Yan , Luis Chamberlain , Itaru Kitayama , "Kirill A. Shutemov" , John Hubbard , David Rientjes , Vlastimil Babka , Hugh Dickins , Kefeng Wang , Barry Song <21cnbao@gmail.com>, Alistair Popple Cc: Ryan Roberts , linux-mm@kvack.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org Subject: [PATCH v8 08/10] selftests/mm/khugepaged: Enlighten for multi-size THP Date: Mon, 4 Dec 2023 10:20:25 +0000 Message-Id: <20231204102027.57185-9-ryan.roberts@arm.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20231204102027.57185-1-ryan.roberts@arm.com> References: <20231204102027.57185-1-ryan.roberts@arm.com> MIME-Version: 1.0 X-Rspamd-Queue-Id: E1FD440002 X-Rspam-User: X-Stat-Signature: o3scms8tp3a367bck5n1z6bxe554iday X-Rspamd-Server: rspam01 X-HE-Tag: 1701685276-768666 X-HE-Meta: U2FsdGVkX1/bSoqTGCpVlySbg5VOpSXxyPH7SPUgF4raBx6M/r6I/sVmAfGi/6HcNf1PWluLcpQlQOHFK6qvStzPmDW18U5vgpgxXesLQ1XA97zWJnqpeAkf+PnHwHa5/F+F8WxI2OQ6lMx6N5/sF1RNJql8fRHpNfEhkG26hl/oVLSi9MRWBS1UJ9X6oaw+oRnC5jB27UbHnJm3szQjiz4vWTuuYBc3Z+B1tzLi4hWO4Ul0RONBsbTtuxSuoJAEu6Ql6r5cQhm6svzko/1o2iO4jcdEa7jmvBkjvg7tG0lt45DFriZs5QmsPMWT+8XjbkmodAjibFZIVXdcG90+yhs9oZ7UQ/Y1kjuc2SMtetl2jvBNSTTEAfcJME4nB6AbAb1pT6emWPk/25wG3YQcFZKHuuCMgNrW0FLmG+fcJoOTSnAeoOtegB5gm28+RllyE7mNq/8ADgZnkUK/gJxJqbCVL/ddwR8QAlnU4+Hwpj7H4blrQByiIT+t8HQRBb1RXvKQ2DVln+wE977yEk/Uraj1BU5mdMAztgOKTMmf8DBuLRG6fb8lsCv+ddTw3317UDM7z1eQ6KgRfQhubMHHRWfZk49rHY1FsLZYii9RyyyVQvBaFH3cuHZ8xFQhwMu6YQFqAPfnNXJ3BoNUX463BwWkvugMHNJzXD1Yeacklplvx12k4mo2/YI2XTI3GgfyE7LVXV8DQI12zeGGhgv1QUdnbnVPTjjlrHb496REF8vnD7CJiGSdzf0z01x8SpIJduD7pNpb5al86uA0oxAdUxRmBN5RMaP3SSFwJLINIkS36VosKxJPFOwF4G7CggRkx15rnNnUEO50k6ejUe8sEDt8EmIA7FOEXZbc/rdM0VsocKibEfieNTOwYZREzZd6cqdL3LyEVrNXTXcXRbQ5eMDWsUC+81KEw0V1KrAiZbWPN7xxim1oIxaMFA+RByQDqsOj9+8eGqst7QsKOhE pEy0JOiV 7ZdN55iA98FDr+IDZX18UK54nG6KzEpLGBaEQLe4PDFwE1wrCfa9RxbgmlnWDERp2gwa2Zj/BsoumjuB25Qy2yrKx8TZykpYn7xwQ9+E7IFUZfcujPQ0dVzx0sBJuDQnY5reaVMzQLbo5tdTDuhofKfNN7QYZ3X11TFJRmeGCUj/9TXbdPrriljbP+KwH+Iyqh54BWLO6gQAzNNUR/ZHpHQLxgaqsLJuENGg3LVRuDXVKbsw= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The `collapse_max_ptes_none` test was previously failing when a THP size less than PMD-size had enabled="always". The root cause is because the test faults in 1 page less than the threshold it set for collapsing. But when THP is enabled always, we "over allocate" and therefore the threshold is passed, and collapse unexpectedly succeeds. Solve this by enlightening khugepaged selftest. Add a command line option to pass in the desired THP size that should be used for all anonymous allocations. The harness will then explicitly configure a THP size as requested and modify the `collapse_max_ptes_none` test so that it faults in the threshold minus the number of pages in the configured THP size. If no command line option is provided, default to order 0, as per previous behaviour. I chose to use an order in the command line interface, since this makes the interface agnostic of base page size, making it easier to invoke from run_vmtests.sh. Signed-off-by: Ryan Roberts --- tools/testing/selftests/mm/khugepaged.c | 48 +++++++++++++++++------ tools/testing/selftests/mm/run_vmtests.sh | 2 + 2 files changed, 39 insertions(+), 11 deletions(-) diff --git a/tools/testing/selftests/mm/khugepaged.c b/tools/testing/selftests/mm/khugepaged.c index 7bd3baa9d34b..829320a519e7 100644 --- a/tools/testing/selftests/mm/khugepaged.c +++ b/tools/testing/selftests/mm/khugepaged.c @@ -28,6 +28,7 @@ static unsigned long hpage_pmd_size; static unsigned long page_size; static int hpage_pmd_nr; +static int anon_order; #define PID_SMAPS "/proc/self/smaps" #define TEST_FILE "collapse_test_file" @@ -607,6 +608,11 @@ static bool is_tmpfs(struct mem_ops *ops) return ops == &__file_ops && finfo.type == VMA_SHMEM; } +static bool is_anon(struct mem_ops *ops) +{ + return ops == &__anon_ops; +} + static void alloc_at_fault(void) { struct thp_settings settings = *thp_current_settings(); @@ -673,6 +679,7 @@ static void collapse_max_ptes_none(struct collapse_context *c, struct mem_ops *o int max_ptes_none = hpage_pmd_nr / 2; struct thp_settings settings = *thp_current_settings(); void *p; + int fault_nr_pages = is_anon(ops) ? 1 << anon_order : 1; settings.khugepaged.max_ptes_none = max_ptes_none; thp_push_settings(&settings); @@ -686,10 +693,10 @@ static void collapse_max_ptes_none(struct collapse_context *c, struct mem_ops *o goto skip; } - ops->fault(p, 0, (hpage_pmd_nr - max_ptes_none - 1) * page_size); + ops->fault(p, 0, (hpage_pmd_nr - max_ptes_none - fault_nr_pages) * page_size); c->collapse("Maybe collapse with max_ptes_none exceeded", p, 1, ops, !c->enforce_pte_scan_limits); - validate_memory(p, 0, (hpage_pmd_nr - max_ptes_none - 1) * page_size); + validate_memory(p, 0, (hpage_pmd_nr - max_ptes_none - fault_nr_pages) * page_size); if (c->enforce_pte_scan_limits) { ops->fault(p, 0, (hpage_pmd_nr - max_ptes_none) * page_size); @@ -1076,7 +1083,7 @@ static void madvise_retracted_page_tables(struct collapse_context *c, static void usage(void) { - fprintf(stderr, "\nUsage: ./khugepaged [dir]\n\n"); + fprintf(stderr, "\nUsage: ./khugepaged [OPTIONS] [dir]\n\n"); fprintf(stderr, "\t\t: :\n"); fprintf(stderr, "\t\t: [all|khugepaged|madvise]\n"); fprintf(stderr, "\t\t: [all|anon|file|shmem]\n"); @@ -1085,15 +1092,34 @@ static void usage(void) fprintf(stderr, "\tCONFIG_READ_ONLY_THP_FOR_FS=y\n"); fprintf(stderr, "\n\tif [dir] is a (sub)directory of a tmpfs mount, tmpfs must be\n"); fprintf(stderr, "\tmounted with huge=madvise option for khugepaged tests to work\n"); + fprintf(stderr, "\n\tSupported Options:\n"); + fprintf(stderr, "\t\t-h: This help message.\n"); + fprintf(stderr, "\t\t-s: mTHP size, expressed as page order.\n"); + fprintf(stderr, "\t\t Defaults to 0. Use this size for anon allocations.\n"); exit(1); } -static void parse_test_type(int argc, const char **argv) +static void parse_test_type(int argc, char **argv) { + int opt; char *buf; const char *token; - if (argc == 1) { + while ((opt = getopt(argc, argv, "s:h")) != -1) { + switch (opt) { + case 's': + anon_order = atoi(optarg); + break; + case 'h': + default: + usage(); + } + } + + argv += optind; + argc -= optind; + + if (argc == 0) { /* Backwards compatibility */ khugepaged_context = &__khugepaged_context; madvise_context = &__madvise_context; @@ -1101,7 +1127,7 @@ static void parse_test_type(int argc, const char **argv) return; } - buf = strdup(argv[1]); + buf = strdup(argv[0]); token = strsep(&buf, ":"); if (!strcmp(token, "all")) { @@ -1135,11 +1161,13 @@ static void parse_test_type(int argc, const char **argv) if (!file_ops) return; - if (argc != 3) + if (argc != 2) usage(); + + get_finfo(argv[1]); } -int main(int argc, const char **argv) +int main(int argc, char **argv) { int hpage_pmd_order; struct thp_settings default_settings = { @@ -1164,9 +1192,6 @@ int main(int argc, const char **argv) parse_test_type(argc, argv); - if (file_ops) - get_finfo(argv[2]); - setbuf(stdout, NULL); page_size = getpagesize(); @@ -1183,6 +1208,7 @@ int main(int argc, const char **argv) default_settings.khugepaged.max_ptes_shared = hpage_pmd_nr / 2; default_settings.khugepaged.pages_to_scan = hpage_pmd_nr * 8; default_settings.hugepages[hpage_pmd_order].enabled = THP_INHERIT; + default_settings.hugepages[anon_order].enabled = THP_ALWAYS; save_settings(); thp_push_settings(&default_settings); diff --git a/tools/testing/selftests/mm/run_vmtests.sh b/tools/testing/selftests/mm/run_vmtests.sh index c0212258b852..87f513f5cf91 100755 --- a/tools/testing/selftests/mm/run_vmtests.sh +++ b/tools/testing/selftests/mm/run_vmtests.sh @@ -357,6 +357,8 @@ CATEGORY="cow" run_test ./cow CATEGORY="thp" run_test ./khugepaged +CATEGORY="thp" run_test ./khugepaged -s 2 + CATEGORY="thp" run_test ./transhuge-stress -d 20 CATEGORY="thp" run_test ./split_huge_page_test