From patchwork Sat Apr 15 22:59:12 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Stefan Roesch X-Patchwork-Id: 13212666 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B068CC77B70 for ; Sat, 15 Apr 2023 23:04:48 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D84666B0078; Sat, 15 Apr 2023 19:04:47 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D0CC06B007B; Sat, 15 Apr 2023 19:04:47 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BFB396B007D; Sat, 15 Apr 2023 19:04:47 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id B277C6B0078 for ; Sat, 15 Apr 2023 19:04:47 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 87BB4ABB1A for ; Sat, 15 Apr 2023 23:04:47 +0000 (UTC) X-FDA: 80685157014.11.1AABB77 Received: from 66-220-144-179.mail-mxout.facebook.com (66-220-144-179.mail-mxout.facebook.com [66.220.144.179]) by imf11.hostedemail.com (Postfix) with ESMTP id E7F0B40019 for ; Sat, 15 Apr 2023 23:04:45 +0000 (UTC) Authentication-Results: imf11.hostedemail.com; dkim=none; spf=neutral (imf11.hostedemail.com: 66.220.144.179 is neither permitted nor denied by domain of shr@devkernel.io) smtp.mailfrom=shr@devkernel.io; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681599886; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xdULGBSJgucAfBmIVVntbieQl+FUgJvEMHgMFpf170g=; b=fQJOSb4L2HACg0uodqAUiW72msXHr6NsxFf39AO4XowxyGc5LbujMOy5jkanCmRun+51Oq +yKCajHy27jTHAwDe6TccgGRaDiRmk+NRDlm+Hk5kzrzzc1p2e2RgHtr5HCUlKneZleGT1 TpC1xbG12lZzJkyY0KxOq65m7ZYcjbs= ARC-Authentication-Results: i=1; imf11.hostedemail.com; dkim=none; spf=neutral (imf11.hostedemail.com: 66.220.144.179 is neither permitted nor denied by domain of shr@devkernel.io) smtp.mailfrom=shr@devkernel.io; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1681599886; a=rsa-sha256; cv=none; b=AbjtBD74sbc/c2j6bRS8K9UFQP2LYKOLpw6EVSP83sfTvhi/Le6IlTawvaua2xstkaD/+O PrCWntn1FCYUzGWF0TJD6VzU1cipoAyzMo8xK/9O/IrFwOgBBkZj6y/Ew0G7Yi5/h+qnw4 4gGCdN/5TvqZt/ZcGQeCFALXOHy3jsE= Received: by devbig1114.prn1.facebook.com (Postfix, from userid 425415) id 32DAA37C4324; Sat, 15 Apr 2023 15:59:19 -0700 (PDT) From: Stefan Roesch To: kernel-team@fb.com Cc: shr@devkernel.io, linux-mm@kvack.org, riel@surriel.com, mhocko@suse.com, david@redhat.com, linux-kselftest@vger.kernel.org, linux-doc@vger.kernel.org, akpm@linux-foundation.org, hannes@cmpxchg.org, willy@infradead.org, Bagas Sanjaya Subject: [PATCH v8 2/3] mm: add new KSM process and sysfs knobs Date: Sat, 15 Apr 2023 15:59:12 -0700 Message-Id: <20230415225913.3206647-3-shr@devkernel.io> X-Mailer: git-send-email 2.31.1 In-Reply-To: <20230415225913.3206647-1-shr@devkernel.io> References: <20230415225913.3206647-1-shr@devkernel.io> MIME-Version: 1.0 X-Rspam-User: X-Rspamd-Server: rspam03 X-Stat-Signature: ggcxwc68rfmftbrkoj4hrta7kf6zthd6 X-Rspamd-Queue-Id: E7F0B40019 X-HE-Tag: 1681599885-447136 X-HE-Meta: U2FsdGVkX186s1XIg9nE+zO3kSUwhtqwqJlRetUo9TjrOfeKbVNHmlHDbSEAlJ+PgbBRVOcp20ekzXT64/dF0GuS8XA21LkiQ1311BdfmhT7gvN/p2BX5WhlHL/1Gu/D1js5SxstfVsLWfujo3aM/ThOOoO3KuQFTT1Ync7in8VWwBtu4DCVc6B1NQY9/ScX7n2Jt/kE57O0S/unoTNGQiJYjxCpVzgLxQ72EE4oerTfWZprnPAU8Raa/aKs1H81TPinZXetxzvBWR5o4LmHRHnnoqu3Ty6SxI4vxxDmGOvMMjqZ5V4b1D3iZ0aUJKbTcMLYEX8MjoKkIdADifvMy+65/4faATJPp4TzA2//YE2a9HEGsp/qjMcGQ2pVhJjlU87lG6goHE7Jpz8caxSj0Idl2GN1FRVFmSYrDNrjOdKt81b2c4YlJg3U+V76QM8EZJxI/7lODHkCqg8AvS6OqqWDxB5Ia2KkfAX79TzIipQELi9f/PB537ST7CXGNK4mu3UbCwLY4JkLjBr/c7ZmVPGohYnpEI1jMKma79KIz+sAkssM2FQ4FsvcNS3Ni1pm9xuUg0BjbOgYEBj3I6NptRjjmi2fUjekRD+/gawRyVzVZtm49Yv0EOziKiyxDU4WnDd1QVK73o8x4Lvma6T3t+L7/ptNDJYo235J7/cGRt+3jtORmwhn4qxfPhVY3BrTbn4Y+2X31kn9GhKjxgtiLWB9I1XiHNbCauxZhz7xWag3LQ0BiCrEq/hdRV+4Ccic7L5wwOzLSWKuqx3g/CVpQ5Xyoysc8kiTyc5/tTU/ErqCcCK85r21QV+1ZMd1qhg0sG1ApRFy+AgFlUYSpnw+AJ7HyQURTUaZveMMUxMkw6ClO7+c+V8riUiSJgG4f1pIB/tIuXKG+IaeRkmc5syDYeulHsB9LVAxZ/1wjug5Qf/2OOj1KxdNqJ3Wr15GNaUwzvpPQl2G3yp9aPACwAW 3KPo+P1Z yiM6xzNIRtTFFIa5Qjqh3mq+nrdPF3DAg4Pc9wvCeHTjdTS7MYCr/BUgQknsaFPk9R/oHqheL4BIWoi/7pNYvOamnP6t+H/QqwVXgHGj54NrHWg39p64s6VgmigAMeINlnHTVgls8GczknNndUeMLMpOLCyKEFbUW4rpTYxz0ooB0pZ2k8rg18nSVU/GCiFlvP0T3DLAB2lD6BxRV/KrQ4B2x7DzncoXRYsFs4qdx2h1CAo2ub3GkSx/2XXlflCqoocrpAcCau+3/X6D2Xg+CYdyJRLEW+eI6b3h4hd/pZ0egHXyQ5lhskRVo0SvTtQ6CdsqjdvEnLI5amcKVX2x9WxOoMFYm9AZj/D3fr7/uYpnzCEUvDBTkEVxBghOQ36/lGUGAP+BWID10PLqmqpiQvR+Qvw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: This adds the general_profit KSM sysfs knob and the process profit metric knobs to ksm_stat. 1) expose general_profit metric The documentation mentions a general profit metric, however this metric is not calculated. In addition the formula depends on the size of internal structures, which makes it more difficult for an administrator to make the calculation. Adding the metric for a better user experience. 2) document general_profit sysfs knob 3) calculate ksm process profit metric The ksm documentation mentions the process profit metric and how to calculate it. This adds the calculation of the metric. 4) mm: expose ksm process profit metric in ksm_stat This exposes the ksm process profit metric in /proc//ksm_stat. The documentation mentions the formula for the ksm process profit metric, however it does not calculate it. In addition the formula depends on the size of internal structures. So it makes sense to expose it. 5) document new procfs ksm knobs Signed-off-by: Stefan Roesch Reviewed-by: Bagas Sanjaya Acked-by: David Hildenbrand Cc: David Hildenbrand Cc: Johannes Weiner Cc: Michal Hocko Cc: Rik van Riel Signed-off-by: Andrew Morton --- Documentation/ABI/testing/sysfs-kernel-mm-ksm | 8 +++++++ Documentation/admin-guide/mm/ksm.rst | 5 ++++- fs/proc/base.c | 3 +++ include/linux/ksm.h | 4 ++++ mm/ksm.c | 21 +++++++++++++++++++ 5 files changed, 40 insertions(+), 1 deletion(-) diff --git a/Documentation/ABI/testing/sysfs-kernel-mm-ksm b/Documentation/ABI/testing/sysfs-kernel-mm-ksm index d244674a9480..6041a025b65a 100644 --- a/Documentation/ABI/testing/sysfs-kernel-mm-ksm +++ b/Documentation/ABI/testing/sysfs-kernel-mm-ksm @@ -51,3 +51,11 @@ Description: Control merging pages across different NUMA nodes. When it is set to 0 only pages from the same node are merged, otherwise pages from all nodes can be merged together (default). + +What: /sys/kernel/mm/ksm/general_profit +Date: April 2023 +KernelVersion: 6.4 +Contact: Linux memory management mailing list +Description: Measure how effective KSM is. + general_profit: how effective is KSM. The formula for the + calculation is in Documentation/admin-guide/mm/ksm.rst. diff --git a/Documentation/admin-guide/mm/ksm.rst b/Documentation/admin-guide/mm/ksm.rst index eed51a910c94..551083a396fb 100644 --- a/Documentation/admin-guide/mm/ksm.rst +++ b/Documentation/admin-guide/mm/ksm.rst @@ -157,6 +157,8 @@ stable_node_chains_prune_millisecs The effectiveness of KSM and MADV_MERGEABLE is shown in ``/sys/kernel/mm/ksm/``: +general_profit + how effective is KSM. The calculation is explained below. pages_shared how many shared pages are being used pages_sharing @@ -207,7 +209,8 @@ several times, which are unprofitable memory consumed. ksm_rmap_items * sizeof(rmap_item). where ksm_merging_pages is shown under the directory ``/proc//``, - and ksm_rmap_items is shown in ``/proc//ksm_stat``. + and ksm_rmap_items is shown in ``/proc//ksm_stat``. The process profit + is also shown in ``/proc//ksm_stat`` as ksm_process_profit. From the perspective of application, a high ratio of ``ksm_rmap_items`` to ``ksm_merging_pages`` means a bad madvise-applied policy, so developers or diff --git a/fs/proc/base.c b/fs/proc/base.c index 5e0e0ccd47aa..96a6a08c8235 100644 --- a/fs/proc/base.c +++ b/fs/proc/base.c @@ -96,6 +96,7 @@ #include #include #include +#include #include #include "internal.h" #include "fd.h" @@ -3207,6 +3208,8 @@ static int proc_pid_ksm_stat(struct seq_file *m, struct pid_namespace *ns, mm = get_task_mm(task); if (mm) { seq_printf(m, "ksm_rmap_items %lu\n", mm->ksm_rmap_items); + seq_printf(m, "ksm_merging_pages %lu\n", mm->ksm_merging_pages); + seq_printf(m, "ksm_process_profit %ld\n", ksm_process_profit(mm)); mmput(mm); } diff --git a/include/linux/ksm.h b/include/linux/ksm.h index fa996373653b..590934bdddcf 100644 --- a/include/linux/ksm.h +++ b/include/linux/ksm.h @@ -64,6 +64,10 @@ struct page *ksm_might_need_to_copy(struct page *page, void rmap_walk_ksm(struct folio *folio, struct rmap_walk_control *rwc); void folio_migrate_ksm(struct folio *newfolio, struct folio *folio); +#ifdef CONFIG_PROC_FS +long ksm_process_profit(struct mm_struct *); +#endif /* CONFIG_PROC_FS */ + #else /* !CONFIG_KSM */ static inline void ksm_add_vma(struct vm_area_struct *vma) diff --git a/mm/ksm.c b/mm/ksm.c index 1c81e4408af1..905c8edce5cf 100644 --- a/mm/ksm.c +++ b/mm/ksm.c @@ -2964,6 +2964,14 @@ static void wait_while_offlining(void) } #endif /* CONFIG_MEMORY_HOTREMOVE */ +#ifdef CONFIG_PROC_FS +long ksm_process_profit(struct mm_struct *mm) +{ + return mm->ksm_merging_pages * PAGE_SIZE - + mm->ksm_rmap_items * sizeof(struct ksm_rmap_item); +} +#endif /* CONFIG_PROC_FS */ + #ifdef CONFIG_SYSFS /* * This all compiles without CONFIG_SYSFS, but is a waste of space. @@ -3228,6 +3236,18 @@ static ssize_t pages_volatile_show(struct kobject *kobj, } KSM_ATTR_RO(pages_volatile); +static ssize_t general_profit_show(struct kobject *kobj, + struct kobj_attribute *attr, char *buf) +{ + long general_profit; + + general_profit = ksm_pages_sharing * PAGE_SIZE - + ksm_rmap_items * sizeof(struct ksm_rmap_item); + + return sysfs_emit(buf, "%ld\n", general_profit); +} +KSM_ATTR_RO(general_profit); + static ssize_t stable_node_dups_show(struct kobject *kobj, struct kobj_attribute *attr, char *buf) { @@ -3292,6 +3312,7 @@ static struct attribute *ksm_attrs[] = { &stable_node_dups_attr.attr, &stable_node_chains_prune_millisecs_attr.attr, &use_zero_pages_attr.attr, + &general_profit_attr.attr, NULL, };