From patchwork Sat Apr 20 23:25:05 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shakeel Butt X-Patchwork-Id: 13637224 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3358BC4345F for ; Sat, 20 Apr 2024 23:25:34 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4B5B26B007B; Sat, 20 Apr 2024 19:25:33 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 43D896B0083; Sat, 20 Apr 2024 19:25:33 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 2DD6A6B0085; Sat, 20 Apr 2024 19:25:33 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 041946B007B for ; Sat, 20 Apr 2024 19:25:32 -0400 (EDT) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 5BE35C0636 for ; Sat, 20 Apr 2024 23:25:32 +0000 (UTC) X-FDA: 82031494104.14.036B269 Received: from out-187.mta0.migadu.com (out-187.mta0.migadu.com [91.218.175.187]) by imf07.hostedemail.com (Postfix) with ESMTP id 89B6F4000B for ; Sat, 20 Apr 2024 23:25:30 +0000 (UTC) Authentication-Results: imf07.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=UrIDxFRy; spf=pass (imf07.hostedemail.com: domain of shakeel.butt@linux.dev designates 91.218.175.187 as permitted sender) smtp.mailfrom=shakeel.butt@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1713655530; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references:dkim-signature; bh=9YG0Yr27rZjU0OlmRSCmu8viB0Ry44abch6JPf2G2gw=; b=wx7NeCfnuqp4SkAxxutHlvh3OXF+skGCTURUiEe2PF/RT6yEIxxQsOmrNAeRFJUeL94yPg 6MsEw+rX8ZmfLE1OHuDTB7Gwt8vmB721YZmMmECTtgxQ9tu1X8uAkICZohiJ1qqb6RvPVP 9dM+Zv3OwRZXp6vQZz6GjBzPYhI4ImU= ARC-Authentication-Results: i=1; imf07.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=UrIDxFRy; spf=pass (imf07.hostedemail.com: domain of shakeel.butt@linux.dev designates 91.218.175.187 as permitted sender) smtp.mailfrom=shakeel.butt@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1713655530; a=rsa-sha256; cv=none; b=B5GfEGoVGKpnkKVMh/kJq5OARff01jzN/vvrPjlXxdDkfg2oO0l0XoDz/NUk1AB69lzui8 pHv/Oi6zME682319zDvQ3MrGIwrHSEOJfjTgpzUtMtlZMAcds8O2U/8/gSd4zilduSppFU xxPuE0t9ySB06UW3jEu2zHhOPX0Qfg0= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1713655528; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=9YG0Yr27rZjU0OlmRSCmu8viB0Ry44abch6JPf2G2gw=; b=UrIDxFRykQOLXhTrCXQVev4LjYc/8/H9kEh1rvTsseAeBhhlphYEqRsghwbXuveza5V3lH o+5T9aWRXHdAs6mJK1Bt/+nYlurFrKwr5iMKCEVxkueeO7U2zhFx6HlTUZNoC+STYR0heG JtP0UgIiBasmIEeChd/jHiEA6SZVpw0= From: Shakeel Butt To: Andrew Morton , Johannes Weiner , Michal Hocko , Roman Gushchin , Muchun Song Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH v2] memcg: simple cleanup of stats update functions Date: Sat, 20 Apr 2024 16:25:05 -0700 Message-ID: <20240420232505.2768428-1-shakeel.butt@linux.dev> MIME-Version: 1.0 X-Migadu-Flow: FLOW_OUT X-Rspamd-Queue-Id: 89B6F4000B X-Stat-Signature: jnhb8toswo9odoh7bckj459bwuugsm1t X-Rspam-User: X-Rspamd-Server: rspam07 X-HE-Tag: 1713655530-693833 X-HE-Meta: U2FsdGVkX19YZkgT4F8mNtWcW2Xz7kvC2Qb+vhYB+5ZCVpzPVQB3s6BUBjV6HW1CAJwrq3Od6jKsylMkaI4bnLlmZilinoODXVTCxcDKdPsCrqRCi5E+oyub8mnL2F3hJRQF+vnX//aNubnosxdSd51n7dr4Y16ZuXLdbDVBpsHERLIaQw0Fw9gX5SAZTE88eo3g+StTNSWzcVmE0hkbRX7ihnWpoTSZNb8U4YOvUx7ucyGDlMamYKZIWGxSfKiqSirVEAJHw5SLrGFtgF2y5wlK/GOQ6cHoUVzgLH3SMcaVc1GZR/8+t+de4P/9rZI3G5UK9Htw/wwZXJQ8YKxTIoeo6q4QIo5axohRxlTqEfQlr3VdOQx/lOQjMc61297mVseN4Zz8SKuEcjsz3v1KLWeKoW3wHX0gSRiSg0KE/4AoEv+D1q0e0sZrmlZI3PYaXUjNHRzbxBgpLSSNZD87kRdhl7wGkWrWyV/9pHbvUND05zH50Frq1JTqasnIiFrPrUgZDYv9ZGfGF3CcQHR4fBoHCKTy5rfzzZtS9s807NbW2OTbP5g0xHQpblVGGRgm+Rj74jFr/9yfA81NbJND0i+nIOQEMj5zk+ul5DUQNQ9RY1vJxkd6BXK2+/1ipKMKjOLA3WxAdQZ3cXWEETJ46UaRGPYwvMbSF8/6tWZKs55cftYTaZxkFe4h5JJ/AKLnv4MyjdYsUB02OKQ2EVcqR9cUTtOGvJMNKgQvKde1GAdDAEwCfn2orXn5utnnDTbVRfRAdUElZYqiM/Dr/3HUkLkTBqd8YqkVL4nBGC9sRDsyBf08q4vaDruVgXPABG7hOJentWoErawdUBbAADcQECoXxUvaAT+k2Yk9qUIgR2RTF5wbl+1bDrVADASs0LWp+x1lPH6Kmzo8m34gGnQjybxqxGulYUuY2NDfxrc5P0QVMujNh7UJVQ5RvhfS3fNg9Jmi5PN6SwQpgJv25Rh F+od1XWR D09nAxiwsg0hUEZBwX/aEk15eaMdhp8HMwY7tRgzwTwyAHraETXknMTsMoBbd2ZAyf9flnCEmi6jet7MRbxyJ2YgILND70lAZD0vpNVyk3oVr275bBraFpuCScJrljDOJYXI8aoJJRL4hKpc= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: mod_memcg_lruvec_state() is never called from outside of memcontrol.c and with always irq disabled. So, replace it with the irq disabled version and add an assert that irq is disabled in the caller. Similarly mod_objcg_state() is not called from outside of memcontrol.c, so simply make it static and change it's name to __mod_objcg_state(). Signed-off-by: Shakeel Butt Acked-by: Johannes Weiner --- Change since v1: - Change mod_objcg_state to __mod_objcg_state as per the naming convention (suggested by Johannes). include/linux/memcontrol.h | 17 ----------------- mm/memcontrol.c | 31 +++++++++++++++---------------- mm/slab.h | 2 -- 3 files changed, 15 insertions(+), 35 deletions(-) diff --git a/include/linux/memcontrol.h b/include/linux/memcontrol.h index 8f332b4ae84c..9aba0d0462ca 100644 --- a/include/linux/memcontrol.h +++ b/include/linux/memcontrol.h @@ -1077,8 +1077,6 @@ static inline unsigned long lruvec_page_state_local(struct lruvec *lruvec, void mem_cgroup_flush_stats(struct mem_cgroup *memcg); void mem_cgroup_flush_stats_ratelimited(struct mem_cgroup *memcg); -void __mod_memcg_lruvec_state(struct lruvec *lruvec, enum node_stat_item idx, - int val); void __mod_lruvec_kmem_state(void *p, enum node_stat_item idx, int val); static inline void mod_lruvec_kmem_state(void *p, enum node_stat_item idx, @@ -1091,16 +1089,6 @@ static inline void mod_lruvec_kmem_state(void *p, enum node_stat_item idx, local_irq_restore(flags); } -static inline void mod_memcg_lruvec_state(struct lruvec *lruvec, - enum node_stat_item idx, int val) -{ - unsigned long flags; - - local_irq_save(flags); - __mod_memcg_lruvec_state(lruvec, idx, val); - local_irq_restore(flags); -} - void __count_memcg_events(struct mem_cgroup *memcg, enum vm_event_item idx, unsigned long count); @@ -1594,11 +1582,6 @@ static inline void mem_cgroup_flush_stats_ratelimited(struct mem_cgroup *memcg) { } -static inline void __mod_memcg_lruvec_state(struct lruvec *lruvec, - enum node_stat_item idx, int val) -{ -} - static inline void __mod_lruvec_kmem_state(void *p, enum node_stat_item idx, int val) { diff --git a/mm/memcontrol.c b/mm/memcontrol.c index 7703ced535a3..833d09c1d523 100644 --- a/mm/memcontrol.c +++ b/mm/memcontrol.c @@ -837,8 +837,9 @@ static unsigned long memcg_page_state_local(struct mem_cgroup *memcg, int idx) return x; } -void __mod_memcg_lruvec_state(struct lruvec *lruvec, enum node_stat_item idx, - int val) +static void __mod_memcg_lruvec_state(struct lruvec *lruvec, + enum node_stat_item idx, + int val) { struct mem_cgroup_per_node *pn; struct mem_cgroup *memcg; @@ -2983,21 +2984,19 @@ void mem_cgroup_commit_charge(struct folio *folio, struct mem_cgroup *memcg) #ifdef CONFIG_MEMCG_KMEM -/* - * mod_objcg_mlstate() may be called with irq enabled, so - * mod_memcg_lruvec_state() should be used. - */ -static inline void mod_objcg_mlstate(struct obj_cgroup *objcg, - struct pglist_data *pgdat, - enum node_stat_item idx, int nr) +static inline void __mod_objcg_mlstate(struct obj_cgroup *objcg, + struct pglist_data *pgdat, + enum node_stat_item idx, int nr) { struct mem_cgroup *memcg; struct lruvec *lruvec; + lockdep_assert_irqs_disabled(); + rcu_read_lock(); memcg = obj_cgroup_memcg(objcg); lruvec = mem_cgroup_lruvec(memcg, pgdat); - mod_memcg_lruvec_state(lruvec, idx, nr); + __mod_memcg_lruvec_state(lruvec, idx, nr); rcu_read_unlock(); } @@ -3317,7 +3316,7 @@ void __memcg_kmem_uncharge_page(struct page *page, int order) obj_cgroup_put(objcg); } -void mod_objcg_state(struct obj_cgroup *objcg, struct pglist_data *pgdat, +static void mod_objcg_state(struct obj_cgroup *objcg, struct pglist_data *pgdat, enum node_stat_item idx, int nr) { struct memcg_stock_pcp *stock; @@ -3345,12 +3344,12 @@ void mod_objcg_state(struct obj_cgroup *objcg, struct pglist_data *pgdat, struct pglist_data *oldpg = stock->cached_pgdat; if (stock->nr_slab_reclaimable_b) { - mod_objcg_mlstate(objcg, oldpg, NR_SLAB_RECLAIMABLE_B, + __mod_objcg_mlstate(objcg, oldpg, NR_SLAB_RECLAIMABLE_B, stock->nr_slab_reclaimable_b); stock->nr_slab_reclaimable_b = 0; } if (stock->nr_slab_unreclaimable_b) { - mod_objcg_mlstate(objcg, oldpg, NR_SLAB_UNRECLAIMABLE_B, + __mod_objcg_mlstate(objcg, oldpg, NR_SLAB_UNRECLAIMABLE_B, stock->nr_slab_unreclaimable_b); stock->nr_slab_unreclaimable_b = 0; } @@ -3376,7 +3375,7 @@ void mod_objcg_state(struct obj_cgroup *objcg, struct pglist_data *pgdat, } } if (nr) - mod_objcg_mlstate(objcg, pgdat, idx, nr); + __mod_objcg_mlstate(objcg, pgdat, idx, nr); local_unlock_irqrestore(&memcg_stock.stock_lock, flags); obj_cgroup_put(old); @@ -3442,13 +3441,13 @@ static struct obj_cgroup *drain_obj_stock(struct memcg_stock_pcp *stock) */ if (stock->nr_slab_reclaimable_b || stock->nr_slab_unreclaimable_b) { if (stock->nr_slab_reclaimable_b) { - mod_objcg_mlstate(old, stock->cached_pgdat, + __mod_objcg_mlstate(old, stock->cached_pgdat, NR_SLAB_RECLAIMABLE_B, stock->nr_slab_reclaimable_b); stock->nr_slab_reclaimable_b = 0; } if (stock->nr_slab_unreclaimable_b) { - mod_objcg_mlstate(old, stock->cached_pgdat, + __mod_objcg_mlstate(old, stock->cached_pgdat, NR_SLAB_UNRECLAIMABLE_B, stock->nr_slab_unreclaimable_b); stock->nr_slab_unreclaimable_b = 0; diff --git a/mm/slab.h b/mm/slab.h index e32d9cf1077a..5f8f47c5bee0 100644 --- a/mm/slab.h +++ b/mm/slab.h @@ -578,8 +578,6 @@ bool __memcg_slab_post_alloc_hook(struct kmem_cache *s, struct list_lru *lru, gfp_t flags, size_t size, void **p); void __memcg_slab_free_hook(struct kmem_cache *s, struct slab *slab, void **p, int objects, struct slabobj_ext *obj_exts); -void mod_objcg_state(struct obj_cgroup *objcg, struct pglist_data *pgdat, - enum node_stat_item idx, int nr); #endif size_t __ksize(const void *objp);