From patchwork Fri Aug 26 22:48:11 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shakeel Butt X-Patchwork-Id: 12956675 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id AFB93ECAAD4 for ; Fri, 26 Aug 2022 22:48:29 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EFEB56B0073; Fri, 26 Aug 2022 18:48:28 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id EADAF940007; Fri, 26 Aug 2022 18:48:28 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D4CBE6B0075; Fri, 26 Aug 2022 18:48:28 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id C3B4D6B0073 for ; Fri, 26 Aug 2022 18:48:28 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 91EAE120DE2 for ; Fri, 26 Aug 2022 22:48:28 +0000 (UTC) X-FDA: 79843234296.19.EC54AD6 Received: from mail-pl1-f201.google.com (mail-pl1-f201.google.com [209.85.214.201]) by imf20.hostedemail.com (Postfix) with ESMTP id 4B85C1C0025 for ; Fri, 26 Aug 2022 22:48:28 +0000 (UTC) Received: by mail-pl1-f201.google.com with SMTP id z18-20020a170903019200b00172dd6da065so1829102plg.14 for ; Fri, 26 Aug 2022 15:48:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=cc:to:from:subject:message-id:mime-version:date:from:to:cc; bh=l6N8I12ejNlrTpzE1zHpjpuxPcjHnjsqdBCs4VzChgw=; b=jLHbx3G5CZLgmkuGkmwbz4/eihPdIy9DXuNsrnhR4RibF75i1m93fFS+WFI+/vCg5i BLZGkvEypm6VguvN/xCoLfW3mWJxNv/i+70ODLaLwHjX47Vt6GrHUyg2KGuJLmtk5py5 tZHVegWijweFwPlUcQ2ssKtSZHtUPmJE8Nc8MUWrPBpPQYe1bbiFosqTkkJcIa9cGZc8 paoG+gXYdHZVvcM2peaslwjglAm9M2XuyYXwUqVAGWeJNNxcL2HcVdwP4hhoh0b9i5Hb Sj+gOlzwHvbsoRB75wN4tI8/UlCdam4RUqYbbWpKflCaCnZS44y0txm/Sxh4mndbVN0U 9wDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:from:subject:message-id:mime-version:date:x-gm-message-state :from:to:cc; bh=l6N8I12ejNlrTpzE1zHpjpuxPcjHnjsqdBCs4VzChgw=; b=d83/lIqhE8evkmRBe3NfnNgfdT/mdLCBKQCkvKOsPe4tPEkX2/MCgQfMJ1D46KKBRv RBwrme+09+eLaUr9guGSBXBm0T/VJJLvwhzOIZzK9CjwHsZ3NUh0A0H+9bkLMe/nTYAh sb+Qqw3rZN4vqRuMWzkr9gQHByUMtkA+63D2ehwM4wW8ZFaAG5RHX3x6/HV/8FXAWoFz ovsRlxgpC5FskkT3PeVirwHMVqN+zjFHRd2xosUyWCAhUfCtNK2vv8ChMVpYeOWbTvTh N7umymnIrYWUNzAxIfsrO6uYtsekcsY++VoE/8SH6Vy6UHXz+NSl8msTzNT1coEOjDsB uvBw== X-Gm-Message-State: ACgBeo3Rm7K1LzZGkle9CgTJLqSIK2rWObrQ3kSneIyR3cCT2pPXy0m7 rA956FAT/TdkCEI0aqbBGLzj6Ezby7bkRw== X-Google-Smtp-Source: AA6agR41a3o8U9TaaCiHdPrFfzHtW5YsUptLs9UjrmBRqMbl0pNX2tOFfCzIJKiou/78YOv3jXspeUqzmdvCdA== X-Received: from shakeelb.c.googlers.com ([fda3:e722:ac3:cc00:7f:e700:c0a8:262e]) (user=shakeelb job=sendgmr) by 2002:a05:6a00:1a8d:b0:52f:433:e499 with SMTP id e13-20020a056a001a8d00b0052f0433e499mr5931967pfv.70.1661554107298; Fri, 26 Aug 2022 15:48:27 -0700 (PDT) Date: Fri, 26 Aug 2022 22:48:11 +0000 Mime-Version: 1.0 X-Mailer: git-send-email 2.37.2.672.g94769d06f0-goog Message-ID: <20220826224812.550793-1-shakeelb@google.com> Subject: [PATCH] mm: deduplicate cacheline padding code From: Shakeel Butt To: Michal Hocko , Feng Tang Cc: Andrew Morton , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Shakeel Butt ARC-Authentication-Results: i=1; imf20.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b=jLHbx3G5; spf=pass (imf20.hostedemail.com: domain of 3u00JYwgKCJoMB4E88F5AIIAF8.6IGFCHOR-GGEP46E.ILA@flex--shakeelb.bounces.google.com designates 209.85.214.201 as permitted sender) smtp.mailfrom=3u00JYwgKCJoMB4E88F5AIIAF8.6IGFCHOR-GGEP46E.ILA@flex--shakeelb.bounces.google.com; dmarc=pass (policy=reject) header.from=google.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1661554108; a=rsa-sha256; cv=none; b=EG/n7Eyn2LEpuI+nn3nQoGZVNoVNP/pYKmmTxhedZL0hcP6a2mzvftvaOOu83QhPnGkEc4 yS6twuQs5kzK8i1DvZtUG0P8ikWUAoGdBm03sJg57xGE3bx4w74XamP7sBW0IJKpj+UECh u8uaQEGSNfOnP6CyhmxA4BM9LWeU2Rw= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1661554108; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=l6N8I12ejNlrTpzE1zHpjpuxPcjHnjsqdBCs4VzChgw=; b=4/lZYATgeRnntzJXhtQJo42TcEYz1wOKqK36++6mBk5QCoQgc+b9XzvQP5PYYt6VdC/AvZ RqU+5U9XXcN0QI5AC3B+L4/R1J8Gbvrq+0pOmIZZflei35qkFcCglkIEciBFzE4jrjdQXB 01+4lr2Ncaz0vkKh+H5eZBkVoPcpB0w= X-Rspam-User: Authentication-Results: imf20.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b=jLHbx3G5; spf=pass (imf20.hostedemail.com: domain of 3u00JYwgKCJoMB4E88F5AIIAF8.6IGFCHOR-GGEP46E.ILA@flex--shakeelb.bounces.google.com designates 209.85.214.201 as permitted sender) smtp.mailfrom=3u00JYwgKCJoMB4E88F5AIIAF8.6IGFCHOR-GGEP46E.ILA@flex--shakeelb.bounces.google.com; dmarc=pass (policy=reject) header.from=google.com X-Rspamd-Server: rspam07 X-Stat-Signature: ua71e79zzqyn9opp8phtd458ds6b1k9x X-Rspamd-Queue-Id: 4B85C1C0025 X-HE-Tag: 1661554108-787255 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: There are three users (mmzone.h, memcontrol.h, page_counter.h) using similar code for forcing cacheline padding between fields of different structures. Dedup that code. Signed-off-by: Shakeel Butt Suggested-by: Feng Tang --- include/linux/cache.h | 13 +++++++++++++ include/linux/memcontrol.h | 13 ++----------- include/linux/mmzone.h | 24 +++++------------------- include/linux/page_counter.h | 13 ++----------- 4 files changed, 22 insertions(+), 41 deletions(-) diff --git a/include/linux/cache.h b/include/linux/cache.h index d742c57eaee5..5da1bbd96154 100644 --- a/include/linux/cache.h +++ b/include/linux/cache.h @@ -85,4 +85,17 @@ #define cache_line_size() L1_CACHE_BYTES #endif +/* + * Helper to add padding within a struct to ensure data fall into separate + * cachelines. + */ +#if defined(CONFIG_SMP) +struct cacheline_padding { + char x[0]; +} ____cacheline_internodealigned_in_smp; +#define CACHELINE_PADDING(name) struct cacheline_padding name +#else +#define CACHELINE_PADDING(name) +#endif + #endif /* __LINUX_CACHE_H */ diff --git a/include/linux/memcontrol.h b/include/linux/memcontrol.h index 344022f102c2..60545e4a1c03 100644 --- a/include/linux/memcontrol.h +++ b/include/linux/memcontrol.h @@ -185,15 +185,6 @@ struct mem_cgroup_thresholds { struct mem_cgroup_threshold_ary *spare; }; -#if defined(CONFIG_SMP) -struct memcg_padding { - char x[0]; -} ____cacheline_internodealigned_in_smp; -#define MEMCG_PADDING(name) struct memcg_padding name -#else -#define MEMCG_PADDING(name) -#endif - /* * Remember four most recent foreign writebacks with dirty pages in this * cgroup. Inode sharing is expected to be uncommon and, even if we miss @@ -304,7 +295,7 @@ struct mem_cgroup { spinlock_t move_lock; unsigned long move_lock_flags; - MEMCG_PADDING(_pad1_); + CACHELINE_PADDING(_pad1_); /* memory.stat */ struct memcg_vmstats vmstats; @@ -326,7 +317,7 @@ struct mem_cgroup { struct list_head objcg_list; #endif - MEMCG_PADDING(_pad2_); + CACHELINE_PADDING(_pad2_); /* * set > 0 if pages under this cgroup are moving to other cgroup. diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h index 14919b2fb5f5..084f47dc0fad 100644 --- a/include/linux/mmzone.h +++ b/include/linux/mmzone.h @@ -121,20 +121,6 @@ static inline bool free_area_empty(struct free_area *area, int migratetype) struct pglist_data; -/* - * Add a wild amount of padding here to ensure data fall into separate - * cachelines. There are very few zone structures in the machine, so space - * consumption is not a concern here. - */ -#if defined(CONFIG_SMP) -struct zone_padding { - char x[0]; -} ____cacheline_internodealigned_in_smp; -#define ZONE_PADDING(name) struct zone_padding name; -#else -#define ZONE_PADDING(name) -#endif - #ifdef CONFIG_NUMA enum numa_stat_item { NUMA_HIT, /* allocated in intended node */ @@ -837,7 +823,7 @@ struct zone { int initialized; /* Write-intensive fields used from the page allocator */ - ZONE_PADDING(_pad1_) + CACHELINE_PADDING(_pad1_) /* free areas of different sizes */ struct free_area free_area[MAX_ORDER]; @@ -849,7 +835,7 @@ struct zone { spinlock_t lock; /* Write-intensive fields used by compaction and vmstats. */ - ZONE_PADDING(_pad2_) + CACHELINE_PADDING(_pad2_) /* * When free pages are below this point, additional steps are taken @@ -886,7 +872,7 @@ struct zone { bool contiguous; - ZONE_PADDING(_pad3_) + CACHELINE_PADDING(_pad3_) /* Zone statistics */ atomic_long_t vm_stat[NR_VM_ZONE_STAT_ITEMS]; atomic_long_t vm_numa_event[NR_VM_NUMA_EVENT_ITEMS]; @@ -1194,7 +1180,7 @@ typedef struct pglist_data { #endif /* CONFIG_NUMA */ /* Write-intensive fields used by page reclaim */ - ZONE_PADDING(_pad1_) + CACHELINE_PADDING(_pad1_) #ifdef CONFIG_DEFERRED_STRUCT_PAGE_INIT /* @@ -1239,7 +1225,7 @@ typedef struct pglist_data { struct lru_gen_mm_walk mm_walk; #endif - ZONE_PADDING(_pad2_) + CACHELINE_PADDING(_pad2_) /* Per-node vmstats */ struct per_cpu_nodestat __percpu *per_cpu_nodestats; diff --git a/include/linux/page_counter.h b/include/linux/page_counter.h index 78a1c934e416..c141ea9a95ef 100644 --- a/include/linux/page_counter.h +++ b/include/linux/page_counter.h @@ -7,22 +7,13 @@ #include #include -#if defined(CONFIG_SMP) -struct pc_padding { - char x[0]; -} ____cacheline_internodealigned_in_smp; -#define PC_PADDING(name) struct pc_padding name -#else -#define PC_PADDING(name) -#endif - struct page_counter { /* * Make sure 'usage' does not share cacheline with any other field. The * memcg->memory.usage is a hot member of struct mem_cgroup. */ atomic_long_t usage; - PC_PADDING(_pad1_); + CACHELINE_PADDING(_pad1_); /* effective memory.min and memory.min usage tracking */ unsigned long emin; @@ -38,7 +29,7 @@ struct page_counter { unsigned long failcnt; /* Keep all the read most fields in a separete cacheline. */ - PC_PADDING(_pad2_); + CACHELINE_PADDING(_pad2_); unsigned long min; unsigned long low;