From patchwork Wed Feb 26 12:03:16 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Byungchul Park X-Patchwork-Id: 13992197 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 63591C021B8 for ; Wed, 26 Feb 2025 12:03:54 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E2CB528001E; Wed, 26 Feb 2025 07:03:50 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id DDC58280020; Wed, 26 Feb 2025 07:03:50 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C074228001E; Wed, 26 Feb 2025 07:03:50 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 95BF8280020 for ; Wed, 26 Feb 2025 07:03:50 -0500 (EST) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 4E216B6729 for ; Wed, 26 Feb 2025 12:03:50 +0000 (UTC) X-FDA: 83161961820.12.9174596 Received: from invmail4.hynix.com (exvmail4.skhynix.com [166.125.252.92]) by imf19.hostedemail.com (Postfix) with ESMTP id 5FCC21A0023 for ; Wed, 26 Feb 2025 12:03:48 +0000 (UTC) Authentication-Results: imf19.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf19.hostedemail.com: domain of byungchul@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=byungchul@sk.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1740571428; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:content-type: content-transfer-encoding:in-reply-to:in-reply-to: references:references; bh=M1fkZu3FyjLbAoapdbPq1UQhtrUdGaJIICRcLwYQhnE=; b=Asr3kY9/FOiLEVmjnK2bbkyi3OFAAFXr5NY9ZV3UCipwJm4gV1pCUnlci7ThzSAbyH64Pp HFzp8NiyqC6og4WtiV9N2kim+RFwbGO36UpzSj04VxPhbiCMZOEgNXCBmp5IHYHtcnXYjJ IgHBBt4/OhxDIGilOammxdixnpuUzqk= ARC-Authentication-Results: i=1; imf19.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf19.hostedemail.com: domain of byungchul@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=byungchul@sk.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1740571428; a=rsa-sha256; cv=none; b=gcx2L0BXM5QWdWWzkw6B7lp4COmrUkvDJqp4ERovouTJH7pqXuKmC9znNjz+hUB9SwnLNY 8rIqSp9MFZKAhHyM4LLD2XL53F/fNRmwM11Q/AIpVyefbm2yEUpSyIEMBIYc+0RNgpkM4J ok1mec7sf8G3uPDk4KjQ6de2i6Yh8t4= X-AuditID: a67dfc5b-3e1ff7000001d7ae-0a-67bf0322c8a4 From: Byungchul Park To: linux-kernel@vger.kernel.org, linux-mm@kvack.org Cc: kernel_team@skhynix.com, akpm@linux-foundation.org, vernhao@tencent.com, mgorman@techsingularity.net, hughd@google.com, willy@infradead.org, david@redhat.com, peterz@infradead.org, luto@kernel.org, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, rjgolo@gmail.com Subject: [RFC PATCH v12 based on v6.14-rc4 05/25] mm/buddy: make room for a new variable, luf_key, in struct page Date: Wed, 26 Feb 2025 21:03:16 +0900 Message-Id: <20250226120336.29565-5-byungchul@sk.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20250226120336.29565-1-byungchul@sk.com> References: <20250226113024.GA1935@system.software.com> <20250226120336.29565-1-byungchul@sk.com> X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrELMWRmVeSWpSXmKPExsXC9ZZnoa4S8/50g7UzFS3mrF/DZvF5wz82 i6/rfzFbPP3Ux2JxedccNot7a/6zWpzftZbVYsfSfUwWlw4sYLI43nuAyWL+vc9sFps3TWW2 OD5lKqPF7x9z2Bz4PL639rF47Jx1l91jwaZSj80rtDw2repk89j0aRK7x7tz59g9Tsz4zeLx ft9VNo+tv+w8GqdeY/P4vEkugCeKyyYlNSezLLVI3y6BK+Pz/c+sBWtkKpbukWxgnCvWxcjJ ISFgInFzynYWGPvbzO/MIDabgLrEjRs/wWwRATOJg61/2LsYuTiYBZYxSew90cAGkhAWKJSY P/sHmM0ioCqxZP9Vxi5GDg5eAVOJs81FEDPlJVZvOAA2hxNozqdpx8DKhQSSJXb+/sMEMlNC 4D6bxKf2HawQDZISB1fcYJnAyLuAkWEVo1BmXlluYmaOiV5GZV5mhV5yfu4mRmBIL6v9E72D 8dOF4EOMAhyMSjy8D87sTRdiTSwrrsw9xCjBwawkwsuZuSddiDclsbIqtSg/vqg0J7X4EKM0 B4uSOK/Rt/IUIYH0xJLU7NTUgtQimCwTB6dUA6PqnNzmmLIt1naGx9b/eORz7td8/oeuTw4w rt17RFB1S+bsiE+BTownZy1lbmuufbn+N59x30rnxcE1pvpbtbbE8m1k2xVQu1tT4BtPKOMT 5hQ/HxvrKuaM/WL5kxw2b/8pWpa2YWfODeV9Vev45+eEvN3yoO75w7JJi7ZvbCjQkJU2PbDz Y74SS3FGoqEWc1FxIgD26I6RZQIAAA== X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFtrJLMWRmVeSWpSXmKPExsXC5WfdrKvEvD/d4OhBEYs569ewWXze8I/N 4uv6X8wWTz/1sVgcnnuS1eLyrjlsFvfW/Ge1OL9rLavFjqX7mCwuHVjAZHG89wCTxfx7n9ks Nm+aymxxfMpURovfP+awOfB7fG/tY/HYOesuu8eCTaUem1doeWxa1cnmsenTJHaPd+fOsXuc mPGbxeP9vqtsHotffGDy2PrLzqNx6jU2j8+b5AJ4o7hsUlJzMstSi/TtErgyPt//zFqwRqZi 6R7JBsa5Yl2MnBwSAiYS32Z+Zwax2QTUJW7c+AlmiwiYSRxs/cPexcjFwSywjEli74kGNpCE sEChxPzZP8BsFgFViSX7rzJ2MXJw8AqYSpxtLoKYKS+xesMBsDmcQHM+TTsGVi4kkCyx8/cf pgmMXAsYGVYximTmleUmZuaY6hVnZ1TmZVboJefnbmIEBuiy2j8TdzB+uex+iFGAg1GJh/fB mb3pQqyJZcWVuYcYJTiYlUR4OTP3pAvxpiRWVqUW5ccXleakFh9ilOZgURLn9QpPTRASSE8s Sc1OTS1ILYLJMnFwSjUwzgz7eXTXDtUfGwVOuRpxPnhu/2Gv0xKlyk+Pp5zNf6sUWhJ+/XDz 7Ur3vg0umpOiX7/cuezP3NoMn8wpD4zmKq5xZEizaL7/0pP3lJlbtbTz//02Rz5Eztq+S1rv cdHkY4ui3Xv07Tds8T/ssfvl86sRk746CTWvLznY/vLEFwmruKkvum6+f6DEUpyRaKjFXFSc CADmImAJTAIAAA== X-CFilter-Loop: Reflected X-Rspam-User: X-Stat-Signature: o1tftxrd1orooch5aw56i5ifcudyo97s X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 5FCC21A0023 X-HE-Tag: 1740571428-636033 X-HE-Meta: U2FsdGVkX18DFgKqxSEVyg90YD9Zs00RGjgeiLF1ydvZ0Zco2r+ZsG/dtwaN7KWfGV2WdyNKnejYeFDpa7vDXZtcnuV6sPvHvyXiitxUUxQF9pBZ3PCy6kiRMq+NScFKc5UdlTqCiCgWEMEIGwhTyAXpCCiM7Xstd6wRTJ0/TxbjjULDxUeY/R51kpT1VwUsd0IjdgFw0DowWRis1x+FWH53Aisw4jwgbdt/IBXe5q/U/OkG0zsNS6GZg1G7KqPCwoURoSTzDfYddo4bcTHhdM7B7NtESBXmjUCVnfTCsB2a/kARXILHEAwY6lNnczXEPsEWdByYQpRpGr3YnN5WUZMPgamjvF3yAJ7csuqBg5zDi/35b/7LhpZN+f8jCEhxK2ugcFTVBIWgu4sVSZP8PIBseWv7Q9Xp5ikOghEhniHmDvbJU9saCvMucqn+TOtRwKGX2Gf/WuCRtdV+WJdj2YRuGrGB4I8tlNiflKUvWCFbaZ6i7IgXMHVZrX1yGZ/KyA4TVgL2+ZG0kRskGElB7uGOnoNWZ+Y5N/lYwPo9gAQSvo9ivg5ickbdQcJW72WDSrNgQI6A37ngBVX8+iX+mFLrpa8BzlfQSicQ9N1oMxATHEGifruMtaabfF8YrPdMzTjycToebe0D/eC0Ea84l5fKwsG+5Xtt6ozEid4fOgzg22JKG0ch+lDgnA3mEIXZJUVCgvWF5fYwReJEUcplfz5SAiIz37oQFacvb8kd47WG4ur37EZE/B4l3+TkeknlVQvgUaQSv7ieqIRmGzSXUnoitUT8mN6EktZa2fmgEOcPMAf72j41xgwKvVp+yHM2qOr1p/6JQr5mo6yIYV3ZpwA7qwu3pwJTO1yHoVbCIJRk7xgIIl0CuAZFHt4rLzrel3sz6q9LlX6Zhl+2wnVDqzYwgDgoK7sX3wJXzFUPVx6ikv2ATT/NqnIq+RqU0ylVoOV2ClyoSsOLs+J5wVM WrjffR90 DGHCOCcx4FB+a9Fo2BOqE/po5vpTOcEfc3goBcd5nd4DHajTvHqweSRpZfnHawN0Wtqrx X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Functionally, no change. This is a preparation for luf mechanism that tracks need of tlb flush for each page residing in buddy. Since the private field in struct page is used only to store page order in buddy, ranging from 0 to MAX_PAGE_ORDER, that can be covered with unsigned short. So splitted it into two smaller ones, order and luf_key, so that the both can be used in buddy at the same time. Signed-off-by: Byungchul Park --- include/linux/mm_types.h | 42 +++++++++++++++++++++++++++++++++------- mm/internal.h | 4 ++-- mm/page_alloc.c | 2 +- 3 files changed, 38 insertions(+), 10 deletions(-) diff --git a/include/linux/mm_types.h b/include/linux/mm_types.h index 0234f14f2aa6b..7d78a285e52ca 100644 --- a/include/linux/mm_types.h +++ b/include/linux/mm_types.h @@ -106,13 +106,27 @@ struct page { pgoff_t index; /* Our offset within mapping. */ unsigned long share; /* share count for fsdax */ }; - /** - * @private: Mapping-private opaque data. - * Usually used for buffer_heads if PagePrivate. - * Used for swp_entry_t if swapcache flag set. - * Indicates order in the buddy system if PageBuddy. - */ - unsigned long private; + union { + /** + * @private: Mapping-private opaque data. + * Usually used for buffer_heads if PagePrivate. + * Used for swp_entry_t if swapcache flag set. + * Indicates order in the buddy system if PageBuddy. + */ + unsigned long private; + struct { + /* + * Indicates order in the buddy system if PageBuddy. + */ + unsigned short order; + + /* + * For tracking need of tlb flush, + * by luf(lazy unmap flush). + */ + unsigned short luf_key; + }; + }; }; struct { /* page_pool used by netstack */ /** @@ -566,6 +580,20 @@ static inline void set_page_private(struct page *page, unsigned long private) page->private = private; } +#define page_buddy_order(page) ((page)->order) + +static inline void set_page_buddy_order(struct page *page, unsigned int order) +{ + page->order = (unsigned short)order; +} + +#define page_luf_key(page) ((page)->luf_key) + +static inline void set_page_luf_key(struct page *page, unsigned short luf_key) +{ + page->luf_key = luf_key; +} + static inline void *folio_get_private(struct folio *folio) { return folio->private; diff --git a/mm/internal.h b/mm/internal.h index 109ef30fee11f..d7161a6e0b352 100644 --- a/mm/internal.h +++ b/mm/internal.h @@ -543,7 +543,7 @@ struct alloc_context { static inline unsigned int buddy_order(struct page *page) { /* PageBuddy() must be checked by the caller */ - return page_private(page); + return page_buddy_order(page); } /* @@ -557,7 +557,7 @@ static inline unsigned int buddy_order(struct page *page) * times, potentially observing different values in the tests and the actual * use of the result. */ -#define buddy_order_unsafe(page) READ_ONCE(page_private(page)) +#define buddy_order_unsafe(page) READ_ONCE(page_buddy_order(page)) /* * This function checks whether a page is free && is the buddy diff --git a/mm/page_alloc.c b/mm/page_alloc.c index 579789600a3c7..c08b1389d5671 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -576,7 +576,7 @@ void prep_compound_page(struct page *page, unsigned int order) static inline void set_buddy_order(struct page *page, unsigned int order) { - set_page_private(page, order); + set_page_buddy_order(page, order); __SetPageBuddy(page); }