From patchwork Tue Apr 8 08:41:51 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Oscar Salvador X-Patchwork-Id: 14042402 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 43730C369A1 for ; Tue, 8 Apr 2025 08:42:22 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id BFC0E6B000A; Tue, 8 Apr 2025 04:42:20 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id BACBA6B000C; Tue, 8 Apr 2025 04:42:20 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A4B846B000D; Tue, 8 Apr 2025 04:42:20 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 844146B000A for ; Tue, 8 Apr 2025 04:42:20 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 3CAC25893F for ; Tue, 8 Apr 2025 08:42:21 +0000 (UTC) X-FDA: 83310234882.30.FFCD595 Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.223.130]) by imf25.hostedemail.com (Postfix) with ESMTP id 3FE5CA0008 for ; Tue, 8 Apr 2025 08:42:19 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=2XwOos+r; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=yTNQnpGT; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=2XwOos+r; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=yTNQnpGT; spf=pass (imf25.hostedemail.com: domain of osalvador@suse.de designates 195.135.223.130 as permitted sender) smtp.mailfrom=osalvador@suse.de; dmarc=pass (policy=none) header.from=suse.de ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1744101739; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=OY+ktWKu7rfDC6OOLEBMjxNMAtURJVUDnyjqclkHyqM=; b=eoe7egYH7PaBVisEdBU+quFzGni31VlYRdBbbfu1zfI/uqeZQBAmR8kus0Gl8Cvk36LNS+ g0h1L/NJAot9+29niwE3NTqYCz7Dh6E48ItkHqdAnP5Ra7CaOIuqNoupHkXIPXnTJ/wfVr IJV/W2peM539MUGDsapVYFFUmPIS1js= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1744101739; a=rsa-sha256; cv=none; b=fc9pve11Pece0f5PMOGBOC/y+ru/uqcz/K7aeBaFv6yWKxrFGEhx3cuNCrTaAfaiu6G+1C FQ0lq5x9rJcdMVhLayFho0gPd1y6K7/R7ofKXpb3hLMHFWJdGkxFpq2pW6ambgkMu7Tiu+ d7KlbOpKJmv43eG6L1RS2JWawjtHv8I= ARC-Authentication-Results: i=1; imf25.hostedemail.com; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=2XwOos+r; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=yTNQnpGT; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=2XwOos+r; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=yTNQnpGT; spf=pass (imf25.hostedemail.com: domain of osalvador@suse.de designates 195.135.223.130 as permitted sender) smtp.mailfrom=osalvador@suse.de; dmarc=pass (policy=none) header.from=suse.de Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 8F70F21185; Tue, 8 Apr 2025 08:42:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744101735; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OY+ktWKu7rfDC6OOLEBMjxNMAtURJVUDnyjqclkHyqM=; b=2XwOos+reVOOfP6FDGwVtID+hc1km1M67+rQc5mr+wTPYI+REDBlJopVzQMlrL1E7CAO3E lUZL0Ic521Xjz97TP4pFuGxx9Im+1n0C5l+Qu2L+8CF+krGA9KcSddez6DZ54mT/8hhuOJ o60Gtr334jhZUSn5GaswJ2c8wNyZDI4= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744101735; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OY+ktWKu7rfDC6OOLEBMjxNMAtURJVUDnyjqclkHyqM=; b=yTNQnpGT7fZKJ4td9Qa8ZhjB6Y7OIvjcsBUoPEfAj65BwcjwxQLJQ2GTC7ZjNZwKOLm8BS wl7Jz92XSxp3RgCA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744101735; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OY+ktWKu7rfDC6OOLEBMjxNMAtURJVUDnyjqclkHyqM=; b=2XwOos+reVOOfP6FDGwVtID+hc1km1M67+rQc5mr+wTPYI+REDBlJopVzQMlrL1E7CAO3E lUZL0Ic521Xjz97TP4pFuGxx9Im+1n0C5l+Qu2L+8CF+krGA9KcSddez6DZ54mT/8hhuOJ o60Gtr334jhZUSn5GaswJ2c8wNyZDI4= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744101735; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=OY+ktWKu7rfDC6OOLEBMjxNMAtURJVUDnyjqclkHyqM=; b=yTNQnpGT7fZKJ4td9Qa8ZhjB6Y7OIvjcsBUoPEfAj65BwcjwxQLJQ2GTC7ZjNZwKOLm8BS wl7Jz92XSxp3RgCA== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 0EAFA13691; Tue, 8 Apr 2025 08:42:15 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id cFXGAGfh9Gd6VgAAD6G6ig (envelope-from ); Tue, 08 Apr 2025 08:42:15 +0000 From: Oscar Salvador To: Andrew Morton Cc: David Hildenbrand , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Vlastimil Babka , Harry Yoo , Jonathan Cameron , linux-cxl@vger.kernel.org, Oscar Salvador Subject: [PATCH v2 1/3] mm,slub: Do not special case N_NORMAL nodes for slab_nodes Date: Tue, 8 Apr 2025 10:41:51 +0200 Message-ID: <20250408084153.255762-2-osalvador@suse.de> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250408084153.255762-1-osalvador@suse.de> References: <20250408084153.255762-1-osalvador@suse.de> MIME-Version: 1.0 X-Rspamd-Action: no action X-Rspam-User: X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: 3FE5CA0008 X-Stat-Signature: hwrgwdby6nh6bpsp7xsnszsqyynajmyu X-HE-Tag: 1744101739-542440 X-HE-Meta: U2FsdGVkX18qQLopwULF1vc3QueuPhMwi1Bn3RJIWM4ZdIfK1GP4+gPN4O48mfFORthFsei0QHYsZD5lm6sgm2+GJq1kPWf9kbttlMKo8qHgHbWDYJnWEjjZfj/CjEpTkTV/XgMQGPpHxL68qpmqBLZmpC1XxbAL0r7S8NengKdHE7E3L1k1iapdTqwMuLWCTCf8bEyDz0wDl8YU8X3ZBdc/3cpt7MKiYkBkWf/NE6/p9PtgjAV1wnwcxUJ9f9aTyedWR1B/j/GzkUIy694ufW8hUBPVqwgJIWT7ai2PIZAQ5BKAdbzfNPHyg+I2p/9WZQlKmE2K9eGDNM8/nC6EnCtigH6OsqHVrPoIxWNgmI+fsQ1+V+dsV2AJ3SzjXGmLdN1G9aBy/NG3vN5YfEOS3EPOTF+yF/kCupRhKlescwtMQJQYsFWykG1brRBgOsJqzgraWRi2IVioIMAbrVjG/0/baN4kqRUycvm+2Od4kxzbdUsJ6Q6JOnGtupzTrXyTRAJx4MRH7Lycla764YnAhA/1akZ+NyIlkB/uynOvP9HtX0tiOOblwSGTHXsdmgwtqNHc+BnaVoWdrrEqXzK/ePJnZziSbh2fi19vrEUZSmB6blfmUkpak+2gPtp5GXV/j4POZv2RuMeJ/GeRwJLE4vfqiCT8Y2a3xUvvXK+dnmjV1FxbqS8IT/F2rVCl5V9KamY6MX3F5i1iOouyOZEJLRPVKqxPd/ED5Wj2O8OMfKk6CfeRIlAteFyoSCGSrKOMew1HcFcn7etQelQefvxdzGSA0j5nMBfYfSS+44gYeHWzOpH+V7/iKDGNtfQ8z0z64EZhlNYqC8DQrscmeV2sYX0qsHxxkXV1ZfvhxnCONWtqDZ11Ple7L61TNnffUGjZgNgy+NP7ZvU7F17hapFHPy04lIqWCaXPQGlACTqTLKLMGQkV+7Y2D+ZtcYESaQepdSYnURzGNMFdAYJYcuq 1aAv2Pu7 ZNm6HiL2cdVMiuX0NATu00a9T2Rso6yV3Y3x1 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Currently, slab_mem_going_going_callback() checks whether the node has N_NORMAL memory in order to be set in slab_nodes. While it is true that gettind rid of that enforcing would mean ending up with movables nodes in slab_nodes, the memory waste that comes with that is negligible. So stop checking for status_change_nid_normal and just use status_change_nid instead which works for both types of memory. Also, once we allocate the kmem_cache_node cache for the node in slab_mem_online_callback(), we never deallocate it in slab_mem_off_callback() when the node goes memoryless, so we can just get rid of it. The only side effect is that we will stop clearing the node from slab_nodes. Signed-off-by: Oscar Salvador Signed-off-by: David Hildenbrand --- mm/slub.c | 30 +----------------------------- 1 file changed, 1 insertion(+), 29 deletions(-) diff --git a/mm/slub.c b/mm/slub.c index b46f87662e71..e716b4cb2d0e 100644 --- a/mm/slub.c +++ b/mm/slub.c @@ -6164,36 +6164,12 @@ static int slab_mem_going_offline_callback(void *arg) return 0; } -static void slab_mem_offline_callback(void *arg) -{ - struct memory_notify *marg = arg; - int offline_node; - - offline_node = marg->status_change_nid_normal; - - /* - * If the node still has available memory. we need kmem_cache_node - * for it yet. - */ - if (offline_node < 0) - return; - - mutex_lock(&slab_mutex); - node_clear(offline_node, slab_nodes); - /* - * We no longer free kmem_cache_node structures here, as it would be - * racy with all get_node() users, and infeasible to protect them with - * slab_mutex. - */ - mutex_unlock(&slab_mutex); -} - static int slab_mem_going_online_callback(void *arg) { struct kmem_cache_node *n; struct kmem_cache *s; struct memory_notify *marg = arg; - int nid = marg->status_change_nid_normal; + int nid = marg->status_change_nid; int ret = 0; /* @@ -6251,10 +6227,6 @@ static int slab_memory_callback(struct notifier_block *self, case MEM_GOING_OFFLINE: ret = slab_mem_going_offline_callback(arg); break; - case MEM_OFFLINE: - case MEM_CANCEL_ONLINE: - slab_mem_offline_callback(arg); - break; case MEM_ONLINE: case MEM_CANCEL_OFFLINE: break; From patchwork Tue Apr 8 08:41:52 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Oscar Salvador X-Patchwork-Id: 14042403 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B36C2C3600C for ; Tue, 8 Apr 2025 08:42:23 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id F0BF46B000C; Tue, 8 Apr 2025 04:42:21 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E951E6B000D; Tue, 8 Apr 2025 04:42:21 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C74BE6B000E; Tue, 8 Apr 2025 04:42:21 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 95C8E6B000C for ; Tue, 8 Apr 2025 04:42:21 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 4C8A112073A for ; Tue, 8 Apr 2025 08:42:22 +0000 (UTC) X-FDA: 83310234924.30.134F070 Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.223.131]) by imf25.hostedemail.com (Postfix) with ESMTP id 24500A000B for ; Tue, 8 Apr 2025 08:42:19 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=vaKKwyCW; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=3omQtDWM; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=OstABFl3; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=KjDnF2o5; spf=pass (imf25.hostedemail.com: domain of osalvador@suse.de designates 195.135.223.131 as permitted sender) smtp.mailfrom=osalvador@suse.de; dmarc=pass (policy=none) header.from=suse.de ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1744101740; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=iRJIRa1nusEckmUT9EBTkRycb79M/nbC/V9st37VTJs=; b=bB+jjAmBcvStQBrYwpEVfIK4ojsx/7/BEdat2TZedLvncEuOt58pd3HkvbOdTv234mt9oK Z+s2F5DLI7X5a+Qbg5aLPL1kLNHk9OKauQ8C2/q+5nBZkOfSVDOd0i8KCtowCgCSjqDg2j DgInIpfUB7kIjNm2lU800+auIugmVuk= ARC-Authentication-Results: i=1; imf25.hostedemail.com; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=vaKKwyCW; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=3omQtDWM; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=OstABFl3; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=KjDnF2o5; spf=pass (imf25.hostedemail.com: domain of osalvador@suse.de designates 195.135.223.131 as permitted sender) smtp.mailfrom=osalvador@suse.de; dmarc=pass (policy=none) header.from=suse.de ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1744101740; a=rsa-sha256; cv=none; b=auO2Bxc6XzQ/KQNVytMzfeT2wPKxlOdiOKpCVaLjqUX6Ym/7h5HdMBeftvnGvOK7aJG9gI 5W85uAwtIq/uBwmzhpJC3I7lmcQeDSmACaFlDLIiucwaE1igRwHyx7sXJ+93mEECdKKfg9 qaBcBJboZU2/v+FgkyDXTHtljh69inU= Received: from imap1.dmz-prg2.suse.org (unknown [10.150.64.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id 719BA1F395; Tue, 8 Apr 2025 08:42:17 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744101738; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iRJIRa1nusEckmUT9EBTkRycb79M/nbC/V9st37VTJs=; b=vaKKwyCWmNRP3SalZqr1q/030/WDz2TCiKPv8SlnHE2GKCcpcWKnfXXQICKvtTnWs/2WHV AQX7LgRiTjbXqaJxMkmw00XngdC6V2e2Cnpj3SU4KDNngZ38HlSeEG0TW6ZKmS7d4ZugN8 m/gvCvVcHDtQuTKnkrrEjemQh9zK/Lc= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744101738; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iRJIRa1nusEckmUT9EBTkRycb79M/nbC/V9st37VTJs=; b=3omQtDWM/9f5HhTy72ygeGc5pKx//1Hc6NAW7A3KcFjPj2tKojAyJpSl4UsuXSVMYgYpIG h71GeuoCq6ahzJCA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744101737; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iRJIRa1nusEckmUT9EBTkRycb79M/nbC/V9st37VTJs=; b=OstABFl3WVco/MvfHCQY+CuIJ5OEg+hazdrrs6OrXLmJoPmuQyaHAs27HrI0iz4+RYAj/j gLZLAbZqe5WeuZ7EGTX7HMTtqk4cjqugetYe1VdAFrhrjT/Nm7uXqDzGYeL3wYL7l9rMfS AleCFiNFOhTDYeyI9ceNvhpkiLTF+Mo= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744101737; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iRJIRa1nusEckmUT9EBTkRycb79M/nbC/V9st37VTJs=; b=KjDnF2o5clbpOhry3V4r98AXIUAmyAvAZeMV8E9Owgbh+TFsCnySO/XqW4NGZbotJzb9Xu c1gjlZSZ+YBUwICw== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id E4D6A13691; Tue, 8 Apr 2025 08:42:16 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id sEziNGjh9Gd6VgAAD6G6ig (envelope-from ); Tue, 08 Apr 2025 08:42:16 +0000 From: Oscar Salvador To: Andrew Morton Cc: David Hildenbrand , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Vlastimil Babka , Harry Yoo , Jonathan Cameron , linux-cxl@vger.kernel.org, Oscar Salvador Subject: [PATCH v2 2/3] mm,memory_hotplug: Implement numa node notifier Date: Tue, 8 Apr 2025 10:41:52 +0200 Message-ID: <20250408084153.255762-3-osalvador@suse.de> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250408084153.255762-1-osalvador@suse.de> References: <20250408084153.255762-1-osalvador@suse.de> MIME-Version: 1.0 X-Rspamd-Queue-Id: 24500A000B X-Rspamd-Server: rspam05 X-Rspam-User: X-Stat-Signature: i1oqaw4nwp36yeyajmqymrj9yc4tqy5g X-HE-Tag: 1744101739-764903 X-HE-Meta: U2FsdGVkX1/3avilJ5hj9xMddIsjvHT7s8LIH9k/iA1gQdUJrbl8uNEVCBQJCGROoTllEy3VHNSnWynnLJoZXRrYlgbuBr+dIhFjaVVwiNkH8PnY81skcmrSz9mC3nWZRPe1Xf6jYDTCmg6IGc+mo9m0cB7yKXq7H4P4r/IItDq6UDcQKIfGAvWowOh1ytU0Riy0MxQuWbEX7zjVVmNdyRf7Uo4pVju5IgzKRPwlf3Men4Tczga1u+xlJqPRu3HwT9ip9dFvIEOVxe06ViSePbtHjmSw4MYGurKzHPBETGqL+GvFscvP9mssma9FH7O6UfI6U2Sdew3WOIz3lXqZ746D/8fkTTyl6IqHz++BOCelF/4Xf5l8K98W38xjx9OUcxHUExXU0c5SikLcwxnUTeDSj9IntGZJr15MdHXWKyEZRhMaKXUumKn2yLpN2oKf1dY/tx7otnvyr4XhWXCwz4B8dV/3MC52QnKA5ZskWN92yS3PsCdOWipxqdUaPcmqBuLLhJprRnrAa7tEheHWUWJrNvSAO6UJWK/1OgYbKCrBHIGfrDkVZUp07W2Hm0SfQulo/pCa+iF65FmiECDy2EjZ29ORLeQXZWwEDKj/xAKYqcTWvSW9zh4uriKTwD6/2S1/hyCxhatpRNWn9B2AWQ5eryEEPcgT1RtM1GIVG6jSKEc/OGyDwbMQm/PUxxqnFM0l7JaL8nZZN44gDVPayNXJZMTu4IM33C7gXyGsyBZ8IIMeEu+Hs1OEfO4vCslPC8a1Em3+G8cQ886ZJ7MI8YFXU7AF14IIk3UIt5wSAgAi4tcOgb11wG3m9gt2hbLifLnPTyXony0M9wdBv7U+p6nrLx52dgXz/ccgRKeo69s8LlUTyRKvzhUee4/sawxbstp1C9ITp9y2jaYSLkkrDChj76Df5L3eDe3wjQOpIOIHE930XCGuri/o2oYuifZv6JbmfQNH7gAMa8p3MN/ CUdHWdz0 ziohgM8+0Zmf1XS08VNVucbPRV52oi7jts5/mM4YRkDbf76TZFKx2PeLtergxnKkYojIV4amfs4vMDezm26xQoTePkM2aDnRusSdsLgiunLB+RUNhVYpmw2jdv6llN3F69OK4lKzkYLJ1wX8jsnE43gQ8mUx1aUPa2IDOGDSFNeyg4QqqtUjbu+P0l6vRgebeYlzlihKnNp4T+DetVkbD/3zoLXG7MgmS9As++lk8IM1PuT5NgDhJEIGrDA4BqiRR0Go1sxWKxzF57/LAb4js16OJfI58M4ihxekkYCQ5FVMJRFtd8ohyW5ITrl3IvLbX/m0LEDB8T1j8h1Axj8aM5Sw30u44tWct9mKz X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: There are at least five consumers of hotplug_memory_notifier that what they really are interested in is whether any numa node changed its state, e.g: going from being memory aware to becoming memoryless and vice versa. Implement a specific notifier for numa nodes when their state gets changed, and have those consumers that only care about numa node state changes use it. Signed-off-by: Oscar Salvador Reviewed-by: Harry Yoo Reviewed-by: Jonathan Cameron --- drivers/acpi/numa/hmat.c | 6 +- drivers/base/node.c | 19 +++++++ drivers/cxl/core/region.c | 14 ++--- drivers/cxl/cxl.h | 4 +- include/linux/memory.h | 38 ++++++++++++- kernel/cgroup/cpuset.c | 2 +- mm/memory-tiers.c | 8 +-- mm/memory_hotplug.c | 117 +++++++++++++++++++++----------------- mm/slub.c | 13 ++--- 9 files changed, 144 insertions(+), 77 deletions(-) diff --git a/drivers/acpi/numa/hmat.c b/drivers/acpi/numa/hmat.c index bfbb08b1e6af..d18f3efa2149 100644 --- a/drivers/acpi/numa/hmat.c +++ b/drivers/acpi/numa/hmat.c @@ -918,10 +918,10 @@ static int hmat_callback(struct notifier_block *self, unsigned long action, void *arg) { struct memory_target *target; - struct memory_notify *mnb = arg; + struct node_notify *mnb = arg; int pxm, nid = mnb->status_change_nid; - if (nid == NUMA_NO_NODE || action != MEM_ONLINE) + if (nid == NUMA_NO_NODE || action != NODE_BECAME_MEM_AWARE) return NOTIFY_OK; pxm = node_to_pxm(nid); @@ -1074,7 +1074,7 @@ static __init int hmat_init(void) hmat_register_targets(); /* Keep the table and structures if the notifier may use them */ - if (hotplug_memory_notifier(hmat_callback, HMAT_CALLBACK_PRI)) + if (hotplug_node_notifier(hmat_callback, HMAT_CALLBACK_PRI)) goto out_put; if (!hmat_set_default_dram_perf()) diff --git a/drivers/base/node.c b/drivers/base/node.c index 0ea653fa3433..182c71dfb5b8 100644 --- a/drivers/base/node.c +++ b/drivers/base/node.c @@ -110,6 +110,25 @@ static const struct attribute_group *node_access_node_groups[] = { NULL, }; +static BLOCKING_NOTIFIER_HEAD(node_chain); + +int register_node_notifier(struct notifier_block *nb) +{ + return blocking_notifier_chain_register(&node_chain, nb); +} +EXPORT_SYMBOL(register_node_notifier); + +void unregister_node_notifier(struct notifier_block *nb) +{ + blocking_notifier_chain_unregister(&node_chain, nb); +} +EXPORT_SYMBOL(unregister_node_notifier); + +int node_notify(unsigned long val, void *v) +{ + return blocking_notifier_call_chain(&node_chain, val, v); +} + static void node_remove_accesses(struct node *node) { struct node_access_nodes *c, *cnext; diff --git a/drivers/cxl/core/region.c b/drivers/cxl/core/region.c index e8d11a988fd9..7d187088f557 100644 --- a/drivers/cxl/core/region.c +++ b/drivers/cxl/core/region.c @@ -2409,12 +2409,12 @@ static int cxl_region_perf_attrs_callback(struct notifier_block *nb, unsigned long action, void *arg) { struct cxl_region *cxlr = container_of(nb, struct cxl_region, - memory_notifier); - struct memory_notify *mnb = arg; + node_notifier); + struct node_notify *mnb = arg; int nid = mnb->status_change_nid; int region_nid; - if (nid == NUMA_NO_NODE || action != MEM_ONLINE) + if (nid == NUMA_NO_NODE || action != NODE_BECAME_MEM_AWARE) return NOTIFY_DONE; /* @@ -3388,7 +3388,7 @@ static void shutdown_notifiers(void *_cxlr) { struct cxl_region *cxlr = _cxlr; - unregister_memory_notifier(&cxlr->memory_notifier); + unregister_node_notifier(&cxlr->node_notifier); unregister_mt_adistance_algorithm(&cxlr->adist_notifier); } @@ -3427,9 +3427,9 @@ static int cxl_region_probe(struct device *dev) if (rc) return rc; - cxlr->memory_notifier.notifier_call = cxl_region_perf_attrs_callback; - cxlr->memory_notifier.priority = CXL_CALLBACK_PRI; - register_memory_notifier(&cxlr->memory_notifier); + cxlr->node_notifier.notifier_call = cxl_region_perf_attrs_callback; + cxlr->node_notifier.priority = CXL_CALLBACK_PRI; + register_node_notifier(&cxlr->node_notifier); cxlr->adist_notifier.notifier_call = cxl_region_calculate_adistance; cxlr->adist_notifier.priority = 100; diff --git a/drivers/cxl/cxl.h b/drivers/cxl/cxl.h index bbbaa0d0a670..d4c9a499de7a 100644 --- a/drivers/cxl/cxl.h +++ b/drivers/cxl/cxl.h @@ -532,7 +532,7 @@ struct cxl_region_params { * @flags: Region state flags * @params: active + config params for the region * @coord: QoS access coordinates for the region - * @memory_notifier: notifier for setting the access coordinates to node + * @node_notifier: notifier for setting the access coordinates to node * @adist_notifier: notifier for calculating the abstract distance of node */ struct cxl_region { @@ -545,7 +545,7 @@ struct cxl_region { unsigned long flags; struct cxl_region_params params; struct access_coordinate coord[ACCESS_COORDINATE_MAX]; - struct notifier_block memory_notifier; + struct notifier_block node_notifier; struct notifier_block adist_notifier; }; diff --git a/include/linux/memory.h b/include/linux/memory.h index 12daa6ec7d09..a5b8068cf182 100644 --- a/include/linux/memory.h +++ b/include/linux/memory.h @@ -99,6 +99,14 @@ int set_memory_block_size_order(unsigned int order); #define MEM_PREPARE_ONLINE (1<<6) #define MEM_FINISH_OFFLINE (1<<7) +/* These states are used for numa node notifiers */ +#define NODE_BECOMING_MEM_AWARE (1<<0) +#define NODE_BECAME_MEM_AWARE (1<<1) +#define NODE_BECOMING_MEMORYLESS (1<<2) +#define NODE_BECAME_MEMORYLESS (1<<3) +#define NODE_CANCEL_MEM_AWARE (1<<4) +#define NODE_CANCEL_MEMORYLESS (1<<5) + struct memory_notify { /* * The altmap_start_pfn and altmap_nr_pages fields are designated for @@ -109,7 +117,10 @@ struct memory_notify { unsigned long altmap_nr_pages; unsigned long start_pfn; unsigned long nr_pages; - int status_change_nid_normal; + int status_change_nid; +}; + +struct node_notify { int status_change_nid; }; @@ -149,15 +160,34 @@ static inline int hotplug_memory_notifier(notifier_fn_t fn, int pri) { return 0; } + +static inline int register_node_notifier(struct notifier_block *nb) +{ + return 0; +} +static inline void unregister_node_notifier(struct notifier_block *nb) +{ +} +static inline int node_notify(unsigned long val, void *v) +{ + return 0; +} +static inline int hotplug_node_notifier(notifier_fn_t fn, int pri) +{ + return 0; +} #else /* CONFIG_MEMORY_HOTPLUG */ extern int register_memory_notifier(struct notifier_block *nb); +extern int register_node_notifier(struct notifier_block *nb); extern void unregister_memory_notifier(struct notifier_block *nb); +extern void unregister_node_notifier(struct notifier_block *nb); int create_memory_block_devices(unsigned long start, unsigned long size, struct vmem_altmap *altmap, struct memory_group *group); void remove_memory_block_devices(unsigned long start, unsigned long size); extern void memory_dev_init(void); extern int memory_notify(unsigned long val, void *v); +extern int node_notify(unsigned long val, void *v); extern struct memory_block *find_memory_block(unsigned long section_nr); typedef int (*walk_memory_blocks_func_t)(struct memory_block *, void *); extern int walk_memory_blocks(unsigned long start, unsigned long size, @@ -177,6 +207,12 @@ int walk_dynamic_memory_groups(int nid, walk_memory_groups_func_t func, register_memory_notifier(&fn##_mem_nb); \ }) +#define hotplug_node_notifier(fn, pri) ({ \ + static __meminitdata struct notifier_block fn##_node_nb =\ + { .notifier_call = fn, .priority = pri };\ + register_node_notifier(&fn##_node_nb); \ +}) + #ifdef CONFIG_NUMA void memory_block_add_nid(struct memory_block *mem, int nid, enum meminit_context context); diff --git a/kernel/cgroup/cpuset.c b/kernel/cgroup/cpuset.c index 39c1fc643d77..3323cf2124bf 100644 --- a/kernel/cgroup/cpuset.c +++ b/kernel/cgroup/cpuset.c @@ -3938,7 +3938,7 @@ void __init cpuset_init_smp(void) cpumask_copy(top_cpuset.effective_cpus, cpu_active_mask); top_cpuset.effective_mems = node_states[N_MEMORY]; - hotplug_memory_notifier(cpuset_track_online_nodes, CPUSET_CALLBACK_PRI); + hotplug_node_notifier(cpuset_track_online_nodes, CPUSET_CALLBACK_PRI); cpuset_migrate_mm_wq = alloc_ordered_workqueue("cpuset_migrate_mm", 0); BUG_ON(!cpuset_migrate_mm_wq); diff --git a/mm/memory-tiers.c b/mm/memory-tiers.c index fc14fe53e9b7..dfe6c28c8352 100644 --- a/mm/memory-tiers.c +++ b/mm/memory-tiers.c @@ -872,7 +872,7 @@ static int __meminit memtier_hotplug_callback(struct notifier_block *self, unsigned long action, void *_arg) { struct memory_tier *memtier; - struct memory_notify *arg = _arg; + struct node_notify *arg = _arg; /* * Only update the node migration order when a node is @@ -882,13 +882,13 @@ static int __meminit memtier_hotplug_callback(struct notifier_block *self, return notifier_from_errno(0); switch (action) { - case MEM_OFFLINE: + case NODE_BECAME_MEMORYLESS: mutex_lock(&memory_tier_lock); if (clear_node_memory_tier(arg->status_change_nid)) establish_demotion_targets(); mutex_unlock(&memory_tier_lock); break; - case MEM_ONLINE: + case NODE_BECAME_MEM_AWARE: mutex_lock(&memory_tier_lock); memtier = set_node_memory_tier(arg->status_change_nid); if (!IS_ERR(memtier)) @@ -929,7 +929,7 @@ static int __init memory_tier_init(void) nodes_and(default_dram_nodes, node_states[N_MEMORY], node_states[N_CPU]); - hotplug_memory_notifier(memtier_hotplug_callback, MEMTIER_HOTPLUG_PRI); + hotplug_node_notifier(memtier_hotplug_callback, MEMTIER_HOTPLUG_PRI); return 0; } subsys_initcall(memory_tier_init); diff --git a/mm/memory_hotplug.c b/mm/memory_hotplug.c index 8305483de38b..84248f2e36f8 100644 --- a/mm/memory_hotplug.c +++ b/mm/memory_hotplug.c @@ -701,24 +701,18 @@ static void online_pages_range(unsigned long start_pfn, unsigned long nr_pages) /* check which state of node_states will be changed when online memory */ static void node_states_check_changes_online(unsigned long nr_pages, - struct zone *zone, struct memory_notify *arg) + struct zone *zone, struct node_notify *arg) { int nid = zone_to_nid(zone); arg->status_change_nid = NUMA_NO_NODE; - arg->status_change_nid_normal = NUMA_NO_NODE; if (!node_state(nid, N_MEMORY)) arg->status_change_nid = nid; - if (zone_idx(zone) <= ZONE_NORMAL && !node_state(nid, N_NORMAL_MEMORY)) - arg->status_change_nid_normal = nid; } -static void node_states_set_node(int node, struct memory_notify *arg) +static void node_states_set_node(int node, struct node_notify *arg) { - if (arg->status_change_nid_normal >= 0) - node_set_state(node, N_NORMAL_MEMORY); - if (arg->status_change_nid >= 0) node_set_state(node, N_MEMORY); } @@ -1177,7 +1171,9 @@ int online_pages(unsigned long pfn, unsigned long nr_pages, int need_zonelists_rebuild = 0; const int nid = zone_to_nid(zone); int ret; - struct memory_notify arg; + struct memory_notify mem_arg; + struct node_notify node_arg; + bool cancel_mem_notifier_on_err = false, cancel_node_notifier_on_err = false; /* * {on,off}lining is constrained to full memory sections (or more @@ -1194,11 +1190,22 @@ int online_pages(unsigned long pfn, unsigned long nr_pages, /* associate pfn range with the zone */ move_pfn_range_to_zone(zone, pfn, nr_pages, NULL, MIGRATE_ISOLATE); - arg.start_pfn = pfn; - arg.nr_pages = nr_pages; - node_states_check_changes_online(nr_pages, zone, &arg); + mem_arg.start_pfn = pfn; + mem_arg.nr_pages = nr_pages; + node_states_check_changes_online(nr_pages, zone, &node_arg); + + if (node_arg.status_change_nid >= 0) { + /* Node is becoming memory aware. Notify consumers */ + cancel_node_notifier_on_err = true; + ret = node_notify(NODE_BECOMING_MEM_AWARE, &node_arg); + ret = notifier_to_errno(ret); + if (ret) + goto failed_addition; + } - ret = memory_notify(MEM_GOING_ONLINE, &arg); + cancel_mem_notifier_on_err = true; + mem_arg.status_change_nid = node_arg.status_change_nid; + ret = memory_notify(MEM_GOING_ONLINE, &mem_arg); ret = notifier_to_errno(ret); if (ret) goto failed_addition; @@ -1224,7 +1231,7 @@ int online_pages(unsigned long pfn, unsigned long nr_pages, online_pages_range(pfn, nr_pages); adjust_present_page_count(pfn_to_page(pfn), group, nr_pages); - node_states_set_node(nid, &arg); + node_states_set_node(nid, &node_arg); if (need_zonelists_rebuild) build_all_zonelists(NULL); @@ -1245,16 +1252,26 @@ int online_pages(unsigned long pfn, unsigned long nr_pages, kswapd_run(nid); kcompactd_run(nid); + if (node_arg.status_change_nid >= 0) + /* + * Node went from memoryless to have memory. Notifiy interested + * consumers + */ + node_notify(NODE_BECAME_MEM_AWARE, &node_arg); + writeback_set_ratelimit(); - memory_notify(MEM_ONLINE, &arg); + memory_notify(MEM_ONLINE, &mem_arg); return 0; failed_addition: pr_debug("online_pages [mem %#010llx-%#010llx] failed\n", (unsigned long long) pfn << PAGE_SHIFT, (((unsigned long long) pfn + nr_pages) << PAGE_SHIFT) - 1); - memory_notify(MEM_CANCEL_ONLINE, &arg); + if (cancel_mem_notifier_on_err) + memory_notify(MEM_CANCEL_ONLINE, &mem_arg); + if (cancel_node_notifier_on_err) + node_notify(NODE_CANCEL_MEM_AWARE, &node_arg); remove_pfn_range_from_zone(zone, pfn, nr_pages); return ret; } @@ -1892,48 +1909,29 @@ early_param("movable_node", cmdline_parse_movable_node); /* check which state of node_states will be changed when offline memory */ static void node_states_check_changes_offline(unsigned long nr_pages, - struct zone *zone, struct memory_notify *arg) + struct zone *zone, struct node_notify *arg) { struct pglist_data *pgdat = zone->zone_pgdat; unsigned long present_pages = 0; enum zone_type zt; arg->status_change_nid = NUMA_NO_NODE; - arg->status_change_nid_normal = NUMA_NO_NODE; /* - * Check whether node_states[N_NORMAL_MEMORY] will be changed. - * If the memory to be offline is within the range - * [0..ZONE_NORMAL], and it is the last present memory there, - * the zones in that range will become empty after the offlining, - * thus we can determine that we need to clear the node from - * node_states[N_NORMAL_MEMORY]. + * Here we count the possible pages within the range [0..ZONE_MOVABLE]. + * If after having accounted all the pages, we see that the nr_pages to + * be offlined is over or equal to the accounted pages, we know that the + * node will become empty, ans so, we can clear it for N_MEMORY. */ - for (zt = 0; zt <= ZONE_NORMAL; zt++) + for (zt = 0; zt <= ZONE_MOVABLE; zt++) present_pages += pgdat->node_zones[zt].present_pages; - if (zone_idx(zone) <= ZONE_NORMAL && nr_pages >= present_pages) - arg->status_change_nid_normal = zone_to_nid(zone); - - /* - * We have accounted the pages from [0..ZONE_NORMAL); ZONE_HIGHMEM - * does not apply as we don't support 32bit. - * Here we count the possible pages from ZONE_MOVABLE. - * If after having accounted all the pages, we see that the nr_pages - * to be offlined is over or equal to the accounted pages, - * we know that the node will become empty, and so, we can clear - * it for N_MEMORY as well. - */ - present_pages += pgdat->node_zones[ZONE_MOVABLE].present_pages; if (nr_pages >= present_pages) arg->status_change_nid = zone_to_nid(zone); } -static void node_states_clear_node(int node, struct memory_notify *arg) +static void node_states_clear_node(int node, struct node_notify *arg) { - if (arg->status_change_nid_normal >= 0) - node_clear_state(node, N_NORMAL_MEMORY); - if (arg->status_change_nid >= 0) node_clear_state(node, N_MEMORY); } @@ -1957,7 +1955,9 @@ int offline_pages(unsigned long start_pfn, unsigned long nr_pages, unsigned long pfn, managed_pages, system_ram_pages = 0; const int node = zone_to_nid(zone); unsigned long flags; - struct memory_notify arg; + struct memory_notify mem_arg; + struct node_notify node_arg; + bool cancel_mem_notifier_on_err = false, cancel_node_notifier_on_err = false; char *reason; int ret; @@ -2016,11 +2016,21 @@ int offline_pages(unsigned long start_pfn, unsigned long nr_pages, goto failed_removal_pcplists_disabled; } - arg.start_pfn = start_pfn; - arg.nr_pages = nr_pages; - node_states_check_changes_offline(nr_pages, zone, &arg); + mem_arg.start_pfn = start_pfn; + mem_arg.nr_pages = nr_pages; + node_states_check_changes_offline(nr_pages, zone, &node_arg); + + if (node_arg.status_change_nid >= 0) { + cancel_node_notifier_on_err = true; + ret = node_notify(NODE_BECOMING_MEMORYLESS, &node_arg); + ret = notifier_to_errno(ret); + if (ret) + goto failed_removal_isolated; + } - ret = memory_notify(MEM_GOING_OFFLINE, &arg); + cancel_mem_notifier_on_err = true; + mem_arg.status_change_nid = node_arg.status_change_nid; + ret = memory_notify(MEM_GOING_OFFLINE, &mem_arg); ret = notifier_to_errno(ret); if (ret) { reason = "notifier failure"; @@ -2100,27 +2110,32 @@ int offline_pages(unsigned long start_pfn, unsigned long nr_pages, * Make sure to mark the node as memory-less before rebuilding the zone * list. Otherwise this node would still appear in the fallback lists. */ - node_states_clear_node(node, &arg); + node_states_clear_node(node, &node_arg); if (!populated_zone(zone)) { zone_pcp_reset(zone); build_all_zonelists(NULL); } - if (arg.status_change_nid >= 0) { + if (node_arg.status_change_nid >= 0) { kcompactd_stop(node); kswapd_stop(node); + /* Node went memoryless. Notifiy interested consumers */ + node_notify(NODE_BECAME_MEMORYLESS, &node_arg); } writeback_set_ratelimit(); - memory_notify(MEM_OFFLINE, &arg); + memory_notify(MEM_OFFLINE, &mem_arg); remove_pfn_range_from_zone(zone, start_pfn, nr_pages); return 0; failed_removal_isolated: /* pushback to free area */ undo_isolate_page_range(start_pfn, end_pfn, MIGRATE_MOVABLE); - memory_notify(MEM_CANCEL_OFFLINE, &arg); + if (cancel_mem_notifier_on_err) + memory_notify(MEM_CANCEL_OFFLINE, &mem_arg); + if (cancel_node_notifier_on_err) + node_notify(NODE_CANCEL_MEMORYLESS, &node_arg); failed_removal_pcplists_disabled: lru_cache_enable(); zone_pcp_enable(zone); diff --git a/mm/slub.c b/mm/slub.c index e716b4cb2d0e..5c0f5d33b551 100644 --- a/mm/slub.c +++ b/mm/slub.c @@ -6168,8 +6168,8 @@ static int slab_mem_going_online_callback(void *arg) { struct kmem_cache_node *n; struct kmem_cache *s; - struct memory_notify *marg = arg; - int nid = marg->status_change_nid; + struct node_notify *narg = arg; + int nid = narg->status_change_nid; int ret = 0; /* @@ -6221,15 +6221,12 @@ static int slab_memory_callback(struct notifier_block *self, int ret = 0; switch (action) { - case MEM_GOING_ONLINE: + case NODE_BECOMING_MEM_AWARE: ret = slab_mem_going_online_callback(arg); break; - case MEM_GOING_OFFLINE: + case NODE_BECOMING_MEMORYLESS: ret = slab_mem_going_offline_callback(arg); break; - case MEM_ONLINE: - case MEM_CANCEL_OFFLINE: - break; } if (ret) ret = notifier_from_errno(ret); @@ -6304,7 +6301,7 @@ void __init kmem_cache_init(void) sizeof(struct kmem_cache_node), SLAB_HWCACHE_ALIGN | SLAB_NO_OBJ_EXT, 0, 0); - hotplug_memory_notifier(slab_memory_callback, SLAB_CALLBACK_PRI); + hotplug_node_notifier(slab_memory_callback, SLAB_CALLBACK_PRI); /* Able to allocate the per node structures */ slab_state = PARTIAL; From patchwork Tue Apr 8 08:41:53 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Oscar Salvador X-Patchwork-Id: 14042404 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 351B1C369A1 for ; Tue, 8 Apr 2025 08:42:30 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A3B316B0010; Tue, 8 Apr 2025 04:42:28 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 9EB896B0011; Tue, 8 Apr 2025 04:42:28 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 864CC6B0012; Tue, 8 Apr 2025 04:42:28 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 64C206B0010 for ; Tue, 8 Apr 2025 04:42:28 -0400 (EDT) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 2E262140841 for ; Tue, 8 Apr 2025 08:42:29 +0000 (UTC) X-FDA: 83310235218.07.C3733C8 Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.223.131]) by imf16.hostedemail.com (Postfix) with ESMTP id F3BD4180002 for ; Tue, 8 Apr 2025 08:42:26 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=G6x6iznC; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=x8d0FELz; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=G6x6iznC; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=x8d0FELz; spf=pass (imf16.hostedemail.com: domain of osalvador@suse.de designates 195.135.223.131 as permitted sender) smtp.mailfrom=osalvador@suse.de; dmarc=pass (policy=none) header.from=suse.de ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1744101747; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=EbHqyD5MPLNmbHBByHN31fJenBrFZtOPsSi4jdC01rk=; b=xT0q6iynichHiYKi7XWewYeZ0Kkqzn+wmU6sVJKBevnDkInTiQwOIH8YlRTJm56NWVYODG KvbV6t65IsYxrlwZphQAXxv+XXpY0r9hURR6P9DdB4JHA/3rsPNO5B0Jm3/ESCx5MK4qd6 T44M31ZKvaPxabhB727tjtmlPkX+Ob4= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1744101747; a=rsa-sha256; cv=none; b=xyusm2GB30BjnJPL+DasvrkiUcYCdIR8P86liiQ96i455mhdt0LEzRyVT2uBV87Scjwica qziHumxf8TOZHTm0Aum5aF8OJ1KR9s4fBoQ+k7l4b6UQmjGDh6R4d6FxJdv7KmImnohZRB C1kfTm+A0Ga7qI9fWjJqwqGdDVZJSqY= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=G6x6iznC; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=x8d0FELz; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=G6x6iznC; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b=x8d0FELz; spf=pass (imf16.hostedemail.com: domain of osalvador@suse.de designates 195.135.223.131 as permitted sender) smtp.mailfrom=osalvador@suse.de; dmarc=pass (policy=none) header.from=suse.de Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id 94EF01F388; Tue, 8 Apr 2025 08:42:18 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744101738; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EbHqyD5MPLNmbHBByHN31fJenBrFZtOPsSi4jdC01rk=; b=G6x6iznCrdzY0itk2HMicKZH0IC8c06xkBWSokxCN6boaS04LYm+Rw4o8JGBWeRoM9wkYq i8D2RmlNBK3DLacMQwFmpQZvrrg157UV8Oe0q1LA/IDLKU6TZm00onqcqs9UnBCbgVCxz2 8nDLXcCD8E1MzdRVdslqdjDVV5JxR54= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744101738; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EbHqyD5MPLNmbHBByHN31fJenBrFZtOPsSi4jdC01rk=; b=x8d0FELzVTCthqRW8sKH9jRxMbo2+4oBUED76yIjwVqCt4WZlh4pnfViRcmW84h7DxCmfA EUU+QMnPB+sS+rCg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744101738; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EbHqyD5MPLNmbHBByHN31fJenBrFZtOPsSi4jdC01rk=; b=G6x6iznCrdzY0itk2HMicKZH0IC8c06xkBWSokxCN6boaS04LYm+Rw4o8JGBWeRoM9wkYq i8D2RmlNBK3DLacMQwFmpQZvrrg157UV8Oe0q1LA/IDLKU6TZm00onqcqs9UnBCbgVCxz2 8nDLXcCD8E1MzdRVdslqdjDVV5JxR54= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744101738; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EbHqyD5MPLNmbHBByHN31fJenBrFZtOPsSi4jdC01rk=; b=x8d0FELzVTCthqRW8sKH9jRxMbo2+4oBUED76yIjwVqCt4WZlh4pnfViRcmW84h7DxCmfA EUU+QMnPB+sS+rCg== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 146F313A80; Tue, 8 Apr 2025 08:42:18 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id +LYwAmrh9Gd6VgAAD6G6ig (envelope-from ); Tue, 08 Apr 2025 08:42:18 +0000 From: Oscar Salvador To: Andrew Morton Cc: David Hildenbrand , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Vlastimil Babka , Harry Yoo , Jonathan Cameron , linux-cxl@vger.kernel.org, Oscar Salvador Subject: [PATCH v2 3/3] mm,memory_hotplug: Rename status_change_nid parameter in memory_notify Date: Tue, 8 Apr 2025 10:41:53 +0200 Message-ID: <20250408084153.255762-4-osalvador@suse.de> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250408084153.255762-1-osalvador@suse.de> References: <20250408084153.255762-1-osalvador@suse.de> MIME-Version: 1.0 X-Rspamd-Action: no action X-Rspam-User: X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: F3BD4180002 X-Stat-Signature: xqgmnnpkz1oxk9b85fsej81u3wob3p8c X-HE-Tag: 1744101746-963891 X-HE-Meta: U2FsdGVkX1+5Hqhy6oQIQXwFN5+gVHAGaOmxGuxpifJTMXmm7lTGzth2cS9J5Tlw6JX5nQzcRacdX8aYo5MfQoUKlO6QrMYcyWN4KS01q9+0FXe7bRAGwFTjXKbkd1CLC+cmYtD5Q6o1OpSBEaeCxv5PaH1i0inttHZ9e2Uk/qAtD0/vi/rjDzpmDQzgCOPGWZZw/6LCjjGrxtpagNARSSfn2PzApFJ8/qlWOAA0JdifXYTsWOPiuBgKexaz+O+6zrYmXhPwXXQif7xAI1YJa38/S1JZ6OlzFmwSaK2FO4ftnYl0BvtHbQrzBN1caa7/G6kQZbfYECDUZ6iI1DiPc5pBTyv/13w3wQWzKDH3y9IYZw2PjQ+JMkdE5rKuhWWFHKQu7o77nLZxb6m2uDXcH6Pxaboa1stpVzLq8fWI9EigYJZ44GctFkA3iko2wAIWJ++x1egz8U97aiqMMYK7Xm2spaXalcvTYUsmLv4aBpkW6kQXPjzbldz22UuClslTdbi0brWq9v/s/ECkhEGJlSs3e2dLa+V2QJ6TI+eZoN+loAxVWWeXF+3E5HTR2Zpijb4alutL2pf1BlQ0u7osKe/b2ZwAaKcAsC6PT1NZ6rVJPlABBcHMOwQ3GARgPds16+YT/uX0d4BjdEI9HFjR74VK8YI9V4732uDJ0XJTwS140u4MkymCi5FgkSzl3hhRZcpueRy4iomYz+fps9F8UNuekdNrvWYfK+yhPS7wEuHUH0lwoF5Q6Z3yXZNMHje20KNuTgzBd8gSHgESMoeZndTeCMoeg/GReEa+R6kk7oTEQ1vPhTbUjwbG5rNOB5mIEhhjEkUW/Cw1vhaJWyDOlL7RlEgASrfpI7QaeMmpKxuJSAf2yUX4fWlEMBbCGS+v5peCpFfDZ2a7j7ac+WjXXdoI8eGiPwH/cvaKjLXhtvGYQH5aJ5poq9ZA27OLld9EVWd7vFlijFSB/wljTxY 1JPiJuHr ihTAnZkvnJjjhxv5er8JX4ghsjlQAo8OBMK4S2+6UaHykEpVTQdCSMdYVs1H79PieMEX3zHnqLkLkSDx0Fg6r8uhnJDvbmMGtTSiH8tvOb/A2PpXxP2ZrEOqz7VOHzKwFYV7dpngcyrrrEGrb0PPjrHHE1kIksl6oMz+h4yYtuXHUpRaSMqkKw4+tA037MOzsOieJoIdoNI2RYWpT6t7SvIynsPGCdKBUT+x4cgU00kNk90l2eWSLCm4WmKDVw1BP1LTL+8BbLx0E/Y3vmB7gEFB3jbPwfxTDB7IB70kQg2pf11zzLCoE/EdIX7W1JS1C0WJYqb+lhaP9r/o02JNEwtKeuGDJb80F/y+K X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The 'status_change_nid' field was used to track changes in the memory state of a numa node, but that funcionality has been decoupled from memory_notify and moved to node_notify. Current consumers of memory_notify are only interested in which node the memory we are adding belongs to, so rename current 'status_change_nid' to 'nid'. Signed-off-by: Oscar Salvador Reviewed-by: Harry Yoo Reviewed-by: Vlastimil Babka --- include/linux/memory.h | 2 +- mm/memory_hotplug.c | 4 ++-- mm/page_ext.c | 12 +----------- 3 files changed, 4 insertions(+), 14 deletions(-) diff --git a/include/linux/memory.h b/include/linux/memory.h index a5b8068cf182..241a98e31277 100644 --- a/include/linux/memory.h +++ b/include/linux/memory.h @@ -117,7 +117,7 @@ struct memory_notify { unsigned long altmap_nr_pages; unsigned long start_pfn; unsigned long nr_pages; - int status_change_nid; + int nid; }; struct node_notify { diff --git a/mm/memory_hotplug.c b/mm/memory_hotplug.c index 84248f2e36f8..19f2f8a08645 100644 --- a/mm/memory_hotplug.c +++ b/mm/memory_hotplug.c @@ -1192,6 +1192,7 @@ int online_pages(unsigned long pfn, unsigned long nr_pages, mem_arg.start_pfn = pfn; mem_arg.nr_pages = nr_pages; + mem_arg.nid = nid; node_states_check_changes_online(nr_pages, zone, &node_arg); if (node_arg.status_change_nid >= 0) { @@ -1204,7 +1205,6 @@ int online_pages(unsigned long pfn, unsigned long nr_pages, } cancel_mem_notifier_on_err = true; - mem_arg.status_change_nid = node_arg.status_change_nid; ret = memory_notify(MEM_GOING_ONLINE, &mem_arg); ret = notifier_to_errno(ret); if (ret) @@ -2018,6 +2018,7 @@ int offline_pages(unsigned long start_pfn, unsigned long nr_pages, mem_arg.start_pfn = start_pfn; mem_arg.nr_pages = nr_pages; + mem_arg.nid = node; node_states_check_changes_offline(nr_pages, zone, &node_arg); if (node_arg.status_change_nid >= 0) { @@ -2029,7 +2030,6 @@ int offline_pages(unsigned long start_pfn, unsigned long nr_pages, } cancel_mem_notifier_on_err = true; - mem_arg.status_change_nid = node_arg.status_change_nid; ret = memory_notify(MEM_GOING_OFFLINE, &mem_arg); ret = notifier_to_errno(ret); if (ret) { diff --git a/mm/page_ext.c b/mm/page_ext.c index c351fdfe9e9a..477e6f24b7ab 100644 --- a/mm/page_ext.c +++ b/mm/page_ext.c @@ -378,16 +378,6 @@ static int __meminit online_page_ext(unsigned long start_pfn, start = SECTION_ALIGN_DOWN(start_pfn); end = SECTION_ALIGN_UP(start_pfn + nr_pages); - if (nid == NUMA_NO_NODE) { - /* - * In this case, "nid" already exists and contains valid memory. - * "start_pfn" passed to us is a pfn which is an arg for - * online__pages(), and start_pfn should exist. - */ - nid = pfn_to_nid(start_pfn); - VM_BUG_ON(!node_online(nid)); - } - for (pfn = start; !fail && pfn < end; pfn += PAGES_PER_SECTION) fail = init_section_page_ext(pfn, nid); if (!fail) @@ -436,7 +426,7 @@ static int __meminit page_ext_callback(struct notifier_block *self, switch (action) { case MEM_GOING_ONLINE: ret = online_page_ext(mn->start_pfn, - mn->nr_pages, mn->status_change_nid); + mn->nr_pages, mn->nid); break; case MEM_OFFLINE: offline_page_ext(mn->start_pfn,