From patchwork Tue Jan 2 18:46:33 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Uladzislau Rezki X-Patchwork-Id: 13509282 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1EA66C46CD2 for ; Tue, 2 Jan 2024 18:47:27 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id ADD856B02DA; Tue, 2 Jan 2024 13:47:21 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id A38056B02DB; Tue, 2 Jan 2024 13:47:21 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 88ED26B02DC; Tue, 2 Jan 2024 13:47:21 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 6CA8F6B02DA for ; Tue, 2 Jan 2024 13:47:21 -0500 (EST) Received: from smtpin02.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 44DD8120149 for ; Tue, 2 Jan 2024 18:47:21 +0000 (UTC) X-FDA: 81635253882.02.0EA53E8 Received: from mail-lf1-f43.google.com (mail-lf1-f43.google.com [209.85.167.43]) by imf26.hostedemail.com (Postfix) with ESMTP id 5E5D2140006 for ; Tue, 2 Jan 2024 18:47:19 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=F7oFccL2; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf26.hostedemail.com: domain of urezki@gmail.com designates 209.85.167.43 as permitted sender) smtp.mailfrom=urezki@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1704221239; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=s9/T5K2ir2OJL/EqmsqvZQ3IpaLcsXDlXwLSIHXyRwY=; b=qo2GvFVaw1QWSdkawYIkyCP/YanIdi9x9QJKH7lfKeHM/JLqaeLAkQu9u8TrbKhlFvgZOL Y7Dei3wfax1O4ffutm3L0fzah1w712mZuQ2gm3qegbrJsRHsqq3cURo/KgRe1LucZrbUAC yLfjrh+YdV94BUITBWGy5Xfh2L/A6Ek= ARC-Authentication-Results: i=1; imf26.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=F7oFccL2; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf26.hostedemail.com: domain of urezki@gmail.com designates 209.85.167.43 as permitted sender) smtp.mailfrom=urezki@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1704221239; a=rsa-sha256; cv=none; b=AH8AYXbGlg5pDe44ywyCY6dpPMX2t3cV1MYkHJ9BDH/EbRM0ZMeUP8dWVfA0EBNv5oUqvo v0S4KJUx8TH9nxVBYs6LAabZSNqrLw6PAHPLuT/WPY/bhKUfxCPKX51bmnTnWhBKKOZ7xp 9BDy9z50PnfnAEix7F/V0RDQWfNBmg0= Received: by mail-lf1-f43.google.com with SMTP id 2adb3069b0e04-50e67f70f34so8394028e87.0 for ; Tue, 02 Jan 2024 10:47:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1704221238; x=1704826038; darn=kvack.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=s9/T5K2ir2OJL/EqmsqvZQ3IpaLcsXDlXwLSIHXyRwY=; b=F7oFccL2aK+9WgeXl8r7sXGuHr9PWHUHPV6+BJp1DayBUeAl2gMNzYv6DhZp626w/v Ym4kOYt7jAbAZ20vpOIFNChWDWCG80SwRCcutZPagW0bNPpJDYCeEz5k0HY8ddLGEKGU qeC9H31j2fo+XjMfI+pDnZx8OC9XVcWb9OnMZDwuCDsewo0rk6d7czha/RITbk73vMhq te/9870Fmx/cyBxgPgAmsqXkZEWchQzfuo5/xzJXEAQwV+d4UlS7MAFDc8czcjIDfFN9 dKCsV8xvtZWDWHsTBxHDt2W3CpKZTkFl6NWATQ3hBptrA6yggTNuwW5doLS3sceKoYoL EL+g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704221238; x=1704826038; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=s9/T5K2ir2OJL/EqmsqvZQ3IpaLcsXDlXwLSIHXyRwY=; b=S2+06wR+KMwD/IJ4UdjMzSMZJN9qvQUVqebMjGGpdEE6SLh1efGkBz2OZysLDz/3T6 ds8AaMbjr6wYTR/94Lj2plX9iCaTNg60gUQyI0FpGKEjiIjpgxTN7rhfLf3dobZfyHmX wwBXS0mwPvL4eWBdm+IzjTH5eiwfJkKC4ADCrCAdt9CO3b/SmcOtruA4s0WhY/O538Li j/QLaFgvHjScFPtdOG6YRStvTNA5qyMGhbonEBumoJf/QwOoJsQotQ5diJkT1AAX17Mg nRM1q8aY501tkehS5N4g4KlHOB+yaFWFc+/yPMUdHZ4wsERhUwPpuYiceIQYtaZLHL/L YuJg== X-Gm-Message-State: AOJu0Yy6+IJih1kJ7hduS7CSwjjw+MeLRwz1inmlA9oRfjtAV/Q+TQaz smOTRnrAaky6rU7xhtUBtu9yVeQ3sU5qEQ== X-Google-Smtp-Source: AGHT+IHRbxitAW0kY1SyrAVZNdrjS0E3Q6aU8WIW/EO9WbSw23NrRoV+q5pHLLcc7N5Pm8J6+ROD3A== X-Received: by 2002:ac2:5fae:0:b0:50e:5f99:21f2 with SMTP id s14-20020ac25fae000000b0050e5f9921f2mr6671072lfe.37.1704221237681; Tue, 02 Jan 2024 10:47:17 -0800 (PST) Received: from pc638.lan (host-185-121-47-193.sydskane.nu. [185.121.47.193]) by smtp.gmail.com with ESMTPSA id q1-20020ac246e1000000b0050e7be886d9sm2592656lfo.56.2024.01.02.10.47.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 02 Jan 2024 10:47:17 -0800 (PST) From: "Uladzislau Rezki (Sony)" To: linux-mm@kvack.org, Andrew Morton Cc: LKML , Baoquan He , Lorenzo Stoakes , Christoph Hellwig , Matthew Wilcox , "Liam R . Howlett" , Dave Chinner , "Paul E . McKenney" , Joel Fernandes , Uladzislau Rezki , Oleksiy Avramchenko Subject: [PATCH v3 11/11] mm: vmalloc: Add a shrinker to drain vmap pools Date: Tue, 2 Jan 2024 19:46:33 +0100 Message-Id: <20240102184633.748113-12-urezki@gmail.com> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20240102184633.748113-1-urezki@gmail.com> References: <20240102184633.748113-1-urezki@gmail.com> MIME-Version: 1.0 X-Rspamd-Queue-Id: 5E5D2140006 X-Rspam-User: X-Rspamd-Server: rspam04 X-Stat-Signature: xtea5jgzgjzmombx346erhagjmgdi8rg X-HE-Tag: 1704221239-855672 X-HE-Meta: U2FsdGVkX1/kY7cM2soO+A1nY1oL4RvRf9sd575b7cb4QzsITFKXo6RzdfnDRYh1mo0zRgWjkTymURdW66IKc5vj9P9pi1usuVNF5t/3+gHzt4n9wVbHgFOY0N6GaO1ReHadZw7owgn6pLu9Qlt4DebiVyAnzCOhCNzrvPSgtkdQsPoN7rYbxqtCAJpI9o+jph0FdMF/pgzBCrJ14EF3RimUHfRqdFUnO4OL0ZEBoTwc+k5vnBB3As2oide4lAQxQngyblfWOnEhFm/LXVSeHvMMYBfIWtabQFpiUWmx/W6sY/sPsr/Hqd114ryfsGG98tXt0v3Vmv6yCxwVDV6Z8FPVB5GIckcDj0pH3IW/sO48R3COCwu53UdZtdtnZpjeBSZ37vWVNu/WAfVybgJwG35nD43M9uHRnPVlQd1peeku6eTgnU5zYk/FZIzvrHURnf+lhCI0DsyssjufZtWl6TUDjmgw483cusYsWM2/VJn/xSi1ViNtIVCAxdsbpYzwfW1AM+GoeWnSEdAi23UmtzzCeWHJvHQXA8ZixU3OW6CYfsLYQ0HWVjTQ+zcmcRdPmFZuIswQ8r2+RiJPwawqg9edm8BMcnhyEZulCUk8POYwkX3YSB0tndIKyBmvTCk8GTDpZVWG22oJ57vjGYeg3jv0xAkeCbxVkz89IQfrXnhJs4wQ/oQyH2HniB3ZjtSX8rpJsKJK8VVKD+DVy+zpYczWaBtnNCCjvXbaBV13SAMvgXFqOba5NzVOIPoM6xPLYfYrrg/ZBkFCz7MqfPzpRnlKUVKa6oQrZ43j5sLkJiQikB8t1sZKvuJZHny3U5u9C/EyaeLbPCyRUp+wJMQ01BU5ISybQ0/eFeqVCxSlb1RNMDk7XciswxtWLMA5y54zJkYvbi3NZTMV74lYE9pSP0wxmbe7LeH/kldUDVEOzXullV3+Isy6k9YwnSqaTR0lsriTrQBkPxU4fa0D8f9 j2aN6Qas gyqQkUOYwNQ/l7esorrVpHUOiTDK4FEKNX06nGmoztWAtiePwIXCOMAXhy7jlQb4qHRYtIKq/6KRWn8QNGIvv3vBHYraAyhjMkpR0eytptFhDFM4eXvwR5kB3XG1Zffy3MHmTz2DdqdJOntDDBYsiFAoP0QXJfqNHolfQ3QFzsR1Y6QIBPpDzyYmW5+4rnU1yB+l7NxjN4ZkM8BS0TQoQLsMWQUBaKYrEFUFjJNV03ojIA2oFhWVfK5sAHkU2z/LLGu7tx0MGHyppCtVfbJ7mU1cP+D7Jyej2pHfvDDSaIgdR+bA6qpFzToLw4uWrRoFMahtEoh603eFl+7P1lsqm8GHetr38MNOBEG6n+ZxBVxEyqMZLcBu6pjGhLVtH6++h6yI1uxi5fg2fPJBrCuPorJ27HrzQQ7++LTZuv1Atsx1M9MGpaWRrqs1WDwECHr6/qs6t X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The added shrinker is used to return back current cached VAs into a global vmap space, when a system enters into a low memory mode. Signed-off-by: Uladzislau Rezki (Sony) --- mm/vmalloc.c | 39 +++++++++++++++++++++++++++++++++++++++ 1 file changed, 39 insertions(+) diff --git a/mm/vmalloc.c b/mm/vmalloc.c index ef534c76daef..e30dabf68263 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -4917,8 +4917,37 @@ static void vmap_init_nodes(void) } } +static unsigned long +vmap_node_shrink_count(struct shrinker *shrink, struct shrink_control *sc) +{ + unsigned long count; + struct vmap_node *vn; + int i, j; + + for (count = 0, i = 0; i < nr_vmap_nodes; i++) { + vn = &vmap_nodes[i]; + + for (j = 0; j < MAX_VA_SIZE_PAGES; j++) + count += READ_ONCE(vn->pool[j].len); + } + + return count ? count : SHRINK_EMPTY; +} + +static unsigned long +vmap_node_shrink_scan(struct shrinker *shrink, struct shrink_control *sc) +{ + int i; + + for (i = 0; i < nr_vmap_nodes; i++) + decay_va_pool_node(&vmap_nodes[i], true); + + return SHRINK_STOP; +} + void __init vmalloc_init(void) { + struct shrinker *vmap_node_shrinker; struct vmap_area *va; struct vmap_node *vn; struct vm_struct *tmp; @@ -4966,4 +4995,14 @@ void __init vmalloc_init(void) */ vmap_init_free_space(); vmap_initialized = true; + + vmap_node_shrinker = shrinker_alloc(0, "vmap-node"); + if (!vmap_node_shrinker) { + pr_err("Failed to allocate vmap-node shrinker!\n"); + return; + } + + vmap_node_shrinker->count_objects = vmap_node_shrink_count; + vmap_node_shrinker->scan_objects = vmap_node_shrink_scan; + shrinker_register(vmap_node_shrinker); }