From patchwork Wed Mar 19 19:30:27 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Raghavendra K T X-Patchwork-Id: 14023080 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5825AC35FFB for ; Wed, 19 Mar 2025 19:33:26 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 65045280019; Wed, 19 Mar 2025 15:33:24 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5FEC2280010; Wed, 19 Mar 2025 15:33:24 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 45393280019; Wed, 19 Mar 2025 15:33:24 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 24FCE280010 for ; Wed, 19 Mar 2025 15:33:24 -0400 (EDT) Received: from smtpin10.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id C1B59A9AD6 for ; Wed, 19 Mar 2025 19:33:24 +0000 (UTC) X-FDA: 83239299528.10.86929B6 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11on2041.outbound.protection.outlook.com [40.107.220.41]) by imf29.hostedemail.com (Postfix) with ESMTP id 03327120017 for ; Wed, 19 Mar 2025 19:33:07 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=EmXCUdck; spf=pass (imf29.hostedemail.com: domain of Raghavendra.KodsaraThimmappa@amd.com designates 40.107.220.41 as permitted sender) smtp.mailfrom=Raghavendra.KodsaraThimmappa@amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); dmarc=pass (policy=quarantine) header.from=amd.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742412788; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=oYUB9Y5oL/vnLd9PbKivHKRUxW1ZVjk0QHYKJpkjL8Y=; b=3S323AzMfNRUJh2AmDpTtTYDOvI1VqxNC5bYwl0v1UIFvPS+D38kuA6mNkSrqOL/J/xd5L DRDdTL4A7UTOn0kX5AiS5xRYZuyJxFRPWD7zUVVlGJ8jLw2cfuvzigE1LigiL+uyzAuwpp yNuQ5/dDu1FFmf+fmHcdFQ4rHD9ojEQ= ARC-Authentication-Results: i=2; imf29.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=EmXCUdck; spf=pass (imf29.hostedemail.com: domain of Raghavendra.KodsaraThimmappa@amd.com designates 40.107.220.41 as permitted sender) smtp.mailfrom=Raghavendra.KodsaraThimmappa@amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); dmarc=pass (policy=quarantine) header.from=amd.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1742412788; a=rsa-sha256; cv=pass; b=TObPjaEcsLcVvZ31V4PzAwfaJ+OZJNv2h/od62kAMzlfmY1zXZ0egbKpotmAr4lwxWv51Y am+JGguPLFA2fAUCfs/kBOyfWaECDraDSgHUPfPthVcAxwmGVI6xuCZL/xvDKMhp81quB4 iIRJLTT0ciwbLgd3tcM9OP8Bxz1Ewss= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=HbThxnNT3sDyTD+HFT8KeE/eohImjEKvRngChsKKkTiOtbkfhnCsOUhyfoHG5flfIeMJ9GJ3kev9wIp2MV6li87aQ5WdPwiH0APTpVN/bqjvJkIWF/NPhVZPEQiAD8aG6YJhNL+lAtd+DMnCMPFiv6E8oWpMOAhDSy4t27U4viaovusMxhQQl8pw/pnx6RHO5svpnvaMpS4PyCAtbBJHPflllzol/aFDi8rp9ZUX4ocZYFRV1Pkr9YKmKf3Gp8wIYuJnPjxijP9njQjpyprmS+HViIjhC8YOaBFVm6XTgM/CGpargSihJgE/t11rxRDWmeU7LQoBfM1UA52Mw8PkYQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=oYUB9Y5oL/vnLd9PbKivHKRUxW1ZVjk0QHYKJpkjL8Y=; b=d+Z5ZmzGtq2Zq6ArdCC2/XgRAbBUugeKcm4QVHW0muQxgrVac4WzVvzUtRGkTzglIVsGE2RTinA9Ft4acsyrT2U913MpBMM84r31RcAwUdT5MR8B5c3/z/KuIdUP1S995RQl/ezcFxxLr0hpsNm4D1ZPjWEbrz8Yxi/+x3NcLbc1Qf1iyLk0uMtnJGxxgfN6zZltc8Pnm+9t85fB9ctXDeCKQC1LfTc/HfS87YFPrSLMIKxF3ESIloze/eG3cyN+ePWscAcKpEF6e+Z1Y9gNljiSfXrwub/uFVtIG/sQ0gSv82yIVf40m38dm41ePpbmxyIpUofedKPezq1VW/etYA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=arm.com smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oYUB9Y5oL/vnLd9PbKivHKRUxW1ZVjk0QHYKJpkjL8Y=; b=EmXCUdckkV9nMB7LnWlYx3I9uMajNBcX/RNm0oTUmK9BnLf5uKbp/MEyk8vd9vjpGvB82yNLWFDmJSQVhOM90DuocRFGE7kPrAd69iDlH4/a1AUL/EGgg09NMvmBEP5ssxUOf4VgzMASJgdj+mGVe39yRDaVP0nonGqdAOy7VoQ= Received: from SA0PR11CA0169.namprd11.prod.outlook.com (2603:10b6:806:1bb::24) by PH7PR12MB5925.namprd12.prod.outlook.com (2603:10b6:510:1d8::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8534.34; Wed, 19 Mar 2025 19:33:02 +0000 Received: from SN1PEPF00026367.namprd02.prod.outlook.com (2603:10b6:806:1bb:cafe::1e) by SA0PR11CA0169.outlook.office365.com (2603:10b6:806:1bb::24) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.8534.34 via Frontend Transport; Wed, 19 Mar 2025 19:33:01 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=SATLEXMB04.amd.com; pr=C Received: from SATLEXMB04.amd.com (165.204.84.17) by SN1PEPF00026367.mail.protection.outlook.com (10.167.241.132) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.8534.20 via Frontend Transport; Wed, 19 Mar 2025 19:33:01 +0000 Received: from tunga.amd.com (10.180.168.240) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 19 Mar 2025 14:32:51 -0500 From: Raghavendra K T To: CC: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Subject: [RFC PATCH V1 12/13] trace/kmmscand: Add tracing of scanning and migration Date: Wed, 19 Mar 2025 19:30:27 +0000 Message-ID: <20250319193028.29514-13-raghavendra.kt@amd.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20250319193028.29514-1-raghavendra.kt@amd.com> References: <20250319193028.29514-1-raghavendra.kt@amd.com> MIME-Version: 1.0 X-Originating-IP: [10.180.168.240] X-ClientProxiedBy: SATLEXMB03.amd.com (10.181.40.144) To SATLEXMB04.amd.com (10.181.40.145) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SN1PEPF00026367:EE_|PH7PR12MB5925:EE_ X-MS-Office365-Filtering-Correlation-Id: 868d5814-7e1f-409a-7c98-08dd671cdc6e X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|36860700013|82310400026|1800799024|376014|7416014; X-Microsoft-Antispam-Message-Info: NzZ3jZA9+096bwOrh/i5UbiNtTMFuIT766qHEUdYOmOvR4TiAetx8Mlu3EKdUhdDMc0RVMbHvtNrv08eGYJQF+24uL/n3D1hdgahLYysmOYw7IoCv95z4hbt7KvmpwQr+4pBZrOHs8qtVa2pLjXX6hzWzaNZK1t3drwEXFHKdc3SV0UoXSejkgC90qBVm+npYY3tqGK4ANsMkcX5TuffSPGqyhjezZiXN78YZdCREpya+0uZ+OfWmuv9BBdy3JLRviNZMXnVBfikXvsjUCV2srPGA0TUNsQ6u/HUFTGbMZGz30lek8Oprc4ktjb++9Oao6IJMTlLvuzNE1qTIDb1Jk92jNE7imGv4vEAAbOas5zU+0jaDbkA0vbwq/UJgKcZcnx7X59G+L+fdoViDJZgPOFrFpaY3lYXF9BGLUKZRv65xxrv6X62ijXKoHyWai5TQwpEGhSRrZy5T+vIHlbnIwi5LaHBlTuHVRS/8KrYrCjHkXdwM487lnpcXeZhHPsJ4lYybw5O/KbX6nTK8U5fQl0sGbF1lu9qKupdlwaEgfAqAdZTWibhzykoriPJEpNvxAT1h/vBB/Y0xqFLUiqtUBIBawE+8QwR3s4hd+uH4W3G/+mUYgmZOU/zc/5hkaT5aSGSeXOitNsETPdm/8KDeMs2SSGbjiffR1nmiqZ3ii9hU8SKdwf+mu4mpIQMk+Xgjycgd6G1KY1MCCTsFt3OKqy7od50zlw6pVzk3W3VUBgpaITpLs3o04RmLqSPFyOQ69xrTP0us6AWWJr4eA8bnCoy0TkreVPL82SLRXW0niyTlBWTp4+/9vdYXHGhep3R7fKKYsrd0DYf6HIghTIBHoXuooEDQHLH5O9Po5GaeaS1zXr2MznQEEXKJboP2pDoI539HIRK27uwzxybBP6wfGnSyRyxx3vUQsb6g83r8s3ctUwJxBAME7J3BjXUISImZrJINnIFQV2q4hBCHG0D8uL6JWo9H8SI3QrMvudne70xX12dGFcmvtpU6IeJTaYixhoIRjQ6nT0ew1yO2d5D8W0mSX1AqljvpSZWTUssPcW5HazaNbYPtLWot4F4swUMtJCcoliFtdONyae3TcJE4SutHclnJDUGyki7JY+3+Krm7v2f2sXM6bg6RWNnXErgneRcCjipBOpU5jmyEQo2axjybSrb//M0ZZRmvuYmm2NeEqKvOWmriHj81LODuV/GrYb5UFYZz3UKvRuU4WRKb9HJfq285t2lwR5gAEXyV2ESBnGEmD0G3fCfjy6vDgY7KTqGHmfYFD4Yof80SGPX3wOMx+kDVtLRoBbk5XeMncVqH1noXshHKJ2v1DxabaT8Zjd1NYD336V3ToFTsP9uZa4JGpAEy/U0E15N0NK9easAccvRAs+QB8QjKCrxsyOoRfoloEyvbo3uKR5fNvBA6m+t44o46KrUEdycAqcoXEUzBbqLadsWw343ar8f8fcSyiZ75ixBCOo5sP/bOPhH2lPvR+cNOQedkDWCFTTHUnQ= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:SATLEXMB04.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(36860700013)(82310400026)(1800799024)(376014)(7416014);DIR:OUT;SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Mar 2025 19:33:01.0827 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 868d5814-7e1f-409a-7c98-08dd671cdc6e X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[SATLEXMB04.amd.com] X-MS-Exchange-CrossTenant-AuthSource: SN1PEPF00026367.namprd02.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR12MB5925 X-Rspam-User: X-Rspamd-Queue-Id: 03327120017 X-Rspamd-Server: rspam08 X-Stat-Signature: cbgze4i9ibgqdbkj61db9x7w8wwqxb65 X-HE-Tag: 1742412787-41018 X-HE-Meta: U2FsdGVkX1+X5N+31ybc1k5uWU7kyOVq+o7+gQdYlWHddv8b10gV8MG9Fm1T+QtS618td7vM8pbl28/njfPRrqqP3NVZwCXeQEQBCX8wZk1YVfRSDk4fg93OcjS22X6Qx5gDb5si5N5g1JROfzHtJKM6iSR0AXZ/3cgG5xlHykoAmx+NuqFsZUOIAi2D3FkwdS9aT4H77OxHxmdJCqUQCs/4U4Qsw4vs8pvwD4RPl9YCXjpKXp4MLWmM6wmS7fw1BGbvkDQTzVwP2pqjmPb/ruCLYBkW1ncr/T3eOXEIKnCjuMFuA8rLMzdMe55axVQ2hH/Q2RnWzWLU90dxTPA2l1psqR2yWYHabvCIPsA4AfRw5qK/mqYPV3CpyAGZQsnZdGJUwYhaxk3KN7QnMwxi55oF4YCNKR/3qZXPSgT9OLWQ8ohEcQbZNspDwI2xp1+SWgh09mY4qQXhiKTe0hPoZqo5HHhHPZRmTtr+w648Hb/GcGK8FQw/cV1ZtvcubTD49e69lKLc+p6yh69c4UNZ1Pxz7xi4SoLK9ve3Ew7s0F6YJAnwf6J++zy++5J2dB2qGdkpk6BTLUzjldco1BDI/bSZVLFETHU76AI5o9dFqCcGNdBNngk+F2VjIi6RJpX9FNUQG9MnuHpBWne2hk5uhIO4bsjFXtfUlgjdklxPwHB7AxNgzst8BPgowrnTs2vV2TcN5us+hn8ORTJZK9qiO7jqYLz8ROkZYjw0l2ULOnl6bs1a0Iimpo1bflLcW9GPyouHjKIDXsdecAFo+QBxS6mkBfzdK2vqC1bLdbKHMnmxuGuUk5vSRcZIFbfqpYm164ho7nM4gYa/ecBzgTyHnJB5pkt8qPQhYLFemxt5s+gfOrSin5/q9zCxk1I7LxtV5zYUHVheaJPiGwAafkDYA1fZkWPjVHYwrtBwO27+/NEO1QPM8Ev2UQaKFQIYR+rmmOkiWHhkPP1pu5R5zoj 740ETwFP SQakyLRPPAZ0w9AYYkc+8Sr3K0scTSoHx6oQmZiWuXMIRP9JdlsCSVZowh9XYsS6W4eoNGM53YkF0/Qxpg+UwbV3/4ryS9OIcuEK1nnIVn4IqdemiAHvNkta7eaUfKb5OMDaVLGhNHSHVY1ciSp7nj623jLlfQGGzcULTHTC0C3RBfXNOFPbAytmjAB4Rg2P9cdqkmcDWAtib3zDoRAkxBPYcNpJG9AdRe6BugQjMRtYZB8op+Vu0NuRaqO/gIHtQynWkJfgw6S68oBhc8fAu2V8vb6m0lM7fnl8x1c1jS0JXhczhqtVLD4KyMPUuYKTyYz2rWFjWpqqJ+jjWoc39kpCZItmVOPVfe3YGCuKqkFrjIOuSLv5mhj+DZumq8mP+7xvpWSJ7Wx910ugYbL49Jx2amjJWocnkyDeKfCyPcMYa7MDWVzwyD9LP0Ya6kjEldOVXThzNM5BWWmGbBFwysfoDrazoaOcxKk8dKt11YakPBtg8Gi8t1YSGDPeIkYKOs6QcocT8xHaSTL4Q4t1Wd5ISD6oGlhraho3oNyH3OB9yD8PmZvryhtAvGsSpP9cWpZUalkX3R/detaqfpN6h0jt0UEF0ahRLBrmToI8cuiWygj+Y7ujFxzuE90jBnzrpPpJ44oa8VULejUw/PxFF6jG6KlqVbV4sKEGg90FzVOAskgHpUj/RZGaPWtyGj51GNZ83n1j3eeAMg1Tih4Cyc7mkeknXA++ZIsuwwIugRTaehflScRhfvViyx2yo9wlKtnUZVPxEzuyDa365QKA8ntGSdeJfsrOt34Lnxx6HSwKlzUfZbrQiqxebVqKglHtlob1+oO+kEwlnDrsD7UoRQB9ZUQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Add tracing support to track - start and end of scanning. - migration. CC: Steven Rostedt CC: Masami Hiramatsu CC: linux-trace-kernel@vger.kernel.org Signed-off-by: Raghavendra K T --- Changes done based Steves feedback: 1) Using EVENT class for similar traces 2) Dropping task_comm 3) remove unnecessary module name in print include/trace/events/kmem.h | 90 +++++++++++++++++++++++++++++++++++++ mm/kmmscand.c | 8 ++++ 2 files changed, 98 insertions(+) diff --git a/include/trace/events/kmem.h b/include/trace/events/kmem.h index b37eb0a7060f..cef527ef9d79 100644 --- a/include/trace/events/kmem.h +++ b/include/trace/events/kmem.h @@ -9,6 +9,96 @@ #include #include +DECLARE_EVENT_CLASS(kmem_mm_class, + + TP_PROTO(struct mm_struct *mm), + + TP_ARGS(mm), + + TP_STRUCT__entry( + __field( struct mm_struct *, mm ) + ), + + TP_fast_assign( + __entry->mm = mm; + ), + + TP_printk("mm = %p", __entry->mm) +); + +DEFINE_EVENT(kmem_mm_class, kmem_mm_enter, + TP_PROTO(struct mm_struct *mm), + TP_ARGS(mm) +); + +DEFINE_EVENT(kmem_mm_class, kmem_mm_exit, + TP_PROTO(struct mm_struct *mm), + TP_ARGS(mm) +); + +DEFINE_EVENT(kmem_mm_class, kmem_scan_mm_start, + TP_PROTO(struct mm_struct *mm), + TP_ARGS(mm) +); + +TRACE_EVENT(kmem_scan_mm_end, + + TP_PROTO( struct mm_struct *mm, + unsigned long start, + unsigned long total, + unsigned long scan_period, + unsigned long scan_size, + int target_node), + + TP_ARGS(mm, start, total, scan_period, scan_size, target_node), + + TP_STRUCT__entry( + __field( struct mm_struct *, mm ) + __field( unsigned long, start ) + __field( unsigned long, total ) + __field( unsigned long, scan_period ) + __field( unsigned long, scan_size ) + __field( int, target_node ) + ), + + TP_fast_assign( + __entry->mm = mm; + __entry->start = start; + __entry->total = total; + __entry->scan_period = scan_period; + __entry->scan_size = scan_size; + __entry->target_node = target_node; + ), + + TP_printk("mm=%p, start = %ld, total = %ld, scan_period = %ld, scan_size = %ld node = %d", + __entry->mm, __entry->start, __entry->total, __entry->scan_period, + __entry->scan_size, __entry->target_node) +); + +TRACE_EVENT(kmem_scan_mm_migrate, + + TP_PROTO(struct mm_struct *mm, + int rc, + int target_node), + + TP_ARGS(mm, rc, target_node), + + TP_STRUCT__entry( + __field( struct mm_struct *, mm ) + __field( int, rc ) + __field( int, target_node ) + ), + + TP_fast_assign( + __entry->mm = mm; + __entry->rc = rc; + __entry->target_node = target_node; + ), + + TP_printk("mm = %p rc = %d node = %d", + __entry->mm, __entry->rc, __entry->target_node) +); + TRACE_EVENT(kmem_cache_alloc, TP_PROTO(unsigned long call_site, diff --git a/mm/kmmscand.c b/mm/kmmscand.c index c88b30e0fc7d..38d7825c0d62 100644 --- a/mm/kmmscand.c +++ b/mm/kmmscand.c @@ -945,6 +945,7 @@ static void kmmscand_migrate_folio(void) } ret = kmmscand_promote_folio(info, dest); + trace_kmem_scan_mm_migrate(info->mm, ret, dest); } /* TBD: encode migrated count here, currently assume folio_nr_pages */ @@ -1115,6 +1116,9 @@ static unsigned long kmmscand_scan_mm_slot(void) mm_target_node = READ_ONCE(mm->target_node); if (mm_target_node != mm_slot_target_node) WRITE_ONCE(mm->target_node, mm_slot_target_node); + + trace_kmem_scan_mm_start(mm); + now = jiffies; if (mm_slot_next_scan && time_before(now, mm_slot_next_scan)) @@ -1172,6 +1176,8 @@ static unsigned long kmmscand_scan_mm_slot(void) kmmscand_update_mmslot_info(mm_slot, total, target_node); } + trace_kmem_scan_mm_end(mm, address, total, mm_slot_scan_period, + mm_slot_scan_size, target_node); outerloop: /* exit_mmap will destroy ptes after this */ @@ -1323,6 +1329,7 @@ void __kmmscand_enter(struct mm_struct *mm) spin_unlock(&kmmscand_mm_lock); mmgrab(mm); + trace_kmem_mm_enter(mm); if (wakeup) wake_up_interruptible(&kmmscand_wait); } @@ -1333,6 +1340,7 @@ void __kmmscand_exit(struct mm_struct *mm) struct mm_slot *slot; int free = 0, serialize = 1; + trace_kmem_mm_exit(mm); spin_lock(&kmmscand_mm_lock); slot = mm_slot_lookup(kmmscand_slots_hash, mm); mm_slot = mm_slot_entry(slot, struct kmmscand_mm_slot, slot);