From patchwork Wed Mar 19 19:22:04 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shivank Garg X-Patchwork-Id: 14023035 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id EFBBCC35FFA for ; Wed, 19 Mar 2025 19:23:27 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 1547E280006; Wed, 19 Mar 2025 15:23:27 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 12C5B280001; Wed, 19 Mar 2025 15:23:27 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EC212280006; Wed, 19 Mar 2025 15:23:26 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id D0199280001 for ; Wed, 19 Mar 2025 15:23:26 -0400 (EDT) Received: from smtpin06.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 0289F14071F for ; Wed, 19 Mar 2025 19:23:26 +0000 (UTC) X-FDA: 83239274454.06.A390259 Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2050.outbound.protection.outlook.com [40.107.244.50]) by imf10.hostedemail.com (Postfix) with ESMTP id 0D423C0013 for ; Wed, 19 Mar 2025 19:23:23 +0000 (UTC) Authentication-Results: imf10.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=REd7jNs8; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf10.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.50 as permitted sender) smtp.mailfrom=shivankg@amd.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1742412204; a=rsa-sha256; cv=pass; b=RHpIEk0zfxJovoM5fbORS8bnw0d3copT1jjyKBTR8LhKeXxujRXm9YZYEUmY8/uT07LoqC 8DqEonxvxZfiRUFMn9F3FlSjKEL+42Df6IucChI2Bf2bNZcR00qMeiSbDQ3kMEM5X3qcH2 xmgcsV46K7DtpiL1XTAYiHo6lCd7Zbs= ARC-Authentication-Results: i=2; imf10.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=REd7jNs8; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf10.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.50 as permitted sender) smtp.mailfrom=shivankg@amd.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742412204; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=SZyoWMY8GPkC6c+QiCnwrogSvPL8DBaC1BvGNUgqyIg=; b=AwN7vu8jwKwTOqp86ZSk4CEikdvfUJadPW67eNLLWkGzMWQ8Ol5mpUL1zU/3AM4/7vH+y4 6qc53g02X2/qYs0+XzCfWSx3yIeeZYQ9/TkoluPcgFTULAC7Kt2wV8JwrvxID/jjJyYe4t YTmpjxpQrspHJylYBJryAZQcZN+/Q9A= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=TBJqvH37che25yt2cYzIZGRPrKVkMD1fXZuQl8GsY04kK97ha0rgH0mSuGDAl7/RllrcuHawYedsbP/sMQfZYdqywovqqNYfRdqcSq3AThpLRuCoiKC/Y3+vDchjIJ1mOkBBjNdaVd8gHDObb5M26peo+xv4q2ffX2kkMG90E0WWuNnOMCkctxIIFYiiszeoZLjSNhehJRCyF6indTtWUbmKfgPUFPJ6o3d5yGPTMgFKyJcmM8e2qN6nYTA9950O6wAkf6iSirIOcmK3+wcvvZKSfowNl+lvaEN0ZSvjvJNFK0fEMOH7GHpSrdCzkm92u8lOOo1o9Vzyx81n1eNAHw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=SZyoWMY8GPkC6c+QiCnwrogSvPL8DBaC1BvGNUgqyIg=; b=DZ7ssxCoLNeb3/tiZQ3uD8g/PGjEbrOQZWrelCnLeGp4CI0d43aQNazRwJ1jLsZ3qScSEon7wKS+rq7+yymV0m55QJlfEbzrl0cJj7itt9lP+tBbIZew9Iw4Erb8EszE01ZY3mDbJGKmy7Shlg4lOtMu1oK+DH5v0ZjEmR88DCuRalsowOlyL2OMirxdcIyF37HHJ8WL7Hl48T9zqRUYkNY8vdEAEUWVSAaZyfHxR8LBiNS9rbtGrMmJrcJP094TAjqTCHbbgNSWJpa2dGHybZKLCR7+IdVXcybya1bx3wGhGx0fmLad/1RCQopRv6bIoTKsijx26fO76tVfTlwyxA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=linux-foundation.org smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=SZyoWMY8GPkC6c+QiCnwrogSvPL8DBaC1BvGNUgqyIg=; b=REd7jNs8gHGP2mKaPvk8TYELAzgTvhFxbCAHUnwRWxPXWfx+JDYGIa4+Bh4ugqs6e6YvIl7esWQML58gL7fVcu7vvc9P42DIhc8IQ/2q0NDNwbPii5Xk01shvIvoXzM5NWjKSDvTfSmpOSGCeFZcHOpR/O6DHGLl2PgWl4TuItg= Received: from CYXPR02CA0026.namprd02.prod.outlook.com (2603:10b6:930:cc::9) by DS0PR12MB7993.namprd12.prod.outlook.com (2603:10b6:8:14b::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8534.34; Wed, 19 Mar 2025 19:23:18 +0000 Received: from CY4PEPF0000EDD5.namprd03.prod.outlook.com (2603:10b6:930:cc:cafe::c) by CYXPR02CA0026.outlook.office365.com (2603:10b6:930:cc::9) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.8511.26 via Frontend Transport; Wed, 19 Mar 2025 19:23:18 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=SATLEXMB04.amd.com; pr=C Received: from SATLEXMB04.amd.com (165.204.84.17) by CY4PEPF0000EDD5.mail.protection.outlook.com (10.167.241.201) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.8534.20 via Frontend Transport; Wed, 19 Mar 2025 19:23:18 +0000 Received: from kaveri.amd.com (10.180.168.240) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 19 Mar 2025 14:23:09 -0500 From: Shivank Garg To: , , CC: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Subject: [PATCH RFC V2 1/9] mm/migrate: factor out code in move_to_new_folio() and migrate_folio_move() Date: Wed, 19 Mar 2025 19:22:04 +0000 Message-ID: <20250319192211.10092-2-shivankg@amd.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20250319192211.10092-1-shivankg@amd.com> References: <20250319192211.10092-1-shivankg@amd.com> MIME-Version: 1.0 X-Originating-IP: [10.180.168.240] X-ClientProxiedBy: SATLEXMB03.amd.com (10.181.40.144) To SATLEXMB04.amd.com (10.181.40.145) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CY4PEPF0000EDD5:EE_|DS0PR12MB7993:EE_ X-MS-Office365-Filtering-Correlation-Id: 0dd7a6a9-10d7-4d68-f27a-08dd671b8106 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|1800799024|36860700013|7416014|82310400026; X-Microsoft-Antispam-Message-Info: dt0tl2cnY7vDBfpDdyeL2xwnBUyZT4Je/1hE2mS3nxOgahtC1f64Myv/XqTUtxL5ZhxVQrSdvu6i+KD2rsVI0FSrGiorB78wJocLI9i6P2r7RlhPPVOfibUuftRbYAkXiVQqx1XD0u5tjuR/P5SsZnDjLWVou7tPo+/Mn9luVlSDbzMcvp3Fag2x+Lc2H3CV3WXSfDwmYHEmPEC8T/qSpQnjh638rxvBMLENyW+jEryQIJ7jcwOawQ0BJafk9p8TpzbxH2iwEgxNSshf1sN6KC8xBU9zUmJLIbf3H8UlZOr0E4rU2AV+xy6LFhbKTpsqQTNqv2XARZ3iQMOZ44TfXFOfICS+XYei7zW4ErasgwNCwKZOkLH8EpZ9egV4tMQ4s3+ME8Dg2j/zDz4bmhqbu0xjaAJkyh7FVfhm7RlZAiaZI3aFP1eUwzuaW/3PliAPS0bswbZ0pQrYaJobsn460B9kH1bdnfFXPfr+SfewDL0UdOwpcPtz86Imu8EtZljDsZlU6070Mwq0YY/z6hUqtB7oh764Yc2x3FDSnYacerxHDL7XbH5bmA6b8Xdjqjzjuru8jkPGZb4uSoLfumYaGobMxo4QbFuEse3CA5LJ1O6KB/k8sWdxiA1JXb2ZCgr0sTG6r4sYCpMhsu6O7FsJDEXRGoGfQL7EiaUIXX65y3J+p7JwFPGdoZZCwgfca0sLG8Wul8YBb5S5vJYvUD28gTk6KHCQqUffQx/NhFVsT13swKG0FxHjaDdngXtdVbjyc392z7dgZoIH09GzL6tuTzcFMliyXaPYBE5bENRT8dCkk2oI0NbaYG/qh+EFcZfwi85a1GWvAh4PsftL5ybVEtoH0m/Fw0/1G+jJTIB8gVSGGSih7hs1N6Zd/rpSDhNgb7jRFodyasd8vpYkdW11s9rnHi0K2x/QusLg//xGecTOB4qKBoXWK1kIfuQBWoxzk1nQtuEvMv1HbX5UGmi705NLw39MNhrz7kMgzIqnkR/QJvyTc3kiL7oiEDXhtONcITOyIg4G/Y08iyL4GOire3cw9MHvEp3RfLKyh1av3MQU1G60uQO/xj75Rv4/W9jP8izvxZuVPRxJ1/WFwm64DIJ6dqeL5iPd05hvXzAaF6hWSUj4jkoy+SmRtlItJ/hQZAs49hWULIcxkgUowB5cFBr2S6w7nW2NBpMJ4owGVmWGGbu/d6iM291EGnRwvyjQSeTE6z3wsEXiI7st6/bP5QpS9AIX5M3y9XSQ35NPG6uLYkUYjzRTIYQcU+Kw5Gkj764R6ddZKnTDzMObCHgpHS0gvKhvmHIh00xCtlB35owofGBAoIXoydI+WWXESkY5qg5aTmJ1cHIL3HKl0FRJhKsuousg35JwYNSAQDBAyZistjtvZYTyH9jJGoFVEYTqmLLiNDwg6JEDBP/aOJ9bP9Mf6U2p4YO7hX9BApM9s1DCV9elrOrhrWmKgh5AstjAnRNSO6r6x2DGjJiK/JSM3JXSG+yOIoVxfdqY0Y17Ql8= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:SATLEXMB04.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(376014)(1800799024)(36860700013)(7416014)(82310400026);DIR:OUT;SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Mar 2025 19:23:18.1410 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 0dd7a6a9-10d7-4d68-f27a-08dd671b8106 X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[SATLEXMB04.amd.com] X-MS-Exchange-CrossTenant-AuthSource: CY4PEPF0000EDD5.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS0PR12MB7993 X-Stat-Signature: 9r83f94ho7d85ujrciaik4rykgmfc3ya X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: 0D423C0013 X-Rspam-User: X-HE-Tag: 1742412203-200420 X-HE-Meta: U2FsdGVkX183tD8B+88RilmVdUpeFNcx4ahOzHpcHmgKk2Or5mqeRts7Lg18NjTIi1tdyQAr0OYdnYR/gAW5KiiQGHxDaNJRwfK2ZiphlsE8QATbPCDV0AJCOS7+5dQRMYZSWjKF6c4v90NbfXuZ9/jcSZT/tdDjsDmFjgyc4aekUZlCQ2/YShC0Dod0KmES0uC6IfNWWdTS3jcS5ZzVrDv6xV/hMS+5AV9Q1SuXiVxtgYHxJCuYJBnPWaN6+m4wibn6mcVw41w3r05h5B9EA5wQFkx9Qu3GfuzWM+zaQyD4T0HH7rhvStRKWVEeBYSFdvgZBkFkud+mUaORlyrUhpwOaI7VDJkGmOu0J0BMA0vTD924JcGktakT4BWIDEjjkR0zyItyB/vOsdnLgs1nWMUPa2xjS1ppEO539Jzg+yg7WRdUALHL+0CTPTk7zfnq1EvDYBavwH9hbHCxQXwyvY7a17J+uyViTFAEdN/7UegSmb6EKTCpC9a+JBIL7bwMJ7FIJk+gwV7xYmf2XGFjw/Xn3MM/xK71RUi1APtdi5VEIFy2OB8EHfMmqN2e9QMYBEWjrz40EfHubw7PbGw6/Ez6lbn/DEz8kussINZFcwei3FMBVFTGNMV4nztux2KBDXSD8+0T9Eh6Xzb4Vxw/4NfoniNe8G/5H+LVeXvesUs6jlE/my9Y0a0e+t+o9HLbHuE1fvOLR3VubhtRv4/6LRPvfCED4kLhi0h7DeQtGKbXFN5LDX2dwvxi7VIcGn2Ayof+jvkfuQDE/qcmESMXUyw0cbx8S0KQeOkCwOQturicLGeuSNtAKakOOqizCC2BH7aTxU6cNQD1FfB9zNqRvBF0PLBnj2+sS00HdUAMXbj78BxsFzL/kAsw5BT8kg91NFfHXeZy3X00MZijs+MPsgFinn4UEtUfFg6oxattuVzBGitiMqNNvzwdWmcdtSNYDDPYaiOL/iZ1DqUqMVe boCbcfs6 kqYvSqK/TC1QoNBWeZe0WyOtGo9TlHMdF57ZWN9/r6jY1Wh9rG6S99yNpHdbG6DaHIDFW1AubXTAKvNPyc3txdZLY4XZGm0Bqa3bDXq4Uj/ILpRd8TI93tf61Jcyt/DO8sMWHBD5X/w4ARsS9P8l+SOmlXPu2RB/ELw7mYqr5hXCIG0/Icaqq9PaXIbVAZ+TbT9FGXRLlYl2F3xZH9tn8JWEajlc1mNtY24sXXFDC8nVLYGR0Q25vq+tnS7qtwcQT6MZ4ZdVwobsJyD1QSBcX8siiYyBN4nZUgrQrU3VGzAYWMGTGfiw1HzOwwHrA7S9bRLjxqC99FbvSKAbxNdPUMhu9ZLs5I7+d6EjNl9L0uE9Jo30f3CUeEw2t8swiEVmf8RuGT46tvSyUuylI2UhkM5bjKFzdblcjYGT7l0DViDktMRCVZE+ms/PzZqRJQQq8xUkzk2MF2CXiM7jFU+gVeb9f0zsJBofiEHDjdoF7ZY1P19NRaF1lYGrtMZAEtXT99UdoXPaaL4nUuS3t+AUgqzpjhk+Um/XVzzg0T/lvUxhTm4ud2yoqtqHsxo75oSI91Y1fmq9qzwo/IKibb+SmpYKYl0W3vUzVUItRy9c1zx69uXBQeTpowpzfMuVR35jvWPFQOoQCkybNjRc= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Zi Yan No function change is intended. The factored out code will be reused in an upcoming batched folio move function. Signed-off-by: Zi Yan Signed-off-by: Shivank Garg --- mm/migrate.c | 101 +++++++++++++++++++++++++++++++++------------------ 1 file changed, 65 insertions(+), 36 deletions(-) diff --git a/mm/migrate.c b/mm/migrate.c index fb19a18892c8..ce7ddc56e878 100644 --- a/mm/migrate.c +++ b/mm/migrate.c @@ -1014,18 +1014,7 @@ static int fallback_migrate_folio(struct address_space *mapping, return migrate_folio(mapping, dst, src, mode); } -/* - * Move a page to a newly allocated page - * The page is locked and all ptes have been successfully removed. - * - * The new page will have replaced the old page if this function - * is successful. - * - * Return value: - * < 0 - error code - * MIGRATEPAGE_SUCCESS - success - */ -static int move_to_new_folio(struct folio *dst, struct folio *src, +static int _move_to_new_folio_prep(struct folio *dst, struct folio *src, enum migrate_mode mode) { int rc = -EAGAIN; @@ -1072,7 +1061,13 @@ static int move_to_new_folio(struct folio *dst, struct folio *src, WARN_ON_ONCE(rc == MIGRATEPAGE_SUCCESS && !folio_test_isolated(src)); } +out: + return rc; +} +static void _move_to_new_folio_finalize(struct folio *dst, struct folio *src, + int rc) +{ /* * When successful, old pagecache src->mapping must be cleared before * src is freed; but stats require that PageAnon be left as PageAnon. @@ -1099,7 +1094,29 @@ static int move_to_new_folio(struct folio *dst, struct folio *src, if (likely(!folio_is_zone_device(dst))) flush_dcache_folio(dst); } -out: +} + + +/* + * Move a page to a newly allocated page + * The page is locked and all ptes have been successfully removed. + * + * The new page will have replaced the old page if this function + * is successful. + * + * Return value: + * < 0 - error code + * MIGRATEPAGE_SUCCESS - success + */ +static int move_to_new_folio(struct folio *dst, struct folio *src, + enum migrate_mode mode) +{ + int rc; + + rc = _move_to_new_folio_prep(dst, src, mode); + + _move_to_new_folio_finalize(dst, src, rc); + return rc; } @@ -1341,29 +1358,9 @@ static int migrate_folio_unmap(new_folio_t get_new_folio, return rc; } -/* Migrate the folio to the newly allocated folio in dst. */ -static int migrate_folio_move(free_folio_t put_new_folio, unsigned long private, - struct folio *src, struct folio *dst, - enum migrate_mode mode, enum migrate_reason reason, - struct list_head *ret) +static void _migrate_folio_move_finalize1(struct folio *src, struct folio *dst, + int old_page_state) { - int rc; - int old_page_state = 0; - struct anon_vma *anon_vma = NULL; - bool is_lru = !__folio_test_movable(src); - struct list_head *prev; - - __migrate_folio_extract(dst, &old_page_state, &anon_vma); - prev = dst->lru.prev; - list_del(&dst->lru); - - rc = move_to_new_folio(dst, src, mode); - if (rc) - goto out; - - if (unlikely(!is_lru)) - goto out_unlock_both; - /* * When successful, push dst to LRU immediately: so that if it * turns out to be an mlocked page, remove_migration_ptes() will @@ -1379,8 +1376,12 @@ static int migrate_folio_move(free_folio_t put_new_folio, unsigned long private, if (old_page_state & PAGE_WAS_MAPPED) remove_migration_ptes(src, dst, 0); +} -out_unlock_both: +static void _migrate_folio_move_finalize2(struct folio *src, struct folio *dst, + enum migrate_reason reason, + struct anon_vma *anon_vma) +{ folio_unlock(dst); set_page_owner_migrate_reason(&dst->page, reason); /* @@ -1400,6 +1401,34 @@ static int migrate_folio_move(free_folio_t put_new_folio, unsigned long private, put_anon_vma(anon_vma); folio_unlock(src); migrate_folio_done(src, reason); +} + +/* Migrate the folio to the newly allocated folio in dst. */ +static int migrate_folio_move(free_folio_t put_new_folio, unsigned long private, + struct folio *src, struct folio *dst, + enum migrate_mode mode, enum migrate_reason reason, + struct list_head *ret) +{ + int rc; + int old_page_state = 0; + struct anon_vma *anon_vma = NULL; + bool is_lru = !__folio_test_movable(src); + struct list_head *prev; + + __migrate_folio_extract(dst, &old_page_state, &anon_vma); + prev = dst->lru.prev; + list_del(&dst->lru); + + rc = move_to_new_folio(dst, src, mode); + if (rc) + goto out; + + if (unlikely(!is_lru)) + goto out_unlock_both; + + _migrate_folio_move_finalize1(src, dst, old_page_state); +out_unlock_both: + _migrate_folio_move_finalize2(src, dst, reason, anon_vma); return rc; out: