From patchwork Tue May 21 11:49:38 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Xu Yang X-Patchwork-Id: 13668886 Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-db3eur04on2079.outbound.protection.outlook.com [40.107.6.79]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 2980A134B1; Tue, 21 May 2024 03:41:44 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.6.79 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716262907; cv=fail; b=uGF+L9TKiHbSo0aOTlfcYeRtuIj78vI4JBWW0JDVWYHmy2Nfk7LEZ5vWuEgSBUbgmMSMS8fXzg2rUvLZYmzYk/4hFYfXyOSdobYVi+XshN7rB81Y/KgwceX/v/xnSkPvWox5VqyCS0FHpEzrM6qkI5LGTE7nwdc1PayULv1tjGE= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716262907; c=relaxed/simple; bh=qHWQxhaliVYLKKkvUo518Gf164gv80CSgF73d7w3+gQ=; h=From:To:Cc:Subject:Date:Message-Id:Content-Type:MIME-Version; b=Tir3UA4rNGJ+aqtpHRlQ7pW0CHpI3C+55e+Lzui4+LxDB9U86Hbod8OXDlpeWnER97p7vlC2xhlEeJyAQEhR2ibPQPumb9l8iZvEGOp5lcV6SwoMYjbjzGDJJjYSeYsVQN3lXZDWB7IMCoxcxmh6lKcGBCcEL/6NpP2rWSC5Fmc= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com; spf=pass smtp.mailfrom=nxp.com; dkim=pass (1024-bit key) header.d=nxp.com header.i=@nxp.com header.b=hTjkG08T; arc=fail smtp.client-ip=40.107.6.79 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=nxp.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=nxp.com header.i=@nxp.com header.b="hTjkG08T" ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=KdvauhSZ4qLgTnl32v9stb7pL+AJtxsSdHWpih2OpUzpSBNR1q9bKtRZoL0FgTuFurWdPdhu+0wQE2Ce83gw3TASMfPZCqzRLZ8H5wMfJKsupgys3OJwzorgrdQTw0gLlQaPDnglgqtc6gS/YG+ODPptVEb2IONrGrSZUOls4LfFGbqHmtQ+azWP/coOsNA8KzziI9BKuNrGOSwUgPhlpVhAyk0OL2phRcPHGcCMampZS8QRApRGL3OayYv4HA8ItqNwRBdyJjUkrgrE362sVtcEencTMdKMkHQ2qsxX9rG5UE38Dl/4zhCQ4sx6aZQm3Jir9Ap25bX08fIPLMM86Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=xoD4U5KT5tLz3wUrOl0GKj4h7wjVLs02V9P6S9Sa7+4=; b=oaiV6SLZYhVumquoaFFAeyJKYTqkCT8vlMy1xpFv2wqcayxdFqYimdR7TmDdXauIfMHWdti4iboyu5Q529MiQXAxNGBpuBzKderFT6ZXMxc3h/MoCRyftWAlkgXrDvU1aGSjxCG08g0Y/a3arKvY0JQzWtVGUFx8hAaN3C0qMbXTXTKGwao6RYGuxcUET8FHyOl+BtgmQk8ONNIBLafoRkZfsV7mBITuJjbS7ukc4ipbUG7IU0jojihciRAdgasydggiQwFdl8qNIc7rxOKKqB1YBDh37dTs1pFz59ptyr7pVdgmmkQtn3RJxmBXhyr8919Xon2Wrse+LRPA7pABCw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nxp.com; dmarc=pass action=none header.from=nxp.com; dkim=pass header.d=nxp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nxp.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xoD4U5KT5tLz3wUrOl0GKj4h7wjVLs02V9P6S9Sa7+4=; b=hTjkG08TVrbSsn2gORJ8zEs2nmsnuvj/6/GcvURCJj3ntTsU33WaYmAYY4TvvnVQpgwsSRXe/QY2tU+FXh4HNKSgJYMWgRdWJgcHhmeGA/cSPuqXJJciTDp2UNy8+dRvPjKPQHYwEeBvhJC5RRTWYkadKEhBRNp49QaYQC9rM98= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nxp.com; Received: from DU2PR04MB8822.eurprd04.prod.outlook.com (2603:10a6:10:2e1::11) by AM9PR04MB8212.eurprd04.prod.outlook.com (2603:10a6:20b:3b7::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7587.36; Tue, 21 May 2024 03:41:42 +0000 Received: from DU2PR04MB8822.eurprd04.prod.outlook.com ([fe80::8d2f:ac7e:966a:2f5f]) by DU2PR04MB8822.eurprd04.prod.outlook.com ([fe80::8d2f:ac7e:966a:2f5f%6]) with mapi id 15.20.7587.035; Tue, 21 May 2024 03:41:42 +0000 From: Xu Yang To: brauner@kernel.org, djwong@kernel.org, willy@infradead.org, akpm@linux-foundation.org Cc: linux-xfs@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, jun.li@nxp.com Subject: [PATCH v5 1/2] filemap: add helper mapping_max_folio_size() Date: Tue, 21 May 2024 19:49:38 +0800 Message-Id: <20240521114939.2541461-1-xu.yang_2@nxp.com> X-Mailer: git-send-email 2.34.1 X-ClientProxiedBy: SG3P274CA0016.SGPP274.PROD.OUTLOOK.COM (2603:1096:4:be::28) To DU2PR04MB8822.eurprd04.prod.outlook.com (2603:10a6:10:2e1::11) Precedence: bulk X-Mailing-List: linux-fsdevel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DU2PR04MB8822:EE_|AM9PR04MB8212:EE_ X-MS-Office365-Filtering-Correlation-Id: ef153253-185b-4de2-7431-08dc7947ee16 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230031|1800799015|52116005|376005|366007|38350700005; X-Microsoft-Antispam-Message-Info: 62iSDpyhjaKEEEaGGhgBQvd4WKW1jPkEyNFP4OZlw8ih6Gh4ntssEUrzer+TiUBFCGUxhfwOWg/PDcApjIv5WY8uAwPZi3ZzMr41dDbbFzyWXuMBGQmQJ1fhX55F5h2qS8cxlM6rs7bIEDXPAZPYdCougowmxYTgFW70N4XM4Iie9pu+RcAxbw6N9JVE63RSJqBnWQG9rhAM5kDJgDUTp6jmmYMPyJ6Qp5KxHyVGFFphMtAF7HbwouFz1Tr+8PTiDNcLcahq8FGcUDwwkuOfl30oJaLlQaG/uylcRFquim5XwNsyIpIEEuWUB5HCtKsDEjtJXkeGhYzm4XZo8dtUvdRkKXXRcM+A2gBy6vAqHZwAj8mUOZvUEvtouNbQxVbx+jldGH3MloSVnxedEeq1UTBHztIPUb9rzQGoAdxkk8mwZmkXdGoe45i7dqS6WFOkbXOKMG4ZZ/f5PIVztUpfm1tziA9iTJWkAmzNJQ7Aw6FSo9L2wxOmO/gm7eHX7nXZZOpGH3kc9IiHkcvp9Fej46Hlk+MifEUllc5D82da0H/NrOsekCvMJgf03uvVtsWwHWN/aCXyZAD6vJ2Drlu1k2HnSu187MuKHyiRSYpv2TlYOQv1lWATo72PeEuAJ3ssXYwujxi7eqUaDta2YimT91gzltGzl8L26zXBGSxiGfvvwqRQ6k3BkK5vbXdHVeVuCj/+IwhveHdywnEp8vbLUvrIU5OqRgFvbE5+6XqqlysQa0muYLgaA4SCvWik7j9yjZ/3hf9Jbt0LrdKQYZCLdqhIGnG1qmO0FOGpfaHibKNxMvK44AQskxBNhtFg+pH/BiYEw0kq5LcOynTp11N4eyEj7A5VgctqECaxI7eB9KLrkV7TSsolaPMGxp10zxC/px3t7mFa7EdhQtJf1PPclnR+lXZfh2Fh4xSz+hlYbStcbqWeJin8Q5/98OJMvhr8bM6BlTYZzFYZBYjLFmD4u+cB7uD8UJ2bcyYnqS4G4cHJtcLzXDq9Ugw0V60jpNv1KxHeRpo99djRUe8d0ZnenQADQQqKTAqrcSFuIunpFbso3yNlLi0xkhdWj/jLeYZmX+qBtLjJNa4U27LGILI6PwZr9wyzCrhz2I+32LU9+pw+AozZKmZ1BEqwnAv8bnt7tkORNxWH8Wf9HtAitkqcnSDKnzFqYW3HavDhAG+vuuLtZkamU7Mtl5RLJ4LDPRhxc57NFhpwTATPPTTlOlh93pWaCeF1h82Y5UbRqRwOeWa+U/azR7MZ48vs36B63DZXtzRxgx/y4JrgVpSwQMpwr8KfDsuKcT9sqLLkJq8xzZZnRtkvDghTQ5Jk15eiFkIO X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DU2PR04MB8822.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(1800799015)(52116005)(376005)(366007)(38350700005);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: GC4fkTpFf8vjSdT+GNrHAFQ0yPBh83w7pKjQTrG9R5C+aX1fYHWrK3bBVkXQDn3uHUoNFsuIWKr+o/fxd7pajkOk13csLIpWV3tr0mx+XEDR42nu1es6ZkGgUjTkbjMaK+8dlFGJHVXoWVzzzTrArzJ8jIqPCrtqDhEtEzqiRq2xkeXASa3x/v0Sf+5ATrj+TYA7kdVDDTr7nwJJNdQ3XRSMpxebTpYjQvPROJfHTfcZ3XC+Cg8sX4XqiMHH3TocSv0ddVDAa/sJes6BVT/apPxETkWW1hzVCZfEJ4/zz7sAyf9Fy0pXyus9YEdi7AOjAn8wbRJgYks/ArN59SV9RBgfSA4wekgYarIa67XEosF2u9Fwxgn8V+XXhkn82U09bsHWC8C/BrYBoReU/aoN22gVvGzq94OIWFJMRLfXFvTI7rNJEf3J2FL066aHayDwuHq0k/dlw+CZafT0YzGN6wNTNRxEsJ/kG6vCyP4krGBO5n5ascPL+Jj3EhO6ArYZn1nFYyd+5JKDlmw9Lknr53tYDbzLU1+T5QceDh7ifdUFFDDxuEPa7VNwDNqv0bOia149B9XNKoSIcbxrDuoTEaN+6usexZkQ66xP2n+l5hPj6C64wRk7DpnOwYXVWyGGh4ryAca52MrGLKzte7S4AfDEeLg0SUnTwkE/afc59sxUkxuKp4joON1D/6Qkj/QTWmr9gabJ0e/Jc2r9U0MxxCf+GaEDl/KgHJeyPy2zryK2PgmhPiiWD1/pSLHNCktw49W44piu6kuO2pe8xg8wQ7cFqtg77ueSUPCzRgOrw+4zQe3E8F1KRNh9V0d1aZeik8e6Xh1xCMqlmDe/NhI4DpG5qKOlkpktbyz5ekVzEfMVMPhliANUgON379gyLVMOTkLvNp72cyoExIJ7SjiP+0VmT5lbk1JOnbiMgDLUFCjd181jFdZ4ZLcqMWFvmpr47mACs3t0Ja2++t0+oWm1ypRu+OO4DLx+G8KGZhLBfNCKstHw7jGLOX+GJvOliFaSC0u6PaiGyBUNTXkYByEsjBtjzaD9uJ/2czI1JjkBYA+0F0Ni3iNuD/nzMHS375jNAaXZrF5vnaHvPBGMogeW1eg1ipTT5Y4j2iUJj9SyjjniBWX1+/qwYTJaEZTNhQWWz2g2ByVT+FMNzOY+kyhN+OjMJzCtjpAFKYe/mS4V8Yzjza4smGaGbUmKcQNWu3BwCO5tBUcGkiibWJOxWL5b8i9YeO5PFNxilJJ4cxI5mwab1b6y7IRiWoI9jTWbJ4aWYqXNo3ks8HlXK/Rjl8gVaMTNzz4NH0v2AmUh3sWRWnNT8t4QtyeaSZhPDB0f1MryC+h2WRksArmpltpcfsVfNJsCR1nnRdNvDneT6yCUR7SHEe+zQjXXq/eR41q01bbptNlx+6gkEEMkKKPTCzpX2bF2WDtzpf93M54lRDh7R7I1QWGE0OyFPO/H9eqB/qgxIbtQ6cuCt6+pKdjjBgzN50N5XoTBpYJTz9kQRsHF6+gVcUWEPVCijjJzxP7ljUmjK/lP3BbN4SpYD5/wMe4h7bUudiLD28vvFdeX/sAQoWYm8XdoSAardxpZSKIh/51q X-OriginatorOrg: nxp.com X-MS-Exchange-CrossTenant-Network-Message-Id: ef153253-185b-4de2-7431-08dc7947ee16 X-MS-Exchange-CrossTenant-AuthSource: DU2PR04MB8822.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 May 2024 03:41:42.5220 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: xY7871XynTdTnSjQtcIG6GrB8YJHXe/SJwB6WsB1ITXO+8W7/7HvNeskIS9ULwLqnIoOphTCpwaLZ/cU8hrVEA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM9PR04MB8212 Add mapping_max_folio_size() to get the maximum folio size for this pagecache mapping. Fixes: 5d8edfb900d5 ("iomap: Copy larger chunks from userspace") Cc: stable@vger.kernel.org Reviewed-by: Darrick J. Wong Signed-off-by: Xu Yang Reviewed-by: Ritesh Harjani (IBM) Reviewed-by: Christoph Hellwig Reviewed-by: Matthew Wilcox (Oracle) --- Changes in v4: - split the mapping_max_folio_size() from v3 - adjust mapping_max_folio_size() comment - add Rb tag Changes in v5: - add fix tag and stable list --- include/linux/pagemap.h | 34 +++++++++++++++++++++------------- 1 file changed, 21 insertions(+), 13 deletions(-) diff --git a/include/linux/pagemap.h b/include/linux/pagemap.h index c5e33e2ca48a..d43cf36bb68b 100644 --- a/include/linux/pagemap.h +++ b/include/linux/pagemap.h @@ -346,6 +346,19 @@ static inline void mapping_set_gfp_mask(struct address_space *m, gfp_t mask) m->gfp_mask = mask; } +/* + * There are some parts of the kernel which assume that PMD entries + * are exactly HPAGE_PMD_ORDER. Those should be fixed, but until then, + * limit the maximum allocation order to PMD size. I'm not aware of any + * assumptions about maximum order if THP are disabled, but 8 seems like + * a good order (that's 1MB if you're using 4kB pages) + */ +#ifdef CONFIG_TRANSPARENT_HUGEPAGE +#define MAX_PAGECACHE_ORDER HPAGE_PMD_ORDER +#else +#define MAX_PAGECACHE_ORDER 8 +#endif + /** * mapping_set_large_folios() - Indicate the file supports large folios. * @mapping: The file. @@ -372,6 +385,14 @@ static inline bool mapping_large_folio_support(struct address_space *mapping) test_bit(AS_LARGE_FOLIO_SUPPORT, &mapping->flags); } +/* Return the maximum folio size for this pagecache mapping, in bytes. */ +static inline size_t mapping_max_folio_size(struct address_space *mapping) +{ + if (mapping_large_folio_support(mapping)) + return PAGE_SIZE << MAX_PAGECACHE_ORDER; + return PAGE_SIZE; +} + static inline int filemap_nr_thps(struct address_space *mapping) { #ifdef CONFIG_READ_ONLY_THP_FOR_FS @@ -530,19 +551,6 @@ static inline void *detach_page_private(struct page *page) return folio_detach_private(page_folio(page)); } -/* - * There are some parts of the kernel which assume that PMD entries - * are exactly HPAGE_PMD_ORDER. Those should be fixed, but until then, - * limit the maximum allocation order to PMD size. I'm not aware of any - * assumptions about maximum order if THP are disabled, but 8 seems like - * a good order (that's 1MB if you're using 4kB pages) - */ -#ifdef CONFIG_TRANSPARENT_HUGEPAGE -#define MAX_PAGECACHE_ORDER HPAGE_PMD_ORDER -#else -#define MAX_PAGECACHE_ORDER 8 -#endif - #ifdef CONFIG_NUMA struct folio *filemap_alloc_folio(gfp_t gfp, unsigned int order); #else From patchwork Tue May 21 11:49:39 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Xu Yang X-Patchwork-Id: 13668887 Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-db3eur04on2079.outbound.protection.outlook.com [40.107.6.79]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 56E91182DB; Tue, 21 May 2024 03:41:47 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.6.79 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716262909; cv=fail; b=YU02kUzeJkZxnl80lUhwWRtaHFLTxfOX3zWxL9rl2ToT2spitre6C9sTTOxqa9MNVrNPl2RMc34/BQqUUQlaQ2ov1kiDGdH1O+vQ7GLp95SrpeFATOU81VstMIA48mS+Jt/Pq0CNP3K/pS1iqudl6Aj1Up1VerGvWSopCSRyXwo= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716262909; c=relaxed/simple; bh=3Br7GrShTYuvp0ga2yOM9alAgyEW/s7Msw9n8DatPDY=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: Content-Type:MIME-Version; b=PsjnyHciebykaJDiMDR/6ZQJYYk9UO+fzO3b7PpI3dc5KE8eySFdYYEcFY82Mqvm0hqptETCtoVfx2D6Oinud83cxplHSHqfleuttZZVmfs2gABxzL1REzLkymk1NH4U9BZ0tYsuX2G2dXkqnjFCP2B9pth0JzFyOmtbdcNX9/o= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com; spf=pass smtp.mailfrom=nxp.com; dkim=pass (1024-bit key) header.d=nxp.com header.i=@nxp.com header.b=hb18RWC4; arc=fail smtp.client-ip=40.107.6.79 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=nxp.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=nxp.com header.i=@nxp.com header.b="hb18RWC4" ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cCh0okGYE2JdN1hWfAlWLxs/n4jI1nhYPUQBbu/PXxMRRoT84pZH3diz4VSLiTX5QlzH/V/zIgcSesTp9GcYmMfdtXvSjI7t+ygIPmqVGxf2j7hpLS51z65QQ1QKMCVAxw4nRXJOGrhQiNMwkbIQtp0z6hONlbGRHWoaNDecPA/eLDdyP/SuktX3w+FwfMFM+RBGhjKFx6CVpi7XXlNC08lRSg8LsrelwQI4YMjMBuG2cio+cDYj5T6YTgsyklCqWT+eEA6X1BRS7HNeTdsqyxRVVZuJRDxa3O1TB2tMSnqj9aYx8wrpUTzXAPwr1hsAnIjJHliY7ZtGs/njCNXcNg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=VioMiY8TvLlw52PeygM9+PK61Y19grDV3m6pKMV7lao=; b=bPDSibbNuxAMmrIBeLcd45KF5yII4OhIDGad7qQBYAhaG0L4/9WgSJLGmeT8HPPZP8MxPSsGhwcwGp8LjBGAaRdPmT4kDsRVCj7c0kt+Px3mfjYEJyM7Rn4PfAfRzkOmgOnCk0B66J4fUevJ/qT2KHviqNh6NE1q+Rx31i+0lERr3R14y6Swxg2kdYLjjuV/zauC/gjxfpcP3GhCa/E5vYUaESNPLbqIk06VBJVBe3WreHrWa/4Fn1pHLrvjgHcH4RyukigrEtfrURSEmq4XkHm5ZF9ut76V6NE2ikOud3ykxRS5+u0CD7Jzqk6fASTuu4zayOY4SfR0dR0grGFUnA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nxp.com; dmarc=pass action=none header.from=nxp.com; dkim=pass header.d=nxp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nxp.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=VioMiY8TvLlw52PeygM9+PK61Y19grDV3m6pKMV7lao=; b=hb18RWC4UFbylLc5RXDDoBR3mYgNsAeIkBfmGSrRVL9PugNGB57PO9UkHr4NTEu+zqejO5rHwC5YseIYm1QA3Z2K+FLALOwkRcHxpEZXJmhvV9+7RHF8/CjeXQIFXFxGYrTiRCGIua2Xih0DE9Oo7siug13IkumcNHA6Rj+KACE= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nxp.com; Received: from DU2PR04MB8822.eurprd04.prod.outlook.com (2603:10a6:10:2e1::11) by AM9PR04MB8212.eurprd04.prod.outlook.com (2603:10a6:20b:3b7::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7587.36; Tue, 21 May 2024 03:41:45 +0000 Received: from DU2PR04MB8822.eurprd04.prod.outlook.com ([fe80::8d2f:ac7e:966a:2f5f]) by DU2PR04MB8822.eurprd04.prod.outlook.com ([fe80::8d2f:ac7e:966a:2f5f%6]) with mapi id 15.20.7587.035; Tue, 21 May 2024 03:41:45 +0000 From: Xu Yang To: brauner@kernel.org, djwong@kernel.org, willy@infradead.org, akpm@linux-foundation.org Cc: linux-xfs@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, jun.li@nxp.com Subject: [PATCH v5 2/2] iomap: fault in smaller chunks for non-large folio mappings Date: Tue, 21 May 2024 19:49:39 +0800 Message-Id: <20240521114939.2541461-2-xu.yang_2@nxp.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240521114939.2541461-1-xu.yang_2@nxp.com> References: <20240521114939.2541461-1-xu.yang_2@nxp.com> X-ClientProxiedBy: SG3P274CA0016.SGPP274.PROD.OUTLOOK.COM (2603:1096:4:be::28) To DU2PR04MB8822.eurprd04.prod.outlook.com (2603:10a6:10:2e1::11) Precedence: bulk X-Mailing-List: linux-fsdevel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DU2PR04MB8822:EE_|AM9PR04MB8212:EE_ X-MS-Office365-Filtering-Correlation-Id: 7bacdb00-c3e4-43a9-3d71-08dc7947eff9 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230031|1800799015|52116005|376005|366007|38350700005; X-Microsoft-Antispam-Message-Info: W06iFkFeU7S0NA0F7Qe06bfN70lvi/6IepHznwpGI8lkL2dbJ7jaXLdfp73bBka4BLwJbZSOTrMVl3mo6sFVwtOmrHYWPI/4VhDcndDzdqjA4dY+m2TwQIdC2KMwVeqUQDlAfLcBSB3/Lbe2gLBLETB9lCnS74HGAtLRgpdS0IJ/eYz+XMYym3/YYkBlnUg6w9zRZ+e7luoa9qSJykS/WBBcahIumf6FaQrLxykUVWf9FVbhFpxpdddVkJYWSO/j4kefQ8XSPoaj6rgzkxfXG99XJ9uQdzw5hUkZMhwr9Wp0IAkwXDtVgD0Lw8g4nv0Hnusqar9g6mp+flsZJgVd00HrX5Kb9cD2x0S4+oMNvkmiqHNHj/fP/UNFqQpckSxTGBUPI/KnM+RMX2CKMrDoRlkM3B+cUR6Pt5vIrN6aJLGYDtDHCPSOvs7YngWg7kHAjk8LzTbJVft5u+FkmrfLJkvPbJL4e7rnN6e3uSw2kWoI+kASbQuOVZPvSfterfZOSM5uHjI9UkGz9RxhtSbWidIiHbdTPB3uYaxrL7pqbUV/dtFYrSuUZClMP+LxBHQrJNiYlIchLe2749E78azmwL+a5IJQ/O81DrpEk2uZvi7Q8R2/Ja430DeUlJSLtdw4NOvgjUkwJ5Ik8nL0EQ+8vSSVcZNqGFfL+zWfqrQR+6ENBzzm3it780sePD6quWLgz5xpWX9Yh1DW3wjJXH+UB0yAjKCIeCLqmHiwFhp+OKUcq4fMQEbVfoujgijUeIy6dKrbUGK5c7i5RW3tBqcHHIw1COkmHd7n284ejvmH8+XJz4L8CCSK71kADjmG+iI+KM3/QoXYPrYPdCAhyoTSJnMvTRjEFFaqPtaMJQ+VdnhPieWgleboT0Vzzit8HKi5J8xEPJS9hsg3G+Byx44+AuG9Iw17KC3l92IhkzFHUzM+/c6jPwyYjldqFjMvnqF7xrVp8Kr0gf713kWooHjRYo60jWOconZT6ZSSXyoSORUBVQLt28iNb/q8UtmFRCHvN+46J7nRdhYDKWdAkHSR0Yu7L+kvlMGrydFlM5K/BX3nAINew74wDfXzDwMgDuY0dKA5ykokYzcKFOKq13V8Vu2EVZg98lXz/ALsdN5wnW14tYUzUjGRXjXR0g+imEY3ECHfcg/Rh+p/Z/+nIa3tiUTMA8pp5FYkK5xwBIkOwLrOe85kVPSB2+rXIs4vt4xuaAcCtoNLfOBjnaP+PAE6hAnl8Kvv9hu5YUUmvg6VsHCbcCyBZ1IfcpK64PYBYdQRcYS+l3lgqx3o2/muFL6MiHVix8pwhlvuqwJXkBApPQxX4tAMV/hEkUSHyquXUItEwuumY6h8HzpNCfJaPThakg== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DU2PR04MB8822.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(1800799015)(52116005)(376005)(366007)(38350700005);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: pthm84TnfcrQZK15VfVY56LsnkeeXb9llGHKZyxcfs0yRnNYyr0cnu93bgGtmyx8HqUMHawHlTRUNyZk0hHej0CyZTyYCGn+z9UbhpFtFxVd8tPFYWkkNg8PrjaOT72yuVUrM8oEMNjyOKx0WeUQ8G0QpmRwdX7TBPK2I0kBEZjjV8gJ65vEm2V4JuqXhsd/fDv6kRMkcd0vbue9kXprphFeQcTyrQVNJy3Z+5a/4U4mNeKeNQPi8kLX6EDIpVmcjrOqFudMQ51WKrUc/Dav+f05U4cmz5xRcZ3zfaDgiDQXlcSBtStZEkOMLTc/92hP/4BuGPy49ZpN2Tf7/Yp2FSfDfFUGm4u/8oCP2NPOyMhiOiqwGzmFx9Kb91jjC2oaBwsVSmntGbmBAnGCz5MDmInFad9Bp1Of9+rXgusEoFV6EiA7Y5E6fLl+BC2ZBSEzHXnxc7tFq8peDUD0+NGmQEgpYuwNIGgNLnnPJgyCWiPjdIljre7wOmEd4AVVYCgArjeX0Iz2H2TxE+q7aMvNjmX+uMoWdNMLL8aeyabAAK2aZ7sJwdmwj0EflPTBMO7Py+xbERpOxTOSRCk1ScOyqpv3Y74RFZMiZKuLYQXKpwikj2szADUbcYroJdvhSw9jcPt/d/sqRmbxkBVhN9du1qtIaX6BsjTHbx2SEfdbXDsYLG4tpYYJVElePhjCLXDBIq9IKqOsig+Qp+e98QLCtND5lwTN5xtC5PWOwNjYw8f6xvN3oDZtWqWuDEbt155YWgv5UHXQTlXcqvlMHZU3FdtJ+3jYh4UnXKo6p+xdHOk2Pz2gtM1GVRA60xf5q5d66OrzrgCRm55kZixnEiAUKYpRbfZf2XG4riXj/R5V49OKIAhwdKW2Zogyr54XLTlOd4MLkzPmFUQRBIWuXV6y+9dRVkbfphziiGAEhn+VhcLvXNAuO5E/363Cobi/TVeGYTiUjlLKZBw4k3JuPEf0tkrmO2BoyPCEd3uASUzc+c+SdKqLOrBSJjEeHkymRJnYNoCycQ/gexvZPHLg3L2I9Ckq5Rfs4cqEnbGlCTzZjsJ0EMQZK+pkCLDf0AAbgN7ShlpcBPnrP70wFOOcr5FrV+DiiLd3z+cwtaBDE5x15eD/+Kp26qtlV8pRIWCsE4inNaecASFsScSqG+kvgSv0wVEwU8xTmAM6qyPJh6KMrODLzAP7lMVtBnEl4SBYlXNPqYZxotZIYt2sJos14USVQrvW0tA8YtJb2+GLSpBy9FQ7nIXtXddi6sMR2H08NSQRATXUs0LYKVkdhjMiqC6sl+eu3KzggxV72gplrAqENVDpSIvEKYE2qpCmljd2zZwb0J89JCIk0HNQsoN5argYHAbs2ZZ6rRriJmika0RiErk4/UoYD7ZE48ruBt55wCLE+BmG7IESnmdzyfghPmkn4W8n9IjjovvwtB6gGdtiKkarauo4LJyuzyei0JnTBp/N34GH1OrB8/uN8q2+X8J+0Y6fLbF1N8uQSFKi5IiQ3U4z1gyM7o+7AL7BazHPXhVtL+RyZ10fcnRUjToaNqOZ3YPvlnTOX6WEallMW+3iGY6LRZVMs7aLjTWk7JJnK1sU X-OriginatorOrg: nxp.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7bacdb00-c3e4-43a9-3d71-08dc7947eff9 X-MS-Exchange-CrossTenant-AuthSource: DU2PR04MB8822.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 May 2024 03:41:45.7338 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Zv5pJ8QQYxYa6V2URaGW5vDeU5PtKctylJ+GiyKO+RARCzOCOO9yxdAs01jx5ZnjPMidQmosoVCnQMTRBitttg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM9PR04MB8212 Since commit (5d8edfb900d5 "iomap: Copy larger chunks from userspace"), iomap will try to copy in larger chunks than PAGE_SIZE. However, if the mapping doesn't support large folio, only one page of maximum 4KB will be created and 4KB data will be writen to pagecache each time. Then, next 4KB will be handled in next iteration. This will cause potential write performance problem. If chunk is 2MB, total 512 pages need to be handled finally. During this period, fault_in_iov_iter_readable() is called to check iov_iter readable validity. Since only 4KB will be handled each time, below address space will be checked over and over again: start end - buf, buf+2MB buf+4KB, buf+2MB buf+8KB, buf+2MB ... buf+2044KB buf+2MB Obviously the checking size is wrong since only 4KB will be handled each time. So this will get a correct chunk to let iomap work well in non-large folio case. With this change, the write speed will be stable. Tested on ARM64 device. Before: - dd if=/dev/zero of=/dev/sda bs=400K count=10485 (334 MB/s) - dd if=/dev/zero of=/dev/sda bs=800K count=5242 (278 MB/s) - dd if=/dev/zero of=/dev/sda bs=1600K count=2621 (204 MB/s) - dd if=/dev/zero of=/dev/sda bs=2200K count=1906 (170 MB/s) - dd if=/dev/zero of=/dev/sda bs=3000K count=1398 (150 MB/s) - dd if=/dev/zero of=/dev/sda bs=4500K count=932 (139 MB/s) After: - dd if=/dev/zero of=/dev/sda bs=400K count=10485 (339 MB/s) - dd if=/dev/zero of=/dev/sda bs=800K count=5242 (330 MB/s) - dd if=/dev/zero of=/dev/sda bs=1600K count=2621 (332 MB/s) - dd if=/dev/zero of=/dev/sda bs=2200K count=1906 (333 MB/s) - dd if=/dev/zero of=/dev/sda bs=3000K count=1398 (333 MB/s) - dd if=/dev/zero of=/dev/sda bs=4500K count=932 (333 MB/s) Fixes: 5d8edfb900d5 ("iomap: Copy larger chunks from userspace") Cc: stable@vger.kernel.org Reviewed-by: Darrick J. Wong Signed-off-by: Xu Yang Reviewed-by: Christoph Hellwig Reviewed-by: Matthew Wilcox (Oracle) --- Changes in v2: - fix address space description in message Changes in v3: - adjust 'chunk' and add mapping_max_folio_size() in header file as suggested by Matthew - add write performance results in commit message Changes in v4: - split mapping_max_folio_size() into a single patch 1/2 - adjust subject - add Rb tag Changes in v5: - no change --- fs/iomap/buffered-io.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/fs/iomap/buffered-io.c b/fs/iomap/buffered-io.c index 41c8f0c68ef5..c5802a459334 100644 --- a/fs/iomap/buffered-io.c +++ b/fs/iomap/buffered-io.c @@ -898,11 +898,11 @@ static bool iomap_write_end(struct iomap_iter *iter, loff_t pos, size_t len, static loff_t iomap_write_iter(struct iomap_iter *iter, struct iov_iter *i) { loff_t length = iomap_length(iter); - size_t chunk = PAGE_SIZE << MAX_PAGECACHE_ORDER; loff_t pos = iter->pos; ssize_t total_written = 0; long status = 0; struct address_space *mapping = iter->inode->i_mapping; + size_t chunk = mapping_max_folio_size(mapping); unsigned int bdp_flags = (iter->flags & IOMAP_NOWAIT) ? BDP_ASYNC : 0; do {