From patchwork Wed May 29 13:45:05 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Pankaj Raghav (Samsung)" X-Patchwork-Id: 13678910 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9C4A6C27C43 for ; Wed, 29 May 2024 13:45:54 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 30D226B00AC; Wed, 29 May 2024 09:45:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 294A96B00AD; Wed, 29 May 2024 09:45:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 0E94F6B00AE; Wed, 29 May 2024 09:45:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id D936B6B00AC for ; Wed, 29 May 2024 09:45:53 -0400 (EDT) Received: from smtpin18.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 9EACAC07F2 for ; Wed, 29 May 2024 13:45:53 +0000 (UTC) X-FDA: 82171556586.18.4CD325E Received: from mout-p-201.mailbox.org (mout-p-201.mailbox.org [80.241.56.171]) by imf16.hostedemail.com (Postfix) with ESMTP id CE8A418000D for ; Wed, 29 May 2024 13:45:51 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=pankajraghav.com header.s=MBO0001 header.b=NUYJ7pDe; spf=pass (imf16.hostedemail.com: domain of kernel@pankajraghav.com designates 80.241.56.171 as permitted sender) smtp.mailfrom=kernel@pankajraghav.com; dmarc=pass (policy=quarantine) header.from=pankajraghav.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1716990352; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=bRJNlq7gVNU9I4tEFfojUYVu+p8wArfYUJ6q9izpCCA=; b=2Pg4BpKClo1qTzgvid2BvdGHak2V/rP9vo6gyfwQIcd45FfIuhTJ/waOnnxo37GYAbAS// I1aM0wAb+9wflx1b6LH7ByTc/7iXgouvCtPiLveTothMuuM2tsIILqP3c+lvBS7gVBF8vd qTCoFW2casAyu6myEAoYdpUt0wJ7NIg= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=pass header.d=pankajraghav.com header.s=MBO0001 header.b=NUYJ7pDe; spf=pass (imf16.hostedemail.com: domain of kernel@pankajraghav.com designates 80.241.56.171 as permitted sender) smtp.mailfrom=kernel@pankajraghav.com; dmarc=pass (policy=quarantine) header.from=pankajraghav.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1716990352; a=rsa-sha256; cv=none; b=CxTfiBKrXnkxWFxtEDFq6d0lKquvSLGy8dRDBj5Pd06JW9hFOHCRtjLWbQnA/oig612V+y f/FBOtbry7ZajMV43u+5o14Pxh5TPGDsYCnCJ7jMsNqQb/brBJ5xjg3BJYljA8H0qOxeU1 44R2/zGahfQ4nWAcdDHnJNaHVZRSP4M= Received: from smtp102.mailbox.org (smtp102.mailbox.org [IPv6:2001:67c:2050:b231:465::102]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mout-p-201.mailbox.org (Postfix) with ESMTPS id 4Vq9d80z8Fz9sqr; Wed, 29 May 2024 15:45:48 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pankajraghav.com; s=MBO0001; t=1716990348; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bRJNlq7gVNU9I4tEFfojUYVu+p8wArfYUJ6q9izpCCA=; b=NUYJ7pDeclNdi7QRK++Dp5VL9zrEcwXU9xsGVgXvv2EEW23dQf7srN5Ji7vfC3d8WgJQko qAXJR123EPpxL8sX1KJaB0F4CA5JA5mkw8Z1nnxni24NQgV+OmmSHJbatQXqi2/QYRAL1j tmsToUP4sNiMFEz06xbIj2y2MfrAzroSgYT+SW46dv4/avjtoUmgRV3kSCHETds7CJpX5D WFFQh8Ec3CwYcRAD2QRHbx9MtSFAhaca5b2kCuG8C1kf6n1tPSoFBYnAEgJ8HeQFvGznXp o5wG4QUeS0m/kEhlHnzzWyvHFVtlh5O4nBS/xBDbfKb/kguGkgIHImCIH+LWyw== From: "Pankaj Raghav (Samsung)" To: david@fromorbit.com, chandan.babu@oracle.com, akpm@linux-foundation.org, brauner@kernel.org, willy@infradead.org, djwong@kernel.org Cc: linux-kernel@vger.kernel.org, hare@suse.de, john.g.garry@oracle.com, gost.dev@samsung.com, yang@os.amperecomputing.com, p.raghav@samsung.com, cl@os.amperecomputing.com, linux-xfs@vger.kernel.org, hch@lst.de, mcgrof@kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org Subject: [PATCH v6 07/11] iomap: fix iomap_dio_zero() for fs bs > system page size Date: Wed, 29 May 2024 15:45:05 +0200 Message-Id: <20240529134509.120826-8-kernel@pankajraghav.com> In-Reply-To: <20240529134509.120826-1-kernel@pankajraghav.com> References: <20240529134509.120826-1-kernel@pankajraghav.com> MIME-Version: 1.0 X-Rspam-User: X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: CE8A418000D X-Stat-Signature: tyhr97pe76fsko6defamygtsi7j1nqa1 X-HE-Tag: 1716990351-977632 X-HE-Meta: U2FsdGVkX18qBYOAIqiRLu98SO+pfH2qNU6OdBDlQ55O6SFhCgl0Q2v4+7Q04lsh5enZQhDNk7YR0cNW7kl4pP/j+WRB3XckKcdUoIQTpiSbMYH+f6yZxEFag5CNGOSyosihYrG/3HuUULWzb3lmJKgGIY0eWT2rNSnPA07I8sMlhyVPjY8Y/+oUw1ok1nA88xxPFMlCYgkyCIEthSazn1bx/GIQpXUhHa5C7QomGTXb7Fw3/092YWX0noxRbeS7SNmDi5M7A+sJm/v1+NwIExD1CpS7dO6l5wfAuHjUn+yUU4mrOUQ4YOrSfzUezY0KSt55hchxjVhOiYTWYw2Iqa6KclM7ckNyVVb4zHWSIpRJsoDoNXyWT66p7nmjODT1L6y25+0o37eHV3sntMGeaAGtqi0qUaZZRvRL91+f5RST0rFsNnJmnQSHUxY9WpDX+bhd+k/IghCuWnJGLA+QfodZngLR6ubU5XRVoaN6L83zo8Bb5RX7gWzLsvX3YzV3lCw0W9Ysx1WW9DyckxJF/xD8ijmYtlSkjChDW0oaKysyS3eYIBiLkt8mAedE6BzzoMViiO1qTH6p83IRkE43A61jYJmkhphoxXw2Dp/qBpUq7YSeifR6zjGwMdlhCUmyaVGpu4wcCOv4FORYyK4y9POKcpmlyBuIsABBBybCDmcibqhSddBxVG2AlOHv4MXvnKzOqDySaApY5z/DTMuUn+y+HbAgoBH5pEFESQLwwuIGep2t0ZTyehGAJhYarsi13eyAi7RRl5HYxVwybCeES4jQSXFFwF+O4P+jSDOpvIpo5FY0ivtKaxSsJdOk0TA/IgmnDG5McKdybZJKYF0AVeCf5XNxfMoFX8ouRVp+Un4wJVJ30JXR2qHo016aeONLie0ojygvvjReB9SWthpxtT/FjgVhP3TKeW2V3sIX1hpSRIE4H7eV8IKR3FfwAPBjTeKYl/JbhLRRQmSncsy 8tQZ5/+k yWh6YIwjvtrn8y0dPf6t8pjeATBTXxZcebRhgx0eNDWiy/SUuHW8KF9XesWvXIzNpoV59sihQQUUYkb3TVQgj2nMAWXnUramCbOygLhfBAM09GST70ayPnDRsnMUUgsOwNKBpzLDRYnbh7gAjILyL9WkQ1yFddrhNu70jyVHfgeY+/SDmUH5TSWvhT2LHM/xx6yRvd//tTPxt277Z9lNqOGOZ9oA0t10lXA2mlzmc+b7pu9M1VIMRK1IF8IWZxLejRVO9zSn9KhcbFY9k9PGjx1WS7ZzjYvCFKnliAKK3kUft4DwcX3XpyVRp7K3MPkiudXD6sWZPzZF9Y/DC2WmeE6BaUnY/6nXrBZrg5bhWc2ywWndKz7ofZMRoGIBEV8VZZbx21hukTpKdkyA= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Pankaj Raghav iomap_dio_zero() will pad a fs block with zeroes if the direct IO size < fs block size. iomap_dio_zero() has an implicit assumption that fs block size < page_size. This is true for most filesystems at the moment. If the block size > page size, this will send the contents of the page next to zero page(as len > PAGE_SIZE) to the underlying block device, causing FS corruption. iomap is a generic infrastructure and it should not make any assumptions about the fs block size and the page size of the system. Signed-off-by: Pankaj Raghav Reviewed-by: Hannes Reinecke --- After disucssing a bit in LSFMM about this, it was clear that using a PMD sized zero folio might not be a good idea[0], especially in platforms with 64k base page size, the huge zero folio can be as high as 512M just for zeroing small block sizes in the direct IO path. The idea to use iomap_init to allocate 64k zero buffer was suggested by Dave Chinner as it gives decent tradeoff between memory usage and efficiency. This is a good enough solution for now as moving beyond 64k block size in XFS might take a while. We can work on a more generic solution in the future to offer different sized zero folio that can go beyond 64k. [0] https://lore.kernel.org/linux-fsdevel/ZkdcAsENj2mBHh91@casper.infradead.org/ fs/internal.h | 8 ++++++++ fs/iomap/buffered-io.c | 5 +++++ fs/iomap/direct-io.c | 9 +++++++-- 3 files changed, 20 insertions(+), 2 deletions(-) diff --git a/fs/internal.h b/fs/internal.h index 84f371193f74..18eedbb82c50 100644 --- a/fs/internal.h +++ b/fs/internal.h @@ -35,6 +35,14 @@ static inline void bdev_cache_init(void) int __block_write_begin_int(struct folio *folio, loff_t pos, unsigned len, get_block_t *get_block, const struct iomap *iomap); +/* + * iomap/buffered-io.c + */ + +#define ZERO_FSB_SIZE (65536) +#define ZERO_FSB_ORDER (get_order(ZERO_FSB_SIZE)) +extern struct page *zero_fs_block; + /* * char_dev.c */ diff --git a/fs/iomap/buffered-io.c b/fs/iomap/buffered-io.c index c5802a459334..2c0149c827cd 100644 --- a/fs/iomap/buffered-io.c +++ b/fs/iomap/buffered-io.c @@ -42,6 +42,7 @@ struct iomap_folio_state { }; static struct bio_set iomap_ioend_bioset; +struct page *zero_fs_block; static inline bool ifs_is_fully_uptodate(struct folio *folio, struct iomap_folio_state *ifs) @@ -1998,6 +1999,10 @@ EXPORT_SYMBOL_GPL(iomap_writepages); static int __init iomap_init(void) { + zero_fs_block = alloc_pages(GFP_KERNEL | __GFP_ZERO, ZERO_FSB_ORDER); + if (!zero_fs_block) + return -ENOMEM; + return bioset_init(&iomap_ioend_bioset, 4 * (PAGE_SIZE / SECTOR_SIZE), offsetof(struct iomap_ioend, io_bio), BIOSET_NEED_BVECS); diff --git a/fs/iomap/direct-io.c b/fs/iomap/direct-io.c index f3b43d223a46..50c2bca8a347 100644 --- a/fs/iomap/direct-io.c +++ b/fs/iomap/direct-io.c @@ -236,17 +236,22 @@ static void iomap_dio_zero(const struct iomap_iter *iter, struct iomap_dio *dio, loff_t pos, unsigned len) { struct inode *inode = file_inode(dio->iocb->ki_filp); - struct page *page = ZERO_PAGE(0); struct bio *bio; + /* + * Max block size supported is 64k + */ + WARN_ON_ONCE(len > ZERO_FSB_SIZE); + bio = iomap_dio_alloc_bio(iter, dio, 1, REQ_OP_WRITE | REQ_SYNC | REQ_IDLE); fscrypt_set_bio_crypt_ctx(bio, inode, pos >> inode->i_blkbits, GFP_KERNEL); + bio->bi_iter.bi_sector = iomap_sector(&iter->iomap, pos); bio->bi_private = dio; bio->bi_end_io = iomap_dio_bio_end_io; - __bio_add_page(bio, page, len, 0); + __bio_add_page(bio, zero_fs_block, len, 0); iomap_dio_submit_bio(iter, dio, bio, pos); }