From patchwork Tue Feb 9 02:30:06 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jens Axboe X-Patchwork-Id: 12077045 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id EA611C433DB for ; Tue, 9 Feb 2021 02:31:28 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id B5D6664D87 for ; Tue, 9 Feb 2021 02:31:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230490AbhBICbH (ORCPT ); Mon, 8 Feb 2021 21:31:07 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56632 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231132AbhBICa5 (ORCPT ); Mon, 8 Feb 2021 21:30:57 -0500 Received: from mail-pl1-x629.google.com (mail-pl1-x629.google.com [IPv6:2607:f8b0:4864:20::629]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 75BA3C061786 for ; Mon, 8 Feb 2021 18:30:16 -0800 (PST) Received: by mail-pl1-x629.google.com with SMTP id u11so8880655plg.13 for ; Mon, 08 Feb 2021 18:30:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=lORwaaiPEScAng7B1o0PI3rE/Z/yT/4jNBxJ0rOXsDA=; b=SjQuZzcSz5/ors8H2c2fFiZya7IIdg+5e48zKW4Xry1PtdKCTBUPuv313R/WdoitzW wuCwqdW24Ut65txynzjDs1N06SiK7i4h+TXbTxmVE5MkXz+USPW5zsA9Wocpj5tU4zEE yBMQpAILtUgKvPnWuksDPdo6J5vxwbq7s3ydpDYJIE896kYhYJOD6KEI+lyq41fVWXet bp74ML+EBujxIPO+SJEvOXIL7wEimkfU8xQv0A/wiZO6zt4LBuBqqVhIvlYrS41ufJfN 49znuQDexZiOgIImZMVJboqYj5OvZTTmWAJJmPj54xT9oaNxc83hpzZNct6bgz48I8E3 lWdg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=lORwaaiPEScAng7B1o0PI3rE/Z/yT/4jNBxJ0rOXsDA=; b=Avpl9+/iuNazYsn4ktAINSMsI6cGCtiBAT2i31QiokBZ+xFxjlnD1uSfDgzqjUDa43 Twv0y7rdWgsVUszfSExeJMz3ZErRQS547bXMHr/qaDH3Q3oEJ6yZuGR1qCt+CDABtpVp nNy5R7Vrqqb7M0LlpL5gkMP2b4hG5X5SWihYH4HOsKEQEvpxIdMGXi5AzaE36k9Qj3kU frntKFME/XvGXtcT7Fvk4tA1RJ0PlS9yA5OUrwj4x2gaVfYokxGJgYr+dJVM6Tww7q1L 8wq8Q1pF0dDYtjIRvKLMVBX3GXt01iYu5UM0Jybx+ajsWwr7G/15Yh9KXk3BmkEtjIzw gqnQ== X-Gm-Message-State: AOAM530XSvh1oyPC31GHeQyx31723FGw+WLFT6KRXVRuBjartrNonmZ4 V+YG1miuzM1Ecv58l0gmTGYnUl267BPdyw== X-Google-Smtp-Source: ABdhPJzRjq3VJvcakEyMmh+N1e9dpfs3Ljn9RDCUa5pfoyICkb5FgskLto2S5Lg49P8ke0tXi65jCw== X-Received: by 2002:a17:90a:cc03:: with SMTP id b3mr1854414pju.2.1612837815702; Mon, 08 Feb 2021 18:30:15 -0800 (PST) Received: from localhost.localdomain ([66.219.217.173]) by smtp.gmail.com with ESMTPSA id y2sm19070597pfe.118.2021.02.08.18.30.14 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 08 Feb 2021 18:30:15 -0800 (PST) From: Jens Axboe To: linux-fsdevel@vger.kernel.org, linux-mm@kvack.org Cc: hch@infradead.org, akpm@linux-foundation.org, Jens Axboe Subject: [PATCH 1/3] mm: provide filemap_range_needs_writeback() helper Date: Mon, 8 Feb 2021 19:30:06 -0700 Message-Id: <20210209023008.76263-2-axboe@kernel.dk> X-Mailer: git-send-email 2.30.0 In-Reply-To: <20210209023008.76263-1-axboe@kernel.dk> References: <20210209023008.76263-1-axboe@kernel.dk> MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org For O_DIRECT reads/writes, we check if we need to issue a call to filemap_write_and_wait_range() to issue and/or wait for writeback for any page in the given range. The existing mechanism just checks for a page in the range, which is suboptimal for IOCB_NOWAIT as we'll fallback to the slow path (and needing retry) if there's just a clean page cache page in the range. Provide filemap_range_needs_writeback() which tries a little harder to check if we actually need to issue and/or wait for writeback in the range. Signed-off-by: Jens Axboe --- include/linux/fs.h | 2 ++ mm/filemap.c | 43 +++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 45 insertions(+) diff --git a/include/linux/fs.h b/include/linux/fs.h index fd47deea7c17..def89222dfe9 100644 --- a/include/linux/fs.h +++ b/include/linux/fs.h @@ -2633,6 +2633,8 @@ static inline int filemap_fdatawait(struct address_space *mapping) extern bool filemap_range_has_page(struct address_space *, loff_t lstart, loff_t lend); +extern bool filemap_range_needs_writeback(struct address_space *, + loff_t lstart, loff_t lend); extern int filemap_write_and_wait_range(struct address_space *mapping, loff_t lstart, loff_t lend); extern int __filemap_fdatawrite_range(struct address_space *mapping, diff --git a/mm/filemap.c b/mm/filemap.c index aa0e0fb04670..6a58d50fbd31 100644 --- a/mm/filemap.c +++ b/mm/filemap.c @@ -633,6 +633,49 @@ static bool mapping_needs_writeback(struct address_space *mapping) return mapping->nrpages; } +/** + * filemap_range_needs_writeback - check if range potentially needs writeback + * @mapping: address space within which to check + * @start_byte: offset in bytes where the range starts + * @end_byte: offset in bytes where the range ends (inclusive) + * + * Find at least one page in the range supplied, usually used to check if + * direct writing in this range will trigger a writeback. Used by O_DIRECT + * read/write with IOCB_NOWAIT, to see if the caller needs to do + * filemap_write_and_wait_range() before proceeding. + * + * Return: %true if the caller should do filemap_write_and_wait_range() before + * doing O_DIRECT to a page in this range, %false otherwise. + */ +bool filemap_range_needs_writeback(struct address_space *mapping, + loff_t start_byte, loff_t end_byte) +{ + XA_STATE(xas, &mapping->i_pages, start_byte >> PAGE_SHIFT); + pgoff_t max = end_byte >> PAGE_SHIFT; + struct page *page; + + if (!mapping_needs_writeback(mapping)) + return false; + if (!mapping_tagged(mapping, PAGECACHE_TAG_DIRTY) && + !mapping_tagged(mapping, PAGECACHE_TAG_WRITEBACK)) + return false; + if (end_byte < start_byte) + return false; + + rcu_read_lock(); + xas_for_each(&xas, page, max) { + if (xas_retry(&xas, page)) + continue; + if (xa_is_value(page)) + continue; + if (PageDirty(page) || PageLocked(page) || PageWriteback(page)) + break; + } + rcu_read_unlock(); + return page != NULL; +} +EXPORT_SYMBOL_GPL(filemap_range_needs_writeback); + /** * filemap_write_and_wait_range - write out & wait on a file range * @mapping: the address_space for the pages From patchwork Tue Feb 9 02:30:07 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jens Axboe X-Patchwork-Id: 12077043 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1364AC433E0 for ; Tue, 9 Feb 2021 02:31:29 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id D0D2064EA4 for ; Tue, 9 Feb 2021 02:31:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231139AbhBICbJ (ORCPT ); Mon, 8 Feb 2021 21:31:09 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56638 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231142AbhBICa5 (ORCPT ); Mon, 8 Feb 2021 21:30:57 -0500 Received: from mail-pg1-x52b.google.com (mail-pg1-x52b.google.com [IPv6:2607:f8b0:4864:20::52b]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 61644C06178A for ; Mon, 8 Feb 2021 18:30:17 -0800 (PST) Received: by mail-pg1-x52b.google.com with SMTP id z21so11534057pgj.4 for ; Mon, 08 Feb 2021 18:30:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=NeAk3PJLifKVqc2Uhcs4FSpHilknKrj5z1MFAaW43Ag=; b=1ias4FnzK1VNFg9SZDY3ZUQe4V9wOj9t9t9923MKJpPj4Sogo47GefH2KPemZbZsox IfaITZ1qCeBJu/ZhxPyhuFhs9u8v0hk01hGMSC16iv9eahk8oyAZ2xGU1N/IUdxrtQqW B+ouKmxnuPJoERPIiXefe6b5cM9xlm6EPqr1aZ5GqG1H5O4bsST+CTLPGrhgkLMRII7P 3RdnxMkp0b/EFTk7h6S0PVBqf3kRtzEnGoYS5FfdU5d0OO6OaJM9Qrr2Bgyt/+ZDAkmN qZMd+smoKKXipq4SNPfR5FGk4iQPca47fR6SipLXy3SCcwBNSE1wslLJ8TUTnN4Ohqm9 rHoQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=NeAk3PJLifKVqc2Uhcs4FSpHilknKrj5z1MFAaW43Ag=; b=BYODn+EmTEQN4Mhlea0P+5jVS95p04EavzjnuB4IzNEfPhkmhmBs+rJ118GZogP/xC LfiLm2ifPLAepN1PC1p0CKG1yXP1NiPmHeH34llqCfgDA+m5V8uvcKx3DfsCjJVlVWcu XMWkQy5z6VY7gwDQBwVNq3//bm/NNVN7crrO5d2aseSGdvUJLEGI4mkFWYxo4Et1zkAT /LIuAhv9eZ41/29WYOKp3zoOc4GbrLuOvprcKz/67hX3wF5KO7zXscXQNdqdCuh+KyoP tuqz8DK23pEOLKejiLfZyqgfgeFwnsy/DWsJF4UnmOnhJ6qLINYvXI12v7BOKZcLWDu4 YjtA== X-Gm-Message-State: AOAM533XcCUvfa+DIaqa+4EtZHNjnTVUs7cSwn8Q5nlM5lUGw/hbaA61 dfInZDOA6hYqh85HvavlyZJ2sUTmHTddtA== X-Google-Smtp-Source: ABdhPJzIodUg5PR3R81qsg3WhYeJzNk6dOAQUyTI4+Gq/PEaHHOneG01zD8/fBvd5h7Imb7eWrJ4vg== X-Received: by 2002:a05:6a00:a8d:b029:1ba:71d1:fe3c with SMTP id b13-20020a056a000a8db02901ba71d1fe3cmr20553833pfl.51.1612837816706; Mon, 08 Feb 2021 18:30:16 -0800 (PST) Received: from localhost.localdomain ([66.219.217.173]) by smtp.gmail.com with ESMTPSA id y2sm19070597pfe.118.2021.02.08.18.30.15 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 08 Feb 2021 18:30:16 -0800 (PST) From: Jens Axboe To: linux-fsdevel@vger.kernel.org, linux-mm@kvack.org Cc: hch@infradead.org, akpm@linux-foundation.org, Jens Axboe Subject: [PATCH 2/3] mm: use filemap_range_needs_writeback() for O_DIRECT reads Date: Mon, 8 Feb 2021 19:30:07 -0700 Message-Id: <20210209023008.76263-3-axboe@kernel.dk> X-Mailer: git-send-email 2.30.0 In-Reply-To: <20210209023008.76263-1-axboe@kernel.dk> References: <20210209023008.76263-1-axboe@kernel.dk> MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org For the generic page cache read helper, use the better variant of checking for the need to call filemap_write_and_wait_range() when doing O_DIRECT reads. This avoids falling back to the slow path for IOCB_NOWAIT, if there are no pages to wait for (or write out). Signed-off-by: Jens Axboe --- mm/filemap.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/mm/filemap.c b/mm/filemap.c index 6a58d50fbd31..c80acb80e8f7 100644 --- a/mm/filemap.c +++ b/mm/filemap.c @@ -2643,8 +2643,8 @@ generic_file_read_iter(struct kiocb *iocb, struct iov_iter *iter) size = i_size_read(inode); if (iocb->ki_flags & IOCB_NOWAIT) { - if (filemap_range_has_page(mapping, iocb->ki_pos, - iocb->ki_pos + count - 1)) + if (filemap_range_needs_writeback(mapping, iocb->ki_pos, + iocb->ki_pos + count - 1)) return -EAGAIN; } else { retval = filemap_write_and_wait_range(mapping, From patchwork Tue Feb 9 02:30:08 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jens Axboe X-Patchwork-Id: 12077047 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2D3DCC433E9 for ; Tue, 9 Feb 2021 02:31:29 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id F159764EBC for ; Tue, 9 Feb 2021 02:31:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231166AbhBICbK (ORCPT ); Mon, 8 Feb 2021 21:31:10 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56644 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231147AbhBICbD (ORCPT ); Mon, 8 Feb 2021 21:31:03 -0500 Received: from mail-pf1-x433.google.com (mail-pf1-x433.google.com [IPv6:2607:f8b0:4864:20::433]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 6466EC06178B for ; Mon, 8 Feb 2021 18:30:18 -0800 (PST) Received: by mail-pf1-x433.google.com with SMTP id z6so1833276pfq.0 for ; Mon, 08 Feb 2021 18:30:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=B3Rk7GfRZkBxeNjU7Kh2bYrh55ud7n78YGybFpQpjSk=; b=16kACgxMGBZehZBaxowbj13gbI/eye+R6F4RoVlRlXWybq8eTBEDzKVDtapQgd+H5D OB7C2HHew7WFUYVvngutI0mymaHtZF+jhsHiffcBZU69I2hCEUpIsZ8ynEfxcGsEw164 wAsWCh7DYnRZa/NgROpaa1mNhpO+xI5ZzonDCKEEwO6Yxo9uBPgskUmbfvxr2TkBUSbG MsTZFCp6CcDdX/9Ye9U72bkvp2e53t8jBli23b8FFJCVrsCg59rH1PJltCb8jxrap7Cc 27mdsD3OJzyronye6gaXdow8VcQTC48U4LFruthYCkqis2pv8BY+U6N6LwLCQ8u+8lsx 2mUw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=B3Rk7GfRZkBxeNjU7Kh2bYrh55ud7n78YGybFpQpjSk=; b=g0zLDKHggnDVHA9Q7WQWdmZgeDJxBbaoHoB5kB5SnxCwFFv8AvAnbtbzy2//sRXlhI UyTNM9GXt1bz4ySdLimxJNDCaQiOkfTZF9S0X5xHpFAQNZzdTTIrZauOVu9nTOZbhusX q+B6Z78EY2AWBHei4BxF9ye+mbdd5qfe9/JNSkHvnilZTKKyZNJsO2Ie0SEHsYowy3B9 ZJ5n97kA+QGw+29brdk2ZHcba+8ULBhXnv0dskAuLA/dh/zpqsZRoNjZ1Ej8khHxGi5t 08BqOs6HM+oLmEunCciqRed2jrgOlk12uw/rEqtstiZyGBKUBe7sureb0U1CBNv9pkgQ gSGg== X-Gm-Message-State: AOAM532ISQl4jwUTG6cp0Q3sIW2TGGhnhSIzl9PGfq7EQA1YmUsHqbI/ UIjMF+uSgiTMGrDkMjhaIijHghvWK8pUfg== X-Google-Smtp-Source: ABdhPJyqaoja4NK3VKz/84pycA5yyMWjTKdCPC0AlBIyGsuH/6UaH2NbIQvUjEEZV3DGm/CWaVMRWw== X-Received: by 2002:a62:8fd4:0:b029:1de:d484:e1f7 with SMTP id n203-20020a628fd40000b02901ded484e1f7mr5031886pfd.78.1612837817672; Mon, 08 Feb 2021 18:30:17 -0800 (PST) Received: from localhost.localdomain ([66.219.217.173]) by smtp.gmail.com with ESMTPSA id y2sm19070597pfe.118.2021.02.08.18.30.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 08 Feb 2021 18:30:17 -0800 (PST) From: Jens Axboe To: linux-fsdevel@vger.kernel.org, linux-mm@kvack.org Cc: hch@infradead.org, akpm@linux-foundation.org, Jens Axboe Subject: [PATCH 3/3] iomap: use filemap_range_needs_writeback() for O_DIRECT reads Date: Mon, 8 Feb 2021 19:30:08 -0700 Message-Id: <20210209023008.76263-4-axboe@kernel.dk> X-Mailer: git-send-email 2.30.0 In-Reply-To: <20210209023008.76263-1-axboe@kernel.dk> References: <20210209023008.76263-1-axboe@kernel.dk> MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org For reads, use the better variant of checking for the need to call filemap_write_and_wait_range() when doing O_DIRECT. This avoids falling back to the slow path for IOCB_NOWAIT, if there are no pages to wait for (or write out). Signed-off-by: Jens Axboe --- fs/iomap/direct-io.c | 23 +++++++++++++++-------- 1 file changed, 15 insertions(+), 8 deletions(-) diff --git a/fs/iomap/direct-io.c b/fs/iomap/direct-io.c index 933f234d5bec..5b111d1635ab 100644 --- a/fs/iomap/direct-io.c +++ b/fs/iomap/direct-io.c @@ -458,9 +458,24 @@ __iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, if (pos >= dio->i_size) goto out_free_dio; + if (iocb->ki_flags & IOCB_NOWAIT) { + if (filemap_range_needs_writeback(mapping, pos, end)) { + ret = -EAGAIN; + goto out_free_dio; + } + flags |= IOMAP_NOWAIT; + } if (iter_is_iovec(iter)) dio->flags |= IOMAP_DIO_DIRTY; } else { + if (iocb->ki_flags & IOCB_NOWAIT) { + if (filemap_range_has_page(mapping, pos, end)) { + ret = -EAGAIN; + goto out_free_dio; + } + flags |= IOMAP_NOWAIT; + } + flags |= IOMAP_WRITE; dio->flags |= IOMAP_DIO_WRITE; @@ -478,14 +493,6 @@ __iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, dio->flags |= IOMAP_DIO_WRITE_FUA; } - if (iocb->ki_flags & IOCB_NOWAIT) { - if (filemap_range_has_page(mapping, pos, end)) { - ret = -EAGAIN; - goto out_free_dio; - } - flags |= IOMAP_NOWAIT; - } - ret = filemap_write_and_wait_range(mapping, pos, end); if (ret) goto out_free_dio;