From patchwork Thu Oct 8 21:22:13 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Eric Sandeen X-Patchwork-Id: 11824595 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id A9F581592 for ; Thu, 8 Oct 2020 21:22:19 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 8106022241 for ; Thu, 8 Oct 2020 21:22:19 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="gorSIQkM" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730270AbgJHVWS (ORCPT ); Thu, 8 Oct 2020 17:22:18 -0400 Received: from us-smtp-delivery-124.mimecast.com ([63.128.21.124]:28834 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728712AbgJHVWS (ORCPT ); Thu, 8 Oct 2020 17:22:18 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1602192136; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=blc6qoatpN2MlMNZuixwC5wp/Rj0TAn/W7vPKCgp6i4=; b=gorSIQkMhGiK7af0TcqCQkqCODh7zK80epNloESI8nC7TrZs3l/4rCVeKX5yhWrwOTJ7oZ azd0ZWpx1NWlN22TAfmRttDG98pTntPufiOyMq3Axw0OyqbJJ2dGIXJC38em8BEimkj/y+ r5KCRSCuEIgnCe+ZL6vmCgfr/uASMs8= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-44-vkaxfoYAMia_CTkgh8xDIw-1; Thu, 08 Oct 2020 17:22:14 -0400 X-MC-Unique: vkaxfoYAMia_CTkgh8xDIw-1 Received: from smtp.corp.redhat.com (int-mx08.intmail.prod.int.phx2.redhat.com [10.5.11.23]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id D8DCB420EF; Thu, 8 Oct 2020 21:22:13 +0000 (UTC) Received: from liberator.sandeen.net (ovpn04.gateway.prod.ext.phx2.redhat.com [10.5.9.4]) by smtp.corp.redhat.com (Postfix) with ESMTP id 9716319D7C; Thu, 8 Oct 2020 21:22:13 +0000 (UTC) Subject: [PATCH V2] generic: test reflinked file corruption after short COW From: Eric Sandeen To: fstests@vger.kernel.org, xfs References: Message-ID: <72427003-febc-cc31-743d-41e25b314874@redhat.com> Date: Thu, 8 Oct 2020 16:22:13 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.3.1 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US X-Scanned-By: MIMEDefang 2.84 on 10.5.11.23 Precedence: bulk List-ID: X-Mailing-List: linux-xfs@vger.kernel.org This test essentially creates an existing COW extent which covers the first 1M, and then does another IO that overlaps it, but extends beyond it. The bug was that we did not trim the new IO to the end of the existing COW extent, and so the IO extended past the COW blocks and corrupted the reflinked files(s). The bug came and went upstream. It was introduced by: 78f0cc9d55cb "xfs: don't use delalloc extents for COW on files with extsize hints" and (inadvertently) fixed as of: 36adcbace24e "xfs: fill out the srcmap in iomap_begin" upstream, and in the 5.4 stable tree with: aee38af574a1 "xfs: trim IO to found COW extent limit" Signed-off-by: Eric Sandeen Reviewed-by: Darrick J. Wong --- V2: Add stable tree fix commit in test description & commit log diff --git a/tests/generic/612 b/tests/generic/612 new file mode 100755 index 00000000..5a765a0c --- /dev/null +++ b/tests/generic/612 @@ -0,0 +1,85 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2020 Red Hat, Inc. All Rights Reserved. +# +# FS QA Test 612 +# +# Regression test for reflink corruption present as of: +# 78f0cc9d55cb "xfs: don't use delalloc extents for COW on files with extsize hints" +# and (inadvertently) fixed as of: +# 36adcbace24e "xfs: fill out the srcmap in iomap_begin" +# upstream, and in the 5.4 stable tree with: +# aee38af574a1 "xfs: trim IO to found COW extent limit" +# +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +here=`pwd` +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -f $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/reflink + +# remove previous $seqres.full before test +rm -f $seqres.full + +# real QA test starts here + +# Modify as appropriate. +_supported_fs generic +_require_test +_require_test_reflink + +DIR=$TEST_DIR/dir.$seq +mkdir -p $DIR +rm -f $DIR/a $DIR/b + +# This test essentially creates an existing COW extent which +# covers the first 1M, and then does another IO that overlaps it, +# but extends beyond it. The bug was that we did not trim the +# new IO to the end of the existing COW extent, and so the IO +# extended past the COW blocks and corrupted the reflinked files(s). + +# Make all files w/ 1m hints; create original 2m file +$XFS_IO_PROG -c "extsize 1048576" $DIR | _filter_xfs_io +$XFS_IO_PROG -c "cowextsize 1048576" $DIR | _filter_xfs_io + +echo "Create file b" +$XFS_IO_PROG -f -c "pwrite -S 0x0 0 2m" -c fsync $DIR/b | _filter_xfs_io + +# Make a reflinked copy +echo "Reflink copy from b to a" +cp --reflink=always $DIR/b $DIR/a + +echo "Contents of b" +hexdump -C $DIR/b + +# Cycle mount to get stuff out of cache +_test_cycle_mount + +# Create a 1m-hinted IO at offset 0, then +# do another IO that overlaps but extends past the 1m hint +echo "Write to a" +$XFS_IO_PROG -c "pwrite -S 0xa 0k -b 4k 4k" \ + -c "pwrite -S 0xa 4k -b 1m 1m" \ + $DIR/a | _filter_xfs_io + +$XFS_IO_PROG -c fsync $DIR/a + +echo "Contents of b now:" +hexdump -C $DIR/b + +# success, all done +status=0 +exit diff --git a/tests/generic/612.out b/tests/generic/612.out new file mode 100644 index 00000000..237a9638 --- /dev/null +++ b/tests/generic/612.out @@ -0,0 +1,18 @@ +QA output created by 612 +Create file b +wrote 2097152/2097152 bytes at offset 0 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +Reflink copy from b to a +Contents of b +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| +* +00200000 +Write to a +wrote 4096/4096 bytes at offset 0 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 4096 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +Contents of b now: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| +* +00200000 diff --git a/tests/generic/group b/tests/generic/group index 4af4b494..bc115f21 100644 --- a/tests/generic/group +++ b/tests/generic/group @@ -614,3 +614,4 @@ 609 auto quick rw 610 auto quick prealloc zero 611 auto quick attr +612 auto quick clone