From patchwork Tue Sep 5 19:11:19 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Amir Goldstein X-Patchwork-Id: 9939545 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 8435860350 for ; Tue, 5 Sep 2017 19:11:22 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 75125289FF for ; Tue, 5 Sep 2017 19:11:22 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 698C5289F2; Tue, 5 Sep 2017 19:11:22 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.3 required=2.0 tests=BAYES_00, DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED, FREEMAIL_FROM, RCVD_IN_DNSWL_HI, RCVD_IN_SORBS_SPAM, T_DKIM_INVALID autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id EA7E3289F2 for ; Tue, 5 Sep 2017 19:11:21 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752556AbdIETLV (ORCPT ); Tue, 5 Sep 2017 15:11:21 -0400 Received: from mail-wm0-f65.google.com ([74.125.82.65]:36766 "EHLO mail-wm0-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752424AbdIETLL (ORCPT ); Tue, 5 Sep 2017 15:11:11 -0400 Received: by mail-wm0-f65.google.com with SMTP id p17so3676844wmd.3; Tue, 05 Sep 2017 12:11:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=Xi5SQSmghz06MtIdyZdbyS7z2bCOCqoXfViXY6EinWM=; b=L3H2bNEEOQ530yNGoes0HN1kCSHhww+VBuzTPpBCcY/XqZK4oiSR1eEd6MVwHSp2EM bU+8/tjSxNjDekGmN0Ixj+ylX3o0Gvk6ltk0Qz+fjuIojbibE7N8COTaBd97P71uaw8Y 8RAuE5zVcjvwqUg9//WJxd5/u7D5kZx3ezCnlb0cGkSScth5Q25HrEhcJj8eKYoXxBei tBjCh1FyDk5hyMctgPNolhPCmg5yreI6hFzGDNwua2yLmjbViqPQI5e6YQEATJTeVB+n 2QNxZnBv1VBkRR9ol5Y/pcI+srkv1CmUp6klxDEkkoqqKYxgh20+PeqhCmqxmbGHJYlS V4SA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=Xi5SQSmghz06MtIdyZdbyS7z2bCOCqoXfViXY6EinWM=; b=YmJxRhGcg0849zQCoBtn0hX6UXra468IsRtv0upHvesanSLSRSG77Z/A5WFQSm81Yb IaQ4MABoal0Gu0tQDxjzVL91QQSDB3aidvuepVxkMFDYwZ5CJW3XRsZcz518pxYYo/rz XKqg05rp26PcqtPiNMrvWoO1k8ld6CIAMEQjfaB3JQTpCme/Kbjx8JPAGrgygZFhnMGe pN/X/RdyHv/JkgOksaq2lgLwRhh5yXcfnc/yz8dzxXcjcxAdkC61LZRzyZjqt9SEpWWd /XqWNq0BJ/BysRb6twmJhWMS0NBeYeHltTSmpp6l+60juuTHFwJ5+6yFscGfwZ7lK1Oq kiyw== X-Gm-Message-State: AHPjjUgRqXOGIUN7oXup6xE7Q11Sji0lQm3q6jbf3h3RmxS+qawW3ZSD aBWpMErRa6tBdw== X-Google-Smtp-Source: ADKCNb4b9WoZsdotnKyKu5MPNhOV6KRZRiXfpNnUr64QCxWR0rQ+jcga+oB4utOR8qGsoeFC0FpJFg== X-Received: by 10.28.74.137 with SMTP id n9mr20013wmi.110.1504638669814; Tue, 05 Sep 2017 12:11:09 -0700 (PDT) Received: from localhost.localdomain (bzq-79-182-137-119.red.bezeqint.net. [79.182.137.119]) by smtp.gmail.com with ESMTPSA id 30sm1829015wry.34.2017.09.05.12.11.08 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 05 Sep 2017 12:11:09 -0700 (PDT) From: Amir Goldstein To: Eryu Guan Cc: Josef Bacik , fstests@vger.kernel.org, linux-fsdevel@vger.kernel.org Subject: [PATCH v3 12/13] fstests: crash consistency fsx test for cloned files Date: Tue, 5 Sep 2017 22:11:19 +0300 Message-Id: <1504638680-25682-13-git-send-email-amir73il@gmail.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1504638680-25682-1-git-send-email-amir73il@gmail.com> References: <1504638680-25682-1-git-send-email-amir73il@gmail.com> Sender: fstests-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: fstests@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Signed-off-by: Amir Goldstein --- tests/generic/502 | 142 ++++++++++++++++++++++++++++++++++++++++++++++++++ tests/generic/502.out | 2 + tests/generic/group | 1 + 3 files changed, 145 insertions(+) create mode 100755 tests/generic/502 create mode 100644 tests/generic/502.out diff --git a/tests/generic/502 b/tests/generic/502 new file mode 100755 index 0000000..a15a311 --- /dev/null +++ b/tests/generic/502 @@ -0,0 +1,142 @@ +#! /bin/bash +# FS QA Test No. 502 +# +# Run fsx with log writes on cloned files to verify power fail safeness. +# +#----------------------------------------------------------------------- +# Copyright (C) 2017 CTERA Networks. All Rights Reserved. +# Author: Amir Goldstein +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it would be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write the Free Software Foundation, +# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA +#----------------------------------------------------------------------- +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +here=`pwd` +status=1 # failure is the default! + +_cleanup() +{ + _log_writes_cleanup +} +trap "_cleanup; exit \$status" 0 1 2 3 15 + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/reflink +. ./common/dmlogwrites + +# real QA test starts here +_supported_fs generic +_supported_os Linux +_require_test +_require_scratch_reflink +_require_cp_reflink +_require_log_writes + +rm -f $seqres.full + +check_files() +{ + local name=$1 + + # Now look for our files + for i in $(find $SANITY_DIR -type f | grep $name | grep mark) + do + local filename=$(basename $i) + local mark="${filename##*.}" + echo "checking $filename" >> $seqres.full + _log_writes_replay_log $filename + _scratch_mount + local expected_md5=$(_md5_checksum $i) + local md5=$(_md5_checksum $SCRATCH_MNT/$name) + [ "${md5}" != "${expected_md5}" ] && _fail "$filename md5sum mismatched" + _scratch_unmount + _check_scratch_fs + done +} + +SANITY_DIR=$TEST_DIR/fsxtests +rm -rf $SANITY_DIR +mkdir $SANITY_DIR + +# Create the log +_log_writes_init + +_log_writes_mkfs >> $seqres.full 2>&1 + +# Log writes emulates discard support, turn it on for maximum crying. +_log_writes_mount -o discard + +# write testfile index -1 to be cloned to testfile0 +$XFS_IO_PROG -f -c "pwrite -S 0xff 0 256k" -c "fsync" \ + $SCRATCH_MNT/testfile-1 > /dev/null 2>&1 + +NUM_FILES=10 +NUM_OPS=100 +FSX_OPTS="-N $NUM_OPS -d -k -P $SANITY_DIR -i $LOGWRITES_DMDEV" +# Set random seeds for fsx runs (0 for timestamp + pid) +seeds=(0 0 0 0 0 0 0 0 0 0) +# Run fsx for a while +for j in `seq 0 $((NUM_FILES-1))` +do + # clone the clone from prev iteration which has already mutated + cp --reflink $SCRATCH_MNT/testfile$((j-1)) $SCRATCH_MNT/testfile$j + run_check $here/ltp/fsx $FSX_OPTS -S ${seeds[$j]} -j $j $SCRATCH_MNT/testfile$j & +done +wait + +test_md5=() +for j in `seq 0 $((NUM_FILES-1))` +do + test_md5[$j]=$(_md5_checksum $SCRATCH_MNT/testfile$j) +done + +# Unmount the scratch dir and tear down the log writes target +_log_writes_mark last +_log_writes_unmount +_log_writes_mark end +_log_writes_remove +_check_scratch_fs + +# check pre umount +echo "checking pre umount" >> $seqres.full +_log_writes_replay_log last +_scratch_mount +_scratch_unmount +_check_scratch_fs + +for j in `seq 0 $((NUM_FILES-1))` +do + check_files testfile$j +done + +# Check the end +echo "checking post umount" >> $seqres.full +_log_writes_replay_log end +_scratch_mount +for j in `seq 0 $((NUM_FILES-1))` +do + md5=$(_md5_checksum $SCRATCH_MNT/testfile$j) + [ "${md5}" != "${test_md5[$j]}" ] && _fail "testfile$j end md5sum mismatched" +done + +echo "Silence is golden" +status=0 +exit + diff --git a/tests/generic/502.out b/tests/generic/502.out new file mode 100644 index 0000000..930f6d4 --- /dev/null +++ b/tests/generic/502.out @@ -0,0 +1,2 @@ +QA output created by 502 +Silence is golden diff --git a/tests/generic/group b/tests/generic/group index 1e1b524..4324775 100644 --- a/tests/generic/group +++ b/tests/generic/group @@ -459,3 +459,4 @@ 454 auto quick attr 500 auto log replay 501 auto quick metadata +502 auto log replay clone