From patchwork Thu Jun 30 10:59:14 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anand Jain X-Patchwork-Id: 9207227 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id D04796075F for ; Thu, 30 Jun 2016 10:58:29 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id BFCB628632 for ; Thu, 30 Jun 2016 10:58:29 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id B4C922865A; Thu, 30 Jun 2016 10:58:29 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=2.0 tests=BAYES_00, RCVD_IN_DNSWL_HI, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 2F87528632 for ; Thu, 30 Jun 2016 10:58:29 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932073AbcF3K6X (ORCPT ); Thu, 30 Jun 2016 06:58:23 -0400 Received: from aserp1040.oracle.com ([141.146.126.69]:33000 "EHLO aserp1040.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751601AbcF3K6W (ORCPT ); Thu, 30 Jun 2016 06:58:22 -0400 Received: from userv0021.oracle.com (userv0021.oracle.com [156.151.31.71]) by aserp1040.oracle.com (Sentrion-MTA-4.3.2/Sentrion-MTA-4.3.2) with ESMTP id u5UAwKCY031931 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Thu, 30 Jun 2016 10:58:20 GMT Received: from userv0121.oracle.com (userv0121.oracle.com [156.151.31.72]) by userv0021.oracle.com (8.13.8/8.13.8) with ESMTP id u5UAwKfv031047 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Thu, 30 Jun 2016 10:58:20 GMT Received: from abhmp0013.oracle.com (abhmp0013.oracle.com [141.146.116.19]) by userv0121.oracle.com (8.13.8/8.13.8) with ESMTP id u5UAwFkh012313; Thu, 30 Jun 2016 10:58:19 GMT Received: from arch2.sg.oracle.com (/10.186.101.143) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Thu, 30 Jun 2016 03:58:15 -0700 From: Anand Jain To: fstests@vger.kernel.org Cc: linux-btrfs@vger.kernel.org Subject: [PATCH v3 6/6] fstests: btrfs: test RAID5 device reappear and balance Date: Thu, 30 Jun 2016 18:59:14 +0800 Message-Id: <1467284354-3450-1-git-send-email-anand.jain@oracle.com> X-Mailer: git-send-email 2.7.0 In-Reply-To: <1463495530-425-6-git-send-email-anand.jain@oracle.com> References: <1463495530-425-6-git-send-email-anand.jain@oracle.com> X-Source-IP: userv0021.oracle.com [156.151.31.71] Sender: linux-btrfs-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP From: Anand Jain The test does the following: Initialize a RAID5 with some data Re-mount RAID5 degraded with _dev3_ missing and write data. Save md5sum checkpoint1 Re-mount healthy RAID5 Let balance fix degraded blocks. Save md5sum checkpoint2 Re-mount RAID1 degraded now with _dev1_ missing. Save md5sum checkpoint3 Verify if all three md5sum matches Signed-off-by: Anand Jain --- v3: Removed _require_scratch_nocheck Fixed the FS fill size to be at 100m Typo fixes in the log and .out file Rebase on latest fstests v2: add tmp= and its rm add comments to why _reload_btrfs_ko is used add missing put and test_mount at notrun exit use echo instead of _fail when checkpoints are checked .out updated to remove Silence.. tests/btrfs/125 | 182 ++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/125.out | 7 ++ tests/btrfs/group | 1 + 3 files changed, 190 insertions(+) create mode 100755 tests/btrfs/125 create mode 100644 tests/btrfs/125.out diff --git a/tests/btrfs/125 b/tests/btrfs/125 new file mode 100755 index 000000000000..1062b87b3eb9 --- /dev/null +++ b/tests/btrfs/125 @@ -0,0 +1,182 @@ +#! /bin/bash +# FS QA Test 125 +# +# This test verify if the reconstructed data on the RAID5 is good. +# Steps: +# Initialize RAID5 with some data +# +# Re-mount RAID5 degraded with dev3 missing and write data +# Save md5sum checkpoint1 +# +# Re-mount healthy RAID5 +# +# Let balance fix the RAID5. +# Save md5sum checkpoint2 +# +# Re-mount RAID5 degraded with dev1 as missing. +# Save md5sum checkpoint3 +# +# Verify if all three checkpoints match +# +#--------------------------------------------------------------------- +# Copyright (c) 2016 Oracle. All Rights Reserved. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it would be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write the Free Software Foundation, +# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA +#--------------------------------------------------------------------- +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +here=`pwd` +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -f $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter + +# remove previous $seqres.full before test +rm -f $seqres.full + +# real QA test starts here + +_supported_fs btrfs +_supported_os Linux +_require_scratch_dev_pool 3 + +# we need btrfs to unload, need test dir unmounted +_test_unmount +_require_btrfs_loadable + +_scratch_dev_pool_get 3 + +dev1=`echo $SCRATCH_DEV_POOL | awk '{print $1}'` +dev2=`echo $SCRATCH_DEV_POOL | awk '{print $2}'` +dev3=`echo $SCRATCH_DEV_POOL | awk '{print $3}'` + +echo dev1=$dev1 >> $seqres.full +echo dev2=$dev2 >> $seqres.full +echo dev3=$dev3 >> $seqres.full + +# Balance won't be successful if filled too much +dev1_sz=`blockdev --getsize64 $dev1` +dev2_sz=`blockdev --getsize64 $dev2` +dev3_sz=`blockdev --getsize64 $dev3` + +# get min of both. +max_fs_sz=`echo -e "$dev1_sz\n$dev2_sz\n$dev3_sz" | sort | head -1` +# Need disks with more than 2G +if [ $max_fs_sz -lt 2000000000 ]; then + _scratch_dev_pool_put + _test_mount + _notrun "Smallest dev size $max_fs_sz, Need at least 2G" +fi +max_fs_sz=100000000 +bs="1M" +count=$(($max_fs_sz / 1000000)) + +#-------------normal init------------------- +echo >> $seqres.full +echo "max_fs_sz=$max_fs_sz count=$count" >> $seqres.full +echo "-----Initialize -----" >> $seqres.full +_scratch_pool_mkfs "-mraid5 -draid5" >> $seqres.full 2>&1 +_scratch_mount >> $seqres.full 2>&1 +dd if=/dev/zero of="$SCRATCH_MNT"/tf1 bs=$bs count=1 \ + >>$seqres.full 2>&1 +_run_btrfs_util_prog filesystem show +_run_btrfs_util_prog filesystem df $SCRATCH_MNT +count=$(( count-- )) + + +#-------------degraded-init------------------- +echo >> $seqres.full +echo "-----Write degraded mount fill upto $max_fs_sz bytes-----" >> $seqres.full +echo +echo "Write data with degraded mount" + +echo "unmount" >> $seqres.full +_scratch_unmount +echo "clean btrfs ko" >> $seqres.full +# un-scan the btrfs devices +_reload_btrfs_ko +_mount -o degraded,device=$dev2 $dev1 $SCRATCH_MNT >>$seqres.full 2>&1 +dd if=/dev/zero of="$SCRATCH_MNT"/tf2 bs=$bs count=$count \ + >>$seqres.full 2>&1 +_run_btrfs_util_prog filesystem show +_run_btrfs_util_prog filesystem df $SCRATCH_MNT +checkpoint1=`md5sum $SCRATCH_MNT/tf2` +echo $checkpoint1 >> $seqres.full 2>&1 + +#-------------balance------------------- +echo >> $seqres.full +echo "-----Mount normal-----" >> $seqres.full +echo +echo "Mount normal and balance" + +_scratch_unmount +_run_btrfs_util_prog device scan +_scratch_mount >> $seqres.full 2>&1 + +echo >> $seqres.full +_run_btrfs_util_prog balance start ${SCRATCH_MNT} + +_run_btrfs_util_prog filesystem show +_run_btrfs_util_prog filesystem df ${SCRATCH_MNT} + +checkpoint2=`md5sum $SCRATCH_MNT/tf2` +echo $checkpoint2 >> $seqres.full 2>&1 + +#-------------degraded-mount------------------- +echo >> $seqres.full +echo "-----Mount degraded with dev1 missing-----" >> $seqres.full +echo +echo "Mount degraded but with other dev" + +_scratch_unmount +# un-scan the btrfs devices +_reload_btrfs_ko + +_mount -o degraded,device=${dev2} $dev3 $SCRATCH_MNT >>$seqres.full 2>&1 + +_run_btrfs_util_prog filesystem show +_run_btrfs_util_prog filesystem df $SCRATCH_MNT +checkpoint3=`md5sum $SCRATCH_MNT/tf2` +echo $checkpoint3 >> $seqres.full 2>&1 + +if [ "$checkpoint1" != "$checkpoint2" ]; then + echo $checkpoint1 + echo $checkpoint2 + echo "Inital sum does not match with after balance" +fi + +if [ "$checkpoint1" != "$checkpoint3" ]; then + echo $checkpoint1 + echo $checkpoint3 + echo "Inital sum does not match with data on dev2 written by balance" +fi + +_scratch_dev_pool_put +_test_mount + +status=0 +exit diff --git a/tests/btrfs/125.out b/tests/btrfs/125.out new file mode 100644 index 000000000000..d795f7d8e8a0 --- /dev/null +++ b/tests/btrfs/125.out @@ -0,0 +1,7 @@ +QA output created by 125 + +Write data with degraded mount + +Mount normal and balance + +Mount degraded but with other dev diff --git a/tests/btrfs/group b/tests/btrfs/group index ba13e128b173..d959b1d38f6d 100644 --- a/tests/btrfs/group +++ b/tests/btrfs/group @@ -127,3 +127,4 @@ 122 auto quick snapshot qgroup 123 auto quick qgroup 124 auto replace +125 auto replace