From patchwork Thu Oct 31 23:42:40 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 13858496 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 12BB71946BC for ; Thu, 31 Oct 2024 23:42:40 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418162; cv=none; b=nu6h4YukDsLguqEm78NHGcaUtNVnGLt3EuziBMyCPNIEEjZyrHcUlsPyXYtSFRB/xjixBBaqREr5eTsk6MpOFqjx6/SxMW94jjoekJyEujdTEP+izspkwnM2bFHqtt54gwKDLjCC0NcgzjQdMCBN/qO6CV7iaRSqw5AEh3v5NyQ= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418162; c=relaxed/simple; bh=59fKSUELu8tgj9fIqu+UnQd+1zyYMz1deGOLmyiXCq0=; h=Date:Subject:From:To:Cc:Message-ID:MIME-Version:In-Reply-To: References:Content-Type; b=im0CzUuGC6TQfI3oYPCnimumhC7P5ZA6H/qdfDtOnC73q380anjPpesLOg6sk+OKvzbpeXWEQZqYv/a1IrkDaWyjZFr39Q9oOpH4ZM6HJLvH1uwuf6Ob0APetfZxaFyvDsVq8Zo9Zl9zOevXEVwF5UJTTjGT9rztnfayUzdCihM= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=Orm5BPP8; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="Orm5BPP8" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 8D264C4CEC3; Thu, 31 Oct 2024 23:42:40 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1730418160; bh=59fKSUELu8tgj9fIqu+UnQd+1zyYMz1deGOLmyiXCq0=; h=Date:Subject:From:To:Cc:In-Reply-To:References:From; b=Orm5BPP8zdCiLvl1mAwA8H4kuOcOBL6o2azF6yZbnXCZuz2hNez6qjnlrhTu7yIFb sUOwclt9vtGl/ojXe3LNv0fTLO9vHYc8uaM4yK8rV6F7AQbqTZp43R/OIjgyQnOFwx uZuoLONZU/m21In3clQv7PqtMrXlymOeDFshtlzJoYtNfsg/4ASRaHXaJs9yBw2yC1 KMKdhBos3Di1BiQI0hy+HfTy9qUPIByckmUpl3zFTrZN06wn2C+dqjsPEspR9KMfKz fmT0hkrYm78wOmRPfEmpiCLwmzvQCxUw5gS1TZ7MAE5q7AW7mJAmRB+yF5hG4WSVPh Udeeo1ghEzmdQ== Date: Thu, 31 Oct 2024 16:42:40 -0700 Subject: [GIT PULL 1/7] libxfs: new code for 6.12 From: "Darrick J. Wong" To: aalbersh@kernel.org, djwong@kernel.org Cc: bfoster@redhat.com, brauner@kernel.org, cem@kernel.org, chandanbabu@kernel.org, da.gomez@samsung.com, dan.carpenter@linaro.org, dchinner@redhat.com, hare@suse.de, hch@lst.de, jlayton@kernel.org, kch@nvidia.com, kernel@pankajraghav.com, linux-xfs@vger.kernel.org, mcgrof@kernel.org, p.raghav@samsung.com, sam@gentoo.org, willy@infradead.org Message-ID: <173041764416.994242.1631031230343563017.stg-ugh@frogsfrogsfrogs> Precedence: bulk X-Mailing-List: linux-xfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: <20241031233336.GD2386201@frogsfrogsfrogs> References: <20241031233336.GD2386201@frogsfrogsfrogs> Hi Andrey, Please pull this branch with changes for xfsprogs for 6.11-rc1. As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems. The following changes since commit 42523142959ddebd127a87e98879f9110da0cc7d: xfsprogs: update gitignore (2024-10-08 14:31:31 +0200) are available in the Git repository at: https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/libxfs-sync-6.12_2024-10-31 for you to fetch changes up to 6611215e3d441a5e6d9d6a2f85c5ea1bf573a8d0: xfs: update the pag for the last AG at recovery time (2024-10-31 15:45:04 -0700) ---------------------------------------------------------------- libxfs: new code for 6.12 [1/7] New code for 6.12. Signed-off-by: Darrick J. Wong ---------------------------------------------------------------- Andrey Albershteyn (1): xfsprogs: Release v6.11.0 Christoph Hellwig (30): libfrog: add xarray emulation xfs: remove xfs_validate_rtextents xfs: factor out a xfs_validate_rt_geometry helper xfs: remove the limit argument to xfs_rtfind_back xfs: assert a valid limit in xfs_rtfind_forw xfs: add bounds checking to xfs_rt{bitmap,summary}_read_buf xfs: factor out rtbitmap/summary initialization helpers xfs: push transaction join out of xfs_rtbitmap_lock and xfs_rtgroup_lock xfs: ensure rtx mask/shift are correct after growfs xfs: remove xfs_rtb_to_rtxrem xfs: simplify xfs_rtalloc_query_range xfs: clean up the ISVALID macro in xfs_bmap_adjacent xfs: remove xfs_{rtbitmap,rtsummary}_wordcount xfs: replace m_rsumsize with m_rsumblocks xfs: use kfree_rcu_mightsleep to free the perag structures xfs: move the tagged perag lookup helpers to xfs_icache.c xfs: convert perag lookup to xarray xfs: ensure st_blocks never goes to zero during COW writes xfs: merge xfs_attr_leaf_try_add into xfs_attr_leaf_addname xfs: return bool from xfs_attr3_leaf_add xfs: distinguish extra split from real ENOSPC from xfs_attr3_leaf_split xfs: distinguish extra split from real ENOSPC from xfs_attr_node_try_addname xfs: fold xfs_bmap_alloc_userdata into xfs_bmapi_allocate xfs: don't ifdef around the exact minlen allocations xfs: call xfs_bmap_exact_minlen_extent_alloc from xfs_bmap_btalloc xfs: support lowmode allocations in xfs_bmap_exact_minlen_extent_alloc xfs: pass the exact range to initialize to xfs_initialize_perag xfs: merge the perag freeing helpers xfs: don't use __GFP_RETRY_MAYFAIL in xfs_initialize_perag xfs: update the pag for the last AG at recovery time Dan Carpenter (1): xfs: remove unnecessary check Darrick J. Wong (8): libxfs: require -std=gnu11 for compilation by default libxfs: test compiling public headers with a C++ compiler libxfs: port IS_ENABLED from the kernel xfs: introduce new file range commit ioctls xfs: pass the icreate args object to xfs_dialloc xfs: fix a sloppy memory handling bug in xfs_iroot_realloc xfs: replace shouty XFS_BM{BT,DR} macros xfs: standardize the btree maxrecs function parameters Dave Chinner (1): xfs: use kvmalloc for xattr buffers Pankaj Raghav (1): xfs: enable block size larger than page size support VERSION | 4 +- configure.ac | 15 ++- db/bmap.c | 10 +- db/bmap_inflate.c | 2 +- db/bmroot.c | 8 +- db/btheight.c | 18 +-- db/check.c | 11 +- db/frag.c | 8 +- db/iunlink.c | 2 +- db/metadump.c | 16 +-- debian/changelog | 6 + doc/CHANGES | 5 + include/builddefs.in | 8 ++ include/kmem.h | 11 ++ include/libxfs.h | 6 +- include/platform_defs.h | 63 ++++++++++ include/xfs_mount.h | 4 +- libfrog/radix-tree.h | 35 ++++++ libxfs/Makefile | 31 ++++- libxfs/defer_item.c | 14 +++ libxfs/init.c | 17 +-- libxfs/ioctl_c_dummy.c | 11 ++ libxfs/ioctl_cxx_dummy.cpp | 13 +++ libxfs/libxfs_api_defs.h | 2 +- libxfs/libxfs_priv.h | 6 +- libxfs/xfs_ag.c | 165 ++++++-------------------- libxfs/xfs_ag.h | 25 +--- libxfs/xfs_alloc.c | 7 +- libxfs/xfs_alloc.h | 4 +- libxfs/xfs_alloc_btree.c | 6 +- libxfs/xfs_alloc_btree.h | 3 +- libxfs/xfs_attr.c | 190 +++++++++++++----------------- libxfs/xfs_attr_leaf.c | 63 +++++----- libxfs/xfs_attr_leaf.h | 2 +- libxfs/xfs_bmap.c | 243 ++++++++++++++++----------------------- libxfs/xfs_bmap_btree.c | 24 ++-- libxfs/xfs_bmap_btree.h | 207 ++++++++++++++++++++++----------- libxfs/xfs_da_btree.c | 5 +- libxfs/xfs_fs.h | 26 +++++ libxfs/xfs_ialloc.c | 14 ++- libxfs/xfs_ialloc.h | 4 +- libxfs/xfs_ialloc_btree.c | 6 +- libxfs/xfs_ialloc_btree.h | 3 +- libxfs/xfs_inode_fork.c | 40 +++---- libxfs/xfs_inode_util.c | 2 +- libxfs/xfs_refcount_btree.c | 5 +- libxfs/xfs_refcount_btree.h | 3 +- libxfs/xfs_rmap_btree.c | 7 +- libxfs/xfs_rmap_btree.h | 3 +- libxfs/xfs_rtbitmap.c | 274 +++++++++++++++++++++++++++++++------------- libxfs/xfs_rtbitmap.h | 61 ++-------- libxfs/xfs_sb.c | 92 ++++++++------- libxfs/xfs_sb.h | 3 + libxfs/xfs_shared.h | 3 + libxfs/xfs_trans_resv.c | 4 +- libxfs/xfs_types.h | 12 -- m4/package_utilies.m4 | 5 + mkfs/proto.c | 17 ++- repair/bmap_repair.c | 2 +- repair/dinode.c | 17 +-- repair/phase5.c | 16 +-- repair/phase6.c | 18 ++- repair/prefetch.c | 8 +- repair/rt.c | 7 +- repair/scan.c | 6 +- 65 files changed, 1076 insertions(+), 852 deletions(-) create mode 100644 libxfs/ioctl_c_dummy.c create mode 100644 libxfs/ioctl_cxx_dummy.cpp From patchwork Thu Oct 31 23:42:55 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 13858497 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id AD69C1946BC for ; Thu, 31 Oct 2024 23:42:56 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418176; cv=none; b=YNdS6vkpzlDyQjKkCJPplxQi2pdMWHcRf1meuI1xjI6NwRkf2F6GQlgzcVfZ1h7pdHYeCE3FtCMi4NVcapkhjbsWglu4z2moU308R4TvtAQbArgWg6JAihlT0bAYMlLwg2+zXAkokIo1YqGS00wjiGLsc4qKv96dBheZpzY+0x8= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418176; c=relaxed/simple; bh=tns1ZrLu2KPMclcoagj8+aNqASFC+0URglOnyP5nHtg=; h=Date:Subject:From:To:Cc:Message-ID:MIME-Version:In-Reply-To: References:Content-Type; b=MD48PDBrZb0FIlzOK143QKSSonZ1NZsFxsAj7dYBHv6NEsxZDntCpvZIn2F4Uz0IIkOttJIE90aRfi/8fiO0+EZRC9SvmjrG+X0cPmCCctB4sej5rGjSV5U+OzVFSZtT+sTcE/5DvV7gbnzdvnER6WYbUAnozQvZ3v2Gmal4URo= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=elk+7H/f; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="elk+7H/f" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 328D0C4CECF; Thu, 31 Oct 2024 23:42:56 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1730418176; bh=tns1ZrLu2KPMclcoagj8+aNqASFC+0URglOnyP5nHtg=; h=Date:Subject:From:To:Cc:In-Reply-To:References:From; b=elk+7H/fcfH6/j3Nh19+nuuSObwMHWfjn4cRN5spXrWi5ZpYWqsFNC7J/Of9Ks2U4 HwSrKd4/OL9vG7gt13vdZImBpbauHCrm7oy07Owh2diXmzCsCBAwa4FSn7BWOlzFyb Ji6ssoBqIJx4DYCzT4+Y+zHu22sSHYWUXLZv4iI0HeFNAL+tUOBmyGFRLTxnqtexgC /U5XaAOSAzq67vh+b5trNM/XLQaB0+LmgATs5tfeKyppSItNOe1Spozn2jzDsUb3Cg dhP4zTJq2ENuAjScsr6ETA9/qECJvr43XIUY2yVcWCEYVwzgKwogS6J2DkVBwnv8YW XZW7mUAfYCyaQ== Date: Thu, 31 Oct 2024 16:42:55 -0700 Subject: [GIT PULL 2/7] xfsprogs: atomic file content commits From: "Darrick J. Wong" To: aalbersh@kernel.org, djwong@kernel.org Cc: hch@lst.de, linux-xfs@vger.kernel.org Message-ID: <173041764501.994242.4495986757240413891.stg-ugh@frogsfrogsfrogs> Precedence: bulk X-Mailing-List: linux-xfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: <20241031233336.GD2386201@frogsfrogsfrogs> References: <20241031233336.GD2386201@frogsfrogsfrogs> Hi Andrey, Please pull this branch with changes for xfsprogs for 6.11-rc1. As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems. The following changes since commit 6611215e3d441a5e6d9d6a2f85c5ea1bf573a8d0: xfs: update the pag for the last AG at recovery time (2024-10-31 15:45:04 -0700) are available in the Git repository at: https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/atomic-file-commits-6.12_2024-10-31 for you to fetch changes up to 1cf7afbc0c8bcb450ebc3acab7616c9da49087de: xfs_io: add atomic file update commands to exercise file commit range (2024-10-31 15:45:04 -0700) ---------------------------------------------------------------- xfsprogs: atomic file content commits [v31.3 2/7] This series creates XFS_IOC_START_COMMIT and XFS_IOC_COMMIT_RANGE ioctls to perform the exchange only if the target file has not been changed since a given sampling point. This new functionality uses the mechanism underlying EXCHANGE_RANGE to stage and commit file updates such that reader programs will see either the old contents or the new contents in their entirety, with no chance of torn writes. A successful call completion guarantees that the new contents will be seen even if the system fails. The pair of ioctls allows userspace to perform what amounts to a compare and exchange operation on entire file contents. Note that there are ongoing arguments in the community about how best to implement some sort of file data write counter that nfsd could also use to signal invalidations to clients. Until such a thing is implemented, this patch will rely on ctime/mtime updates. Signed-off-by: Darrick J. Wong ---------------------------------------------------------------- Darrick J. Wong (7): man: document file range commit ioctls libfrog: add support for commit range ioctl family libxfs: remove unused xfs_inode fields libxfs: validate inumber in xfs_iget xfs_fsr: port to new file exchange library function xfs_io: add a commitrange option to the exchangerange command xfs_io: add atomic file update commands to exercise file commit range fsr/xfs_fsr.c | 74 ++++---- include/xfs_inode.h | 4 - io/exchrange.c | 390 +++++++++++++++++++++++++++++++++++++- io/io.h | 4 + io/open.c | 27 ++- libfrog/file_exchange.c | 194 +++++++++++++++++++ libfrog/file_exchange.h | 10 + libxfs/inode.c | 2 +- man/man2/ioctl_xfs_commit_range.2 | 296 +++++++++++++++++++++++++++++ man/man2/ioctl_xfs_fsgeometry.2 | 2 +- man/man2/ioctl_xfs_start_commit.2 | 1 + man/man8/xfs_io.8 | 35 +++- 12 files changed, 983 insertions(+), 56 deletions(-) create mode 100644 man/man2/ioctl_xfs_commit_range.2 create mode 100644 man/man2/ioctl_xfs_start_commit.2 From patchwork Thu Oct 31 23:43:11 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 13858498 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id F241A1946BC for ; Thu, 31 Oct 2024 23:43:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418192; cv=none; b=DyrS6MnAXifkS7J2C2A1Rzfg59DGnvGqJGA575e8TITzlK1F3DHDsFQmVyeuNeY0rGq8rrBr41WmWIGKEN2jCpu4ZldQjgW76UpSZxDTXfvEtxkOkeFSxsWcuQrkJhd9hJZQHONVUDU5n+FzJwckzWMHY5dB6OgM9ElQ3A4blMk= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418192; c=relaxed/simple; bh=kcm6XbX+MCe2/zh0unBoHq/mfg/h+YGP2PbRpwHlP/c=; h=Date:Subject:From:To:Cc:Message-ID:MIME-Version:In-Reply-To: References:Content-Type; b=E/YpFg4BWwIRLl8iEHbvvx6A2efffZVB7QJf4ajn2HT4JZnZqBhSQP7M8ttwziRGgBlY3Pj9DvhsSw7Le4d6wurs81TwsbFw8t7ZBk1NIpRZIKhnNIE6TtoALlmTTSE5Pf5OhyzVbhQAwp+ei3bwfQfgMjAx+eQqqo85y2uu7eY= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=e9nc500k; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="e9nc500k" Received: by smtp.kernel.org (Postfix) with ESMTPSA id CBEDDC4CEC3; Thu, 31 Oct 2024 23:43:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1730418191; bh=kcm6XbX+MCe2/zh0unBoHq/mfg/h+YGP2PbRpwHlP/c=; h=Date:Subject:From:To:Cc:In-Reply-To:References:From; b=e9nc500k1C6M9emkZc62FpbQ0OXippTK2Z14t6z3DWBtb6jT3Xf3rAd++tzTcTH5Y s/j4RmdH3jnainoWNx0xju/dGkbgHJd2BRpbAINeuCCRdtFzsSBYC8mSgi4FHbycUC PhSRmL1z6Q7t6f1uTBKRvDEovUZhBJzgNP39vJ9ikgLxEZ28Gi2qk+qpUtsklpi0mC WWJFJvV+9S7ucZ5M2AlZmZMrQwwL4WBqYdWFfViAwI++i+mwV2kLje3V8EmlWVvLKQ +fRurLbh84HKOwTynX/0OaloEqtgCXLQLDOj/bTw76kzm3Z3w1518iN7GSzat4ARrl m7YeUmu8rAm2A== Date: Thu, 31 Oct 2024 16:43:11 -0700 Subject: [GIT PULL 3/7] xfs_db: debug realtime geometry From: "Darrick J. Wong" To: aalbersh@kernel.org, djwong@kernel.org Cc: hch@lst.de, linux-xfs@vger.kernel.org Message-ID: <173041764589.994242.3294432927483613816.stg-ugh@frogsfrogsfrogs> Precedence: bulk X-Mailing-List: linux-xfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: <20241031233336.GD2386201@frogsfrogsfrogs> References: <20241031233336.GD2386201@frogsfrogsfrogs> Hi Andrey, Please pull this branch with changes for xfsprogs for 6.11-rc1. As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems. The following changes since commit 1cf7afbc0c8bcb450ebc3acab7616c9da49087de: xfs_io: add atomic file update commands to exercise file commit range (2024-10-31 15:45:04 -0700) are available in the Git repository at: https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/debug-realtime-geometry-6.12_2024-10-31 for you to fetch changes up to 5f10590bae67d7698191a1392b6b1d3ce4d11a0c: xfs_db: convert rtsummary geometry (2024-10-31 15:45:05 -0700) ---------------------------------------------------------------- xfs_db: debug realtime geometry [v5.3 3/7] Before we start modernizing the realtime device, let's first make a few improvements to the XFS debugger to make our lives easier. First up is making it so that users can point the debugger at the block device containing the realtime section, and augmenting the io cursor code to be able to read blocks from the rt device. Next, we add a new geometry conversion command (rtconvert) to make it easier to go back and forth between rt blocks, rt extents, and the corresponding locations within the rt bitmap and summary files. Signed-off-by: Darrick J. Wong ---------------------------------------------------------------- Darrick J. Wong (8): xfs_db: support passing the realtime device to the debugger xfs_db: report the realtime device when associated with each io cursor xfs_db: make the daddr command target the realtime device xfs_db: access realtime file blocks xfs_db: access arbitrary realtime blocks and extents xfs_db: enable conversion of rt space units xfs_db: convert rtbitmap geometry xfs_db: convert rtsummary geometry db/block.c | 171 ++++++++++++++++++++- db/block.h | 20 +++ db/convert.c | 438 +++++++++++++++++++++++++++++++++++++++++++++++++++--- db/faddr.c | 5 +- db/init.c | 7 +- db/io.c | 39 ++++- db/io.h | 3 + db/xfs_admin.sh | 4 +- man/man8/xfs_db.8 | 131 +++++++++++++++- 9 files changed, 778 insertions(+), 40 deletions(-) From patchwork Thu Oct 31 23:43:26 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 13858499 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id E27DA1946BC for ; Thu, 31 Oct 2024 23:43:27 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418209; cv=none; b=b/ou7pt8yERmhj1bDazkwyBLWyOl7Cn7BJzuSEzTZVXYZ7q+wAPJucr1HEQvKzla8npaGCOrpt9xdW6ShQGvmfTS7BNfqMFgFyttIunPs65JbdAT5U65qhKunocTGJ0qLr26PcSvh71vZ5uQTVLAOt2u1FEhvoM305N4jrydD1g= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418209; c=relaxed/simple; bh=uY3xj2F/n52NJC3T8pHCRBb4pcAvqlWPEab59fhlIVw=; h=Date:Subject:From:To:Cc:Message-ID:MIME-Version:In-Reply-To: References:Content-Type; b=BTJIcJARW0dsrGuQGIWTunPkJw0r4BqdueWu5ty83zF7+J114dNy2kchHG7epXYPfHhxh5ol2j0x6GpfgUKGaGYUML6jIrrQfI2naCKCKyPDa7KV5t8FSGX3E82Wzkiq2vI2k+jDn9G1695XB/BuQT8OcvwmBbKIWwxu7HfcLjE= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=Uf78nbJ6; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="Uf78nbJ6" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 6CC0EC4CEC3; Thu, 31 Oct 2024 23:43:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1730418207; bh=uY3xj2F/n52NJC3T8pHCRBb4pcAvqlWPEab59fhlIVw=; h=Date:Subject:From:To:Cc:In-Reply-To:References:From; b=Uf78nbJ6ZC0UxOR0p3XCthSvGRrB2QrhlKftB876cx6Jkr2BgTGkl4YhnpHubrAku 66bYI4VFUXHlf+IDUNY3YsdOdGaVh5qUrxEjryRAUTbG523YBGFeBIS/GT38Y/uFBm 2ndSo2JYPg7tWXYo3BtmJLOM10dqAs/zhI1w+gjNtRRNCRhredlaJNJ2+1SbKhC8Ev cbfnh3NFJ5bJqgWA+Fikf9Xt3aJ9f2O+DwGuesFHhSl30fzOnpGGX2NtQHAbEbbOCG 6e+Erl4c3AMlW8w9Wyy4X5PeBbmX4/6a9tACiqCOS7LlR3+6BJ2S7zgyIkrmLJ6T85 49vyxN2G+KGWA== Date: Thu, 31 Oct 2024 16:43:26 -0700 Subject: [GIT PULL 4/7] xfs_metadump: support external devices From: "Darrick J. Wong" To: aalbersh@kernel.org, djwong@kernel.org Cc: hch@lst.de, linux-xfs@vger.kernel.org Message-ID: <173041764673.994242.698115173572630517.stg-ugh@frogsfrogsfrogs> Precedence: bulk X-Mailing-List: linux-xfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: <20241031233336.GD2386201@frogsfrogsfrogs> References: <20241031233336.GD2386201@frogsfrogsfrogs> Hi Andrey, Please pull this branch with changes for xfsprogs for 6.11-rc1. As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems. The following changes since commit 5f10590bae67d7698191a1392b6b1d3ce4d11a0c: xfs_db: convert rtsummary geometry (2024-10-31 15:45:05 -0700) are available in the Git repository at: https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/metadump-external-devices-6.12_2024-10-31 for you to fetch changes up to 5e8139658b798d931079404660273840432bcd9f: xfs_db: allow setting current address to log blocks (2024-10-31 15:45:05 -0700) ---------------------------------------------------------------- xfs_metadump: support external devices [v5.3 4/7] This series augments the xfs_metadump and xfs_mdrestore utilities to capture the contents of an external log in a metadump, and restore it on the other end. This will enable better debugging analysis of broken filesystems, since it will now be possible to capture external log data. This is a prequisite for the rt groups feature, since we'll also need to capture the rt superblocks written to the rt device. This also means we can capture the contents of external logs for better analysis by support staff. Signed-off-by: Darrick J. Wong ---------------------------------------------------------------- Darrick J. Wong (1): xfs_db: allow setting current address to log blocks db/block.c | 103 +++++++++++++++++++++++++++++++++++++++++++++++++++++- man/man8/xfs_db.8 | 17 +++++++++ 2 files changed, 119 insertions(+), 1 deletion(-) From patchwork Thu Oct 31 23:43:42 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 13858500 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 9607A1946BC for ; Thu, 31 Oct 2024 23:43:43 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418223; cv=none; b=S9uoTcPpXIbkpn+WNuB/KeIhjm5BumOovo9TVFCGPNLNLHhbfTrVCyl+jdasutmZVyPQYvmVKY/IFHhCWbunevHpmCt5V5FifnN25CObXoE5qENZsycpuSXBYVELylVbVF92D4e74RUm2xh9fPET4TbVsQ1UyyiAAt3j3pflIp8= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418223; c=relaxed/simple; bh=A5aofJxnrax0Ii6fLXfC7R7Ix+3uGBiv+ca1JcyfCiI=; h=Date:Subject:From:To:Cc:Message-ID:MIME-Version:In-Reply-To: References:Content-Type; b=j2WJmhAPNLvL7XL5mdIhiTpgbbKtpRtXwHqfogyHaSkdtrPkNmJ9IW3V37Vx0oNmIn/A8VhN1dNvp8h9YGVHp3IKSkUZri8lRIjWkj6QXQcOrspwpVcbQy+jTFh/pjsRYpLj6ZSHUlZP67Js/AxLnthoaoWdtxUka4ZB/M0ehhE= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=evgA6Pxx; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="evgA6Pxx" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 17CC9C4CEC3; Thu, 31 Oct 2024 23:43:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1730418223; bh=A5aofJxnrax0Ii6fLXfC7R7Ix+3uGBiv+ca1JcyfCiI=; h=Date:Subject:From:To:Cc:In-Reply-To:References:From; b=evgA6PxxrGulQnKKqE+ECHUFzSc6YUiy6ENYFCcv3k1tZM1uPMohY4VybE5pmXNpQ 0b+pDxymEYqKDek+PJDaelMevQOiFvx8HulXym7xWmtcIKZC7sSFEDBzFyQJbooasu HL2SHEC1V5g/At7z6f2FlFsP6VKkN/5n8KScTEz3JtXWPy0uHzRFH5P95R60h8NBeo 9vQA5FvCCfe5Qj1n5FupPN0VDMrAtEKXvigpbTL0X5+/Rbx8rKYquOM8B7z8qvNr4W yUwK4csn18YyTI/KSL+CRb9a34OZXBOpzkdNRR2skNq5AFWmonYZA33QSTRPPKPeCj xc/qDHICC6t0Q== Date: Thu, 31 Oct 2024 16:43:42 -0700 Subject: [GIT PULL 5/7] mkfs/repair: use new rtbitmap helpers From: "Darrick J. Wong" To: aalbersh@kernel.org, djwong@kernel.org Cc: # v5.19.0, hch@lst.de, linux-xfs@vger.kernel.org Message-ID: <173041764757.994242.5921950807905351688.stg-ugh@frogsfrogsfrogs> Precedence: bulk X-Mailing-List: linux-xfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: <20241031233336.GD2386201@frogsfrogsfrogs> References: <20241031233336.GD2386201@frogsfrogsfrogs> Hi Andrey, Please pull this branch with changes for xfsprogs for 6.11-rc1. As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems. The following changes since commit 5e8139658b798d931079404660273840432bcd9f: xfs_db: allow setting current address to log blocks (2024-10-31 15:45:05 -0700) are available in the Git repository at: https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/misc-use-rtbitmap-helpers-6.12_2024-10-31 for you to fetch changes up to 07c09d46665cfac48256f6faf829897554ec74bf: xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino (2024-10-31 15:45:05 -0700) ---------------------------------------------------------------- mkfs/repair: use new rtbitmap helpers [v5.3 5/7] Use the new rtfile helpers to create the rt bitmap and summary files instead of duplicating the logic that the in-kernel growfs already had. Signed-off-by: Darrick J. Wong ---------------------------------------------------------------- Christoph Hellwig (5): xfs_repair: use xfs_validate_rt_geometry mkfs: remove a pointless rtfreesp_init forward declaration mkfs: use xfs_rtfile_initialize_blocks xfs_repair: use libxfs_rtfile_initialize_blocks xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino Darrick J. Wong (1): xfs_repair: checking rt free space metadata must happen during phase 4 libxfs/libxfs_api_defs.h | 2 + mkfs/proto.c | 107 +++--------------- repair/phase4.c | 7 ++ repair/phase5.c | 6 - repair/phase6.c | 284 ++++++++--------------------------------------- repair/sb.c | 40 +------ repair/xfs_repair.c | 3 - 7 files changed, 73 insertions(+), 376 deletions(-) From patchwork Thu Oct 31 23:43:58 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 13858501 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 39AFB1946BC for ; Thu, 31 Oct 2024 23:43:58 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418239; cv=none; b=m7/bSTJeiv7rX1SP9Lk5Kf0XzvBrhXXM9UkJwvB7cMgc2y8+YJKyjKiNtOxmvQ103pQtbLIrQO/rOChMVVFXkZnXBbWJ47wwLtAo1sorhnWHLLXKtIvMJNE2EOm1hSReNHjwSst70BEX6in6DWjrugcrkqBO15j0K0r0o0M5aSI= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418239; c=relaxed/simple; bh=1xUKDGoHNvdzUbFshIJj2M9PARWC24W0xplKsIkvlCw=; h=Date:Subject:From:To:Cc:Message-ID:MIME-Version:In-Reply-To: References:Content-Type; b=XE7GTgpqKIskHkwleeDRxGqA0v8AbiHgkd0egA+ZokUy1lyIeAb0wHE585KPVIRcwJHtOwk7wFiqQtvtXXyGuylc4vKKc5Vo0SUaIxZr1Ui2QEGv5j1daRP+swO4wqAScFFkCibi1ZbWlUl8b0fULs60X/q6P9YIEcob+/XM+pQ= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=RS70/gY9; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="RS70/gY9" Received: by smtp.kernel.org (Postfix) with ESMTPSA id A4EEEC4CEC3; Thu, 31 Oct 2024 23:43:58 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1730418238; bh=1xUKDGoHNvdzUbFshIJj2M9PARWC24W0xplKsIkvlCw=; h=Date:Subject:From:To:Cc:In-Reply-To:References:From; b=RS70/gY9wIRu4pmaR7J5Zkw4ZUumgP6DnHQlb3Hj88Yy19YSB6pUudkJLJM91bX+b LgKJI7VMRISUTk+uMOpCL4fqaztg1RjzAkv2KtIObOnmmo7C1rxFs86NoujnNa2Rin 0tQkdPVzDvMgb1FDvHguzefJojljBQ7mC+S4ZrJsKOT0kJZBGJqWoVZIJ8gki/aT// vVi00VlMrNE2cPxL28c+l9V3oa5k/1ufB7/VJXEVFoXee25v99rHUg9Ec2kc9jsNGv t74DNzucLiAg0kRtILU4HCnwFOYd2wwK1k0wnFbCcY1iRbox0Sc6fqRD3Cdf6Eodqf 35qUC28DoF52g== Date: Thu, 31 Oct 2024 16:43:58 -0700 Subject: [GIT PULL 6/7] xfs_scrub_all: bug fix for 6.12 From: "Darrick J. Wong" To: aalbersh@kernel.org, djwong@kernel.org Cc: # v6.10.0, hch@lst.de, linux-xfs@vger.kernel.org Message-ID: <173041764842.994242.13161959286165075663.stg-ugh@frogsfrogsfrogs> Precedence: bulk X-Mailing-List: linux-xfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: <20241031233336.GD2386201@frogsfrogsfrogs> References: <20241031233336.GD2386201@frogsfrogsfrogs> Hi Andrey, Please pull this branch with changes for xfsprogs for 6.11-rc1. As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems. The following changes since commit 07c09d46665cfac48256f6faf829897554ec74bf: xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino (2024-10-31 15:45:05 -0700) are available in the Git repository at: https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/scrub-fixes-6.12_2024-10-31 for you to fetch changes up to 024f91c02f22a6f1f1256a5b09323bc3b104f839: xfs_scrub_all: wait for services to start activating (2024-10-31 15:45:05 -0700) ---------------------------------------------------------------- xfs_scrub_all: bug fix for 6.12 [v31.3 6/7] Fix a problem with xfs_scrub_all mistakenly thinking that a service finished before it really did. Signed-off-by: Darrick J. Wong ---------------------------------------------------------------- Darrick J. Wong (1): xfs_scrub_all: wait for services to start activating scrub/xfs_scrub_all.in | 52 ++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 52 insertions(+) From patchwork Thu Oct 31 23:44:13 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 13858502 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id B93721CF29C for ; Thu, 31 Oct 2024 23:44:14 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418254; cv=none; b=u5A0WBbkzJGuMK+c776O6rbHUALRym2PIrcL1eq/eJm5ybw6Qpz0YUXlcDPpGExmR8AaV2P5xOd4k9oJZ3Uk4837Q3Y5cMobmC6i1l794f1BDhwFkRiCwLqkRFvFts1kRzu5e5oKWLnp83sW/tk06m7Om9fByZu4iAFPZNQDo40= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1730418254; c=relaxed/simple; bh=TCCbty4V+E/8XIi8NisO3V2tVqw2qiFQrX0FzQ22JI8=; h=Date:Subject:From:To:Cc:Message-ID:MIME-Version:In-Reply-To: References:Content-Type; b=nIrciKbhGgn0/GjBh7mTmCwm8/Q2p1lT/dkhTiiNoNslLnZuaO7VfoRW/GsUL7/vA+C99cvxEXdlFLcInYsBp6OnEme7H9CENTUYjpRsOxfvChcU4GYTZfu+oLxjkoHSq3lmuzqTquULWORCYdji63ciUT8ifNE8wvVMF4pLQBg= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=mb26wLFx; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="mb26wLFx" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 44440C4CEC3; Thu, 31 Oct 2024 23:44:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1730418254; bh=TCCbty4V+E/8XIi8NisO3V2tVqw2qiFQrX0FzQ22JI8=; h=Date:Subject:From:To:Cc:In-Reply-To:References:From; b=mb26wLFx4BeP7HsfbmNOl+JjDBFJLzr2+AT8A243204kd9ZHSY0uswRlBVRLd+CqM eKD+uD/mZWB6sckS0SvBcOueqEDH9SmTQ7mWKYLEDGnZFegeBsjz9h3LnemHkGb50I iM+HbhKmtNt1clz0t6tLj2KARplr7IGHJ3sQHZXwfdf3JoRKB4hgQYt1O6sJQcvEmN 7bgX1bbmA5nLgmldVYzz59hivUZYAt8GSExfQT9EaY0wmwNervb945q4st4cZaVNtD dbPCLkzKlvrMFxYrkSS66hl8HXaHY+OtKKPsbCPhjtrR4WySlWmlIefxaKYqnhdByx 8uXkYRqVXbSCw== Date: Thu, 31 Oct 2024 16:44:13 -0700 Subject: [GIT PULL 7/7] mkfs: new config file for 6.12 LTS From: "Darrick J. Wong" To: aalbersh@kernel.org, djwong@kernel.org Cc: hch@lst.de, linux-xfs@vger.kernel.org Message-ID: <173041764926.994242.16998301667196193579.stg-ugh@frogsfrogsfrogs> Precedence: bulk X-Mailing-List: linux-xfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: <20241031233336.GD2386201@frogsfrogsfrogs> References: <20241031233336.GD2386201@frogsfrogsfrogs> Hi Andrey, Please pull this branch with changes for xfsprogs for 6.11-rc1. As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems. The following changes since commit 024f91c02f22a6f1f1256a5b09323bc3b104f839: xfs_scrub_all: wait for services to start activating (2024-10-31 15:45:05 -0700) are available in the Git repository at: https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/mkfs-configs-6.12_2024-10-31 for you to fetch changes up to d19c5581b03e236de3737a35e53c99529ac8e912: mkfs: add a config file for 6.12 LTS kernels (2024-10-31 15:45:05 -0700) ---------------------------------------------------------------- mkfs: new config file for 6.12 LTS [7/7] New mkfs config file for 6.12 LTS. Signed-off-by: Darrick J. Wong ---------------------------------------------------------------- Darrick J. Wong (1): mkfs: add a config file for 6.12 LTS kernels mkfs/Makefile | 3 ++- mkfs/lts_6.12.conf | 19 +++++++++++++++++++ 2 files changed, 21 insertions(+), 1 deletion(-) create mode 100644 mkfs/lts_6.12.conf