Message ID | 20231009203231.1715845-1-zi.yan@sent.com (mailing list archive) |
---|---|
Headers | show
Return-Path: <owner-linux-mm@kvack.org> X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 07029CD612F for <linux-mm@archiver.kernel.org>; Mon, 9 Oct 2023 20:32:48 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C2ECE6B019C; Mon, 9 Oct 2023 16:32:47 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id BB6A96B019D; Mon, 9 Oct 2023 16:32:47 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A2FBC6B01A1; Mon, 9 Oct 2023 16:32:47 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 94FF76B019C for <linux-mm@kvack.org>; Mon, 9 Oct 2023 16:32:47 -0400 (EDT) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 6D4EEC042F for <linux-mm@kvack.org>; Mon, 9 Oct 2023 20:32:47 +0000 (UTC) X-FDA: 81327071574.22.1D29111 Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) by imf27.hostedemail.com (Postfix) with ESMTP id 594E340009 for <linux-mm@kvack.org>; Mon, 9 Oct 2023 20:32:44 +0000 (UTC) Authentication-Results: imf27.hostedemail.com; dkim=pass header.d=sent.com header.s=fm2 header.b=eXdStKJ2; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=Ha1tRQ+k; dmarc=pass (policy=none) header.from=sent.com; spf=pass (imf27.hostedemail.com: domain of zi.yan@sent.com designates 66.111.4.25 as permitted sender) smtp.mailfrom=zi.yan@sent.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1696883564; h=from:from:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references:dkim-signature; bh=JPvpBZP1SSiqvBRF9ydN+g0ZFANiZsdjFQ7+amB/n1s=; b=OXsF5ur20qjh0L7W8A3qFH4UwmtIvDxgs3cul/fsAhViZN5FnjahsDVpdk44/kqKOA26mD 5+CBfAtFE3oT8jOCYpQ45U4K2ckDFKLLLBxzyJGd8FOSzwFowKAkqaQKneGbLJ970LxWwS yE7//AntT4s+0rNELb1k0AoZ79ucMCc= ARC-Authentication-Results: i=1; imf27.hostedemail.com; dkim=pass header.d=sent.com header.s=fm2 header.b=eXdStKJ2; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=Ha1tRQ+k; dmarc=pass (policy=none) header.from=sent.com; spf=pass (imf27.hostedemail.com: domain of zi.yan@sent.com designates 66.111.4.25 as permitted sender) smtp.mailfrom=zi.yan@sent.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1696883564; a=rsa-sha256; cv=none; b=YyzylePx8D55YThVhciHE+zEp9J1L1ewLIbtUhgknj+em3misWJUa/U9D4Huslc42ws0X1 2W3MQ0ZybIBxWye1NanbmKOKRp8ai6tSkSflmzSGBRdTkuFTsSGd7uLziyL5v8CxgtAm1O HEHwqxUT2Duue6lcYBWv5nGRJIb5TwI= Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id A12B15C02B9; Mon, 9 Oct 2023 16:32:43 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Mon, 09 Oct 2023 16:32:43 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sent.com; h=cc :cc:content-transfer-encoding:content-type:date:date:from:from :in-reply-to:message-id:mime-version:reply-to:reply-to:sender :subject:subject:to:to; s=fm2; t=1696883563; x=1696969963; bh=JP vpBZP1SSiqvBRF9ydN+g0ZFANiZsdjFQ7+amB/n1s=; b=eXdStKJ2pUQ8PIxQKv v4+49A47wjAImQwoLH2c9IWNdyCam1VBVuLz+McMZoPKxDRdxoOYIRCBRQducQR2 WfM2TuASvkyffQNdk9oFuFANUnk+4AQ/Fue6JYRdYw7XM9EfN/kpfFudR2Z9KM0a FMIeJFp751MvE2jeSz2I5wTB6ZO2UyjsLwlS9dWVyNX2316+O0oAD1Ou2xnKiKJT oQH5iSKi7F3lPORxiGkWp+ZieyeHw3BZepFlgetSkTDJxdmeF1Go4XiO20X09hpL kxK899lKSbaI31hk+OiY6anY+25Wn7VB3cFdYE1OGFxb+7CEO/FeaorveYoarwFT SY8A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:message-id:mime-version:reply-to:reply-to:sender :subject:subject:to:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm2; t=1696883563; x=1696969963; bh=J PvpBZP1SSiqvBRF9ydN+g0ZFANiZsdjFQ7+amB/n1s=; b=Ha1tRQ+kVnqQxBJUW 8EXwUIBNS5fH98GQgY8Lpb+aSAXu9/UPJZq5f0z12lKqQ1XPql/iPGB8K+PS8XzG lbPEvqRmWfVWNSWh5wJeuthxxqrcQjN5Jl7/djL/PjOqwLdE86pF+5Eeu4hrJkqI mw5fV36KFlmVg+NnzMxLLNVWOrBUSaBYoGPKngcUiQiEveiBpu9fKBYeMRC0r8L1 G5oCI82lUGZrN2KTGhtS/cbGyqxOGACP5ZdiDKEHscmyiK5+aJMPHSeJiWOaAbMT Ekj++sOuSOf6ZRtL40TRcr68ZqRctc/1Cthp4yR7BZJQhHFyq+ZgFkPinrH59E+X I77OQ== X-ME-Sender: <xms:a2MkZbYN0m_GE-7ZPHL_6gSeMUQ0dTB0gojE2bxWhJ9PervBdcnP_g> <xme:a2MkZaZ2fxQ91dfQ68wuQtf9z-4SZojUBPrI-_DY1neqnBI6vtwZlxtlcSK8uaBxx FClTnxx6SHQUaJXew> X-ME-Received: <xmr:a2MkZd8AR4tShPz3vpDAzLQxgo_zKTVVuXvthKZAwByt2tRLp0u-uv0PaAgdZiwoVfXagmLn2wjmGdpsraeLmZr_QUCJXVvZbPRvzR4C5sUeIu8_VEIuTeDO> X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrheefgdduhedtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffkofhrggfgsedtqhertdertddtnecuhfhrohhmpegkihcujggr nhcuoeiiihdrhigrnhesshgvnhhtrdgtohhmqeenucggtffrrghtthgvrhhnpedtgffhtd etledtkeeihfefueeuhedvudfhvdeifeevtdektdetgfeiieejuefhtdenucevlhhushht vghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpeiiihdrhigrnhesshgvnh htrdgtohhm X-ME-Proxy: <xmx:a2MkZRole4xCL4y7dbo4nCkPKaTJ5Biin5xKqlZLvwWRwrrdnro5Qw> <xmx:a2MkZWrs_2-5SGgXAb4NThbbCa9K4QiD8LtWeE211BsXQvfxfBMNMA> <xmx:a2MkZXSB_fyD-ml_c4raEJFn9Se0QGwerLpsZu96LpeGExVkFnYSJw> <xmx:a2MkZXdMVirKhVCTbzS6phbxkP0-BITuzcHOvIPMAVZfRFufF5KJMQ> Feedback-ID: iccd040f4:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Mon, 9 Oct 2023 16:32:42 -0400 (EDT) From: Zi Yan <zi.yan@sent.com> To: Huang Ying <ying.huang@intel.com>, linux-mm@kvack.org, linux-kernel@vger.kernel.org Cc: Zi Yan <ziy@nvidia.com>, Andrew Morton <akpm@linux-foundation.org>, "Matthew Wilcox (Oracle)" <willy@infradead.org>, David Hildenbrand <david@redhat.com>, Baolin Wang <baolin.wang@linux.alibaba.com> Subject: [PATCH 0/1] Large folio migration fix and questions on migration stats Date: Mon, 9 Oct 2023 16:32:30 -0400 Message-ID: <20231009203231.1715845-1-zi.yan@sent.com> X-Mailer: git-send-email 2.42.0 Reply-To: Zi Yan <ziy@nvidia.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: 594E340009 X-Stat-Signature: darod3afwe6ird7iub6hzpcgynhnkb6s X-Rspam-User: X-HE-Tag: 1696883564-956349 X-HE-Meta: U2FsdGVkX18X1jZxg7rQLidQcePa6aOvGRfr5zAmydUcXzqDu1/My6rKzNVpZUtke5PEkzsF1aV4dlLDkowTtDJIyG5j+6kuQHXD04h2mdgLc9RIlXwFU2Imy5wCFMt/hLRNWUltpoBX5ek/+8qFNIlQBDkTpm/Oa3iE5HCVBC5S/jATi1P8dGjiFoFSog5X2iqBQRmU6hAfvQ/yQyAJlU3K5w7Bcx8vJxdva28nYtccmPWunrPJBLs/cbosKL8L5Gk2NtYzLLHeEMa6zmjHNHPhQf4tyCoJQKR1nXNdLlQBIJ0JfF1jh1N3NLywXnrupx8U6FPZu9YQ3FtPXYLlLjgO/nWpmKR8i82yGbOd+6IUezbLbcSuj9l0x9ZxWYCFkZWxGu59xSjEfUOJNOEHoSA1cLldGx/7kI/C/HbFCUQ77LQY3dN7BsFsciT5/Z8le6qhgW5SXtEiJylPX6Zs3kAlS3mWtjSOUaZWUwiT8+sQMfk92ziX4jyDngnL02SJ+HHy7YI2fXz75SGdTmX9L3am8z/uUafd6mUd/SOPe1BFPacCP/azNTu8wt1OrLKrxn2Z7vQ7THiD9roaGwaZCJnqFDnLv4Deo365MKbkrHFINOdQY+kNJcvyK/FnFRapNtiGHv0WNhNCsZOA4zRdj5ZrkvOTMFoWKq43hq+/y6+hfntKS8A1887ts6gnBUQqrBxB5aEDktY6ZzINt76KrlyrWrkfdO9Ehs9MrOmQRwOsi9bpeiHWh5dukBTycJ78CUZjz09FXxGfUCi5NGdSkxNrgXoJTt9+OFEYfB7u8InduB5VjpSMdufJapKJBRnwU+LbXpA6FSz+5cibp5LGB74MuyXGseZ8yeaxhO/SfqnTiAflKr0aVUhyMdDRXMCqmwyl8gXlOQF/PWSpOxx+Lg9vTO6KedaQZGhrjSbXwT3sqatZLxHs/GBvvdQ9XpyTtT+XYe3OSXTcVhZxMt7 8oGjYfCt f5yVn5yuTCkWYAwa1SSSaha9VstUzfh1DLbovfArWjn2dLDQzSYhi7pfDccNt5PeNlUFe7msyOwO39N9FUTkKCfbgm5Q/HYhYQbtrDT949WBHKJpnHCHaBeaUpibM7LkiOXXSsbbH0MEG9Jnp8qcWurmLHHsqYzMurY9qI9rwC84Ta8ShlidEhpku53Z4TwwFCP4RN5m7mte+5TgEtOIFbeEFfN4mH9Ipt6TSMSzw3bGgb+wE8obA0x18rDxA8tdUusjeuCbu2LKh3l+z7fNQOg9JLqNypdR2fJH06EFQlTN8vQuhTgzRVbmxzEgod1Lzye04AvdQxiO6LvGGTCWjMO14ZItRzH8EXkHGHr2xXma7t802cbi1Ux9wVJodHx1wA/w/7BOQLT06EDSwEbyikiHA7W6Yzml7ZQI+EaAG3So0IarvQWMpUH9ctg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: <linux-mm.kvack.org> |
Series |
Large folio migration fix and questions on migration stats
|
expand
|
From: Zi Yan <ziy@nvidia.com> I am adding support for >0 folio compaction and find the VM_BUG_ON(!list_empty(&cc->migratepages)) in compact_zone() can be triggered when a large folio is tried to be migrated, split, and its split base pages are not migrated. The fix is in patch 1. In the upstream tree, large folios can be migrated via move_pages() syscall and there is no VM_BUG_ON in do_move_pages_to_node() but pages left in the source page list will not be returned to LRU lists. This is from my code inspection and I have not reproduced it on upstream tree yet. In addition, I wonder if we need to add any large folio migration stats in addition to existing THP migration stats, at least for large folio split stats. Otherwise, large folio migrations seem to happen without any notice. Thanks. Zi Yan (1): mm/migrate: correct nr_failed in migrate_pages_sync() mm/migrate.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)