From patchwork Tue Mar 30 21:35:40 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anthony Yznaga X-Patchwork-Id: 12173765 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER,SPF_HELO_NONE, SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 78AA3C433C1 for ; Tue, 30 Mar 2021 21:26:04 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 19CDF6195C for ; Tue, 30 Mar 2021 21:26:04 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 19CDF6195C Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=oracle.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id B795C6B0082; Tue, 30 Mar 2021 17:26:00 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id B4E3F6B0083; Tue, 30 Mar 2021 17:26:00 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 97B7D6B0085; Tue, 30 Mar 2021 17:26:00 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0060.hostedemail.com [216.40.44.60]) by kanga.kvack.org (Postfix) with ESMTP id 773136B0082 for ; Tue, 30 Mar 2021 17:26:00 -0400 (EDT) Received: from smtpin08.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 0A3B72466 for ; Tue, 30 Mar 2021 21:26:00 +0000 (UTC) X-FDA: 77977823280.08.4E1C9C7 Received: from aserp2130.oracle.com (aserp2130.oracle.com [141.146.126.79]) by imf05.hostedemail.com (Postfix) with ESMTP id 0CFE1E0001B4 for ; Tue, 30 Mar 2021 21:25:58 +0000 (UTC) Received: from pps.filterd (aserp2130.oracle.com [127.0.0.1]) by aserp2130.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 12ULPOZn123006; Tue, 30 Mar 2021 21:25:24 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : content-type : mime-version; s=corp-2020-01-29; bh=9KJx/AvLkVuTG95Nz9S7Rml6tSTK5D5P6CG5yLsuZdY=; b=sckAMlJlOto+DjOfTm1TeqhIe3N1CQl6wBlChEyUJEsSvv9RGI/vwv0JoccwfIrrgpUu EUbBw1YceXSlfApm41nZ585sCQGAA0mIAh9VAVSGe+xbuFICNjW9WVvDLaTxWPlxfKRe 3c7n9NMnPMcO9b+7C1SkSb+NJMzL1ohdseLRaEilwFN7Y+TPpPP/kS/LhJbKt1zOf/vk HPSCc+Rq7fFhTsuKVAQnmFCsOVxRJ05ZpjzBLS/rZHPr2g1ZLHc4zxDJhaxXXlviBCvn NmYFsXb8c/ks4bEctQdfx8kM3j2VQ3dSSSlyEH6lt4UqAN6QL8+Vff+Z+ls/0eK3+JXf zA== Received: from aserp3020.oracle.com (aserp3020.oracle.com [141.146.126.70]) by aserp2130.oracle.com with ESMTP id 37mafv081e-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 30 Mar 2021 21:25:24 +0000 Received: from pps.filterd (aserp3020.oracle.com [127.0.0.1]) by aserp3020.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 12ULOmHf183931; Tue, 30 Mar 2021 21:25:24 GMT Received: from nam11-bn8-obe.outbound.protection.outlook.com (mail-bn8nam11lp2174.outbound.protection.outlook.com [104.47.58.174]) by aserp3020.oracle.com with ESMTP id 37mac7u3yf-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 30 Mar 2021 21:25:23 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=DnVCjXHA7zw/J/hz9kgdMnEX5cslK3Kq4iZ3Ky+hqK21E66VOtrqoKWgVazC8gscyc11QkcR958qFa7PSwlO1F8xMydNLd4ULu8GfigdDV2zYo9MQma8hBIwTsuIlR6bx9M5JhFYAgClkv2tpWEz6Z8Xfqb70C70rz4/pXVS+oEUAfnHF92J6Eex8YcDs6OET/sFoAS7pyIos1x3bUTSWCAkGIJsqPrSuLTMhxb6H+j4odJGuKyNMuhPKnXnucorMm+88wdbbq2pwiSVhwrHzCFaxNaqbeGWLrYjvBPvShUrcgs4jBNqXYj5rPL5EVZ4soeV7MH8y0cpI5R+r37MNw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9KJx/AvLkVuTG95Nz9S7Rml6tSTK5D5P6CG5yLsuZdY=; b=DzJV3r/nIAaavy3RNN7eAlgzlaAXIKlAn9y1AJ2OOtMTn9KqCTPHF839gSSi7VKrXYvmxoglNPYdoExvcEql1lqcnHhtGB74HKVOPW12sNm46FsYN93phsca1z6QE19H/QHCXzxJcwYkySbpuiYTPAPlefYXNw2oDaDDqnZkKENpkEejLY8uEL69N56BYCAoZb83GXQHHPhPvtIjC0F3OBFaVGcKcI6x/3SBQ2GKg0tT6ZovYirgI68IDl3SWoliGaQvLgc9dk/pKVlyicRVPlcJ/hR0mHZLQAgm66PuNdg1dP01FMYwALl/KQh7/kp+T1PWRd8Vtf6w3WVqZNILGg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9KJx/AvLkVuTG95Nz9S7Rml6tSTK5D5P6CG5yLsuZdY=; b=UR+T/+dNFBlkljLkyrxFhtVC/wg8otMnUuPwTMWWbsx0RlbTm4Y+t5tmg/gPOGRTeNTO59kB1xVK6tlbWCzrRlBwteRy4KL8cVPpOUtfPIUXJBSCWZ87klDJx4Z518Kc2f1JRd8kKMyDwjPxf/s7CK+YKvWqjORLP4Q9Y01V+QE= Authentication-Results: kvack.org; dkim=none (message not signed) header.d=none;kvack.org; dmarc=none action=none header.from=oracle.com; Received: from MN2PR10MB3533.namprd10.prod.outlook.com (2603:10b6:208:118::32) by MN2PR10MB3120.namprd10.prod.outlook.com (2603:10b6:208:122::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3977.24; Tue, 30 Mar 2021 21:25:21 +0000 Received: from MN2PR10MB3533.namprd10.prod.outlook.com ([fe80::cc79:c40e:430f:e254]) by MN2PR10MB3533.namprd10.prod.outlook.com ([fe80::cc79:c40e:430f:e254%4]) with mapi id 15.20.3977.033; Tue, 30 Mar 2021 21:25:21 +0000 From: Anthony Yznaga To: linux-mm@kvack.org, linux-kernel@vger.kernel.org Cc: willy@infradead.org, corbet@lwn.net, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, x86@kernel.org, hpa@zytor.com, dave.hansen@linux.intel.com, luto@kernel.org, peterz@infradead.org, rppt@kernel.org, akpm@linux-foundation.org, hughd@google.com, ebiederm@xmission.com, keescook@chromium.org, ardb@kernel.org, nivedita@alum.mit.edu, jroedel@suse.de, masahiroy@kernel.org, nathan@kernel.org, terrelln@fb.com, vincenzo.frascino@arm.com, martin.b.radev@gmail.com, andreyknvl@google.com, daniel.kiper@oracle.com, rafael.j.wysocki@intel.com, dan.j.williams@intel.com, Jonathan.Cameron@huawei.com, bhe@redhat.com, rminnich@gmail.com, ashish.kalra@amd.com, guro@fb.com, hannes@cmpxchg.org, mhocko@kernel.org, iamjoonsoo.kim@lge.com, vbabka@suse.cz, alex.shi@linux.alibaba.com, david@redhat.com, richard.weiyang@gmail.com, vdavydov.dev@gmail.com, graf@amazon.com, jason.zeng@intel.com, lei.l.li@intel.com, daniel.m.jordan@oracle.com, steven.sistare@oracle.com, linux-fsdevel@vger.kernel.org, linux-doc@vger.kernel.org, kexec@lists.infradead.org Subject: [RFC v2 05/43] mm: PKRAM: support preserving transparent hugepages Date: Tue, 30 Mar 2021 14:35:40 -0700 Message-Id: <1617140178-8773-6-git-send-email-anthony.yznaga@oracle.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1617140178-8773-1-git-send-email-anthony.yznaga@oracle.com> References: <1617140178-8773-1-git-send-email-anthony.yznaga@oracle.com> X-Originating-IP: [148.87.23.8] X-ClientProxiedBy: BYAPR11CA0099.namprd11.prod.outlook.com (2603:10b6:a03:f4::40) To MN2PR10MB3533.namprd10.prod.outlook.com (2603:10b6:208:118::32) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from ca-qasparc-x86-2.us.oracle.com (148.87.23.8) by BYAPR11CA0099.namprd11.prod.outlook.com (2603:10b6:a03:f4::40) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3977.26 via Frontend Transport; Tue, 30 Mar 2021 21:25:17 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 7da638c5-3afb-45e3-afa9-08d8f3c252cb X-MS-TrafficTypeDiagnostic: MN2PR10MB3120: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:4941; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: srKziVRZBVYXXKXAz9YlwY1e+E5gtEcphN71s15JQY/sbFV55Ii0bKHw94EmHMlJ1U9s/CaTSSuTormn0W8i+F+4iFOZfJ3WnX8UBQOJM2LaRe1DSyCMkW2uqR1Z18pcZCcAhUFxREN7k9pc5Um2oxajdpwmUKWV1IygHnNg6g+ja5ms2FICAd2kWuTd4Xez8eDr4XBXPA8QyMz6Ad/fnqGmjrBaTIMb3KvU/j2kl6JkqjEPm4BDznhXKdr2yrmhOF6UeAyvyGpubIHaW6fERKxxfEXh/7Wu2qV4C86jVw+bxjiaY8lVE+IRcnKiG+JnDnfo5/n1WWS6WtyISK0mx9isrsdMvFzrhuqMDQD1cGEVuziPJFxjUfV8DdqwzH1AIWqhznuNpMQ/FishcSkX/lyDpDdYeuMFbocYfxU9s1QWvTijM05+TwbUYU6jqSq/XDL5Pa90qhKVVdYTr9lbc1aszwTRZ/KukXjeCIYz90wsvACS72p6ktJcSEQflYke16qQg97meXuiCadAeDAVGGdVMTQc9jx94LXJgfN/MXT7djHWFNkN/SFkMS2Q0Yv8zSAYjVqE2BQPUV6zb3RqWgUADOKICZvbfiiYevlUogQCrSGS3wpiapDcHZUJbMs+KhUj+VbuRn9pwu7SOqELGA== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MN2PR10MB3533.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(136003)(39860400002)(366004)(376002)(346002)(396003)(52116002)(316002)(186003)(6486002)(16526019)(5660300002)(2616005)(956004)(6666004)(8676002)(66556008)(44832011)(478600001)(83380400001)(7406005)(38100700001)(86362001)(7696005)(66476007)(66946007)(4326008)(2906002)(26005)(7416002)(36756003)(8936002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData: aKQ5yCPIQoDErcrOAYYtwRGvWsp0EDoHnHJZ5ix12by3wo1td8Cn0hGjdxhkEtt2VheoEM81loSqOt5Aj/diy/cdGJ4dWh0SCmtXj9zAolMWuWXBFOOVG7vR0zEHu0uaNAszgTBZevhEMMyV6YV7MSCOxA28wjUCHEKMkkIv0sXpV/C+6j+jshCyPGIHAqRQB/Hk3P+qCsH5tmwOMz4H1LfbfG0joKdHAnFsMhpCRQaeyAG0WSgTSl8JSLLcpXxCUuKNUNgEctg/+0WXwjjMTTzNDA4lX8Txxk6lpL2NS8Nr3jgLJZkYGQPfTuHqafnmIPFpCNxfJ2doiWdpB/yXg2eFgMa2ORfLLbdrN/xTF2UBwvP3LfCphU2ViDLnfExKkRXFQx/7GBja8duE3luIs93T+T7zXgYoR6beTipTRq9fY4EhG02qrqjA0GQDJNse3g1H3ETHf+Q/xqBbrFLIbZpUbGtCMAjVtdaOKan989qiDyM25IQZ/BjGR9t5xFvr3rLjp00Tkr1WOGHTPMpfbQJiUAxmh4gHcfNe7eVfwLvXdCSWIxwtQXN0ADy0UNmNfVNUFvdx3WyWrxp13ouar25l0UuVJYzbIYuCyh84MBwsiq4uk7xNSG4/04TzfC8W4GZvUjHf95yXlyvccVMlSOMHIhADopr0v7GxVf1vokEU1j8hEY80lOnoQLYRNSJOUwiq/iUJslkZeUgIiDMdamrGnZIjtIpHGv9489lsFA+RbQofvFwNZtmOej8qWcIa+kACYxWVjAiAVOdUfWWLmMoiHP4DUEonXQ8Y0ZoD3/sgXbDuiB3a6XrJA1t9C9EE1fTywkOZvK94mS3CCi+V4sSeqYMUiC+vMj5QelQE1gGT+uWk74dIJI3piOZlV8igI9RRACJof2UPmeifCP+kST0XIwx2EPApIzdSyCnwf3+U/HVB2JEFYgGHbeVNMOjozdoqZecpymIyGy88kFPku+m+aYQmMeuHG2MWwXiFKQUKr/AyZUlnve/z354FyC691ISSppX8rw0Bifmh2ayhxHF4kUznfVBYgNNTrRKVcn5OLDkTHvHs+TLcUnEMvFLH6s7035sHve/jCiinBeWeVhOh6PGWBZt5YoF5uaLEnAbK+su7BkXZaJ627F9l6nTsDdjQhv3M+Gv628ejS7r+EawpXH9O+LkJwIwIQ7qMbiesDPLBiNV3DR3QIo+JyhzilpoSbekQ/nVkUIe2nI6RG+rTvcKT6ktO+Scg6hzfsJbh7xg2va6+ZWvxXK3Ev3FAry5WmhNHZAANjTLqeX9tH1e3T9YLJy9pkc88W2BFtHOH8jMujc+258n9wGUSzFsB X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7da638c5-3afb-45e3-afa9-08d8f3c252cb X-MS-Exchange-CrossTenant-AuthSource: MN2PR10MB3533.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Mar 2021 21:25:21.2949 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: UMtv2ipe9iQvNd+S+Xyb+Y871Mv31zjx9rNU0fsHaU/6G5dAOTHGJNCcR4LSSm4tOJhJos/LeEE6Ai/2DTW7T4KrijdFjCSBOcp/EQthmzg= X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR10MB3120 X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=9939 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxlogscore=999 mlxscore=0 adultscore=0 spamscore=0 malwarescore=0 phishscore=0 suspectscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2103300000 definitions=main-2103300156 X-Proofpoint-ORIG-GUID: 60D6oIWZKJa9H0rka--lxzY85z_1zNud X-Proofpoint-GUID: 60D6oIWZKJa9H0rka--lxzY85z_1zNud X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=9939 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 clxscore=1015 adultscore=0 impostorscore=0 bulkscore=0 spamscore=0 lowpriorityscore=0 mlxlogscore=999 priorityscore=1501 phishscore=0 malwarescore=0 mlxscore=0 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2103300000 definitions=main-2103300156 X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 0CFE1E0001B4 X-Stat-Signature: xfo4ta8b65i6a68i85n3tbdgnhg5azpr Received-SPF: none (oracle.com>: No applicable sender policy available) receiver=imf05; identity=mailfrom; envelope-from=""; helo=aserp2130.oracle.com; client-ip=141.146.126.79 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1617139558-174631 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Support preserving a transparent hugepage by recording the page order and a flag indicating it is a THP. Use these values when the page is restored to reconstruct the THP. Signed-off-by: Anthony Yznaga --- mm/pkram.c | 20 ++++++++++++++++---- 1 file changed, 16 insertions(+), 4 deletions(-) diff --git a/mm/pkram.c b/mm/pkram.c index 9c42db66d022..da44a6060c5f 100644 --- a/mm/pkram.c +++ b/mm/pkram.c @@ -21,6 +21,9 @@ #define PKRAM_ENTRY_FLAGS_SHIFT 0x5 #define PKRAM_ENTRY_FLAGS_MASK 0x7f +#define PKRAM_ENTRY_ORDER_MASK 0x1f + +#define PKRAM_PAGE_TRANS_HUGE 0x1 /* page is a transparent hugepage */ /* * Keeps references to data pages saved to PKRAM. @@ -211,7 +214,11 @@ static void pkram_add_link_entry(struct pkram_data_stream *pds, struct page *pag pkram_entry_t p; short flags = 0; + if (PageTransHuge(page)) + flags |= PKRAM_PAGE_TRANS_HUGE; + p = page_to_phys(page); + p |= compound_order(page); p |= ((flags & PKRAM_ENTRY_FLAGS_MASK) << PKRAM_ENTRY_FLAGS_SHIFT); link->entry[pds->entry_idx] = p; pds->entry_idx++; @@ -516,7 +523,7 @@ static int __pkram_save_page(struct pkram_access *pa, struct page *page, pkram_add_link_entry(pds, page); - pa->pages.next_index++; + pa->pages.next_index += compound_nr(page); return 0; } @@ -542,19 +549,24 @@ int pkram_save_file_page(struct pkram_access *pa, struct page *page) BUG_ON((node->flags & PKRAM_ACCMODE_MASK) != PKRAM_SAVE); - BUG_ON(PageCompound(page)); - return __pkram_save_page(pa, page, page->index); } static struct page *__pkram_prep_load_page(pkram_entry_t p) { struct page *page; + int order; short flags; flags = (p >> PKRAM_ENTRY_FLAGS_SHIFT) & PKRAM_ENTRY_FLAGS_MASK; page = pfn_to_page(PHYS_PFN(p)); + if (flags & PKRAM_PAGE_TRANS_HUGE) { + order = p & PKRAM_ENTRY_ORDER_MASK; + prep_compound_page(page, order); + prep_transhuge_page(page); + } + return page; } @@ -588,7 +600,7 @@ static struct page *__pkram_load_page(struct pkram_access *pa, unsigned long *in if (index) { *index = pa->pages.next_index; - pa->pages.next_index++; + pa->pages.next_index += compound_nr(page); } /* clear to avoid double free (see pkram_truncate_link()) */