From patchwork Fri Jun 15 07:29:48 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Naoya Horiguchi X-Patchwork-Id: 10465831 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id CFFD760384 for ; Fri, 15 Jun 2018 07:32:35 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id BDD3D28CFE for ; Fri, 15 Jun 2018 07:32:35 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id B099428D08; Fri, 15 Jun 2018 07:32:35 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00, MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 0508528CFE for ; Fri, 15 Jun 2018 07:32:35 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 1A4A46B0006; Fri, 15 Jun 2018 03:32:34 -0400 (EDT) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id 12BCA6B000A; Fri, 15 Jun 2018 03:32:34 -0400 (EDT) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EE7AA6B000C; Fri, 15 Jun 2018 03:32:33 -0400 (EDT) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-io0-f198.google.com (mail-io0-f198.google.com [209.85.223.198]) by kanga.kvack.org (Postfix) with ESMTP id BB92F6B0006 for ; Fri, 15 Jun 2018 03:32:33 -0400 (EDT) Received: by mail-io0-f198.google.com with SMTP id x23-v6so6706465iob.1 for ; Fri, 15 Jun 2018 00:32:33 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-original-authentication-results:x-gm-message-state:from:to:cc :subject:thread-topic:thread-index:date:message-id:references :in-reply-to:accept-language:content-language:content-id :content-transfer-encoding:mime-version; bh=E88ymBwvnhC0IpgX9kctsST4TUYELUeMfGYK9UWXnwQ=; b=JhYEmQnW1YH/UcPsqIIwKSicIr2vPELdVLz9XwDbYAZhf1ftuhO17CsyUbgSLjFlGA QWINKirzSv+QNvx0/MV2uED84LB3W4sxGUVP7IWMSW9cPBPLedxw4P5SJPIltCCv1Lnw AgAyR1BWU2WLmBMYV6KZ6T3qaYYHlepUuH7mGbFPBjKDZdYCRNxyiwTLI7GytUn89J5J 6jewC6GCEHCNQr/MuBNsj1HXtL1XznPJJiNlo/82gaBVx9ZlBeRasfDxahGGgMW7fpL/ WkR64FJNXvbF6W6cpjZ5aD4KElXl4BPED7Gfmmqu7o39xtknRVwMZ3I80Z/fcySHWiq6 32sA== X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: domain of n-horiguchi@ah.jp.nec.com designates 114.179.232.162 as permitted sender) smtp.mailfrom=n-horiguchi@ah.jp.nec.com X-Gm-Message-State: APt69E2XtA0LxlgyXg4wVNY4fWDQ73FuyCrvP8IAq3FDSxHSHv526O3t EUzzGNcHGgq4jOiXFjDvlAP597eX/hAVrMQ/i/8t0I3njqtbPFQphS8a94fXu/wwubgJRImTeKz qsGI1mpd0MEzVarsoxfLXrKK4tx0nRvUIyta2H1OmmtikNk74C2+j5Xu0ut4LV5wsGw== X-Received: by 2002:a24:6f8f:: with SMTP id x137-v6mr277573itb.121.1529047953453; Fri, 15 Jun 2018 00:32:33 -0700 (PDT) X-Google-Smtp-Source: ADUXVKLxQOHXRlsjTjc1fHU6i9p9nR6HQTzjyRa9KTnE2o+BpNNoo++gpDSs7DyudMLGI4NyT9Pl X-Received: by 2002:a24:6f8f:: with SMTP id x137-v6mr277538itb.121.1529047952667; Fri, 15 Jun 2018 00:32:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529047952; cv=none; d=google.com; s=arc-20160816; b=i5lU2VUPHubk1SvpBrEgVBD8rw6QLnlwICkApoCZmhMsT1SDj/9JJdll4UO7gtPlf7 Oj3s/tZmtiGPyGrEWy7NcrGTy9cTkhS2mz+X8QQc3RxfhsN7S/l5WVvglpbodaoUpzu7 5muMs/GxhF/HnGi6XR/XPWTNogEGk08StKkD10XiFCn0b13+f9c1woD/8T9B/asaMvXX 7YGZQoCTrOSIxC/XMxdx8P8thAiV9ppCwU+mE4KyJdAEH1JDO0VAzwTC8WXWVHZrf5q3 C4dKSXSoLkH3Io+Qdu8V5YIgK0EE97EIPuXuoNiluQEyXc/CB+Pt4fRCQ4LQ+4cL1F1b tb3g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:content-id:content-language :accept-language:in-reply-to:references:message-id:date:thread-index :thread-topic:subject:cc:to:from:arc-authentication-results; bh=E88ymBwvnhC0IpgX9kctsST4TUYELUeMfGYK9UWXnwQ=; b=NNUz/A3djNTwStVuMwGJvUlBv3bWsJB0McYbb59kiMnEsIQa0rWnsaOGzmq5n2AXTy tg9IDLsfMPgWMcYD80X0JSe9RgOhVcYoNA//kdzB+48xf7Ff74bTI+KYG6/d7XVFmDPr QYyNHf2x4ZYBSYYSHzF4KnOQxCsUpCgy3m1cY0lgNeN1F+Ac8yXlF1gsQsvUrDgl0DQK hfBIdKKk5V+PolCWV7Zza/954tFVQsfjejCDYa5v8IuF63khXrK8PzVZ/tEzvmYZBx7C dTbD/zbc6vmJAkUMl0tIwFst4TsQbGOwvgv/rxVu7pz433I9Rzk4CA8heeyU80CoJ3nb deRg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of n-horiguchi@ah.jp.nec.com designates 114.179.232.162 as permitted sender) smtp.mailfrom=n-horiguchi@ah.jp.nec.com Received: from tyo162.gate.nec.co.jp (tyo162.gate.nec.co.jp. [114.179.232.162]) by mx.google.com with ESMTPS id c13-v6si971507itd.112.2018.06.15.00.32.32 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 15 Jun 2018 00:32:32 -0700 (PDT) Received-SPF: pass (google.com: domain of n-horiguchi@ah.jp.nec.com designates 114.179.232.162 as permitted sender) client-ip=114.179.232.162; Authentication-Results: mx.google.com; spf=pass (google.com: domain of n-horiguchi@ah.jp.nec.com designates 114.179.232.162 as permitted sender) smtp.mailfrom=n-horiguchi@ah.jp.nec.com Received: from mailgate01.nec.co.jp ([114.179.233.122]) by tyo162.gate.nec.co.jp (8.15.1/8.15.1) with ESMTPS id w5F7W0OU011451 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 15 Jun 2018 16:32:00 +0900 Received: from mailsv02.nec.co.jp (mailgate-v.nec.co.jp [10.204.236.94]) by mailgate01.nec.co.jp (8.15.1/8.15.1) with ESMTP id w5F7W0wm030499; Fri, 15 Jun 2018 16:32:00 +0900 Received: from mail03.kamome.nec.co.jp (mail03.kamome.nec.co.jp [10.25.43.7]) by mailsv02.nec.co.jp (8.15.1/8.15.1) with ESMTP id w5F7W05u003979; Fri, 15 Jun 2018 16:32:00 +0900 Received: from bpxc99gp.gisp.nec.co.jp ([10.38.151.151] [10.38.151.151]) by mail01b.kamome.nec.co.jp with ESMTP id BT-MMP-1200420; Fri, 15 Jun 2018 16:29:49 +0900 Received: from BPXM23GP.gisp.nec.co.jp ([10.38.151.215]) by BPXC23GP.gisp.nec.co.jp ([10.38.151.151]) with mapi id 14.03.0319.002; Fri, 15 Jun 2018 16:29:49 +0900 From: Naoya Horiguchi To: "linux-mm@kvack.org" CC: Michal Hocko , Oscar Salvador , Oscar Salvador , "Pavel Tatashin" , Steven Sistare , Daniel Jordan , Matthew Wilcox , "linux-kernel@vger.kernel.org" , Andrew Morton , "mingo@kernel.org" , "dan.j.williams@intel.com" , Huang Ying Subject: [PATCH v3] x86/e820: put !E820_TYPE_RAM regions into memblock.reserved Thread-Topic: [PATCH v3] x86/e820: put !E820_TYPE_RAM regions into memblock.reserved Thread-Index: AQHUBHqk2ayFHAouJUSDPhJEYCKcCw== Date: Fri, 15 Jun 2018 07:29:48 +0000 Message-ID: <20180615072947.GB23273@hori1.linux.bs1.fc.nec.co.jp> References: <20180607065940.GA7334@techadventures.net> <20180607094921.GA8545@techadventures.net> <20180607100256.GA9129@hori1.linux.bs1.fc.nec.co.jp> <20180613054107.GA5329@hori1.linux.bs1.fc.nec.co.jp> <20180613090700.GG13364@dhcp22.suse.cz> <20180614051618.GB17860@hori1.linux.bs1.fc.nec.co.jp> <20180614053859.GA9863@techadventures.net> <20180614063454.GA32419@hori1.linux.bs1.fc.nec.co.jp> <20180614213033.GA19374@techadventures.net> <20180615010927.GC1196@hori1.linux.bs1.fc.nec.co.jp> In-Reply-To: <20180615010927.GC1196@hori1.linux.bs1.fc.nec.co.jp> Accept-Language: en-US, ja-JP Content-Language: ja-JP X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.51.8.81] Content-ID: <438DE963F8C23244B9AADE194DC1EADF@gisp.nec.co.jp> MIME-Version: 1.0 X-TM-AS-MML: disable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP Hi, I updated the patch, so let me share it. # I'll be offline early in the next week, maybe come back on Wednesday. # Have a nice weekend. Thanks, Naoya Horiguchi Acked-by: Michal Hocko Reviewed-by: Pavel Tatashin --- From: Naoya Horiguchi Date: Thu, 14 Jun 2018 16:04:36 +0900 Subject: [PATCH] x86/e820: put !E820_TYPE_RAM regions into memblock.reserved There is a kernel panic that is triggered when reading /proc/kpageflags on the kernel booted with kernel parameter 'memmap=nn[KMG]!ss[KMG]': BUG: unable to handle kernel paging request at fffffffffffffffe PGD 9b20e067 P4D 9b20e067 PUD 9b210067 PMD 0 Oops: 0000 [#1] SMP PTI CPU: 2 PID: 1728 Comm: page-types Not tainted 4.17.0-rc6-mm1-v4.17-rc6-180605-0816-00236-g2dfb086ef02c+ #160 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.11.0-2.fc28 04/01/2014 RIP: 0010:stable_page_flags+0x27/0x3c0 Code: 00 00 00 0f 1f 44 00 00 48 85 ff 0f 84 a0 03 00 00 41 54 55 49 89 fc 53 48 8b 57 08 48 8b 2f 48 8d 42 ff 83 e2 01 48 0f 44 c7 <48> 8b 00 f6 c4 01 0f 84 10 03 00 00 31 db 49 8b 54 24 08 4c 89 e7 RSP: 0018:ffffbbd44111fde0 EFLAGS: 00010202 RAX: fffffffffffffffe RBX: 00007fffffffeff9 RCX: 0000000000000000 RDX: 0000000000000001 RSI: 0000000000000202 RDI: ffffed1182fff5c0 RBP: ffffffffffffffff R08: 0000000000000001 R09: 0000000000000001 R10: ffffbbd44111fed8 R11: 0000000000000000 R12: ffffed1182fff5c0 R13: 00000000000bffd7 R14: 0000000002fff5c0 R15: ffffbbd44111ff10 FS: 00007efc4335a500(0000) GS:ffff93a5bfc00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: fffffffffffffffe CR3: 00000000b2a58000 CR4: 00000000001406e0 Call Trace: kpageflags_read+0xc7/0x120 proc_reg_read+0x3c/0x60 __vfs_read+0x36/0x170 vfs_read+0x89/0x130 ksys_pread64+0x71/0x90 do_syscall_64+0x5b/0x160 entry_SYSCALL_64_after_hwframe+0x44/0xa9 RIP: 0033:0x7efc42e75e23 Code: 09 00 ba 9f 01 00 00 e8 ab 81 f4 ff 66 2e 0f 1f 84 00 00 00 00 00 90 83 3d 29 0a 2d 00 00 75 13 49 89 ca b8 11 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 34 c3 48 83 ec 08 e8 db d3 01 00 48 89 04 24 According to kernel bisection, this problem became visible due to commit f7f99100d8d9 which changes how struct pages are initialized. Memblock layout affects the pfn ranges covered by node/zone. Consider that we have a VM with 2 NUMA nodes and each node has 4GB memory, and the default (no memmap= given) memblock layout is like below: MEMBLOCK configuration: memory size = 0x00000001fff75c00 reserved size = 0x000000000300c000 memory.cnt = 0x4 memory[0x0] [0x0000000000001000-0x000000000009efff], 0x000000000009e000 bytes on node 0 flags: 0x0 memory[0x1] [0x0000000000100000-0x00000000bffd6fff], 0x00000000bfed7000 bytes on node 0 flags: 0x0 memory[0x2] [0x0000000100000000-0x000000013fffffff], 0x0000000040000000 bytes on node 0 flags: 0x0 memory[0x3] [0x0000000140000000-0x000000023fffffff], 0x0000000100000000 bytes on node 1 flags: 0x0 ... If you give memmap=1G!4G (so it just covers memory[0x2]), the range [0x100000000-0x13fffffff] is gone: MEMBLOCK configuration: memory size = 0x00000001bff75c00 reserved size = 0x000000000300c000 memory.cnt = 0x3 memory[0x0] [0x0000000000001000-0x000000000009efff], 0x000000000009e000 bytes on node 0 flags: 0x0 memory[0x1] [0x0000000000100000-0x00000000bffd6fff], 0x00000000bfed7000 bytes on node 0 flags: 0x0 memory[0x2] [0x0000000140000000-0x000000023fffffff], 0x0000000100000000 bytes on node 1 flags: 0x0 ... This causes shrinking node 0's pfn range because it is calculated by the address range of memblock.memory. So some of struct pages in the gap range are left uninitialized. We have a function zero_resv_unavail() which does zeroing the struct pages within the reserved unavailable range (i.e. memblock.memory && !memblock.reserved). This patch utilizes it to cover all unavailable ranges by putting them into memblock.reserved. Fixes: f7f99100d8d9 ("mm: stop zeroing memory during allocation in vmemmap") Signed-off-by: Naoya Horiguchi Tested-by: Oscar Salvador --- arch/x86/kernel/e820.c | 15 ++++++++++++--- 1 file changed, 12 insertions(+), 3 deletions(-) diff --git a/arch/x86/kernel/e820.c b/arch/x86/kernel/e820.c index d1f25c831447..c88c23c658c1 100644 --- a/arch/x86/kernel/e820.c +++ b/arch/x86/kernel/e820.c @@ -1248,6 +1248,7 @@ void __init e820__memblock_setup(void) { int i; u64 end; + u64 addr = 0; /* * The bootstrap memblock region count maximum is 128 entries @@ -1264,13 +1265,21 @@ void __init e820__memblock_setup(void) struct e820_entry *entry = &e820_table->entries[i]; end = entry->addr + entry->size; + if (addr < entry->addr) + memblock_reserve(addr, entry->addr - addr); + addr = end; if (end != (resource_size_t)end) continue; + /* + * all !E820_TYPE_RAM ranges (including gap ranges) are put + * into memblock.reserved to make sure that struct pages in + * such regions are not left uninitialized after bootup. + */ if (entry->type != E820_TYPE_RAM && entry->type != E820_TYPE_RESERVED_KERN) - continue; - - memblock_add(entry->addr, entry->size); + memblock_reserve(entry->addr, entry->size); + else + memblock_add(entry->addr, entry->size); } /* Throw away partial pages: */