From patchwork Tue Sep 1 00:06:30 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Minchan Kim X-Patchwork-Id: 11747127 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 2B9C61667 for ; Tue, 1 Sep 2020 00:07:50 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id C989E21707 for ; Tue, 1 Sep 2020 00:07:49 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="VBhEdOAw" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C989E21707 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id DA5B26B0003; Mon, 31 Aug 2020 20:07:48 -0400 (EDT) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id D57296B0037; Mon, 31 Aug 2020 20:07:48 -0400 (EDT) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C469E6B0055; Mon, 31 Aug 2020 20:07:48 -0400 (EDT) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0038.hostedemail.com [216.40.44.38]) by kanga.kvack.org (Postfix) with ESMTP id 9AE516B0003 for ; Mon, 31 Aug 2020 20:07:48 -0400 (EDT) Received: from smtpin18.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 62F9B3638 for ; Tue, 1 Sep 2020 00:07:48 +0000 (UTC) X-FDA: 77212554216.18.doll55_060ac5127093 Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin18.hostedemail.com (Postfix) with ESMTP id 33A3A100ED0FD for ; Tue, 1 Sep 2020 00:07:48 +0000 (UTC) X-Spam-Summary: 1,0,0,711519a1b9dd352d,d41d8cd98f00b204,minchan.kim@gmail.com,,RULES_HIT:41:355:379:541:800:967:968:973:982:988:989:1260:1263:1311:1314:1345:1437:1515:1535:1544:1605:1711:1730:1747:1777:1792:1801:1981:2194:2198:2199:2200:2393:2525:2559:2568:2631:2682:2685:2693:2859:2892:2911:2915:2933:2937:2939:2942:2945:2947:2951:2954:3022:3138:3139:3140:3141:3142:3865:3866:3867:3868:3870:3871:3872:3873:3874:3934:3936:3938:3941:3944:3947:3950:3953:3956:3959:4119:4250:4321:4425:4605:5007:6119:6261:6653:6742:6743:7875:7903:8599:8957:8985:9025:10004:10913:11026:11657:11658:11914:12043:12050:12296:12297:12438:12517:12519:12555:12679:12740:12783:12895:12986:13053:13141:13206:13229:13230:13846:13894:14096:14181:14394:14721:14849:21080:21433:21444:21451:21611:21627:21740:21749:21796:21809:21811:30003:30034:30036:30054:30069:30070:30075,0,RBL:209.85.210.193:@gmail.com:.lbl8.mailshell.net-62.50.0.100 66.100.201.100;04yf7izppzayijxm18ncuwk1a3xgjoptuasd3r68jyicu71iqrgjni5x3ktggpm.q4ruiw derh54jm X-HE-Tag: doll55_060ac5127093 X-Filterd-Recvd-Size: 8497 Received: from mail-pf1-f193.google.com (mail-pf1-f193.google.com [209.85.210.193]) by imf26.hostedemail.com (Postfix) with ESMTP for ; Tue, 1 Sep 2020 00:07:47 +0000 (UTC) Received: by mail-pf1-f193.google.com with SMTP id t9so1624121pfq.8 for ; Mon, 31 Aug 2020 17:07:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=Qhlsr+suuDkN/ZVkq37k+a1bP/C6TH/jBPPik3MNM3E=; b=VBhEdOAw9J6tfskz+U2eNtrKbJi9CZSc9QFc49BdI8wskdNqDi3UDJc7R2gQkJGA2k ZXVCADlVT2TJgZ1mxBun3T0kTRN03VOgEyK4RBqFS7TmdU/TUfFxKtHslManRVHqJEjQ ADI3FUK+jFBYtHyOVD//c5KVHMgqy5ZdfDwT2rnTwqjFgUD6Fzzv1RY7m24RIxh/QM0X FrjsdzDX7No/55e5OXCdOCBe8Gh0Dfqo/zgePKKEk9S1rn0lmrGCuQrpQTKvx6PUN0s3 me9PTx/goe1rFzqvjXcfEKJdKJCZ8yHmcxzWQCV48Wv+Sjt3FeA5p61D90tmorZC/S4v eYyQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:date:message-id :mime-version:content-transfer-encoding; bh=Qhlsr+suuDkN/ZVkq37k+a1bP/C6TH/jBPPik3MNM3E=; b=ez+mWt7P+H9gAxPUtdt494fkijIocvFybyYb6K8Y6Iir0kY0Hyt6fL2/7qJZy3Ao5N xlNAmzLJZXnmjEvxsbBfvk/3bQc6tkJYfx4gfeDN38mn2/3R1sfahjzl2fRT+RGBri2R OBsR1YNbZTCBmsbUXpwH1y3BsYOs6e9iTVQ0YSYH0wwylYVGCHFzepbMQcm/vmaErZHv by9Z26Oh26oQgGR92b5pBQhv6biNmVh6w/jwYAbmvWEeK1RLn2yxn5tiv/cxfEolOol1 MGhcoR/urpMGqHVAH9Gawx0cvYZoTnaoUtENKOVBhPwd4l9le8Ek0S9Jl6qtd35uPrzm ndCQ== X-Gm-Message-State: AOAM53369dIkY4jCVX0yCIaz/zHz1A/eLjeMv7CiFX4bQT3Ibhx6aPG0 BkDTwbihO6pxUj06a4S9T00= X-Google-Smtp-Source: ABdhPJwTkw89fLl8yoCut62uET3njozAyscjbC1KEVyOrdhZDCNO99/4q/7r9iDjxjBzWeu/IF2zvA== X-Received: by 2002:aa7:9910:: with SMTP id z16mr3322533pff.120.1598918866562; Mon, 31 Aug 2020 17:07:46 -0700 (PDT) Received: from bbox-1.mtv.corp.google.com ([2620:15c:211:1:7220:84ff:fe09:5e58]) by smtp.gmail.com with ESMTPSA id k5sm769777pjq.5.2020.08.31.17.07.44 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 31 Aug 2020 17:07:45 -0700 (PDT) From: Minchan Kim To: Andrew Morton Cc: LKML , Christian Brauner , linux-mm , linux-api@vger.kernel.org, oleksandr@redhat.com, Suren Baghdasaryan , Tim Murray , Sandeep Patil , Sonny Rao , Brian Geffon , Michal Hocko , Johannes Weiner , Shakeel Butt , John Dias , Joel Fernandes , Jann Horn , alexander.h.duyck@linux.intel.com, sj38.park@gmail.com, David Rientjes , Arjun Roy , Linus Torvalds , Minchan Kim Subject: [PATCH v9 0/3] introduce memory hinting API for external process Date: Mon, 31 Aug 2020 17:06:30 -0700 Message-Id: <20200901000633.1920247-1-minchan@kernel.org> X-Mailer: git-send-email 2.28.0.402.g5ffc5be6b7-goog MIME-Version: 1.0 X-Rspamd-Queue-Id: 33A3A100ED0FD X-Spamd-Result: default: False [0.00 / 100.00] X-Rspamd-Server: rspam04 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Now, we have MADV_PAGEOUT and MADV_COLD as madvise hinting API. With that, application could give hints to kernel what memory range are preferred to be reclaimed. However, in some platform(e.g., Android), the information required to make the hinting decision is not known to the app. Instead, it is known to a centralized userspace daemon(e.g., ActivityManagerService), and that daemon must be able to initiate reclaim on its own without any app involvement. To solve the concern, this patch introduces new syscall - process_madvise(2). Bascially, it's same with madvise(2) syscall but it has some differences. 1. It needs pidfd of target process to provide the hint 2. It supports only MADV_{COLD|PAGEOUT} at this moment. Other hints in madvise will be opened when there are explicit requests from community to prevent unexpected bugs we couldn't support. 3. Only privileged processes can do something for other process's address space. For more detail of the new API, please see "mm: introduce external memory hinting API" description in this patchset. * from v8 - https://lore.kernel.org/linux-api/20200622192900.22757-1-minchan@kernel.org/ * drop passing task_struct to do_madvise - Linus * remove compat syscall entry - Christian * drop mmget_still_valid since we don't need any longer * https://patchwork.kernel.org/patch/11740595/ * from v7 - http://lore.kernel.org/r/20200302193630.68771-1-minchan@kernel.org * dropping pid support from new syscall and fold releated patches into syscall patch * dropping KSM patch by discussion - Oleksandr, I lost the discussion. Please resend the single patch against of the patchset if you resolves the discussion. https://lore.kernel.org/linux-api/20200302193630.68771-8-minchan@kernel.org/ * from v6 - https://lore.kernel.org/linux-api/20200219014433.88424-1-minchan@kernel.org/ * fix comments and descriptions - Suren * Add Reviewed-by - Suren * fix build break reported by 0-day * from v5 - https://lore.kernel.org/linux-mm/20200214170520.160271-1-minchan@kernel.org/ * use null task and requestor's mm for io_madvise - Jann and Jens * use right commit description for moving pidfd_get_pid - Christian * from v4 - https://lore.kernel.org/linux-mm/20200212233946.246210-1-minchan@kernel.org/ * pass mm down to functions, not accessing task->mm - Jann * clean up - Alexander * add Reviewed-by - Alexander, SeongJae * patch reordering * from v3 - https://lore.kernel.org/linux-mm/20200128001641.5086-1-minchan@kernel.org/ * verify task->mm aftere access_mm - Oleg * split some patches for easy review - Alexander * clean up fatal signal checking - Suren * from v2 - https://lore.kernel.org/linux-mm/20200116235953.163318-1-minchan@kernel.org/ * check signal callee and caller to bail out - Kirill Tkhai * put more clarification for justification of new API * from v1 - https://lore.kernel.org/linux-mm/20200110213433.94739-1-minchan@kernel.org/ * fix syscall number - SeongJae * use get_pid_task - Kirill Tkhai * extend API to support pid as well as pidfd - Kirill Tkhai This patchset is against on v5.9-rc2-mmots-2020-08-30-18-40. Minchan Kim (3): mm/madvise: pass mm to do_madvise pid: move pidfd_get_pid() to pid.c mm/madvise: introduce process_madvise() syscall: an external memory hinting API arch/alpha/kernel/syscalls/syscall.tbl | 1 + arch/arm/tools/syscall.tbl | 1 + arch/arm64/include/asm/unistd.h | 2 +- arch/arm64/include/asm/unistd32.h | 2 + arch/ia64/kernel/syscalls/syscall.tbl | 1 + arch/m68k/kernel/syscalls/syscall.tbl | 1 + arch/microblaze/kernel/syscalls/syscall.tbl | 1 + arch/mips/kernel/syscalls/syscall_n32.tbl | 1 + arch/mips/kernel/syscalls/syscall_o32.tbl | 1 + arch/parisc/kernel/syscalls/syscall.tbl | 1 + arch/powerpc/kernel/syscalls/syscall.tbl | 1 + arch/s390/kernel/syscalls/syscall.tbl | 1 + arch/sh/kernel/syscalls/syscall.tbl | 1 + arch/sparc/kernel/syscalls/syscall.tbl | 1 + arch/x86/entry/syscalls/syscall_32.tbl | 1 + arch/x86/entry/syscalls/syscall_64.tbl | 1 + arch/xtensa/kernel/syscalls/syscall.tbl | 1 + fs/io_uring.c | 2 +- include/linux/mm.h | 2 +- include/linux/pid.h | 1 + include/linux/syscalls.h | 2 + include/uapi/asm-generic/unistd.h | 4 +- kernel/exit.c | 17 --- kernel/pid.c | 17 +++ kernel/sys_ni.c | 1 + mm/madvise.c | 141 ++++++++++++++++++-- 26 files changed, 171 insertions(+), 35 deletions(-)