From patchwork Wed Jun 19 15:43:46 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ilya Leoshkevich X-Patchwork-Id: 13704126 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4B0D9C2BA15 for ; Wed, 19 Jun 2024 15:45:56 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E33956B00A1; Wed, 19 Jun 2024 11:45:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DE3776B02C9; Wed, 19 Jun 2024 11:45:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BE74F6B02C7; Wed, 19 Jun 2024 11:45:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 94EA66B00A0 for ; Wed, 19 Jun 2024 11:45:54 -0400 (EDT) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 180DB1A07D7 for ; Wed, 19 Jun 2024 15:45:54 +0000 (UTC) X-FDA: 82248063828.03.7B2BB38 Received: from mx0b-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by imf02.hostedemail.com (Postfix) with ESMTP id D75008000A for ; Wed, 19 Jun 2024 15:45:51 +0000 (UTC) Authentication-Results: imf02.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=MM7V8Kud; spf=pass (imf02.hostedemail.com: domain of iii@linux.ibm.com designates 148.163.158.5 as permitted sender) smtp.mailfrom=iii@linux.ibm.com; dmarc=pass (policy=none) header.from=ibm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1718811947; a=rsa-sha256; cv=none; b=BBGkaYicwleeNPaCoqVaHHqJlvdPYeom2j5HHzjIlQNLLZk+nBYplkKFQ4dx5sJhmwZRZw sOR7RVMzFCgBBQddBYzESrIqSanXWXIWEpqzeAEOG+CZ24qUJQfEou0r8dDFJyxI98mXAU IOC5Hl3OaP7A3EWw8Fhy4XdWSwV2c6M= ARC-Authentication-Results: i=1; imf02.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=MM7V8Kud; spf=pass (imf02.hostedemail.com: domain of iii@linux.ibm.com designates 148.163.158.5 as permitted sender) smtp.mailfrom=iii@linux.ibm.com; dmarc=pass (policy=none) header.from=ibm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1718811947; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=VXS/CROs6yE7UNWuiQuFKJi6Qw5yeAHe/FeukS5ug+8=; b=iYBkXtFISOesTfRN2W+YCDLXvNnkCqabXlwptFfMy/2T2HnAouL1Wv2XgQXFkCHtI2tIWF RXlHPaoJdD7etJYs9brdLDVAbHLcJOOjgFu0CJ+VJeaDf9rzH6bc56vUCDdeZgVJUpfORP qF32c88Y2vzhsNlB6Eynrb2EFzJkKVk= Received: from pps.filterd (m0353724.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 45JETKsZ000677; Wed, 19 Jun 2024 15:45:45 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from :to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; s=pp1; bh=VXS/CROs6yE7U NWuiQuFKJi6Qw5yeAHe/FeukS5ug+8=; b=MM7V8KudXTL02R4wGd0IoGTYtbgGC NV/w0YQggSOMBdnmMh0BBwlUNCQPx9FVo1JmbSa8Sh612PZZhG2fSPXp1L2RuOqX gnjYEFDQQgl8u3ZpL3H98XbYdY7IcchfbtU0lcy7Jb3C6GADz9qNXa6q9fjWo1LC 1jkndlXWGR+hmZ6USo2W8ix6EOgXtreJ2A4P4JNmrlaNGY2gpGiAyAue6HMulLCI zRw5FEQ5sIBBHLj2JgqtcCczZ/QCofk1Tcuzb32nZVdL+vyooutlMbE7eWiLVcCd GYn0c6+WeJJkR+GvMKgrBcPEhLYR3EbkZZDnTagxb8SFDakNhI6yYPFvg== Received: from pps.reinject (localhost [127.0.0.1]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3yv14tg8bq-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 19 Jun 2024 15:45:45 +0000 (GMT) Received: from m0353724.ppops.net (m0353724.ppops.net [127.0.0.1]) by pps.reinject (8.18.0.8/8.18.0.8) with ESMTP id 45JFjiXA027307; Wed, 19 Jun 2024 15:45:44 GMT Received: from ppma13.dal12v.mail.ibm.com (dd.9e.1632.ip4.static.sl-reverse.com [50.22.158.221]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3yv14tg8bg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 19 Jun 2024 15:45:44 +0000 (GMT) Received: from pps.filterd (ppma13.dal12v.mail.ibm.com [127.0.0.1]) by ppma13.dal12v.mail.ibm.com (8.17.1.19/8.17.1.19) with ESMTP id 45JEdTxx009433; Wed, 19 Jun 2024 15:45:43 GMT Received: from smtprelay04.fra02v.mail.ibm.com ([9.218.2.228]) by ppma13.dal12v.mail.ibm.com (PPS) with ESMTPS id 3ysqgmwmmk-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 19 Jun 2024 15:45:43 +0000 Received: from smtpav06.fra02v.mail.ibm.com (smtpav06.fra02v.mail.ibm.com [10.20.54.105]) by smtprelay04.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 45JFjbaP14025152 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 19 Jun 2024 15:45:39 GMT Received: from smtpav06.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id B37F02004B; Wed, 19 Jun 2024 15:45:37 +0000 (GMT) Received: from smtpav06.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 5919F20049; Wed, 19 Jun 2024 15:45:37 +0000 (GMT) Received: from black.boeblingen.de.ibm.com (unknown [9.155.200.166]) by smtpav06.fra02v.mail.ibm.com (Postfix) with ESMTP; Wed, 19 Jun 2024 15:45:37 +0000 (GMT) From: Ilya Leoshkevich To: Alexander Gordeev , Alexander Potapenko , Andrew Morton , Christoph Lameter , David Rientjes , Heiko Carstens , Joonsoo Kim , Marco Elver , Masami Hiramatsu , Pekka Enberg , Steven Rostedt , Vasily Gorbik , Vlastimil Babka Cc: Christian Borntraeger , Dmitry Vyukov , Hyeonggon Yoo <42.hyeyoo@gmail.com>, kasan-dev@googlegroups.com, linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-s390@vger.kernel.org, linux-trace-kernel@vger.kernel.org, Mark Rutland , Roman Gushchin , Sven Schnelle , Ilya Leoshkevich Subject: [PATCH v5 11/37] kmsan: Allow disabling KMSAN checks for the current task Date: Wed, 19 Jun 2024 17:43:46 +0200 Message-ID: <20240619154530.163232-12-iii@linux.ibm.com> X-Mailer: git-send-email 2.45.1 In-Reply-To: <20240619154530.163232-1-iii@linux.ibm.com> References: <20240619154530.163232-1-iii@linux.ibm.com> MIME-Version: 1.0 X-TM-AS-GCONF: 00 X-Proofpoint-GUID: RrhlJjxZQYf9pK6OPK865PIXzJkUUgUU X-Proofpoint-ORIG-GUID: rnvyXIBHOyj0RfBbiCienZKnto1dMAcv X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.28.16 definitions=2024-06-19_02,2024-06-19_01,2024-05-17_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 lowpriorityscore=0 malwarescore=0 suspectscore=0 mlxscore=0 clxscore=1015 spamscore=0 mlxlogscore=999 impostorscore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2405170001 definitions=main-2406190115 X-Stat-Signature: wi8wtnyxk8hr8bajy5q1nk4fmxjpfzpg X-Rspamd-Queue-Id: D75008000A X-Rspam-User: X-Rspamd-Server: rspam10 X-HE-Tag: 1718811951-614578 X-HE-Meta: U2FsdGVkX19njUatx+pcs9eQtTq/YErP7Oi9y7d8G+Ket248QpHPADtqfhQxjvmYnTilOgLYCj/iIAqGmyy8zfGqoqcmCc6zy125V/q2kN0d+h1BFVUXYTk7epwROWgYfA+NFe7yj1IzZdLGmJNXAqjOhrmi57v4NJAXvtHKFXF6kGrlNuEyVwB7YRPqwWQbcs2zi/Jii/hWgj/AxX6TzHQ/VMe4JFbH5omObHtmHm19sKARaWVMajIUuKDnJzoj7rUn8lPeS0VKom1TG9zP8Jn5Yk8/lWJJMoRDM7/JOcGBLMRjR4wPBRpnxrioAK8TgYPhAewowc/+LUS7lD/sro/Q33yLA8LpNorYudB95GDAJYeK/zYEXZKF179JJR3+AT1ZLZcOc29ZxfiJiRf/U/cKZDYEPUNh3CjZcBragf58d4UJtf0V36+yDmy7gN1giT1MIsFzkG1LEscq2XoEEoVqr4v/uFe+CUxUbPn1jO+fQVP+6SxYL+WVSptKzstaetkCVSQyJ7OMb9NwznPbfmFe4iu8x5KuXGXFRdbdlVzK77mm6i0dlUASsLxjnxdLDrHXApkZBBlV15AOrsRhElaYNIHLpB5nUBIYRBRXLYqPIe2jbcTuonl3kbMI1pDpE9mx04/QvViwy+QccLyji7b5Re7h9HVUKwFxhLYr0L/fmZVJ+tssrxPIt4QQyMyGqcntlEc1zH3qbLc9AK6TCRSZMkdp40rkySEbKfTel61WDvtfpX6q5L2SLwluWdNpoxcNecI7sA70yc7sitEW95sLWieSwLZy8uXFxFDxhq7UnQHjUkleBTN1L2qU1SwVJTMA6GavkDJlnDfZB98J7ikg0y0gFB6Y5Zli6AWoJr2JdjnCs0bnRKWJC+ZXsUUNxo+zNCqOFa3HEec2XVj2PQex5RnOTjxxUkH6eVXd8VRupkwlLNvS6XB7kB+kJL5/NifzGoXtMt6kbl49bHe YRjzq7gU p4gS3i/GL6p8Bi0NVeeS8Yc7hNw4UeZpfK8dKI0WmRNqTBqVjiXCNQtSX2AGinxa7qNjUfGcJ682cPHp1+bsavWG5t5CEXs6Kt3Z7oSM/0AmTqGqgxlJBPBvPkM5XUWDcKsgJq9J6Td0dz5JrlHUlctqQZ85KRyNYJ175HS5qB7FWV6/NDktKwxCoGN39tua59t8Nhy/tH9H/QPwc7DwErDz6WhcDQTMmO+pzxTSwrH7pXYUGflLgiGe1AqJwJ+De/7hIvnZZWTmyztymY6z3y9pT3B+LncQiBv89G+RAkQo/rBGwdWwNNPfAY52FhkfE2U0DXzL3ZwE8M3dY4XvEVh3bXtRy1/a6Udkv27duW9vgxVw= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Like for KASAN, it's useful to temporarily disable KMSAN checks around, e.g., redzone accesses. Introduce kmsan_disable_current() and kmsan_enable_current(), which are similar to their KASAN counterparts. Make them reentrant in order to handle memory allocations in interrupt context. Repurpose the allow_reporting field for this. Reviewed-by: Alexander Potapenko Signed-off-by: Ilya Leoshkevich --- Documentation/dev-tools/kmsan.rst | 11 +++++++++-- include/linux/kmsan.h | 24 ++++++++++++++++++++++++ include/linux/kmsan_types.h | 2 +- mm/kmsan/core.c | 1 - mm/kmsan/hooks.c | 18 +++++++++++++++--- mm/kmsan/report.c | 7 ++++--- tools/objtool/check.c | 2 ++ 7 files changed, 55 insertions(+), 10 deletions(-) diff --git a/Documentation/dev-tools/kmsan.rst b/Documentation/dev-tools/kmsan.rst index 323eedad53cd..6a48d96c5c85 100644 --- a/Documentation/dev-tools/kmsan.rst +++ b/Documentation/dev-tools/kmsan.rst @@ -110,6 +110,13 @@ in the Makefile. Think of this as applying ``__no_sanitize_memory`` to every function in the file or directory. Most users won't need KMSAN_SANITIZE, unless their code gets broken by KMSAN (e.g. runs at early boot time). +KMSAN checks can also be temporarily disabled for the current task using +``kmsan_disable_current()`` and ``kmsan_enable_current()`` calls. Each +``kmsan_enable_current()`` call must be preceded by a +``kmsan_disable_current()`` call; these call pairs may be nested. One needs to +be careful with these calls, keeping the regions short and preferring other +ways to disable instrumentation, where possible. + Support ======= @@ -338,11 +345,11 @@ Per-task KMSAN state ~~~~~~~~~~~~~~~~~~~~ Every task_struct has an associated KMSAN task state that holds the KMSAN -context (see above) and a per-task flag disallowing KMSAN reports:: +context (see above) and a per-task counter disallowing KMSAN reports:: struct kmsan_context { ... - bool allow_reporting; + unsigned int depth; struct kmsan_context_state cstate; ... } diff --git a/include/linux/kmsan.h b/include/linux/kmsan.h index fe6c2212bdb1..23de1b3d6aee 100644 --- a/include/linux/kmsan.h +++ b/include/linux/kmsan.h @@ -239,6 +239,22 @@ void kmsan_unpoison_entry_regs(const struct pt_regs *regs); */ void *kmsan_get_metadata(void *addr, bool is_origin); +/* + * kmsan_enable_current(): Enable KMSAN for the current task. + * + * Each kmsan_enable_current() current call must be preceded by a + * kmsan_disable_current() call. These call pairs may be nested. + */ +void kmsan_enable_current(void); + +/* + * kmsan_disable_current(): Disable KMSAN for the current task. + * + * Each kmsan_disable_current() current call must be followed by a + * kmsan_enable_current() call. These call pairs may be nested. + */ +void kmsan_disable_current(void); + #else static inline void kmsan_init_shadow(void) @@ -338,6 +354,14 @@ static inline void kmsan_unpoison_entry_regs(const struct pt_regs *regs) { } +static inline void kmsan_enable_current(void) +{ +} + +static inline void kmsan_disable_current(void) +{ +} + #endif #endif /* _LINUX_KMSAN_H */ diff --git a/include/linux/kmsan_types.h b/include/linux/kmsan_types.h index 929287981afe..dfc59918b3c0 100644 --- a/include/linux/kmsan_types.h +++ b/include/linux/kmsan_types.h @@ -31,7 +31,7 @@ struct kmsan_context_state { struct kmsan_ctx { struct kmsan_context_state cstate; int kmsan_in_runtime; - bool allow_reporting; + unsigned int depth; }; #endif /* _LINUX_KMSAN_TYPES_H */ diff --git a/mm/kmsan/core.c b/mm/kmsan/core.c index 95f859e38c53..81b22220711a 100644 --- a/mm/kmsan/core.c +++ b/mm/kmsan/core.c @@ -43,7 +43,6 @@ void kmsan_internal_task_create(struct task_struct *task) struct thread_info *info = current_thread_info(); __memset(ctx, 0, sizeof(*ctx)); - ctx->allow_reporting = true; kmsan_internal_unpoison_memory(info, sizeof(*info), false); } diff --git a/mm/kmsan/hooks.c b/mm/kmsan/hooks.c index b408714f9ba3..267d0afa2e8b 100644 --- a/mm/kmsan/hooks.c +++ b/mm/kmsan/hooks.c @@ -39,12 +39,10 @@ void kmsan_task_create(struct task_struct *task) void kmsan_task_exit(struct task_struct *task) { - struct kmsan_ctx *ctx = &task->kmsan_ctx; - if (!kmsan_enabled || kmsan_in_runtime()) return; - ctx->allow_reporting = false; + kmsan_disable_current(); } void kmsan_slab_alloc(struct kmem_cache *s, void *object, gfp_t flags) @@ -424,3 +422,17 @@ void kmsan_check_memory(const void *addr, size_t size) REASON_ANY); } EXPORT_SYMBOL(kmsan_check_memory); + +void kmsan_enable_current(void) +{ + KMSAN_WARN_ON(current->kmsan_ctx.depth == 0); + current->kmsan_ctx.depth--; +} +EXPORT_SYMBOL(kmsan_enable_current); + +void kmsan_disable_current(void) +{ + current->kmsan_ctx.depth++; + KMSAN_WARN_ON(current->kmsan_ctx.depth == 0); +} +EXPORT_SYMBOL(kmsan_disable_current); diff --git a/mm/kmsan/report.c b/mm/kmsan/report.c index c79d3b0d2d0d..92e73ec61435 100644 --- a/mm/kmsan/report.c +++ b/mm/kmsan/report.c @@ -8,6 +8,7 @@ */ #include +#include #include #include #include @@ -158,12 +159,12 @@ void kmsan_report(depot_stack_handle_t origin, void *address, int size, if (!kmsan_enabled) return; - if (!current->kmsan_ctx.allow_reporting) + if (current->kmsan_ctx.depth) return; if (!origin) return; - current->kmsan_ctx.allow_reporting = false; + kmsan_disable_current(); ua_flags = user_access_save(); raw_spin_lock(&kmsan_report_lock); pr_err("=====================================================\n"); @@ -216,5 +217,5 @@ void kmsan_report(depot_stack_handle_t origin, void *address, int size, if (panic_on_kmsan) panic("kmsan.panic set ...\n"); user_access_restore(ua_flags); - current->kmsan_ctx.allow_reporting = true; + kmsan_enable_current(); } diff --git a/tools/objtool/check.c b/tools/objtool/check.c index 0a33d9195b7a..01237d167223 100644 --- a/tools/objtool/check.c +++ b/tools/objtool/check.c @@ -1202,6 +1202,8 @@ static const char *uaccess_safe_builtin[] = { "__sanitizer_cov_trace_switch", /* KMSAN */ "kmsan_copy_to_user", + "kmsan_disable_current", + "kmsan_enable_current", "kmsan_report", "kmsan_unpoison_entry_regs", "kmsan_unpoison_memory",