From patchwork Mon Mar 8 15:55:13 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Andrey Konovalov X-Patchwork-Id: 12122815 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.6 required=3.0 tests=BAYES_00, DKIM_ADSP_CUSTOM_MED,DKIM_INVALID,DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 79C91C433DB for ; Mon, 8 Mar 2021 15:55:24 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 1332C650DC for ; Mon, 8 Mar 2021 15:55:24 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 1332C650DC Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 870078D0036; Mon, 8 Mar 2021 10:55:23 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 846558D001D; Mon, 8 Mar 2021 10:55:23 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 70E468D0036; Mon, 8 Mar 2021 10:55:23 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0108.hostedemail.com [216.40.44.108]) by kanga.kvack.org (Postfix) with ESMTP id 58D848D001D for ; Mon, 8 Mar 2021 10:55:23 -0500 (EST) Received: from smtpin18.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id 140F3180AD81D for ; Mon, 8 Mar 2021 15:55:23 +0000 (UTC) X-FDA: 77897156526.18.FB71BB7 Received: from mail-qt1-f201.google.com (mail-qt1-f201.google.com [209.85.160.201]) by imf13.hostedemail.com (Postfix) with ESMTP id CCAC2E0011F3 for ; Mon, 8 Mar 2021 15:55:20 +0000 (UTC) Received: by mail-qt1-f201.google.com with SMTP id w33so8246988qte.11 for ; Mon, 08 Mar 2021 07:55:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=sender:date:message-id:mime-version:subject:from:to:cc; bh=FoMoOBBpWzT75wmFJ4xJzRk+FU5MgOdLV7/pA36y50w=; b=gJjqv60KbnOg/rjkTVlwcooSILnYJ3qeJRQgS9DTzcLaQb5lxvLl1m11dOVtbvwUDv IyNBTpOv9RYKxYzlDivy5JN6bnZagUv6vYJdw670cjpVq20vt5lCwFKLdpfhGMfdUo45 u4xs8vMYjYWNyhaPTw8Vvpt9eAscslNnL5twuLXJwVRWHKeBEdNcMzVXMsZSBcGmAfxN zSJytXSh0gYbY4k/oi5SGmevNq7lIDm2ke7+kxf8q8ZYBzCU+Nv0h2hM9SxKJDBM5GRi CmK/me3P/TgWsXjAugxJtgZQbjZaeefObcdBU/5Xa4xOYZui6YqK81n6kXBXsYOs2eJk QgbA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:message-id:mime-version:subject:from :to:cc; bh=FoMoOBBpWzT75wmFJ4xJzRk+FU5MgOdLV7/pA36y50w=; b=gljrHNKLgWqqKIsNmEfgSRqjAL3ZCOD7Fn8DMarSnDFFa5gaZYKEvwP81vswrTjuIK r0qKN+kvQUwFgQmJIwvWoF4sOH9bX/8R8OrTM9dM6uP/FDDJDEr9B6woX2SCvZ1jgNto VxTXOiKC6go8HDoWijrGC21gnl8nkttaQ7Fycdx0FZnw3XT1clEYbzShTvC9dbrhBb9d 04YuV53gTnG6A+XJ1XR8Fw9VpsSpCpFLrV5jPJ+G4O2FMbAUnFsKZtFwLLLRdV1ZGNzm jNgsNnJr6SrqaXbPuR9UrPGZBQgELzNxA68If/BtqthSSZGq2XyWuqtmYhpm4FMvzmwo nRXg== X-Gm-Message-State: AOAM533L6kYxQbV1dvsPRFafUX3LzSto2oCu+QhLWBaIIwe+xvVryc/P kfXeY93PI656SIPKtFg+kHwEeEQIECNEmCyO X-Google-Smtp-Source: ABdhPJxpc8xtWCUHnacmkUYbjfY6hvpOAtCcn6T/A/8xB55wTWfnA/FRfsF9ckMO+6ZAPsDaU0zHb/aq1Bb/PMdk X-Received: from andreyknvl3.muc.corp.google.com ([2a00:79e0:15:13:85fb:aac9:69ed:e574]) (user=andreyknvl job=sendgmr) by 2002:a05:6214:1870:: with SMTP id eh16mr8647655qvb.23.1615218921580; Mon, 08 Mar 2021 07:55:21 -0800 (PST) Date: Mon, 8 Mar 2021 16:55:13 +0100 Message-Id: Mime-Version: 1.0 X-Mailer: git-send-email 2.30.1.766.gb4fecdf3b7-goog Subject: [PATCH v2 0/5] kasan: integrate with init_on_alloc/free From: Andrey Konovalov To: Catalin Marinas , Vincenzo Frascino , Alexander Potapenko , Marco Elver Cc: Andrew Morton , Will Deacon , Dmitry Vyukov , Andrey Ryabinin , Peter Collingbourne , Evgenii Stepanov , Branislav Rankov , Kevin Brodsky , kasan-dev@googlegroups.com, linux-arm-kernel@lists.infradead.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, Andrey Konovalov X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: CCAC2E0011F3 X-Stat-Signature: bttrroyc7mgrec3seefdygresshyiie6 Received-SPF: none (flex--andreyknvl.bounces.google.com>: No applicable sender policy available) receiver=imf13; identity=mailfrom; envelope-from="<36UhGYAoKCJw6J9NAUGJRHCKKCHA.8KIHEJQT-IIGR68G.KNC@flex--andreyknvl.bounces.google.com>"; helo=mail-qt1-f201.google.com; client-ip=209.85.160.201 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1615218920-368443 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: This patch series integrates HW_TAGS KASAN with init_on_alloc/free by initializing memory via the same arm64 instruction that sets memory tags. This is expected to improve HW_TAGS KASAN performance when init_on_alloc/free is enabled. The exact perfomance numbers are unknown as MTE-enabled hardware doesn't exist yet. Changes v1->v2: - Add and use kasan_has_integrated_init() helper. - Update comments to not explicitly mention relation between HW_TAGS KASAN and memory init. - Fix non initting memory with kasan=off by checking kasan_enabled() instead of IS_ENABLED(CONFIG_KASAN_HW_TAGS). Andrey Konovalov (5): arm64: kasan: allow to init memory when setting tags kasan: init memory in kasan_(un)poison for HW_TAGS kasan, mm: integrate page_alloc init with HW_TAGS kasan, mm: integrate slab init_on_alloc with HW_TAGS kasan, mm: integrate slab init_on_free with HW_TAGS arch/arm64/include/asm/memory.h | 4 +- arch/arm64/include/asm/mte-kasan.h | 20 ++++++--- include/linux/kasan.h | 48 +++++++++++++------- lib/test_kasan.c | 4 +- mm/kasan/common.c | 45 +++++++++---------- mm/kasan/generic.c | 12 ++--- mm/kasan/kasan.h | 19 ++++---- mm/kasan/shadow.c | 10 ++--- mm/kasan/sw_tags.c | 2 +- mm/mempool.c | 4 +- mm/page_alloc.c | 37 +++++++++++----- mm/slab.c | 43 ++++++++++-------- mm/slab.h | 17 ++++++-- mm/slub.c | 70 +++++++++++++++--------------- 14 files changed, 196 insertions(+), 139 deletions(-)