From patchwork Sun Mar 5 13:37:03 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Marcelo Tosatti X-Patchwork-Id: 13160148 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 50799C6FA9E for ; Sun, 5 Mar 2023 13:42:01 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EAF6D6B007E; Sun, 5 Mar 2023 08:41:51 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id E1EF76B0083; Sun, 5 Mar 2023 08:41:51 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 9E0E16B007E; Sun, 5 Mar 2023 08:41:51 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 59E706B007E for ; Sun, 5 Mar 2023 08:41:51 -0500 (EST) Received: from smtpin06.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 29E8CAABBE for ; Sun, 5 Mar 2023 13:41:51 +0000 (UTC) X-FDA: 80534957622.06.27511B6 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by imf11.hostedemail.com (Postfix) with ESMTP id 6E87F40003 for ; Sun, 5 Mar 2023 13:41:49 +0000 (UTC) Authentication-Results: imf11.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=EpgRVJQR; spf=pass (imf11.hostedemail.com: domain of mtosatti@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=mtosatti@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1678023709; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:references:dkim-signature; bh=X5A6sr5GdS/CRp9e0AjLg+A82o3GBDzuPA8yAWqGcJk=; b=jXjuJTA3/sbb1cq89QpeQPj9v2ty6oO3MlRqvIDw9I76Jk92RsBD2cJQn1z2ZWgL9Riwj2 ahlJ+XaJhF36RbRHhHjAbmVDQLG6xV/4PmggyNYeCiFZqWp08SipmH9EjPo9dsEtac5YZw oFlekCSIQQIpr7IOrfXI6bfdAbiaXww= ARC-Authentication-Results: i=1; imf11.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=EpgRVJQR; spf=pass (imf11.hostedemail.com: domain of mtosatti@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=mtosatti@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1678023709; a=rsa-sha256; cv=none; b=N8+VQBbjl43feTLMMW4+NT8yXOoJpq8AhZQEw8WSPWwQ7SViEmkj1/vRaSKZ3VysDajq4Y 2L/xILLbceig7/+cYoogkrj+8W0JKagTEz58QcUg+Nsf1/BHHFQQrJHigqgBegmskVWTx7 BjLI+UBi7Kc44/eLcQL3jFuA1uLTrOQ= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1678023708; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: references:references; bh=X5A6sr5GdS/CRp9e0AjLg+A82o3GBDzuPA8yAWqGcJk=; b=EpgRVJQRYy1jHsb3Fl1VCaVd8MfIWV51kkPDkAVV2gYbc/YTBOFoWnSwViQQGuGaXgafN9 BD0nyTAZb3U4dtN6t6T6Ls7h+2RbkX8LmsQy/uE5eTuucfs/AH3o6PjerzRQVRW2isMgX9 PppGV6HLyUUa0c1+3ATWeo7b2yyjoxc= Received: from mimecast-mx02.redhat.com (mimecast-mx02.redhat.com [66.187.233.88]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-643-tu_aXllPNFqq4K3hRNnk7A-1; Sun, 05 Mar 2023 08:41:45 -0500 X-MC-Unique: tu_aXllPNFqq4K3hRNnk7A-1 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.rdu2.redhat.com [10.11.54.6]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id F15BC1875041; Sun, 5 Mar 2023 13:41:44 +0000 (UTC) Received: from tpad.localdomain (ovpn-112-2.gru2.redhat.com [10.97.112.2]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 8EEAC2166B26; Sun, 5 Mar 2023 13:41:44 +0000 (UTC) Received: by tpad.localdomain (Postfix, from userid 1000) id 2AAE0401A0FCD; Sun, 5 Mar 2023 10:41:23 -0300 (-03) Message-ID: <20230305134053.563070832@redhat.com> User-Agent: quilt/0.67 Date: Sun, 05 Mar 2023 10:37:03 -0300 From: Marcelo Tosatti To: Christoph Lameter Cc: Aaron Tomlin , Frederic Weisbecker , Andrew Morton , linux-kernel@vger.kernel.org, linux-mm@kvack.org, Russell King , Huacai Chen , Heiko Carstens , x86@kernel.org, Marcelo Tosatti Subject: [PATCH v4 06/12] add this_cpu_cmpxchg_local and asm-generic definitions References: <20230305133657.255737580@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.1 on 10.11.54.6 X-Stat-Signature: d65okrsogw7qhq3st4tp5rtb8bkkzng7 X-Rspam-User: X-Rspamd-Queue-Id: 6E87F40003 X-Rspamd-Server: rspam06 X-HE-Tag: 1678023709-968753 X-HE-Meta: U2FsdGVkX19BgZFMnUJzJ2zYIsIqEO7Yzes+yguY47/9/HnjEW2lgZZpgc7WIxi135SxJOdDp1RWpZ7XvryhUwbUJdjZez3/JzTaW6jg7uNdQWtIlWlf/VIiBbYe22K78DbtWxutvnqa4TB+w2HJxeyFa3sKWY0VWQ9lUmIPSR7tHKfVUTSUV2++gqNDC7/tzItBAhPo319zvJw10mufCdEw15XBl71zGQTmwozao/2mJV0oau8j53mlXpEF1Z1nFGen6gLiZtwZzVfIiZYG4GT9wBB5XcGGir7pXEhc1aaLBugK06B+fLTm5tUl+UsbAq5gKudHnqtrfgc+9/Am/x8H3T0Aaz6epaHxUlgD6opGGjQ21T0u7+93CzhpWx3OCLLJ5jHpENVyv7Y7akEei5tThaUgUrhI+xd5l6VqatScIcMtnUYeA2/zHDQZ4RCnsGyL5oyrVXIAC0AhMFpY6jCbvLOoUSWR+i7VP/pHWEFoJKgReJYDgoNcZGfZbTC8j/0kLNaOqQMtHOpj1jo+041tNgs8rW5GG0BV9KZK+qyBL6z3ORehapbrUgDYIXZVwnoNN4yj/0Q5Udug72tJo+slBTK/ezhjigOfGBeG4iXxCIctDcel66Vcp9BnEsTcXGKVf7U4LEOoQPIFs24QkIOHMcfBX63f02XBP6NS+V1HeICCqbqNpPqihrWrwJoDfXFRxef0rGGiSB5qak0tBfrBAR6ofpxzvu/H46f36a+5u78i0A+KIceYx8t7btSu0SsLZf0WIjRyALyOQyyHpbN3WEotRdPFulb2+bxZpgXHnnWVGzuVsn2Zb8rqPG7fj5o3NqcXXBEQFilDNbPtm2D7Ql3ayyg9oeVRvQdGblrF+y7/erlUFsoFZqAiBwR81RZ7EaXY/7Y0kUMP0IA8GJu3YPK/n+ag3Xw05MJz1YcNS8nl3SWztHoz6OJWNL6qnEcwGjKdpsdPT3RjaND 2rnNymep FYtuZjptpsa+1gDNVsuXrTsSHg6EpSGOpyEe70FiCAWKtj68BHvr1ex5n/HKnW0vIcwBQIrn5pN9+kbw3grQP5fyc8Q53aZhwGPZ0TWUgr/K+0+topNFQtxsh41GRIUSqJzVBb+O7nUB5upmFvN9IZWqWJMRun9bsD8xe7n8NOrfsnANAChr0hIfCXHOc04HcdXSneyyr2aTEjUphtDUdcCaA0+GwTfMSK0iL7vynbzssN+IBvzLDx6fG+g== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Goal is to have vmstat_shepherd to transfer from per-CPU counters to global counters remotely. For this, an atomic this_cpu_cmpxchg is necessary. Add this_cpu_cmpxchg_local_ helpers to asm-generic/percpu.h. Signed-off-by: Marcelo Tosatti Index: linux-vmstat-remote/include/asm-generic/percpu.h =================================================================== --- linux-vmstat-remote.orig/include/asm-generic/percpu.h +++ linux-vmstat-remote/include/asm-generic/percpu.h @@ -424,6 +424,23 @@ do { \ this_cpu_generic_cmpxchg(pcp, oval, nval) #endif +#ifndef this_cpu_cmpxchg_local_1 +#define this_cpu_cmpxchg_local_1(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif +#ifndef this_cpu_cmpxchg_local_2 +#define this_cpu_cmpxchg_local_2(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif +#ifndef this_cpu_cmpxchg_local_4 +#define this_cpu_cmpxchg_local_4(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif +#ifndef this_cpu_cmpxchg_local_8 +#define this_cpu_cmpxchg_local_8(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif + #ifndef this_cpu_cmpxchg_double_1 #define this_cpu_cmpxchg_double_1(pcp1, pcp2, oval1, oval2, nval1, nval2) \ this_cpu_generic_cmpxchg_double(pcp1, pcp2, oval1, oval2, nval1, nval2) Index: linux-vmstat-remote/include/linux/percpu-defs.h =================================================================== --- linux-vmstat-remote.orig/include/linux/percpu-defs.h +++ linux-vmstat-remote/include/linux/percpu-defs.h @@ -513,6 +513,8 @@ do { \ #define this_cpu_xchg(pcp, nval) __pcpu_size_call_return2(this_cpu_xchg_, pcp, nval) #define this_cpu_cmpxchg(pcp, oval, nval) \ __pcpu_size_call_return2(this_cpu_cmpxchg_, pcp, oval, nval) +#define this_cpu_cmpxchg_local(pcp, oval, nval) \ + __pcpu_size_call_return2(this_cpu_cmpxchg_local_, pcp, oval, nval) #define this_cpu_cmpxchg_double(pcp1, pcp2, oval1, oval2, nval1, nval2) \ __pcpu_double_call_return_bool(this_cpu_cmpxchg_double_, pcp1, pcp2, oval1, oval2, nval1, nval2)