From patchwork Thu Jan 12 19:43:23 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Peter Zijlstra X-Patchwork-Id: 13098766 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id DA565C61DB3 for ; Thu, 12 Jan 2023 19:57:51 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 2033E8000C; Thu, 12 Jan 2023 14:57:31 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 16E3C8000E; Thu, 12 Jan 2023 14:57:31 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E59118000B; Thu, 12 Jan 2023 14:57:30 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id D7A4380009 for ; Thu, 12 Jan 2023 14:57:30 -0500 (EST) Received: from smtpin06.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id AF1611A0681 for ; Thu, 12 Jan 2023 19:57:30 +0000 (UTC) X-FDA: 80347206660.06.C946502 Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) by imf29.hostedemail.com (Postfix) with ESMTP id 0375112000A for ; Thu, 12 Jan 2023 19:57:28 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=infradead.org header.s=desiato.20200630 header.b=Y8LFyBFl; spf=none (imf29.hostedemail.com: domain of peterz@infradead.org has no SPF policy when checking 90.155.92.199) smtp.mailfrom=peterz@infradead.org; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1673553449; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:references:dkim-signature; bh=RrpmTujnodPvC1LE/jXScgO4ZKUrxiQVlZ4+SEf4m04=; b=z66M22146IbVLGAvJ9BCAFpP4shybAZhehe3jUQHPdN2Zdmy4uPwSn5adqgP99dDYEil8A ytpfpTXOtC/i/BH4T+0/T6UGktpAKxJdqavphl1IvXpqShjEntnOdkkVuyUCaDXdQsAOrL 3ZrnbZ2lLLfceOm6RN5nDq2+GavuMlo= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=infradead.org header.s=desiato.20200630 header.b=Y8LFyBFl; spf=none (imf29.hostedemail.com: domain of peterz@infradead.org has no SPF policy when checking 90.155.92.199) smtp.mailfrom=peterz@infradead.org; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1673553449; a=rsa-sha256; cv=none; b=rOygsEw3ZXXuDBuXKSaU7fnhNJWm0ock6eokiheoxWpPshbs05jZhbsZCBVxu7ypr4I4C3 IQIrdwYT35wUO4RP7O8Al79oryVxQpTDfzdtILBQNlAXRXIiXZLmTW1EMs8nKOw+rCvfqr aXsuCEs3XlDGO5m9zGPIBjRfG0kqoew= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=Content-Type:MIME-Version:References: Subject:Cc:To:From:Date:Message-ID:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:In-Reply-To; bh=RrpmTujnodPvC1LE/jXScgO4ZKUrxiQVlZ4+SEf4m04=; b=Y8LFyBFl3JbIwtnCWjFL/hhR5y twnVLexiBK1ooMbeDatb6RWwBocZW13sf5pirkWAWAH1nsW2rgd7ecx2Gc/qOdtvY6YZxKvumRcTm amulB5kgeQbRdQF87cEBBGyv4iJlugiK9kXbD+c92ulURa+BZ+6IgO0Q1qr4EELRq9g05K3UaslzX AWK5oxOOelmKqL4CSrymA461jkib6Q12hrzk8J/XFrR76pcWqThQ8X70scSBkUeWz1SP2e4AHdemR 4sJ92NwETWbqsv5J5iWtGkWZGwcWClLra0VFFumQGPO8rMb8BpC/UsbZk6Ohp1wUq3mHnYc2/nqyR 7VPa7mnA==; Received: from j130084.upc-j.chello.nl ([24.132.130.84] helo=noisy.programming.kicks-ass.net) by desiato.infradead.org with esmtpsa (Exim 4.96 #2 (Red Hat Linux)) id 1pG3hD-0045oB-09; Thu, 12 Jan 2023 19:57:08 +0000 Received: from hirez.programming.kicks-ass.net (hirez.programming.kicks-ass.net [192.168.1.225]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by noisy.programming.kicks-ass.net (Postfix) with ESMTPS id 117A63033FB; Thu, 12 Jan 2023 20:57:13 +0100 (CET) Received: by hirez.programming.kicks-ass.net (Postfix, from userid 0) id B27F62CCF1F50; Thu, 12 Jan 2023 20:57:07 +0100 (CET) Message-ID: <20230112195539.883561913@infradead.org> User-Agent: quilt/0.66 Date: Thu, 12 Jan 2023 20:43:23 +0100 From: Peter Zijlstra To: peterz@infradead.org Cc: richard.henderson@linaro.org, ink@jurassic.park.msu.ru, mattst88@gmail.com, vgupta@kernel.org, linux@armlinux.org.uk, nsekhar@ti.com, brgl@bgdev.pl, ulli.kroll@googlemail.com, linus.walleij@linaro.org, shawnguo@kernel.org, Sascha Hauer , kernel@pengutronix.de, festevam@gmail.com, linux-imx@nxp.com, tony@atomide.com, khilman@kernel.org, krzysztof.kozlowski@linaro.org, alim.akhtar@samsung.com, catalin.marinas@arm.com, will@kernel.org, guoren@kernel.org, bcain@quicinc.com, chenhuacai@kernel.org, kernel@xen0n.name, geert@linux-m68k.org, sammy@sammy.net, monstr@monstr.eu, tsbogend@alpha.franken.de, dinguyen@kernel.org, jonas@southpole.se, stefan.kristiansson@saunalahti.fi, shorne@gmail.com, James.Bottomley@HansenPartnership.com, deller@gmx.de, mpe@ellerman.id.au, npiggin@gmail.com, christophe.leroy@csgroup.eu, paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, hca@linux.ibm.com, gor@linux.ibm.com, agordeev@linux.ibm.com, borntraeger@linux.ibm.com, svens@linux.ibm.com, ysato@users.sourceforge.jp, dalias@libc.org, davem@davemloft.net, richard@nod.at, anton.ivanov@cambridgegreys.com, johannes@sipsolutions.net, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, dave.hansen@linux.intel.com, x86@kernel.org, hpa@zytor.com, acme@kernel.org, mark.rutland@arm.com, alexander.shishkin@linux.intel.com, jolsa@kernel.org, namhyung@kernel.org, jgross@suse.com, srivatsa@csail.mit.edu, amakhalov@vmware.com, pv-drivers@vmware.com, boris.ostrovsky@oracle.com, chris@zankel.net, jcmvbkbc@gmail.com, rafael@kernel.org, lenb@kernel.org, pavel@ucw.cz, gregkh@linuxfoundation.org, mturquette@baylibre.com, sboyd@kernel.org, daniel.lezcano@linaro.org, lpieralisi@kernel.org, sudeep.holla@arm.com, agross@kernel.org, andersson@kernel.org, konrad.dybcio@linaro.org, anup@brainfault.org, thierry.reding@gmail.com, jonathanh@nvidia.com, jacob.jun.pan@linux.intel.com, atishp@atishpatra.org, Arnd Bergmann , yury.norov@gmail.com, andriy.shevchenko@linux.intel.com, linux@rasmusvillemoes.dk, dennis@kernel.org, tj@kernel.org, cl@linux.com, rostedt@goodmis.org, mhiramat@kernel.org, frederic@kernel.org, paulmck@kernel.org, pmladek@suse.com, senozhatsky@chromium.org, john.ogness@linutronix.de, juri.lelli@redhat.com, vincent.guittot@linaro.org, dietmar.eggemann@arm.com, bsegall@google.com, mgorman@suse.de, bristot@redhat.com, vschneid@redhat.com, ryabinin.a.a@gmail.com, glider@google.com, andreyknvl@gmail.com, dvyukov@google.com, vincenzo.frascino@arm.com, Andrew Morton , jpoimboe@kernel.org, linux-alpha@vger.kernel.org, linux-kernel@vger.kernel.org, linux-snps-arc@lists.infradead.org, linux-omap@vger.kernel.org, linux-samsung-soc@vger.kernel.org, linux-csky@vger.kernel.org, linux-hexagon@vger.kernel.org, linux-ia64@vger.kernel.org, loongarch@lists.linux.dev, linux-m68k@lists.linux-m68k.org, linux-mips@vger.kernel.org, openrisc@lists.librecores.org, linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-riscv@lists.infradead.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, sparclinux@vger.kernel.org, linux-um@lists.infradead.org, linux-perf-users@vger.kernel.org, virtualization@lists.linux-foundation.org, linux-xtensa@linux-xtensa.org, linux-acpi@vger.kernel.org, linux-pm@vger.kernel.org, linux-clk@vger.kernel.org, linux-arm-msm@vger.kernel.org, linux-tegra@vger.kernel.org, linux-arch@vger.kernel.org, linux-mm@kvack.org, linux-trace-kernel@vger.kernel.org, kasan-dev@googlegroups.com, "Rafael J. Wysocki" , Ulf Hansson Subject: [PATCH v3 09/51] cpuidle,omap3: Push RCU-idle into driver References: <20230112194314.845371875@infradead.org> MIME-Version: 1.0 X-Stat-Signature: 7yjzy7dt5reswb65oji8cjehr3c4nx5o X-Rspam-User: X-Rspamd-Queue-Id: 0375112000A X-Rspamd-Server: rspam06 X-HE-Tag: 1673553448-470953 X-HE-Meta: U2FsdGVkX19gtqN7OJIYdTwZ1lyiol5fextAkzSEv+O7mgOUgI99fSABXdOOUmdMv3TIGbHBQHqyU+n5EhPXXCKChSG17OGCsZai2ia1uXtfSi/OpVdjo7MIKgNbhaimxgzBFTuw+1OGit8ugyD44u0xODlMy2+ZT9JQGnCjY1hlWShEWrno9OBLbUhngHehL6oU0CuFfiXERTVgHFtYqCx4a8q5q4u66gSm0B+TgbjuAcn3Sdx9xUeWpL03I7ZPvfZWXtX61zxbPKsXjwNR6y1mjMvsGeebbrbWHVdRBuYECj67yuSS4qcfoto5OA6byul8r6IuIRZ4q606KnCPZrT+HaCFANrbx/HqcBBhtGgQ9HOFNoAZM3vCI0KuscD8UO21TmqF7vSjjDjqL6vWy8tSGnhZLPDRX/YAYt2TQZizqc6BkTf4f/HU0TiJYOXiA6/UbOd4vH3DqEUuSi++0eAZFj90SoAIDKheUiFw8ZNyZFRS1Hq52kuZ/qdUGG038FTDW3FzOOVzhE/7jzQpTBREduI+ba6jgv5eIe0bksT/Gcs/2TG2RO/ospmSIMhPhozrOgaMkJDlcOUArmIGZji2RCnh3Y9e7Iwla3xoVLJEfl2gpb6asAaPMu0WAxRJYocfp/jQScXfVsCoVLPdhimw7RvsBv/AZl21VGFzaR6v5yRSBtv1+uX2Qa6ZtCptLYD/gPAKnwpUNB8DC0H6P9k+4Kc5BFGyNDsn92MCFobYpb/lumCWg15qMa5RfWBnEUyMpoVdC4csTqKnl2RSEekGJE0JLTPF36EHjKTyBeND0tez02ti5vRYeX3O1llCujK6g1bfEIfhNjbqYB2nBjChJloTp+yjKuCmKp1RKuWeLgDppQKnh9+hLzlT6mnUTPQX2ZMa7InBQlx6EUCrnrpNSjuWDAOgB48GQdK7qyHwWittZNnoOi83Q0AE7chBmSQPo6j1n0ElQp8nwZD PaTz2g+9 lQGcrVQq+F9C9m1sRSjjP0cTORKayIMvTltK4ojLlzYewLYxeBc1Z+Ek981+w4uKwtZ/rzZQ9r+y8fKBv5GxqNhsV+xsQXgnLmyeVIQYMVe6tu1hEJkLeUNZn7FzoM1NcM+pQD0QkCBeJcYQ80+3c4gUcsZ2K01PO1IIlF4Gyx4bsFC5RQK/fYX4gDs1jygEJ1HVesJR40jw5Lp+XZczHo1llI38rXve+CjqdLNCPFs3tPs3C7oGaSGeIg2qFlJVrOx7q+4Bo5+qAgO6qERP4HpBGAEwQJQhTv6dnoEbo6okFbs5xZLYVYUFXEUn0oiI4Y3mCTNOvQrW/pASPac24cvUmUCFr4vAGKkN/Qp/jtG/8JpNkbiDZJgayPNVjVs8safdlUaxZuGnApl/wyLg1Mb/oARnSJEL2STZgmVhlzn4WMy2VZT634FPqhoY7cuWInZywiM86DG1Y7lLi4aSlbY29eDHOy/lA/BXawZm+7RKSkuHJS70sL1kTLCiBacK/Q6iCdbFQp+2niRS0bi/ZWkRCFouGKpWqhiwvAZnHe7zG17UNRxVih/BmSd23hjW3zr0qjHrLppns46tB8H4GrrVQGv2PptUxFjDPfLQPmL2Ixh6lnrmDdBry4WDc/UU415Plf+QOmDvupyfVdb1RftGgAg0xzOgtVlHT2Em8sX7DT3MrS8zA8GX6RIN0zNLK5zwyn+CzVeAEFKqtqjyGPJxbFDFYDbceHyREuJ28hPDMZDIQXYB3ECVcf8aW/iInIMsdln7Of85HATCH4g7hrTG3HqCXz5E73Z0K/p0LsUlvvtpQTk6/FLDGw7YRFnB+XDj7if3etU9rWgHIIozp+GTWwWEozkSRSnhoc5kzXl9bPD1ouUt5Y4Q0vXv/KITG4SB1SM4wTvJEsYaTRMVGU3kCmgqeCXdnVqNS7s7Hn3bucecXb+qTR/i93WjiVDoI6kBIyYT7TLn2oOg9U/9xXHM7a1On fe0qcOId W74VrHJ8+EsCD3Cde+Y+nHYzWposuLeagz1vJ8hErBuKti2na0UQuBHxuibQtpyJl95nqBsiDjKWkjral0T7pMg6wGZ+BIOmwyu2L9GtPOBxbHL0QPX9uEm7cwsVK9Cp03noDTuLvfqeHVv7INnWnhYFKa3mNhZm0v03VMKrfS2JilnDroujPXBHM6CN2aJhisizuMJa3oejI242pKh+y03fyd/TKcVeJEs1KcLzG1TcETpFcUrlmuVELob1Xy+cbAhKm9u9Rfctitg/FMXq3gecDl7LLpTzm9kWHvGZ+F70EpZwFBB/KfUPqDoexPP9kgdBjl4XanTbQViJKS3MpCTYrZ3askNaLerkV3K4hgaX8oszKw/q+p6Crfd5WJZFk+BNgbdk5gI83bQxrglTcY+pJsBPqIJVyoMT562a8bA3unihtNeaGqXuRU9qrjoajTS2dwDe+dRxEhPxG4Q7eoX2BYnnvQ15ImrC2CSo5yQ4IJYHVOICqwDi9bZHgmcJyn2lnH7JswTiCXAGprF0YWLKtAQfY9zeGMls4qyPZlk2XvaTLZy8GW4tU0OGyh7G9lnMWkwVXmNtd3hK6THR6oBsy1g/65+qjq2SB3lhyeIDRGv2KRdO04mipjnKNO3COr/SaHXW0u4OrJZ/6Sk0DoPpt1bvM3GTZQj0WoUY/tYSXfU1ObF/DEV6iqUEcllXh5fvH6ODCYqsLrbohxIUTjkzeQvuaTwIgGPPF/QwZJWOG7Y3h2xlk2LsU8ka41axJH2Bua7Lfkikb+XB6aAQMOfly+rDegbQciJjdOVI5g6OuVdgjtTmV9frmRCUyY6jtb0c8rsGHgIt+6kJ00WG2UJh8+h30vLIBcpZ7x/P507rLLlIkhdexxvAgPjbx9CVbgtHalUKpm2AK52ApMSu2PXI1uDmO+MqKQ4IaU4BG2OudjxeK6d23qERGwYwxSu2eI6rXoOFGPj3KKkU31jKWvkO08HOp Ung86nhz 55rWnrkEd4LlOKyUylsToFoy8B+0h28TrO5DN9dB5NS36jGCjJ+VeCFZtw3NrrgrnVfFZ8XziilGy6cIDldqB0EQ9KYH+ziCPQUMvYjK1jqxMwoY2IGsNwqvlsq7OmDQmoT4WG04z+nkDiMC2GEX2Lbceklk/154NWUEZVeKtHvuW+uouEVyl6smJ6B4HG/6nykVP1kqSio6vM1oetWGT3amr/rG7r58e2eXYHxejdwWqVmzSxoMuOdA/TiMydouYfhGoARYcAJ9Ciqv+Affg04qjGG4I8xrFy/kCoG64NxJHkfRUNBbQtlA2+kcclmG9Wec4Hg/CvlGrewGExmrOJRRR7lOh67t17qjiVfqM/zHCifxthHpPvkjFlsFiiFgRR7yQ0F46ERLabKyVBwNteeUA7TZPAqDEMkUDS9vNU/mLNknJgSy4vVGLjIAxplGNaQe0FDN3Jd/gVW7s6YrlrDcqYLWhKbgwIwegt1E1BZIaySNw8HcGp6BHeUqOTmDU/JH+HWqTaCiV5LPeYZASoz3eWW3iZE/QTO27VTWMBc8J/fnffVMqlIXiXtN/YgXjp2zFxreevyv9OYTkAXMi98Yu0uxXv4vVfdLe/cbsLfbkNegn5XeyM414CYN39LeVH69YHrucLL5ijjohXvKikh3LLbTKs7c0fcThszSUWrjTC0KHKXXG6G3Jjqr5Y0XFuSFwCMlml66CIjBPkdjmqGMBzo+a7K28whXZ4t+GYNyd2RKDpuHKftEP87wIsGn6g6RgVj5BOmmH+bVg2pQhLUMl+JmzaUIroNfZct75ySWYmJH3eEnT0P7fqXW9I2ekYK/IJhXOyTLQ6lGAR4SavdDKhTySM41w0OBSagwhrXD+A6zEZ4zLeb2qIxr/J0OZQFeEc2Hg/Hwu4yeXDd9M6MP6mUQ5/PL8EAWtRW7RHDEYNpkZjDNTZpl1LXJDixYSkW+eBldW8zNTKK993+IbHN6xD9w5 1Ezfs87r vQCd7u+nYLQTbw2E6o5ddiGG5gRs/qW4gMd2ehph9gKfcKimCKgmMdtG3E0P3nTH4KHqZKe0sNayJAzIzEcfo11XmbyFkHysJZlafYfiEGPg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Doing RCU-idle outside the driver, only to then teporarily enable it again before going idle is daft. Notably the cpu_pm_*() calls implicitly re-enable RCU for a bit. Signed-off-by: Peter Zijlstra (Intel) Reviewed-by: Frederic Weisbecker Reviewed-by: Tony Lindgren Acked-by: Rafael J. Wysocki Tested-by: Tony Lindgren Tested-by: Ulf Hansson --- arch/arm/mach-omap2/cpuidle34xx.c | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) --- a/arch/arm/mach-omap2/cpuidle34xx.c +++ b/arch/arm/mach-omap2/cpuidle34xx.c @@ -133,7 +133,9 @@ static int omap3_enter_idle(struct cpuid } /* Execute ARM wfi */ + ct_idle_enter(); omap_sram_idle(); + ct_idle_exit(); /* * Call idle CPU PM enter notifier chain to restore @@ -265,6 +267,7 @@ static struct cpuidle_driver omap3_idle_ .owner = THIS_MODULE, .states = { { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 2 + 2, .target_residency = 5, @@ -272,6 +275,7 @@ static struct cpuidle_driver omap3_idle_ .desc = "MPU ON + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 10 + 10, .target_residency = 30, @@ -279,6 +283,7 @@ static struct cpuidle_driver omap3_idle_ .desc = "MPU ON + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 50 + 50, .target_residency = 300, @@ -286,6 +291,7 @@ static struct cpuidle_driver omap3_idle_ .desc = "MPU RET + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 1500 + 1800, .target_residency = 4000, @@ -293,6 +299,7 @@ static struct cpuidle_driver omap3_idle_ .desc = "MPU OFF + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 2500 + 7500, .target_residency = 12000, @@ -300,6 +307,7 @@ static struct cpuidle_driver omap3_idle_ .desc = "MPU RET + CORE RET", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 3000 + 8500, .target_residency = 15000, @@ -307,6 +315,7 @@ static struct cpuidle_driver omap3_idle_ .desc = "MPU OFF + CORE RET", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 10000 + 30000, .target_residency = 30000, @@ -328,6 +337,7 @@ static struct cpuidle_driver omap3430_id .owner = THIS_MODULE, .states = { { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 110 + 162, .target_residency = 5, @@ -335,6 +345,7 @@ static struct cpuidle_driver omap3430_id .desc = "MPU ON + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 106 + 180, .target_residency = 309, @@ -342,6 +353,7 @@ static struct cpuidle_driver omap3430_id .desc = "MPU ON + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 107 + 410, .target_residency = 46057, @@ -349,6 +361,7 @@ static struct cpuidle_driver omap3430_id .desc = "MPU RET + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 121 + 3374, .target_residency = 46057, @@ -356,6 +369,7 @@ static struct cpuidle_driver omap3430_id .desc = "MPU OFF + CORE ON", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 855 + 1146, .target_residency = 46057, @@ -363,6 +377,7 @@ static struct cpuidle_driver omap3430_id .desc = "MPU RET + CORE RET", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 7580 + 4134, .target_residency = 484329, @@ -370,6 +385,7 @@ static struct cpuidle_driver omap3430_id .desc = "MPU OFF + CORE RET", }, { + .flags = CPUIDLE_FLAG_RCU_IDLE, .enter = omap3_enter_idle_bm, .exit_latency = 7505 + 15274, .target_residency = 484329,