From patchwork Fri Dec 17 06:07:44 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Zhaoyang Huang X-Patchwork-Id: 12683725 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6CC4FC433EF for ; Fri, 17 Dec 2021 06:08:23 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C30BE6B0072; Fri, 17 Dec 2021 01:08:12 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id BDFCB6B0073; Fri, 17 Dec 2021 01:08:12 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id AA6FB6B0075; Fri, 17 Dec 2021 01:08:12 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0171.hostedemail.com [216.40.44.171]) by kanga.kvack.org (Postfix) with ESMTP id 9AF816B0072 for ; Fri, 17 Dec 2021 01:08:12 -0500 (EST) Received: from smtpin31.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id 479C8181AEF09 for ; Fri, 17 Dec 2021 06:08:02 +0000 (UTC) X-FDA: 78926255604.31.EFFA93B Received: from mail-pj1-f51.google.com (mail-pj1-f51.google.com [209.85.216.51]) by imf30.hostedemail.com (Postfix) with ESMTP id 008A48001B for ; Fri, 17 Dec 2021 06:08:01 +0000 (UTC) Received: by mail-pj1-f51.google.com with SMTP id np6-20020a17090b4c4600b001a90b011e06so1682069pjb.5 for ; Thu, 16 Dec 2021 22:08:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:subject:date:message-id; bh=tKUR11+VJDxu6abRc3pnA0Mxj4gPKgi7U53J9cfBDfI=; b=kUqCuV1ZrKslAqq0lWt9KzC8x5lNvA4MryDIBzosvZTihVPlN9ag1apZ5nDd9MTx5p f0zWqpBWEdEoveQv8mywuScLwtIsDvB0/CYVB8qTxx975po75pIwOdoem/8A8fEsYaWZ +lb50jDoeeTewKuA6ER+mfRZOIqItAgFXb5Z18ykcZyj9RRX7c4qozgHhv779TEw7JG7 5W39OBfgTsXdmTDT/vqAEm1s5HqYiOmhPErb3PSZllsMpfnoKFNxZsQ9hR/oLTQzqK7S /t/fYtC+DVFoyYReLa9APcarMnjqf6k6awmF/oz3tbd9yl+nrtiHx4MPPQJo7PYDjjRo xk/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:subject:date:message-id; bh=tKUR11+VJDxu6abRc3pnA0Mxj4gPKgi7U53J9cfBDfI=; b=qTt44rMLl5DzdeRT16gJ3PlRig+ijXGEMVNIhgKIMpwyp4tluu8nR5iwbWvUW2AeYU cewCzCy9zeiNF1yHEF2l5fs4TSs63+XAva9R9bHObQaKF9qvmOVxPLRBaMnt3+hewZQa rjkXJQ2M7fOw9kqCCitPN4qxAhQjxHCGs55/YWowcrttPX4M2EyK8xXomQs1R9wP3wuT fncyYYDmfLhEsWEcsapicv5MUmup/fFsyq2v+i0mPeBDsYUZPI9JPLUGCyFpCGCsZ46l dfoA3mDSBaYjs2N7oRfH7h2r+yFIYW+LXFPST0hCRAJhNKwEguz2DLc1GZSHU8cMnElp qxyg== X-Gm-Message-State: AOAM532ZqYeCJlxKn1T4fXKzHYXfEn7TM4gxNGNBcmM1tcvFMlrajqBS YO5vVdbOBFcVxLDih+zqrd8= X-Google-Smtp-Source: ABdhPJyQrahQsPOsq74gZi8Q7kzz4sDyg/XCu6jWUXOWPNgITfm97mUYPL/Olr8NuC2oZjGJ77riQQ== X-Received: by 2002:a17:902:d488:b0:141:f3a3:d2f4 with SMTP id c8-20020a170902d48800b00141f3a3d2f4mr1842703plg.86.1639721280927; Thu, 16 Dec 2021 22:08:00 -0800 (PST) Received: from bj03382pcu.spreadtrum.com ([117.18.48.102]) by smtp.gmail.com with ESMTPSA id h5sm8569339pfc.113.2021.12.16.22.07.58 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Dec 2021 22:08:00 -0800 (PST) From: Huangzhaoyang To: Johannes Weiner , Zhaoyang Huang , linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH] psi: fix possible trigger missing in the window Date: Fri, 17 Dec 2021 14:07:44 +0800 Message-Id: <1639721264-12294-1-git-send-email-huangzhaoyang@gmail.com> X-Mailer: git-send-email 1.7.9.5 X-Rspamd-Queue-Id: 008A48001B X-Stat-Signature: x7z4c1oizob9y6msobu46pkmxewbpzco Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=kUqCuV1Z; spf=pass (imf30.hostedemail.com: domain of huangzhaoyang@gmail.com designates 209.85.216.51 as permitted sender) smtp.mailfrom=huangzhaoyang@gmail.com; dmarc=pass (policy=none) header.from=gmail.com X-Rspamd-Server: rspam10 X-HE-Tag: 1639721281-269480 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Zhaoyang Huang There could be missing wake up if the rest of the window remain the same stall states as the polling_total updates for every polling_min_period. Signed-off-by: Zhaoyang Huang --- include/linux/psi_types.h | 2 ++ kernel/sched/psi.c | 30 ++++++++++++++++++------------ 2 files changed, 20 insertions(+), 12 deletions(-) diff --git a/include/linux/psi_types.h b/include/linux/psi_types.h index 0a23300..9533d2e 100644 --- a/include/linux/psi_types.h +++ b/include/linux/psi_types.h @@ -132,6 +132,8 @@ struct psi_trigger { /* Refcounting to prevent premature destruction */ struct kref refcount; + + bool new_stall; }; struct psi_group { diff --git a/kernel/sched/psi.c b/kernel/sched/psi.c index 1652f2b..402718c 100644 --- a/kernel/sched/psi.c +++ b/kernel/sched/psi.c @@ -458,9 +458,12 @@ static void psi_avgs_work(struct work_struct *work) static void window_reset(struct psi_window *win, u64 now, u64 value, u64 prev_growth) { + struct psi_trigger *t = container_of(win, struct psi_trigger, win); + win->start_time = now; win->start_value = value; win->prev_growth = prev_growth; + t->new_stall = false; } /* @@ -515,7 +518,6 @@ static void init_triggers(struct psi_group *group, u64 now) static u64 update_triggers(struct psi_group *group, u64 now) { struct psi_trigger *t; - bool new_stall = false; u64 *total = group->total[PSI_POLL]; /* @@ -523,19 +525,26 @@ static u64 update_triggers(struct psi_group *group, u64 now) * watchers know when their specified thresholds are exceeded. */ list_for_each_entry(t, &group->triggers, node) { - u64 growth; - /* Check for stall activity */ if (group->polling_total[t->state] == total[t->state]) continue; /* - * Multiple triggers might be looking at the same state, - * remember to update group->polling_total[] once we've - * been through all of them. Also remember to extend the - * polling time if we see new stall activity. + * update the trigger if there is new stall which will be + * reset when run out of the window */ - new_stall = true; + t->new_stall = true; + + memcpy(&group->polling_total[t->state], &total[t->state], + sizeof(group->polling_total[t->state])); + } + + list_for_each_entry(t, &group->triggers, node) { + u64 growth; + + /* check if new stall happened during this window*/ + if (!t->new_stall) + continue; /* Calculate growth since last update */ growth = window_update(&t->win, now, total[t->state]); @@ -552,10 +561,6 @@ static u64 update_triggers(struct psi_group *group, u64 now) t->last_event_time = now; } - if (new_stall) - memcpy(group->polling_total, total, - sizeof(group->polling_total)); - return now + group->poll_min_period; } @@ -1152,6 +1157,7 @@ struct psi_trigger *psi_trigger_create(struct psi_group *group, t->last_event_time = 0; init_waitqueue_head(&t->event_wait); kref_init(&t->refcount); + t->new_stall = false; mutex_lock(&group->trigger_lock);