From patchwork Sat Sep 10 19:33:15 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Toke_H=C3=B8iland-J=C3=B8rgensen?= X-Patchwork-Id: 9325075 X-Patchwork-Delegate: johannes@sipsolutions.net Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id AE2A960231 for ; Sat, 10 Sep 2016 19:33:35 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 9E98229594 for ; Sat, 10 Sep 2016 19:33:35 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 921A82959B; Sat, 10 Sep 2016 19:33:35 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.0 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 29F1029594 for ; Sat, 10 Sep 2016 19:33:33 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752047AbcIJTdc (ORCPT ); Sat, 10 Sep 2016 15:33:32 -0400 Received: from mail2.tohojo.dk ([77.235.48.147]:33366 "EHLO mail2.tohojo.dk" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751618AbcIJTdb (ORCPT ); Sat, 10 Sep 2016 15:33:31 -0400 X-Virus-Scanned: amavisd-new at mail2.tohojo.dk DKIM-Filter: OpenDKIM Filter v2.10.3 mail2.tohojo.dk 678FC41621 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=toke.dk; s=201310; t=1473536006; bh=mATg4FGfknKzM0RlpnoGjQ5hzc1nPkg8Cm2DqABCTRI=; h=From:To:Cc:Subject:Date:From; b=oLbcv2SCCLUchjAOhSWgoveUlPlVrIN601DwBnSzzkAMYMFWmgYwSLbLwQQi9LQs6 VNlwViwl4T5gjF5pxIsoLNXKpPivJoHNqOO3f1GHAdRqn0Gajgz2zEyV8Upx9bp473 WpXVKUBy2zJaz33o0cJsQKgTChW7vRCRAXd1CeqA= Received: by alrua-x1.borgediget.toke.dk (Postfix, from userid 1000) id 0F9538368; Sat, 10 Sep 2016 21:33:25 +0200 (CEST) From: =?UTF-8?q?Toke=20H=C3=B8iland-J=C3=B8rgensen?= To: make-wifi-fast@lists.bufferbloat.net, linux-wireless@vger.kernel.org Cc: =?UTF-8?q?Toke=20H=C3=B8iland-J=C3=B8rgensen?= , Michal Kazior , Felix Fietkau Subject: [PATCH] mac80211: Dynamically set CoDel parameters per station. Date: Sat, 10 Sep 2016 21:33:15 +0200 Message-Id: <20160910193315.30738-1-toke@toke.dk> MIME-Version: 1.0 Sender: linux-wireless-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-wireless@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP CoDel can be too aggressive if a station sends at a very low rate, leading to starvation. This gets worse the more stations are present, as each station gets more bursty the longer the round-robin scheduling between stations takes. This adds dynamic adjustment of CoDel parameters per station. It uses the rate selection information to estimate throughput and sets more lenient CoDel parameters if the estimated throughput is below a threshold. To not change parameters too often, a hysteresis of two seconds is added. A new callback is added that drivers can use to notify mac80211 about changes in expected throughput, so the same adjustment can be made for cards that implement rate control in firmware. Drivers that don't use this will just get the default parameters. The threshold used and the CoDel parameters set for slow stations are chosen to err on the side of caution. I.e. rather be too lenient than too aggressive. A better algorithm can then be added later. Cc: Michal Kazior Cc: Felix Fietkau Signed-off-by: Toke Høiland-Jørgensen --- include/net/mac80211.h | 17 +++++++++++++++++ net/mac80211/rate.c | 2 ++ net/mac80211/sta_info.c | 35 +++++++++++++++++++++++++++++++++++ net/mac80211/sta_info.h | 12 ++++++++++++ net/mac80211/tx.c | 9 ++++++++- 5 files changed, 74 insertions(+), 1 deletion(-) diff --git a/include/net/mac80211.h b/include/net/mac80211.h index cca510a..6e0cf85 100644 --- a/include/net/mac80211.h +++ b/include/net/mac80211.h @@ -4089,6 +4089,23 @@ void ieee80211_get_tx_rates(struct ieee80211_vif *vif, int max_rates); /** + * ieee80211_sta_set_expected_throughput - set the expected throughput for a + * station + * + * Call this function to notify mac80211 about a change in expected throughput + * to a station. A driver for a device that does rate control in firmware can + * call this function when the expected throughput estimate towards a station + * changes. The information is used to tune the CoDel AQM applied to traffic + * going towards that station (which can otherwise be too aggressive and cause + * slow stations to starve). + * + * @sta: the station to set throughput for. + * @thr: the current expected throughput in kbps. + */ +void ieee80211_sta_set_expected_throughput(struct ieee80211_sta *pubsta, + u32 thr); + +/** * ieee80211_tx_status - transmit status callback * * Call this function for all transmitted frames after they have been diff --git a/net/mac80211/rate.c b/net/mac80211/rate.c index 206698b..5370f5c 100644 --- a/net/mac80211/rate.c +++ b/net/mac80211/rate.c @@ -890,6 +890,8 @@ int rate_control_set_rates(struct ieee80211_hw *hw, drv_sta_rate_tbl_update(hw_to_local(hw), sta->sdata, pubsta); + sta_update_codel_params(sta, sta_get_expected_throughput(sta)); + return 0; } EXPORT_SYMBOL(rate_control_set_rates); diff --git a/net/mac80211/sta_info.c b/net/mac80211/sta_info.c index 19f14c9..6deda4a 100644 --- a/net/mac80211/sta_info.c +++ b/net/mac80211/sta_info.c @@ -20,6 +20,7 @@ #include #include +#include #include #include "ieee80211_i.h" #include "driver-ops.h" @@ -419,6 +420,8 @@ struct sta_info *sta_info_alloc(struct ieee80211_sub_if_data *sdata, sta->sta.max_rc_amsdu_len = IEEE80211_MAX_MPDU_LEN_HT_BA; + sta_update_codel_params(sta, 0); + sta_dbg(sdata, "Allocated STA %pM\n", sta->sta.addr); return sta; @@ -2306,6 +2309,15 @@ u32 sta_get_expected_throughput(struct sta_info *sta) return thr; } +void ieee80211_sta_set_expected_throughput(struct ieee80211_sta *pubsta, + u32 thr) +{ + struct sta_info *sta = container_of(pubsta, struct sta_info, sta); + + sta_update_codel_params(sta, thr); +} +EXPORT_SYMBOL(ieee80211_sta_set_expected_throughput); + unsigned long ieee80211_sta_last_active(struct sta_info *sta) { struct ieee80211_sta_rx_stats *stats = sta_get_last_rx_stats(sta); @@ -2314,3 +2326,26 @@ unsigned long ieee80211_sta_last_active(struct sta_info *sta) return stats->last_rx; return sta->status_stats.last_ack; } + +void sta_update_codel_params(struct sta_info *sta, u32 thr) +{ + u64 now = ktime_get_ns(); + + if (!sta->sdata->local->ops->wake_tx_queue) + return; + + if (now - sta->cparams.update_time < STA_CPARAMS_HYSTERESIS) + return; + + if (thr && thr < STA_SLOW_THRESHOLD) { + sta->cparams.params.target = MS2TIME(50); + sta->cparams.params.interval = MS2TIME(300); + sta->cparams.params.ecn = false; + } else { + sta->cparams.params.target = MS2TIME(20); + sta->cparams.params.interval = MS2TIME(100); + sta->cparams.params.ecn = true; + } + sta->cparams.params.ce_threshold = CODEL_DISABLED_THRESHOLD; + sta->cparams.update_time = now; +} diff --git a/net/mac80211/sta_info.h b/net/mac80211/sta_info.h index 0556be3..ad088ff 100644 --- a/net/mac80211/sta_info.h +++ b/net/mac80211/sta_info.h @@ -384,6 +384,14 @@ struct ieee80211_sta_rx_stats { u64 msdu[IEEE80211_NUM_TIDS + 1]; }; +#define STA_CPARAMS_HYSTERESIS (2L * NSEC_PER_SEC) +#define STA_SLOW_THRESHOLD 8000 /* 8 Mbps */ + +struct sta_codel_params { + struct codel_params params; + u64 update_time; +}; + /** * struct sta_info - STA information * @@ -437,6 +445,7 @@ struct ieee80211_sta_rx_stats { * @known_smps_mode: the smps_mode the client thinks we are in. Relevant for * AP only. * @cipher_scheme: optional cipher scheme for this station + * @cparams: CoDel parameters for this station. * @reserved_tid: reserved TID (if any, otherwise IEEE80211_TID_UNRESERVED) * @fast_tx: TX fastpath information * @fast_rx: RX fastpath information @@ -540,6 +549,8 @@ struct sta_info { enum ieee80211_smps_mode known_smps_mode; const struct ieee80211_cipher_scheme *cipher_scheme; + struct sta_codel_params cparams; + u8 reserved_tid; struct cfg80211_chan_def tdls_chandef; @@ -713,6 +724,7 @@ void sta_set_rate_info_tx(struct sta_info *sta, void sta_set_sinfo(struct sta_info *sta, struct station_info *sinfo); u32 sta_get_expected_throughput(struct sta_info *sta); +void sta_update_codel_params(struct sta_info *sta, u32 thr); void ieee80211_sta_expire(struct ieee80211_sub_if_data *sdata, unsigned long exp_time); diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c index efc38e7..ec60ac1 100644 --- a/net/mac80211/tx.c +++ b/net/mac80211/tx.c @@ -1342,9 +1342,16 @@ static struct sk_buff *fq_tin_dequeue_func(struct fq *fq, local = container_of(fq, struct ieee80211_local, fq); txqi = container_of(tin, struct txq_info, tin); - cparams = &local->cparams; cstats = &local->cstats; + if (txqi->txq.sta) { + struct sta_info *sta = container_of(txqi->txq.sta, + struct sta_info, sta); + cparams = &sta->cparams.params; + } else { + cparams = &local->cparams; + } + if (flow == &txqi->def_flow) cvars = &txqi->def_cvars; else