From patchwork Thu Mar 16 11:08:00 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yi Sun X-Patchwork-Id: 9627885 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 9D8CC6048C for ; Thu, 16 Mar 2017 11:16:22 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 94DC42857D for ; Thu, 16 Mar 2017 11:16:22 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 89BEF285B5; Thu, 16 Mar 2017 11:16:22 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.1 required=2.0 tests=BAYES_00,DKIM_SIGNED, RCVD_IN_DNSWL_MED,T_DKIM_INVALID autolearn=ham version=3.3.1 Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id DCCFF2857D for ; Thu, 16 Mar 2017 11:16:21 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1coTM5-0004Nh-3G; Thu, 16 Mar 2017 11:14:05 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1coTM4-0004M8-3g for xen-devel@lists.xenproject.org; Thu, 16 Mar 2017 11:14:04 +0000 Received: from [85.158.137.68] by server-7.bemta-3.messagelabs.com id CC/22-23854-B737AC85; Thu, 16 Mar 2017 11:14:03 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrLLMWRWlGSWpSXmKPExsVywNwkVreq+FS EwYpF6hbft0xmcmD0OPzhCksAYxRrZl5SfkUCa8bbQ4cZC965VjTs+snewPjRsIuRi4NF4BaT xOWPU9hAHCGBaYwS+5a/ZOpi5OSQEOCVOLJsBiuE7S/x+tRddoiiBkaJ5r2tjCAJNgF1icdfe 8AaRASUJO6tmswEUsQssJNJYt3p78wgCWGBOIkfB2ewgNgsAqoSH3t/soPYvAIeEt8aJkJtk5 M4eWwy2DZOoPjH9nYwW0jAXeLdhr/sExj5FjAyrGLUKE4tKkst0jU00UsqykzPKMlNzMzRNTQ w1stNLS5OTE/NSUwq1kvOz93ECAwWBiDYwbhiu+chRkkOJiVR3vIfJyKE+JLyUyozEosz4otK c1KLDzHKcHAoSfAeUToZISRYlJqeWpGWmQMMW5i0BAePkghvLkiat7ggMbc4Mx0idYpRUUqc9 wJIQgAkkVGaB9cGi5VLjLJSwryMQIcI8RSkFuVmlqDKv2IU52BUEubdDDKFJzOvBG76K6DFTE CL3344AbK4JBEhJdXAWLy6y1sr5/b5M16VoRdeu+y/6qj62uG8INN9k10RlzL5FATex0S+Ovf rQ6+m5mR1/76vSRNM3YNm3mJ+z7Li9vU6n9Cjf68l58Udv3VQwOz9QQfvv+9fV/HWb3jtuPBs 7dXa4qPzmU8GRv38Pc3YpfPF9bSqw1f6Vm8QmX9gXpKgkT/rJ9uSWiWW4oxEQy3mouJEACQUk VuQAgAA X-Env-Sender: yi.y.sun@linux.intel.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1489662818!78881615!9 X-Originating-IP: [192.55.52.93] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogMTkyLjU1LjUyLjkzID0+IDMyNDY2NQ==\n X-StarScan-Received: X-StarScan-Version: 9.2.3; banners=-,-,- X-VirusChecked: Checked Received: (qmail 8493 invoked from network); 16 Mar 2017 11:14:02 -0000 Received: from mga11.intel.com (HELO mga11.intel.com) (192.55.52.93) by server-2.tower-31.messagelabs.com with DHE-RSA-AES256-GCM-SHA384 encrypted SMTP; 16 Mar 2017 11:14:02 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=intel.com; i=@intel.com; q=dns/txt; s=intel; t=1489662842; x=1521198842; h=from:to:cc:subject:date:message-id:in-reply-to: references; bh=k77AprNWmqcSzxzGO+hLJoRfnT9b900m2anZnr5RAlU=; b=QHt9DUlFyfQnTvzboG4l5ojYiL573npM7G5wAz7OY2hz3shgGC6hVVsY gXOwXcBquabwRu6evEz4rQeoRh0KVw==; Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga102.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 16 Mar 2017 04:14:01 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.36,172,1486454400"; d="scan'208";a="944976489" Received: from vmmmba-s2600wft.bj.intel.com ([10.240.193.63]) by orsmga003.jf.intel.com with ESMTP; 16 Mar 2017 04:13:58 -0700 From: Yi Sun To: xen-devel@lists.xenproject.org Date: Thu, 16 Mar 2017 19:08:00 +0800 Message-Id: <1489662495-5375-11-git-send-email-yi.y.sun@linux.intel.com> X-Mailer: git-send-email 1.9.1 In-Reply-To: <1489662495-5375-1-git-send-email-yi.y.sun@linux.intel.com> References: <1489662495-5375-1-git-send-email-yi.y.sun@linux.intel.com> Cc: kevin.tian@intel.com, wei.liu2@citrix.com, andrew.cooper3@citrix.com, dario.faggioli@citrix.com, he.chen@linux.intel.com, ian.jackson@eu.citrix.com, Yi Sun , mengxu@cis.upenn.edu, jbeulich@suse.com, chao.p.peng@linux.intel.com, roger.pau@citrix.com Subject: [Xen-devel] [PATCH v9 10/25] x86: refactor psr: L3 CAT: set value: assemble features value array. X-BeenThere: xen-devel@lists.xen.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Errors-To: xen-devel-bounces@lists.xen.org Sender: "Xen-devel" X-Virus-Scanned: ClamAV using ClamSMTP Only can one COS ID be used by one domain at one time. That means all enabled features' COS registers at this COS ID are valid for this domain at that time. When user updates a feature's value, we need make sure all other features' values are not affected. So, we firstly need gather an array which contains all features current values and replace the setting feature's value in array to new value. Then, we can try to find if there is a COS ID on which all features' COS registers values are same as the array. If we can find, we just use this COS ID. If fail to find, we need pick a new COS ID. This patch implements value array assembling flow. Signed-off-by: Yi Sun --- v9: - add comments about boundary checking. (suggested by Wei Liu) - rename 'assemble_val_array' to 'combine_val_array' in pervious patch. (suggested by Wei Liu) - rename 'l3_cat_get_cos_num' to 'cat_get_cos_num' to cover all L3/L2 CAT features. (suggested by Roger Pau) - rename 'l3_cat_get_old_val' to 'cat_get_old_val' to cover all L3/L2 CAT features and reuse cat_get_val in it. (suggested by Roger Pau) - replace feature list handling to feature array handling. (suggested by Roger Pau) - modify patch title to indicate 'L3 CAT'. (suggested by Jan Beulich) - replace 'm' to 'new_val'. (suggested by Jan Beulich) - move cos check outside callback function. (suggested by Jan Beulich) - remove 'get_cos_num' callback function. (suggested by Jan Beulich) - changes about 'uint64_t' to 'uint32_t'. (suggested by Jan Beulich) v6: - change 'assemble_val_array' to 'combine_val_array'. (suggested by Konrad Rzeszutek Wilk) - check return value of 'get_old_val'. (suggested by Konrad Rzeszutek Wilk) - replace some 'EINVAL' to 'ENOSPC'. (suggested by Konrad Rzeszutek Wilk) v5: - modify comments according to changes of codes. (suggested by Jan Beulich) - change 'bool_t' to 'bool'. (suggested by Jan Beulich) - modify return value of callback functions because we do not need them to return number of entries the feature uses. In caller, we call 'get_cos_num' to get the number of entries the feature uses. (suggested by Jan Beulich) - modify variables names to make them better, e.g. 'feat_tmp' to 'feat'. (suggested by Jan Beulich) v4: - create this patch to make codes easier to understand. (suggested by Jan Beulich) --- xen/arch/x86/psr.c | 152 +++++++++++++++++++++++++++++++++++++++++++++++++++-- 1 file changed, 149 insertions(+), 3 deletions(-) diff --git a/xen/arch/x86/psr.c b/xen/arch/x86/psr.c index f8d4be4..18aad8e 100644 --- a/xen/arch/x86/psr.c +++ b/xen/arch/x86/psr.c @@ -101,6 +101,28 @@ struct feat_node { /* get_val is used to get feature COS register value. */ void (*get_val)(const struct feat_node *feat, unsigned int cos, enum cbm_type type, uint32_t *val); + + /* + * get_old_val and set_new_val are a pair of functions called in order. + * The caller will traverse all features in the array and call + * 'get_old_val' to get old_cos register value of all supported + * features. Then, call 'set_new_val' to set the new value for the + * designated feature. + * + * All the values are set into value array according to the traversal + * order, meaning the same order of feature array members. + * + * The return value meaning of set_new_val: + * 0 - success. + * negative - error. + */ + void (*get_old_val)(uint32_t val[], + const struct feat_node *feat, + unsigned int old_cos); + int (*set_new_val)(uint32_t val[], + const struct feat_node *feat, + enum cbm_type type, + uint32_t new_val); } ops; /* Encapsulate feature specific HW info here. */ @@ -212,6 +234,29 @@ static enum psr_feat_type psr_cbm_type_to_feat_type(enum cbm_type type) } /* CAT common functions implementation. */ +static bool psr_check_cbm(unsigned int cbm_len, uint32_t cbm) +{ + unsigned int first_bit, zero_bit; + + /* Set bits should only in the range of [0, cbm_len]. */ + if ( cbm & (~0ul << cbm_len) ) + return false; + + /* At least one bit need to be set. */ + if ( cbm == 0 ) + return false; + + first_bit = find_first_bit((uint64_t *)&cbm, cbm_len); + zero_bit = find_next_zero_bit((uint64_t *)&cbm, cbm_len, first_bit); + + /* Set bits should be contiguous. */ + if ( zero_bit < cbm_len && + find_next_bit((uint64_t *)&cbm, cbm_len, zero_bit) < cbm_len ) + return false; + + return true; +} + static void cat_init_feature(struct cpuid_leaf regs, struct feat_node *feat, struct psr_socket_info *info, @@ -285,11 +330,35 @@ static void cat_get_val(const struct feat_node *feat, unsigned int cos, *val = feat->cos_reg_val[cos]; } +/* val[] len checking is done by caller. */ +static void cat_get_old_val(uint32_t val[], + const struct feat_node *feat, + unsigned int old_cos) +{ + cat_get_val(feat, old_cos, 0, &val[0]); +} + +/* val[] len checking is done by caller. */ +static int cat_set_new_val(uint32_t val[], + const struct feat_node *feat, + enum cbm_type type, + uint32_t new_val) +{ + if ( !psr_check_cbm(feat->info.cat_info.cbm_len, new_val) ) + return -EINVAL; + + val[0] = new_val; + + return 0; +} + /* L3 CAT ops */ static const struct feat_ops l3_cat_ops = { .get_cos_max = cat_get_cos_max, .get_feat_info = cat_get_feat_info, .get_val = cat_get_val, + .get_old_val = cat_get_old_val, + .set_new_val = cat_set_new_val, }; static void __init parse_psr_bool(char *s, char *value, char *feature, @@ -581,7 +650,21 @@ int psr_get_val(struct domain *d, unsigned int socket, /* Set value functions */ static unsigned int get_cos_num(const struct psr_socket_info *info) { - return 0; + const struct feat_node *feat; + unsigned int num = 0, i; + + /* Get all features total amount. */ + for ( i = 0; i < PSR_SOCKET_MAX_FEAT; i++ ) + { + if ( !info->features[i] ) + continue; + + feat = info->features[i]; + + num += feat->cos_num; + } + + return num; } static int gather_val_array(uint32_t val[], @@ -589,7 +672,34 @@ static int gather_val_array(uint32_t val[], const struct psr_socket_info *info, unsigned int old_cos) { - return -EINVAL; + const struct feat_node *feat; + unsigned int i; + + if ( !val ) + return -EINVAL; + + /* Get all features current values according to old_cos. */ + for ( i = 0; i < PSR_SOCKET_MAX_FEAT; i++ ) + { + if ( !info->features[i] ) + continue; + + feat = info->features[i]; + + if ( old_cos > feat->ops.get_cos_max(feat) ) + old_cos = 0; + + /* value getting order is same as feature array */ + feat->ops.get_old_val(val, feat, old_cos); + + array_len -= feat->cos_num; + if ( array_len < 0 ) + return -ENOSPC; + + val += feat->cos_num; + } + + return 0; } static int insert_new_val_to_array(uint32_t val[], @@ -599,7 +709,43 @@ static int insert_new_val_to_array(uint32_t val[], enum cbm_type type, uint32_t new_val) { - return -EINVAL; + const struct feat_node *feat; + int ret; + unsigned int i; + + ASSERT(feat_type < PSR_SOCKET_MAX_FEAT); + + /* Set new value into array according to feature's position in array. */ + for ( i = 0; i < feat_type; i++ ) + { + if ( !info->features[i] ) + continue; + + feat = info->features[i]; + + array_len -= feat->cos_num; + if ( array_len <= 0 ) + return -ENOSPC; + + val += feat->cos_num; + } + + feat = info->features[feat_type]; + + array_len -= feat->cos_num; + if ( array_len < 0 ) + return -ENOSPC; + + /* + * Value setting position is same as feature array. + * Different features may have different setting behaviors, e.g. CDP + * has two values (DATA/CODE) which need us to save input value to + * different position in the array according to type, so we have to + * maintain a callback function. + */ + ret = feat->ops.set_new_val(val, feat, type, new_val); + + return ret; } static int find_cos(const uint32_t val[], uint32_t array_len,