From patchwork Thu Jul 6 01:53:16 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yi Sun X-Patchwork-Id: 9827445 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 6203C602BD for ; Thu, 6 Jul 2017 02:09:19 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 4B214285C7 for ; Thu, 6 Jul 2017 02:09:19 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 3FEFB285C9; Thu, 6 Jul 2017 02:09:19 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=2.0 tests=BAYES_00, RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id B8BA6285CC for ; Thu, 6 Jul 2017 02:09:18 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dSwCm-0001YC-1m; Thu, 06 Jul 2017 02:07:44 +0000 Received: from mail6.bemta6.messagelabs.com ([193.109.254.103]) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dSwCk-0001VU-N8 for xen-devel@lists.xenproject.org; Thu, 06 Jul 2017 02:07:42 +0000 Received: from [193.109.254.147] by server-4.bemta-6.messagelabs.com id FC/BC-02962-E6B9D595; Thu, 06 Jul 2017 02:07:42 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrPLMWRWlGSWpSXmKPExsXS1tYhr5s7Ozb S4PoWUYvvWyYzOTB6HP5whSWAMYo1My8pvyKBNWPBh43MBRc0K1at42xgvKLUxcjJISRQKdHd sYwNxJYQ4JU4smwGaxcjB5AdIDHjiXwXIxdQSQOjxPlTj5lAatgE1CUef+0Bs0UElCTurZrMB FLELHCYSeL6rS+sIAlhAQeJSxuXgdksAqoSJ+bNZgexeQU8JU4/+A21TE7i5LHJYDWcQPEjV5 vZIQ7ykNjY/pppAiPvAkaGVYwaxalFZalFuoaWeklFmekZJbmJmTm6hgZmermpxcWJ6ak5iUn Fesn5uZsYgcHAAAQ7GH8sCzjEKMnBpCTK+0c/NlKILyk/pTIjsTgjvqg0J7X4EKMMB4eSBK/O LKCcYFFqempFWmYOMCxh0hIcPEoivKuFgdK8xQWJucWZ6RCpU4zGHBtWr//CxPFqwv9vTEIse fl5qVLivPYgkwRASjNK8+AGweLlEqOslDAvI9BpQjwFqUW5mSWo8q8YxTkYlYR5g0Gm8GTmlc DtewV0ChPQKYqNMSCnlCQipKQaGCsSRHiuyctPujfF7Q7zo96XJred2dKcmG3L591evvRkxMZ j/bPX9odoi66XfXS5Rkc2SPh9omyDDbf96aVKJWtu7IueYWyR1V22MNc/8u7RrxvMzcxEDt7Q 2fWUxcp51ezCEyU6K/P352+q8o46LXu6uq6q1C8kLr94Y+eV9JTdqxyd6h9/VWIpzkg01GIuK k4EAMQZpl2SAgAA X-Env-Sender: yi.y.sun@linux.intel.com X-Msg-Ref: server-3.tower-27.messagelabs.com!1499306837!105490986!10 X-Originating-IP: [134.134.136.31] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 9.4.25; banners=-,-,- X-VirusChecked: Checked Received: (qmail 35789 invoked from network); 6 Jul 2017 02:07:40 -0000 Received: from mga06.intel.com (HELO mga06.intel.com) (134.134.136.31) by server-3.tower-27.messagelabs.com with DHE-RSA-AES256-GCM-SHA384 encrypted SMTP; 6 Jul 2017 02:07:40 -0000 Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by orsmga104.jf.intel.com with ESMTP; 05 Jul 2017 19:07:40 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos; i="5.40,314,1496127600"; d="scan'208"; a="1191048269" Received: from vmmmba-s2600wft.bj.intel.com ([10.240.193.80]) by fmsmga002.fm.intel.com with ESMTP; 05 Jul 2017 19:07:37 -0700 From: Yi Sun To: xen-devel@lists.xenproject.org Date: Thu, 6 Jul 2017 09:53:16 +0800 Message-Id: <1499305996-19029-24-git-send-email-yi.y.sun@linux.intel.com> X-Mailer: git-send-email 1.9.1 In-Reply-To: <1499305996-19029-1-git-send-email-yi.y.sun@linux.intel.com> References: <1499305996-19029-1-git-send-email-yi.y.sun@linux.intel.com> Cc: kevin.tian@intel.com, wei.liu2@citrix.com, andrew.cooper3@citrix.com, dario.faggioli@citrix.com, He Chen , ian.jackson@eu.citrix.com, Yi Sun , mengxu@cis.upenn.edu, jbeulich@suse.com, chao.p.peng@linux.intel.com, roger.pau@citrix.com Subject: [Xen-devel] [PATCH v13 23/23] docs: add L2 CAT description in docs. X-BeenThere: xen-devel@lists.xen.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Errors-To: xen-devel-bounces@lists.xen.org Sender: "Xen-devel" X-Virus-Scanned: ClamAV using ClamSMTP This patch adds L2 CAT description in related documents. Signed-off-by: He Chen Signed-off-by: Yi Sun Acked-by: Wei Liu --- v13: - rebase the patch on latest code. --- docs/man/xl.pod.1.in | 27 +++++++++++++++++++++++---- docs/misc/xl-psr.markdown | 18 ++++++++++++------ 2 files changed, 35 insertions(+), 10 deletions(-) diff --git a/docs/man/xl.pod.1.in b/docs/man/xl.pod.1.in index d87fe16..16c8306 100644 --- a/docs/man/xl.pod.1.in +++ b/docs/man/xl.pod.1.in @@ -1712,6 +1712,9 @@ occupancy monitoring share the same set of underlying monitoring service. Once a domain is attached to the monitoring service, monitoring data can be shown for any of these monitoring types. +There is no cache monitoring and memory bandwidth monitoring on L2 cache so +far. + =over 4 =item B I @@ -1736,7 +1739,7 @@ monitor types are: Intel Broadwell and later server platforms offer capabilities to configure and make use of the Cache Allocation Technology (CAT) mechanisms, which enable more -cache resources (i.e. L3 cache) to be made available for high priority +cache resources (i.e. L3/L2 cache) to be made available for high priority applications. In the Xen implementation, CAT is used to control cache allocation on VM basis. To enforce cache on a specific domain, just set capacity bitmasks (CBM) for the domain. @@ -1746,11 +1749,11 @@ Intel Broadwell and later server platforms also offer Code/Data Prioritization applications. CDP is used on a per VM basis in the Xen implementation. To specify code or data CBM for the domain, CDP feature must be enabled and CBM type options need to be specified when setting CBM, and the type options (code -and data) are mutually exclusive. +and data) are mutually exclusive. There is no CDP support on L2 so far. =over 4 -=item B [I] I I +=item B [I] I I Set cache capacity bitmasks(CBM) for a domain. For how to specify I please refer to L. @@ -1763,6 +1766,11 @@ B Specify the socket to process, otherwise all sockets are processed. +=item B<-l LEVEL>, B<--level=LEVEL> + +Specify the cache level to process, otherwise the last level cache (L3) is +processed. + =item B<-c>, B<--code> Set code CBM when CDP is enabled. @@ -1773,10 +1781,21 @@ Set data CBM when CDP is enabled. =back -=item B [I] +=item B [I] [I] Show CAT settings for a certain domain or all domains. +B + +=over 4 + +=item B<-l LEVEL>, B<--level=LEVEL> + +Specify the cache level to process, otherwise the last level cache (L3) is +processed. + +=back + =back =head1 IGNORED FOR COMPATIBILITY WITH XM diff --git a/docs/misc/xl-psr.markdown b/docs/misc/xl-psr.markdown index c3c1e8e..04dd957 100644 --- a/docs/misc/xl-psr.markdown +++ b/docs/misc/xl-psr.markdown @@ -70,7 +70,7 @@ total-mem-bandwidth instead of cache-occupancy). E.g. after a `xl psr-cmt-attach Cache Allocation Technology (CAT) is a new feature available on Intel Broadwell and later server platforms that allows an OS or Hypervisor/VMM to -partition cache allocation (i.e. L3 cache) based on application priority or +partition cache allocation (i.e. L3/L2 cache) based on application priority or Class of Service (COS). Each COS is configured using capacity bitmasks (CBM) which represent cache capacity and indicate the degree of overlap and isolation between classes. System cache resource is divided into numbers of @@ -107,7 +107,7 @@ System CAT information such as maximum COS and CBM length can be obtained by: The simplest way to change a domain's CBM from its default is running: -`xl psr-cat-cbm-set [OPTIONS] ` +`xl psr-cat-set [OPTIONS] ` where cbm is a number to represent the corresponding cache subset can be used. A cbm is valid only when: @@ -119,13 +119,19 @@ A cbm is valid only when: In a multi-socket system, the same cbm will be set on each socket by default. Per socket cbm can be specified with the `--socket SOCKET` option. +In different systems, the different cache level is supported, e.g. L3 cache or +L2 cache. Per cache level cbm can be specified with the `--level LEVEL` option. + Setting the CBM may not be successful if insufficient COS is available. In such case unused COS(es) may be freed by setting CBM of all related domains to its default value(all-ones). Per domain CBM settings can be shown by: -`xl psr-cat-show` +`xl psr-cat-show [OPTIONS] ` + +In different systems, the different cache level is supported, e.g. L3 cache or +L2 cache. Per cache level cbm can be specified with the `--level LEVEL` option. ## Code and Data Prioritization (CDP) @@ -172,13 +178,13 @@ options is invalid. Example: Setting code CBM for a domain: -`xl psr-cat-cbm-set -c ` +`xl psr-cat-set -c ` Setting data CBM for a domain: -`xl psr-cat-cbm-set -d ` +`xl psr-cat-set -d ` Setting the same code and data CBM for a domain: -`xl psr-cat-cbm-set ` +`xl psr-cat-set ` ## Reference