From patchwork Thu Nov 24 18:14:09 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anthony PERARD X-Patchwork-Id: 9446155 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 916116071C for ; Thu, 24 Nov 2016 18:16:54 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 8655127FBC for ; Thu, 24 Nov 2016 18:16:54 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 7A93F280F4; Thu, 24 Nov 2016 18:16:54 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=2.0 tests=BAYES_00, RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id C367D280D0 for ; Thu, 24 Nov 2016 18:16:52 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1c9yXW-0005az-Ky; Thu, 24 Nov 2016 18:14:30 +0000 Received: from mail6.bemta6.messagelabs.com ([193.109.254.103]) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1c9yXV-0005am-Lw for xen-devel@lists.xen.org; Thu, 24 Nov 2016 18:14:29 +0000 Received: from [193.109.254.147] by server-6.bemta-6.messagelabs.com id 94/21-28843-40E27385; Thu, 24 Nov 2016 18:14:28 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFmplkeJIrShJLcpLzFFi42JxWrohUpdFzzz C4Gsrr8WSj4tZHBg9ju7+zRTAGMWamZeUX5HAmjG55ylrwbLCik/LvjE2MN7x7WLk5JAQ8Jd4 t+oDG4jNJmAgsWL6VUYQW0RAVmJ11xx2EJtZIELixY1VYDXCAkkSE2dMYgWxWQRUJTb0vwKze QXsJKbfamSCmCkvsfD8ETBbSEBN4sbCZSwQNYISJ2c+YYGYKSFx8MUL5gmM3LOQpGYhSS1gZF rFqFGcWlSWWqRrZKqXVJSZnlGSm5iZo2toYKaXm1pcnJiempOYVKyXnJ+7iREYDAxAsINx1YL AQ4ySHExKorybhcwjhPiS8lMqMxKLM+KLSnNSiw8xynBwKEnw2usA5QSLUtNTK9Iyc4BhCZOW 4OBREuEN0wJK8xYXJOYWZ6ZDpE4xWnK82fXyARPHvzmvgOSSvZ8fMAmx5OXnpUqJ8zaAzBMAa cgozYMbB4udS4yyUsK8jEAHCvEUpBblZpagyr9iFOdgVBLmrQaZwpOZVwK39RXQQUxAB0l+Mw Y5qCQRISXVwDj/qubcuLNc5qGT7dbe6tdXuuTEfEDz0baJb00COLprX/9L186dWtqqJZLstef MVQPLiyaLy8/n9L629Vmf+uTn5S2bJ820co8L2O+nURxVtiOnuvBWxs3LFaZXd//uEuvfMj1/ k2R2X3LXNHOmWTs0zs3j0Qk5pD79du7/kuWr47s/LVNjYlRiKc5INNRiLipOBACRrsPqmAIAA A== X-Env-Sender: prvs=1297afe57=anthony.perard@citrix.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1480011266!53749515!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n, received_headers: No Received headers X-StarScan-Received: X-StarScan-Version: 9.0.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 27537 invoked from network); 24 Nov 2016 18:14:27 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-10.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 24 Nov 2016 18:14:27 -0000 X-IronPort-AV: E=Sophos;i="5.31,543,1473120000"; d="scan'208";a="391288889" From: Anthony PERARD To: Date: Thu, 24 Nov 2016 18:14:09 +0000 Message-ID: <20161124181412.18266-1-anthony.perard@citrix.com> X-Mailer: git-send-email 2.10.2 MIME-Version: 1.0 Cc: Anthony PERARD , Ian Jackson Subject: [Xen-devel] [OSSTEST PATCH v8 0/3] Have OpenStack tested on top of xen's master and libvirt's master. X-BeenThere: xen-devel@lists.xen.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xen.org Sender: "Xen-devel" X-Virus-Scanned: ClamAV using ClamSMTP Hi, I have looked into getting OpenStack been tested on the latest Xen via osstest. The ts-openstack-deploy script does prepare a bit more the host, clone devstack and other OpenStack trees, then run ./stack.sh, which is a bit like raisin and deploy OpenStack on the host. Once the machine is ready, the integration test suite from OpenStack, Tempest, is started by ts-openstack-tempest. Thanks. Changes in V8: - few coding style fixes - fix flight generation Changes in V7: - few changes detailed in patches Changes in V6: - rebased - fix ts-openstack-deploy script to work with newer devstach and new debian. Change in V5: - on small change in patch 1, but I keeped the acked-by - few changes in the way the flight is created (in the last patch) Change in V4: few changes listed in second and third patch, mostly cleanup. Change in V3: - Track Nova tree instead of devstack. Nova is the service we care about from a Xen point of view. Also it is updated much more often than devstack. - Cleanups, see change log in patches. Changes in V2: - no more Osstest::Toolstack::OpenStack. - osstest now clone every single tree that devstack is going to need. And ./stack.sh should fail if one tree is missing. - avoid build-*-xsm for an openstack flight - rename ts-devstack to ts-openstack-devstack - New test script ts-openstack-tempest - Add CONFIG_CRYPTO_XTS=m to the kernel build. - new possible runvar $dom0_mem to control dom0 memory - several fix to have volume tests working. - have OpenStack deploy from it's builddir instead of /opt/stack - have 4GB for dom0 instead of relying on balloning. Run of AP_FETCH_PLACEHOLDERS=y ./standalone-generate-dump-flight-runvars on master (5d88d6299618f6bce204d82579392a76028fb8cd) vs this patch series: Anthony PERARD (3): ts-openstack-deploy: Deploy OpenStack on a host with devstack ts-openstack-tempest: Run Tempest to check OpenStack Create a flight to test OpenStack with xen-unstable and libvirt ap-common | 18 +++++++ ap-fetch-version | 4 ++ ap-fetch-version-old | 5 ++ ap-print-url | 3 ++ ap-push | 5 ++ cr-daily-branch | 8 +++ cr-for-branches | 2 +- cri-common | 1 + make-flight | 51 ++++++++++++++++++- sg-run-job | 6 +++ ts-openstack-deploy | 137 +++++++++++++++++++++++++++++++++++++++++++++++++++ ts-openstack-tempest | 64 ++++++++++++++++++++++++ 12 files changed, 302 insertions(+), 2 deletions(-) create mode 100755 ts-openstack-deploy create mode 100755 ts-openstack-tempest --- master ./standalone-generate-dump-flight-runvars +++ openstack-patch-v8 ./standalone-generate-dump-flight-runvars @@ -7742,6 +7742,118 @@ linux-arm-xen test-armhf-armhf-xl-rtds xenbuildjob build-armhf linux-arm-xen test-armhf-armhf-xl-vhd xenbuildjob build-armhf linux-arm-xen test-armhf-armhf-xl-xsm xenbuildjob build-armhf-xsm +openstack-nova build-amd64 all_host_di_version current +openstack-nova build-amd64-libvirt all_host_di_version current +openstack-nova build-amd64-pvops all_host_di_version current +openstack-nova build-amd64-xsm all_host_di_version current +openstack-nova test-amd64-amd64-devstack all_host_di_version current +openstack-nova test-amd64-amd64-devstack-xsm all_host_di_version current +openstack-nova build-amd64 all_host_suite jessie +openstack-nova build-amd64-libvirt all_host_suite jessie +openstack-nova build-amd64-pvops all_host_suite jessie +openstack-nova build-amd64-xsm all_host_suite jessie +openstack-nova test-amd64-amd64-devstack all_host_suite jessie +openstack-nova test-amd64-amd64-devstack-xsm all_host_suite jessie +openstack-nova test-amd64-amd64-devstack all_hostflags arch-amd64,arch-xen-amd64,suite-jessie,purpose-test +openstack-nova test-amd64-amd64-devstack-xsm all_hostflags arch-amd64,arch-xen-amd64,suite-jessie,purpose-test +openstack-nova build-amd64 arch amd64 +openstack-nova build-amd64-libvirt arch amd64 +openstack-nova build-amd64-pvops arch amd64 +openstack-nova build-amd64-xsm arch amd64 +openstack-nova test-amd64-amd64-devstack arch amd64 +openstack-nova test-amd64-amd64-devstack-xsm arch amd64 +openstack-nova build-amd64 build_lvextend_max 50 +openstack-nova build-amd64-libvirt build_lvextend_max 50 +openstack-nova build-amd64-pvops build_lvextend_max 50 +openstack-nova build-amd64-xsm build_lvextend_max 50 +openstack-nova build-amd64-libvirt buildjob build-amd64 +openstack-nova test-amd64-amd64-devstack buildjob build-amd64 +openstack-nova test-amd64-amd64-devstack-xsm buildjob build-amd64-xsm +openstack-nova test-amd64-amd64-devstack dom0_mem 4000 +openstack-nova test-amd64-amd64-devstack-xsm dom0_mem 4000 +openstack-nova build-amd64 enable_ovmf true +openstack-nova build-amd64-xsm enable_ovmf true +openstack-nova build-amd64 enable_xend false +openstack-nova build-amd64-xsm enable_xend false +openstack-nova build-amd64 enable_xsm false +openstack-nova build-amd64-xsm enable_xsm true +openstack-nova test-amd64-amd64-devstack enable_xsm false +openstack-nova test-amd64-amd64-devstack-xsm enable_xsm true +openstack-nova build-amd64 host_hostflags share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build +openstack-nova build-amd64-libvirt host_hostflags share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build +openstack-nova build-amd64-pvops host_hostflags share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build +openstack-nova build-amd64-xsm host_hostflags share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build +openstack-nova build-amd64-pvops kconfighow xen-enable-xen-config +openstack-nova test-amd64-amd64-devstack kernbuildjob build-amd64-pvops +openstack-nova test-amd64-amd64-devstack-xsm kernbuildjob build-amd64-pvops +openstack-nova test-amd64-amd64-devstack kernkind pvops +openstack-nova test-amd64-amd64-devstack-xsm kernkind pvops +openstack-nova test-amd64-amd64-devstack libvirtbuildjob build-amd64-libvirt +openstack-nova test-amd64-amd64-devstack-xsm libvirtbuildjob build-amd64-libvirt +openstack-nova test-amd64-amd64-devstack revision_cinder +openstack-nova test-amd64-amd64-devstack-xsm revision_cinder +openstack-nova test-amd64-amd64-devstack revision_devstack +openstack-nova test-amd64-amd64-devstack-xsm revision_devstack +openstack-nova test-amd64-amd64-devstack revision_glance +openstack-nova test-amd64-amd64-devstack-xsm revision_glance +openstack-nova test-amd64-amd64-devstack revision_keystone +openstack-nova test-amd64-amd64-devstack-xsm revision_keystone +openstack-nova build-amd64-libvirt revision_libvirt ap-fetch-version-baseline:libvirt +openstack-nova build-amd64-pvops revision_linux ap-fetch-version-baseline:linux +openstack-nova build-amd64-pvops revision_linuxfirmware ap-fetch-version-baseline:linuxfirmware +openstack-nova build-amd64 revision_minios +openstack-nova build-amd64-xsm revision_minios +openstack-nova test-amd64-amd64-devstack revision_nova ap-fetch-version:openstack-nova +openstack-nova test-amd64-amd64-devstack-xsm revision_nova ap-fetch-version:openstack-nova +openstack-nova build-amd64 revision_ovmf +openstack-nova build-amd64-xsm revision_ovmf +openstack-nova build-amd64 revision_qemu +openstack-nova build-amd64-xsm revision_qemu +openstack-nova build-amd64 revision_qemuu ap-fetch-version-baseline:qemu-upstream-unstable +openstack-nova build-amd64-xsm revision_qemuu ap-fetch-version-baseline:qemu-upstream-unstable +openstack-nova test-amd64-amd64-devstack revision_requirements +openstack-nova test-amd64-amd64-devstack-xsm revision_requirements +openstack-nova build-amd64 revision_seabios +openstack-nova build-amd64-xsm revision_seabios +openstack-nova test-amd64-amd64-devstack revision_tempest +openstack-nova test-amd64-amd64-devstack-xsm revision_tempest +openstack-nova build-amd64 revision_xen ap-fetch-version-baseline:xen-unstable +openstack-nova build-amd64-xsm revision_xen ap-fetch-version-baseline:xen-unstable +openstack-nova test-amd64-amd64-devstack toolstack libvirt +openstack-nova test-amd64-amd64-devstack-xsm toolstack libvirt +openstack-nova test-amd64-amd64-devstack tree_cinder git://git.openstack.org/openstack/cinder.git +openstack-nova test-amd64-amd64-devstack-xsm tree_cinder git://git.openstack.org/openstack/cinder.git +openstack-nova test-amd64-amd64-devstack tree_devstack git://git.openstack.org/openstack-dev/devstack.git +openstack-nova test-amd64-amd64-devstack-xsm tree_devstack git://git.openstack.org/openstack-dev/devstack.git +openstack-nova test-amd64-amd64-devstack tree_glance git://git.openstack.org/openstack/glance.git +openstack-nova test-amd64-amd64-devstack-xsm tree_glance git://git.openstack.org/openstack/glance.git +openstack-nova test-amd64-amd64-devstack tree_keystone git://git.openstack.org/openstack/keystone.git +openstack-nova test-amd64-amd64-devstack-xsm tree_keystone git://git.openstack.org/openstack/keystone.git +openstack-nova build-amd64-libvirt tree_libvirt git://xenbits.xen.org/libvirt.git +openstack-nova build-amd64-pvops tree_linux git://xenbits.xen.org/linux-pvops.git +openstack-nova build-amd64-pvops tree_linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git +openstack-nova build-amd64 tree_minios +openstack-nova build-amd64-xsm tree_minios +openstack-nova test-amd64-amd64-devstack tree_nova git://git.openstack.org/openstack/nova.git +openstack-nova test-amd64-amd64-devstack-xsm tree_nova git://git.openstack.org/openstack/nova.git +openstack-nova build-amd64 tree_ovmf +openstack-nova build-amd64-xsm tree_ovmf +openstack-nova build-amd64 tree_qemu git://xenbits.xen.org/qemu-xen-traditional.git +openstack-nova build-amd64-xsm tree_qemu git://xenbits.xen.org/qemu-xen-traditional.git +openstack-nova build-amd64 tree_qemuu git://xenbits.xen.org/qemu-xen.git +openstack-nova build-amd64-xsm tree_qemuu git://xenbits.xen.org/qemu-xen.git +openstack-nova test-amd64-amd64-devstack tree_requirements git://git.openstack.org/openstack/requirements.git +openstack-nova test-amd64-amd64-devstack-xsm tree_requirements git://git.openstack.org/openstack/requirements.git +openstack-nova build-amd64 tree_seabios +openstack-nova build-amd64-xsm tree_seabios +openstack-nova test-amd64-amd64-devstack tree_tempest git://git.openstack.org/openstack/tempest.git +openstack-nova test-amd64-amd64-devstack-xsm tree_tempest git://git.openstack.org/openstack/tempest.git +openstack-nova build-amd64 tree_xen git://xenbits.xen.org/xen.git +openstack-nova build-amd64-libvirt tree_xen git://xenbits.xen.org/xen.git +openstack-nova build-amd64-xsm tree_xen git://xenbits.xen.org/xen.git +openstack-nova build-amd64-pvops treevcs_linux git +openstack-nova test-amd64-amd64-devstack xenbuildjob build-amd64 +openstack-nova test-amd64-amd64-devstack-xsm xenbuildjob build-amd64-xsm osstest build-amd64 all_host_di_version current osstest build-amd64-libvirt all_host_di_version current osstest build-amd64-pvops all_host_di_version current