[OSSTEST,v9,0/3] Have OpenStack tested on top of xen's master and libvirt's master.

Commit Message

Anthony PERARD Dec. 13, 2016, 6:10 p.m. UTC

Hi,

I have looked into getting OpenStack been tested on the latest Xen via
osstest.

The ts-openstack-deploy script does prepare a bit more the host, clone
devstack and other OpenStack trees, then run ./stack.sh, which is a bit
like raisin and deploy OpenStack on the host. Once the machine is ready,
the integration test suite from OpenStack, Tempest, is started by
ts-openstack-tempest.

Thanks.

Changes in V9:
  - enable test on armhf
  - rename runvars to {tree,revision}_openstack_*

Changes in V8:
  - few coding style fixes
  - fix flight generation

Changes in V7:
  - few changes detailed in patches

Changes in V6:
  - rebased
  - fix ts-openstack-deploy script to work with newer devstach and new debian.

Change in V5:
  - on small change in patch 1, but I keeped the acked-by
  - few changes in the way the flight is created (in the last patch)

Change in V4:
  few changes listed in second and third patch, mostly cleanup.

Change in V3:
  - Track Nova tree instead of devstack.
      Nova is the service we care about from a Xen point of view.
      Also it is updated much more often than devstack.
  - Cleanups, see change log in patches.

Changes in V2:
  - no more Osstest::Toolstack::OpenStack.
  - osstest now clone every single tree that devstack is going to need.
    And ./stack.sh should fail if one tree is missing.
  - avoid build-*-xsm for an openstack flight
  - rename ts-devstack to ts-openstack-devstack
  - New test script ts-openstack-tempest
  - Add CONFIG_CRYPTO_XTS=m to the kernel build.
  - new possible runvar $dom0_mem to control dom0 memory
  - several fix to have volume tests working.
  - have OpenStack deploy from it's builddir instead of /opt/stack
  - have 4GB for dom0 instead of relying on balloning.

Run of AP_FETCH_PLACEHOLDERS=y ./standalone-generate-dump-flight-runvars on
master (5d88d6299618f6bce204d82579392a76028fb8cd) vs this patch series:


Anthony PERARD (3):
  ts-openstack-deploy: Deploy OpenStack on a host with devstack
  ts-openstack-tempest: Run Tempest to check OpenStack
  Create a flight to test OpenStack with xen-unstable and libvirt

 ap-common            |  18 +++++++
 ap-fetch-version     |   4 ++
 ap-fetch-version-old |   5 ++
 ap-print-url         |   3 ++
 ap-push              |   5 ++
 cr-daily-branch      |   8 +++
 cr-for-branches      |   2 +-
 cri-common           |   1 +
 make-flight          |  45 ++++++++++++++++-
 sg-run-job           |   6 +++
 ts-openstack-deploy  | 137 +++++++++++++++++++++++++++++++++++++++++++++++++++
 ts-openstack-tempest |  64 ++++++++++++++++++++++++
 12 files changed, 296 insertions(+), 2 deletions(-)
 create mode 100755 ts-openstack-deploy
 create mode 100755 ts-openstack-tempest

Patch

--- master ./standalone-generate-dump-flight-runvars
+++ openstack-patch-v9 ./standalone-generate-dump-flight-runvars
@@ -7742,6 +7742,231 @@ 
 linux-arm-xen              test-armhf-armhf-xl-rtds       xenbuildjob             build-armhf
 linux-arm-xen              test-armhf-armhf-xl-vhd        xenbuildjob             build-armhf
 linux-arm-xen              test-armhf-armhf-xl-xsm        xenbuildjob             build-armhf-xsm
+openstack-nova             build-amd64                   all_host_di_version              current
+openstack-nova             build-amd64-libvirt           all_host_di_version              current
+openstack-nova             build-amd64-pvops             all_host_di_version              current
+openstack-nova             build-amd64-xsm               all_host_di_version              current
+openstack-nova             build-armhf                   all_host_di_version              current
+openstack-nova             build-armhf-libvirt           all_host_di_version              current
+openstack-nova             build-armhf-pvops             all_host_di_version              current
+openstack-nova             build-armhf-xsm               all_host_di_version              current
+openstack-nova             test-amd64-amd64-devstack     all_host_di_version              current
+openstack-nova             test-amd64-amd64-devstack-xsm all_host_di_version              current
+openstack-nova             test-armhf-armhf-devstack     all_host_di_version              current
+openstack-nova             test-armhf-armhf-devstack-xsm all_host_di_version              current
+openstack-nova             build-amd64                   all_host_suite                   jessie
+openstack-nova             build-amd64-libvirt           all_host_suite                   jessie
+openstack-nova             build-amd64-pvops             all_host_suite                   jessie
+openstack-nova             build-amd64-xsm               all_host_suite                   jessie
+openstack-nova             build-armhf                   all_host_suite                   jessie
+openstack-nova             build-armhf-libvirt           all_host_suite                   jessie
+openstack-nova             build-armhf-pvops             all_host_suite                   jessie
+openstack-nova             build-armhf-xsm               all_host_suite                   jessie
+openstack-nova             test-amd64-amd64-devstack     all_host_suite                   jessie
+openstack-nova             test-amd64-amd64-devstack-xsm all_host_suite                   jessie
+openstack-nova             test-armhf-armhf-devstack     all_host_suite                   jessie
+openstack-nova             test-armhf-armhf-devstack-xsm all_host_suite                   jessie
+openstack-nova             test-amd64-amd64-devstack     all_hostflags                    arch-amd64,arch-xen-amd64,suite-jessie,purpose-test
+openstack-nova             test-amd64-amd64-devstack-xsm all_hostflags                    arch-amd64,arch-xen-amd64,suite-jessie,purpose-test
+openstack-nova             test-armhf-armhf-devstack     all_hostflags                    arch-armhf,arch-xen-armhf,suite-jessie,purpose-test
+openstack-nova             test-armhf-armhf-devstack-xsm all_hostflags                    arch-armhf,arch-xen-armhf,suite-jessie,purpose-test
+openstack-nova             build-amd64                   arch                             amd64
+openstack-nova             build-amd64-libvirt           arch                             amd64
+openstack-nova             build-amd64-pvops             arch                             amd64
+openstack-nova             build-amd64-xsm               arch                             amd64
+openstack-nova             build-armhf                   arch                             armhf
+openstack-nova             build-armhf-libvirt           arch                             armhf
+openstack-nova             build-armhf-pvops             arch                             armhf
+openstack-nova             build-armhf-xsm               arch                             armhf
+openstack-nova             test-amd64-amd64-devstack     arch                             amd64
+openstack-nova             test-amd64-amd64-devstack-xsm arch                             amd64
+openstack-nova             test-armhf-armhf-devstack     arch                             armhf
+openstack-nova             test-armhf-armhf-devstack-xsm arch                             armhf
+openstack-nova             build-amd64                   build_lvextend_max               50
+openstack-nova             build-amd64-libvirt           build_lvextend_max               50
+openstack-nova             build-amd64-pvops             build_lvextend_max               50
+openstack-nova             build-amd64-xsm               build_lvextend_max               50
+openstack-nova             build-armhf                   build_lvextend_max               50
+openstack-nova             build-armhf-libvirt           build_lvextend_max               50
+openstack-nova             build-armhf-pvops             build_lvextend_max               50
+openstack-nova             build-armhf-xsm               build_lvextend_max               50
+openstack-nova             build-amd64-libvirt           buildjob                         build-amd64
+openstack-nova             build-armhf-libvirt           buildjob                         build-armhf
+openstack-nova             test-amd64-amd64-devstack     buildjob                         build-amd64
+openstack-nova             test-amd64-amd64-devstack-xsm buildjob                         build-amd64-xsm
+openstack-nova             test-armhf-armhf-devstack     buildjob                         build-armhf
+openstack-nova             test-armhf-armhf-devstack-xsm buildjob                         build-armhf-xsm
+openstack-nova             test-amd64-amd64-devstack     dom0_mem                         4000
+openstack-nova             test-amd64-amd64-devstack-xsm dom0_mem                         4000
+openstack-nova             test-armhf-armhf-devstack     dom0_mem                         4000
+openstack-nova             test-armhf-armhf-devstack-xsm dom0_mem                         4000
+openstack-nova             build-amd64                   enable_ovmf                      true
+openstack-nova             build-amd64-xsm               enable_ovmf                      true
+openstack-nova             build-armhf                   enable_ovmf                      true
+openstack-nova             build-armhf-xsm               enable_ovmf                      true
+openstack-nova             build-amd64                   enable_xend                      false
+openstack-nova             build-amd64-xsm               enable_xend                      false
+openstack-nova             build-armhf                   enable_xend                      false
+openstack-nova             build-armhf-xsm               enable_xend                      false
+openstack-nova             build-amd64                   enable_xsm                       false
+openstack-nova             build-amd64-xsm               enable_xsm                       true
+openstack-nova             build-armhf                   enable_xsm                       false
+openstack-nova             build-armhf-xsm               enable_xsm                       true
+openstack-nova             test-amd64-amd64-devstack     enable_xsm                       false
+openstack-nova             test-amd64-amd64-devstack-xsm enable_xsm                       true
+openstack-nova             test-armhf-armhf-devstack     enable_xsm                       false
+openstack-nova             test-armhf-armhf-devstack-xsm enable_xsm                       true
+openstack-nova             build-amd64                   host_hostflags                   share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build
+openstack-nova             build-amd64-libvirt           host_hostflags                   share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build
+openstack-nova             build-amd64-pvops             host_hostflags                   share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build
+openstack-nova             build-amd64-xsm               host_hostflags                   share-build-jessie-amd64,arch-amd64,suite-jessie,purpose-build
+openstack-nova             build-armhf                   host_hostflags                   share-build-jessie-armhf,arch-armhf,suite-jessie,purpose-build
+openstack-nova             build-armhf-libvirt           host_hostflags                   share-build-jessie-armhf,arch-armhf,suite-jessie,purpose-build
+openstack-nova             build-armhf-pvops             host_hostflags                   share-build-jessie-armhf,arch-armhf,suite-jessie,purpose-build
+openstack-nova             build-armhf-xsm               host_hostflags                   share-build-jessie-armhf,arch-armhf,suite-jessie,purpose-build
+openstack-nova             build-armhf-pvops             kconfig_override_y               CONFIG_EXT4_FS
+openstack-nova             build-amd64-pvops             kconfighow                       xen-enable-xen-config
+openstack-nova             build-armhf-pvops             kconfighow                       xen-enable-xen-config
+openstack-nova             test-amd64-amd64-devstack     kernbuildjob                     build-amd64-pvops
+openstack-nova             test-amd64-amd64-devstack-xsm kernbuildjob                     build-amd64-pvops
+openstack-nova             test-armhf-armhf-devstack     kernbuildjob                     build-armhf-pvops
+openstack-nova             test-armhf-armhf-devstack-xsm kernbuildjob                     build-armhf-pvops
+openstack-nova             test-amd64-amd64-devstack     kernkind                         pvops
+openstack-nova             test-amd64-amd64-devstack-xsm kernkind                         pvops
+openstack-nova             test-armhf-armhf-devstack     kernkind                         pvops
+openstack-nova             test-armhf-armhf-devstack-xsm kernkind                         pvops
+openstack-nova             test-amd64-amd64-devstack     libvirtbuildjob                  build-amd64-libvirt
+openstack-nova             test-amd64-amd64-devstack-xsm libvirtbuildjob                  build-amd64-libvirt
+openstack-nova             test-armhf-armhf-devstack     libvirtbuildjob                  build-armhf-libvirt
+openstack-nova             test-armhf-armhf-devstack-xsm libvirtbuildjob                  build-armhf-libvirt
+openstack-nova             build-amd64-libvirt           revision_libvirt                 ap-fetch-version-baseline:libvirt
+openstack-nova             build-armhf-libvirt           revision_libvirt                 ap-fetch-version-baseline:libvirt
+openstack-nova             build-amd64-pvops             revision_linux                   ap-fetch-version-baseline:linux
+openstack-nova             build-armhf-pvops             revision_linux                   ap-fetch-version-baseline:linux-arm-xen
+openstack-nova             build-amd64-pvops             revision_linuxfirmware           ap-fetch-version-baseline:linuxfirmware
+openstack-nova             build-armhf-pvops             revision_linuxfirmware           ap-fetch-version-baseline:linuxfirmware
+openstack-nova             build-amd64                   revision_minios
+openstack-nova             build-amd64-xsm               revision_minios
+openstack-nova             build-armhf                   revision_minios
+openstack-nova             build-armhf-xsm               revision_minios
+openstack-nova             test-amd64-amd64-devstack     revision_openstack_cinder
+openstack-nova             test-amd64-amd64-devstack-xsm revision_openstack_cinder
+openstack-nova             test-armhf-armhf-devstack     revision_openstack_cinder
+openstack-nova             test-armhf-armhf-devstack-xsm revision_openstack_cinder
+openstack-nova             test-amd64-amd64-devstack     revision_openstack_devstack
+openstack-nova             test-amd64-amd64-devstack-xsm revision_openstack_devstack
+openstack-nova             test-armhf-armhf-devstack     revision_openstack_devstack
+openstack-nova             test-armhf-armhf-devstack-xsm revision_openstack_devstack
+openstack-nova             test-amd64-amd64-devstack     revision_openstack_glance
+openstack-nova             test-amd64-amd64-devstack-xsm revision_openstack_glance
+openstack-nova             test-armhf-armhf-devstack     revision_openstack_glance
+openstack-nova             test-armhf-armhf-devstack-xsm revision_openstack_glance
+openstack-nova             test-amd64-amd64-devstack     revision_openstack_keystone
+openstack-nova             test-amd64-amd64-devstack-xsm revision_openstack_keystone
+openstack-nova             test-armhf-armhf-devstack     revision_openstack_keystone
+openstack-nova             test-armhf-armhf-devstack-xsm revision_openstack_keystone
+openstack-nova             test-amd64-amd64-devstack     revision_openstack_nova          ap-fetch-version:openstack-nova
+openstack-nova             test-amd64-amd64-devstack-xsm revision_openstack_nova          ap-fetch-version:openstack-nova
+openstack-nova             test-armhf-armhf-devstack     revision_openstack_nova          ap-fetch-version:openstack-nova
+openstack-nova             test-armhf-armhf-devstack-xsm revision_openstack_nova          ap-fetch-version:openstack-nova
+openstack-nova             test-amd64-amd64-devstack     revision_openstack_requirements
+openstack-nova             test-amd64-amd64-devstack-xsm revision_openstack_requirements
+openstack-nova             test-armhf-armhf-devstack     revision_openstack_requirements
+openstack-nova             test-armhf-armhf-devstack-xsm revision_openstack_requirements
+openstack-nova             test-amd64-amd64-devstack     revision_openstack_tempest
+openstack-nova             test-amd64-amd64-devstack-xsm revision_openstack_tempest
+openstack-nova             test-armhf-armhf-devstack     revision_openstack_tempest
+openstack-nova             test-armhf-armhf-devstack-xsm revision_openstack_tempest
+openstack-nova             build-amd64                   revision_ovmf
+openstack-nova             build-amd64-xsm               revision_ovmf
+openstack-nova             build-armhf                   revision_ovmf
+openstack-nova             build-armhf-xsm               revision_ovmf
+openstack-nova             build-amd64                   revision_qemu
+openstack-nova             build-amd64-xsm               revision_qemu
+openstack-nova             build-armhf                   revision_qemu
+openstack-nova             build-armhf-xsm               revision_qemu
+openstack-nova             build-amd64                   revision_qemuu                   ap-fetch-version-baseline:qemu-upstream-unstable
+openstack-nova             build-amd64-xsm               revision_qemuu                   ap-fetch-version-baseline:qemu-upstream-unstable
+openstack-nova             build-armhf                   revision_qemuu                   ap-fetch-version-baseline:qemu-upstream-unstable
+openstack-nova             build-armhf-xsm               revision_qemuu                   ap-fetch-version-baseline:qemu-upstream-unstable
+openstack-nova             build-amd64                   revision_seabios
+openstack-nova             build-amd64-xsm               revision_seabios
+openstack-nova             build-armhf                   revision_seabios
+openstack-nova             build-armhf-xsm               revision_seabios
+openstack-nova             build-amd64                   revision_xen                     ap-fetch-version-baseline:xen-unstable
+openstack-nova             build-amd64-xsm               revision_xen                     ap-fetch-version-baseline:xen-unstable
+openstack-nova             build-armhf                   revision_xen                     ap-fetch-version-baseline:xen-unstable
+openstack-nova             build-armhf-xsm               revision_xen                     ap-fetch-version-baseline:xen-unstable
+openstack-nova             test-amd64-amd64-devstack     toolstack                        libvirt
+openstack-nova             test-amd64-amd64-devstack-xsm toolstack                        libvirt
+openstack-nova             test-armhf-armhf-devstack     toolstack                        libvirt
+openstack-nova             test-armhf-armhf-devstack-xsm toolstack                        libvirt
+openstack-nova             build-amd64-libvirt           tree_libvirt                     git://xenbits.xen.org/libvirt.git
+openstack-nova             build-armhf-libvirt           tree_libvirt                     git://xenbits.xen.org/libvirt.git
+openstack-nova             build-amd64-pvops             tree_linux                       git://xenbits.xen.org/linux-pvops.git
+openstack-nova             build-armhf-pvops             tree_linux                       git://xenbits.xen.org/linux-pvops.git
+openstack-nova             build-amd64-pvops             tree_linuxfirmware               git://xenbits.xen.org/osstest/linux-firmware.git
+openstack-nova             build-armhf-pvops             tree_linuxfirmware               git://xenbits.xen.org/osstest/linux-firmware.git
+openstack-nova             build-amd64                   tree_minios
+openstack-nova             build-amd64-xsm               tree_minios
+openstack-nova             build-armhf                   tree_minios
+openstack-nova             build-armhf-xsm               tree_minios
+openstack-nova             test-amd64-amd64-devstack     tree_openstack_cinder            git://git.openstack.org/openstack/cinder.git
+openstack-nova             test-amd64-amd64-devstack-xsm tree_openstack_cinder            git://git.openstack.org/openstack/cinder.git
+openstack-nova             test-armhf-armhf-devstack     tree_openstack_cinder            git://git.openstack.org/openstack/cinder.git
+openstack-nova             test-armhf-armhf-devstack-xsm tree_openstack_cinder            git://git.openstack.org/openstack/cinder.git
+openstack-nova             test-amd64-amd64-devstack     tree_openstack_devstack          git://git.openstack.org/openstack-dev/devstack.git
+openstack-nova             test-amd64-amd64-devstack-xsm tree_openstack_devstack          git://git.openstack.org/openstack-dev/devstack.git
+openstack-nova             test-armhf-armhf-devstack     tree_openstack_devstack          git://git.openstack.org/openstack-dev/devstack.git
+openstack-nova             test-armhf-armhf-devstack-xsm tree_openstack_devstack          git://git.openstack.org/openstack-dev/devstack.git
+openstack-nova             test-amd64-amd64-devstack     tree_openstack_glance            git://git.openstack.org/openstack/glance.git
+openstack-nova             test-amd64-amd64-devstack-xsm tree_openstack_glance            git://git.openstack.org/openstack/glance.git
+openstack-nova             test-armhf-armhf-devstack     tree_openstack_glance            git://git.openstack.org/openstack/glance.git
+openstack-nova             test-armhf-armhf-devstack-xsm tree_openstack_glance            git://git.openstack.org/openstack/glance.git
+openstack-nova             test-amd64-amd64-devstack     tree_openstack_keystone          git://git.openstack.org/openstack/keystone.git
+openstack-nova             test-amd64-amd64-devstack-xsm tree_openstack_keystone          git://git.openstack.org/openstack/keystone.git
+openstack-nova             test-armhf-armhf-devstack     tree_openstack_keystone          git://git.openstack.org/openstack/keystone.git
+openstack-nova             test-armhf-armhf-devstack-xsm tree_openstack_keystone          git://git.openstack.org/openstack/keystone.git
+openstack-nova             test-amd64-amd64-devstack     tree_openstack_nova              git://git.openstack.org/openstack/nova.git
+openstack-nova             test-amd64-amd64-devstack-xsm tree_openstack_nova              git://git.openstack.org/openstack/nova.git
+openstack-nova             test-armhf-armhf-devstack     tree_openstack_nova              git://git.openstack.org/openstack/nova.git
+openstack-nova             test-armhf-armhf-devstack-xsm tree_openstack_nova              git://git.openstack.org/openstack/nova.git
+openstack-nova             test-amd64-amd64-devstack     tree_openstack_requirements      git://git.openstack.org/openstack/requirements.git
+openstack-nova             test-amd64-amd64-devstack-xsm tree_openstack_requirements      git://git.openstack.org/openstack/requirements.git
+openstack-nova             test-armhf-armhf-devstack     tree_openstack_requirements      git://git.openstack.org/openstack/requirements.git
+openstack-nova             test-armhf-armhf-devstack-xsm tree_openstack_requirements      git://git.openstack.org/openstack/requirements.git
+openstack-nova             test-amd64-amd64-devstack     tree_openstack_tempest           git://git.openstack.org/openstack/tempest.git
+openstack-nova             test-amd64-amd64-devstack-xsm tree_openstack_tempest           git://git.openstack.org/openstack/tempest.git
+openstack-nova             test-armhf-armhf-devstack     tree_openstack_tempest           git://git.openstack.org/openstack/tempest.git
+openstack-nova             test-armhf-armhf-devstack-xsm tree_openstack_tempest           git://git.openstack.org/openstack/tempest.git
+openstack-nova             build-amd64                   tree_ovmf
+openstack-nova             build-amd64-xsm               tree_ovmf
+openstack-nova             build-armhf                   tree_ovmf
+openstack-nova             build-armhf-xsm               tree_ovmf
+openstack-nova             build-amd64                   tree_qemu                        git://xenbits.xen.org/qemu-xen-traditional.git
+openstack-nova             build-amd64-xsm               tree_qemu                        git://xenbits.xen.org/qemu-xen-traditional.git
+openstack-nova             build-armhf                   tree_qemu                        git://xenbits.xen.org/qemu-xen-traditional.git
+openstack-nova             build-armhf-xsm               tree_qemu                        git://xenbits.xen.org/qemu-xen-traditional.git
+openstack-nova             build-amd64                   tree_qemuu                       git://xenbits.xen.org/qemu-xen.git
+openstack-nova             build-amd64-xsm               tree_qemuu                       git://xenbits.xen.org/qemu-xen.git
+openstack-nova             build-armhf                   tree_qemuu                       git://xenbits.xen.org/qemu-xen.git
+openstack-nova             build-armhf-xsm               tree_qemuu                       git://xenbits.xen.org/qemu-xen.git
+openstack-nova             build-amd64                   tree_seabios
+openstack-nova             build-amd64-xsm               tree_seabios
+openstack-nova             build-armhf                   tree_seabios
+openstack-nova             build-armhf-xsm               tree_seabios
+openstack-nova             build-amd64                   tree_xen                         git://xenbits.xen.org/xen.git
+openstack-nova             build-amd64-libvirt           tree_xen                         git://xenbits.xen.org/xen.git
+openstack-nova             build-amd64-xsm               tree_xen                         git://xenbits.xen.org/xen.git
+openstack-nova             build-armhf                   tree_xen                         git://xenbits.xen.org/xen.git
+openstack-nova             build-armhf-libvirt           tree_xen                         git://xenbits.xen.org/xen.git
+openstack-nova             build-armhf-xsm               tree_xen                         git://xenbits.xen.org/xen.git
+openstack-nova             build-amd64-pvops             treevcs_linux                    git
+openstack-nova             build-armhf-pvops             treevcs_linux                    git
+openstack-nova             test-amd64-amd64-devstack     xenbuildjob                      build-amd64
+openstack-nova             test-amd64-amd64-devstack-xsm xenbuildjob                      build-amd64-xsm
+openstack-nova             test-armhf-armhf-devstack     xenbuildjob                      build-armhf
+openstack-nova             test-armhf-armhf-devstack-xsm xenbuildjob                      build-armhf-xsm
 osstest                    build-amd64                                           all_host_di_version     current
 osstest                    build-amd64-libvirt                                   all_host_di_version     current
 osstest                    build-amd64-pvops                                     all_host_di_version     current