From patchwork Thu Apr 15 21:51:33 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Cleber Rosa X-Patchwork-Id: 12206049 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI, MENTIONS_GIT_HOSTING,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 766C6C433ED for ; Thu, 15 Apr 2021 21:53:01 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id F02DB610CD for ; Thu, 15 Apr 2021 21:53:00 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org F02DB610CD Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:60714 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lX9v1-0001K2-RX for qemu-devel@archiver.kernel.org; Thu, 15 Apr 2021 17:52:59 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:43422) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lX9u5-0008TA-6Y for qemu-devel@nongnu.org; Thu, 15 Apr 2021 17:52:01 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:49039) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lX9u2-0001j1-Hi for qemu-devel@nongnu.org; Thu, 15 Apr 2021 17:52:00 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1618523517; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=HX2Y4Cchvu61ADnwg90FzOyHqsaOBqKLkToY0HXaA3A=; b=MGcCG6VjVLlx90RH0tvLyOyM30LAWm7b9Oozq9g3vxtlSfxU2K+9I1QxwTHgr0GC9W4+pU zDPYNpNz1RzME4AqRoJpQSzUWkYvAoFs3kPlIEmMIcsMwolZVx9dNxnh6u7KKfnBjCj997 CDh7oQoAMcXTtRbtQlZb4gV7ZKmUQgI= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-521-KwZ3W8B-Mpe8s8QJxcmChQ-1; Thu, 15 Apr 2021 17:51:55 -0400 X-MC-Unique: KwZ3W8B-Mpe8s8QJxcmChQ-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id E2A9B107ACC7; Thu, 15 Apr 2021 21:51:53 +0000 (UTC) Received: from localhost.localdomain.com (ovpn-116-207.rdu2.redhat.com [10.10.116.207]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 915AC5D9DE; Thu, 15 Apr 2021 21:51:42 +0000 (UTC) From: Cleber Rosa To: qemu-devel@nongnu.org Subject: [PATCH 0/8] Tests: introduce custom jobs Date: Thu, 15 Apr 2021 17:51:33 -0400 Message-Id: <20210415215141.1865467-1-crosa@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=crosa@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Received-SPF: pass client-ip=216.205.24.124; envelope-from=crosa@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Aleksandar Rikalo , Beraldo Leal , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , Cornelia Huck , Thomas Huth , Wainer dos Santos Moschetta , =?utf-8?q?Philippe_Mathi?= =?utf-8?q?eu-Daud=C3=A9?= , Willian Rampazzo , Auger Eric , qemu-s390x@nongnu.org, Willian Rampazzo , Cleber Rosa , =?utf-8?q?Alex_Benn=C3=A9e?= , Aurelien Jarno , Eduardo Habkost Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" Different users (or even companies) have different interests, and may want to run a reduced set of tests during development, or a larger set of tests during QE. To cover these use cases, this introduces some example (but functional) jobs. It's expected that some common jobs will come up from common requirements for different users (and maybe be added to a common location such as tests/jobs), and that very specific jobs will be added to directories specific to certain groups, say "contrib/com.redhat/jobs" or the like. This series does *not* add new jobs to GitLab CI pipeline, but this is expected to be done later on custom runners. That is, custom runners could be used for custom jobs. Anyway, a GitLab CI pipeline can be seen here: https://gitlab.com/cleber.gnu/qemu/-/pipelines/287210066 This is based on the Avocado version bump patch: https://lists.gnu.org/archive/html/qemu-devel/2021-04/msg02391.html Based-On: <20210414161144.1598980-1-crosa@redhat.com> Cleber Rosa (8): Acceptance Jobs: preserve the cache for pip on GitLab CI Acceptance tests: do not try to reuse packages from the system tests/acceptance/linux_ssh_mips_malta.py: drop identical setUp tests/acceptance/migration.py: cancel test if migration is not supported tests/acceptance/cpu_queries.py: use the proper logging channels Acceptance tests: prevent shutdown on non-specific target tests tests/acceptance/migration.py: cancel test on s390x Tests: add custom test jobs .gitlab-ci.yml | 1 + configure | 2 +- tests/Makefile.include | 10 +++- tests/acceptance/cpu_queries.py | 4 +- tests/acceptance/linux_ssh_mips_malta.py | 7 +-- tests/acceptance/migration.py | 16 ++++-- tests/acceptance/version.py | 2 +- tests/jobs/acceptance-all-targets.py | 67 ++++++++++++++++++++++++ tests/jobs/acceptance-kvm-only.py | 35 +++++++++++++ tests/jobs/qtest-unit-acceptance.py | 31 +++++++++++ tests/jobs/qtest-unit.py | 24 +++++++++ tests/jobs/utils.py | 22 ++++++++ 12 files changed, 207 insertions(+), 14 deletions(-) create mode 100644 tests/jobs/acceptance-all-targets.py create mode 100644 tests/jobs/acceptance-kvm-only.py create mode 100644 tests/jobs/qtest-unit-acceptance.py create mode 100644 tests/jobs/qtest-unit.py create mode 100644 tests/jobs/utils.py