From patchwork Tue Oct 9 23:26:00 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Cleber Rosa X-Patchwork-Id: 10633395 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 39D6C13AD for ; Tue, 9 Oct 2018 23:27:49 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 2C37329B1F for ; Tue, 9 Oct 2018 23:27:49 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 1FEA329B8D; Tue, 9 Oct 2018 23:27:49 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from lists.gnu.org (lists.gnu.org [208.118.235.17]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id BEB8829B1F for ; Tue, 9 Oct 2018 23:27:48 +0000 (UTC) Received: from localhost ([::1]:54162 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gA1Po-0004K4-3d for patchwork-qemu-devel@patchwork.kernel.org; Tue, 09 Oct 2018 19:27:48 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:35938) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gA1OW-0003Mz-EK for qemu-devel@nongnu.org; Tue, 09 Oct 2018 19:26:29 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gA1OS-0000mR-T0 for qemu-devel@nongnu.org; Tue, 09 Oct 2018 19:26:28 -0400 Received: from mx1.redhat.com ([209.132.183.28]:41926) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1gA1OR-0000j2-J5 for qemu-devel@nongnu.org; Tue, 09 Oct 2018 19:26:24 -0400 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 6A4083082E06; Tue, 9 Oct 2018 23:26:16 +0000 (UTC) Received: from localhost.localdomain.com (ovpn-120-82.rdu2.redhat.com [10.10.120.82]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 2B6917ED60; Tue, 9 Oct 2018 23:26:09 +0000 (UTC) From: Cleber Rosa To: qemu-devel@nongnu.org Date: Tue, 9 Oct 2018 19:26:00 -0400 Message-Id: <20181009232607.15521-1-crosa@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.46]); Tue, 09 Oct 2018 23:26:16 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [PATCH v2 0/7] Acceptance Tests: basic architecture support X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Fam Zheng , Eduardo Habkost , Laszlo Ersek , Cleber Rosa , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , Stefan Hajnoczi , Caio Carrara , =?utf-8?q?Alex_Benn=C3=A9e?= Errors-To: qemu-devel-bounces+patchwork-qemu-devel=patchwork.kernel.org@nongnu.org Sender: "Qemu-devel" X-Virus-Scanned: ClamAV using ClamSMTP The current version of the Acceptance Tests have been basically tested on x86_64. Most of them should be valid tests on many different architectures. This introduces another standard test parameter, 'arch', and a public test attribute with the same name. Then, because of the different behavior in different QEMU targets, it adds a more explicit configuration of the QEMUMachine machine type used on the tests (the self.vm attribute). Finally, for tests that are known to be architecture specific, it changes the approach, from using tags to canceling the test. The difference is that this reuses the same 'arch' parameter (so no need to pass tags for the same reason), and instead of completely excluding the test from the job, it just won't be executed on architectures that are not supported. More details about this on the last commit. Changes from v1: ================ * Fixed typo in docstring (s/param/type) (Murilo) * Pretty print the "arch.json" variants file, in order to make editing easier and avoid hitting email line length limits (Eric, Philippe) * Distinguish between host and target arch when canceling tests (Philippe) Cleber Rosa (7): Acceptance Tests: improve docstring on pick_default_qemu_bin() Acceptance Tests: introduce arch parameter and attribute scripts/qemu.py: add method and private attribute for arch scripts/qemu.py: set predefined machine type based on arch Acceptance Tests: set machine type Acceptance Tests: add variants definition for architectures Acceptance Tests: change the handling of tests for specific archs docs/devel/testing.rst | 18 +++++ scripts/qemu.py | 29 ++++++- tests/acceptance/avocado_qemu/__init__.py | 17 ++++- tests/acceptance/boot_linux_console.py | 6 +- tests/acceptance/variants/arch.json | 92 +++++++++++++++++++++++ tests/acceptance/version.py | 2 + tests/acceptance/vnc.py | 5 ++ 7 files changed, 163 insertions(+), 6 deletions(-) create mode 100644 tests/acceptance/variants/arch.json