From patchwork Sun Aug 27 03:00:53 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Rajiv Ranganath X-Patchwork-Id: 9923655 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 75B3460380 for ; Sun, 27 Aug 2017 03:03:08 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 6765C28583 for ; Sun, 27 Aug 2017 03:03:08 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 5BEE92858F; Sun, 27 Aug 2017 03:03:08 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.1 required=2.0 tests=BAYES_00,DKIM_SIGNED, RCVD_IN_DNSWL_MED,T_DKIM_INVALID autolearn=ham version=3.3.1 Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 8951A28583 for ; Sun, 27 Aug 2017 03:03:07 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlnoq-0005Hq-96; Sun, 27 Aug 2017 03:01:00 +0000 Received: from mail6.bemta6.messagelabs.com ([193.109.254.103]) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dlnop-0005H6-Pg for xen-devel@lists.xen.org; Sun, 27 Aug 2017 03:00:59 +0000 Received: from [193.109.254.147] by server-8.bemta-6.messagelabs.com id B1/E0-09901-BE532A95; Sun, 27 Aug 2017 03:00:59 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFmphleJIrShJLcpLzFFi42Lxqg120X1luij SYF+vvsWSj4tZHBg9ju7+zRTAGMWamZeUX5HAmrFp03bGgjfWFb/OfGdqYNxk1MXIxSEkMJFR 4vOfXWwgDovAPlaJ5jmL2EEcCYGDrBI/m7uYuxg5gZw0iX/vFjBC2GUSJ/e/ZAexhQS0JBoXH GSDGPWVUeLX7A9sIAk2AWOJJYceg9kiAtIS1z5fBmrm4GAWkJI4fdAcJCwsEC5x6s1EVhCbRU BVYlfTTCYQm1fAXaLp+TwmiF1yEg3n74PdwCngIbH9xUtWiL3uEp++rgerEQWqWXm5hRWiV1D i5MwnLBCrNCXW79IHCTMLyEtsfzuHeQKjyCwkVbMQqmYhqVrAyLyKUaM4tagstUjXyFAvqSgz PaMkNzEzR9fQwEwvN7W4ODE9NScxqVgvOT93EyMw/BmAYAfjn2UBhxglOZiURHkdNBZGCvEl5 adUZiQWZ8QXleakFh9i1ODgELi7pHcDoxRLXn5eqpIE7xyTRZFCgkWp6akVaZk5wAiFKZXg4F ES4a0ESfMWFyTmFmemQ6ROMRpzbFi9/gsTx6QD278wCYFNkhLnnQlSKgBSmlGaBzcIljguMcp KCfMyAp0pxFOQWpSbWYIq/4pRnINRSZiXF5iGhHgy80rg9r0COoUJ6BRFwYUgp5QkIqSkGhg1 D+d/kXiXPcftrsxdO/EXkx07KkuWZfCYS1/fyWO6T37HdnnB/2+8LldIX/JfrDPBYJrY7bkiR eyTDkfsY5o+q6zXImyDT9X9GI4FYbvSQ25kKW/u1krYtrHWj/srk+L3rkXtDK7e5SFbFzk+aL n2/NKSaTZrjiSbXrx+S1pr3l2eev83ql1KLMUZiYZazEXFiQCC3IyHFwMAAA== X-Env-Sender: rajiv.ranganath@atihita.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1503802857!90420422!1 X-Originating-IP: [74.125.83.68] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 9.4.45; banners=-,-,- X-VirusChecked: Checked Received: (qmail 54746 invoked from network); 27 Aug 2017 03:00:58 -0000 Received: from mail-pg0-f68.google.com (HELO mail-pg0-f68.google.com) (74.125.83.68) by server-10.tower-27.messagelabs.com with AES128-GCM-SHA256 encrypted SMTP; 27 Aug 2017 03:00:58 -0000 Received: by mail-pg0-f68.google.com with SMTP id r133so3695486pgr.2 for ; Sat, 26 Aug 2017 20:00:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=atihita-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :user-agent:mime-version:content-transfer-encoding; bh=5R6dFMJ0oZM6XFMIlxjxws7kOnaqoLQXyDFuJsp1DuM=; b=sFaHEyDTKZuv8JKQX35gE0tcdwrmUJDL5dhm3a+xZ7knToYdOv4N12a+u+7EdzGsCw 89fwcEs/OSyk0zZTesbA6lol4FazrDvJ8isldOWawRrKAFEAfHrNlM/0VnsAClo4K6TC HqMpx4KvU3RNo3ZW2XLDUGhuBhJtR0NGcC/B6jtzfUG5t5rJRsugITdpvYQx/JoO81nk xh8rJ4HnJfz4EqqeLO7DsyNyfjtn3ye1ChhgBWAuYsZqwzZEgbMK26aqIbqDCc3CCyQl iTN3jgOfjo4+0chJw4uvpLnjSUGrHA+s9bHts48w6lM2Qh3MQ1HLk2/nnMUzdO0yDDj4 g/HQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:user-agent:mime-version:content-transfer-encoding; bh=5R6dFMJ0oZM6XFMIlxjxws7kOnaqoLQXyDFuJsp1DuM=; b=sGhfikQjxZBzcMQHSk4aR4mFPxFK3vQyq/mtfpyVBlf7AQLVSMRWq2cQbznM6CUVua XSe1r6M/I5jDSjQ1JV1ibi+Xy7RDRIHm8n2R2HbKIduKkruJQgEWat/G0Avys5CN8zQj ufndf9RvYRafkrxpQU+Y0BF36bf2QBiw5kLfAHnSC+SwAUYJhQkkTXmkrM0UvnnFWR5V vDdwZxfVI1HNFhfwfT8Fv4rhlbjbqPAGMAj4KAObarDGHIvUQxmQkM04GOrRKKWc2XCi k8AkbSfI6fAW3HZlnLmHF1H7hzIGP6/kcjbh/yKT+gNhVSmt6uRXTw9mdL42AZnOzWpz Mxxw== X-Gm-Message-State: AHYfb5hqSl5QAki2gYARTQUu7f/5nKOn0Pd4R02C29gz+5n/xQfX/UgK xuUEkuqKqPapa9R38Q1Zlg== X-Received: by 10.99.16.65 with SMTP id 1mr3385386pgq.208.1503802856631; Sat, 26 Aug 2017 20:00:56 -0700 (PDT) Received: from localhost ([103.205.218.127]) by smtp.gmail.com with ESMTPSA id z9sm16990454pgz.40.2017.08.26.20.00.55 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 26 Aug 2017 20:00:56 -0700 (PDT) From: Rajiv Ranganath To: xen-devel@lists.xen.org Date: Sun, 27 Aug 2017 08:30:53 +0530 Message-Id: <20170827030053.40527.90818.stgit@rajivs-macbook-pro.local> X-Mailer: git-send-email 2.9.0 In-Reply-To: <20170827030018.40527.88922.stgit@rajivs-macbook-pro.local> References: <20170827030018.40527.88922.stgit@rajivs-macbook-pro.local> User-Agent: StGit/0.17.1-dirty MIME-Version: 1.0 Cc: sstabellini@kernel.org Subject: [Xen-devel] [stage1-xen PATCH v1 04/10] build/fedora: Add `run` and `components/*` scripts X-BeenThere: xen-devel@lists.xen.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xen.org Sender: "Xen-devel" X-Virus-Scanned: ClamAV using ClamSMTP From: Rajiv M Ranganath Signed-off-by: Rajiv Ranganath --- build/fedora/components/qemu | 50 ++++++++++++++++++++++++++++++++++++ build/fedora/components/rkt | 58 ++++++++++++++++++++++++++++++++++++++++++ build/fedora/components/xen | 46 +++++++++++++++++++++++++++++++++ build/fedora/run | 56 +++++++++++++++++++++++++++++++++++++++++ 4 files changed, 210 insertions(+) create mode 100755 build/fedora/components/qemu create mode 100755 build/fedora/components/rkt create mode 100755 build/fedora/components/xen create mode 100755 build/fedora/run diff --git a/build/fedora/components/qemu b/build/fedora/components/qemu new file mode 100755 index 0000000..6c89e2c --- /dev/null +++ b/build/fedora/components/qemu @@ -0,0 +1,50 @@ +#!/usr/bin/python2 + +import shlex +import subprocess +import sys +import os + +# Modify this if you would like to install Qemu elsewhere on your filesystem or +# a different version of Qemu +QEMU_PREFIX = '/opt/qemu-unstable' +QEMU_BRANCH = 'master' + +# This should correspond to your Xen install prefix +XEN_PREFIX = '/opt/xen-unstable' + + +# helper function to capture stdout from a long running process +def subprocess_stdout(cmd, cwd, env): + p = subprocess.Popen( + shlex.split(cmd), cwd=cwd, env=env, stdout=subprocess.PIPE) + while p.poll() is None: + l = p.stdout.readline() + sys.stdout.write(l) + if p.returncode != 0: + sys.exit(1) + +env = os.environ.copy() + +# build and install qemu +print "Cloning qemu..." +cmd = "git clone --branch %(branch)s git://git.qemu.org/qemu.git" % { + 'branch': QEMU_BRANCH +} +subprocess.check_output(shlex.split(cmd), cwd='/root') + +steps = [ + "./configure --prefix=%(qemu_prefix)s --enable-xen --target-list=i386-softmmu --extra-cflags=\"-I%(xen_prefix)s/include\" --extra-ldflags=\"-L%(xen_prefix)s/lib -Wl,-rpath,%(xen_prefix)s/lib\" --disable-kvm --enable-virtfs --enable-linux-aio" + % { + 'qemu_prefix': QEMU_PREFIX, + 'xen_prefix': XEN_PREFIX + }, 'make', 'make install' +] +for cmd in steps: + cwd = '/root/qemu' + subprocess_stdout(cmd, cwd, env) + +cmd = "cp i386-softmmu/qemu-system-i386 %(xen_prefix)s/lib/xen/bin/qemu-system-i386" % { + 'xen_prefix': XEN_PREFIX +} +subprocess.check_output(shlex.split(cmd), cwd='/root/qemu') diff --git a/build/fedora/components/rkt b/build/fedora/components/rkt new file mode 100755 index 0000000..edfdd1c --- /dev/null +++ b/build/fedora/components/rkt @@ -0,0 +1,58 @@ +#!/usr/bin/python2 + +import shlex +import subprocess +import sys +import os + +# `rkt` is installed in the same prefix as `stage1-xen`. Modify this if you +# would like to install rkt elsewhere on your filesystem. +STAGE1_XEN_PREFIX = '/opt/stage1-xen' +RKT_PREFIX = STAGE1_XEN_PREFIX +RKT_BRANCH = 'master' + +# Adjust this according to what RKT_BRANCH generates +RKT_BUILD_VER = 'rkt-1.28.1+git' + + +# helper function to capture stdout from a long running process +def subprocess_stdout(cmd, cwd, env): + p = subprocess.Popen( + shlex.split(cmd), cwd=cwd, env=env, stdout=subprocess.PIPE) + while p.poll() is None: + l = p.stdout.readline() + sys.stdout.write(l) + if p.returncode != 0: + sys.exi(1) + + +env = os.environ.copy() + +# build rkt +print "Cloning rkt..." +cmd = "git clone --branch %(branch)s https://github.com/rkt/rkt.git" % { + 'branch': RKT_BRANCH +} +subprocess.check_output(shlex.split(cmd), cwd='/root') + +steps = [ + './autogen.sh', './configure --disable-tpm --with-stage1-flavors=coreos', + 'make' +] +for cmd in steps: + cwd = '/root/rkt' + subprocess_stdout(cmd, cwd, env) + +# install rkt build artifacts to RKT_PREFIX +steps = [ + "mkdir -p %(prefix)s/bin" % { + 'prefix': RKT_PREFIX + }, + "cp /root/rkt/build-%(build_ver)s/target/bin/rkt %(prefix)s/bin/rkt" % { + 'build_ver': RKT_BUILD_VER, + 'prefix': RKT_PREFIX + } +] +for cmd in steps: + cwd = '/root/rkt' + subprocess_stdout(cmd, cwd, env) diff --git a/build/fedora/components/xen b/build/fedora/components/xen new file mode 100755 index 0000000..95da9a6 --- /dev/null +++ b/build/fedora/components/xen @@ -0,0 +1,46 @@ +#!/usr/bin/python2 + +import shlex +import subprocess +import sys +import os + +# Modify this if you would like to install Xen elsewhere on your filesystem or +# a different version of Xen +XEN_PREFIX = '/opt/xen-unstable' +XEN_BRANCH = 'master' + + +# helper function to capture stdout from a long running process +def subprocess_stdout(cmd, cwd, env): + p = subprocess.Popen( + shlex.split(cmd), cwd=cwd, env=env, stdout=subprocess.PIPE) + while p.poll() is None: + l = p.stdout.readline() + sys.stdout.write(l) + if p.returncode != 0: + sys.exit(1) + + +env = os.environ.copy() + +# build and install xen +print "Cloning xen..." +cmd = "git clone --branch %(branch)s git://xenbits.xen.org/xen.git" % { + 'branch': XEN_BRANCH +} +subprocess.check_output(shlex.split(cmd), cwd='/root') + +steps = [ + "./configure --prefix=%(prefix)s --with-system-qemu=%(prefix)s/lib/xen/bin/qemu-system-i386 --disable-stubdom --disable-qemu-traditional --disable-rombios --sysconfdir=%(prefix)s/etc --enable-rpath --disable-systemd" + % { + 'prefix': XEN_PREFIX + }, 'make', + "make install BOOT_DIR=%(prefix)s/boot DEBUG_DIR=%(prefix)s/lib/debug EFI_DIR=%(prefix)s/boot/efi/EFI/xen" + % { + 'prefix': XEN_PREFIX + } +] +for cmd in steps: + cwd = '/root/xen' + subprocess_stdout(cmd, cwd, env) diff --git a/build/fedora/run b/build/fedora/run new file mode 100755 index 0000000..6cb6417 --- /dev/null +++ b/build/fedora/run @@ -0,0 +1,56 @@ +#!/usr/bin/python2 + +import shlex +import subprocess +import sys +import os + +# This scripts calls out to `xen`, `qemu` and `rkt` scripts in the +# `components/` directory within a container. It is expected that components +# directory is present at the same directory level as run script. +STAGE1_XEN_COMPONENTS = ['xen', 'qemu', 'rkt'] + + +# helper function to capture stdout from a long running process +def subprocess_stdout(cmd, cwd, env): + p = subprocess.Popen( + shlex.split(cmd), cwd=cwd, env=env, stdout=subprocess.PIPE) + while p.poll() is None: + l = p.stdout.readline() + sys.stdout.write(l) + if p.returncode != 0: + sys.exit(1) + + +env = os.environ.copy() + +dirname = os.path.dirname(os.path.realpath(__file__)) +steps = [os.path.join(dirname, 'components', x) for x in STAGE1_XEN_COMPONENTS] +for cmd in steps: + cwd = '/root' + subprocess_stdout(cmd, cwd, env) + +# build stage1-xen +env['GOPATH'] = '/root/gopath' +cwd = '/root/gopath/src/github.com/rkt/stage1-xen' +cmd = 'bash build.sh' +subprocess_stdout(cmd, cwd, env) + +# install build artifacts to `/opt/stage1-xen/aci` and create a tarball +steps = [ + 'mkdir -p /opt/stage1-xen/aci', + 'cp /root/gopath/src/github.com/rkt/stage1-xen/stage1-xen.aci /opt/stage1-xen/aci/stage1-xen.aci', + 'cp /root/gopath/src/github.com/rkt/stage1-xen/build/fedora/source_path.sh /opt/stage1-xen/bin/source_path.sh', + 'cp -r /root/gopath/src/github.com/rkt/stage1-xen/build/fedora/xen-unstable-runit /opt/xen-unstable-runit' +] +for cmd in steps: + cwd = '/root' + subprocess_stdout(cmd, cwd, env) + +cwd = '/opt' +cmd = 'tar zcvf /root/stage1-xen-build.tar.gz qemu-unstable/ stage1-xen/ xen-unstable/ xen-unstable-runit/' +subprocess_stdout(cmd, cwd, env) + +cwd = '/root' +cmd = 'mv /root/stage1-xen-build.tar.gz /tmp' +subprocess_stdout(cmd, cwd, env)