From patchwork Mon Aug 12 07:03:01 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sai.Sathujoda@toshiba-tsip.com X-Patchwork-Id: 13760222 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9DB3BC531DD for ; Mon, 12 Aug 2024 07:04:22 +0000 (UTC) Received: from mo-csw.securemx.jp (mo-csw.securemx.jp [210.130.202.158]) by mx.groups.io with SMTP id smtpd.web11.40678.1723446252124696545 for ; Mon, 12 Aug 2024 00:04:12 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: toshiba-tsip.com, ip: 210.130.202.158, mailfrom: sai.sathujoda@toshiba-tsip.com) Received: by mo-csw.securemx.jp (mx-mo-csw1122) id 47C74AOE1597540; Mon, 12 Aug 2024 16:04:10 +0900 X-Iguazu-Qid: 2rWgipQxjcYlGxZfGc X-Iguazu-QSIG: v=2; s=0; t=1723446249; q=2rWgipQxjcYlGxZfGc; m=lU1GZDBRxkuLXq5Zj0RYpyqRPcz/Pz+ahP1/Gz76uV8= Received: from imx12-a.toshiba.co.jp ([38.106.60.135]) by relay.securemx.jp (mx-mr1122) id 47C748l03069432 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Mon, 12 Aug 2024 16:04:09 +0900 From: Sai.Sathujoda@toshiba-tsip.com To: cip-dev@lists.cip-project.org, jan.kiszka@siemens.com Cc: sai ashrith sathujoda , dinesh.kumar@toshiba-tsip.com, kazuhiro3.hayashi@toshiba.co.jp Subject: [isar-cip-core 1/3] scripts/run-cve-checks.sh: Extract suite from dpkg status file name Date: Mon, 12 Aug 2024 12:33:01 +0530 X-TSB-HOP2: ON Message-Id: <20240812070303.1206167-2-Sai.Sathujoda@toshiba-tsip.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20240812070303.1206167-1-Sai.Sathujoda@toshiba-tsip.com> References: <20240812070303.1206167-1-Sai.Sathujoda@toshiba-tsip.com> MIME-Version: 1.0 X-OriginalArrivalTime: 12 Aug 2024 07:04:06.0812 (UTC) FILETIME=[D28D1DC0:01DAEC85] List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Mon, 12 Aug 2024 07:04:22 -0000 X-Groupsio-URL: https://lists.cip-project.org/g/cip-dev/message/16770 From: sai ashrith sathujoda cve_checker.py script in debian-cve-checker repository expects relevant suite as input which is needed for debsecan tool to list vulnerabilities of that suite. Signed-off-by: sai ashrith sathujoda --- scripts/run-cve-checks.sh | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/scripts/run-cve-checks.sh b/scripts/run-cve-checks.sh index 9cebc90..12fd74e 100755 --- a/scripts/run-cve-checks.sh +++ b/scripts/run-cve-checks.sh @@ -32,7 +32,8 @@ aws s3 cp --no-progress --recursive s3://download.cip-project.org/cip-core/cve-c mkdir cve-reports for file in *.dpkg_status; do echo "Checking $file" - cve_checker.py --status "$file" --output ./cve-reports/"${file%.dpkg_status}".csv + suite=$(echo "${file%.dpkg_status}" | awk -F- '{print $NF}') + cve_checker.py --suite "$suite" --status "$file" --output ./cve-reports/"${file%.dpkg_status}".csv done # Synchronize the CVE reports to AWS (it will delete old reports) From patchwork Mon Aug 12 07:03:02 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sai.Sathujoda@toshiba-tsip.com X-Patchwork-Id: 13760221 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8788FC52D7C for ; Mon, 12 Aug 2024 07:04:22 +0000 (UTC) Received: from mo-csw.securemx.jp (mo-csw.securemx.jp [210.130.202.158]) by mx.groups.io with SMTP id smtpd.web10.40580.1723446252559063554 for ; Mon, 12 Aug 2024 00:04:12 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: toshiba-tsip.com, ip: 210.130.202.158, mailfrom: sai.sathujoda@toshiba-tsip.com) Received: by mo-csw.securemx.jp (mx-mo-csw1122) id 47C74AAp1597552; Mon, 12 Aug 2024 16:04:10 +0900 X-Iguazu-Qid: 2rWgxxkZ67aDU4coF6 X-Iguazu-QSIG: v=2; s=0; t=1723446250; q=2rWgxxkZ67aDU4coF6; m=jjwvn7aUr4Q0HvuYK3ZxU3vrtqF8a4mFGJHUgp6dwhk= Received: from imx2-a.toshiba.co.jp (imx2-a.toshiba.co.jp [106.186.93.35]) by relay.securemx.jp (mx-mr1121) id 47C7493Z2719234 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Mon, 12 Aug 2024 16:04:09 +0900 From: Sai.Sathujoda@toshiba-tsip.com To: cip-dev@lists.cip-project.org, jan.kiszka@siemens.com Cc: sai ashrith sathujoda , dinesh.kumar@toshiba-tsip.com, kazuhiro3.hayashi@toshiba.co.jp Subject: [isar-cip-core 2/3] scripts/deploy-cip-core.sh: Include release name in dpkg status filename Date: Mon, 12 Aug 2024 12:33:02 +0530 X-TSB-HOP2: ON Message-Id: <20240812070303.1206167-3-Sai.Sathujoda@toshiba-tsip.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20240812070303.1206167-1-Sai.Sathujoda@toshiba-tsip.com> References: <20240812070303.1206167-1-Sai.Sathujoda@toshiba-tsip.com> MIME-Version: 1.0 X-OriginalArrivalTime: 12 Aug 2024 07:04:06.0890 (UTC) FILETIME=[D29904A0:01DAEC85] List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Mon, 12 Aug 2024 07:04:22 -0000 X-Groupsio-URL: https://lists.cip-project.org/g/cip-dev/message/16771 From: sai ashrith sathujoda This commit includes release name as part of dpkg status filename so that it can be passed as "--suite" to cve_checker.py script. Signed-off-by: sai ashrith sathujoda --- scripts/deploy-cip-core.sh | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/scripts/deploy-cip-core.sh b/scripts/deploy-cip-core.sh index c75f2d1..6e4dfd7 100755 --- a/scripts/deploy-cip-core.sh +++ b/scripts/deploy-cip-core.sh @@ -71,4 +71,10 @@ fi # * cve-reports: folder to store the cve-reports generated from the dpkg status files # * they can be linked from the release website DPKG_STATUS_FILENAME=${CI_JOB_NAME#build:}.dpkg_status + +# As default release name is not included in CI_JOB_NAME, it is appended to dpkg status file name +# For further use in run-cve-checks.sh script to get the right suite +if ! echo "$CI_JOB_NAME" | grep -q "$1"; then + DPKG_STATUS_FILENAME=${CI_JOB_NAME#build:}-$1.dpkg_status +fi aws s3 cp --no-progress build/tmp/deploy/images/"$TARGET"/cip-core-image-*.dpkg_status s3://download.cip-project.org/cip-core/cve-checks/dpkg-status/"$DPKG_STATUS_FILENAME" From patchwork Mon Aug 12 07:03:03 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sai.Sathujoda@toshiba-tsip.com X-Patchwork-Id: 13760220 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 858EFC3DA7F for ; Mon, 12 Aug 2024 07:04:22 +0000 (UTC) Received: from mo-csw.securemx.jp (mo-csw.securemx.jp [210.130.202.134]) by mx.groups.io with SMTP id smtpd.web10.40581.1723446253104642129 for ; Mon, 12 Aug 2024 00:04:13 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: toshiba-tsip.com, ip: 210.130.202.134, mailfrom: sai.sathujoda@toshiba-tsip.com) Received: by mo-csw.securemx.jp (mx-mo-csw1800) id 47C74Bj02480181; Mon, 12 Aug 2024 16:04:11 +0900 X-Iguazu-Qid: 2yAapsDzCvM7QodTsJ X-Iguazu-QSIG: v=2; s=0; t=1723446250; q=2yAapsDzCvM7QodTsJ; m=HWzP9TAx597bhhzR9zxNi+W/Qa8j2JZerpSeJ7bRF+I= Received: from imx2-a.toshiba.co.jp (imx2-a.toshiba.co.jp [106.186.93.35]) by relay.securemx.jp (mx-mr1802) id 47C749vt738836 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Mon, 12 Aug 2024 16:04:10 +0900 From: Sai.Sathujoda@toshiba-tsip.com To: cip-dev@lists.cip-project.org, jan.kiszka@siemens.com Cc: sai ashrith sathujoda , dinesh.kumar@toshiba-tsip.com, kazuhiro3.hayashi@toshiba.co.jp Subject: [isar-cip-core 3/3] .gitlab-ci.yml: Update debian-cve-checker image reference and runner tag Date: Mon, 12 Aug 2024 12:33:03 +0530 X-TSB-HOP2: ON Message-Id: <20240812070303.1206167-4-Sai.Sathujoda@toshiba-tsip.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20240812070303.1206167-1-Sai.Sathujoda@toshiba-tsip.com> References: <20240812070303.1206167-1-Sai.Sathujoda@toshiba-tsip.com> MIME-Version: 1.0 X-OriginalArrivalTime: 12 Aug 2024 07:04:06.0968 (UTC) FILETIME=[D2A4EB80:01DAEC85] List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Mon, 12 Aug 2024 07:04:22 -0000 X-Groupsio-URL: https://lists.cip-project.org/g/cip-dev/message/16772 From: sai ashrith sathujoda This commit updates image reference of debian-cve-checker project. The reason to change the runner tag to large is because cve-checks job is being stuck in the middle after generating cve-reports for dpkg status files of very few targets. This behavior is observed in several attempts. After changing th tag to large, the job ran successfully in minimal time. Signed-off-by: sai ashrith sathujoda --- .gitlab-ci.yml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index ab1835a..6c92927 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -456,9 +456,9 @@ test:qemu-arm-IEC: cve-checks: stage: cve-check needs: [] - image: registry.gitlab.com/cip-playground/debian-cve-checker:latest + image: registry.gitlab.com/cip-project/cip-core/debian-cve-checker:build-latest tags: - - small + - large script: - scripts/run-cve-checks.sh when: manual