From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from [87.239.111.99] (localhost [127.0.0.1]) by dev.tarantool.org (Postfix) with ESMTP id 318D3A507F4; Fri, 1 Mar 2024 11:25:45 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org 318D3A507F4 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tarantool.org; s=dev; t=1709281545; bh=rBBLfVGlfpG6VPMNUeICvvSSMcQHFCiqpaLwg4yXEqE=; h=To:Date:Subject:List-Id:List-Unsubscribe:List-Archive:List-Post: List-Help:List-Subscribe:From:Reply-To:From; b=kFowlHRw/1Tu3LCf+PDTF7+bAZOeRxLRakqNPHYgN62925TLFOfQLImC+RFiG2Qgj JsZgfDNvc2bli+zzWLSfc4zDE1oeh73HwbqUSgI8Eyvsts+PwhZh13uhhs3XmAofw8 DivjEAzp0mZ/mReX8tBWMto30UFBxdMn83sf8Z6A= Received: from mail-lf1-f41.google.com (mail-lf1-f41.google.com [209.85.167.41]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by dev.tarantool.org (Postfix) with ESMTPS id DF034A507C1 for ; Fri, 1 Mar 2024 11:25:43 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org DF034A507C1 Received: by mail-lf1-f41.google.com with SMTP id 2adb3069b0e04-513298d6859so1496579e87.3 for ; Fri, 01 Mar 2024 00:25:43 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1709281543; x=1709886343; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=yyPdfPsPsYqUxRxH/FSrQicBVygvZE6ySJlYMf7Cmu8=; b=lXImp+7NZffhewMfYQ6YrsxI9r2Ji+equcSJ0YxVlispGxM7sJP931LB1qD52OeYFR N/nmB38/OJXJYD6uVSX3T4987jHLcoxDEhWZ4utKYvUzejn5bXnVOEMSwtnQQ22ReYNR VeFp6d8skGagWe2rfovjAe7GKHWLy0OIfLGuUsKMHSA+EEi9BXudR5Abw7MYcXTRNZX+ KMCAIa9bdQ9aqWPo6v6dyeFfl8KFwehhXZdIB5JQCTUcO9OW3P69p6SiMR55kzS1K6cb Kaq/6GWGFWqjhiZyVfxr7brjHJ7VRoy+d/JyVsKgYqmmsMHSnEWykl1s/KGhxtrahdlB prJA== X-Gm-Message-State: AOJu0YxQDoZVdY5NZCXXRt0K7dVG5BsZAZIh6kI96Uk/FkO6pTackFQG IQJdL1A8B8ThefYy2iONCYSRlWtF4ihLdminzAdt1dNZPuyPcmNeQYemQmH02/k= X-Google-Smtp-Source: AGHT+IHIIXtmU2ybK21KZZbGchAxA9qnX6olWLUfZHOxGrNNg5U7EAvX66IoEgfxnJ9vf7W77oNrJw== X-Received: by 2002:ac2:47f0:0:b0:513:259f:8860 with SMTP id b16-20020ac247f0000000b00513259f8860mr546865lfp.33.1709281542362; Fri, 01 Mar 2024 00:25:42 -0800 (PST) Received: from fckxorg.mail.msk ([2a00:1148:b0ba:16:a3e8:bdc1:dbed:dbc8]) by smtp.gmail.com with ESMTPSA id o18-20020a05651205d200b005132f12ee7asm191765lfo.174.2024.03.01.00.25.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 01 Mar 2024 00:25:41 -0800 (PST) X-Google-Original-From: Maxim Kokryashkin To: tarantool-patches@dev.tarantool.org, skaplun@tarantool.org, sergeyb@tarantool.org Date: Fri, 1 Mar 2024 11:25:38 +0300 Message-ID: <20240301082538.107373-1-m.kokryashkin@tarantool.org> X-Mailer: git-send-email 2.43.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: [Tarantool-patches] [PATCH luajit] ci: extend tarantool integration testing X-BeenThere: tarantool-patches@dev.tarantool.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Tarantool development patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Maxim Kokryashkin via Tarantool-patches Reply-To: Maxim Kokryashkin Errors-To: tarantool-patches-bounces@dev.tarantool.org Sender: "Tarantool-patches" This patch makes use of reusable workflows from the Tarantool repository, so now LuaJIT CI tests integration in all relevant workflows. Also, this patch disables MacOS testing for Tarantool integration since those runs were made nightly in the Tarantool repo. As noted in the documentation[1], it is impossible for a single workflow call tree to include more than 20 workflows. To overcome this limitation, workflows are started in a bunch of separate files. This makes it impossible to depend on LuaJIT-only jobs for integration workflow since it is impossible to make cross-dependencies between workflow files. The name of a callee workflow cannot be substituted using a matrix[2], so workflow calls are copied and pasted instead. Table below shows which workflows are enabled and why. Workflow name |+/-| Reason ----------------------------------------------------------------- codeql | - | Not relevant to LuaJIT. coverage | + | Long tests for profilers. coverity | - | Cron workflow. debug | + | Tarantool debug build. debug_aarch64 | + | Tarantool debug build. debug_asan_clang | + | Tarantool debug build. default_gcc_centos_7 | + | Ancient gcc build. freebsd | - | Nightly build. fuzzing | - | Impossible to bump LuaJIT. integration | + | Tarantool ecosystem. jepsen-cluster-txm | - | Manual workflow. jepsen-cluster | - | Manual workflow. jepsen-single-instance-txm | - | Cron workflow. jepsen-single-instance | - | Cron workflow. lango-stale-reviews | - | Cron workflow. lint | - | LuaJIT has its own lint. luajit-integration | + | Exotic LuaJIT options. memtx_allocator_based_on_malloc | + | Not relevant to LuaJIT. osx | - | Nightly build. out_of_source | - | Not relevent to LuaJIT. packaging | - | No LuaJIT-relevant variety. perf_cbench | - | Not enabled for PRs. perf_linkbench_ssd | - | Not enabled for PRs. perf_micro | - | Not relevant to LuaJIT. perf_nosqlbench_hash | - | Not enabled for PRs. perf_nosqlbench_tree | - | Not enabled for PRs. perf_sysbench | - | Not enabled for PRs. perf_tpcc | - | Not enabled for PRs. perf_tpch | - | Not enabled for PRs. perf_ycsb_hash | - | Not enabled for PRs. perf_ycsb_tree | - | Not enabled for PRs. publish-module-api-doc | - | No Doxygen in LuaJIT. release | + | Tarantool release build. release_asan_clang | + | Tarantool release build. release_clang | + | Tarantool release build. release_lto | + | Tarantool release build. release_lto_clang | + | Tarantool release build. reusable_build | - | Utility for integration. source | - | Not enabled for PRs. static_build | + | Tarantool static build. static_build_cmake_linux | + | Tarantool static build. static_build_pack_test_deploy | - | Utility for packaging. submodule_update | - | Not enabled for PRs. [1]: https://docs.github.com/en/actions/using-workflows/reusing-workflows#limitations [2]: https://github.com/orgs/community/discussions/45342#discussioncomment-4779360 --- Branch: https://github.com/tarantool/luajit/tree/fckxorg/integration-testing .github/workflows/exotic-tarantool.yml | 62 ++++++++++++ .github/workflows/tarantool-ecosystem.yml | 35 +++++++ .github/workflows/testing.yml | 116 ++++++++++++++++------ 3 files changed, 183 insertions(+), 30 deletions(-) create mode 100644 .github/workflows/exotic-tarantool.yml create mode 100644 .github/workflows/tarantool-ecosystem.yml diff --git a/.github/workflows/exotic-tarantool.yml b/.github/workflows/exotic-tarantool.yml new file mode 100644 index 00000000..be55291a --- /dev/null +++ b/.github/workflows/exotic-tarantool.yml @@ -0,0 +1,62 @@ +name: "Exotic Tarantool builds testing" + +on: + push: + branches-ignore: + - '**-notest' + - 'upstream-**' + tags-ignore: + - '**' + +concurrency: + # An update of a developer branch cancels the previously + # scheduled workflow run for this branch. However, the default + # branch, and long-term branch (tarantool/release/2.11, + # tarantool/release/2.10, etc) workflow runs are never canceled. + # + # We use a trick here: define the concurrency group as 'workflow + # run ID' + # 'workflow run attempt' because it is a unique + # combination for any run. So it effectively discards grouping. + # + # XXX: we cannot use `github.sha` as a unique identifier because + # pushing a tag may cancel a run that works on a branch push + # event. + group: ${{ startsWith(github.ref, 'refs/heads/tarantool/') + && format('{0}-{1}', github.run_id, github.run_attempt) + || format('{0}-{1}', github.workflow, github.ref) }} + cancel-in-progress: true + +jobs: + test-exotic-tarantool: + strategy: + fail-fast: false + matrix: + ARCH: [ARM64, x86_64] + BUILDTYPE: [Debug, Release] + GC64: [ON, OFF] + OS: [Linux, macOS] + include: + - BUILDTYPE: Debug + CMAKEFLAGS: -DCMAKE_BUILD_TYPE=Debug + - BUILDTYPE: Release + CMAKEFLAGS: -DCMAKE_BUILD_TYPE=RelWithDebInfo + exclude: + - ARCH: ARM64 + GC64: OFF + - OS: macOS + GC64: OFF + name: > + Tarantool + (${{ matrix.OS }}/${{ matrix.ARCH }}) + ${{ matrix.BUILDTYPE }} + GC64:${{ matrix.GC64 }} + # XXX: Only LuaJIT-tests are running in this workflow. + uses: tarantool/tarantool/.github/workflows/luajit-integration.yml@master + with: + CMAKE_EXTRA_PARAMS: > + -G Ninja + ${{ matrix.CMAKEFLAGS }} + -DLUAJIT_ENABLE_GC64=${{ matrix.GC64 }} + arch: ${{ matrix.ARCH }} + os: ${{ matrix.OS }} + revision: ${{ github.sha }} diff --git a/.github/workflows/tarantool-ecosystem.yml b/.github/workflows/tarantool-ecosystem.yml new file mode 100644 index 00000000..82a47fe1 --- /dev/null +++ b/.github/workflows/tarantool-ecosystem.yml @@ -0,0 +1,35 @@ +name: Tarantool ecosystem integration testing + +on: + push: + branches-ignore: + - '**-notest' + - 'upstream-**' + tags-ignore: + - '**' + +concurrency: + # An update of a developer branch cancels the previously + # scheduled workflow run for this branch. However, the default + # branch, and long-term branch (tarantool/release/2.11, + # tarantool/release/2.10, etc) workflow runs are never canceled. + # + # We use a trick here: define the concurrency group as 'workflow + # run ID' + # 'workflow run attempt' because it is a unique + # combination for any run. So it effectively discards grouping. + # + # XXX: we cannot use `github.sha` as a unique identifier because + # pushing a tag may cancel a run that works on a branch push + # event. + group: ${{ startsWith(github.ref, 'refs/heads/tarantool/') + && format('{0}-{1}', github.run_id, github.run_attempt) + || format('{0}-{1}', github.workflow, github.ref) }} + cancel-in-progress: true + +jobs: + test-tarantool-integration: + uses: tarantool/tarantool/.github/workflows/integration.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + diff --git a/.github/workflows/testing.yml b/.github/workflows/testing.yml index cb4ba57b..7bd527be 100644 --- a/.github/workflows/testing.yml +++ b/.github/workflows/testing.yml @@ -83,37 +83,93 @@ jobs: run: cmake --build . --parallel --target LuaJIT-test working-directory: ${{ env.BUILDDIR }} + test-tarantool-coverage: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/coverage.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} - test-tarantool: - strategy: - fail-fast: false - matrix: - ARCH: [ARM64, x86_64] - BUILDTYPE: [Debug, Release] - GC64: [ON, OFF] - OS: [Linux, macOS] - include: - - BUILDTYPE: Debug - CMAKEFLAGS: -DCMAKE_BUILD_TYPE=Debug - - BUILDTYPE: Release - CMAKEFLAGS: -DCMAKE_BUILD_TYPE=RelWithDebInfo - exclude: - - ARCH: ARM64 - GC64: OFF - - OS: macOS - GC64: OFF - name: > - Tarantool - (${{ matrix.OS }}/${{ matrix.ARCH }}) - ${{ matrix.BUILDTYPE }} - GC64:${{ matrix.GC64 }} + test-tarantool-debug: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/debug.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-debug_aarch64: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/debug_aarch64.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-debug_asan_clang: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/debug_asan_clang.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-default_gcc_centos_7: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/default_gcc_centos_7.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-out_of_source: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/out_of_source.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-release: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/release.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-release_asan_clang: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/release_asan_clang.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-release_clang: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/release_clang.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-release_lto: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/release_lto.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-release_lto_clang: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/release_lto_clang.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-static_build: + needs: test-luajit + uses: tarantool/tarantool/.github/workflows/static_build.yml@master + with: + submodule: luajit + revision: ${{ github.sha }} + + test-tarantool-static_build_cmake_linux: needs: test-luajit - uses: tarantool/tarantool/.github/workflows/luajit-integration.yml@master + uses: tarantool/tarantool/.github/workflows/static_build_cmake_linux.yml@master with: - CMAKE_EXTRA_PARAMS: > - -G Ninja - ${{ matrix.CMAKEFLAGS }} - -DLUAJIT_ENABLE_GC64=${{ matrix.GC64 }} - arch: ${{ matrix.ARCH }} - os: ${{ matrix.OS }} + submodule: luajit revision: ${{ github.sha }} -- 2.43.0