Skip to content

Commit ffe001d

Browse files
committed
Seperate tpch and imdb benchmarking CI jobs
Signed-off-by: Austin Liu <austin362667@gmail.com> Fix path Signed-off-by: Austin Liu <austin362667@gmail.com> Fix path Signed-off-by: Austin Liu <austin362667@gmail.com>
1 parent d35c7b6 commit ffe001d

1 file changed

Lines changed: 30 additions & 5 deletions

File tree

.github/workflows/rust.yml

Lines changed: 30 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -252,9 +252,9 @@ jobs:
252252
working-directory: ./datafusion/wasmtest
253253
run: wasm-pack build --dev
254254

255-
# verify that the benchmark queries return the correct results
256-
verify-benchmark-results:
257-
name: verify benchmark results (amd64)
255+
# verify that tpch benchmark queries return the correct results
256+
verify-tpch-benchmark-results:
257+
name: verify tpch benchmark results (amd64)
258258
needs: [ linux-build-lib ]
259259
runs-on: ubuntu-latest
260260
container:
@@ -275,13 +275,38 @@ jobs:
275275
make
276276
./dbgen -f -s 0.1
277277
mv *.tbl ../datafusion/sqllogictest/test_files/tpch/data
278-
../benchmarks/bench.sh data imdb
279278
- name: Verify that benchmark queries return expected results
280279
run: |
281280
export TPCH_DATA=`realpath datafusion/sqllogictest/test_files/tpch/data`
282281
# use release build for plan verificaton because debug build causes stack overflow
283282
cargo test plan_q --package datafusion-benchmarks --profile release-nonlto --features=ci -- --test-threads=1
284-
INCLUDE_TPCH=true INCLUDE_IMDB=true cargo test --test sqllogictests
283+
INCLUDE_TPCH=true cargo test --test sqllogictests -- tpch
284+
- name: Verify Working Directory Clean
285+
run: git diff --exit-code
286+
287+
# verify that imdb benchmark queries return the correct results
288+
verify-imdb-benchmark-results:
289+
name: verify imdb benchmark results (amd64)
290+
needs: [ linux-build-lib ]
291+
runs-on: ubuntu-latest
292+
container:
293+
image: amd64/rust
294+
steps:
295+
- uses: actions/checkout@v4
296+
with:
297+
submodules: true
298+
- name: Setup Rust toolchain
299+
uses: ./.github/actions/setup-builder
300+
with:
301+
rust-version: stable
302+
- name: Download benchmark data and expected query results
303+
run: |
304+
benchmarks/bench.sh data imdb
305+
- name: Verify that benchmark queries return expected results
306+
run: |
307+
# use release build for plan verificaton because debug build causes stack overflow
308+
cargo test plan_q --package datafusion-benchmarks --profile release-nonlto --features=ci -- --test-threads=1
309+
INCLUDE_IMDB=true cargo test --test sqllogictests -- imdb
285310
- name: Verify Working Directory Clean
286311
run: git diff --exit-code
287312

0 commit comments

Comments
 (0)