Skip to content

[SPARK-54392][SS] Optimize JVM-Python communication for TWS initial s… #16182

[SPARK-54392][SS] Optimize JVM-Python communication for TWS initial s…

[SPARK-54392][SS] Optimize JVM-Python communication for TWS initial s… #16182

Triggered via push December 6, 2025 02:59
Status Failure
Total duration 1h 50m 18s
Artifacts 16

build_main.yml

on: push
Run  /  Check changes
38s
Run / Check changes
Run  /  Base image build
1m 1s
Run / Base image build
Run  /  Protobuf breaking change detection and Python CodeGen check
0s
Run / Protobuf breaking change detection and Python CodeGen check
Run  /  Java 17 build with Maven
44m 11s
Run / Java 17 build with Maven
Run  /  Java 25 build with Maven
40m 32s
Run / Java 25 build with Maven
Run  /  Run TPC-DS queries with SF=1
0s
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
0s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
0s
Run / Run Spark on Kubernetes Integration test
Run  /  Run Spark UI tests
0s
Run / Run Spark UI tests
Matrix: Run / build
Run  /  Build modules: sparkr
0s
Run / Build modules: sparkr
Run  /  Linters, licenses, and dependencies
27m 8s
Run / Linters, licenses, and dependencies
Run  /  Documentation generation
0s
Run / Documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

1 error and 3 warnings
Run / Build modules: sql - other tests
Process completed with exit code 18.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
No files were found with the provided path: **/target/test-reports/*.xml **/target/surefire-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
WARNING conda.cli.main_config:_set_key(456): Key auto_activate_base is an alias of auto_activate; setting value with latter
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
The 'defaults' channel might have been added implicitly. If this is intentional, add 'defaults' to the 'channels' list. Otherwise, consider setting 'conda-remove-defaults' to 'true'.

Artifacts

Produced during runtime
Name Size Digest
apache~spark~8EI5WO.dockerbuild
33.5 KB
sha256:25c9dc56c3ae05669972f332af0aa01c581c3fae1591f42ab824aee5a6bdd268
apache~spark~JIP0SD.dockerbuild
27.7 KB
sha256:ab7aaacdea4ff106bef8cb93599d2cd54d6e75b1fff4922f0e35a6675bad092e
test-results-api, catalyst, hive-thriftserver--17-hadoop3-hive2.3
39 KB
sha256:b8cd64489c8d336e9da368df4ef22338dc3b8a486385a693d8fc603856353db4
test-results-core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant--17-hadoop3-hive2.3
37.6 KB
sha256:142405fb42f049042c3b97167d13b1aa2d1f78656b95889d7d508df4a7ed7de7
test-results-hive-- other tests-17-hadoop3-hive2.3
236 KB
sha256:f8d696e55569a51e82650c149012b0d5a0507f593a1ac27dbf85dca953014caf
test-results-hive-- slow tests-17-hadoop3-hive2.3
225 KB
sha256:cd62fce62752ca6db2d63bb6d75f54ca05c4bc89af219b8331d242f62570a769
test-results-mllib-local, mllib, graphx, profiler, pipelines--17-hadoop3-hive2.3
432 KB
sha256:1fd774d43f1fe87b389c0ab366c6d3c62f65796ef589b1b068ec333e60288dc3
test-results-pyspark-connect--17-hadoop3-hive2.3-python3.11
229 KB
sha256:6896ad685793fb64324fbd0fc73eb6ddfc872edc425c1ccc303d3ecacd625f49
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines--17-hadoop3-hive2.3-python3.11
182 KB
sha256:c2bdfcd3f694b4e2ae448c4b08c1dfe3e32c0ec9774dd1b5209f0b23dfbda29a
test-results-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3-python3.11
266 KB
sha256:1bce76b64dd4e3d6b4116b8a57f854abbfb91b13960754e7b879bc6ecc3f1607
test-results-pyspark-structured-streaming, pyspark-structured-streaming-connect--17-hadoop3-hive2.3-python3.11
41.3 KB
sha256:27b2d19de7cc5aa878dea60881d2593e937e6a26ca9b211f044c097a431b295d
test-results-sql-- extended tests-17-hadoop3-hive2.3
1.3 MB
sha256:d31e04612bb1c9fc15926e0ffdfcee3650b3afa88392600d3e24649c8dfde96d
test-results-sql-- other tests-17-hadoop3-hive2.3
1.54 MB
sha256:e2f6080ed8a2ffbffeffcd991a4467c293584e2bd298acc7f6dcfbc8e3cade24
test-results-sql-- slow tests-17-hadoop3-hive2.3
1.31 MB
sha256:76bdf5af9bd86073912945db0a650b4e7578fe2c0ecc481cd11c5a2c29efc977
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf, connect--17-hadoop3-hive2.3
236 KB
sha256:3b0d4b661d67d6a9cea33e1de2bb307040eddbbe11d7cb4f6939824115719c62
unit-tests-log-sql-- other tests-17-hadoop3-hive2.3
49.6 MB
sha256:04e799f68d9f81826617c4ca21c056069b1d82f626d8e4e3aa4a75ea6563f367