Skip to content
Tests

Add Spark 4.0 support #2589

Sign in to view logs

Add Spark 4.0 support

Add Spark 4.0 support #2589

Triggered via pull request December 4, 2024 13:55
@dolfinusdolfinus
synchronize #297
feature/test-spark4.0
Status Failure
Total duration 9m 42s
Artifacts 46

tests.yml

on: pull_request
Get version matrix based on changes in PR/commit  /  Get version matrix based on changes in PR/commit
31s
Get version matrix based on changes in PR/commit / Get version matrix based on changes in PR/commit
Matrix: tests-clickhouse
Matrix: tests-core
Matrix: tests-ftp
Matrix: tests-ftps
Matrix: tests-hdfs
Matrix: tests-hive
Matrix: tests-kafka
Matrix: tests-local-fs
Matrix: tests-mongodb
Matrix: tests-mssql
Matrix: tests-mysql
Matrix: tests-oracle
Matrix: tests-postgres
Matrix: tests-s3
Matrix: tests-samba
Matrix: tests-sftp
Matrix: tests-teradata
Matrix: tests-webdav
Matrix: tests-greenplum
Tests done
0s
Tests done
Fit to window
Zoom out
Zoom in

Annotations

1 error and 47 warnings
Run Hive tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run Hive tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
Process completed with exit code 1.
Get version matrix based on changes in PR/commit / Get version matrix based on changes in PR/commit
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run core tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run core tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run core tests (spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run core tests (spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run FTP tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run FTP tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run core tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run core tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Clickhouse tests (server=24.8.2.3-alpine, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Clickhouse tests (server=24.8.2.3-alpine, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Clickhouse tests (server=21.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Clickhouse tests (server=21.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run FTPS tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run FTPS tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Clickhouse tests (server=24.8.2.3-alpine, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run Clickhouse tests (server=24.8.2.3-alpine, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Greenplum tests (server=6.23.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Greenplum tests (server=6.23.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Greenplum tests (server=7.0.0, spark=3.2.4, pydantic=2, java=11, python=3.10, os=ubuntu-latest) / Run Greenplum tests (server=7.0.0, spark=3.2.4, pydantic=2, java=11, python=3.10, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run LocalFS tests (spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run LocalFS tests (spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Hive tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Hive tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run LocalFS tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run LocalFS tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Hive tests (spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Hive tests (spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Hive tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run Hive tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run LocalFS tests (spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run LocalFS tests (spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MongoDB tests (server=4.0.0, spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run MongoDB tests (server=4.0.0, spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run LocalFS tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run LocalFS tests (spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run LocalFS tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run LocalFS tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MongoDB tests (server=7.0.14, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run MongoDB tests (server=7.0.14, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MongoDB tests (server=7.0.12, spark=4.0.0, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run MongoDB tests (server=7.0.12, spark=4.0.0, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MySQL tests (server=5.7.13, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run MySQL tests (server=5.7.13, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MySQL tests (server=9.0.1, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run MySQL tests (server=9.0.1, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MySQL tests (server=9.0.1, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run MySQL tests (server=9.0.1, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Kafka tests (server=3.7.1, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Kafka tests (server=3.7.1, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Kafka tests (server=3.7.1, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run Kafka tests (server=3.7.1, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MSSQL tests (server=2022-latest, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run MSSQL tests (server=2022-latest, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run MSSQL tests (server=2022-latest, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run MSSQL tests (server=2022-latest, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run HDFS tests (server=hadoop3-hdfs, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run HDFS tests (server=hadoop3-hdfs, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Oracle tests (server=11.2.0.2-slim-faststart, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Oracle tests (server=11.2.0.2-slim-faststart, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Oracle tests (server=23.4-slim-faststart, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Oracle tests (server=23.4-slim-faststart, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Oracle tests (server=23.4-slim-faststart, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run Oracle tests (server=23.4-slim-faststart, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Teradata tests (spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Teradata tests (spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Samba tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run Samba tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run HDFS tests (server=hadoop3-hdfs, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run HDFS tests (server=hadoop3-hdfs, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run SFTP tests (server=9.7_p1-r4-ls166, pydantic=2, python=3.12, os=ubuntu-latest) / Run SFTP tests (server=9.7_p1-r4-ls166, pydantic=2, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Postgres tests (server=16.4-alpine, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Postgres tests (server=16.4-alpine, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Postgres tests (server=9.4.26-alpine, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Postgres tests (server=9.4.26-alpine, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Samba tests (server=latest, pydantic=1, python=3.7, os=ubuntu-latest) / Run Samba tests (server=latest, pydantic=1, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Kafka tests (server=3.2.3, spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Kafka tests (server=3.2.3, spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Postgres tests (server=16.4-alpine, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run Postgres tests (server=16.4-alpine, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run HDFS tests (server=hadoop2-hdfs, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run HDFS tests (server=hadoop2-hdfs, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run S3 tests (server=2021.3.17, spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run S3 tests (server=2021.3.17, spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run S3 tests (server=2024.8.29, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run S3 tests (server=2024.8.29, spark=3.5.3, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run WebDAV tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run WebDAV tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run S3 tests (server=2024.8.29, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest) / Run S3 tests (server=2024.8.29, spark=4.0.0, pydantic=2, java=22, python=3.12, os=ubuntu-latest)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

Artifacts

Produced during runtime
Name Size
coverage-clickhouse-21.1-spark-2.3.1-python-3.7-os-ubuntu-latest
113 KB
coverage-clickhouse-24.8.2.3-alpine-spark-3.5.3-python-3.12-os-ubuntu-latest
145 KB
coverage-clickhouse-24.8.2.3-alpine-spark-4.0.0-python-3.12-os-ubuntu-latest
145 KB
coverage-core-spark-2.3.1-python-3.7-os-ubuntu-latest
161 KB
coverage-core-spark-3.5.3-python-3.12-os-ubuntu-latest
205 KB
coverage-core-spark-4.0.0-python-3.12-os-ubuntu-latest
205 KB
coverage-ftp-latest-python-3.12-os-ubuntu-latest
3.15 KB
coverage-ftps-latest-python-3.12-os-ubuntu-latest
152 KB
coverage-greenplum-6.23.1-spark-2.3.1-python-3.7-os-ubuntu-latest
113 KB
coverage-greenplum-7.0.0-spark-3.2.4-python-3.10-os-ubuntu-latest
124 KB
coverage-hdfs-hadoop2-hdfs-spark-2.3.1-python-3.7-os-ubuntu-latest
139 KB
coverage-hdfs-hadoop3-hdfs-spark-3.5.3-python-3.12-os-ubuntu-latest
171 KB
coverage-hdfs-hadoop3-hdfs-spark-4.0.0-python-3.12-os-ubuntu-latest
171 KB
coverage-hive-spark-2.3.1-python-3.7-os-ubuntu-latest
116 KB
coverage-hive-spark-3.5.3-python-3.12-os-ubuntu-latest
147 KB
coverage-kafka-3.2.3-spark-2.4.8-python-3.7-os-ubuntu-latest
115 KB
coverage-kafka-3.7.1-spark-3.5.3-python-3.12-os-ubuntu-latest
146 KB
coverage-kafka-3.7.1-spark-4.0.0-python-3.12-os-ubuntu-latest
146 KB
coverage-local-fs-spark-2.3.1-python-3.7-os-ubuntu-latest
106 KB
coverage-local-fs-spark-2.4.8-python-3.7-os-ubuntu-latest
107 KB
coverage-local-fs-spark-3.2.4-python-3.7-os-ubuntu-latest
109 KB
coverage-local-fs-spark-3.5.1-python-3.12-os-ubuntu-latest
139 KB
coverage-local-fs-spark-4.0.0-python-3.12-os-ubuntu-latest
139 KB
coverage-mongodb-4.0.0-spark-3.2.4-python-3.7-os-ubuntu-latest
111 KB
coverage-mongodb-7.0.12-spark-4.0.0-python-3.12-os-ubuntu-latest
141 KB
coverage-mongodb-7.0.14-spark-3.5.3-python-3.12-os-ubuntu-latest
141 KB
coverage-mssql-2017-latest-spark-2.3.1-python-3.7-os-ubuntu-20.04
113 KB
coverage-mssql-2022-latest-spark-3.5.3-python-3.12-os-ubuntu-latest
145 KB
coverage-mssql-2022-latest-spark-4.0.0-python-3.12-os-ubuntu-latest
145 KB
coverage-mysql-5.7.13-spark-2.3.1-python-3.7-os-ubuntu-latest
112 KB
coverage-mysql-9.0.1-spark-3.5.3-python-3.12-os-ubuntu-latest
145 KB
coverage-mysql-9.0.1-spark-4.0.0-python-3.12-os-ubuntu-latest
145 KB
coverage-oracle-11.2.0.2-slim-faststart-spark-2.3.1-python-3.7-os-ubuntu-latest
114 KB
coverage-oracle-23.4-slim-faststart-spark-3.5.3-python-3.12-os-ubuntu-latest
147 KB
coverage-oracle-23.4-slim-faststart-spark-4.0.0-python-3.12-os-ubuntu-latest
147 KB
coverage-postgres-16.4-alpine-spark-3.5.3-python-3.12-os-ubuntu-latest
155 KB
coverage-postgres-16.4-alpine-spark-4.0.0-python-3.12-os-ubuntu-latest
155 KB
coverage-postgres-9.4.26-alpine-spark-2.3.1-python-3.7-os-ubuntu-latest
122 KB
coverage-s3-2021.3.17-spark-3.2.4-python-3.7-os-ubuntu-latest
135 KB
coverage-s3-2024.8.29-spark-3.5.3-python-3.12-os-ubuntu-latest
168 KB
coverage-s3-2024.8.29-spark-4.0.0-python-3.12-os-ubuntu-latest
167 KB
coverage-samba-latest-python-3.12-os-ubuntu-latest
151 KB
coverage-samba-latest-python-3.7-os-ubuntu-latest
120 KB
coverage-sftp-9.7_p1-r4-ls166-python-3.12-os-ubuntu-latest
152 KB
coverage-teradata-spark-3.5.3-python-3.12-os-ubuntu-latest
124 KB
coverage-webdav-latest-python-3.12-os-ubuntu-latest
151 KB