#283 Add support for using Spark JDBC connectors for SELECT SQL queries. #300

yruslan · 2023-11-22T07:13:51Z

Closes #283

github-actions · 2023-11-22T07:17:00Z

File	Coverage [86.15%]	🍏
TableReaderJdbcConfig.scala	100%	🍏
JdbcSource.scala	100%	🍏
CsvUtils.scala	100%	🍏
OrchestratorImpl.scala	99.71%	🍏
TableReaderJdbcNative.scala	97.15%	🍏
TableReaderJdbc.scala	87.78%	🍏
TaskRunnerBase.scala	80.93%	🍏
IngestionJob.scala	78.15%	❌

Total Project Coverage	83.5%	🍏

…Spark JDBC connector.

…ion fields.

…ith the runner.

yruslan marked this pull request as ready for review November 22, 2023 07:18

yruslan requested a review from jirifilip as a code owner November 22, 2023 07:18

yruslan added 5 commits November 22, 2023 11:05

#283 Implement the support for using SQL statements with the builtin …

9b8993e

…Spark JDBC connector.

#283 Add unit tests for the new feature of JdbcSource.

03ffa47

#283 Implement projection pushdown for JDBC sources.

daf23d8

Fix CsvUtils reflection compatibility with code coverage instrumentat…

562e673

…ion fields.

Add a bit more coverage for JDBC table readers.

19ae00f

yruslan force-pushed the feature/283-jdbc-source-for-select-queries branch from 3fe12e0 to 19ae00f Compare November 22, 2023 10:27

Include Spark suffix for 'extras' built with Delta to be consistent w…

9832980

…ith the runner.

yruslan force-pushed the feature/283-jdbc-source-for-select-queries branch from 215a1be to 9832980 Compare November 22, 2023 10:32

Fix a couple of typos.

61e10a3

yruslan merged commit 7d781b8 into main Nov 24, 2023
9 checks passed

yruslan deleted the feature/283-jdbc-source-for-select-queries branch November 24, 2023 07:37

yruslan mentioned this pull request Nov 30, 2023

Release Pramen v1.7.0 #310

Merged

Provide feedback