Release Pramen v1.7.0

[yruslan]

What's Changed

• When 'trackDays=0', Pramen should never checks source data record count if the table is already loaded for the day #279 When 'trackDays=0', Pramen never checks source data record count if the table is already loaded for the day in #279 When 'trackDays=0', Pramen never checks source data record count if the table is already loaded for the day. #280
• Add support for Spark JDBC sources with SQL inputs #283 Add support for using Spark JDBC connectors for SELECT SQL queries in #283 Add support for using Spark JDBC connectors for SELECT SQL queries. #300
• The 'preman-runner' component component is obsolete, can be merged with 'pramen-core' #291 Combine 'core' and 'runner' modules into 'core' in #291 Combine 'core' and 'runner' modules into 'core'. #297
• Pramen considers late data the data that has already been loaded #292 Fix the last expected info date calculation in #292 Fix the last expected info date calculation. #293
• Allow the ability for multiple transformers to write to the same table #294 Allow multiple transformers output to the same table in #294 Allow multiple transformers output to the same table #296
• Make 'format' parameter of SparkSource optional. #295 Make 'format' parameter of SparkSource optional in Make 'format' parameter of SparkSource optional. #295
• Do not include Delta Lake format libraries in the assembly JAR by default #298 Do not include Delta Lake classes in the runner bundle by default in #298 Do not include Delta Lake classes in the runner bundle by default. #299
• Pramen pipelines sometimes hang when parallel.tasks > 1 #302 Improve handling of fatal errors in parallel pipeline executions in #302 Improve handling of fatal errors in parallel pipeline executions. #303
• Make SqlGenerators.getWhere() accessible on the trait level #307 Open access to more methods of SQL Generators in #307 Open access to more methods of SQL Generators. #309

[github-actions]

Unit Test Coverage

There is no coverage information present for the Files changed

Total Project Coverage	83.25%	🍏