Arctic-0.4.0
Changelog for Arctic-0.4.0
New Features:
- [Feature]: Support managing iceberg tables already existed #260
- [Feature][Spark]: Standard auth utils method for Kyuubi #582
- [Feature][AMS]: Show table info for native iceberg in AMS dashboard #531
- [Feature][Spark]: Support duplicate-key-check when insert into and insert overwrite #484
- [Feature][AMS]: Support add/modify by AMS Dashboard #412
- [Feature][AMS]: Add setting page in AMS dashboard #407
- [Feature]: Support table watermark to determine table freshness #394
- [Feature]: AMS terminal uses Kyuubi as its backend SQL engine #262
Improvement:
- [Improvement]: Hidden username and password in setting page #630
- [Improvement]: Fix file upload when using derby as storage #622
- [Improvement]: Expose arctic benchmark code and docker environment file #265
- [Improvement]: Do some initialization when adding catalog #617
- [Improvement]: Identify Hadoop and Hive version Arctic had supported #356
- [Improvement]: Upgrade iceberg version to 0.13 or 0.14 #397
- [Improvement]: Update the documentation in the Flink DML section #598
- [Improvement][AMS]: Improve the high concurrency processing capability of the allocateTransactionId interface #393
- [ARCTIC-557][FLINK] Doc catalog authorization configs #570
- [Optimize] Risk of AMS memory usage and task execute timeout when processing a large number of small files #128
Bugfix:
- [Bug]: Some bugs in the local test for version 0.4.0 bug #626
- [Bug]: Including a line-through in the arctic HA property causes the catalog to load failed #515
- [Bug][Flink]: Read duplicated data from a keyed table, even though the upsert mode is enabled. #592
- [Bug]: Flink 1.15 quickstart failed for java.lang.ClassNotFoundException #563
- [ARCTIC-561] When the flink job fails, the flink job will commit a wrong transaction id #568
- [Bug]: For the Arctic keyed table, the out-of-order TransactionId lead to inconsistent data #479
- [Bug][Flink]: Watermark may be lost if split read too fast. #486