Apache Iceberg 1.12.0 released with V4 spec updates and Spark 3.4 removal
Key Takeaway
Apache Iceberg 1.12.0 introduces V4 specification features, including Parquet/Avro manifest support and relative paths.
Summary
The Apache Iceberg 1.12.0 release brings significant updates to the table format specification and ecosystem integrations. Key changes include support for writing Parquet and Avro manifests in the V4 spec, the removal of Spark 3.4 support, and various improvements for Flink and Kafka Connect. The release also introduces new security model documentation and technical refinements to core IO operations.
Technical changes in Iceberg 1.12.0
- V4 Specification: Adds support for writing Parquet/Avro manifests and introduces relative paths.
- Spark Integration: Removes support for Spark 3.4 and deprecates SparkFilters in favor of SparkV2Filters.
- Flink Improvements: Adds support for writing shredded variants, handles table comments in FlinkSQL, and allows slot sharing group settings in DynamicSink.
- Core & IO: Implements DelegateFileIO for encrypting IO and adds content statistics to the spec.
- Kafka Connect: Fixes commit failure handling and resolves CME in IcebergSinkConfig.
Why it matters
The removal of Spark 3.4 support signals a shift toward newer Spark versions, while the V4 spec updates prepare the ecosystem for more efficient manifest handling.
Original reference: github.com →