There is increased interest in Iceberg Puffin file format recently.
E.g. Iceberg V3 spec adds support for deletion vectors which are expected to be stored in Puffin files.

As noted on the dev-list, currently, only iceberg-java users are able to read and write Puffin files.
Iceberg-rust itself has zero support for Puffin file format today.
This ticket aims to change that by adding support for Puffin to iceberg-rust and iceberg-python (through exposed bindings).

I have already finished writing a PR to add full support for Puffin to iceberg-rust here: #714
However as that PR is quite large, I am splitting it up into multiple PRs as follows:

• feat(puffin): Add Puffin crate and CompressionCodec #745
• refactor(puffin): Move puffin crate contents inside iceberg crate #789
• feat(puffin): Parse Puffin FileMetadata #765
• feat(puffin): Add PuffinReader
• feat(puffin): Add PuffinWriter
• feat(puffin): Make crate contents visible
  • Basically add pub and pub use annotations
  • Turn dead-code warning back on (disabled earlier to allow development)
  • Switch to rust generated files for tests in FileMetadata and Reader classes
• feat(puffin): Add Python bindings
• Optimize puffin file metadata parsing: feat(puffin): Parse Puffin FileMetadata #765 (comment)