How can I quickly calculate the size of each partition?

[majian1998]

Query engine

Spark, Flink

Question

Currently, I just want to quickly calculate the size of each partition in Iceberg. Is there a good way to do this?

[ajantha-bhat]

You can use partitions metadata table which reads all the manifests and populates this table
https://iceberg.apache.org/docs/1.6.0/spark-queries/#partitions

But if that is slow and you want more quicker way, you can use the partition statistics available in Iceberg.
#8450
Note: Partition stats only available via java API. It is in the process of integarting with engines.

Spark [WIP]: #12450

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'