Skip to content

Add a table API to compute partition stats.  #10105

Description

@ajantha-bhat

Feature Request / Improvement

Based on the experiments from #9437, spark action is not effective as the serialization cost of each partition stats entry is expensive.

Need a table API in the core module to compute stats in a distributed way.
Local algorithm will be similar to the POC from #9437

Query engine

None

Metadata

Metadata

Assignees

Labels

improvementPR that improves existing functionalitystale

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions