Feature Request / Improvement
Based on the experiments from #9437, spark action is not effective as the serialization cost of each partition stats entry is expensive.
Need a table API in the core module to compute stats in a distributed way.
Local algorithm will be similar to the POC from #9437
Query engine
None
Feature Request / Improvement
Based on the experiments from #9437, spark action is not effective as the serialization cost of each partition stats entry is expensive.
Need a table API in the core module to compute stats in a distributed way.
Local algorithm will be similar to the POC from #9437
Query engine
None