refactor: optimize dump partition iteration and add progress tracking #20

Merged
coissac merged 1 commits from push-xqswlxlvmyrq into main 2026-06-09 09:34:13 +00:00

1 Commits

Author SHA1 Message Date
Eric Coissac db730e9cf6 refactor: optimize dump partition iteration and add progress tracking
Refactor partition iteration to support a generic `on_partition` callback executed after each parallel partition completes. Split the logic into bounded and unbounded paths; the bounded path uses an `AtomicUsize` to enforce row limits, while the unbounded path eliminates atomic contention to improve throughput. Additionally, integrate a progress bar into the dump command by passing an increment callback to `idx.dump()`, ensuring proper initialization and cleanup.
2026-06-09 11:07:48 +02:00