feat: add CPU-aware parallel worker pool for partition merging

Introduce CpuSample to measure process-level CPU efficiency and wall-clock time. Use crossbeam-channel to distribute partition merging tasks to a dynamic worker pool that scales based on CPU utilization, capped at half the available cores. Update diagnostics to track pool usage.
2026-06-13 11:32:12 +02:00
parent fb8c6e427c
commit bc14346f5f
4 changed files with 123 additions and 34 deletions
@@ -1507,6 +1507,7 @@ dependencies = [
 name = "obikindex"
 version = "0.1.0"
 dependencies = [
+ "crossbeam-channel",
 "indicatif",
 "ndarray",
 "obicompactvec",