OBIKmers/obikmer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 8 Wiki Activity

feat: add CPU-aware parallel worker pool for partition merging

Browse Source 
Introduce CpuSample to measure process-level CPU efficiency and wall-clock time. Use crossbeam-channel to distribute partition merging tasks to a dynamic worker pool that scales based on CPU utilization, capped at half the available cores. Update diagnostics to track pool usage.
This commit is contained in:
Eric Coissac
2026-06-13 11:32:12 +02:00
parent fb8c6e427c
commit bc14346f5f
4 changed files with 123 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/obikindex/Cargo.toml
+2 -1
View File
@@ -11,7 +11,8 @@ obisys = { path = "../obisys" }
obicompactvec = { path = "../obicompactvec" }
obilayeredmap = { path = "../obilayeredmap" }
ndarray = "0.16"
rayon = "1"
rayon = "1"
crossbeam-channel = "0.5"
serde = { version = "1", features = ["derive"] }
serde_json = "1"
indicatif = "0.17"