OBIKmers/obikmer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 8 Wiki Activity

refactor: parallelize merge and partition logic with obipipeline

Browse Source 
Introduce the `obipipeline` dependency and refactor merge and partition logic to leverage parallel execution. Update `merge_partitions` to use rayon with dynamic memory budgeting and concurrency control via a pilot run. Refactor Pass 1 to concurrently read unitigs, filter kmers through a shared `LayeredMap`, and populate the graph safely. Simplify diagnostics to report total kmer counts and replace manual flags with graph length validation.
This commit is contained in:
Eric Coissac
2026-06-12 20:54:44 +02:00
parent 2bc189e962
commit ba49af6f9e
4 changed files with 134 additions and 187 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/obikpartitionner/Cargo.toml
+2 -1
View File
@@ -28,4 +28,5 @@ memmap2 = "0.9.10"
obicompactvec = { path = "../obicompactvec" }
ptr_hash = "1.1"
indicatif = "0.17"
obisys = { path = "../obisys" }
obisys = { path = "../obisys" }
obipipeline = { path = "../obipipeline" }