Eric Coissac 4736a7b6de refactor: restructure k-mer partitioning pipeline for memory efficiency
Replace in-memory hashing with a disk-backed external merge sort and `PersistentCompactIntVec` to drastically reduce peak RAM. Unify both phases using a custom `PtrHash` MPHF, eliminating `GOFunction` and `boomphf`. Introduce a concrete three-step `count_partition()` pipeline with adaptive chunk sizing based on available system memory. Update dependencies to `memmap2`, `ptr_hash`, and `obicompactvec`. Additionally, document strict genomics-only memory constraints and enforce an architectural feedback workflow requiring explicit user authorization before structural changes.
2026-05-17 16:08:47 +08:00
S
Description
No description provided
Readme
382 MiB
0 Stars 1 Watchers 0 Forks
v1.3.5
Latest
2026-09-12 05:49:49 +00:00
Languages
HTML 52.6%
Rust 42.5%
Python 1.7%
Shell 1.2%
Makefile 1%
Other 1%