Push zkspuxlpumpw #27

2026-06-13T11:25:07Z

coissac commented

2026-06-13 11:25:07 +00:00

No description provided.

coissac added 2 commits 2026-06-13 11:25:07 +00:00

feat: add performance instrumentation and dynamic worker scaling 6d85387077

This change enhances observability and adaptability in the merge pipeline. Performance timing and debug logging are added to the De Bruijn graph and partition merge layers to track phase durations and pipeline metrics. The merge module replaces blocking receives with timed polls to sample CPU efficiency, dynamically spawning workers when utilization drops below a threshold. A new script is also introduced to parse merge debug logs and generate structured Markdown reports detailing throughput, phase breakdowns, and partition performance.

refactor: Enforce Rayon parallelism and fix merge_layer concurrency 547cb72d76

Updated memory guidelines and feedback docs to explicitly classify intra-partition phases as parallel, correcting prior assumptions of sequential execution. Refactored merge_layer.rs to wrap column builders in Arc<Mutex<ColBuilder>> and use Arc::try_unwrap for safe concurrent access, eliminating race conditions and preventing double-closes during pass2.

coissac merged commit 817b02cbc1 into main

2026-06-13 11:25:12 +00:00

coissac deleted branch push-zkspuxlpumpw

2026-06-13 11:25:13 +00:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: OBIKmers/obikmer#27