refactor: replace in-memory vectors with temp-file-backed storage

Introduces `TempCompactIntVec` and `TempBitVec` as temporary, file-backed intermediates to replace eager in-memory vectors, enabling OS-level paging under memory pressure. Updates the `MatrixGroupOps` trait to return `io::Result` types, allowing proper error propagation and supporting chunked accumulation for large column groups. Includes builder patterns with `.freeze()` finalization, automatic `TempDir` cleanup on drop, and necessary test updates to handle the new fallible signatures. Also fixes `Cargo.toml` section ordering.

This commit is contained in:

Eric Coissac

2026-06-17 15:13:22 +02:00

parent 1d38d87ff9

commit fb4962c4fe

11 changed files with 399 additions and 131 deletions

									
										src/obicompactvec/Cargo.toml
									
		+1
		-1
	
												View File
												
				@@ -7,6 +7,6 @@ edition = "2024"

				memmap2  = "0.9"

				ndarray  = "0.16"

				rayon    = "1"

				tempfile = "3"

				[dev-dependencies]

				tempfile = "3"