obitools/obitools3
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 66 Wiki Activity
629 Commits 18 Branches 66 Tags
09982689552f9e3714722a696e736ed0eac61a49
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Celine Mercier 0998268955 Fixed two little potential bugs when cleaning unfinished columns and 
deleted old trace
 2017-11-24 18:03:59 +01:00
Celine Mercier 31726407a3 Taxonomy: fixed a bug where a pointer was not properly reallocated, and 
a bug where the merged list of taxids was not built correctly
 2017-11-24 18:01:30 +01:00
Celine Mercier d21f4a6f90 Header parser: identifiers ending with ';' are now handled 2017-11-24 17:59:52 +01:00
Celine Mercier 9e3ac477eb OBIDMS: Opened DMS now have a counter associated so that DMS are not 
actually opened several times by the same program, which triggers the
cleaning of unfinished views and columns (to discuss)
 2017-11-24 17:58:47 +01:00
Celine Mercier ee5d647d0d Taxonomy: fixed a bug un parental tree iterator 2017-11-24 17:55:17 +01:00
Celine Mercier 38fef5b9d4 obi test: better taxonomy testing 2017-11-24 17:54:10 +01:00
Celine Mercier 3ba7ce1c91 View rollback: version files and column directories aren't deleted 
anymore to prevent indexer bug, and fixed a freeing bug
 2017-11-15 17:27:26 +01:00
Celine Mercier 9a50803c00 Added tuple columns containing immutable indexed data arrays of any type 2017-11-15 13:48:59 +01:00
Celine Mercier 1684f96b79 Fixed a bug when flagging a read-only column as finished 2017-10-26 19:11:29 +02:00
Celine Mercier 43f65e7fd0 obi uniq: fixed bug where dictionary indexes were not read properly, and 
added view rollback in case of an exception.
 2017-10-26 19:00:05 +02:00
Celine Mercier dfd51939a0 Views are now rollbacked if an error occurs, and unfinished views and 
columns are deleted when an OBIDMS is opened.
 2017-10-26 18:58:48 +02:00
Celine Mercier 1ae634d56b Added atexit command to obi import, obi uniq and obi less 2017-10-16 11:09:55 +02:00
Celine Mercier 04e065094a All DMS opened by a program are now listed and closed with atexit system 2017-10-16 10:35:07 +02:00
Celine Mercier 5ddd1d9ae6 obi uniq: added taxonomy handling 2017-10-04 16:13:07 +02:00
Celine Mercier 9fc6868341 Increased maximum length for elements names 2017-10-04 16:10:53 +02:00
Celine Mercier f2ece573ff Removed deprecated command 2017-10-04 16:09:41 +02:00
Celine Mercier fb9b219abe Fixed a bug with taxonomy URIs not being read correctly 2017-10-04 16:00:30 +02:00
Celine Mercier 09a5f89849 Column API: improvements to be more flexible when referring to elements 
in columns with several elements per line.
 2017-10-04 15:59:23 +02:00
Celine Mercier 535692b020 Taxonomy: new functions and improvements 2017-10-04 15:55:13 +02:00
Celine Mercier 0ab081f79e Updated obi test to work with changes in taxonomy API 2017-10-04 15:50:32 +02:00
Celine Mercier 1cb05de7e3 Basic obi less 2017-10-04 15:46:26 +02:00
Celine Mercier 532d8e9cd7 obi import: small efficiency improvement when dealing with NA values 2017-10-04 15:44:48 +02:00
Celine Mercier b4088a7928 Cython API: Added basic taxonomy option 2017-10-04 15:42:17 +02:00
Celine Mercier ae24a807da obi uniq: added the option to merge ids, except it only works on small 
sets until lists are implemented properly using obiblobs
 2017-09-25 17:28:03 +02:00
Celine Mercier 75c15594c4 obi uniq: added option to use categories additionally to the sequence to 
determine uniqueness
 2017-09-25 10:56:43 +02:00
Celine Mercier 5ed6835e0e Fixed a bug where the new line count when truncating a column would not 
be computed correctly when dealing with high numbers (bad automatic type
for intermediate result)
 2017-09-25 10:52:19 +02:00
Celine Mercier 41dec03448 Merge branch 'master' of git@git.metabarcoding.org:obitools/obitools3.git 2017-09-18 16:08:31 +02:00
Celine Mercier 7c57bd33e5 Added check to prevent views from having the name 'taxonomy' (used for 
URIs)
 2017-09-15 14:54:55 +02:00
Celine Mercier 0e140df0fb Cython API: added some imports in __init__ files 2017-09-14 18:30:04 +02:00
Celine Mercier 73bca6288f New obi uniq 2017-08-20 18:04:21 +02:00
Celine Mercier 6a2759eee6 obi import with new input/ouput API 2017-08-20 17:58:36 +02:00
Celine Mercier 38029b1f77 Forgot a ; 2017-08-20 17:56:18 +02:00
Celine Mercier 663a1a1091 Cython API: column elements: added possibility to check if an element 
exists from its index, and a dict-like get() method
 2017-08-20 17:44:05 +02:00
Celine Mercier c6d5436a58 Cython API: fixed a bug where iteration on a NUC_SEQS view would not be 
done correctly (bug appeared with optimization modifications done
lately)
 2017-08-20 17:41:41 +02:00
Celine Mercier 47cad285d6 Cython API: fixed 2 little bugs in Seq API 2017-08-20 17:39:30 +02:00
Celine Mercier 74f15d1a23 Cython API: Various fixes in input handlers (parsers, openers etc). 
Mostly working but not bug-free
 2017-08-20 17:37:51 +02:00
Celine Mercier c559ddf487 BUG FIX: creation of a new column would fail because of a case not 
handled when a high number of elements per line would imply less than
one line per memory page
 2017-08-20 17:30:23 +02:00
Celine Mercier 93cff94e7f Fixed some compilation warnings 2017-08-20 17:25:58 +02:00
Celine Mercier 9744a48a67 BUG FIX: seemingly identical obiblobs would have different hash values 
because of the padding added by the compiler. Fixed by using calloc
instead of malloc for obiblob memory allocation.
 2017-08-20 17:25:15 +02:00
Celine Mercier 6afdc9fb5f AVLs: Added an error check 2017-08-20 17:21:06 +02:00
Celine Mercier 6f202363f4 Fixed a typo in doc 2017-08-20 17:20:13 +02:00
Celine Mercier 7f1ff49aa2 Cython API to import a column and a view from a DMS to another DMS 2017-08-03 16:34:02 +02:00
Celine Mercier 4b86aa67a8 New C functions to import a column and a view from a DMS to another DMS 2017-08-03 16:33:12 +02:00
Celine Mercier a3e81930c2 Views: finished handling and documenting the conditions for an existing 
column to be added to a view
 2017-08-03 16:32:22 +02:00
Celine Mercier 644b55b49f Fixed doc typo 2017-08-03 16:29:25 +02:00
Celine Mercier 927c684fc2 Utils: new function to copy the content of a file into another file 2017-08-03 16:28:54 +02:00
Celine Mercier 344566d9e9 AVLs: made some functions public and changed some rights to be able to 
import AVLs from a DMS to another
 2017-08-03 16:27:43 +02:00
Celine Mercier 35b0c55a8c Cython API: various improvements and checks 2017-07-28 13:15:13 +02:00
Celine Mercier 84bb93096f Cython API: fixes and improvements in Column API 2017-07-28 10:27:04 +02:00
Celine Mercier 01c69e7e25 Cython API: fixed a bug when printing a column 2017-07-28 10:01:56 +02:00
Celine Mercier adf5cbef97 Added DMS method to create a DMS if it doesn't already exists, otherwise 
opens it
 2017-07-28 09:55:43 +02:00
Celine Mercier 9482c663c0 minor comments and changes 2017-07-27 19:46:34 +02:00
Celine Mercier c5f3fdc295 Increased maximum element names length in columns 2017-07-27 19:44:49 +02:00
Celine Mercier 89e2f80fd8 Goes with previous commit 2017-07-27 19:43:00 +02:00
Celine Mercier 7112f44fb7 Bug fixes for input handlers, openers, parsers etc. Compiling but not 
tested
 2017-07-27 19:42:44 +02:00
Celine Mercier b2fc1f4611 obi uniq: first version 2017-07-27 19:40:19 +02:00
Celine Mercier 75f691d55a Cython API: Seq classes reworked 2017-07-27 19:39:58 +02:00
Celine Mercier 0655063bb0 Cython API: view_NUC_SEQS changes to go with previous commits 2017-07-27 19:39:26 +02:00
Celine Mercier 9701b1230c Cython API: OBIWrapper.new method is now OBIWrapper.new_wrapper to avoid 
mismatching method definitions with subclasses
 2017-07-27 19:38:25 +02:00
Celine Mercier f8a4428674 Cython API: DMS test_open method doesn't raise an exception anymore 2017-07-27 19:36:28 +02:00
Celine Mercier 1a0f18a11a Cython API: added a __setitem__ method to the View class that can detect 
if the item is a Line and create the corresponding columns if needed +
minor changes
 2017-07-27 19:35:28 +02:00
Celine Mercier 3d7aa52c90 Cython API: Fixed a bug when setting NA values in Column_multi_elts, and 
added some properties
 2017-07-27 19:31:15 +02:00
Celine Mercier 69c50ff922 Cython API: added a Column subclass to allow direct access to indexes 
for columns that store indexes referring to other data
 2017-07-27 19:29:10 +02:00
Celine Mercier c91969126b Cython C API declarations to go with previous commit 2017-07-27 19:26:59 +02:00
Celine Mercier 15d383fa8b Added possibility to specify the offset for encoding and decoding 
sequence quality character strings
 2017-07-27 19:24:41 +02:00
Celine Mercier 99ceed5fff Cython API: renamed OBI_Taxonomy to Taxonomy and OBI_Taxon to Taxon 2017-07-27 19:21:45 +02:00
Celine Mercier 59dd0a8a8c Standardized and improved the API to create new columns, updated the doc 2017-07-18 17:34:32 +02:00
Celine Mercier c88df2e12c First version of automatic ID and COUNT columns, to discuss (for now, 
columns created when NUC_SEQ views are closed if the columns don't
already exist)
 2017-07-17 17:31:09 +02:00
Celine Mercier 1e57bfacb4 Fixed some C documentation 2017-07-17 16:45:08 +02:00
Celine Mercier 3e6aecc635 Added a C function to add a COUNT column to a view with all lines set to 
1
 2017-07-11 16:44:23 +02:00
Celine Mercier ced9a268a1 obi import: added an option to specify the NA value in the input file 
(default is 'NA', same as in R's read.table function)
 2017-07-11 12:10:33 +02:00
Celine Mercier df2ad41150 Cython APi: Added a width property to views, corresponding to their 
column count
 2017-07-11 11:46:32 +02:00
Celine Mercier f8895e879d Cython API: Added a function to get a column from its index in the view 2017-07-11 11:36:42 +02:00
Celine Mercier b729b8928f obi less: fixed bug when the length of a view would be less than the 
default number of lines printed
 2017-07-10 17:04:02 +02:00
Celine Mercier b6b95f26b6 obi import: Skipping sequences is now done through the iterators so that 
sequences are not uselessly parsed
 2017-07-10 17:02:30 +02:00
Celine Mercier b94ec9557f Cython API: None values aren't inclued anymore in the dictionary 
returned when getting a line from a column with multiple elements per
line, and reworked that function to be more optimized
 2017-07-07 17:28:53 +02:00
Celine Mercier 143bddf1d1 Cython API: Added an __iter__ method to the class Column_line (iterating 
on the elements names) (previously an iteration would work but with
unexpected results)
 2017-07-07 15:41:10 +02:00
Celine Mercier a718081ebd Bug with error handling: for now obi_errno needs to be passed to the 
function handling errors and exceptions, as it can't read the right
value of the global obi_errno (Cython configuration problem?)
 2017-07-07 15:36:11 +02:00
Celine Mercier 740d021276 obi import: fixed bugs when rewriting a column: a bug with new elements 
names ignoring previous elements names found, a bug with the global
obi_errno being reset too late, and a bug with the column dictionary
used by obi import not being updated after rewriting a column
 2017-07-07 15:33:43 +02:00
Celine Mercier 906343187b Fixed bug with view option in obi less and obi check 2017-07-06 16:42:27 +02:00
Celine Mercier c3cd57a9e3 Removed deprecated file 2017-07-06 10:57:14 +02:00
Celine Mercier f03928c679 Committing minor comments before merging branch with master 2017-07-06 10:56:39 +02:00
Celine Mercier 717ee46f08 Commented a loose print 2017-07-05 18:02:18 +02:00
Celine Mercier 313508cc94 Better *Seq* classes but still need work 2017-07-05 17:53:46 +02:00
Celine Mercier 535fc2af83 Column rewriter and optimized View getter 2017-07-05 17:49:05 +02:00
Celine Mercier 3bbc2ae469 More optimized Column item getter 2017-07-05 17:37:19 +02:00
Celine Mercier 5ee0b3989a Cython API: set_line of Column_multi_elts now accept as values argument 
any class where values are referenced by keys with an iterator
 2017-07-05 17:32:32 +02:00
Celine Mercier d10192ab0e C functions to detect IUPAC sequences 2017-07-05 17:26:03 +02:00
Celine Mercier 101f764cce New obi import with rewriting of columns when column type or line 
elements (keys) change
 2017-07-05 17:15:23 +02:00
Celine Mercier cb5ad2ed2d Added functions to try to open a DMS if it exists 2017-07-05 15:38:22 +02:00
Celine Mercier f5e992abbf Added a check on the element when setting a value in a column 2017-07-05 14:49:20 +02:00
Celine Mercier 1d2996c6c0 Better handling and tracing of Index Errors between C and Cython 2017-07-05 14:45:43 +02:00
Celine Mercier f6631f3857 Removed deprecated declarations 2017-07-05 14:42:21 +02:00
Celine Mercier 3f5fef10b9 obi test: minor changes 2017-07-05 14:37:27 +02:00
Celine Mercier 20c72af697 Basic obi check command to check DMS and view informations 2017-07-05 13:54:19 +02:00
Celine Mercier d252131950 Basic obi less command 2017-07-05 13:44:12 +02:00
Celine Mercier ca16ce0bb0 Basic obi grep with new Cython API 2017-07-05 11:58:10 +02:00
Celine Mercier ac94b35336 Removed unused import 2017-07-05 11:52:31 +02:00
Celine Mercier 2d65db4ebc Goes with c2af955b : forgotten files for NUC_SEQS views 2017-04-21 15:15:12 +02:00
Celine Mercier 4b037ae236 Updated obi test to test NUC_SEQS views and the taxonomy API 2017-04-21 12:09:04 +02:00