Commit Graph
100 Commits
Author SHA1 Message Date
Celine Mercier 532d8e9cd7 obi import: small efficiency improvement when dealing with NA values 2017-10-04 15:44:48 +02:00
Celine Mercier b4088a7928 Cython API: Added basic taxonomy option 2017-10-04 15:42:17 +02:00
Celine Mercier ae24a807da obi uniq: added the option to merge ids, except it only works on small
sets until lists are implemented properly using obiblobs
2017-09-25 17:28:03 +02:00
Celine Mercier 75c15594c4 obi uniq: added option to use categories additionally to the sequence to
determine uniqueness
2017-09-25 10:56:43 +02:00
Celine Mercier 5ed6835e0e Fixed a bug where the new line count when truncating a column would not
be computed correctly when dealing with high numbers (bad automatic type
for intermediate result)
2017-09-25 10:52:19 +02:00
Celine Mercier 41dec03448 Merge branch 'master' of git@git.metabarcoding.org:obitools/obitools3.git 2017-09-18 16:08:31 +02:00
Celine Mercier 7c57bd33e5 Added check to prevent views from having the name 'taxonomy' (used for
URIs)
2017-09-15 14:54:55 +02:00
Celine Mercier 0e140df0fb Cython API: added some imports in __init__ files 2017-09-14 18:30:04 +02:00
Celine Mercier 73bca6288f New obi uniq 2017-08-20 18:04:21 +02:00
Celine Mercier 6a2759eee6 obi import with new input/ouput API 2017-08-20 17:58:36 +02:00
Celine Mercier 38029b1f77 Forgot a ; 2017-08-20 17:56:18 +02:00
Celine Mercier 663a1a1091 Cython API: column elements: added possibility to check if an element
exists from its index, and a dict-like get() method
2017-08-20 17:44:05 +02:00
Celine Mercier c6d5436a58 Cython API: fixed a bug where iteration on a NUC_SEQS view would not be
done correctly (bug appeared with optimization modifications done
lately)
2017-08-20 17:41:41 +02:00
Celine Mercier 47cad285d6 Cython API: fixed 2 little bugs in Seq API 2017-08-20 17:39:30 +02:00
Celine Mercier 74f15d1a23 Cython API: Various fixes in input handlers (parsers, openers etc).
Mostly working but not bug-free
2017-08-20 17:37:51 +02:00
Celine Mercier c559ddf487 BUG FIX: creation of a new column would fail because of a case not
handled when a high number of elements per line would imply less than
one line per memory page
2017-08-20 17:30:23 +02:00
Celine Mercier 93cff94e7f Fixed some compilation warnings 2017-08-20 17:25:58 +02:00
Celine Mercier 9744a48a67 BUG FIX: seemingly identical obiblobs would have different hash values
because of the padding added by the compiler. Fixed by using calloc
instead of malloc for obiblob memory allocation.
2017-08-20 17:25:15 +02:00
Celine Mercier 6afdc9fb5f AVLs: Added an error check 2017-08-20 17:21:06 +02:00
Celine Mercier 6f202363f4 Fixed a typo in doc 2017-08-20 17:20:13 +02:00
Celine Mercier 7f1ff49aa2 Cython API to import a column and a view from a DMS to another DMS 2017-08-03 16:34:02 +02:00
Celine Mercier 4b86aa67a8 New C functions to import a column and a view from a DMS to another DMS 2017-08-03 16:33:12 +02:00
Celine Mercier a3e81930c2 Views: finished handling and documenting the conditions for an existing
column to be added to a view
2017-08-03 16:32:22 +02:00
Celine Mercier 644b55b49f Fixed doc typo 2017-08-03 16:29:25 +02:00
Celine Mercier 927c684fc2 Utils: new function to copy the content of a file into another file 2017-08-03 16:28:54 +02:00
Celine Mercier 344566d9e9 AVLs: made some functions public and changed some rights to be able to
import AVLs from a DMS to another
2017-08-03 16:27:43 +02:00
Celine Mercier 35b0c55a8c Cython API: various improvements and checks 2017-07-28 13:15:13 +02:00
Celine Mercier 84bb93096f Cython API: fixes and improvements in Column API 2017-07-28 10:27:04 +02:00
Celine Mercier 01c69e7e25 Cython API: fixed a bug when printing a column 2017-07-28 10:01:56 +02:00
Celine Mercier adf5cbef97 Added DMS method to create a DMS if it doesn't already exists, otherwise
opens it
2017-07-28 09:55:43 +02:00
Celine Mercier 9482c663c0 minor comments and changes 2017-07-27 19:46:34 +02:00
Celine Mercier c5f3fdc295 Increased maximum element names length in columns 2017-07-27 19:44:49 +02:00
Celine Mercier 89e2f80fd8 Goes with previous commit 2017-07-27 19:43:00 +02:00
Celine Mercier 7112f44fb7 Bug fixes for input handlers, openers, parsers etc. Compiling but not
tested
2017-07-27 19:42:44 +02:00
Celine Mercier b2fc1f4611 obi uniq: first version 2017-07-27 19:40:19 +02:00
Celine Mercier 75f691d55a Cython API: Seq classes reworked 2017-07-27 19:39:58 +02:00
Celine Mercier 0655063bb0 Cython API: view_NUC_SEQS changes to go with previous commits 2017-07-27 19:39:26 +02:00
Celine Mercier 9701b1230c Cython API: OBIWrapper.new method is now OBIWrapper.new_wrapper to avoid
mismatching method definitions with subclasses
2017-07-27 19:38:25 +02:00
Celine Mercier f8a4428674 Cython API: DMS test_open method doesn't raise an exception anymore 2017-07-27 19:36:28 +02:00
Celine Mercier 1a0f18a11a Cython API: added a __setitem__ method to the View class that can detect
if the item is a Line and create the corresponding columns if needed +
minor changes
2017-07-27 19:35:28 +02:00
Celine Mercier 3d7aa52c90 Cython API: Fixed a bug when setting NA values in Column_multi_elts, and
added some properties
2017-07-27 19:31:15 +02:00
Celine Mercier 69c50ff922 Cython API: added a Column subclass to allow direct access to indexes
for columns that store indexes referring to other data
2017-07-27 19:29:10 +02:00
Celine Mercier c91969126b Cython C API declarations to go with previous commit 2017-07-27 19:26:59 +02:00
Celine Mercier 15d383fa8b Added possibility to specify the offset for encoding and decoding
sequence quality character strings
2017-07-27 19:24:41 +02:00
Celine Mercier 99ceed5fff Cython API: renamed OBI_Taxonomy to Taxonomy and OBI_Taxon to Taxon 2017-07-27 19:21:45 +02:00
Celine Mercier 59dd0a8a8c Standardized and improved the API to create new columns, updated the doc 2017-07-18 17:34:32 +02:00
Celine Mercier c88df2e12c First version of automatic ID and COUNT columns, to discuss (for now,
columns created when NUC_SEQ views are closed if the columns don't
already exist)
2017-07-17 17:31:09 +02:00
Celine Mercier 1e57bfacb4 Fixed some C documentation 2017-07-17 16:45:08 +02:00
Celine Mercier 3e6aecc635 Added a C function to add a COUNT column to a view with all lines set to
1
2017-07-11 16:44:23 +02:00
Celine Mercier ced9a268a1 obi import: added an option to specify the NA value in the input file
(default is 'NA', same as in R's read.table function)
2017-07-11 12:10:33 +02:00
Celine Mercier df2ad41150 Cython APi: Added a width property to views, corresponding to their
column count
2017-07-11 11:46:32 +02:00
Celine Mercier f8895e879d Cython API: Added a function to get a column from its index in the view 2017-07-11 11:36:42 +02:00
Celine Mercier b729b8928f obi less: fixed bug when the length of a view would be less than the
default number of lines printed
2017-07-10 17:04:02 +02:00
Celine Mercier b6b95f26b6 obi import: Skipping sequences is now done through the iterators so that
sequences are not uselessly parsed
2017-07-10 17:02:30 +02:00
Celine Mercier b94ec9557f Cython API: None values aren't inclued anymore in the dictionary
returned when getting a line from a column with multiple elements per
line, and reworked that function to be more optimized
2017-07-07 17:28:53 +02:00
Celine Mercier 143bddf1d1 Cython API: Added an __iter__ method to the class Column_line (iterating
on the elements names) (previously an iteration would work but with
unexpected results)
2017-07-07 15:41:10 +02:00
Celine Mercier a718081ebd Bug with error handling: for now obi_errno needs to be passed to the
function handling errors and exceptions, as it can't read the right
value of the global obi_errno (Cython configuration problem?)
2017-07-07 15:36:11 +02:00
Celine Mercier 740d021276 obi import: fixed bugs when rewriting a column: a bug with new elements
names ignoring previous elements names found, a bug with the global
obi_errno being reset too late, and a bug with the column dictionary
used by obi import not being updated after rewriting a column
2017-07-07 15:33:43 +02:00
Celine Mercier 906343187b Fixed bug with view option in obi less and obi check 2017-07-06 16:42:27 +02:00
Celine Mercier c3cd57a9e3 Removed deprecated file 2017-07-06 10:57:14 +02:00
Celine Mercier f03928c679 Committing minor comments before merging branch with master 2017-07-06 10:56:39 +02:00
Celine Mercier 717ee46f08 Commented a loose print 2017-07-05 18:02:18 +02:00
Celine Mercier 313508cc94 Better *Seq* classes but still need work 2017-07-05 17:53:46 +02:00
Celine Mercier 535fc2af83 Column rewriter and optimized View getter 2017-07-05 17:49:05 +02:00
Celine Mercier 3bbc2ae469 More optimized Column item getter 2017-07-05 17:37:19 +02:00
Celine Mercier 5ee0b3989a Cython API: set_line of Column_multi_elts now accept as values argument
any class where values are referenced by keys with an iterator
2017-07-05 17:32:32 +02:00
Celine Mercier d10192ab0e C functions to detect IUPAC sequences 2017-07-05 17:26:03 +02:00
Celine Mercier 101f764cce New obi import with rewriting of columns when column type or line
elements (keys) change
2017-07-05 17:15:23 +02:00
Celine Mercier cb5ad2ed2d Added functions to try to open a DMS if it exists 2017-07-05 15:38:22 +02:00
Celine Mercier f5e992abbf Added a check on the element when setting a value in a column 2017-07-05 14:49:20 +02:00
Celine Mercier 1d2996c6c0 Better handling and tracing of Index Errors between C and Cython 2017-07-05 14:45:43 +02:00
Celine Mercier f6631f3857 Removed deprecated declarations 2017-07-05 14:42:21 +02:00
Celine Mercier 3f5fef10b9 obi test: minor changes 2017-07-05 14:37:27 +02:00
Celine Mercier 20c72af697 Basic obi check command to check DMS and view informations 2017-07-05 13:54:19 +02:00
Celine Mercier d252131950 Basic obi less command 2017-07-05 13:44:12 +02:00
Celine Mercier ca16ce0bb0 Basic obi grep with new Cython API 2017-07-05 11:58:10 +02:00
Celine Mercier ac94b35336 Removed unused import 2017-07-05 11:52:31 +02:00
Celine Mercier 2d65db4ebc Goes with c2af955b : forgotten files for NUC_SEQS views 2017-04-21 15:15:12 +02:00
Celine Mercier 4b037ae236 Updated obi test to test NUC_SEQS views and the taxonomy API 2017-04-21 12:09:04 +02:00
Celine Mercier c2af955b78 Cython view API: added NUC_SEQS views and sequence classes + changed
cloning API
2017-04-21 12:08:14 +02:00
Celine Mercier 71b1a43df8 Added functions to clone views with a simpler API 2017-04-21 11:58:15 +02:00
Celine Mercier 1725b8b80c Reworked taxonomy Cython API to be a subclass of OBIWrapper 2017-04-21 11:54:05 +02:00
Celine Mercier ab0d08293e Cython API: removed unnecessary imports 2017-04-21 11:51:05 +02:00
Celine Mercier 2f0c4b90d7 Fixed a problem where a view would have a wrong line count after adding
a first column to it if there was already a Line selection associated
(happening when cloning), and fixed a bad error check.
2017-04-14 16:25:55 +02:00
Celine Mercier 537b9847da Minor C doc clarification 2017-04-14 16:23:17 +02:00
Celine Mercier b998373be5 Cython API: updated the test command for the new API and deactivated the
other commands for now
2017-04-14 16:21:33 +02:00
Celine Mercier 6f780148e2 Cython API: added taxonomy API 2017-04-14 16:20:30 +02:00
Celine Mercier 0e08fc486a Cython API: fixed bug when deleting a column from a view where the
Cython wrapper wasn't closed, and fixed the Line selection
materialization
2017-04-14 16:19:18 +02:00
Celine Mercier 2bbee64e57 Cython API: fixed problems with Column class 2017-04-14 16:14:41 +02:00
Celine Mercier 693859eec2 Cython API: fixed conversion bugs when setting and getting values
(especially NA values) in OBI_CHAR, OBI_STR and OBI_SEQ columns
2017-04-14 16:07:23 +02:00
Celine Mercier a3fad27190 Cython API: automatic importing of column classes now works 2017-04-06 15:45:02 +02:00
Celine Mercier f351540b0b Merge branch 'Eric_new_Python_API' of git@git.metabarcoding.org:obitools/obitools3.git into Eric_new_Python_API 2017-04-06 15:39:52 +02:00
Celine Mercier 5de9e0de51 Cython API: now using const char* instead of char* for the type of
values read from OBI_STR columns
2017-04-06 15:15:20 +02:00
Celine Mercier ad8de80353 Views: better checks when adding an existing column to a view 2017-04-06 14:44:07 +02:00
Celine Mercier 8cd3e3604f Cython Column API 2017-04-06 14:42:11 +02:00
Celine Mercier 255f3c92ae Cython View API 2017-04-06 14:41:58 +02:00
Celine Mercier 08be4e231d Cython Object API 2017-04-06 14:41:43 +02:00
Celine Mercier b5b7995411 new Cython DMS API 2017-04-06 14:41:26 +02:00
Celine Mercier 0dfb1eb3e6 Cython typed columns 2017-04-06 14:40:44 +02:00
Celine Mercier 381194194c Cython API: compiling but not working 2017-03-06 16:07:02 +01:00