Commit Graph
100 Commits
Author SHA1 Message Date
Celine Mercier dfd51939a0 Views are now rollbacked if an error occurs, and unfinished views and
columns are deleted when an OBIDMS is opened.
2017-10-26 18:58:48 +02:00
Celine Mercier 1ae634d56b Added atexit command to obi import, obi uniq and obi less 2017-10-16 11:09:55 +02:00
Celine Mercier 04e065094a All DMS opened by a program are now listed and closed with atexit system 2017-10-16 10:35:07 +02:00
Celine Mercier 5ddd1d9ae6 obi uniq: added taxonomy handling 2017-10-04 16:13:07 +02:00
Celine Mercier 9fc6868341 Increased maximum length for elements names 2017-10-04 16:10:53 +02:00
Celine Mercier f2ece573ff Removed deprecated command 2017-10-04 16:09:41 +02:00
Celine Mercier fb9b219abe Fixed a bug with taxonomy URIs not being read correctly 2017-10-04 16:00:30 +02:00
Celine Mercier 09a5f89849 Column API: improvements to be more flexible when referring to elements
in columns with several elements per line.
2017-10-04 15:59:23 +02:00
Celine Mercier 535692b020 Taxonomy: new functions and improvements 2017-10-04 15:55:13 +02:00
Celine Mercier 0ab081f79e Updated obi test to work with changes in taxonomy API 2017-10-04 15:50:32 +02:00
Celine Mercier 1cb05de7e3 Basic obi less 2017-10-04 15:46:26 +02:00
Celine Mercier 532d8e9cd7 obi import: small efficiency improvement when dealing with NA values 2017-10-04 15:44:48 +02:00
Celine Mercier b4088a7928 Cython API: Added basic taxonomy option 2017-10-04 15:42:17 +02:00
Celine Mercier ae24a807da obi uniq: added the option to merge ids, except it only works on small
sets until lists are implemented properly using obiblobs
2017-09-25 17:28:03 +02:00
Celine Mercier 75c15594c4 obi uniq: added option to use categories additionally to the sequence to
determine uniqueness
2017-09-25 10:56:43 +02:00
Celine Mercier 5ed6835e0e Fixed a bug where the new line count when truncating a column would not
be computed correctly when dealing with high numbers (bad automatic type
for intermediate result)
2017-09-25 10:52:19 +02:00
Celine Mercier 41dec03448 Merge branch 'master' of git@git.metabarcoding.org:obitools/obitools3.git 2017-09-18 16:08:31 +02:00
Celine Mercier 7c57bd33e5 Added check to prevent views from having the name 'taxonomy' (used for
URIs)
2017-09-15 14:54:55 +02:00
Celine Mercier 0e140df0fb Cython API: added some imports in __init__ files 2017-09-14 18:30:04 +02:00
Celine Mercier 73bca6288f New obi uniq 2017-08-20 18:04:21 +02:00
Celine Mercier 6a2759eee6 obi import with new input/ouput API 2017-08-20 17:58:36 +02:00
Celine Mercier 38029b1f77 Forgot a ; 2017-08-20 17:56:18 +02:00
Celine Mercier 663a1a1091 Cython API: column elements: added possibility to check if an element
exists from its index, and a dict-like get() method
2017-08-20 17:44:05 +02:00
Celine Mercier c6d5436a58 Cython API: fixed a bug where iteration on a NUC_SEQS view would not be
done correctly (bug appeared with optimization modifications done
lately)
2017-08-20 17:41:41 +02:00
Celine Mercier 47cad285d6 Cython API: fixed 2 little bugs in Seq API 2017-08-20 17:39:30 +02:00
Celine Mercier 74f15d1a23 Cython API: Various fixes in input handlers (parsers, openers etc).
Mostly working but not bug-free
2017-08-20 17:37:51 +02:00
Celine Mercier c559ddf487 BUG FIX: creation of a new column would fail because of a case not
handled when a high number of elements per line would imply less than
one line per memory page
2017-08-20 17:30:23 +02:00
Celine Mercier 93cff94e7f Fixed some compilation warnings 2017-08-20 17:25:58 +02:00
Celine Mercier 9744a48a67 BUG FIX: seemingly identical obiblobs would have different hash values
because of the padding added by the compiler. Fixed by using calloc
instead of malloc for obiblob memory allocation.
2017-08-20 17:25:15 +02:00
Celine Mercier 6afdc9fb5f AVLs: Added an error check 2017-08-20 17:21:06 +02:00
Celine Mercier 6f202363f4 Fixed a typo in doc 2017-08-20 17:20:13 +02:00
Celine Mercier 7f1ff49aa2 Cython API to import a column and a view from a DMS to another DMS 2017-08-03 16:34:02 +02:00
Celine Mercier 4b86aa67a8 New C functions to import a column and a view from a DMS to another DMS 2017-08-03 16:33:12 +02:00
Celine Mercier a3e81930c2 Views: finished handling and documenting the conditions for an existing
column to be added to a view
2017-08-03 16:32:22 +02:00
Celine Mercier 644b55b49f Fixed doc typo 2017-08-03 16:29:25 +02:00
Celine Mercier 927c684fc2 Utils: new function to copy the content of a file into another file 2017-08-03 16:28:54 +02:00
Celine Mercier 344566d9e9 AVLs: made some functions public and changed some rights to be able to
import AVLs from a DMS to another
2017-08-03 16:27:43 +02:00
Celine Mercier 35b0c55a8c Cython API: various improvements and checks 2017-07-28 13:15:13 +02:00
Celine Mercier 84bb93096f Cython API: fixes and improvements in Column API 2017-07-28 10:27:04 +02:00
Celine Mercier 01c69e7e25 Cython API: fixed a bug when printing a column 2017-07-28 10:01:56 +02:00
Celine Mercier adf5cbef97 Added DMS method to create a DMS if it doesn't already exists, otherwise
opens it
2017-07-28 09:55:43 +02:00
Celine Mercier 9482c663c0 minor comments and changes 2017-07-27 19:46:34 +02:00
Celine Mercier c5f3fdc295 Increased maximum element names length in columns 2017-07-27 19:44:49 +02:00
Celine Mercier 89e2f80fd8 Goes with previous commit 2017-07-27 19:43:00 +02:00
Celine Mercier 7112f44fb7 Bug fixes for input handlers, openers, parsers etc. Compiling but not
tested
2017-07-27 19:42:44 +02:00
Celine Mercier b2fc1f4611 obi uniq: first version 2017-07-27 19:40:19 +02:00
Celine Mercier 75f691d55a Cython API: Seq classes reworked 2017-07-27 19:39:58 +02:00
Celine Mercier 0655063bb0 Cython API: view_NUC_SEQS changes to go with previous commits 2017-07-27 19:39:26 +02:00
Celine Mercier 9701b1230c Cython API: OBIWrapper.new method is now OBIWrapper.new_wrapper to avoid
mismatching method definitions with subclasses
2017-07-27 19:38:25 +02:00
Celine Mercier f8a4428674 Cython API: DMS test_open method doesn't raise an exception anymore 2017-07-27 19:36:28 +02:00
Celine Mercier 1a0f18a11a Cython API: added a __setitem__ method to the View class that can detect
if the item is a Line and create the corresponding columns if needed +
minor changes
2017-07-27 19:35:28 +02:00
Celine Mercier 3d7aa52c90 Cython API: Fixed a bug when setting NA values in Column_multi_elts, and
added some properties
2017-07-27 19:31:15 +02:00
Celine Mercier 69c50ff922 Cython API: added a Column subclass to allow direct access to indexes
for columns that store indexes referring to other data
2017-07-27 19:29:10 +02:00
Celine Mercier c91969126b Cython C API declarations to go with previous commit 2017-07-27 19:26:59 +02:00
Celine Mercier 15d383fa8b Added possibility to specify the offset for encoding and decoding
sequence quality character strings
2017-07-27 19:24:41 +02:00
Celine Mercier 99ceed5fff Cython API: renamed OBI_Taxonomy to Taxonomy and OBI_Taxon to Taxon 2017-07-27 19:21:45 +02:00
Celine Mercier 59dd0a8a8c Standardized and improved the API to create new columns, updated the doc 2017-07-18 17:34:32 +02:00
Celine Mercier c88df2e12c First version of automatic ID and COUNT columns, to discuss (for now,
columns created when NUC_SEQ views are closed if the columns don't
already exist)
2017-07-17 17:31:09 +02:00
Celine Mercier 1e57bfacb4 Fixed some C documentation 2017-07-17 16:45:08 +02:00
Celine Mercier 3e6aecc635 Added a C function to add a COUNT column to a view with all lines set to
1
2017-07-11 16:44:23 +02:00
Celine Mercier ced9a268a1 obi import: added an option to specify the NA value in the input file
(default is 'NA', same as in R's read.table function)
2017-07-11 12:10:33 +02:00
Celine Mercier df2ad41150 Cython APi: Added a width property to views, corresponding to their
column count
2017-07-11 11:46:32 +02:00
Celine Mercier f8895e879d Cython API: Added a function to get a column from its index in the view 2017-07-11 11:36:42 +02:00
Celine Mercier b729b8928f obi less: fixed bug when the length of a view would be less than the
default number of lines printed
2017-07-10 17:04:02 +02:00
Celine Mercier b6b95f26b6 obi import: Skipping sequences is now done through the iterators so that
sequences are not uselessly parsed
2017-07-10 17:02:30 +02:00
Celine Mercier b94ec9557f Cython API: None values aren't inclued anymore in the dictionary
returned when getting a line from a column with multiple elements per
line, and reworked that function to be more optimized
2017-07-07 17:28:53 +02:00
Celine Mercier 143bddf1d1 Cython API: Added an __iter__ method to the class Column_line (iterating
on the elements names) (previously an iteration would work but with
unexpected results)
2017-07-07 15:41:10 +02:00
Celine Mercier a718081ebd Bug with error handling: for now obi_errno needs to be passed to the
function handling errors and exceptions, as it can't read the right
value of the global obi_errno (Cython configuration problem?)
2017-07-07 15:36:11 +02:00
Celine Mercier 740d021276 obi import: fixed bugs when rewriting a column: a bug with new elements
names ignoring previous elements names found, a bug with the global
obi_errno being reset too late, and a bug with the column dictionary
used by obi import not being updated after rewriting a column
2017-07-07 15:33:43 +02:00
Celine Mercier 906343187b Fixed bug with view option in obi less and obi check 2017-07-06 16:42:27 +02:00
Celine Mercier c3cd57a9e3 Removed deprecated file 2017-07-06 10:57:14 +02:00
Celine Mercier f03928c679 Committing minor comments before merging branch with master 2017-07-06 10:56:39 +02:00
Celine Mercier 717ee46f08 Commented a loose print 2017-07-05 18:02:18 +02:00
Celine Mercier 313508cc94 Better *Seq* classes but still need work 2017-07-05 17:53:46 +02:00
Celine Mercier 535fc2af83 Column rewriter and optimized View getter 2017-07-05 17:49:05 +02:00
Celine Mercier 3bbc2ae469 More optimized Column item getter 2017-07-05 17:37:19 +02:00
Celine Mercier 5ee0b3989a Cython API: set_line of Column_multi_elts now accept as values argument
any class where values are referenced by keys with an iterator
2017-07-05 17:32:32 +02:00
Celine Mercier d10192ab0e C functions to detect IUPAC sequences 2017-07-05 17:26:03 +02:00
Celine Mercier 101f764cce New obi import with rewriting of columns when column type or line
elements (keys) change
2017-07-05 17:15:23 +02:00
Celine Mercier cb5ad2ed2d Added functions to try to open a DMS if it exists 2017-07-05 15:38:22 +02:00
Celine Mercier f5e992abbf Added a check on the element when setting a value in a column 2017-07-05 14:49:20 +02:00
Celine Mercier 1d2996c6c0 Better handling and tracing of Index Errors between C and Cython 2017-07-05 14:45:43 +02:00
Celine Mercier f6631f3857 Removed deprecated declarations 2017-07-05 14:42:21 +02:00
Celine Mercier 3f5fef10b9 obi test: minor changes 2017-07-05 14:37:27 +02:00
Celine Mercier 20c72af697 Basic obi check command to check DMS and view informations 2017-07-05 13:54:19 +02:00
Celine Mercier d252131950 Basic obi less command 2017-07-05 13:44:12 +02:00
Celine Mercier ca16ce0bb0 Basic obi grep with new Cython API 2017-07-05 11:58:10 +02:00
Celine Mercier ac94b35336 Removed unused import 2017-07-05 11:52:31 +02:00
Celine Mercier 2d65db4ebc Goes with c2af955b : forgotten files for NUC_SEQS views 2017-04-21 15:15:12 +02:00
Celine Mercier 4b037ae236 Updated obi test to test NUC_SEQS views and the taxonomy API 2017-04-21 12:09:04 +02:00
Celine Mercier c2af955b78 Cython view API: added NUC_SEQS views and sequence classes + changed
cloning API
2017-04-21 12:08:14 +02:00
Celine Mercier 71b1a43df8 Added functions to clone views with a simpler API 2017-04-21 11:58:15 +02:00
Celine Mercier 1725b8b80c Reworked taxonomy Cython API to be a subclass of OBIWrapper 2017-04-21 11:54:05 +02:00
Celine Mercier ab0d08293e Cython API: removed unnecessary imports 2017-04-21 11:51:05 +02:00
Celine Mercier 2f0c4b90d7 Fixed a problem where a view would have a wrong line count after adding
a first column to it if there was already a Line selection associated
(happening when cloning), and fixed a bad error check.
2017-04-14 16:25:55 +02:00
Celine Mercier 537b9847da Minor C doc clarification 2017-04-14 16:23:17 +02:00
Celine Mercier b998373be5 Cython API: updated the test command for the new API and deactivated the
other commands for now
2017-04-14 16:21:33 +02:00
Celine Mercier 6f780148e2 Cython API: added taxonomy API 2017-04-14 16:20:30 +02:00
Celine Mercier 0e08fc486a Cython API: fixed bug when deleting a column from a view where the
Cython wrapper wasn't closed, and fixed the Line selection
materialization
2017-04-14 16:19:18 +02:00
Celine Mercier 2bbee64e57 Cython API: fixed problems with Column class 2017-04-14 16:14:41 +02:00