Commit Graph
100 Commits
Author SHA1 Message Date
Celine Mercier 8ce4f264aa When enlarging a column, the function doesn't try anymore to keep the
mapped region at the same pointer (never works), and unmap/remap
instead.
2015-11-10 13:18:36 +01:00
Celine Mercier d885eb48ff The header size when creating a column is now calculated according to
the size of the header structure and the page size of the platform.
2015-11-10 13:09:30 +01:00
Celine Mercier 661fe3606a In OBI_CHAR columns, characters are now given and retrieved as decoded
(unicode) characters.
2015-11-10 11:24:08 +01:00
Celine Mercier c4b7e579cf Comments in column headers are now working. 2015-11-10 10:56:45 +01:00
Celine Mercier f6ec8ba963 The header size is now directly read in the file when a column or an
array is opened.
2015-11-09 17:50:32 +01:00
Celine Mercier 0e3d6ed2d7 Methods __len__ (number of lines used) and __sizeof__ (total size in
bytes) implemented for columns.
2015-11-09 15:56:20 +01:00
Celine Mercier 01bfc14503 The data size in bytes is now stored in the header of a column. 2015-11-09 15:55:00 +01:00
Celine Mercier 65c1b1e8b2 Minor changes to make the creation of files and directories cleaner 2015-11-09 15:22:01 +01:00
Celine Mercier b37bd8f21c File descriptors for dms, column and array directories are now stored in
structures.
2015-11-09 15:06:02 +01:00
Celine Mercier 05e3956a0c Minor changes in code to improve readability (freeing some character
strings earlier)
2015-11-09 11:22:51 +01:00
Celine Mercier 9b066f4327 Major update: obiarrays with columns containing indices referring to
character strings.
2015-11-06 17:55:15 +01:00
Celine Mercier 456551ffeb obi arrays that don't work because of cython bug passing wrong pointers 2015-11-03 14:22:00 +01:00
Celine Mercier ecb9d97adb Reorganized the code to have less functions, and the functions to get
and format the creation date of a column are now working.
2015-10-15 15:12:45 +02:00
Celine Mercier 0eaa5aa784 Major changes : new cython subclasses to handle columns with multiple
elements per line in a more efficient way + now elements_names are
passed as a list + new function to recover only the header of a column
2015-10-14 18:05:34 +02:00
Celine Mercier 21923e213d The unit tests now test for None values 2015-10-12 18:02:40 +02:00
Celine Mercier 6877fc4892 Fixed a critical bug where values were initialized to NA at the wrong
location when there was multiple elements per line
2015-10-12 17:54:36 +02:00
Celine Mercier dbed3d9d1d New module for unit testing with PyUnit 2015-10-09 15:42:57 +02:00
Celine Mercier fc8bf16769 Fixed a critical bug in the computation of the new number of lines of a
column when truncating
2015-10-09 13:49:48 +02:00
Celine Mercier e114a3c9cb fixed a critical bug where data size was not calculated correctly and
column directory is now closed when column is closed
2015-10-09 10:25:40 +02:00
Celine Mercier ebc9f6f512 fixed a bug where Cython was casting doubles in floats 2015-10-08 15:28:30 +02:00
Celine Mercier 2b3f03ec28 Removed deprecated script 2015-10-08 10:46:46 +02:00
Celine Mercier 8fd9c06be2 Fixed missing file for documentation compilation 2015-10-08 10:45:54 +02:00
Celine Mercier b553eef781 Method to close a DMS is uncommented but not complete yet (columns have
to be closed separately)
2015-10-08 10:44:13 +02:00
Celine Mercier ee4c513fd4 Fixed a bug where cloning a column would fail if the data was empty 2015-10-08 10:36:02 +02:00
Celine Mercier c013e6ad33 fixed typo in doxygen doc 2015-10-08 10:33:19 +02:00
Celine Mercier c98d567e2f Updated the documentation and restructured a bit because it wasn't
compiling (note: Breathe not working)
2015-10-06 11:09:01 +02:00
Celine Mercier 392f110c8d new functions in the OBIDMS_column class to raise NotImplementedError
exceptions and to get the creation date of a column
2015-10-02 13:51:26 +02:00
Celine Mercier 6ced3c4896 new functions to get the creation date of a column 2015-10-02 13:47:53 +02:00
Celine Mercier 4b8bf41a71 closes #13, obi_errno is initialized to 0 2015-10-02 13:46:34 +02:00
Celine Mercier c59a244e9d Fixed little typo 2015-09-30 12:07:13 +02:00
Celine Mercier 4b7f2d268b Doxygen documentation corrected and completed. 2015-09-30 12:03:46 +02:00
Celine Mercier 45af8396b8 minor change in variable name for better coherence 2015-09-28 13:52:41 +02:00
Celine Mercier eeebbc77c3 missing __init__ file in previous commit 2015-09-28 13:52:13 +02:00
Celine Mercier 72155c3b73 entirely reworked cython wrapper 2015-09-28 13:51:35 +02:00
Celine Mercier 9aaf2d264a test 2015-09-25 11:29:17 +02:00
Celine Mercier 0951934f77 test 2015-09-25 11:28:23 +02:00
Celine Mercier 68b6ab3224 working on the cython wrapper. This doesn't compile 2015-09-24 11:32:09 +02:00
Celine Mercier b0570ee486 fixed permissions when creating files 2015-09-22 15:52:07 +02:00
Celine Mercier 72105b2aed fixed the computation of the data size when cloning a column 2015-09-22 10:27:17 +02:00
Celine Mercier 9ab8a42340 fixed the mkdir permission mode that forced the user to use sudo to
write in the created directories
2015-09-21 15:48:02 +02:00
Celine Mercier 7b606c0477 Column files now always have a size that is a multiple of the page size,
and the function that enlarges mapped column files tries mapping on next
byte before unmapping/mapping again
2015-09-21 15:42:29 +02:00
Celine Mercier 7d7dbb1bf9 Handling of single char columns 2015-09-18 15:49:15 +02:00
Celine Mercier 34a3717fb9 The cython function to open a column is now a method of the OBIDMS class 2015-09-17 11:23:50 +02:00
Celine Mercier 2698022aaf New OBIDMS method to list the columns of an OBIDMS 2015-09-15 17:09:31 +02:00
Celine Mercier 90bf15186e Method to get a column's number of lines used 2015-09-14 17:33:40 +02:00
Celine Mercier 5c3bc03bd2 Added the handling of errors with the functions to get a value in a
column
2015-09-14 17:04:29 +02:00
Celine Mercier f2231770f1 If an error occurs when cloning a column, the new cloned file is now
deleted
2015-09-02 13:06:21 +02:00
Celine Mercier 52e3f2ce4a Columns that are cloned are now closed after cloning 2015-09-02 10:36:00 +02:00
Celine Mercier f0dffaff13 Merge branch 'master' of git@git.metabarcoding.org:obitools/obitools3.git 2015-09-02 10:15:18 +02:00
Celine Mercier f31d8983bb Columns are now enlarged if needed when setting a value 2015-09-01 17:38:08 +02:00
Celine Mercier 3b7536c0df The number of lines used is updated in the header when a value is set,
and the iteration on the values of a column is done on the number of
lines used (instead of on the total line count).
2015-08-26 17:25:15 +02:00
Celine Mercier 34ade161de added an obidebug() line 2015-08-26 17:05:37 +02:00
Celine Mercier 48d10ea17c Functions to truncate and/or close a column 2015-08-26 17:01:54 +02:00
Celine Mercier fdc3b96beb Added cython subclasses for columns with _writable or _read for each
data type. Trying to set a value on a _read subclass raises an
exception.
2015-08-26 15:34:12 +02:00
Celine Mercier 95dbeb25a0 Added functions to get and set values in columns using the element name
(for columns with lines made of vectors of elements), for all data types
2015-08-26 15:05:23 +02:00
Celine Mercier 9d91e907e5 When a column is created, its data is initialized to the NA value of the
obitype
2015-08-26 12:00:38 +02:00
Celine Mercier 3f81dc0173 Changed the variable name 'nb_elements' to 'nb_lines' for better clarity 2015-08-26 10:52:19 +02:00
Celine Mercier 8ff3488926 Fix: The number of lines used is set when cloning a column with its data 2015-08-26 10:38:07 +02:00
Celine Mercier 611699252e Files and functions for columns with the data type OBIChar_t, working
but using char* (needs to be changed)
2015-08-26 10:31:56 +02:00
Celine Mercier 9ad31fddff Added the possibility to clone a column, with or without its data 2015-08-26 10:29:07 +02:00
Celine Mercier 2162bf4272 obidebug.h for debugging tools 2015-06-26 17:56:15 +02:00
Celine Mercier c454f9612e changed 'column groups' to be called 'column directories' for now. 2015-06-26 17:53:03 +02:00
Celine Mercier 71cd59f775 close file descriptors that don't refer to a directory (as those can not
be reopened)
2015-06-24 13:53:12 +02:00
Celine Mercier 719ef61461 changed file names 2015-06-23 18:36:20 +02:00
Celine Mercier 152b34b5f4 Closes #10 : column groups stored in directories 2015-06-23 18:35:34 +02:00
Celine Mercier 61b6c3ce83 Added OBI errnos but work in progress 2015-06-23 17:56:21 +02:00
Celine Mercier 0a78a786c1 fixed replacement *at functions and made get_full_path() function public 2015-06-23 17:55:00 +02:00
Celine Mercier e6e68786f7 private *at functions (openat, mkdirat, opendirat, closedirat) 2015-06-18 17:19:23 +02:00
Celine Mercier 58e7066b9f updated and fixed the documentation 2015-06-17 17:17:54 +02:00
Celine Mercier ed662077b3 fixed bugs and typos in the obidms and obidmscolumn source and header
files
2015-06-17 16:51:16 +02:00
Celine Mercier 9f9c20aa4a new OBIDMS_column cython class 2015-06-17 16:49:49 +02:00
Celine Mercier 73ba9fd4c3 updated the OBIDMS class 2015-06-17 16:48:56 +02:00
Celine Mercier 771be89103 updated the documentation (replaced 'release files' with 'version
files')
2015-06-17 16:45:04 +02:00
Celine Mercier f740557d96 fixes #9 : replacement function for openat(). 2015-06-17 14:55:05 +02:00
Celine Mercier aff74c72dd updated the documentation 2015-06-10 15:41:14 +02:00
Celine Mercier 5d967f5b7b fixed typos and other minor things 2015-06-10 15:19:02 +02:00
Celine Mercier 9b6de9c411 Attempt at defining some naming conventions. 2015-05-28 17:54:11 +02:00
Celine Mercier 27e246e709 updated the documentation 2015-05-28 17:03:50 +02:00
Celine Mercier ff64d1b2e9 deleting a useless file 2015-05-28 16:35:43 +02:00
Celine Mercier 235a81a534 deleting test data file 2015-05-28 16:35:03 +02:00
Celine Mercier 4759e1cf54 deleting the Breathe sources 2015-05-28 16:34:24 +02:00
Celine Mercier f4a123cd17 updated the documentation with the special values, and the idea of
column directories and column group directories.
2015-05-28 16:33:45 +02:00
Celine Mercier 0b031da28c A very basic obicount 2015-05-22 17:54:34 +02:00
Celine Mercier 2073f9f307 OBIDMSColumn file for testing 2015-05-22 17:53:42 +02:00
Celine Mercier f60a98a21d Updated the documentation 2015-05-22 17:52:55 +02:00
Celine Mercier 2395688bd3 adding Doxygen doc generation to the Sphinx Makefile 2015-05-21 11:05:43 +02:00
Celine Mercier 1d39dcc559 updated documentation 2015-05-18 17:57:10 +02:00
Celine Mercier 196140af35 included the doc from both header files in the documentation 2015-05-13 11:16:50 +02:00
Celine Mercier 5990da3215 first header files for OBIColumns. 2015-05-13 11:06:52 +02:00
Celine Mercier 6e1b92db8f Updated the doc with the idea of OBIDMS release files. 2015-05-12 16:41:12 +02:00
Celine Mercier 3662613551 Closes #4. Updated the doc with new naming conventions for OBIDMS column
files.
2015-05-12 15:17:28 +02:00
Celine Mercier d922cceb59 Merge branch 'master' of git@git.metabarcoding.org:obitools/obitools3.git 2015-05-12 14:29:39 +02:00
Celine Mercier db8b54aad6 fixed "ULM" mistake : replaced with "UML" 2015-05-12 14:25:52 +02:00
Celine Mercier aece3281a0 adding Doxyfile 2015-05-12 11:27:08 +02:00
Celine Mercier 6dd6567231 documentation for the OBIDMS ULM 2015-05-11 17:45:47 +02:00
Celine Mercier c99677a6b6 adding the doxygen directories 2015-05-11 17:27:03 +02:00
Celine Mercier e1aa835463 fixed conf.py to put relative paths 2015-05-11 17:23:43 +02:00
Celine Mercier 476f30659d new version of the documentation with a part generated using doxygen and
breathe
2015-05-11 17:20:59 +02:00
Celine Mercier 428431932f configuring the sphinx conf.py file for breathe 2015-05-11 17:19:41 +02:00
Celine Mercier 66296e1c06 adding the breathe files 2015-05-11 17:18:23 +02:00