Changelog

[0.13.0] - 2025-01-16

Added

• Official support for Python 3.13

Changed

• Using the official name "LinkAhead" wherever possible without large effort. This includes the following exposed names / features:
  • models.data_model.LINKAHEAD_INTERNAL_PROPERTIES
  • export_related.export exports to linkahead_data.xml now.
• Renamed (and added) installation "extra" options:
  • h5 instead of h5-crawler
  • dev, doc, test and all are new, they install the dependencies for developing, testing, documentation and everything.
• The pandoc_header_tools.get_header() parameter add_header has been renamed to add_header_to_file to resolve a name collision.

Removed

• Bloxberg code snippets. These were just a proof of concept, untested and never used in production.
• Labfolder converter. It was broken anyway, not used by anyone we know and there were no automated tests. For the time being, it lives on in the f-labfolder-converter branch, issue 67 is there to coordinate resurrections efforts if someone needs it..
• Support for Python 3.8

Fixed

• Yaml data model parser adds data types of properties of record types and other attributes which fixes https://gitlab.indiscale.com/caosdb/customers/f-fit/management/-/issues/58
• XLSXConverter now checks path validity before parsing the worksheet.

Documentation

• Added documentation of caosadvancedtools.loadFiles module.

Changelog

[0.12.0] - 2024-07-31

Added

• Possibility to configure custom CSS to be used in static HTML sites created by the crawler

Changed

• The static HTML pages that are generated by the crawler now require the webinterface to be built with JS_DIST_BUNDLE=TRUE, i.e. all js source files bundled into one webcaosdb.dist.js. This is the default and highly recommended for production systems in any case but it will break the display of these static files in certain corner cases where you may want to use JS_DIST_BUNDLE=FALSE for development or debugging reasons.

Fixed

• Rendering of entities in static HTML sites created by the crawler.
• #63 The TableImporter now gives a detailed output in what row/column which TypeError occurred.

Changelog

[0.11.0] 2024-07-09

Added

• XLSX handling: conversion from XLSX to Json
• linkahead-loadfiles now also is a standalone script in the installation

Changed

• The TableImporter and its subclasses now change all integer datatypes to the nullable pandas.Int64Datatype so that integer columns with empty fields can be treated properly. In case you don't want the datatypes to be changed automatically, initialize the TableImporter with convert_int_to_nullable_int=False.

Fixed

• Blacklisted buggy openpyxl version
• #62 The TableImporter now handles empty fields in integer columns by supporting the corresponding nullable integer types in Pandas.

Documentation

• loadFiles has better -h documentation now
• Rudimentary documentation for table_importer module

Changelog

[0.10.0] - 2024-04-24

Added

• XLSX handling: template generator and conversion from Json to XLSX
• Json schema exporter:
  • has new parameter use_rt_pool
  • propagates more properties in the make_array function
• Support for Python 3.12 and experimental support for 3.13

Changed

• table_converter.to_table now returns an empty DataFrame instead of raising a ValueError when called with an empty container.

Removed

• The deprecated parent keyword from the YAML datamodel specification. Use inherit_from_{obligatory|recommended|suggested} instead.
• Support for Python 3.7

Fixed

• Json schema exporter handles reference properties better.
• #59 to_table failed on lists as values.

Documentation

• Added documentation for json-schema datamodel export

Changelog

[0.9.0] - 2023-11-27

Added

• Added support for passing callables as find_func to the BaseTableExporter.
• Added member BaseTableExporter.all_keys
• Parsing from YAML now allows to give an existing model to which the YAML data model shall be added.
• The json_schema_exporter module which introduces tools to create a json schema from a RecordType, e.g., for the usage in web forms.
• DataModel.get_deep(name: str) method which uses the DataModel as a kind of cache pool.

Changed

• A bit better error handling in the yaml model parser.
• TableImporter.check_datatypes allows numeric values in string columns if strict=False (default).

Fixed

• TableImporter.check_missing in case of array-valued fields in table
• YAML model parser has better description handling.

Documentation

• Test coverage reports are now generated in .tox/cov_html/ by tox.

Changelog

[0.8.0] - 2023-05-30

(Florian Spreckelsen)

Added

• TableImporter now accepts a existing_columns argument which demands that certain columns exist
• The JsonSchemaParser class supports patternProperties
• The JsonSchemaParser calss supports json-schema references ($ref)

Changed

• The converters and datatype arguments of TableImporter now may have keys for nonexisting columns
• The JsonSchemaParser class does not require the top-level entry of a json schema definition to specify a RecordType.

Fixed

• refactored to work with the new default key word in FIND queries: RECORD

Changelog

[0.7.0] - 2023-03-09

(Florian Spreckelsen)

Added

• create_entity_link function to create html links to entities; useful for logging

Changelog

[0.6.1] - 2023-01-20##

Added

• Re-introduced support for Python 3.7

[0.6.0] - 2022-10-11

(Florian Spreckelsen)

Added

• Unauthorized inserts can now be cached. Note that the Crawler cannot postpone inserts but the Cache has the functionality now.
• caosdbignore; You can add one or more .caosdbignore files to the directory structure that you want to make available in CaosDB and the run loadFiles. The syntax is that of .gitignore files. For more information see loadFiles section of the Crawler in the documentation.

Changelog

[0.5.0] - 2022-09-05

(Florian Spreckelsen)

Added

• You can now use python -m caosadvancedtools.models.parser model_file to parse and potentially synchronize data models.

Deprecated

• #36 parent keyword in yaml datamodel definition (replaced by inherit_from_{obligatory|recommended|suggested} keywords).