F json schema datamodel

Summary

For https://gitlab.indiscale.com/caosdb/customers/leibniz-zmt/management/-/issues/17 and https://gitlab.indiscale.com/caosdb/customers/leibniz-zmt/management/-/issues/24. A rudimentary parser of datamodels defined in json-schemas is introduced. It is sufficient to create flat datamodels, but it still lacks a lot.

• inheritance: This will probably require an extension of datamodel itself, so we won't implement it
• suggested properties: ditto
• $defs and $ref in json schema
• Re-use of already defined RTs or Poroperties as List properties
• Reference properties that are different from the referenced RT. (Although this is possible for list of references)
• Values
• The extern keyword from the yaml parser
• Documentation

Focus

Mainly, a new parser has been introduced. Most changes are actually tests for the new parser.

Test Environment

In principle, the new unit tests and the new integration test are sufficient. You can also use Joscha's ZMT model to verify that the parser actually fulfills the minimal requirement of creating a datamodel for exactly this schema.

Check List for the Author

Please, prepare your MR for a review. Be sure to write a summary and a focus and create gitlab comments for the reviewer. They should guide the reviewer through the changes, explain your changes and also point out open questions. For further good practices have a look at our review guidelines

• All automated tests pass
• Reference related Issues
• Up-to-date CHANGELOG.md
• Annotations in code (Gitlab comments)
  • Intent of new code
  • Problems with old code
  • Why this implementation?

Check List for the Reviewer

• I understand the intent of this MR
• All automated tests pass
• Up-to-date CHANGELOG.md
• The test environment setup works and the intended behavior is reproducible in the test environment
• In-code documentation and comments are up-to-date.
• Check: Are there spezifications? Are they satisfied?

For further good practices have a look at our review guidelines.

unittests/test_parser.py

 import unittest
+from datetime import date
 from tempfile import NamedTemporaryFile
 
 import caosdb as db
@@ -421,12 +422,26 @@ Experiment:
     temperature:
       datatype: DOUBLE
       description: 'temp'
+TestExperiment:
+  role: Record
+  inherit_from_obligatory:
+    - Experiment
+  obligatory_properties:
+    date: 2022-03-02
+    identifier: Test
+    temperature: 23
+  recommended_properties:
+    additional_prop:
+      datatype: INTEGER
+      value: 7
 """
     entities = parse_model_from_string(model)
     assert "Experiment" in entities
     assert "date" in entities
     assert "identifier" in entities
     assert "temperature" in entities
+    assert "TestExperiment" in entities
+    assert "additional_prop" in entities
     assert isinstance(entities["Experiment"], db.RecordType)
 
     assert entities["Experiment"].get_property("date") is not None
@@ -438,3 +453,10 @@ Experiment:
 
     assert entities["Experiment"].get_property("temperature") is not None
     assert entities["Experiment"].get_property("temperature").value is None
+
+    test_rec = entities["TestExperiment"]
+    assert isinstance(test_rec, db.Record)
+    assert test_rec.get_property("date").value == date(2022, 3, 2)
+    assert test_rec.get_property("identifier").value == "Test"
+    assert test_rec.get_property("temperature").value == 23
+    assert test_rec.get_property("additional_prop").value == 7