FIX: Ignore obligatory properties when inserting identifiables

Summary

See #40 (closed).

Focus

Added a flag in the insertion of identifiables in crawler.py. Also repaired the integration test for datamodel problems.

Test Environment

Integration tests should be sufficient.

Check List for the Author

Please, prepare your MR for a review. Be sure to write a summary and a focus and create gitlab comments for the reviewer. They should guide the reviewer through the changes, explain your changes and also point out open questions. For further good practices have a look at our review guidelines

• All automated tests pass
• Reference related Issues
• Up-to-date CHANGELOG.md
• Annotations in code (Gitlab comments)
  • Intent of new code
  • Problems with old code
  • Why this implementation?

Check List for the Reviewer

• I understand the intent of this MR
• All automated tests pass
• Up-to-date CHANGELOG.md
• The test environment setup works and the intended behavior is reproducible in the test environment
• In-code documentation and comments are up-to-date.
• Check: Are there spezifications? Are they satisfied?

For further good practices have a look at our review guidelines.

src/caosadvancedtools/crawler.py

@@ -544,8 +544,8 @@ carefully and if the changes are ok, click on the following link:
         try:
             if len(cfood.to_be_updated) > 0:
                 logger.info(
-                        "Updating {} Records...".format(
-                            len(cfood.to_be_updated)))
+                    "Updating {} Records...".format(
+                        len(cfood.to_be_updated)))
             guard.safe_update(cfood.to_be_updated, unique=False)
         except FileNotFoundError as e:
             logger.info("Cannot access {}. However, it might be needed for"
@@ -610,7 +610,8 @@ carefully and if the changes are ok, click on the following link:
                 logger.info(
                     "Inserting {} Records...".format(
                         len(missing_identifiables)))
-                guard.safe_insert(missing_identifiables, unique=False)
+                guard.safe_insert(missing_identifiables, unique=False,
+                                  flags={"force-missing-obligatory": "ignore"})
             except Exception as e:
                 DataModelProblems.evaluate_exception(e)