FIX: `to_table` failed on lists

Summary

Fix for #117 (closed)

Focus

• Performance
• Sufficient test

Test Environment

Run the unit test:

pytest --pdb --pdbcls=IPython.terminal.debugger:TerminalPdb unittests/test_table_converter.py::TableTest::test_list

Check List for the Author

Please, prepare your MR for a review. Be sure to write a summary and a focus and create gitlab comments for the reviewer. They should guide the reviewer through the changes, explain your changes and also point out open questions. For further good practices have a look at our review guidelines

• All automated tests pass
• Reference related issues
• Up-to-date CHANGELOG.md (or not necessary)
• Up-to-date JSON schema (or not necessary)
• Appropriate user and developer documentation (or not necessary)
  • How do I use the software? Assume "stupid" users.
  • How do I develop or debug the software? Assume novice developers.
• Annotations in code (Gitlab comments)
  • Intent of new code
  • Problems with old code
  • Why this implementation?

Check List for the Reviewer

• I understand the intent of this MR
• All automated tests pass
• Up-to-date CHANGELOG.md (or not necessary)
• Appropriate user and developer documentation (or not necessary)
• The test environment setup works and the intended behavior is reproducible in the test environment
• In-code documentation and comments are up-to-date.
• Check: Are there specifications? Are they satisfied?

For further good practices have a look at our review guidelines.

unittests/test_table_converter.py

@@ -27,6 +27,7 @@ from tempfile import NamedTemporaryFile
 import caosdb as db
 import pandas as pd
 from caosdb.apiutils import compare_entities
+from numpy import nan
 
 from caosadvancedtools.table_converter import (from_table, from_tsv, to_table,
                                                to_tsv)
@@ -68,7 +69,7 @@ class TableTest(unittest.TestCase):
     def test_list(self):
         r1 = db.Record()
         r1.add_parent("no1")
-        r1.add_property("p1")
+        r1.add_property("p1", value=1)
         r1.add_property("p3", value=23)
         r1.add_property("p4", value=[1])
         r2 = db.Record()
@@ -82,7 +83,18 @@ class TableTest(unittest.TestCase):
         r3.add_property("p5", value=[50, 51])
         c = db.Container()
         c.extend([r1, r2, r3])
-        to_table(c)
+        result = to_table(c)
+        # NaN is hard to compare, so we replace it by -999
+        # autopep8: off
+        assert result.replace(to_replace=nan, value=-999).to_dict() == {
+            'p1': {0: 1,    1: -999,         2: -999    },  # noqa: E202
+            'p3': {0: 23,   1: [30, 31],     2: -999    },  # noqa: E202
+            'p4': {0: [1],  1: [40.0, 41.0], 2: -999    },  # noqa: E202
+            'p2': {0: -999, 1: [20, 21],     2: -999    },  # noqa: E202
+            'p5': {0: -999, 1: -999,         2: [50, 51]}
+        }
+        # autopep8: on
+        assert list(result.dtypes) == [float, object, object, object, object]
 
 
 class FromTsvTest(unittest.TestCase):