sav/spss converter

Summary

This adds a new TableConverter for SAV files (generated by SPSS).

Also:

• xfail for Python 3.13 in the pipeline.
• Documentation
• Linting, styling

Focus

Nothing special.

Test Environment

Run the unit tests.

Check List for the Author

Please, prepare your MR for a review. Be sure to write a summary and a focus and create gitlab comments for the reviewer. They should guide the reviewer through the changes, explain your changes and also point out open questions. For further good practices have a look at our review guidelines

• All automated tests pass
• Reference related issues caosdb/customers/interfach/management#6
• Up-to-date CHANGELOG.md (or not necessary)
• Up-to-date JSON schema (or not necessary)
• Appropriate user and developer documentation (or not necessary)
  • How do I use the software? Assume "stupid" users.
  • How do I develop or debug the software? Assume novice developers.
• Annotations in code (Gitlab comments)
  • Intent of new code
  • Problems with old code
  • Why this implementation?

Check List for the Reviewer

• I understand the intent of this MR
• All automated tests pass
• Up-to-date CHANGELOG.md (or not necessary)
• Appropriate user and developer documentation (or not necessary)
• The test environment setup works and the intended behavior is reproducible in the test environment
• In-code documentation and comments are up-to-date.
• Check: Are there specifications? Are they satisfied?

For further good practices have a look at our review guidelines.

src/caoscrawler/conv_impl/spss.py

@@ -56,12 +56,6 @@ class SPSSConverter(converters.TableConverter):
         df = pd.io.spss.read_spss(element.path, dtype_backend="pyarrow")
         dtypes = read_column_types(element.path)
 
-        # if element.path.endswith(".sav"):
-        #     sav_df, meta = pyreadstat.read_sav(element.path, metadataonly=True)
-        # from IPython import embed
-        # embed()
-        df.drop(range(15, len(df.index)), inplace=True)
-
         # Fix datetime columns
         for name, dtype in dtypes.items():
             if dtype != "DATETIME":
@@ -70,9 +64,6 @@ class SPSSConverter(converters.TableConverter):
             col.fillna(np.nan, inplace=True)
             col.replace([np.nan], [None], inplace=True)
 
-        # from IPython import embed
-        # embed()
-
         return self._children_from_dataframe(df)
 
 
@@ -216,21 +207,6 @@ directory: # corresponds to the directory given to the crawler
 # python3 -m caosadvancedtools.models.parser datamodel.yaml --sync
 
 """
-# #
-# # Code for creating enum records:
-# #
-# """
-#     for name, values in enums.items():
-#         for line in f"""
-# cont = db.Container()
-# for value in {repr(values)}:
-#     rec = db.Record(name=value).add_parent(name="{name}")
-#     cont.append(rec)
-# cont.insert()
-#         """.splitlines(keepends=True):
-#             if line.strip():
-#                 output += f"# {line}"
-#     output += "#\n"
 
     # Actual datamodel
     output += """