Skip to content
Snippets Groups Projects
Commit 0c58166b authored by Florian Spreckelsen's avatar Florian Spreckelsen
Browse files

DOC: Extend blacklist explanation

parent 60d79e17
No related branches found
No related tags found
2 merge requests!178FIX: #96 Better error output for crawl.py script.,!163F dict heuristic
Pipeline #54401 failed
...@@ -334,8 +334,13 @@ property: ...@@ -334,8 +334,13 @@ property:
.. image:: img/properties-from-dict-records-person.png .. image:: img/properties-from-dict-records-person.png
:height: 200 :height: 200
For the time being, only the parents of the referenced record can be
set via this option. More complicated treatments can be implemented
via the ``referenced_record_callback`` (see below).
Properties can be blacklisted with the ``properties_blacklist`` Properties can be blacklisted with the ``properties_blacklist``
keyword. Since the keyword, i.e., all keys listed under ``properties_blacklist`` will be
excluded from automated treatment. Since the
:py:class:`~caoscrawler.converters.PropertiesFromDictConverter` has :py:class:`~caoscrawler.converters.PropertiesFromDictConverter` has
all the functionality of the all the functionality of the
:py:class:`~caoscrawler.converters.DictElementConverter`, individual :py:class:`~caoscrawler.converters.DictElementConverter`, individual
...@@ -343,7 +348,10 @@ properties can still be used in a subtree. Together with ...@@ -343,7 +348,10 @@ properties can still be used in a subtree. Together with
``properties_blacklist`` this can be used to add custom treatment to ``properties_blacklist`` this can be used to add custom treatment to
specific properties by blacklisting them in ``record_from_dict`` and specific properties by blacklisting them in ``record_from_dict`` and
then treating them in the subtree the same as you would do it in the then treating them in the subtree the same as you would do it in the
standard :py:class:`~caoscrawler.converters.DictElementConverter`. standard
:py:class:`~caoscrawler.converters.DictElementConverter`. Note that
the blacklisted keys are excluded on **all** levels of the dictionary,
i.e., also when they occur in a referenced entity.
For further customization, the For further customization, the
:py:class:`~caoscrawler.converters.PropertiesFromDictConverter` can be :py:class:`~caoscrawler.converters.PropertiesFromDictConverter` can be
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment