DOC: add to changelog, setup.py and docs

CHANGELOG.md

@@ -7,6 +7,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 ## [Unreleased] ##
 
 ### Added ###
+- caosdbignore; You can add one or more `.caosdbignore` files to the directory 
+  structure that you want to make available in CaosDB and the run loadFiles.
+  The syntax is that of `.gitignore` files. For more information see `loadFiles`
+  section of the Crawler in the documentation.
 
 ### Changed ###
 

setup.py

@@ -162,6 +162,7 @@ def setup_package():
                           "xlrd>=2.0",
                           ],
         extras_require={"h5-crawler": ["h5py>=3.3.0", ],
+                        "gitignore_parser ": ["gitignore_parser >=0.1.0", ],
                         },
         packages=find_packages('src'),
         package_dir={'': 'src'},

src/doc/crawler.rst

@@ -121,6 +121,14 @@ as seen by the CaosDB server (The actual path may vary. This is the used
 in the LinkAhead distribution of CaosDB). In this case the root file
 system as seen from within the CaosDB docker process is used.
 
+
+You can provide a `.caosdbignore` file as a commandline option to the above
+loadFiles command. The syntax of that file is the same as for `.gitignore`
+files. Note, that you can have additional `.caosdbignore` files at lower levels
+which are appended to the current ignore file and have an effect of the
+respective subtree.
+
+
 Extending the Crawlers
 ======================