eikek
497d85f5d8
Add include/exclude file filter for consumedir
...
Allows to control files to upload by either including or excluding
files via a shell glob pattern.
2021-06-17 21:48:57 +02:00
Eike Kettner
1d7a2bc9d5
Don't use jq to clean whitespace/quotes
...
It seems that older jq versions choke on some output from curl inside
these scripts. But I couldn't reproduce this on the cmdline; so not
really sure what's going on, suspecting some settings in the bash
script. Tested this with jq-1.5 and jq-1.6, both worked. But since
`xargs` also trims a string from quotes and whitespace, it can be used
instead of jq in these places.
2021-06-01 23:23:08 +02:00
eikek
bdc7822f50
Add documentation about docker setup
2021-05-31 22:19:49 +02:00
eikek
d7363b9c8e
Add a poll option to the consumedir script
...
This was available for docker only via a special entrypoint and is now
integrated into the script.
2021-05-31 14:32:37 +02:00
Jan Bader
2855cf9828
Make consumedir-cleaner able to run on Windows
...
Since `bc` isn't available for Windows I changed it to use `expr`.
2021-05-17 11:32:10 +02:00
Eike Kettner
cc38b850a6
Remove deprecated search routes and some refactoring
2021-03-27 22:13:13 +01:00
Eike Kettner
2c844b8182
Add a script to download files
...
This script take a search query and downloads all the files. It is a
more efficient approach to "download as zip". The files are put flat
into the current directory.
2021-03-14 16:39:51 +01:00
Eike Kettner
70b5625c48
Add skip-duplicates to the request in ds.sh
2021-03-10 22:14:19 +01:00
Eike Kettner
198b2f8f96
Move consumedir entrypoint to docker and fix compose setup
...
To make it work as before, some env variables are necessary to be
available to the consumedir container. It's only needed there, but
since the env file exists, they are now listed there.
Also partially reverts the consumedir.dockerfile. Using the base-image
makes sure that all build images are created from the same sources.
2021-01-28 22:31:58 +01:00
Jan Bader
650685976c
Use linux line-endings
2021-01-27 21:36:49 +01:00
Jan Bader
517979f81e
Add usage
2021-01-27 21:30:38 +01:00
Jan Bader
bebe0dabde
Add consumedir-entrypoint.sh to allow polling consumedir
2021-01-27 21:13:16 +01:00
Eike Kettner
189f202b21
Move tool scripts into a separate dir
2021-01-23 20:30:48 +01:00
Eike Kettner
8cfafe5f3b
Fix export-files by checking for header case insensitive
2021-01-04 20:59:31 +01:00
Eike Kettner
951623375c
Add a script to reset a password and update docs
2021-01-04 20:59:31 +01:00
Eike Kettner
8c8dd2fb40
Improve export-file.sh script and add docs
2020-11-30 00:59:37 +01:00
Eike Kettner
0dafe57034
Add an export-files script
2020-11-29 01:30:15 +01:00
Eike Kettner
7b34586730
Log a warning if the setup check fails
...
A collective can disable the endpoint at any time. So informing about
a misconfigured or disabled endpoint on start for each known
collective.
Issue: #470
2020-11-25 21:35:21 +01:00
Eike Kettner
88c16d1bbe
Add skipDuplicates option to upload in consumedir
...
The `-m` setting checks before upload if a file exists. It is now also
checked when the file is being processed.
2020-11-23 23:52:12 +01:00
Eike Kettner
631e6abbfd
Skip hidden files in consumedir
2020-11-23 23:00:05 +01:00
Eike Kettner
67d2e93c4d
Check setup when using integration endpoint
...
Public upload urls cannot be checked like that currently.
2020-11-23 22:48:22 +01:00
Eike Kettner
abecfeafec
Add curl response to stdout if it fails
...
Apparently, it must be called with `-v` otherwise it is silent.
2020-11-23 22:17:14 +01:00
Eike Kettner
757273d6ce
Add a simple script for re-generating preview images
...
Submits jobs to regenerate previews of all attachments of a
collective.
2020-11-09 09:57:27 +01:00
Malte
5f32ca4cdc
fixes hard-wired created date
...
(https://github.com/eikek/docspell/pull/403#discussion_r513790807 )
2020-10-29 06:19:20 +01:00
Malte
08912696fb
Merge branch 'pr-consumedir_clean' of github.com:totti4ever/docspell into pr-consumedir_clean
2020-10-28 22:17:57 +01:00
Malte
03486280e0
first beta of consume dir cleaner
2020-10-28 22:16:03 +01:00
Malte
6313e6e340
first beta of consume dir cleaner
2020-10-28 20:20:57 +01:00
totti4ever
f08fcce4c7
Fixed typo at error detail spooling
2020-10-22 23:05:44 +02:00
totti4ever
9fa93a3ba1
Create README.md
2020-10-22 20:36:00 +02:00
Malte
8aaffb0455
added SKIP_EXISTING_DOCS variable and improved error handling
...
* errors, specially during long initial runs are caught better now and should continue, if possible
* set `SKIP_EXISTING_DOCS` to `true` (default) to skip existing documents (if set to false, they won't be uploaded again, but tags, correspondent, date and title will be overwritten)
* for testing purposes you can set the variables `LIMIT` and `LIMIT_DOC` to limit the tags and correspondents respetively the documents and document-tag-relations
2020-10-22 19:58:32 +02:00
Malte
b1dea4ea3b
version bump
2020-10-21 13:09:27 +02:00
Malte
5d12840568
added transfer of title and creation date ( #358 )
2020-10-21 13:04:58 +02:00
Malte
820c363f96
fixed problems with session timeout
...
- moved auth header to curl_call to fix the infinite loop when re-login was neccessary
- also restructured tiny bits
2020-10-20 23:03:54 +02:00
Malte
ecc7ff1ff4
change /bin/bash to env variant
...
see https://github.com/eikek/docspell/pull/359#pullrequestreview-513105961
2020-10-20 22:35:56 +02:00
Malte
684470da75
removed LIMIT, which is meant for testing purposes. Uncomment it to use
2020-10-20 22:20:00 +02:00
Malte
d58a91e6df
first beta of paperless importer ( #358 )
...
allows to import files, tags and correspondents (as organization)
2020-10-20 22:06:08 +02:00
Eike Kettner
89bbb5247e
Fix consumedir to handle files/directories with spaces
2020-09-20 21:34:38 +02:00
eikek
75e918cca5
Update README.md
2020-08-25 17:23:31 +02:00
Eike Kettner
f1288d384e
Update documentation
2020-08-13 22:13:35 +02:00
Eike Kettner
df73bc6285
Fixes for consumedir.sh
...
- The `-e` option on realpath is not available in busybox
- Avoid creating sha checksum twice
2020-06-28 13:37:39 +02:00
Eike Kettner
8500d4d804
Extend consumedir.sh to work with integration endpoint
...
Now running one consumedir script can upload files to multiple
collectives separately.
2020-06-28 00:08:37 +02:00
Eike Kettner
d13e0a4370
Add a recursive option to consumedir
2020-06-27 01:14:34 +02:00
Eike Kettner
09579eef16
Add docs for how to create a smtp gateway
2020-06-14 21:35:20 +02:00
Eike Kettner
5679ac4858
Remove references to pdf in the doc
...
It's not only for pdf files anymore.
2020-05-27 00:44:04 +02:00
Eike Kettner
7bbc41467c
Fix typos
2020-05-25 09:24:24 +02:00
Eike Kettner
e331808ecf
Update microsite
2020-03-28 21:44:14 +01:00
Eike Kettner
1bb464b9ed
Extend tools/ds.sh to check for file existence
2020-02-27 20:03:46 +01:00
Eike Kettner
7e1678da98
Remove pdf filter in ds.sh script
2020-02-20 21:52:33 +01:00
Eike Kettner
eb6c483ef0
Add route to check for files by their checksum
...
Adopt scripts in `tools/` to check for existing files using these
routes.
2019-12-31 23:45:02 +01:00
Eike Kettner
3eb9916f1a
Add a firefox add-on
2019-09-21 22:02:37 +02:00
