Commit Graph

109 Commits

Author SHA1 Message Date
Eike Kettner
d7bc963450 Cleanup nodes that are not reachable anymore 2021-02-18 00:37:18 +01:00
Eike Kettner
c45d72df34 Update nix setup 2021-01-25 10:17:25 +01:00
Eike Kettner
606a6756c8 Fix nix package for tools 2021-01-23 20:30:48 +01:00
Eike Kettner
98aa3423c1 Fix joex config for nix package 2021-01-23 20:30:48 +01:00
Eike Kettner
189f202b21 Move tool scripts into a separate dir 2021-01-23 20:30:48 +01:00
Eike Kettner
a6c31be22f Update documentation 2021-01-20 22:47:15 +01:00
Eike Kettner
f01646aeb5 Reorganize nlp pipeline and add nlp-unsupported language italian
Improves and reorganizes how nlp pipelines are setup. Now users can
choose from many options, depending on their hardware and usage
scenario.

This is the base to use more languages without depending on what
stanford-nlp supports. Support then is involves to text extraction and
simple regex-ner processing.
2021-01-18 17:41:40 +01:00
Eike Kettner
b57ceb6764 Use jdk11 in nix packages 2021-01-12 01:09:15 +01:00
Eike Kettner
646eedadf7 Update nix setup 2021-01-11 23:24:29 +01:00
Eike Kettner
a563ba33e7 Add new joex option to nix module 2021-01-06 23:06:13 +01:00
Eike Kettner
2a172ce720 Remove fulltext recreate-key config value
It's now in the admin routes, protected by the
`admin-endpoint.secret`.
2021-01-04 15:18:02 +01:00
Eike Kettner
21cd778c37 Merge branch 'fix-0.17' into master 2020-12-15 20:45:39 +01:00
Eike Kettner
e8433be862 Update nix package 2020-12-15 20:43:01 +01:00
Eike Kettner
9c106fcda6 Update nix package 2020-12-14 14:56:32 +01:00
Eike Kettner
5681581bf8 Add missing configs to nix modules 2020-12-14 14:51:56 +01:00
Eike Kettner
ab0fe34ee8 Update nix setup 2020-11-28 18:11:41 +01:00
Eike Kettner
f261aeae6e Update nix/nixos setup 2020-11-15 13:10:19 +01:00
Eike Kettner
acbfb9464f Update nix module with new config values 2020-11-15 00:01:48 +01:00
Eike Kettner
79c781db79 Update nix setup 2020-11-01 20:59:04 +01:00
Eike Kettner
0114bb4d72 Use source name from config file for integration endpoint uploads
Fixes: #389
2020-10-26 22:37:30 +01:00
Eike Kettner
d25448d8d9 Update nix setup 2020-10-19 14:55:49 +02:00
Eike Kettner
13daa99933 Update docker and nix setup 2020-09-28 01:10:44 +02:00
Eike Kettner
2773eb5341 Merge branch 'current-docs' 2020-09-25 22:03:41 +02:00
Eike Kettner
a36c499fb1 Update docs on rpi regarding requirements for joex 2020-09-25 21:58:02 +02:00
Eike Kettner
dc88fcb960 Update nix and docker setup 2020-09-09 22:31:35 +02:00
Eike Kettner
9547d6ffac Allo setting jvm arguments in nixos modules 2020-09-08 18:07:04 +02:00
Eike Kettner
8e5e198098 Update nix and docker setups 2020-09-08 00:32:17 +02:00
Eike Kettner
1dcccbcf7d Allow to hide classification settings in the webapp 2020-09-05 16:00:19 +02:00
Eike Kettner
afbe9554b6 Update joex nixos module 2020-09-02 22:23:12 +02:00
Eike Kettner
3473cbb773 Use collective data with NER annotation 2020-08-25 20:40:44 +02:00
Eike Kettner
d68d076c84 Update nix and docker setups 2020-08-15 00:34:33 +02:00
Eike Kettner
09d74b7e80 Return item notes with search results
In order to not make the response very large, a admin can define a
limit on how much to return.
2020-08-05 00:09:37 +02:00
Eike Kettner
7f20c80e51 Update nix setup 2020-08-01 16:54:06 +02:00
Eike Kettner
3d49ceaab5 Use ocrmypdf tool to create pdf/a during conversion
- Use another external tool to convert pdf to pdf which also adds the
  extracted text as another layer into the pdf

- Although not used, the external conversion routine will now check
  for an existing text file that is named as the pdf file with extension
  `.txt`. If present it is included in the conversion result and will be
  used as the extracted text.

- text extraction for pdf files happens now on the converted file,
  because it may already contain the text from the conversion step and
  thus avoids running OCR twice.

- All errors during conversion are not fatal; processing continues
  without a converted file.
2020-07-18 17:19:29 +02:00
Eike Kettner
ec7b34ee6f Update nix/nixos and docker setups 2020-06-29 21:01:07 +02:00
Eike Kettner
7193279053 Prepare nixos setup for full-text-search and new consumedir settings 2020-06-28 13:49:47 +02:00
Eike Kettner
d79ae6233a Restrict proposals for due date
Avoid dates too far in the future.
2020-06-26 16:58:17 +02:00
Eike Kettner
41286959b2 Updating nix modules with new config options 2020-06-25 23:56:44 +02:00
Eike Kettner
30937d4908 Set default max page size to 200 2020-06-24 00:04:10 +02:00
Eike Kettner
5c77c3ed18 Update nix files 2020-06-17 22:18:10 +02:00
Eike Kettner
dee65928a1 Fix default value in nixos module 2020-06-17 21:23:37 +02:00
Eike Kettner
e15e2c9313 Replace hardcoded number by a config value 2020-06-14 00:49:19 +02:00
Eike Kettner
617487f5b3 Add mail-debug flag to rest-server
It has been added to the joex application, but it should be possible
to debug mail problems on both apps.
2020-06-13 15:10:00 +02:00
Eike Kettner
0b7cc0ec6b Update nix and docker setups 2020-05-25 17:57:41 +02:00
Eike Kettner
b4da523347 Update nixos modules with new config options 2020-05-25 15:32:03 +02:00
Eike Kettner
45ff865ed1 Update nix files to new version 2020-04-30 22:23:02 +02:00
Eike Kettner
485d995277 Add list-id option to nixos module 2020-04-30 21:34:31 +02:00
Eike Kettner
0e099681d6 Update nix release to version 0.4.0 2020-03-28 23:48:26 +01:00
Eike Kettner
6a1297fc95 Add a limit for text analysis 2020-03-27 22:54:49 +01:00
Eike Kettner
74fb0d994f Add new options to nix module 2020-03-27 20:16:18 +01:00
Eike Kettner
de3e07a77c Nix modules: change docspell user to be a normal user
Seems that unoconv requires a shell.
2020-03-01 21:34:11 +01:00
Eike Kettner
0d650616e3 Nix: use non-headless jre. now required for image/pdf code 2020-03-01 20:06:50 +01:00
Eike Kettner
1a0f176019 Add an unoconv listener to joex nixos module 2020-03-01 01:24:07 +01:00
Eike Kettner
73596f5f07 Fix nix download urls 2020-03-01 00:56:07 +01:00
Eike Kettner
c23d73fffb Add new version to nix files 2020-02-28 21:18:10 +01:00
Eike Kettner
ec419c7bfd Adopt nix modules to new config 2020-02-22 12:40:56 +01:00
Eike Kettner
61bbdab8b5 nix: add user doc and pkg fixes
- Add user doc for how to use with nix/nixos

- fix potential collisions in packages if both are installed via
  `nix-env`
2020-01-24 21:56:48 +01:00
Eike Kettner
c0f39d6497 Improve nix files
List available versions; refactor modules to reuse default values.
2020-01-22 23:33:42 +01:00
Eike Kettner
23af8acff8 Add support for integrating into nix/nixos 2020-01-20 00:21:15 +01:00