Commit Graph

120 Commits

Author SHA1 Message Date
1d2a6e6caa Add endpoint to search for items and return their tags
This is a more expensive query, since the tags must be resolved per
item. This is now implemented by doing additional queries while
caching each resolved tag.
2020-06-07 15:18:28 +02:00
6abdb95f02 Reformatting 2020-06-06 20:52:23 +02:00
071ab60a5c Remove i_date query binding 2020-06-06 15:15:29 +02:00
d5819eab35 Fix offset/limit clause for mariadb
MariaDB wants first limit and then offset (optionally), postgres
doesn't care.
2020-06-06 11:13:33 +02:00
e5b90eff34 Allow client to load items in batches 2020-06-06 11:05:15 +02:00
4b0eb650f2 Rename package to avoid name clashes 2020-05-25 16:22:09 +02:00
56624515a5 ScalafmtAll 2020-05-25 13:56:06 +02:00
ee394eae86 Try streamline the different impls for MimeType 2020-05-25 09:24:24 +02:00
3cb738568f Allow to change position of attachments 2020-05-24 17:30:25 +02:00
4694433e38 Fix attachment positions
It worked for new items, because the implicit offset was 0. when
adding archives to existing items, there are already attachments and
the new attachments are added to the end. This won't work if files are
added concurrently, because there is no quick and reliable way to
determine the offset then.
2020-05-24 15:13:30 +02:00
1dde43e092 Only process attachments in task arguments
When files are added to an item, the attachments already present must
not be "re-processed".
2020-05-24 13:29:38 +02:00
f4949446e3 Allow to specify an item id to amend files to existing items 2020-05-23 20:15:55 +02:00
25d089da6c Update state and proposals only on invalid items
Invalid items are those that are not ready, and not shown to the user.
When changing metadata, it should only be changed, if the item was not
already shown to the user.
2020-05-23 15:46:24 +02:00
f16632bc7f Allow a collective to disable the integration endpoint 2020-05-23 14:29:24 +02:00
9f9dd6c0fb Change routes for scan-mailbox task to allow multiple tasks per user 2020-05-21 22:04:45 +02:00
f2d67dc816 Initial impl of import from mailbox user task 2020-05-20 17:52:38 +02:00
c9de74fd91 Add imap settings 2020-05-18 08:46:04 +02:00
0a5501dcb0 Fix findFileByChecksum 2020-05-10 21:03:12 +02:00
bd5066740d Joex depends on backend module
The job executor depends on backend module, since it may control the
application via user tasks. The `ONode` can now be moved from the
store module into the backend module.
2020-05-10 21:03:12 +02:00
c41cdeefec Update scalafmt to 2.5.1 + scalafmtAll 2020-05-04 23:53:57 +02:00
96c5e99f19 Fix scaladoc tag
There is no scaladoc tag @implNote.
2020-04-30 22:04:29 +02:00
a939839041 Delete single attachments 2020-04-26 23:11:49 +02:00
ffc1cdee51 Sort due items by their earliest due date 2020-04-22 22:21:28 +02:00
bbfd694b45 Allow to start a user task once 2020-04-22 21:08:45 +02:00
2723d6b43b Implement notify-due-items task 2020-04-22 21:08:45 +02:00
3a90d874a5 Improve form 2020-04-22 21:08:45 +02:00
ad772c0c25 Server-side stub impl for notify-due-items 2020-04-22 21:08:45 +02:00
9656ba62f4 scalafmtAll 2020-03-26 18:26:00 +01:00
09ea724c13 Store message-id of eml files 2020-03-25 22:00:51 +01:00
43efb4e6ba Use doobie support from emil project 2020-03-24 23:40:29 +01:00
7e6eec9533 Include archive infos in item detail 2020-03-22 21:35:50 +01:00
3703dce9a6 Update fs2 to 2.3.0 2020-03-20 22:47:09 +01:00
74a6cf1dd1 Remove unused migration directory 2020-03-19 22:43:41 +01:00
b1a1a2b837 Add archives to collective insights 2020-03-19 22:43:18 +01:00
439aaee27b Search archives when looking for files via checksum 2020-03-19 22:42:48 +01:00
4ed7a137f7 Add support for archive files
Each attachment is now first extracted into potentially multiple ones,
if it is recognized as an archive. This is the first step in
processing. The original archive file is also stored and the resulting
attachments are associated to their original archive.

First support is implemented for zip files.
2020-03-19 22:42:27 +01:00
00ca6b5697 Improve text analysis
- Search for consecutive labels

- Sort list of candidates by a weight

- Search for organizations using person labels
2020-03-17 22:34:50 +01:00
718e44a21c Add cleanup jobs task 2020-03-09 20:24:00 +01:00
854a596da3 Integrate periodic tasks
The first use case for periodic task is the cleanup of expired
invitation keys. This is part of a house-keeping periodic task.
2020-03-08 22:49:49 +01:00
616c333fa5 Implement storage routines for periodic scheduler 2020-03-08 13:56:23 +01:00
1e598bd902 Sketch a scheduler for running periodic tasks
Periodic tasks are special in that they are usually kept around and
started based on a schedule. A new component checks periodic tasks and
submits them in the queue once they are due.

In order to avoid duplicate periodic jobs, the tracker of a job is
used to store the periodic job id. Each time a periodic task is due,
it is first checked if there is a job running (or queued) for this
task.
2020-03-08 12:55:03 +01:00
42c59179b8 Fix search by checksum to include source files 2020-03-02 20:56:32 +01:00
2f87065b2e sbt scalafmtAll 2020-02-25 20:55:00 +01:00
cc16b0c024 Fix query to also work with mariadb 2020-02-24 13:34:54 +01:00
661cc3e65f Fix deleting attachments (again) 2020-02-23 20:18:13 +01:00
d937e0501a Add source files to collective insights 2020-02-23 20:17:53 +01:00
957073fe62 Return info about original files in item detail
This adds data to the current rest api.
2020-02-23 14:25:32 +01:00
74a037887d Fix deleting items and attachments to also remove the binary files 2020-02-22 00:54:55 +01:00
72fd3b1a25 Implement downloading original file 2020-02-20 22:33:57 +01:00
97305d27ff Integrate support for more files into processing and upload
The restriction that only pdf files can be uploaded is removed. All
files can now be uploaded. The processing may not process all. It is
still possible to restrict file uploads by types via a configuration.
2020-02-19 23:27:00 +01:00