Commit Graph

29 Commits

Author SHA1 Message Date
eb11b33028 Fix mariadb changsets 2020-09-07 20:02:50 +02:00
cb1a9e0699 Use separate sql migration for h2 2020-09-07 13:04:29 +02:00
8c4f2e702b Add classifier settings 2020-09-02 18:28:14 +02:00
de5b33c40d Add updated column to some tables 2020-08-24 21:30:52 +02:00
c697501571 Add folders sql changeset for mariadb 2020-07-14 23:22:52 +02:00
ec7f027b4e Fix postgres changeset for folders 2020-07-12 16:15:02 +02:00
2ab0b5e222 Rename space -> folder 2020-07-11 11:54:23 +02:00
7ec0fc2593 Add endpoints for managing spaces to openapi spec 2020-07-11 01:30:28 +02:00
13ad5e3219 Setup space entities 2020-07-11 01:30:28 +02:00
23477e34f9 Change columns from timestamp to datetime
In MariaDB the timestamp has some properties that make it a not a good
fit.
2020-06-26 17:07:00 +02:00
532caed84c Consistent logging of request/responses to solr
Using a middleware. Also add missing changesets for mariadb.
2020-06-24 21:25:46 +02:00
1f4220eccb Index exsiting data in solr 2020-06-19 00:43:35 +02:00
60c079f664 Add task to index current database state 2020-06-18 22:38:45 +02:00
4028b7979e Fix mariadb timestamp columns
MariaDB automatically inserts the current time, even when saying `SET
datecol = null`.
2020-06-17 21:51:30 +02:00
f16632bc7f Allow a collective to disable the integration endpoint 2020-05-23 14:29:24 +02:00
c9de74fd91 Add imap settings 2020-05-18 08:46:04 +02:00
09ea724c13 Store message-id of eml files 2020-03-25 22:00:51 +01:00
4ed7a137f7 Add support for archive files
Each attachment is now first extracted into potentially multiple ones,
if it is recognized as an archive. This is the first step in
processing. The original archive file is also stored and the resulting
attachments are associated to their original archive.

First support is implemented for zip files.
2020-03-19 22:42:27 +01:00
616c333fa5 Implement storage routines for periodic scheduler 2020-03-08 13:56:23 +01:00
1e598bd902 Sketch a scheduler for running periodic tasks
Periodic tasks are special in that they are usually kept around and
started based on a schedule. A new component checks periodic tasks and
submits them in the queue once they are due.

In order to avoid duplicate periodic jobs, the tracker of a job is
used to store the periodic job id. Each time a periodic task is due,
it is first checked if there is a job running (or queued) for this
task.
2020-03-08 12:55:03 +01:00
ba3865ef5e Starting to support more file types
First, files are be converted to PDF for archiving. It is also easier
to create a preview. This is done via the `ConvertPdf` processing
task (which is not yet implemented).

Text extraction then tries first with the original file. If that
fails, OCR is done on the (potentially) converted pdf file.

To not loose information of the original file, it is saved using the
table `attachment_source`. If the original file is already a pdf, or
the conversion did not succeed, the `attachment` and
`attachment_source` record point to the same file.
2020-02-10 12:42:45 +01:00
6d0c140e8e Add mariadb database migration 2020-01-12 01:17:49 +01:00
2ecfb679d9 Add routes to retrieve sent mails 2020-01-11 12:58:04 +01:00
2d69d39dd1 Connect multiple items to a mail 2020-01-09 18:20:59 +01:00
7a3289c41d Prepare sending mail 2020-01-08 22:44:34 +01:00
32050a9faf Finish mail settings 2020-01-07 00:20:28 +01:00
2e3454c7a1 Starting with mail settings 2020-01-05 15:31:32 +01:00
a9e70401de Update dependencies 2019-12-28 12:38:11 +01:00
831cd8b655 Initial version.
Features:

- Upload PDF files let them analyze

- Manage meta data and items

- See processing in webapp
2019-09-21 22:02:36 +02:00