Commit Graph

177 Commits

Author SHA1 Message Date
Scala Steward
c5e940b032
Update pureconfig to 0.13.0 2020-06-27 22:16:05 +02:00
Scala Steward
f1899c3bd9
Update flyway-core to 6.5.0 2020-06-26 18:23:49 +02:00
mergify[bot]
50b3554c9a
Merge pull request #160 from eikek/fts
Fts
2020-06-25 21:19:42 +00:00
Scala Steward
1ebd4fee20
Update http4s-blaze-client, ... to 0.21.5 2020-06-25 06:20:09 +02:00
Scala Steward
2c5fbc2306
Update mariadb-java-client to 2.6.1 2020-06-23 14:26:05 +02:00
Eike Kettner
15c0fb4395 Merge branch 'master' into fts 2020-06-23 00:32:27 +02:00
Eike Kettner
9db3c70e3f ScalafmtAll to sbt files 2020-06-23 00:28:42 +02:00
Scala Steward
48afb99573
Update swagger-ui to 3.27.0 2020-06-19 20:46:03 +02:00
Eike Kettner
1f4220eccb Index exsiting data in solr 2020-06-19 00:43:35 +02:00
Eike Kettner
152ad7373c Update dependencies
- fs2, flexmark, flyway, pdfbox, postgres, swagger
2020-06-12 22:22:37 +02:00
Eike Kettner
74e57b58ff Update commons-io to 2.7 2020-06-01 21:08:49 +02:00
Scala Steward
3b0bba9d2b
Update flexmark, ... to 0.61.34 2020-05-28 08:18:46 +02:00
Scala Steward
ff0828e8f7
Update flyway-core to 6.4.3 2020-05-27 18:21:10 +02:00
Eike Kettner
8bbde5a181 Update emil to 0.6.1 2020-05-25 16:54:17 +02:00
Scala Steward
2c4b1d947e
Update swagger-ui to 3.25.4 2020-05-25 04:13:10 +02:00
Scala Steward
7305881288
Update flexmark, ... to 0.61.32 2020-05-20 02:16:58 +02:00
Scala Steward
541b457d2e
Update flexmark, ... to 0.61.30 2020-05-18 02:13:30 +02:00
Scala Steward
5d6658770e Update emil-common, emil-doobie, ... to 0.6.0 2020-05-17 11:55:53 +02:00
Scala Steward
d278f59577
Update swagger-ui to 3.25.3 2020-05-15 02:12:08 +02:00
Scala Steward
e097995166
Update flexmark, ... to 0.61.28 2020-05-14 20:58:05 +02:00
Scala Steward
354524b0f3
Update flyway-core to 6.4.2 2020-05-12 16:28:30 +02:00
mergify[bot]
1f18955e73
Merge pull request #109 from scala-steward/update/flexmark-0.61.26
Update flexmark, ... to 0.61.26
2020-05-11 23:14:47 +00:00
Scala Steward
2c2d5999c2
Update yamusca-core to 0.6.2 2020-05-10 13:36:44 +02:00
Scala Steward
3ebfa80a5a
Update swagger-ui to 3.25.2 2020-05-07 20:20:09 +02:00
Scala Steward
ac2db0f631
Update jquery to 3.5.1 2020-05-06 16:15:08 +02:00
Eike Kettner
8a476aaef7 Remove sqlite dependency 2020-05-05 20:39:11 +02:00
Scala Steward
a60a1ce523
Update flexmark, ... to 0.61.26 2020-05-05 02:17:28 +02:00
Scala Steward
05a0c23110
Update flexmark, ... to 0.61.24 2020-05-04 11:30:29 +02:00
Scala Steward
019a4a02d9
Update flyway-core to 6.4.1 2020-04-30 14:22:57 +02:00
Scala Steward
c50edd0498
Update emil-common, emil-doobie, ... to 0.5.1 2020-04-30 00:21:47 +02:00
Eike Kettner
75a66ecb86 Update http4s to 0.21.4 2020-04-29 01:05:13 +02:00
Scala Steward
3d76433f91
Update swagger-ui to 3.25.1 2020-04-27 22:14:13 +02:00
eikek
916a9dbcc9
Merge pull request #99 from scala-steward/update/flexmark-0.61.20
Update flexmark, ... to 0.61.20
2020-04-26 15:42:22 +02:00
Scala Steward
d402f77880
Update calev-circe, calev-core, calev-fs2 to 0.3.1 2020-04-26 12:13:19 +02:00
Scala Steward
be0ce706db
Update flexmark, ... to 0.61.20 2020-04-25 00:31:26 +02:00
Scala Steward
5a567c7f4c
Update flexmark, ... to 0.61.18 2020-04-24 06:14:21 +02:00
Scala Steward
3106e71075
Update icu4j to 67.1 2020-04-23 04:12:43 +02:00
Eike Kettner
ad772c0c25 Server-side stub impl for notify-due-items 2020-04-22 21:08:45 +02:00
Eike Kettner
e97e0db45c Prepare notification form 2020-04-22 21:08:45 +02:00
Eike Kettner
fb348b3a7c Don't update stanford-nlp just yet
With current version (3.9.2) analysis against a test corpus showed
much better results as with version 4.0 dropped in. It needs more
investigation than just bumping versions.
2020-04-22 21:06:42 +02:00
eikek
c2ff9b82be
Merge pull request #96 from scala-steward/update/tika-core-1.24.1
Update tika-core to 1.24.1
2020-04-21 23:01:27 +02:00
Scala Steward
38dfcd6cd0
Update tika-core to 1.24.1 2020-04-21 22:52:50 +02:00
Scala Steward
46fcc07ce8
Update flexmark, ... to 0.61.16 2020-04-21 22:52:45 +02:00
eikek
7f67693003
Merge pull request #95 from scala-steward/update/flyway-core-6.4.0
Update flyway-core to 6.4.0
2020-04-21 21:43:40 +02:00
Scala Steward
75d423dce5
Update flyway-core to 6.4.0 2020-04-21 20:44:27 +02:00
Scala Steward
61edac7460
Update stanford-corenlp to 4.0.0 2020-04-21 16:29:37 +02:00
Scala Steward
0323045715
Update flexmark, ... to 0.61.12 2020-04-18 08:10:50 +02:00
Scala Steward
d3a7eff939
Update flexmark, ... to 0.61.10 2020-04-17 00:11:20 +02:00
Scala Steward
9c3a0d7320
Update jquery to 3.5.0 2020-04-15 00:16:04 +02:00
Scala Steward
b0692e6826
Update flexmark, ... to 0.61.8 2020-04-14 04:09:29 +02:00
Scala Steward
c9e6496236
Update flexmark, ... to 0.61.6 2020-04-12 08:10:20 +02:00
Scala Steward
eb0733f47a
Update flexmark, ... to 0.61.4 2020-04-11 06:13:03 +02:00
Scala Steward
5de6874cb0
Update flexmark, ... to 0.61.2 2020-04-08 22:10:11 +02:00
Eike Kettner
3ffc3fb317 Fix a classpath issue
Remove javax.activation from stanford-nlp artifact. There are new
coordinates now as the java-mail library and the activation library
have been moved to eclipse jakarta.
2020-04-07 22:38:25 +02:00
Eike Kettner
1206105f0b Fix several bugs with handling e-mail files
- When converting from html->pdf, the wkhtmltopdf program exits with
  errors if the document contains invalid links. The content is now
  cleaned before handed to wkhtmltopdf.
- Update emil library which fixes a bug when reading mails without
  explicit transfer encoding (8bit)
- Add a info header to converted mails
2020-04-07 22:38:25 +02:00
eikek
12672938a0
Merge pull request #78 from scala-steward/update/calev-core-0.3.0
Update calev-core, calev-fs2 to 0.3.0
2020-04-07 09:17:39 +02:00
Scala Steward
d77ab41da1
Update minitest, minitest-laws to 2.8.2 2020-04-07 00:55:52 +02:00
Scala Steward
8fc09cb92e
Update calev-core, calev-fs2 to 0.3.0 2020-04-07 00:55:37 +02:00
Scala Steward
b86fb4042c
Update flyway-core to 6.3.3 2020-04-06 20:11:55 +02:00
Scala Steward
530a7d89f3
Update doobie-core, doobie-hikari to 0.9.0 2020-04-06 00:15:28 +02:00
Scala Steward
28601e6143
Update minitest, minitest-laws to 2.8.1 2020-04-05 16:11:22 +02:00
Scala Steward
45ba0a40ef
Update flexmark, ... to 0.61.0 2020-04-04 20:09:33 +02:00
Scala Steward
11cc9edbd7
Update http4s-blaze-client, ... to 0.21.3 2020-04-02 08:14:42 +02:00
Scala Steward
cea5f05c70
Update calev-core, calev-fs2 to 0.2.0 2020-04-02 02:10:32 +02:00
Scala Steward
9f4f71d4a6
Update postgresql to 42.2.12 2020-04-01 02:37:29 +02:00
Scala Steward
6d2baba052
Update bitpeace-core to 0.4.5 2020-03-28 16:14:53 +01:00
Scala Steward
fe2b27bd49
Update http4s-blaze-client, ... to 0.21.2 2020-03-25 04:13:16 +01:00
Eike Kettner
0b80572664 Fix encodings for mails with non-utf8 html parts 2020-03-24 23:40:29 +01:00
Scala Steward
519a39c991
Update flyway-core to 6.3.2 2020-03-24 14:17:49 +01:00
Eike Kettner
cf7ccd572c Improve handling encodings
Html and text files are not fixed to be UTF-8. The encoding is now
detected, which may not work for all files. Default/fallback will be
utf-8.

There is still a problem with mails that contain html parts not in
utf8 encoding. The mail text is always returned as a string and the
original encoding is lost. Then the html is stored using utf-8 bytes,
but wkhtmltopdf reads it using latin1. It seems that the `--encoding`
setting doesn't override encoding provided by the document.
2020-03-23 22:51:28 +01:00
Eike Kettner
3703dce9a6 Update fs2 to 2.3.0 2020-03-20 22:47:09 +01:00
Scala Steward
6477745b77
Update mariadb-java-client to 2.6.0 2020-03-20 09:08:34 +01:00
Scala Steward
736a28bc4f
Update tika-core to 1.24 2020-03-17 16:43:17 +01:00
Scala Steward
b6bed9a629
Update emil-common, emil-javamail to 0.3.0 2020-03-15 22:20:18 +01:00
Scala Steward
0076b3782d
Update flyway-core to 6.3.1 2020-03-13 18:25:20 +01:00
Scala Steward
80a6b920d9
Update postgresql to 42.2.11 2020-03-11 00:19:53 +01:00
Scala Steward
e39a983c96
Update bitpeace-core to 0.4.4 2020-03-10 02:25:12 +01:00
eikek
a07a6ff376
Merge pull request #45 from eikek/feature/background-tasks
Feature/background tasks
2020-03-09 20:59:46 +01:00
Eike Kettner
854a596da3 Integrate periodic tasks
The first use case for periodic task is the cleanup of expired
invitation keys. This is part of a house-keeping periodic task.
2020-03-08 22:49:49 +01:00
Eike Kettner
1e598bd902 Sketch a scheduler for running periodic tasks
Periodic tasks are special in that they are usually kept around and
started based on a schedule. A new component checks periodic tasks and
submits them in the queue once they are due.

In order to avoid duplicate periodic jobs, the tracker of a job is
used to store the periodic job id. Each time a periodic task is due,
it is first checked if there is a job running (or queued) for this
task.
2020-03-08 12:55:03 +01:00
Scala Steward
b692b31c9f
Update flyway-core to 6.3.0 2020-03-05 12:18:50 +01:00
Scala Steward
f7483e8476
Update pureconfig to 0.12.3 2020-02-29 16:51:38 +01:00
Scala Steward
43f90cdf32
Update poi, poi-ooxml, poi-scratchpad to 4.1.2 2020-02-27 22:12:23 +01:00
Scala Steward
1ca7deb7bd
Update pdfbox to 2.0.19 2020-02-25 00:10:43 +01:00
Eike Kettner
98f8b1a4b8 Merge remote-tracking branch 'origin/master' into feature/file-types 2020-02-24 23:07:24 +01:00
Scala Steward
f03c893148
Update flyway-core to 6.2.4 2020-02-20 16:16:42 +01:00
Eike Kettner
9b1349734e Convert some files to pdf 2020-02-19 02:03:10 +01:00
Eike Kettner
756f8bcb4c Merge remote-tracking branch 'origin/master' into feature/file-types 2020-02-16 21:53:28 +01:00
Eike Kettner
8143a4edcc Adding extraction primitives 2020-02-16 21:37:26 +01:00
Eike Kettner
851ee7ef0f Reorganize processing code
Use separate modules for

- text extraction
- conversion to pdf
- text analysis
2020-02-15 21:25:25 +01:00
Scala Steward
492ab23973
Update http4s-blaze-client, ... to 0.21.1 2020-02-14 06:22:44 +01:00
Scala Steward
dcf9edc50d
Update flyway-core to 6.2.3 2020-02-13 14:23:03 +01:00
Eike Kettner
569aae3038 Add example files into its own project
The text and convert module can use them in their tests.
2020-02-11 22:46:23 +01:00
Eike Kettner
ce22b727b1 Add new convert module and sketch its integration 2020-02-11 00:33:52 +01:00
Scala Steward
e08ef5997b
Update swagger-ui to 3.25.0 2020-02-10 10:18:20 +01:00
Scala Steward
b653f0c57c
Update http4s-blaze-client, ... to 0.21.0 2020-02-09 22:19:17 +01:00
Scala Steward
6b391cfde9
Update http4s-blaze-client, ... to 0.21.0-RC5 2020-02-09 00:19:54 +01:00
Eike Kettner
8908ad2561 Add attachment preview url based on ViewerJS
The viewerJS library can display PDF files easily using pdfjs. Another
attachment route redirects to the viewerjs application to display the
current attachment.

The attachment responses have been improved in that now the response
headers are added to all responses. Additional a HEAD route has been
added to support the viewerJS application.
2020-02-08 18:02:31 +01:00
eikek
070b4f8452 Merge pull request #24 from scala-steward/update/http4s-blaze-client-0.21.0-RC4
Update http4s-blaze-client, ... to 0.21.0-RC4
2020-02-08 10:09:08 +01:00
Scala Steward
76992c56ef
Update circe-generic, circe-parser to 0.13.0 2020-02-08 02:16:39 +01:00