Commit Graph

1324 Commits

Author SHA1 Message Date
eikek
c2ff9b82be
Merge pull request #96 from scala-steward/update/tika-core-1.24.1
Update tika-core to 1.24.1
2020-04-21 23:01:27 +02:00
Scala Steward
38dfcd6cd0
Update tika-core to 1.24.1 2020-04-21 22:52:50 +02:00
Scala Steward
46fcc07ce8
Update flexmark, ... to 0.61.16 2020-04-21 22:52:45 +02:00
eikek
3805e1f3cf
Merge pull request #93 from scala-steward/update/sbt-microsites-1.2.0
Update sbt-microsites to 1.2.0
2020-04-21 21:43:50 +02:00
eikek
7f67693003
Merge pull request #95 from scala-steward/update/flyway-core-6.4.0
Update flyway-core to 6.4.0
2020-04-21 21:43:40 +02:00
Scala Steward
75d423dce5
Update flyway-core to 6.4.0 2020-04-21 20:44:27 +02:00
Scala Steward
61edac7460
Update stanford-corenlp to 4.0.0 2020-04-21 16:29:37 +02:00
Scala Steward
8c8a5917c7
Update sbt-microsites to 1.2.0 2020-04-21 14:30:43 +02:00
Scala Steward
0323045715
Update flexmark, ... to 0.61.12 2020-04-18 08:10:50 +02:00
Scala Steward
d3a7eff939
Update flexmark, ... to 0.61.10 2020-04-17 00:11:20 +02:00
Scala Steward
4ba3ef4d49
Update sbt to 1.3.10 2020-04-15 11:05:49 +02:00
Scala Steward
9c3a0d7320
Update jquery to 3.5.0 2020-04-15 00:16:04 +02:00
Scala Steward
b0692e6826
Update flexmark, ... to 0.61.8 2020-04-14 04:09:29 +02:00
Scala Steward
c9e6496236
Update flexmark, ... to 0.61.6 2020-04-12 08:10:20 +02:00
Scala Steward
eb0733f47a
Update flexmark, ... to 0.61.4 2020-04-11 06:13:03 +02:00
Scala Steward
e527ce3c45
Update sbt-scalafmt to 2.3.4 2020-04-10 21:04:01 +02:00
Scala Steward
7f27d6b4f2
Update sbt-scalafmt to 2.3.3 2020-04-10 16:44:33 +02:00
Scala Steward
5de6874cb0
Update flexmark, ... to 0.61.2 2020-04-08 22:10:11 +02:00
Eike Kettner
3ffc3fb317 Fix a classpath issue
Remove javax.activation from stanford-nlp artifact. There are new
coordinates now as the java-mail library and the activation library
have been moved to eclipse jakarta.
2020-04-07 22:38:25 +02:00
Eike Kettner
1206105f0b Fix several bugs with handling e-mail files
- When converting from html->pdf, the wkhtmltopdf program exits with
  errors if the document contains invalid links. The content is now
  cleaned before handed to wkhtmltopdf.
- Update emil library which fixes a bug when reading mails without
  explicit transfer encoding (8bit)
- Add a info header to converted mails
2020-04-07 22:38:25 +02:00
eikek
12672938a0
Merge pull request #78 from scala-steward/update/calev-core-0.3.0
Update calev-core, calev-fs2 to 0.3.0
2020-04-07 09:17:39 +02:00
Scala Steward
d77ab41da1
Update minitest, minitest-laws to 2.8.2 2020-04-07 00:55:52 +02:00
Scala Steward
8fc09cb92e
Update calev-core, calev-fs2 to 0.3.0 2020-04-07 00:55:37 +02:00
Scala Steward
b86fb4042c
Update flyway-core to 6.3.3 2020-04-06 20:11:55 +02:00
Scala Steward
530a7d89f3
Update doobie-core, doobie-hikari to 0.9.0 2020-04-06 00:15:28 +02:00
Scala Steward
28601e6143
Update minitest, minitest-laws to 2.8.1 2020-04-05 16:11:22 +02:00
Scala Steward
45ba0a40ef
Update flexmark, ... to 0.61.0 2020-04-04 20:09:33 +02:00
Scala Steward
11cc9edbd7
Update http4s-blaze-client, ... to 0.21.3 2020-04-02 08:14:42 +02:00
Scala Steward
cea5f05c70
Update calev-core, calev-fs2 to 0.2.0 2020-04-02 02:10:32 +02:00
Scala Steward
9f4f71d4a6
Update postgresql to 42.2.12 2020-04-01 02:37:29 +02:00
Scala Steward
9a7365ede5
Update sbt to 1.3.9 2020-03-31 18:20:27 +02:00
Scala Steward
6d2baba052
Update bitpeace-core to 0.4.5 2020-03-28 16:14:53 +01:00
Scala Steward
e035b8e985
Update sbt-sonatype to 3.9.2 2020-03-27 22:29:05 +01:00
Scala Steward
2d0fcfbe2f
Update sbt-sonatype to 3.9.1 2020-03-27 10:43:38 +01:00
Scala Steward
fe2b27bd49
Update http4s-blaze-client, ... to 0.21.2 2020-03-25 04:13:16 +01:00
Eike Kettner
0b80572664 Fix encodings for mails with non-utf8 html parts 2020-03-24 23:40:29 +01:00
Scala Steward
519a39c991
Update flyway-core to 6.3.2 2020-03-24 14:17:49 +01:00
Eike Kettner
cf7ccd572c Improve handling encodings
Html and text files are not fixed to be UTF-8. The encoding is now
detected, which may not work for all files. Default/fallback will be
utf-8.

There is still a problem with mails that contain html parts not in
utf8 encoding. The mail text is always returned as a string and the
original encoding is lost. Then the html is stored using utf-8 bytes,
but wkhtmltopdf reads it using latin1. It seems that the `--encoding`
setting doesn't override encoding provided by the document.
2020-03-23 22:51:28 +01:00
Eike Kettner
3703dce9a6 Update fs2 to 2.3.0 2020-03-20 22:47:09 +01:00
Scala Steward
0903bdf6b3
Update sbt-microsites to 1.1.5 2020-03-20 12:45:58 +01:00
eikek
fd48dace9d
Merge pull request #60 from scala-steward/update/sbt-mdoc-2.1.5
Update sbt-mdoc to 2.1.5
2020-03-20 10:40:14 +01:00
Scala Steward
67a96d95c8
Update sbt-mdoc to 2.1.5 2020-03-20 09:08:40 +01:00
Scala Steward
6477745b77
Update mariadb-java-client to 2.6.0 2020-03-20 09:08:34 +01:00
Scala Steward
736a28bc4f
Update tika-core to 1.24 2020-03-17 16:43:17 +01:00
Scala Steward
1125cc872c
Update sbt-mdoc to 2.1.4 2020-03-16 16:21:51 +01:00
Scala Steward
f043cb48f4
Update sbt-native-packager to 1.7.0 2020-03-16 10:16:14 +01:00
eikek
1e17df4b8c
Merge pull request #52 from scala-steward/update/sbt-native-packager-1.6.2
Update sbt-native-packager to 1.6.2
2020-03-15 22:34:39 +01:00
Scala Steward
4bfb03b442
Update sbt-native-packager to 1.6.2 2020-03-15 22:20:31 +01:00
Scala Steward
b6bed9a629
Update emil-common, emil-javamail to 0.3.0 2020-03-15 22:20:18 +01:00
eikek
a27700fd55
Merge pull request #50 from scala-steward/update/flyway-core-6.3.1
Update flyway-core to 6.3.1
2020-03-15 13:17:00 +01:00
Scala Steward
0076b3782d
Update flyway-core to 6.3.1 2020-03-13 18:25:20 +01:00
Scala Steward
56014e5ee2
Update sbt-mdoc to 2.1.3 2020-03-13 10:20:09 +01:00
Scala Steward
80a6b920d9
Update postgresql to 42.2.11 2020-03-11 00:19:53 +01:00
Scala Steward
bce64048a4
Update sbt-microsites to 1.1.3 2020-03-10 12:27:57 +01:00
Scala Steward
e39a983c96
Update bitpeace-core to 0.4.4 2020-03-10 02:25:12 +01:00
eikek
a07a6ff376
Merge pull request #45 from eikek/feature/background-tasks
Feature/background tasks
2020-03-09 20:59:46 +01:00
Eike Kettner
854a596da3 Integrate periodic tasks
The first use case for periodic task is the cleanup of expired
invitation keys. This is part of a house-keeping periodic task.
2020-03-08 22:49:49 +01:00
Eike Kettner
1e598bd902 Sketch a scheduler for running periodic tasks
Periodic tasks are special in that they are usually kept around and
started based on a schedule. A new component checks periodic tasks and
submits them in the queue once they are due.

In order to avoid duplicate periodic jobs, the tracker of a job is
used to store the periodic job id. Each time a periodic task is due,
it is first checked if there is a job running (or queued) for this
task.
2020-03-08 12:55:03 +01:00
Scala Steward
f656b69fad
Update sbt-scalafmt to 2.3.2 2020-03-05 20:34:38 +01:00
Scala Steward
b692b31c9f
Update flyway-core to 6.3.0 2020-03-05 12:18:50 +01:00
Scala Steward
f7483e8476
Update pureconfig to 0.12.3 2020-02-29 16:51:38 +01:00
Scala Steward
43f90cdf32
Update poi, poi-ooxml, poi-scratchpad to 4.1.2 2020-02-27 22:12:23 +01:00
Scala Steward
1ca7deb7bd
Update pdfbox to 2.0.19 2020-02-25 00:10:43 +01:00
Eike Kettner
98f8b1a4b8 Merge remote-tracking branch 'origin/master' into feature/file-types 2020-02-24 23:07:24 +01:00
Scala Steward
3893fb449e
Update sbt-microsites to 1.1.2 2020-02-21 16:35:43 +01:00
Scala Steward
f03c893148
Update flyway-core to 6.2.4 2020-02-20 16:16:42 +01:00
Eike Kettner
9b1349734e Convert some files to pdf 2020-02-19 02:03:10 +01:00
Eike Kettner
756f8bcb4c Merge remote-tracking branch 'origin/master' into feature/file-types 2020-02-16 21:53:28 +01:00
Eike Kettner
8143a4edcc Adding extraction primitives 2020-02-16 21:37:26 +01:00
Eike Kettner
851ee7ef0f Reorganize processing code
Use separate modules for

- text extraction
- conversion to pdf
- text analysis
2020-02-15 21:25:25 +01:00
Scala Steward
492ab23973
Update http4s-blaze-client, ... to 0.21.1 2020-02-14 06:22:44 +01:00
Scala Steward
dcf9edc50d
Update flyway-core to 6.2.3 2020-02-13 14:23:03 +01:00
Eike Kettner
569aae3038 Add example files into its own project
The text and convert module can use them in their tests.
2020-02-11 22:46:23 +01:00
Eike Kettner
ce22b727b1 Add new convert module and sketch its integration 2020-02-11 00:33:52 +01:00
Scala Steward
e08ef5997b
Update swagger-ui to 3.25.0 2020-02-10 10:18:20 +01:00
Scala Steward
b653f0c57c
Update http4s-blaze-client, ... to 0.21.0 2020-02-09 22:19:17 +01:00
Scala Steward
6b391cfde9
Update http4s-blaze-client, ... to 0.21.0-RC5 2020-02-09 00:19:54 +01:00
Eike Kettner
8908ad2561 Add attachment preview url based on ViewerJS
The viewerJS library can display PDF files easily using pdfjs. Another
attachment route redirects to the viewerjs application to display the
current attachment.

The attachment responses have been improved in that now the response
headers are added to all responses. Additional a HEAD route has been
added to support the viewerJS application.
2020-02-08 18:02:31 +01:00
eikek
070b4f8452 Merge pull request #24 from scala-steward/update/http4s-blaze-client-0.21.0-RC4
Update http4s-blaze-client, ... to 0.21.0-RC4
2020-02-08 10:09:08 +01:00
Scala Steward
76992c56ef
Update circe-generic, circe-parser to 0.13.0 2020-02-08 02:16:39 +01:00
Scala Steward
9317b4c33d
Update postgresql to 42.2.10 2020-02-06 22:20:49 +01:00
Scala Steward
29d05c7049
Update flyway-core to 6.2.2 2020-02-06 20:11:45 +01:00
Scala Steward
e30ff58b84
Update http4s-blaze-client, ... to 0.21.0-RC4 2020-02-05 16:13:24 +01:00
Eike Kettner
f8aa5c28ac Update http4s to 0.21.0-RC3, fs2 to 2.2.2 2020-02-04 22:14:18 +01:00
Scala Steward
a9ada2d623
Update sbt to 1.3.8 2020-02-04 02:56:54 +01:00
eikek
99b2b4c587
Merge pull request #20 from scala-steward/update/flyway-core-6.2.1
Update flyway-core to 6.2.1
2020-01-30 21:48:25 +01:00
eikek
abd64eafdc
Merge pull request #19 from scala-steward/update/sbt-native-packager-1.6.1
Update sbt-native-packager to 1.6.1
2020-01-30 21:48:13 +01:00
Scala Steward
116ce1369f
Update flyway-core to 6.2.1 2020-01-30 16:17:25 +01:00
Scala Steward
f18c06f6a8
Update sbt-native-packager to 1.6.1 2020-01-30 14:15:45 +01:00
Scala Steward
2c258060fe
Update sbt-scalafmt to 2.3.1 2020-01-30 00:28:01 +01:00
eikek
bfd5bdb0c2
Merge pull request #12 from scala-steward/update/bitpeace-core-0.4.3
Update bitpeace-core to 0.4.3
2020-01-28 23:00:58 +01:00
eikek
1d4ab089fb
Merge pull request #14 from scala-steward/update/flyway-core-6.2.0
Update flyway-core to 6.2.0
2020-01-28 22:59:51 +01:00
eikek
916e1ce5c0
Merge pull request #15 from scala-steward/update/mariadb-java-client-2.5.4
Update mariadb-java-client to 2.5.4
2020-01-28 22:59:40 +01:00
eikek
a0b60b5155
Merge pull request #16 from scala-steward/update/http4s-blaze-client-0.21.0-RC2
Update http4s-blaze-client, ... to 0.21.0-RC2
2020-01-28 22:59:22 +01:00
Scala Steward
628b802631
Update http4s-blaze-client, ... to 0.21.0-RC2 2020-01-28 00:16:32 +01:00
Scala Steward
30458c43e9
Update mariadb-java-client to 2.5.4 2020-01-27 18:24:48 +01:00
Scala Steward
a709cb208f
Update flyway-core to 6.2.0 2020-01-23 18:12:13 +01:00
Scala Steward
d7baa6dd59
Update bitpeace-core to 0.4.3 2020-01-21 22:04:22 +01:00
Scala Steward
8d8a24d818
Update sbt-native-packager to 1.6.0 2020-01-21 18:20:06 +01:00
eikek
ec29e44d3d
Merge pull request #6 from scala-steward/update/sbt-microsites-1.1.0
Update sbt-microsites to 1.1.0
2020-01-21 18:05:03 +01:00
eikek
33c4474246
Merge pull request #8 from scala-steward/update/sbt-release-1.0.13
Update sbt-release to 1.0.13
2020-01-21 18:04:31 +01:00
Scala Steward
bff2c27c5d
Update sbt-release to 1.0.13 2020-01-17 18:11:43 +01:00
Scala Steward
bcfface651
Update sbt to 1.3.7 2020-01-16 09:14:25 +01:00
Scala Steward
068e01314c
Update sbt-microsites to 1.1.0 2020-01-13 17:49:32 +01:00
Eike Kettner
36075fbaaf
Merge pull request #5 from eikek/send-mail
Send items via mail
2020-01-11 18:54:57 +01:00
Eike Kettner
3d70a452c6 Fix emil dependency 2020-01-11 18:49:09 +01:00
Eike Kettner
5663a9692c
Merge pull request #1 from scala-steward/update/flyway-core-6.1.4
Update flyway-core to 6.1.4
2020-01-10 21:31:46 +01:00
Eike Kettner
28fd1c993e
Merge pull request #2 from scala-steward/update/mariadb-java-client-2.5.3
Update mariadb-java-client to 2.5.3
2020-01-10 21:31:30 +01:00
Scala Steward
b9b7f5a6f1
Update sbt-mdoc to 2.1.1 2020-01-10 12:50:32 +01:00
Scala Steward
1dd404fc24
Update mariadb-java-client to 2.5.3 2020-01-10 12:50:26 +01:00
Scala Steward
d9a60ef1f9
Update flyway-core to 6.1.4 2020-01-10 12:50:20 +01:00
Eike Kettner
b795a22992 Send mails for items 2020-01-10 00:45:29 +01:00
Eike Kettner
2e3454c7a1 Starting with mail settings 2020-01-05 15:31:32 +01:00
Eike Kettner
1705aa084d Update sbt plugin 2020-01-03 20:42:33 +01:00
Eike Kettner
d05e919eb4 Update doobie, use legacy java.time conversions 2019-12-31 13:55:09 +01:00
Eike Kettner
57e274e2b0 Upgrade microsite 2019-12-30 02:33:46 +01:00
Eike Kettner
546f1a6ee3 Add scalafmt.conf and elm compile options 2019-12-29 20:52:43 +01:00
Eike Kettner
a9e70401de Update dependencies 2019-12-28 12:38:11 +01:00
Eike Kettner
0d8f39c431 Update dependencies 2019-11-17 00:51:23 +01:00
Eike Kettner
818b30a6c3 Update dependencies 2019-10-28 12:13:32 +01:00
Eike Kettner
d73f8833f3 Use sbt to 1.3.2 2019-09-27 22:34:20 +02:00
Eike Kettner
9a6f3eb786 Update dependencies 2019-09-21 22:02:37 +02:00
Eike Kettner
831cd8b655 Initial version.
Features:

- Upload PDF files let them analyze

- Manage meta data and items

- See processing in webapp
2019-09-21 22:02:36 +02:00
Eike Kettner
6154e6a387 Initial application stub 2019-09-21 14:54:03 +02:00