TheAnachronism/docspell
1
0
Fork 0
mirror of https://github.com/TheAnachronism/docspell.git synced 2024-11-13 02:31:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
NaN Commits 2 Branches 1 Tag 89 MiB
57ecea818c
Commit Graph

145 Commits

Author SHA1 Message Date
eikek
6bb6cad39d Test db migrations for all supported databases 2021-08-23 23:41:03 +02:00
eikek
865d4a3172 Disable eviction warnings regarding calev and fs2-cron-calev 
The calev-core jar and fs2-cron-calev are compatible, although the
minor was increased in the calev project. This can be removed once
fs2-cron-calev has been released.
 2021-08-21 11:18:29 +02:00
Scala Steward
e4fecefaea
Reformat with scalafmt 3.0.0 2021-08-19 08:50:30 +02:00
eikek
f4a2b86ea8 Use a minimum age of items to remove 
In order to keep deleted items for a while, the periodic task can now
use a duration to only remove items with a certain age. This can be
used to ensure that a deleted item stays at least X days before it
will be removed from the database.

Refs: #347
 2021-08-15 12:32:50 +02:00
eikek
edb344314f Use an enum instead of a boolean to differentiate search 
It's not very likely to have more modes of search besides normal and
trashed, but got surprised in that way quite often and it's nicer this
way anyways.
 2021-08-14 15:11:48 +02:00
eikek
8545637a8f Adopt elm file headers to match elm-format 2021-07-25 13:59:48 +02:00
mergify[bot]
d83ee84a44
Merge pull request #932 from eikek/javac-settings 
Compile the small number of java source files to java 8 target
 2021-07-11 15:17:35 +00:00
eikek
b32f66d156 Add sbt header plugin 2021-07-04 10:57:53 +02:00
eikek
ce6f53cc29 Fix next-job query to do round-robin through job groups 2021-06-27 00:04:56 +02:00
eikek
b1c93d214d Update scala library to 2.13.6 2021-06-17 22:53:26 +02:00
eikek
a5a829f3cc Compile the small number of java source files to java 8 target 
Since scala also produces class files version 52, the few java files
should also be compiled into this format.
 2021-06-16 01:04:35 +02:00
eikek
b1740fb305 Add openapi linting to sbt's lint alias 2021-06-12 21:50:51 +02:00
eikek
1e685a9ea2 Update sbt openapi plugin and use redoc for documentation 2021-06-12 19:04:27 +02:00
eikek
3e7b66fd42 Add workflow for publishing website 
Builds an publishes the website on each push to `current-docs` branch.
 2021-05-31 14:43:23 +02:00
eikek
c0402b1f92 Migrate old sbt syntax to new one 2021-05-31 14:32:37 +02:00
eikek
626a53384b Merge branch 'current-docs' 2021-05-31 13:59:44 +02:00
eikek
bd093ee97d Use sbt-github-pages plugin 
This makes it easier to use within a gitub action.
 2021-05-31 13:44:47 +02:00
Eike Kettner
63dc6fe13d Remove compiled scalajs files from final package 
Only the js file is necessary, the intermediate sjs files are not
needed at runtime.
 2021-05-30 21:54:17 +02:00
Eike Kettner
9c427c3d38 Fix sbt warnings and add more aliases 2021-04-10 17:16:33 +02:00
Eike Kettner
e1bbc2edf5 Apply autoformat 2021-04-10 16:31:58 +02:00
Eike Kettner
274e433d9d Allow to change use enum for org/equipment 2021-03-10 23:55:18 +01:00
Eike Kettner
6a63694a3e Convert unit tests to munit 2021-03-10 19:48:56 +01:00
Eike Kettner
d4006461f6 Serving scalajs artifacts and provide errors to js 2021-03-03 00:45:10 +01:00
Eike Kettner
d737da768e Move to munit in query module 2021-03-01 00:51:01 +01:00
Eike Kettner
9013d9264e Add more convenient date parsers and some basic macros 2021-03-01 00:51:01 +01:00
Eike Kettner
af73b59ec2 Parser improvements 
- default expressions into a and node
- fix parsing string lists that end in whitespace
- fix package names of internal classes
 2021-03-01 00:51:01 +01:00
Eike Kettner
c3cdec416c Sketching some basic tests 2021-03-01 00:50:52 +01:00
Eike Kettner
be5c7ffb88 First draft of ast and parser 2021-03-01 00:46:57 +01:00
Eike Kettner
74a79a79d9 Initial project setup 2021-03-01 00:46:57 +01:00
Eike Kettner
e6d9ce2c37 Remove obsolete type capabilities 
These are now detected by the new scala compiler and lead to compile
errors.
 2021-03-01 00:16:30 +01:00
Scala Steward
83c4c5c877
Update scala-library to 2.13.5 2021-02-26 23:07:31 +01:00
Eike Kettner
48eee00c0b Allow person to be correspondent, concerning or both 2021-02-16 22:49:55 +01:00
Eike Kettner
442b76c5af Setup tailwind with docspell build 2021-02-03 21:35:15 +01:00
Eike Kettner
1e48346361 Update emil to 0.7.1 2021-01-24 20:07:09 +01:00
Eike Kettner
a6f29153c4 Control what tag categories to use for auto-tagging 2021-01-19 01:20:13 +01:00
Eike Kettner
fb05e997ab Provide multiple date suggestions for English 
Issue: #561
 2021-01-10 09:02:26 +01:00
Eike Kettner
b08e88cd69 Add (inofficial) routes to get system information 2021-01-05 20:54:53 +01:00
Eike Kettner
668abf2140 Add a reset-password admin route 2021-01-04 20:59:31 +01:00
Eike Kettner
6346bf6a34 Add summary for fulltext searches 2020-12-17 00:11:33 +01:00
Eike Kettner
5882405f30 Search index if search object only contains this field 2020-12-05 02:59:57 +01:00
Eike Kettner
0560867b83 Use scalafix' semanticdb version 
Which is now correct after the scalafix bump
 2020-11-27 23:47:51 +01:00
Eike Kettner
3fabe0a582 Update to Scala 2.13.4 2020-11-27 20:26:24 +01:00
Eike Kettner
248ad04dd0 Prepare custom fields 2020-11-22 21:41:09 +01:00
Eike Kettner
3c4f2c6841 Fix packaging tools 
Due to hardcoding files, the new ones were not packaged.
 2020-11-13 22:19:21 +01:00
Eike Kettner
55a6f7aaf6 Add more properties to upload meta data 2020-11-11 21:01:23 +01:00
Eike Kettner
3a26620b2b debian packages: use same system user 
Default database is H2 which requires that both processes can access
the file.
 2020-10-20 01:07:23 +02:00
Eike Kettner
3b8500245f Provide gz version of web assets 2020-09-03 00:22:58 +02:00
Eike Kettner
dbd27057d1 Improve source view and add qrcode for urls 
The qr-code for urls is added so that these urls are easy to copy into
a phone. Then buttons for copying them into the clipboard have been
added.
 2020-08-03 23:58:41 +02:00
Eike Kettner
0599176ae8 Update scala to 2.13.3 2020-08-01 01:03:43 +02:00
Eike Kettner
9af02cd90b Autoformat build.sbt 2020-07-30 20:33:26 +02:00
Eike Kettner
9bc6c60dfe Update build for new website 2020-07-30 20:33:26 +02:00
Eike Kettner
f8c6f79b10 Initial website 2020-07-30 20:33:26 +02:00
Eike Kettner
d277f99fee Add sbt alias for reformatting 2020-07-14 23:18:39 +02:00
Eike Kettner
672ed445b1 Add scalafix and organize-imports rule 2020-06-28 21:20:47 +02:00
Eike Kettner
41c0f70d3b Fix cancelling jobs 
A request to cancel a job was not processed correctly. The cancelling
routine of a task must run, regardless of the (non-final) state. Now
it works like this: if a job is currently running, it is interrupted
and its cancel routine is invoked. It then enters "cancelled" state.
If it is stuck, it is loaded and only its cancel routine is run. If it
is in a final state or waiting, it is removed from the queue.
 2020-06-26 23:08:27 +02:00
Eike Kettner
330fdcdd5b Add rest endpoints to re-create the index 2020-06-21 20:13:33 +02:00
Eike Kettner
1f4220eccb Index exsiting data in solr 2020-06-19 00:43:35 +02:00
Eike Kettner
c7f598e3b0 Initial module setup 2020-06-17 23:20:46 +02:00
Eike Kettner
09579eef16 Add docs for how to create a smtp gateway 2020-06-14 21:35:20 +02:00
Eike Kettner
bd5066740d Joex depends on backend module 
The job executor depends on backend module, since it may control the
application via user tasks. The `ONode` can now be moved from the
store module into the backend module.
 2020-05-10 21:03:12 +02:00
Eike Kettner
0a1b3fcf95 Set list-id header for notification mails 2020-04-30 21:23:56 +02:00
Eike Kettner
fa10fe3fae Update scala to 2.13.2 2020-04-24 22:24:31 +02:00
Eike Kettner
2723d6b43b Implement notify-due-items task 2020-04-22 21:08:45 +02:00
Eike Kettner
e97e0db45c Prepare notification form 2020-04-22 21:08:45 +02:00
Eike Kettner
1206105f0b Fix several bugs with handling e-mail files 
- When converting from html->pdf, the wkhtmltopdf program exits with
  errors if the document contains invalid links. The content is now
  cleaned before handed to wkhtmltopdf.
- Update emil library which fixes a bug when reading mails without
  explicit transfer encoding (8bit)
- Add a info header to converted mails
 2020-04-07 22:38:25 +02:00
Eike Kettner
e331808ecf Update microsite 2020-03-28 21:44:14 +01:00
Eike Kettner
16edf84752 Setup new site 2020-03-27 00:35:15 +01:00
Eike Kettner
e305b46708 Extract tnef attachments and fix incomplete html 
The wkhtmltopdf requires the content encoding set correctly in the
document.
 2020-03-24 23:40:29 +01:00
Eike Kettner
cf7ccd572c Improve handling encodings 
Html and text files are not fixed to be UTF-8. The encoding is now
detected, which may not work for all files. Default/fallback will be
utf-8.

There is still a problem with mails that contain html parts not in
utf8 encoding. The mail text is always returned as a string and the
original encoding is lost. Then the html is stored using utf-8 bytes,
but wkhtmltopdf reads it using latin1. It seems that the `--encoding`
setting doesn't override encoding provided by the document.
 2020-03-23 22:51:28 +01:00
Eike Kettner
00ca6b5697 Improve text analysis 
- Search for consecutive labels

- Sort list of candidates by a weight

- Search for organizations using person labels
 2020-03-17 22:34:50 +01:00
Eike Kettner
854a596da3 Integrate periodic tasks 
The first use case for periodic task is the cleanup of expired
invitation keys. This is part of a house-keeping periodic task.
 2020-03-08 22:49:49 +01:00
Eike Kettner
1e598bd902 Sketch a scheduler for running periodic tasks 
Periodic tasks are special in that they are usually kept around and
started based on a schedule. A new component checks periodic tasks and
submits them in the queue once they are due.

In order to avoid duplicate periodic jobs, the tracker of a job is
used to store the periodic job id. Each time a periodic task is due,
it is first checked if there is a job running (or queued) for this
task.
 2020-03-08 12:55:03 +01:00
Eike Kettner
9b28858d06 Create a simple client for joex in its api module 
This client can be used within the backend app and later in other
modules. The `OJoex` object is replaced with a better implementation
where the http client is initialized once on app start.
 2020-03-03 23:07:49 +01:00
Eike Kettner
d8bbcb1409 Fix front-page links for microsite 
The links work while testing locally with jekyll. Must be checked at
the published site.
 2020-03-01 09:45:38 +01:00
Eike Kettner
ad8d64eded Fix microsite and add changelog 2020-02-27 23:59:03 +01:00
Eike Kettner
8cfecfb3dd Update docs 2020-02-22 00:48:58 +01:00
Eike Kettner
9b1349734e Convert some files to pdf 2020-02-19 02:03:10 +01:00
Eike Kettner
8143a4edcc Adding extraction primitives 2020-02-16 21:37:26 +01:00
Eike Kettner
851ee7ef0f Reorganize processing code 
Use separate modules for

- text extraction
- conversion to pdf
- text analysis
 2020-02-15 21:25:25 +01:00
Eike Kettner
5c3d2b2e28 Rename example-files to files 2020-02-14 11:14:09 +01:00
Eike Kettner
bf9bf25502 Rename example files 2020-02-14 11:10:54 +01:00
Eike Kettner
569aae3038 Add example files into its own project 
The text and convert module can use them in their tests.
 2020-02-11 22:46:23 +01:00
Eike Kettner
ce22b727b1 Add new convert module and sketch its integration 2020-02-11 00:33:52 +01:00
Eike Kettner
e1826f39ac Disable revolver plugin on non-app projects 
This allows to type `reStart` in the root sbt project to start both
applications.
 2020-02-08 18:02:31 +01:00
Eike Kettner
61bbdab8b5 nix: add user doc and pkg fixes 
- Add user doc for how to use with nix/nixos

- fix potential collisions in packages if both are installed via
  `nix-env`
 2020-01-24 21:56:48 +01:00
Eike Kettner
2454f358b1 Add sbt task to create a zip for things in tools/ 2020-01-19 20:32:52 +01:00
Eike Kettner
c84a69aa9c Update documentation 2020-01-11 22:12:51 +01:00
Eike Kettner
2e3454c7a1 Starting with mail settings 2020-01-05 15:31:32 +01:00
Eike Kettner
d05e919eb4 Update doobie, use legacy java.time conversions 2019-12-31 13:55:09 +01:00
Eike Kettner
57e274e2b0 Upgrade microsite 2019-12-30 02:33:46 +01:00
Eike Kettner
546f1a6ee3 Add scalafmt.conf and elm compile options 2019-12-29 20:52:43 +01:00
Eike Kettner
2ad1586d00 Set stricter compile options and fix cookie data 2019-09-28 22:17:45 +02:00
Eike Kettner
9a6f3eb786 Update dependencies 2019-09-21 22:02:37 +02:00
Eike Kettner
831cd8b655 Initial version. 
Features:

- Upload PDF files let them analyze

- Manage meta data and items

- See processing in webapp
 2019-09-21 22:02:36 +02:00
Eike Kettner
6154e6a387 Initial application stub 2019-09-21 14:54:03 +02:00