TheAnachronism/docspell
1
0
Fork 0
mirror of https://github.com/TheAnachronism/docspell.git synced 2024-11-13 02:31:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
NaN Commits 2 Branches 1 Tag 89 MiB
c81b92af6d
Commit Graph

370 Commits

Author SHA1 Message Date
Eike Kettner
5679ac4858 Remove references to pdf in the doc 
It's not only for pdf files anymore.
 2020-05-27 00:44:04 +02:00
Eike Kettner
3d902c3273 Add a docker image for watching a directory 2020-05-25 19:43:06 +02:00
Eike Kettner
f33c2a2293 Set version to 0.7.0-SNAPSHOT 2020-05-25 17:58:05 +02:00
Eike Kettner
9caa074657 Set version to 0.6.0 2020-05-25 17:29:57 +02:00
Eike Kettner
e882b87f15 Update changelog and small doc fixes 2020-05-25 17:29:50 +02:00
Eike Kettner
50a4b5ccb9 Hide delete button on new form 2020-05-25 17:03:31 +02:00
Eike Kettner
4b0eb650f2 Rename package to avoid name clashes 2020-05-25 16:22:09 +02:00
Eike Kettner
56624515a5 ScalafmtAll 2020-05-25 13:56:06 +02:00
Eike Kettner
2e88207ff1 Post process all extracted text 
Removes 0 bytes and leading/trailing whitespace
 2020-05-25 13:56:06 +02:00
Eike Kettner
4e22361985 Documentation updates 2020-05-25 09:52:19 +02:00
Eike Kettner
ee394eae86 Try streamline the different impls for MimeType 2020-05-25 09:24:24 +02:00
Eike Kettner
81a1b7af0b Make the current drop target visible 2020-05-24 17:48:02 +02:00
Eike Kettner
90e039ceb3 Change attachments position via drag-and-drop 2020-05-24 17:30:25 +02:00
Eike Kettner
3cb738568f Allow to change position of attachments 2020-05-24 17:30:25 +02:00
Eike Kettner
6807ce4d2f Move utility functions into a Util file 2020-05-24 15:58:09 +02:00
Eike Kettner
bcd13bed94 Show information on what files to upload 2020-05-24 15:13:30 +02:00
Eike Kettner
4694433e38 Fix attachment positions 
It worked for new items, because the implicit offset was 0. when
adding archives to existing items, there are already attachments and
the new attachments are added to the end. This won't work if files are
added concurrently, because there is no quick and reliable way to
determine the offset then.
 2020-05-24 15:13:30 +02:00
Eike Kettner
1dde43e092 Only process attachments in task arguments 
When files are added to an item, the attachments already present must
not be "re-processed".
 2020-05-24 13:29:38 +02:00
Eike Kettner
4e49c78e72 Change some log levels of item processing task 2020-05-24 12:54:35 +02:00
Eike Kettner
973847807f Update add item view with upload progress info 2020-05-24 11:48:49 +02:00
Eike Kettner
24caba1457 Refactor UploadRoutes to remove duplicate code 2020-05-24 11:48:49 +02:00
Eike Kettner
f519a8effa Check for an existing item before attempting to add files 2020-05-24 11:48:49 +02:00
Eike Kettner
075b665c68 Add some more tlds to look for 2020-05-24 11:48:49 +02:00
Eike Kettner
6501060730 Make notes more prominent. Fix heading in mail form 2020-05-23 20:15:55 +02:00
Eike Kettner
b8267f60c1 Fix edit notes rendering 
It must be outside the iframe tree, to not modify it when it
appears/disappears.
 2020-05-23 20:15:55 +02:00
Eike Kettner
a5ca3b0325 Add routes and upload form to item detail 2020-05-23 20:15:55 +02:00
Eike Kettner
f4949446e3 Allow to specify an item id to amend files to existing items 2020-05-23 20:15:55 +02:00
Eike Kettner
25d089da6c Update state and proposals only on invalid items 
Invalid items are those that are not ready, and not shown to the user.
When changing metadata, it should only be changed, if the item was not
already shown to the user.
 2020-05-23 15:46:24 +02:00
Eike Kettner
855d4eefa8 Set progress in a linear way between each step 2020-05-23 15:33:58 +02:00
eikek
e2fc13673e
Merge pull request #129 from eikek/integration-endpoint 
Integration endpoint
 2020-05-23 15:00:03 +02:00
Eike Kettner
785cdde1a6 Update documentation 2020-05-23 14:37:12 +02:00
Eike Kettner
f16632bc7f Allow a collective to disable the integration endpoint 2020-05-23 14:29:24 +02:00
Eike Kettner
f74f8e5198 Add new way for uploading files to any collective 
Applications running next to docspell may want a way to upload files
to any collective for integration purposes. This endpoint can be used
for this. It is disabled by default and can be enabled via the
configuration file.
 2020-05-23 14:29:24 +02:00
Eike Kettner
892002b351 Remove unused routes 
The functionality has been implemented in `CheckFileRoutes`.
 2020-05-23 10:29:59 +02:00
Eike Kettner
229baa0719 Fix redirecting / to /app 
Before all paths not otherwise handled were redirected, but it should
only be the root path.
 2020-05-23 09:58:34 +02:00
Eike Kettner
4227278bb0 Update documentation 2020-05-23 00:10:07 +02:00
Eike Kettner
69c46f9f1f Fix date-picker initialization in search menu 2020-05-21 23:27:08 +02:00
Eike Kettner
920fcf28dd Change webapp to support multiple scan-mailbox tasks 2020-05-21 22:04:45 +02:00
Eike Kettner
9f9dd6c0fb Change routes for scan-mailbox task to allow multiple tasks per user 2020-05-21 22:04:45 +02:00
Eike Kettner
743aa9d754 Hide correct list element in item card 2020-05-21 01:02:46 +02:00
Eike Kettner
4724e691bc Update user info in scan-mailbox form 2020-05-21 00:09:47 +02:00
Eike Kettner
09b6b1bb05 Improve user-task texts 2020-05-20 22:58:19 +02:00
Eike Kettner
d9782582d8 Use max-mails setting with higher priority 
The `mail-chunk-size` is set to its configured value or `max-mails`
whichever is lower.
 2020-05-20 22:44:29 +02:00
Eike Kettner
c0259dba7e Allow to enable debug flag for javamail 2020-05-20 22:15:25 +02:00
Eike Kettner
2858d6b853 Notify job executors at the end of the task 2020-05-20 19:44:45 +02:00
Eike Kettner
31a1abf395 Add server limits to importing mails task 2020-05-20 17:52:38 +02:00
Eike Kettner
f2d67dc816 Initial impl of import from mailbox user task 2020-05-20 17:52:38 +02:00
Eike Kettner
451a09dda0 Allow to skip joex notification on uploads 2020-05-20 17:52:38 +02:00
Eike Kettner
852455c610 Add upload operation to task arguments 2020-05-20 17:52:38 +02:00
Eike Kettner
6e8582ea80 Implement scan-mailbox form and routes 2020-05-20 17:52:38 +02:00
Eike Kettner
0d6677f90b Add stub form scan-mailbox form 2020-05-20 17:52:38 +02:00
Eike Kettner
a4be63fd77 Add stub for scan-mailbox task 2020-05-20 17:52:38 +02:00
Eike Kettner
ebe65c7624 Change menu title in user settings 2020-05-20 17:52:38 +02:00
Eike Kettner
5d5311913c Add ScanMailboxArgs 2020-05-20 17:52:38 +02:00
Eike Kettner
c9de74fd91 Add imap settings 2020-05-18 08:46:04 +02:00
Eike Kettner
cece5b6193 Fix mobile support 
Next to the missing css classs, the viewport definition was missing in
the html.
 2020-05-17 23:21:42 +02:00
Eike Kettner
f5c23ceb3d Change edit-notes icon 2020-05-17 22:41:25 +02:00
Eike Kettner
dd2e66095a Update screenshots 2020-05-17 22:23:11 +02:00
Eike Kettner
ee4d4e7ae5 Improve responsiveness of detail view 2020-05-17 21:58:19 +02:00
Eike Kettner
72a88f21cb Use cards for viewing items 2020-05-17 21:42:16 +02:00
Eike Kettner
98f202b797 More ui tweaks to item list 2020-05-17 18:16:04 +02:00
Eike Kettner
62111e5f93 Allow to hide the search menu 
This is more convenient on small screens
 2020-05-17 18:15:44 +02:00
Eike Kettner
f45b40342c Improve document list view 
Replace the html table with something that has more vertical space,
but scales better horizontally. On most screens at least 6-8 entries
should be visible at once.
 2020-05-17 18:15:22 +02:00
Eike Kettner
d65c1e0d36 Use date from e-mails to set item date 2020-05-17 11:58:51 +02:00
Eike Kettner
5e6ce1737c Change recognizing dates with short years 
Short years are now added to the current centure (2000) such that date
strings like 12/26/11 result in 12/26/2011 and not 12/26/1911.
 2020-05-17 11:58:51 +02:00
Eike Kettner
3e10e2175a Sort by weights better and save them 2020-05-17 11:58:51 +02:00
Scala Steward
5d6658770e Update emil-common, emil-doobie, ... to 0.6.0 2020-05-17 11:55:53 +02:00
Eike Kettner
6747a86fea Simplify jsoup sanitizer to reuse from emil 2020-05-14 23:56:08 +02:00
Eike Kettner
0a5501dcb0 Fix findFileByChecksum 2020-05-10 21:03:12 +02:00
Eike Kettner
9c882e1be9 Fix package name 2020-05-10 21:03:12 +02:00
Eike Kettner
bd5066740d Joex depends on backend module 
The job executor depends on backend module, since it may control the
application via user tasks. The `ONode` can now be moved from the
store module into the backend module.
 2020-05-10 21:03:12 +02:00
Eike Kettner
c41cdeefec Update scalafmt to 2.5.1 + scalafmtAll 2020-05-04 23:53:57 +02:00
Eike Kettner
9ec75cf85e Set next version to 0.6.0-SNAPSHOT 2020-04-30 22:39:02 +02:00
Eike Kettner
e1117bcc92 Set version to 0.5.0 2020-04-30 22:04:29 +02:00
Eike Kettner
96c5e99f19 Fix scaladoc tag 
There is no scaladoc tag @implNote.
 2020-04-30 22:04:29 +02:00
Eike Kettner
a9869e927e Add new feature to list 2020-04-30 21:41:19 +02:00
Eike Kettner
1d1df58cb9 Put edit notes icon in item action bar 2020-04-30 21:23:56 +02:00
Eike Kettner
0a1b3fcf95 Set list-id header for notification mails 2020-04-30 21:23:56 +02:00
Eike Kettner
75a66ecb86 Update http4s to 0.21.4 2020-04-29 01:05:13 +02:00
Eike Kettner
7fa25c3711 Move notes toggle to top 2020-04-27 21:25:49 +02:00
Eike Kettner
a939839041 Delete single attachments 2020-04-26 23:11:49 +02:00
Eike Kettner
75c32fa2bf Remove wrong header line in upload page 2020-04-24 23:25:04 +02:00
Eike Kettner
fa10fe3fae Update scala to 2.13.2 2020-04-24 22:24:31 +02:00
Eike Kettner
315ea63f44 Improve notify mail template 2020-04-23 23:17:34 +02:00
Eike Kettner
af4e5f161d Add documentation about notify-due-items 2020-04-23 22:26:06 +02:00
Eike Kettner
06d2c9ecba Add info text to int field 2020-04-23 21:46:10 +02:00
Eike Kettner
84e0ebf1a2 Add a flag for restricting overdue items 2020-04-23 21:37:03 +02:00
Eike Kettner
b2ca314da9 Check code formatting with travis ci 2020-04-23 20:25:21 +02:00
Eike Kettner
d52efdfcf0 Improve mail template 2020-04-22 23:41:09 +02:00
Eike Kettner
ffc1cdee51 Sort due items by their earliest due date 2020-04-22 22:21:28 +02:00
Eike Kettner
e1f9ae2629 Include links to items into mail template 2020-04-22 21:53:25 +02:00
Eike Kettner
bbfd694b45 Allow to start a user task once 2020-04-22 21:08:45 +02:00
Eike Kettner
af5b62c057 Remove form message on updates 2020-04-22 21:08:45 +02:00
Eike Kettner
2723d6b43b Implement notify-due-items task 2020-04-22 21:08:45 +02:00
Eike Kettner
e7b81c701f Better handle no connections 2020-04-22 21:08:45 +02:00
Eike Kettner
2042824ab4 Fix initial loading notify form 2020-04-22 21:08:45 +02:00
Eike Kettner
93182c040e Save notify-due-items user task 2020-04-22 21:08:45 +02:00
Eike Kettner
3a90d874a5 Improve form 2020-04-22 21:08:45 +02:00
Eike Kettner
5a2e28415a Streamline form and input field 2020-04-22 21:08:45 +02:00
Eike Kettner
c8683743d0 Provide help within the form 2020-04-22 21:08:45 +02:00
Eike Kettner
5bfa7b05a0 Add better input for calendar events 2020-04-22 21:08:45 +02:00
Eike Kettner
3524904faf Add routes to check calendar events 2020-04-22 21:08:45 +02:00
Eike Kettner
9b30542974 Copy/paste form together 2020-04-22 21:08:45 +02:00
Eike Kettner
ad772c0c25 Server-side stub impl for notify-due-items 2020-04-22 21:08:45 +02:00
Eike Kettner
e97e0db45c Prepare notification form 2020-04-22 21:08:45 +02:00
Eike Kettner
362e1a5e14 Fix compile errors in test code 2020-04-07 23:00:25 +02:00
Eike Kettner
1206105f0b Fix several bugs with handling e-mail files 
- When converting from html->pdf, the wkhtmltopdf program exits with
  errors if the document contains invalid links. The content is now
  cleaned before handed to wkhtmltopdf.
- Update emil library which fixes a bug when reading mails without
  explicit transfer encoding (8bit)
- Add a info header to converted mails
 2020-04-07 22:38:25 +02:00
Eike Kettner
63161b5bdf Add docker setup to quickstart 2020-03-31 22:56:51 +02:00
Eike Kettner
efc73c1060 Set version to 0.5.0-SNAPSHOT 2020-03-28 23:52:15 +01:00
Eike Kettner
c77ead3921 Set version to 0.4.0 2020-03-28 21:44:14 +01:00
Eike Kettner
e331808ecf Update microsite 2020-03-28 21:44:14 +01:00
Eike Kettner
6a1297fc95 Add a limit for text analysis 2020-03-27 22:54:49 +01:00
Eike Kettner
14a25fe23e Fix serializing mediatype parameters 2020-03-27 21:50:06 +01:00
Eike Kettner
aed5dfaff6 Fix mimetype extractors 2020-03-27 21:49:55 +01:00
Eike Kettner
75405dbcba Update documentation 2020-03-27 20:16:18 +01:00
Eike Kettner
16edf84752 Setup new site 2020-03-27 00:35:15 +01:00
Eike Kettner
9656ba62f4 scalafmtAll 2020-03-26 18:26:00 +01:00
Eike Kettner
09ea724c13 Store message-id of eml files 2020-03-25 22:00:51 +01:00
Eike Kettner
43efb4e6ba Use doobie support from emil project 2020-03-24 23:40:29 +01:00
Eike Kettner
e305b46708 Extract tnef attachments and fix incomplete html 
The wkhtmltopdf requires the content encoding set correctly in the
document.
 2020-03-24 23:40:29 +01:00
Eike Kettner
0b80572664 Fix encodings for mails with non-utf8 html parts 2020-03-24 23:40:29 +01:00
Eike Kettner
cf7ccd572c Improve handling encodings 
Html and text files are not fixed to be UTF-8. The encoding is now
detected, which may not work for all files. Default/fallback will be
utf-8.

There is still a problem with mails that contain html parts not in
utf8 encoding. The mail text is always returned as a string and the
original encoding is lost. Then the html is stored using utf-8 bytes,
but wkhtmltopdf reads it using latin1. It seems that the `--encoding`
setting doesn't override encoding provided by the document.
 2020-03-23 22:51:28 +01:00
Eike Kettner
b265421a46 Allow to use the browser's pdf viewer 
The viewerjs library has some limitations. Sometimes PDFs are quite
blurry and some content is displayed scrambled. Switching to the
browsers build-in PDF viewer (for chromium and firefox) fixes this. So
while on mobile the viewerjs is the only working viewer, for desktop
use it might be desireable to use the browsers builtin viewer instead.
 2020-03-22 22:03:43 +01:00
Eike Kettner
75ead33652 Provide a download link to the original archive file 2020-03-22 21:48:49 +01:00
Eike Kettner
7e6eec9533 Include archive infos in item detail 2020-03-22 21:35:50 +01:00
Eike Kettner
cbc95b11e6 Add routes to retrive the archive of an attachment 2020-03-22 21:21:49 +01:00
Eike Kettner
9a99c852a8 Fix typo in search menu 2020-03-22 21:08:01 +01:00
Eike Kettner
3703dce9a6 Update fs2 to 2.3.0 2020-03-20 22:47:09 +01:00
Eike Kettner
cba466ed47 Set item due date candidate 
After processing, set the due date of an item to the first candidate.
The earliest due date is considered best match.
 2020-03-20 22:39:09 +01:00
Eike Kettner
74a6cf1dd1 Remove unused migration directory 2020-03-19 22:43:41 +01:00
Eike Kettner
b1a1a2b837 Add archives to collective insights 2020-03-19 22:43:18 +01:00
Eike Kettner
d78bd4142c Update documentation 2020-03-19 22:42:58 +01:00
Eike Kettner
439aaee27b Search archives when looking for files via checksum 2020-03-19 22:42:48 +01:00
Eike Kettner
6b1156182c Add support for eml (rfc822 email) files 2020-03-19 22:42:40 +01:00
Eike Kettner
4ed7a137f7 Add support for archive files 
Each attachment is now first extracted into potentially multiple ones,
if it is recognized as an archive. This is the first step in
processing. The original archive file is also stored and the resulting
attachments are associated to their original archive.

First support is implemented for zip files.
 2020-03-19 22:42:27 +01:00
Eike Kettner
10f3d5b7ed Fix bug to select other attachments 2020-03-17 22:37:43 +01:00
Eike Kettner
f0449dd2ce Properly initialize thread pools 2020-03-17 22:37:12 +01:00
Eike Kettner
00ca6b5697 Improve text analysis 
- Search for consecutive labels

- Sort list of candidates by a weight

- Search for organizations using person labels
 2020-03-17 22:34:50 +01:00
Eike Kettner
718e44a21c Add cleanup jobs task 2020-03-09 20:24:00 +01:00
Eike Kettner
854a596da3 Integrate periodic tasks 
The first use case for periodic task is the cleanup of expired
invitation keys. This is part of a house-keeping periodic task.
 2020-03-08 22:49:49 +01:00
Eike Kettner
616c333fa5 Implement storage routines for periodic scheduler 2020-03-08 13:56:23 +01:00
Eike Kettner
1e598bd902 Sketch a scheduler for running periodic tasks 
Periodic tasks are special in that they are usually kept around and
started based on a schedule. A new component checks periodic tasks and
submits them in the queue once they are due.

In order to avoid duplicate periodic jobs, the tracker of a job is
used to store the periodic job id. Each time a periodic task is due,
it is first checked if there is a job running (or queued) for this
task.
 2020-03-08 12:55:03 +01:00
Eike Kettner
9b28858d06 Create a simple client for joex in its api module 
This client can be used within the backend app and later in other
modules. The `OJoex` object is replaced with a better implementation
where the http client is initialized once on app start.
 2020-03-03 23:07:49 +01:00
Eike Kettner
42c59179b8 Fix search by checksum to include source files 2020-03-02 20:56:32 +01:00
Eike Kettner
867b59ac10 Fix link in doc menu 2020-03-01 14:08:21 +01:00
Eike Kettner
d8bbcb1409 Fix front-page links for microsite 
The links work while testing locally with jekyll. Must be checked at
the published site.
 2020-03-01 09:45:38 +01:00
Eike Kettner
b7f2c051f4 Set next version to 0.4.0-SNAPSHOT 2020-02-28 21:19:01 +01:00
Eike Kettner
aa3b9258c4 Set version to 0.3.0 2020-02-28 20:52:39 +01:00
Eike Kettner
3f53779ae4 Change documentation side menu and front 2020-02-28 20:52:39 +01:00
Eike Kettner
ad8d64eded Fix microsite and add changelog 2020-02-27 23:59:03 +01:00