Commit Graph

745 Commits

Author SHA1 Message Date
Eike Kettner
795cd8bc80 Set search when clicking on parts of the item card
When user clicks on correspondent etc. on an item card, the search is
set to this value.
2020-11-14 01:45:10 +01:00
Eike Kettner
faf97222ea Make resetting search form more efficient
Instead of reloading the whole menu, only empty the fields.
2020-11-14 01:45:10 +01:00
Eike Kettner
b1d0ae0cc8 Expose clicks on item cards 2020-11-14 01:45:10 +01:00
Eike Kettner
ec5b822e09 Add subject-filter to scan-mailbox-form 2020-11-13 23:15:20 +01:00
Eike Kettner
5034e12bec Add a subject filter to scan-mailbox args 2020-11-13 23:15:20 +01:00
Eike Kettner
2f9e0a8214 Use more prominent indication when an item is selected
Downside to this approach is that the item card is not accessible when
selected.
2020-11-13 01:54:19 +01:00
Eike Kettner
8950cc4dc9 Improve item card 2020-11-13 01:18:45 +01:00
mergify[bot]
e5ce1fd45f
Merge pull request #437 from eikek/upload-improvements
Upload improvements
2020-11-12 22:58:08 +00:00
Eike Kettner
75c1c5b7f4 Add tags and file-filter settings to scan-mailbox form 2020-11-12 22:37:37 +01:00
Eike Kettner
04ba14f802 Amend source form with tags and file-filter
Allow to define tags and a file filter per source.
2020-11-12 22:37:28 +01:00
Eike Kettner
4fd6e02ec0 Improve glob and filter archive entries 2020-11-11 21:01:23 +01:00
Eike Kettner
27eb5d70de Apply given tags in processing step
Issue: #346
2020-11-11 21:01:23 +01:00
Eike Kettner
55a6f7aaf6 Add more properties to upload meta data 2020-11-11 21:01:23 +01:00
Eike Kettner
a21a97f7d5 Add a simple glob data type 2020-11-10 22:44:08 +01:00
Eike Kettner
746e04c624 Improve logging when creating preview images 2020-11-10 22:25:46 +01:00
Eike Kettner
ed26fe226b Split item card it several functions 2020-11-10 22:25:25 +01:00
Eike Kettner
976aa75710 Move card size definition in css and fix height bug
For very tall images (sometimes shopping receipts), the height must be
restricted, too.
2020-11-09 21:36:17 +01:00
Eike Kettner
10305bc82d Minor improvements 2020-11-09 21:16:53 +01:00
Eike Kettner
29455d638c Add startup task to find page counts of existing files 2020-11-09 20:35:35 +01:00
Eike Kettner
de00b46e5d Move searchbar to the right 2020-11-09 17:12:06 +01:00
Eike Kettner
89646ef3f6 Hide number of pages, if item is only one file with one page 2020-11-09 17:06:44 +01:00
Eike Kettner
7a14b05ea7 Enhance item card displaying current file and number of pages 2020-11-09 17:04:56 +01:00
Eike Kettner
848c245db6 Change the card link to only use the main content
The card is no longer a link itself. The main target is moved to be
the content (the area containing the title and tags). This is in
preparation of upcoming changes: if the whole card is a link, it
cannot contain other links, due to a restriction by html. Later a card
may have more links to provide.
2020-11-09 14:36:58 +01:00
Eike Kettner
67e8994aec Use attachment preview urls
This changes the preview urls to use the concrete attachment ids. This
way browsers have it easier to switch the preview image when the
attachment position is changed.
2020-11-09 14:29:52 +01:00
Eike Kettner
8c08bf233d Amend search results with attachment info
This uses again another query per item to retrieve some information
about each attachment already in the search results.
2020-11-09 14:24:28 +01:00
Eike Kettner
a77f34b7ba Add a processing step to retrieve page counts 2020-11-09 11:08:24 +01:00
Eike Kettner
5906c705c9 Allow the user to choose between 3 preview sizes 2020-11-09 09:40:21 +01:00
Eike Kettner
8c8788bc69 Provide fallback image for previews 2020-11-09 09:00:03 +01:00
Eike Kettner
d4bbb936b6 Count preview image sizes in insight data 2020-11-09 09:00:03 +01:00
Eike Kettner
30682fbecc Document the re-generate all previews endpoint 2020-11-09 09:00:03 +01:00
Eike Kettner
f4e50c5229 Provide endpoints to submit tasks to re-generate previews
The scaling factor can be given in the config file. When this changes,
images can be regenerated via POSTing to certain endpoints. It is
possible to regenerate just one attachment preview or all within a
collective.
2020-11-09 09:00:02 +01:00
Eike Kettner
6037b54959 Don't fail processing if generating preview fails 2020-11-09 00:05:11 +01:00
Eike Kettner
cf6e63785d Fix potential index-out-of-bounds error in classifier
The stanford library expects a non-empty text.
2020-11-09 00:04:51 +01:00
Eike Kettner
709848244c Create tasks to generate all previews
There is a task to generate preview images per attachment. It can
either add them (if not present yet) or overwrite them (e.g. some
config has changed).

There is a task that selects all attachments without previews and
submits a task to create it. This is submitted on start automatically
to generate previews for all existing attachments.
2020-11-08 23:46:02 +01:00
Eike Kettner
eede194352 Fix deleting preview files 2020-11-08 21:27:55 +01:00
Eike Kettner
2c96590aad First ui view of preview images for items
Users can choose to not show them via ui settings
2020-11-08 15:12:56 +01:00
Eike Kettner
7ba6baf6f0 Make preview image smaller 2020-11-08 15:12:56 +01:00
Eike Kettner
757ad31165 Add a route to get the item preview
This is the first available preview of an attachment wrt position. If
all attachments have a preview image, the preview of the first
attachment is returned.
2020-11-08 15:12:56 +01:00
Eike Kettner
8cc89fd3b7 Move handling binary responses to a shared space 2020-11-08 15:12:56 +01:00
Eike Kettner
d376ef3ef1 Add simple route to get the preview image 2020-11-08 13:33:39 +01:00
Eike Kettner
6db5c39d78 Fix converted filename
Mark it by default with a string from the config file.

Issue: 397
2020-11-08 09:45:03 +01:00
Eike Kettner
ef7cb4e779 Create a preview image of all files during processing 2020-11-08 01:25:59 +01:00
Eike Kettner
0841a33ae3 Add a table to hold the preview files 2020-11-08 01:25:38 +01:00
Eike Kettner
350a271b22 Add simple pdf page preview function 2020-11-08 01:25:14 +01:00
Eike Kettner
59dfae6a49 Introduce fomantic-ui, replacing semantic-ui
Replaced semantic-ui with the drop-in replacement fomantic-ui [0]
which is a maintained fork. The fomantic-ui used here is a custom
build [1] of the less-version _without_ google-fonts (css-only). The
javascript part of fomantic-ui is not used, and also jquery could be
dropped now.

[0] https://fomantic-ui.com
[1] https://github.com/eikek/fomantic-slim-default

Issue: #349
2020-11-05 22:44:10 +01:00
Eike Kettner
47e780d35f Set version to 0.15.0-SNAPSHOT 2020-11-01 21:00:19 +01:00
Eike Kettner
1a1104c387 Set version to 0.14.0 2020-11-01 20:25:07 +01:00
Eike Kettner
a965605a9e Improve tag multi-edit 2020-10-31 14:42:17 +01:00
Eike Kettner
f4c79c72ae Allow to remove tags from multiple items 2020-10-31 14:42:17 +01:00
Eike Kettner
6a16d8afc7 Allow to confirm/unconfirm multiple items 2020-10-29 23:15:38 +01:00
Eike Kettner
ab50792879 Change icon for hiding/showing search menu 2020-10-29 23:02:08 +01:00
Eike Kettner
0461cfefe7 Fix sql error for mariadb <10.4
MariaDB below 10.4 doesn't support parentheses around selects for
`intersect` and `union`.

https://mariadb.com/kb/en/intersect/#parentheses

Fixes #404
2020-10-28 22:54:51 +01:00
Eike Kettner
509823404e Try improve search bar/menu switch
Adressing some parts of #395
2020-10-28 21:55:42 +01:00
mergify[bot]
96d7eb5c97
Merge pull request #401 from eikek/fix-replace-cards
Preserve context highlighting from full-text search
2020-10-27 23:57:12 +00:00
Eike Kettner
c6b8355902 Preserve context highlighting from full-text search
When replacing changed cards the fulltext highlighting should be
preserved from the original item.
2020-10-27 22:51:11 +01:00
Eike Kettner
183bcf5bec Add ui-settings flag for side menus 2020-10-27 22:35:52 +01:00
Eike Kettner
83b41b027f Change default position for notes to bottom 2020-10-27 20:43:58 +01:00
mergify[bot]
2ad2f3be57
Merge pull request #392 from eikek/fix-process-timeout
Fix process timeout
2020-10-26 23:48:27 +00:00
Eike Kettner
ab1139523a Let the convert-all task retry when pdf conversion fails 2020-10-26 23:39:26 +01:00
Eike Kettner
b59696a9d3 Make sure to only remove/retry items in premature states 2020-10-26 23:39:26 +01:00
Eike Kettner
0114bb4d72 Use source name from config file for integration endpoint uploads
Fixes: #389
2020-10-26 22:37:30 +01:00
Eike Kettner
dd89e05cc2 Convert exceptions when converting to pdf into an error result
The file processing tries pdf conversion once and keeps going if it
fails. Some errors (e.g. timeouts) are raised via an exception.

Issue: #387
2020-10-26 19:51:02 +01:00
Eike Kettner
0f84200118 Indicate saving when changing name for multiple items 2020-10-26 15:32:58 +01:00
Eike Kettner
0eabb7d589 Change tooltip of new select-items button 2020-10-26 14:46:04 +01:00
Eike Kettner
998aad5627 Delete multiple items 2020-10-26 14:46:04 +01:00
Eike Kettner
9193d7ca51 Send multiple items to reprocessing 2020-10-26 14:03:56 +01:00
Eike Kettner
26e89bf84e Edit org/person/equipment of multiple items 2020-10-26 13:35:47 +01:00
Eike Kettner
2e6026b817 Edit dates of multiple items 2020-10-26 13:16:03 +01:00
Eike Kettner
7ade7dd70b Display direction icon when editing multiple items 2020-10-26 12:49:30 +01:00
Eike Kettner
d4043634ac Edit direction of multiple items 2020-10-26 12:48:15 +01:00
Eike Kettner
42c989a6cd Edit folder of multiple items 2020-10-26 12:39:44 +01:00
Eike Kettner
17472fa4ca Edit name of multiple items 2020-10-26 12:17:55 +01:00
Eike Kettner
7ad37c8d26 Editing tags for multiple items 2020-10-26 11:54:04 +01:00
Eike Kettner
5735a47199 Replace changed item cards 2020-10-25 23:08:40 +01:00
Eike Kettner
458fa7edd9 Allow to search in a defined item subset 2020-10-25 22:19:55 +01:00
Eike Kettner
5f2f20c8d7 Extend http api for multi-edit 2020-10-25 22:19:55 +01:00
Eike Kettner
55cfc4c908 Allow to select multiple items for deletion and edit 2020-10-25 22:19:55 +01:00
Eike Kettner
6ea9193b5e Only scroll to the last visited item when initializing the page
When searching again on that page, scrolling/highlighting should not
happen. It now happens whenever coming to this page (not only when
going back from detail view).

Fixes: #373
2020-10-22 23:33:57 +02:00
Eike Kettner
3e752487e4 Remove unused argument 2020-10-22 23:33:46 +02:00
Eike Kettner
fc5f7c7dca Use previously updated ui settings
Fixes: #368
2020-10-22 00:08:03 +02:00
Eike Kettner
3e2d272746 Add unique constraint for equipment names
Fixes #370
2020-10-21 22:42:19 +02:00
Eike Kettner
3c0b86cb19 Fix regex patterns used for NER
Patterns are split on whitespace by the nlp library and then compiled,
so each "word" must be a valid regex.

Fixes: #356
2020-10-21 00:55:14 +02:00
Eike Kettner
6639a39375 Set version to 0.14.0-SNAPSHOT 2020-10-19 15:07:01 +02:00
Eike Kettner
7a9daa9f4b Set version to 0.13.0 2020-10-19 14:16:16 +02:00
Eike Kettner
e68ee67aec Fix route in openapi spec for uploading 2020-10-19 13:45:14 +02:00
Eike Kettner
d66ae4fdc2 Display error message properly on modal edit 2020-10-19 00:30:55 +02:00
Eike Kettner
3771587e55 Find duplicate tags without category 2020-10-19 00:30:41 +02:00
Eike Kettner
6a3386ce66 Fix sql comparison with optional values 2020-10-19 00:29:41 +02:00
Eike Kettner
ec0d0f8475 Fix openapi spec for rest-server
- The `itemId` parameter was not declared for
  `item/{itemId}/reprocess`
- `tagCategories*` must be declared required for `ItemSearch`
  structure
2020-10-18 23:55:56 +02:00
Eike Kettner
5e0eaf419e Fix browser back button to restore scroll state
Removes the url parameter that was used to identify the card to scroll
to and instead use the id from the internal model.
2020-10-18 21:35:42 +02:00
Eike Kettner
ead2e52253 Show item name in document title 2020-10-18 14:26:18 +02:00
Eike Kettner
fc5035ea8d Use anchor links instead of javascript to go to detail view 2020-10-18 14:09:52 +02:00
Eike Kettner
4ee881963e Fix cookie's secure flag based on protocol
Now, if the configured base-url is `localhost` (that is, it is left
unchanged), the request is insepected to retrieve the base-url value.
This is then used to set the `secure` cookie attribute. The `domain`
attribute has been removed from the cookie.

The notify-items task has been updated to use the same pattern for
creating absolute urls to items it its mail body.
2020-10-11 18:31:36 +02:00
Eike Kettner
df646dfabe Get the client host first from x-forwarded-host header
Then use the x-forwarded-for header (doing a reverse lookup, if
possible). At last use the Host header.
2020-10-09 23:47:07 +02:00
Eike Kettner
3f697f51aa Autoformat 2020-10-06 23:31:09 +02:00
Eike Kettner
160fc6627c Reset upload page on init
Fixes: #294
2020-10-03 00:37:27 +02:00
Eike Kettner
87d9e03f1f Submit search when intialising overview page
When coming back from detail with changes to an item, it should update
the view. Otherwise it is confusing to still see a deleted or changed
item.
2020-10-03 00:32:42 +02:00
Eike Kettner
53c8d3031d Skip invalid dates find in texts
Fixes: #298
2020-10-02 22:37:15 +02:00
Eike Kettner
80ddca9aa3 Add counter to joblog for correct log order
This is to distinguish log entries created at the same time.
2020-10-02 22:14:30 +02:00
Eike Kettner
d4354b8b49 Skip pdf conversion if a converted file exists
For images the conversion also returns the extracted text. If this
would have failed to be saved, it is extracted in the following
text-extraction step.
2020-10-02 17:39:39 +02:00
Eike Kettner
b6f23b038a Fix finding attachments for retries
The attachments to process again must be searched in sources and
archives, too.
2020-10-02 17:39:34 +02:00
Eike Kettner
5e21552358 Don't do duplicate check on retries 2020-10-02 16:50:52 +02:00
Eike Kettner
e26d7129e7 Add fix for mariadb text columns
The `text` data type can only store up to 64kb data. The `mediumtext`
up to 16M and `longtext` up to 4G.

Issue: #297
2020-10-02 16:50:51 +02:00
Eike Kettner
552cdac1d3 Apply flyway api changes 2020-09-28 15:12:10 +02:00
Eike Kettner
db9753046a Set version to 0.13.0-SNAPSHOT 2020-09-28 01:12:10 +02:00
Eike Kettner
f40eb15e86 Set version to 0.12.0 2020-09-28 00:52:09 +02:00
Eike Kettner
67e1ba05f4 Fix domain for auth cookie
The domain was incorrectly extracted from the request. It must be
using the `Host` header at last, trying now `X-Forwarded-For` and
`X-Forwarded-Host` first.
2020-09-28 00:52:09 +02:00
Eike Kettner
72048b9b34 Drop deferred message if user clicked away 2020-09-26 01:28:34 +02:00
Eike Kettner
284c42aec6 Remove attachment tab menu 2020-09-26 01:15:16 +02:00
Eike Kettner
e831d7bdd7 Move attachment tabs into a menu
If multiple attachments are present, the tab menu doesn't show all. So
if there is more than one attachment they can be selected from a menu.
2020-09-26 01:14:56 +02:00
Eike Kettner
ca05b3c195 Fix initialising pages; improve scroll to item 2020-09-25 22:54:50 +02:00
Eike Kettner
030ee6c932 Update website 2020-09-24 00:49:51 +02:00
Eike Kettner
285db78613 Add checkbox to upload page for skipping duplicates 2020-09-23 23:37:00 +02:00
Eike Kettner
f6f63000be Prepend a duplicate check when uploading files 2020-09-23 23:37:00 +02:00
Eike Kettner
02a0343e55 Allow to enable/disable keyboard navigation in user settings 2020-09-22 22:33:21 +02:00
Eike Kettner
5b56ea881c Use Ctrl modifier when navigating in item detail
Otherwise it clashes with input fields
2020-09-22 22:07:27 +02:00
Eike Kettner
60b8dc2134 Navigate items using keyboard
- previous/next item with `.,`
- confirm with `c`
- unconfirm with `u`
2020-09-22 00:27:32 +02:00
Eike Kettner
dc0e05bc20 Navigate in ugly dropdown with keybord
- iterate through options with n,p,j,k
- select with enter
- remove item with esc
- fixes dropdown bug when removing an item, where the menu opens
2020-09-21 23:52:50 +02:00
Eike Kettner
22d70b4997 Allow keyboard navigation in FixedDropdown 2020-09-21 23:27:09 +02:00
Eike Kettner
42a7a003a7 Save name in item detail while typing 2020-09-21 21:12:00 +02:00
Eike Kettner
a5bc6b53a9 Reset hidden fields on confirm
On confirm hidden fields are cleared, so that no "confirmed"
information is attached that the user has never seen.
2020-09-21 14:38:40 +02:00
Eike Kettner
ed1d13e712 Hide folder menu entry if folder field is not active 2020-09-21 14:10:31 +02:00
Eike Kettner
9958d228bd Remove hidden fields from list view 2020-09-21 14:08:13 +02:00
Eike Kettner
57ab050cf7 Remove hidden fields from item details 2020-09-21 13:58:52 +02:00
Eike Kettner
3a3be8cd1e Remove unnecessary scrolling and fix background 2020-09-19 09:30:35 +02:00
Eike Kettner
0f345bb75f Fix footer css on some pages 2020-09-19 09:10:30 +02:00
Eike Kettner
d3bf03482e Add a simple service worker to make an installable app 2020-09-18 22:59:58 +02:00
Eike Kettner
b5f3c64058 Only copy search term when selection changes
This is a fixup for #261
2020-09-18 16:04:57 +02:00
Eike Kettner
f78696b479 Fix manifest.json
For "add to your homescreen" on mobile devices.
2020-09-17 00:02:31 +02:00
Eike Kettner
aeedf58c2b Move field contents when switching search mode in search bar 2020-09-16 22:30:24 +02:00
Eike Kettner
09785292e7 Visually indicate the last viewed item in the list 2020-09-15 23:33:28 +02:00
Eike Kettner
ad110b2a05 Replace js code with proper elm using elm-scroll package 2020-09-14 23:35:21 +02:00
Eike Kettner
3852c69da1 Scroll to the current item when going back from detail
The list view now supports an item id that will be scrolled to and is
highlighted with a shadow. When going back from detail view this is
now used to scroll to the currently viewed item.
2020-09-14 21:57:14 +02:00
Eike Kettner
913bfb611c Remove unused viewmode 2020-09-14 21:57:14 +02:00
Eike Kettner
f65f5eff35 Set client base-url from browser when not given
This is necessary when generating absolute URLs in the webapp (as done
in "Sources" page).
2020-09-13 14:05:20 +02:00
Eike Kettner
d8bb6dcba3 Dynamically configure cookie and base-url
When `base-url` is the default (i.e. localhost), the cookie is now
configured with the domain doing the request and the webapp is
configured to run requests against the host in the address bar of the
browser.
2020-09-13 14:05:20 +02:00
Eike Kettner
5809f94d6f Set version to 0.12.0-SNAPSHOT 2020-09-09 22:32:54 +02:00
Eike Kettner
43f331841f Set version to 0.11.1 2020-09-09 21:45:16 +02:00
Eike Kettner
9c82f186d0 Add missing solr migration for french 2020-09-09 21:39:23 +02:00
Eike Kettner
c658677032 Autoformat 2020-09-09 00:29:32 +02:00
Eike Kettner
97757876d5 Fix formatting 2020-09-08 00:47:42 +02:00
Eike Kettner
6358b4eb75 Set version to 0.12.0-SNAPSHOT 2020-09-08 00:33:35 +02:00
Eike Kettner
cc0416804b Set version to 0.11.0 2020-09-07 23:59:05 +02:00
Eike Kettner
eb11b33028 Fix mariadb changsets 2020-09-07 20:02:50 +02:00
Eike Kettner
c9bd57592b Don't use test data if there is just one config
If classifier models cannot be compared, there is no reason to test.
2020-09-07 20:02:50 +02:00
Eike Kettner
76ccfb8a81 Only learn from confirmed items
Text classification should only learn from confirmed items. Log if
classification is disabled when processing an item.
2020-09-07 13:04:40 +02:00
Eike Kettner
cb1a9e0699 Use separate sql migration for h2 2020-09-07 13:04:29 +02:00
Eike Kettner
06879456a6 Change job priority on queue page 2020-09-05 18:50:58 +02:00
Eike Kettner
1dcccbcf7d Allow to hide classification settings in the webapp 2020-09-05 16:00:19 +02:00
Eike Kettner
7a0f71604d Serve static files/assets preferring the gzip version 2020-09-03 01:29:09 +02:00