Commit Graph

601 Commits

Author SHA1 Message Date
Eike Kettner
3f697f51aa Autoformat 2020-10-06 23:31:09 +02:00
Eike Kettner
160fc6627c Reset upload page on init
Fixes: #294
2020-10-03 00:37:27 +02:00
Eike Kettner
87d9e03f1f Submit search when intialising overview page
When coming back from detail with changes to an item, it should update
the view. Otherwise it is confusing to still see a deleted or changed
item.
2020-10-03 00:32:42 +02:00
Eike Kettner
53c8d3031d Skip invalid dates find in texts
Fixes: #298
2020-10-02 22:37:15 +02:00
Eike Kettner
80ddca9aa3 Add counter to joblog for correct log order
This is to distinguish log entries created at the same time.
2020-10-02 22:14:30 +02:00
Eike Kettner
d4354b8b49 Skip pdf conversion if a converted file exists
For images the conversion also returns the extracted text. If this
would have failed to be saved, it is extracted in the following
text-extraction step.
2020-10-02 17:39:39 +02:00
Eike Kettner
b6f23b038a Fix finding attachments for retries
The attachments to process again must be searched in sources and
archives, too.
2020-10-02 17:39:34 +02:00
Eike Kettner
5e21552358 Don't do duplicate check on retries 2020-10-02 16:50:52 +02:00
Eike Kettner
e26d7129e7 Add fix for mariadb text columns
The `text` data type can only store up to 64kb data. The `mediumtext`
up to 16M and `longtext` up to 4G.

Issue: #297
2020-10-02 16:50:51 +02:00
Eike Kettner
552cdac1d3 Apply flyway api changes 2020-09-28 15:12:10 +02:00
Eike Kettner
db9753046a Set version to 0.13.0-SNAPSHOT 2020-09-28 01:12:10 +02:00
Eike Kettner
f40eb15e86 Set version to 0.12.0 2020-09-28 00:52:09 +02:00
Eike Kettner
67e1ba05f4 Fix domain for auth cookie
The domain was incorrectly extracted from the request. It must be
using the `Host` header at last, trying now `X-Forwarded-For` and
`X-Forwarded-Host` first.
2020-09-28 00:52:09 +02:00
Eike Kettner
72048b9b34 Drop deferred message if user clicked away 2020-09-26 01:28:34 +02:00
Eike Kettner
284c42aec6 Remove attachment tab menu 2020-09-26 01:15:16 +02:00
Eike Kettner
e831d7bdd7 Move attachment tabs into a menu
If multiple attachments are present, the tab menu doesn't show all. So
if there is more than one attachment they can be selected from a menu.
2020-09-26 01:14:56 +02:00
Eike Kettner
ca05b3c195 Fix initialising pages; improve scroll to item 2020-09-25 22:54:50 +02:00
Eike Kettner
030ee6c932 Update website 2020-09-24 00:49:51 +02:00
Eike Kettner
285db78613 Add checkbox to upload page for skipping duplicates 2020-09-23 23:37:00 +02:00
Eike Kettner
f6f63000be Prepend a duplicate check when uploading files 2020-09-23 23:37:00 +02:00
Eike Kettner
02a0343e55 Allow to enable/disable keyboard navigation in user settings 2020-09-22 22:33:21 +02:00
Eike Kettner
5b56ea881c Use Ctrl modifier when navigating in item detail
Otherwise it clashes with input fields
2020-09-22 22:07:27 +02:00
Eike Kettner
60b8dc2134 Navigate items using keyboard
- previous/next item with `.,`
- confirm with `c`
- unconfirm with `u`
2020-09-22 00:27:32 +02:00
Eike Kettner
dc0e05bc20 Navigate in ugly dropdown with keybord
- iterate through options with n,p,j,k
- select with enter
- remove item with esc
- fixes dropdown bug when removing an item, where the menu opens
2020-09-21 23:52:50 +02:00
Eike Kettner
22d70b4997 Allow keyboard navigation in FixedDropdown 2020-09-21 23:27:09 +02:00
Eike Kettner
42a7a003a7 Save name in item detail while typing 2020-09-21 21:12:00 +02:00
Eike Kettner
a5bc6b53a9 Reset hidden fields on confirm
On confirm hidden fields are cleared, so that no "confirmed"
information is attached that the user has never seen.
2020-09-21 14:38:40 +02:00
Eike Kettner
ed1d13e712 Hide folder menu entry if folder field is not active 2020-09-21 14:10:31 +02:00
Eike Kettner
9958d228bd Remove hidden fields from list view 2020-09-21 14:08:13 +02:00
Eike Kettner
57ab050cf7 Remove hidden fields from item details 2020-09-21 13:58:52 +02:00
Eike Kettner
3a3be8cd1e Remove unnecessary scrolling and fix background 2020-09-19 09:30:35 +02:00
Eike Kettner
0f345bb75f Fix footer css on some pages 2020-09-19 09:10:30 +02:00
Eike Kettner
d3bf03482e Add a simple service worker to make an installable app 2020-09-18 22:59:58 +02:00
Eike Kettner
b5f3c64058 Only copy search term when selection changes
This is a fixup for #261
2020-09-18 16:04:57 +02:00
Eike Kettner
f78696b479 Fix manifest.json
For "add to your homescreen" on mobile devices.
2020-09-17 00:02:31 +02:00
Eike Kettner
aeedf58c2b Move field contents when switching search mode in search bar 2020-09-16 22:30:24 +02:00
Eike Kettner
09785292e7 Visually indicate the last viewed item in the list 2020-09-15 23:33:28 +02:00
Eike Kettner
ad110b2a05 Replace js code with proper elm using elm-scroll package 2020-09-14 23:35:21 +02:00
Eike Kettner
3852c69da1 Scroll to the current item when going back from detail
The list view now supports an item id that will be scrolled to and is
highlighted with a shadow. When going back from detail view this is
now used to scroll to the currently viewed item.
2020-09-14 21:57:14 +02:00
Eike Kettner
913bfb611c Remove unused viewmode 2020-09-14 21:57:14 +02:00
Eike Kettner
f65f5eff35 Set client base-url from browser when not given
This is necessary when generating absolute URLs in the webapp (as done
in "Sources" page).
2020-09-13 14:05:20 +02:00
Eike Kettner
d8bb6dcba3 Dynamically configure cookie and base-url
When `base-url` is the default (i.e. localhost), the cookie is now
configured with the domain doing the request and the webapp is
configured to run requests against the host in the address bar of the
browser.
2020-09-13 14:05:20 +02:00
Eike Kettner
5809f94d6f Set version to 0.12.0-SNAPSHOT 2020-09-09 22:32:54 +02:00
Eike Kettner
43f331841f Set version to 0.11.1 2020-09-09 21:45:16 +02:00
Eike Kettner
9c82f186d0 Add missing solr migration for french 2020-09-09 21:39:23 +02:00
Eike Kettner
c658677032 Autoformat 2020-09-09 00:29:32 +02:00
Eike Kettner
97757876d5 Fix formatting 2020-09-08 00:47:42 +02:00
Eike Kettner
6358b4eb75 Set version to 0.12.0-SNAPSHOT 2020-09-08 00:33:35 +02:00
Eike Kettner
cc0416804b Set version to 0.11.0 2020-09-07 23:59:05 +02:00
Eike Kettner
eb11b33028 Fix mariadb changsets 2020-09-07 20:02:50 +02:00
Eike Kettner
c9bd57592b Don't use test data if there is just one config
If classifier models cannot be compared, there is no reason to test.
2020-09-07 20:02:50 +02:00
Eike Kettner
76ccfb8a81 Only learn from confirmed items
Text classification should only learn from confirmed items. Log if
classification is disabled when processing an item.
2020-09-07 13:04:40 +02:00
Eike Kettner
cb1a9e0699 Use separate sql migration for h2 2020-09-07 13:04:29 +02:00
Eike Kettner
06879456a6 Change job priority on queue page 2020-09-05 18:50:58 +02:00
Eike Kettner
1dcccbcf7d Allow to hide classification settings in the webapp 2020-09-05 16:00:19 +02:00
Eike Kettner
7a0f71604d Serve static files/assets preferring the gzip version 2020-09-03 01:29:09 +02:00
Eike Kettner
4309bd8dfd Some cleanup 2020-09-02 21:22:30 +02:00
Eike Kettner
f9fcee81a5 Add start-now button for train-classifier task 2020-09-02 21:22:22 +02:00
Eike Kettner
8677eca6d4 Fix setting default in dropdown 2020-09-02 18:28:14 +02:00
Eike Kettner
237b960625 Guess a tag on item processing using a trained model if available 2020-09-02 18:28:14 +02:00
Eike Kettner
316b490008 Implement learning a text classifier from collective data 2020-09-02 18:28:14 +02:00
Eike Kettner
68bb65572b Integrate learn-classifier task into the app 2020-09-02 18:28:14 +02:00
Eike Kettner
0c97b4ef76 Initial impl of a text classifier based on stanford-nlp 2020-09-02 18:28:14 +02:00
Eike Kettner
8c4f2e702b Add classifier settings 2020-09-02 18:28:14 +02:00
Eike Kettner
3473cbb773 Use collective data with NER annotation 2020-08-25 20:40:44 +02:00
Eike Kettner
de5b33c40d Add updated column to some tables 2020-08-24 21:30:52 +02:00
Eike Kettner
96d2f948f2 Use collective's addressbook to configure regexner 2020-08-24 14:40:52 +02:00
Eike Kettner
8628a0a8b3 Allow configuring stanford-ner and cache based on collective 2020-08-24 10:55:59 +02:00
Eike Kettner
fdb46da26d Add french language and upgrade stanford-nlp to 4.0.0 2020-08-23 17:48:42 +02:00
Eike Kettner
30d5abddd8 Set version to 0.11.0-SNAPSHOT 2020-08-15 00:41:58 +02:00
Eike Kettner
f2fbf20f00 Set version to 0.10.0 2020-08-14 23:42:01 +02:00
Eike Kettner
7921dca665 Fixup for dropdown improvement 2020-08-14 23:37:28 +02:00
Eike Kettner
fde52bbbb0 Make dropdowns searchable by default and improve open/close clicks
Ref #207
2020-08-14 23:04:39 +02:00
Eike Kettner
760dec2230 Rename new route for retrieving used tags 2020-08-13 23:25:30 +02:00
Eike Kettner
3986487f11 Add api docs and cleanup 2020-08-13 21:22:54 +02:00
Eike Kettner
081c4da903 Add a route to trigger the convert-all-pdf task for a collective 2020-08-13 01:06:13 +02:00
Eike Kettner
69674eb485 Improve job-queue query to make sure jobs across all states show up 2020-08-13 01:06:13 +02:00
Eike Kettner
41ea071555 Add a task to convert all pdfs that have not been converted 2020-08-13 01:06:13 +02:00
Eike Kettner
07e9a9767e Add a task to re-process files of an item 2020-08-12 22:29:56 +02:00
Eike Kettner
57c1144f40 Allow to filter tags/categories in search menu 2020-08-10 13:25:25 +02:00
Eike Kettner
098e4cf868 Fix uploading to enabled/disabled source endpoints 2020-08-09 09:21:23 +02:00
Eike Kettner
6460315b2b Improve menu shadow 2020-08-09 09:12:28 +02:00
Eike Kettner
e793b63248 Allow to hide fields in menus based on ui settings 2020-08-08 22:51:02 +02:00
Eike Kettner
43946ed347 Fail early when source id is wrong 2020-08-08 18:43:18 +02:00
Eike Kettner
5810eac899 Fix remembering selection when going to detail view 2020-08-08 17:24:27 +02:00
Eike Kettner
75c958281e Redesign search/landing page 2020-08-08 16:38:52 +02:00
Eike Kettner
000d1aff2b Toggle tags via drag-drop from list view 2020-08-08 15:50:54 +02:00
Eike Kettner
06ad9ac46c Add routes to conveniently set/toggle tags 2020-08-08 15:08:04 +02:00
Eike Kettner
f86f644365 Prepare for drag-drop items into tags in list view 2020-08-08 14:34:26 +02:00
Eike Kettner
b1ef0c55af Show only visible folders in search menu 2020-08-08 14:16:13 +02:00
Eike Kettner
d6d16e39bd Drag-drop items into folders in list view 2020-08-08 14:03:36 +02:00
Eike Kettner
9c50a85363 Prepare drag-drop for items into folders 2020-08-08 13:20:29 +02:00
Eike Kettner
f0a5f84c8b Define how many tags to see in ui settings 2020-08-08 11:16:45 +02:00
Eike Kettner
4c57d16501 Rename ui setting field 2020-08-08 10:23:08 +02:00
Eike Kettner
7c8c2f856f Include tag categories into the new tag selection field 2020-08-08 10:20:43 +02:00
Eike Kettner
3642b95f8c Add a better tag selection field 2020-08-08 09:23:48 +02:00
Eike Kettner
1c8b66194b Add a route to return used tags
This is part of the `/insights` route without queries for file usage.
2020-08-08 08:35:35 +02:00
Eike Kettner
a4796f3f7f Return more tag details with item insights 2020-08-08 00:41:20 +02:00
Eike Kettner
c8ad9bf11f Put number of folders to display in ui settings 2020-08-08 00:06:23 +02:00
Eike Kettner
873d9fafc3 Add better folder field to search menu and re-order fields 2020-08-08 00:06:21 +02:00