Commit Graph

463 Commits

Author SHA1 Message Date
Eike Kettner
7df77208fe Fix duplicate search results 2020-06-24 01:15:53 +02:00
Eike Kettner
8e0282c25f Indicate when the search-menu is not used 2020-06-24 01:15:41 +02:00
Eike Kettner
7d7460b1c9 Cleanup + hiding false errors from log 2020-06-24 00:23:22 +02:00
Eike Kettner
30937d4908 Set default max page size to 200 2020-06-24 00:04:10 +02:00
Eike Kettner
43b18db76a Don't scroll when loading more items 2020-06-24 00:03:58 +02:00
Eike Kettner
b8558d6837 Don't trigger search when fields are cleared 2020-06-24 00:03:17 +02:00
Eike Kettner
6846f2f46e Add new search-index route to web-ui 2020-06-24 00:03:17 +02:00
Eike Kettner
d5c9923a6d Add a route that only searches the full-text index
It returns the results in the same order as received from the index to
preserve the relevance ordering.
2020-06-24 00:03:17 +02:00
Eike Kettner
d9f0f05613 Refactor findItemsWithTags to more general useful 2020-06-23 21:27:01 +02:00
Eike Kettner
647911563e Fix paging when using full-text search 2020-06-23 01:44:52 +02:00
Eike Kettner
15c0fb4395 Merge branch 'master' into fts 2020-06-23 00:32:27 +02:00
Eike Kettner
e06a3f8fdd ScalafmtAll 2020-06-23 00:18:59 +02:00
Eike Kettner
a3e16e57de Display search highlighting in webapp 2020-06-23 00:17:29 +02:00
Eike Kettner
ffbb16db45 Transport highlighting information to the client 2020-06-23 00:17:29 +02:00
Eike Kettner
a58ffd11e1 Return attachment-name from index 2020-06-22 21:28:26 +02:00
Eike Kettner
8ffbf651b0 Add fts routes to openapi.yml 2020-06-22 21:00:34 +02:00
Eike Kettner
5e77ff0fc5 Start search by pressing enter and not on each stroke
This reduces (unecessary) requests and eases the restless list
rendering. Throttling is still in place to avoid too many requests
when e.g. holding the enter-key.
2020-06-22 00:46:11 +02:00
Eike Kettner
6c8abf4cd7 Fix searchmenu styling 2020-06-21 23:45:12 +02:00
Eike Kettner
af4522c0a7 Prepare ui to handle content search 2020-06-21 22:33:10 +02:00
Eike Kettner
3d82e03a8a Remove solr query from debug log 2020-06-21 22:29:45 +02:00
Eike Kettner
cfe5aa8894 Use no-op fts-client if disabled + push this flag to the webui 2020-06-21 21:06:08 +02:00
Eike Kettner
330fdcdd5b Add rest endpoints to re-create the index 2020-06-21 20:13:33 +02:00
Eike Kettner
0d8b03fc61 Add backend operations for re-creating the full-text index 2020-06-21 15:46:51 +02:00
Eike Kettner
14ea4091c4 Renaming things 2020-06-21 13:15:02 +02:00
Eike Kettner
2f6e531c45 Refactoring index migration task 2020-06-21 01:37:23 +02:00
Eike Kettner
9acea8307d Update full-text index when changing data 2020-06-21 00:33:39 +02:00
Eike Kettner
383614f908 Allow updating single fields in solr 2020-06-20 23:37:47 +02:00
Eike Kettner
7609b2b7c3 Run scalafmtAll 2020-06-20 23:03:51 +02:00
Eike Kettner
1f4ff0d4c4 Add language to schema, extend fts-client 2020-06-20 22:44:47 +02:00
Eike Kettner
3576c45d1a First basic working solr search 2020-06-20 02:18:49 +02:00
Eike Kettner
2a0bf24088 Setup solr schema and index all data using a system task
The task runs on application start. It sets the schema using solr's
schema api and then indexes all data in the database. Each step is
memorized so that it is not executed again on subsequent starts.
2020-06-19 21:37:22 +02:00
Eike Kettner
1f4220eccb Index exsiting data in solr 2020-06-19 00:43:35 +02:00
Eike Kettner
60c079f664 Add task to index current database state 2020-06-18 22:38:45 +02:00
Eike Kettner
146d1b0562 Make data to index more flexible and extensible 2020-06-17 23:20:46 +02:00
Eike Kettner
522daaf57e Introducing fts client into codebase 2020-06-17 23:20:46 +02:00
Eike Kettner
ee801745a7 Add fultext field to search params 2020-06-17 23:20:46 +02:00
Eike Kettner
c7f598e3b0 Initial module setup 2020-06-17 23:20:46 +02:00
Eike Kettner
492f4d304f Set version to 0.8.0-SNAPSHOT 2020-06-17 22:28:45 +02:00
Eike Kettner
33bef52229 Set version to 0.7.0 2020-06-17 21:59:13 +02:00
Eike Kettner
bc20e9a9bb Execute search when loading page 2020-06-17 21:57:50 +02:00
Eike Kettner
4028b7979e Fix mariadb timestamp columns
MariaDB automatically inserts the current time, even when saying `SET
datecol = null`.
2020-06-17 21:51:30 +02:00
Eike Kettner
897d91475e Update scalafmt-core to 2.6.0 2020-06-17 19:53:56 +02:00
Eike Kettner
7a3d2e4dc6 Extract OItemSearch from OItem 2020-06-15 23:13:48 +02:00
Eike Kettner
09579eef16 Add docs for how to create a smtp gateway 2020-06-14 21:35:20 +02:00
Eike Kettner
0643534994 Add edit icon for changing attachment name 2020-06-14 17:03:07 +02:00
Eike Kettner
84a26461ed Add a route to update the name of an attachment 2020-06-14 17:03:07 +02:00
Eike Kettner
e15e2c9313 Replace hardcoded number by a config value 2020-06-14 00:49:19 +02:00
Eike Kettner
479a341b13 Add documentation page for searching 2020-06-14 00:18:18 +02:00
Eike Kettner
e0c8c45061 Hide search menu by default and add search bar to top
Adds a search bar to the top of the listing page that is the same as
the `All Names` search field in the search menu. Search menu can be
toggled as before.
2020-06-13 22:05:16 +02:00
Eike Kettner
88234986e6 Make name field search in item name only
Now there is an `allNames` field that searches names of multiple
things.
2020-06-13 21:17:29 +02:00
Eike Kettner
67666595eb Make name search case insensitive 2020-06-13 21:17:15 +02:00
Eike Kettner
217fef7384 Throttle search requests
Throttle search requests when typing. Also fix handling subscriptions
in main.
2020-06-13 21:17:15 +02:00
Eike Kettner
5468e24b55 Add search field for 'all-names' to search menu 2020-06-13 21:03:45 +02:00
Eike Kettner
f30c8a5e4d Add new search term that searches in all meta data
A field that searches via substring search in names of correspondents
and concerned meta data.
2020-06-13 17:08:26 +02:00
Eike Kettner
35c9409680 Automatically add wildcards to name search
If wildcards are already present or if the search string appears in
quotes, wildcard '*' characters are not added.
2020-06-13 16:31:16 +02:00
Eike Kettner
6e4aeb512d Reorganize search menu items 2020-06-13 16:19:35 +02:00
Eike Kettner
617487f5b3 Add mail-debug flag to rest-server
It has been added to the joex application, but it should be possible
to debug mail problems on both apps.
2020-06-13 15:10:00 +02:00
Eike Kettner
1f9f09ba6f Reorder user task table columns 2020-06-13 14:48:12 +02:00
Eike Kettner
bdfc151272 Close task form after submitting and return to list view 2020-06-13 14:40:13 +02:00
Eike Kettner
2c13f9307c Adopt UI to allow multiple notification tasks 2020-06-13 14:26:38 +02:00
Eike Kettner
e51e84408b Change notify-due-item routes to allow multiple tasks per user 2020-06-13 14:26:38 +02:00
Eike Kettner
d41ddd9729 Fix bug in dropdown
The menu for a multi-dropdown should only show entries that are not
already selected (there is no use case to select the same item more
than once).
2020-06-12 23:12:49 +02:00
Eike Kettner
216c89c7d1 Some small documentation fixes 2020-06-12 21:52:29 +02:00
Eike Kettner
9658b2780b Prettify modal dialogs a bit 2020-06-12 00:17:26 +02:00
Eike Kettner
936177a910 Allow to add remaining metadata in item edit view 2020-06-11 22:52:30 +02:00
Eike Kettner
363eb81aff Add remaining routes to create and update item meta data 2020-06-11 22:28:31 +02:00
Eike Kettner
a4d60c0d92 Add correspondent organizations in item edit view 2020-06-11 22:11:58 +02:00
Eike Kettner
c6accca0ff Add route to create and associate correspondent org 2020-06-11 22:11:58 +02:00
Eike Kettner
459647f83f Add new tags in item detail view 2020-06-11 21:52:10 +02:00
Eike Kettner
f407f08ed3 Add a route to add a new tag and associate it to an item 2020-06-11 21:51:42 +02:00
Eike Kettner
d440247857 Change modify item routes to use http put 2020-06-09 23:20:58 +02:00
Eike Kettner
80131522de Use same limit for searchable dropdowns 2020-06-09 22:57:21 +02:00
Eike Kettner
a3b482fa13 Fix some icons 2020-06-09 21:10:49 +02:00
Eike Kettner
3ad9b24c2c Use a better way to select a color 2020-06-08 21:48:27 +02:00
Eike Kettner
4c832dba35 Fix search on initial page load
It must now wait until ui-settings have been provided.
2020-06-08 01:17:19 +02:00
Eike Kettner
e8c3edfd23 Add pdf-preview checkbox to ui settings 2020-06-08 01:13:26 +02:00
Eike Kettner
1dd84c11bd Apply tag colors from settings 2020-06-08 00:54:47 +02:00
Eike Kettner
1cd65b7b7c Store tag category colors in ui settings 2020-06-07 22:16:40 +02:00
Eike Kettner
f4e37b512f Add input field to provide colors for tag categories 2020-06-07 21:42:11 +02:00
Eike Kettner
5b2b2eceb3 Show tags in item list view
Also set default page size down to 60.
2020-06-07 15:43:46 +02:00
Eike Kettner
1d2a6e6caa Add endpoint to search for items and return their tags
This is a more expensive query, since the tags must be resolved per
item. This is now implemented by doing additional queries while
caching each resolved tag.
2020-06-07 15:18:28 +02:00
Eike Kettner
79fc5a30a1 Introduce ui settings and let user set page size for item search 2020-06-07 00:51:11 +02:00
Eike Kettner
6abdb95f02 Reformatting 2020-06-06 20:52:23 +02:00
Eike Kettner
77e8a51acd Fix updating item list when there are no results 2020-06-06 15:15:53 +02:00
Eike Kettner
071ab60a5c Remove i_date query binding 2020-06-06 15:15:29 +02:00
Eike Kettner
d5819eab35 Fix offset/limit clause for mariadb
MariaDB wants first limit and then offset (optionally), postgres
doesn't care.
2020-06-06 11:13:33 +02:00
Eike Kettner
b150269528 Add a load-more button to item list 2020-06-06 11:05:15 +02:00
Eike Kettner
e5b90eff34 Allow client to load items in batches 2020-06-06 11:05:15 +02:00
Eike Kettner
062618bf86 Fix typos in documentation 2020-06-03 23:50:48 +02:00
Eike Kettner
2efb0210af Authorize first on integration route 2020-05-28 07:33:14 +02:00
Eike Kettner
4e0d95a213 Allow to check availability of the integration endpoint 2020-05-27 23:55:45 +02:00
Eike Kettner
7b64cdd0c1 Add missing integration-endpoint in openapi spec
This got forgotten to add in openapi, it is already implemented.
2020-05-27 23:40:50 +02:00
Eike Kettner
6165b6b8c6 Set default value for allowed-ips protection to false
The endpoint is disabled by default, no matter what protection modes
are enabled. If all are disabled, then the endpoint is not
protected (if enabled by an admin). Conversely, if all protection
modes are enabled, they all must succeed.

All protection modes should be off by default, so the user would
choose one. It is confusing, if a user enables one and doesn't realize
that another one is also enabled by default.
2020-05-27 23:30:52 +02:00
Eike Kettner
5679ac4858 Remove references to pdf in the doc
It's not only for pdf files anymore.
2020-05-27 00:44:04 +02:00
Eike Kettner
3d902c3273 Add a docker image for watching a directory 2020-05-25 19:43:06 +02:00
Eike Kettner
f33c2a2293 Set version to 0.7.0-SNAPSHOT 2020-05-25 17:58:05 +02:00
Eike Kettner
9caa074657 Set version to 0.6.0 2020-05-25 17:29:57 +02:00
Eike Kettner
e882b87f15 Update changelog and small doc fixes 2020-05-25 17:29:50 +02:00
Eike Kettner
50a4b5ccb9 Hide delete button on new form 2020-05-25 17:03:31 +02:00
Eike Kettner
4b0eb650f2 Rename package to avoid name clashes 2020-05-25 16:22:09 +02:00
Eike Kettner
56624515a5 ScalafmtAll 2020-05-25 13:56:06 +02:00
Eike Kettner
2e88207ff1 Post process all extracted text
Removes 0 bytes and leading/trailing whitespace
2020-05-25 13:56:06 +02:00
Eike Kettner
4e22361985 Documentation updates 2020-05-25 09:52:19 +02:00
Eike Kettner
ee394eae86 Try streamline the different impls for MimeType 2020-05-25 09:24:24 +02:00
Eike Kettner
81a1b7af0b Make the current drop target visible 2020-05-24 17:48:02 +02:00
Eike Kettner
90e039ceb3 Change attachments position via drag-and-drop 2020-05-24 17:30:25 +02:00
Eike Kettner
3cb738568f Allow to change position of attachments 2020-05-24 17:30:25 +02:00
Eike Kettner
6807ce4d2f Move utility functions into a Util file 2020-05-24 15:58:09 +02:00
Eike Kettner
bcd13bed94 Show information on what files to upload 2020-05-24 15:13:30 +02:00
Eike Kettner
4694433e38 Fix attachment positions
It worked for new items, because the implicit offset was 0. when
adding archives to existing items, there are already attachments and
the new attachments are added to the end. This won't work if files are
added concurrently, because there is no quick and reliable way to
determine the offset then.
2020-05-24 15:13:30 +02:00
Eike Kettner
1dde43e092 Only process attachments in task arguments
When files are added to an item, the attachments already present must
not be "re-processed".
2020-05-24 13:29:38 +02:00
Eike Kettner
4e49c78e72 Change some log levels of item processing task 2020-05-24 12:54:35 +02:00
Eike Kettner
973847807f Update add item view with upload progress info 2020-05-24 11:48:49 +02:00
Eike Kettner
24caba1457 Refactor UploadRoutes to remove duplicate code 2020-05-24 11:48:49 +02:00
Eike Kettner
f519a8effa Check for an existing item before attempting to add files 2020-05-24 11:48:49 +02:00
Eike Kettner
075b665c68 Add some more tlds to look for 2020-05-24 11:48:49 +02:00
Eike Kettner
6501060730 Make notes more prominent. Fix heading in mail form 2020-05-23 20:15:55 +02:00
Eike Kettner
b8267f60c1 Fix edit notes rendering
It must be outside the iframe tree, to not modify it when it
appears/disappears.
2020-05-23 20:15:55 +02:00
Eike Kettner
a5ca3b0325 Add routes and upload form to item detail 2020-05-23 20:15:55 +02:00
Eike Kettner
f4949446e3 Allow to specify an item id to amend files to existing items 2020-05-23 20:15:55 +02:00
Eike Kettner
25d089da6c Update state and proposals only on invalid items
Invalid items are those that are not ready, and not shown to the user.
When changing metadata, it should only be changed, if the item was not
already shown to the user.
2020-05-23 15:46:24 +02:00
Eike Kettner
855d4eefa8 Set progress in a linear way between each step 2020-05-23 15:33:58 +02:00
eikek
e2fc13673e
Merge pull request #129 from eikek/integration-endpoint
Integration endpoint
2020-05-23 15:00:03 +02:00
Eike Kettner
785cdde1a6 Update documentation 2020-05-23 14:37:12 +02:00
Eike Kettner
f16632bc7f Allow a collective to disable the integration endpoint 2020-05-23 14:29:24 +02:00
Eike Kettner
f74f8e5198 Add new way for uploading files to any collective
Applications running next to docspell may want a way to upload files
to any collective for integration purposes. This endpoint can be used
for this. It is disabled by default and can be enabled via the
configuration file.
2020-05-23 14:29:24 +02:00
Eike Kettner
892002b351 Remove unused routes
The functionality has been implemented in `CheckFileRoutes`.
2020-05-23 10:29:59 +02:00
Eike Kettner
229baa0719 Fix redirecting / to /app
Before all paths not otherwise handled were redirected, but it should
only be the root path.
2020-05-23 09:58:34 +02:00
Eike Kettner
4227278bb0 Update documentation 2020-05-23 00:10:07 +02:00
Eike Kettner
69c46f9f1f Fix date-picker initialization in search menu 2020-05-21 23:27:08 +02:00
Eike Kettner
920fcf28dd Change webapp to support multiple scan-mailbox tasks 2020-05-21 22:04:45 +02:00
Eike Kettner
9f9dd6c0fb Change routes for scan-mailbox task to allow multiple tasks per user 2020-05-21 22:04:45 +02:00
Eike Kettner
743aa9d754 Hide correct list element in item card 2020-05-21 01:02:46 +02:00
Eike Kettner
4724e691bc Update user info in scan-mailbox form 2020-05-21 00:09:47 +02:00
Eike Kettner
09b6b1bb05 Improve user-task texts 2020-05-20 22:58:19 +02:00
Eike Kettner
d9782582d8 Use max-mails setting with higher priority
The `mail-chunk-size` is set to its configured value or `max-mails`
whichever is lower.
2020-05-20 22:44:29 +02:00
Eike Kettner
c0259dba7e Allow to enable debug flag for javamail 2020-05-20 22:15:25 +02:00
Eike Kettner
2858d6b853 Notify job executors at the end of the task 2020-05-20 19:44:45 +02:00
Eike Kettner
31a1abf395 Add server limits to importing mails task 2020-05-20 17:52:38 +02:00
Eike Kettner
f2d67dc816 Initial impl of import from mailbox user task 2020-05-20 17:52:38 +02:00
Eike Kettner
451a09dda0 Allow to skip joex notification on uploads 2020-05-20 17:52:38 +02:00
Eike Kettner
852455c610 Add upload operation to task arguments 2020-05-20 17:52:38 +02:00
Eike Kettner
6e8582ea80 Implement scan-mailbox form and routes 2020-05-20 17:52:38 +02:00
Eike Kettner
0d6677f90b Add stub form scan-mailbox form 2020-05-20 17:52:38 +02:00
Eike Kettner
a4be63fd77 Add stub for scan-mailbox task 2020-05-20 17:52:38 +02:00
Eike Kettner
ebe65c7624 Change menu title in user settings 2020-05-20 17:52:38 +02:00
Eike Kettner
5d5311913c Add ScanMailboxArgs 2020-05-20 17:52:38 +02:00
Eike Kettner
c9de74fd91 Add imap settings 2020-05-18 08:46:04 +02:00
Eike Kettner
cece5b6193 Fix mobile support
Next to the missing css classs, the viewport definition was missing in
the html.
2020-05-17 23:21:42 +02:00
Eike Kettner
f5c23ceb3d Change edit-notes icon 2020-05-17 22:41:25 +02:00