Commit Graph

365 Commits

Author SHA1 Message Date
4041018c47 Reduce not expressions
Fixes queries containing macros inside a "not".
2021-04-11 12:57:42 +02:00
e1bbc2edf5 Apply autoformat 2021-04-10 16:31:58 +02:00
144ea852bf Update fs2-core, fs2-io to 2.5.4 2021-03-31 21:10:42 +02:00
c36073b852 Allow to give human readable summary to user tasks 2021-03-27 22:13:13 +01:00
cc38b850a6 Remove deprecated search routes and some refactoring 2021-03-27 22:13:13 +01:00
177488817d Fix h2 migration
Using java source code obviously requires `javac` during migration.
2021-03-13 16:38:48 +01:00
2e443bc9b9 Fix mariadb migration 2021-03-13 15:52:38 +01:00
0229a867af Add a use colum to metadata entities 2021-03-10 23:55:18 +01:00
6a63694a3e Convert unit tests to munit 2021-03-10 19:48:56 +01:00
77a87782b7 Refactoring parser
- put all used strings in one place to have it easier to track
- don't use `$` for shortcuts, it's a detail not interesting to a
  user; now names must not clash (which is a good idea anyways)
- Added two more shortcuts `conc` and `corr`
2021-03-08 22:51:14 +01:00
e681ffa96f Extend query builder allowing more conditions
Before only a column or a dbfunction could be used in a condition. It
is now allowed for all `SelectExpr`.
2021-03-08 22:51:08 +01:00
30c901ddf1 Add more ways to query for attachments
- find items with a specified attachment count
- find items by attachment id
2021-03-08 09:49:38 +01:00
2b2f913e85 Add checksum query expr 2021-03-08 01:53:21 +01:00
1c834cbb77 Correctly compare numeric field values 2021-03-03 22:54:55 +01:00
71985244f1 Use a better representation for macros 2021-03-03 00:44:49 +01:00
a48504debb Specificly search for field id vs name 2021-03-02 21:09:31 +01:00
168f5a1a98 Fix like search for custom fields 2021-03-01 20:56:23 +01:00
f8307f77c6 Search by field id or name 2021-03-01 20:56:23 +01:00
698ff58aa3 Provide a more convenient interface to search 2021-03-01 11:50:07 +01:00
d737da768e Move to munit in query module 2021-03-01 00:51:01 +01:00
9013d9264e Add more convenient date parsers and some basic macros 2021-03-01 00:51:01 +01:00
af73b59ec2 Parser improvements
- default expressions into a and node
- fix parsing string lists that end in whitespace
- fix package names of internal classes
2021-03-01 00:51:01 +01:00
a80d73d5d2 Optimize imports 2021-03-01 00:51:01 +01:00
e9ed998e3a Basic poc to search via custom query 2021-03-01 00:51:01 +01:00
186014a1c6 Refactor search to separate between a base query and user query
The `findBase` is adding only strictly required conditions. Everything
else comes from the user.
2021-03-01 00:51:01 +01:00
c3cdec416c Sketching some basic tests 2021-03-01 00:50:52 +01:00
be5c7ffb88 First draft of ast and parser 2021-03-01 00:46:57 +01:00
e6d9ce2c37 Remove obsolete type capabilities
These are now detected by the new scala compiler and lead to compile
errors.
2021-03-01 00:16:30 +01:00
7ef3185659 Add language to a source
Allows to define upload urls for different languages.
2021-02-18 23:34:42 +01:00
d7bc963450 Cleanup nodes that are not reachable anymore 2021-02-18 00:37:18 +01:00
5181283b1b Add a short-name to organizations 2021-02-17 22:55:35 +01:00
20ccdda609 Add a notes field to equipments 2021-02-17 22:39:07 +01:00
48eee00c0b Allow person to be correspondent, concerning or both 2021-02-16 22:49:55 +01:00
394aeeccb6 Introduce a sql literal and constants in query builder
The h2 jdbc driver could not translate the union query in QCollective
when the `kind` was set via a constant value. Using literals works
here. Renamed the corresponding elements in the query builder.
2021-01-25 00:18:24 +01:00
1b66e2af5c Fix classifier_settings table 2021-01-23 21:30:26 +01:00
c7e850116f Make the text length limit optional 2021-01-22 23:06:50 +01:00
38e0a50942 Merge pull request #582 from eikek/delete-org-fix
Fix deleting organization
2021-01-21 22:56:56 +00:00
f4a03e7c69 Fix deleting organization
The foreign key in person must be resetted.
2021-01-21 21:27:02 +01:00
4cba96f390 Always return classifier results as suggestion
The classifier results are spliced into the suggestion list at second
place. When linking they are only used if nlp didn't find anything.
2021-01-21 21:05:28 +01:00
9957c3267e Add constraints from config to classifier training
For large and/or many documents, training the classifier can lead to
OOM errors. Some limits have been set by default.
2021-01-21 17:46:39 +01:00
363cf5aef0 Quote names in sql changesets 2021-01-21 00:22:58 +01:00
38387e00a0 Fix mariadb migration 2021-01-21 00:22:53 +01:00
27c24c128d Store tags guessed with classifier in database 2021-01-20 00:30:40 +01:00
9d83cb7fe4 Store item based proposals in separate table
Classifier don't work on each attachment, but on all. So the results
must not be stored at an attachment. This reverts some previous
changes to put the classifier results for item entities into its own
table.
2021-01-19 23:48:09 +01:00
3ff9284a64 Return classifier results as suggestions 2021-01-19 23:13:51 +01:00
1cd3441462 Run classifier for item entities (concerned, correspondent)
Store the results separately from nlp results in attachment metadata.
2021-01-19 22:08:29 +01:00
d124f0c1a9 Rename db changeset
It's not just a fix, but adds new things
2021-01-19 22:08:29 +01:00
99dcaae66b Learn classifiers for item entities
Learns classifiers for concerned and correspondent entities. This can
be used as an alternative to or after nlp.
2021-01-19 20:54:47 +01:00
a6f29153c4 Control what tag categories to use for auto-tagging 2021-01-19 01:20:13 +01:00
cce8878898 Exclude tags w/o category from classifying; remove obsolete models 2021-01-18 21:51:49 +01:00