Eike Kettner
8455d1badf
Lookup results from classifier
...
The model may be out of date, data may change. Then it should be
looked up to fetch the id to be compatible with next stages.
2021-01-19 22:56:01 +01:00
Eike Kettner
1cd3441462
Run classifier for item entities (concerned, correspondent)
...
Store the results separately from nlp results in attachment metadata.
2021-01-19 22:08:29 +01:00
Eike Kettner
d124f0c1a9
Rename db changeset
...
It's not just a fix, but adds new things
2021-01-19 22:08:29 +01:00
Eike Kettner
5c487ef7a9
Refactor running classifier in text analysis
2021-01-19 21:30:02 +01:00
Eike Kettner
99dcaae66b
Learn classifiers for item entities
...
Learns classifiers for concerned and correspondent entities. This can
be used as an alternative to or after nlp.
2021-01-19 20:54:47 +01:00
Eike Kettner
a6f29153c4
Control what tag categories to use for auto-tagging
2021-01-19 01:20:13 +01:00
Eike Kettner
cce8878898
Exclude tags w/o category from classifying; remove obsolete models
2021-01-18 21:51:49 +01:00
Eike Kettner
3e28ce1254
Add the sql concat function to query builder
2021-01-18 21:51:45 +01:00
Eike Kettner
249f9e6e2a
Extend guessing tags to all tag categories
2021-01-18 21:51:45 +01:00
Eike Kettner
c5778880d9
Update documentation
2021-01-18 17:41:40 +01:00
Eike Kettner
3f75af0807
Add 9 more lanugages to the list of document lanugages
2021-01-18 17:41:40 +01:00
Eike Kettner
94bb18c152
Refactor solr language fields
2021-01-18 17:41:40 +01:00
Eike Kettner
26dff18ae0
Add spanish as an example
...
Adding a new language without nlp requires now only to fill out the
pieces:
- define a list of month names to support date recognition
- add it to joex' dockerfile to be available for tesseract
- update the solr migration/field definitions
- update the elm file so it shows up on the client
2021-01-18 17:41:40 +01:00
Eike Kettner
360cad3304
Refactoring solr/fts migration
...
When re-indexing everything, skip intermediate populating the index
and do this as the very last step.
Parameterize adding new fields by their language.
2021-01-18 17:41:40 +01:00
Eike Kettner
ff121d462c
Disable memory intensive tests on travis
2021-01-18 17:41:40 +01:00
Eike Kettner
f01646aeb5
Reorganize nlp pipeline and add nlp-unsupported language italian
...
Improves and reorganizes how nlp pipelines are setup. Now users can
choose from many options, depending on their hardware and usage
scenario.
This is the base to use more languages without depending on what
stanford-nlp supports. Support then is involves to text extraction and
simple regex-ner processing.
2021-01-18 17:41:40 +01:00
Eike Kettner
a70e9ab614
Store used language for processing on attachmentmeta
...
Issue: #570
2021-01-17 22:56:33 +01:00
Eike Kettner
6cf3f9be5a
Fix joex version endpoint in spec
2021-01-17 22:56:33 +01:00
Eike Kettner
aa937797be
Choose nlp mode in config file
2021-01-17 22:56:33 +01:00
Eike Kettner
54a09861c4
Use model cache with basic annotator
2021-01-17 22:56:33 +01:00
Eike Kettner
a77f67d73a
Make pipeline cache generic to be used with BasicCRFAnnotator
2021-01-17 22:56:33 +01:00
Eike Kettner
4462ebae0f
Resurrect the basic ner classifier
2021-01-17 22:56:33 +01:00
Eike Kettner
a699e87304
Separate ner from classification
2021-01-17 22:56:33 +01:00
Eike Kettner
f02f15e5bd
Move blocker into constructor of text analyser
2021-01-17 22:56:33 +01:00
mergify[bot]
ffbec3502f
Merge pull request #575 from eikek/category-search-fix
...
Category search fix
2021-01-17 20:28:06 +00:00
Eike Kettner
b2b8ad625a
scalafmt
2021-01-17 20:11:58 +01:00
Eike Kettner
f0f0e6e0d4
Search for categories case-insensitive
...
The string was already lowercased, but the comparison was not.
Fixes #568
2021-01-17 20:10:24 +01:00
Eike Kettner
623a61dbb6
Introduce a lowerEq operator to the query builder
2021-01-17 20:10:00 +01:00
Eike Kettner
0be89687dc
Ignore poi updates for now
...
The new version 5.0.0 brings additional 18M transitive dependencies.
It's worth it to checkout what is needed/changed before upgrading.
2021-01-17 19:49:15 +01:00
mergify[bot]
f40290d4ef
Merge pull request #571 from scala-steward/update/swagger-ui-3.40.0
...
Update swagger-ui to 3.40.0
2021-01-15 23:45:44 +00:00
Scala Steward
d337e8bb6a
Update swagger-ui to 3.40.0
2021-01-16 00:19:17 +01:00
mergify[bot]
53aeb365d1
Merge pull request #569 from scala-steward/update/sbt-scalafix-0.9.25
...
Update sbt-scalafix to 0.9.25
2021-01-15 20:08:37 +00:00
Scala Steward
99641e502b
Update sbt-scalafix to 0.9.25
2021-01-15 20:23:51 +01:00
mergify[bot]
96fcd92c83
Merge pull request #566 from scala-steward/update/yamusca-core-0.8.0
...
Update yamusca-core to 0.8.0
2021-01-14 01:40:09 +00:00
Scala Steward
cd73dd4c08
Update yamusca-core to 0.8.0
2021-01-14 02:13:43 +01:00
Eike Kettner
b57ceb6764
Use jdk11 in nix packages
2021-01-12 01:09:15 +01:00
Eike Kettner
f18b763dee
Merge branch 'current-docs'
2021-01-12 00:16:41 +01:00
Eike Kettner
a40779d73a
Fix external link
2021-01-12 00:15:37 +01:00
Eike Kettner
c18c5db717
Remove space in changelog that breaks formatting
2021-01-12 00:14:07 +01:00
Eike Kettner
54bd75e99e
Set version to 0.19.0-SNAPSHOT
2021-01-11 23:27:47 +01:00
Eike Kettner
646eedadf7
Update nix setup
2021-01-11 23:24:29 +01:00
Eike Kettner
0d1b55a205
Set version to 0.18.0
2021-01-11 22:39:40 +01:00
Eike Kettner
83c89d0678
Update changelog date
2021-01-11 22:39:40 +01:00
Eike Kettner
d77b5855e4
Set default pool-size to 1
2021-01-11 22:30:59 +01:00
Eike Kettner
8910ac6954
Add docs for file processing
2021-01-11 22:30:59 +01:00
Eike Kettner
96c337f7db
Update screencasts in documentation
2021-01-11 21:38:13 +01:00
Eike Kettner
31fe4f817a
Update documentation
2021-01-11 21:38:13 +01:00
Eike Kettner
8cf1e38323
Update Changelog
2021-01-11 21:38:13 +01:00
Eike Kettner
38ae7a9027
Make source a quick link on card and detail
2021-01-11 21:37:36 +01:00
mergify[bot]
63535408c9
Merge pull request #564 from scala-steward/update/flyway-core-7.5.0
...
Update flyway-core to 7.5.0
2021-01-11 15:43:40 +00:00
