Commit graph

30 commits

Author SHA1 Message Date
Joerg Reichert
3857a7c002 downgrade elasticsearch because not recognized as elastic from rails otherwise 2023-04-02 00:43:07 +02:00
Joerg Reichert
857ff4f164 Use data originated from OParl API 2020-09-20 23:18:17 +02:00
Lars Henrik Mai
c08ce6864c Rubocop autocorrect app directory 2020-03-11 14:29:50 +01:00
Lars Henrik Mai
ec4aa64cfc Remove unneeded git keep files 2020-03-11 14:29:50 +01:00
Lars Henrik Mai
dc3a97d3b8 Update elasticsearch
- Build our own elasticsearch image based on 6.8.6 which includes
configuration files for german decompounder from https://github.com/uschindler/german-decompounder

- move elastichq to separate service and use the official image instead of including it as plugin in the elasticsearch image

- Adjust compounder filter config in papers to use the included hyphenation_decompounder.
See https://www.elastic.co/guide/en/elasticsearch/reference/6.8/analysis-compound-word-tokenfilter.html

- Remove obsolete "string" type in the mapping of papers, and replace it
with "text" or "keywords" accordingly. See https://www.elastic.co/blog/strings-are-dead-long-live-strings
2020-01-16 12:20:47 +01:00
Joerg Reichert
5c96de3ded 28 - use elasticsearch-analysis-decompound plugin to support finding results within compound words 2017-01-01 15:05:28 +01:00
Joerg Reichert
5ef5975ad7 by default sort by published date, as initial web site shows all papers and thus there is no query yet that can be sorted by relevance 2016-03-26 13:40:39 +01:00
Joerg Reichert
0718e86f07 added mapping for attribute published_at to fix sorting by date. Note this requires rebuilding the elasticsearch index 2016-03-26 13:33:27 +01:00
Lars Henrik Mai
d790e97535 Create environment specific index name for papers
This will require re-indexing your development database
2016-02-17 20:45:29 +01:00
Lars Henrik Mai
fce65636f7 Make PaperSearch persistent 2015-11-23 22:10:45 +01:00
Lars Henrik Mai
f883df3347 Use PaperSearch definition in controller 2015-11-23 22:10:44 +01:00
Lars Henrik Mai
2ec222281c Extract search query into own class 2015-11-23 22:10:44 +01:00
Lars Henrik Mai
ebca521e2f Refactor and expand Paper validations 2015-11-23 22:10:43 +01:00
Lars Henrik Mai
d5849c2bea Add paper validation tests 2015-11-23 22:10:43 +01:00
Lars Henrik Mai
ae8ff0e95e use german analyzer 2015-07-18 12:44:40 +02:00
Lars Henrik Mai
25e7a580a8 split originator on indexing 2015-07-18 12:44:40 +02:00
Lars Henrik Mai
d27f78afba fix aggregations to work more like drill down 2015-07-18 12:44:40 +02:00
Lars Henrik Mai
2b7ab65432 reenable select boxes for filter by facets 2015-07-18 12:44:40 +02:00
Lars Henrik Mai
1cf5485356 add filter for originator 2015-07-18 12:44:39 +02:00
Lars Henrik Mai
41ed4a9674 add filter by paper_type 2015-07-18 12:44:39 +02:00
Lars Henrik Mai
cb877d510e originator facets 2015-07-18 12:44:39 +02:00
Lars Henrik Mai
f709c399be paper_type facets 2015-07-18 12:44:39 +02:00
Lars Henrik Mai
5b677ab3ca use dsl for search definition and fix pagination 2015-07-18 12:43:43 +02:00
Andreas Haller
8afc7c9c93 Make papers.published_at optional 2015-07-08 20:04:50 +02:00
Andreas Haller
46de026234 Add importer model, validations to paper model 2015-05-17 18:30:03 +02:00
Andreas Haller
5ea5aae4b8 Don’t import the same URI multiple times
Use url as unique identifier during import
2015-04-28 00:47:57 +02:00
Andreas Haller
973af9f0d9 Replace direct ES access with elasticsearch-model 2015-04-27 21:26:37 +02:00
Andreas Haller
2b4281ad87 Import JSON data from morph.io via rake task
Usage: 
MORPH_API_KEY=‘your key’ b rake import_papers:from_morph
2015-04-27 21:03:58 +02:00
Andreas Haller
d39f00165e Add Paper model, Paper.import_from_csv 2015-04-13 22:09:28 +02:00
Andreas Haller
7cd9f207f5 Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00