codeforleipzig/stadtratmonitor
codeforleipzig/stadtratmonitor
1
1
Fork 0
mirror of https://github.com/CodeforLeipzig/stadtratmonitor.git synced 2024-12-22 15:43:14 +01:00
Code Issues Projects Releases Packages 4 Wiki Activity
Stadtratmonitor – Frontend https://stadtratmonitor.leipzig.codefor.de
68 commits 9 branches 0 tags 4 MiB
JavaScript 53.6%
CSS 37.5%
Ruby 4.7%
SCSS 1.9%
Slim 1.8%
Other 0.5%
Find a file
Lars Henrik Mai 0a702a18be Add rake task to rebuild paper index
2016-01-23 20:32:37 +01:00
app Make PaperSearch persistent 2015-11-23 22:10:45 +01:00
bin Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00
config Configure Elasticsearch URL via ENV 2016-01-23 20:32:22 +01:00
db Add paper_searches table 2015-11-23 22:10:45 +01:00
lib Add rake task to rebuild paper index 2016-01-23 20:32:37 +01:00
log Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00
public Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00
test Add simplecov for code coverage 2016-01-11 22:01:33 +01:00
vendor/assets Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00
.gitignore gitignore .vagrant dir 2016-01-23 20:31:40 +01:00
.ruby-version Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00
config.ru Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00
Gemfile Add simplecov for code coverage 2016-01-11 22:01:33 +01:00
Gemfile.lock Add simplecov for code coverage 2016-01-11 22:01:33 +01:00
LICENSE Initial commit 2014-11-19 17:03:06 +01:00
Rakefile Start with a Rails app with authentication via Persona, Foundation CSS 2014-11-19 18:48:28 +01:00
README.md Rename import task to import_papers 2015-07-27 22:57:32 +02:00

README.md

Stadtratmonitor

Setup

  1. Install Ruby, Bundler, Elasticsearch
  2. Start Elasticsearch: elasticsearch
  3. Setup Rails app: bundle && bundle exec rake db:setup
  4. Start Rails server: bundle exec rails s
  5. Visit http://localhost:3000

TODOs: https://github.com/ahx/stadtratmonitor/issues

Adding a data source (web scraper)

Example scraper: https://morph.io/ahx/city_council_leipzig_recent_papers

Scrapers are stored inside the database (see "Importer" model). To Add a new scraper, you have to create a new Importer record and set it's url field to Morph.io's API URL field.

Adding a scraper manually:

  1. Start Rails console bundle exec rails console
  2. Import.create(url: "https://api.morph.io/[scraper]/data.json?key=[api_key]&query=[sql]")
  3. exit

Now import everything via bundle exec rake import_papers.