These CKAN Versions are exactely matched:

• 2.10.0
• 2.10.1
• 2.10.2
• 2.10.3
• 2.10.4
• 2.10.5
• 2.10.6
• 2.10.7
• 2.10.8
• 2.10.9
• 2.11.0
• 2.11.1
• 2.11.2
• 2.11.3
• 2.11.4
• 2.12.0
• 2.9.0
• 2.9.0a
• 2.9.1
• 2.9.10
• 2.9.11
• 2.9.13
• 2.9.2
• 2.9.3
• 2.9.4
• 2.9.5
• 2.9.6
• 2.9.7
• 2.9.8
• 2.9.9

CKAN Harvester for openBis (OAI-PMH)

This harvester uses the OAI-PMH interface of openBis to harvest metadata.

Instructions

Installation

Use pip to install this plugin. This example installs it in /vagrant

source /home/www-data/pyenv/bin/activate
pip install -e git+https://github.com/openresearchdata/ckanext-openbis.git#egg=ckanext-openbis --src /vagrant
cd /vagrant/ckanext-openbis
pip install -r requirements.txt
python setup.py develop

Make sure the ckanext-oaipmh and ckanext-harvest extension are installed as well.

Setup the Harvester

• add openbis_harvester to ckan.plugins in development.ini (or production.ini)
• restart your webserver
• with the web browser go to <your ckan url>/harvest/new
• as URL fill in the base URL of an OAI-PMH conforming openBis instance
• select Source type openBis
• if your OAI-PMH needs credentials, add the following to the “Configuration” section: {"username": "foo", "password": "bar" }
• if you only want to harvest a specific set, add the following to the “Configuration” section: {"set": "baz"}
• Save
• on the harvest admin click Reharvest

Run the Harvester

On the command line do this:

• activate the python environment
• cd to the ckan directory, e.g. /usr/lib/ckan/default/src/ckan
• start the consumers (NOTE: only run 1 gather and 1 fetch consumer per server):

paster --plugin=ckanext-openbis harvester gather_consumer &
paster --plugin=ckanext-openbis harvester fetch_consumer &

• run the job:

  paster --plugin=ckanext-openbis harvester run

The harvester should now start and import the OAI-PMH metadata.

Developing without running jobs manually

To make it easier to develop, tests are setup that allow to do that: