These CKAN Versions are exactely matched:

• 2.10.0
• 2.10.1
• 2.10.2
• 2.10.3
• 2.10.4
• 2.10.5
• 2.10.6
• 2.10.7
• 2.10.8
• 2.10.9
• 2.11.0
• 2.11.1
• 2.11.2
• 2.11.3
• 2.11.4
• 2.12.0
• 2.9.0
• 2.9.0a
• 2.9.1
• 2.9.10
• 2.9.11
• 2.9.13
• 2.9.2
• 2.9.3
• 2.9.4
• 2.9.5
• 2.9.6
• 2.9.7
• 2.9.8
• 2.9.9

FAIR Data Point Harvester

CKAN harvester for FAIR Data Point. Contains a harvester for FAIR data points. In the future, the FAIR data point API might be supported by this extension too.

Requirements

• CKAN 2.9 (tested), 2.8/2.10 not tested
• ckanext-scheming
• ckanext-harvest
• ckanext-dcat

Features

The harvester runs in three stages:

1. Gather stage: Uses FairDataPointRecordProvider to create list of identifiers (catalogs and datasets) for harvest
2. Fetch stage: Downloads source data, may include additional data from other sources
3. Import stage: Maps RDF from FAIR data point to CKAN packages/resources using application profiles

Installation

git clone https://github.com/CivityNL/ckanext-fairdatapoint.git
cd ckanext-fairdatapoint
pip install -e .
pip install -r requirements.txt

Add fairdatapoint to ckan.plugins in your CKAN config file.

Dependencies

pip install -e 'git+https://github.com/ckan/ckanext-scheming.git@release-3.0.0#egg=ckanext-scheming[requirements]'
pip install -e 'git+https://github.com/ckan/ckanext-harvest.git@v1.5.6#egg=ckanext-harvest[requirements]'
pip install -e 'git+https://github.com/ckan/ckanext-dcat.git@v1.5.1#egg=ckanext-dcat'

Harvester Configuration

Set the profile for harvesting:

{ "profiles": "fairdatapoint_dcat_ap" }

Commands

# Run harvester from command line
ckan --config=<full path to CKAN ini-file> harvester run-test <id of harvester>

# Rebuild search index
ckan --config=<full path to CKAN ini-file> search-index rebuild