These CKAN Versions are exactely matched:

• 2.10.0
• 2.10.1
• 2.10.2
• 2.10.3
• 2.10.4
• 2.10.5
• 2.10.6
• 2.10.7
• 2.10.8
• 2.10.9
• 2.11.0
• 2.11.1
• 2.11.2
• 2.11.3
• 2.11.4
• 2.12.0
• 2.5.0
• 2.5.1
• 2.5.2
• 2.5.3
• 2.5.4
• 2.5.5
• 2.5.6
• 2.5.7
• 2.5.8
• 2.5.9
• 2.6.0
• 2.6.1
• 2.6.2
• 2.6.3
• 2.6.4
• 2.6.5
• 2.6.6
• 2.6.7
• 2.6.8
• 2.6.9
• 2.7.0
• 2.7.1
• 2.7.10
• 2.7.11
• 2.7.12
• 2.7.2
• 2.7.3
• 2.7.4
• 2.7.5
• 2.7.6
• 2.7.7
• 2.7.8
• 2.7.9
• 2.8.0
• 2.8.1
• 2.8.10
• 2.8.11
• 2.8.12
• 2.8.2
• 2.8.3
• 2.8.4
• 2.8.5
• 2.8.6
• 2.8.7
• 2.8.8
• 2.8.9
• 2.9.0
• 2.9.0a
• 2.9.1
• 2.9.10
• 2.9.11
• 2.9.13
• 2.9.2
• 2.9.3
• 2.9.4
• 2.9.5
• 2.9.6
• 2.9.7
• 2.9.8
• 2.9.9

ckanext-datasolr

⚠️ This extension is no longer maintained. (Archived on Nov 26, 2019)

datasolr is a CKAN extension to use Solr to perform datastore queries.

Motivation

Motivated by low PostgreSQL performance on very large datasets, datasolr provides an alternative API endpoint to perform searches using Solr. datasolr is compatible with and can be configured to replace the datastore_search API endpoint.

Use Case

datasolr aims to replace the search component of the datastore only. It is not a full replacement for the datastore, and its use case is for large datasets that are either not updated, or updated at regular intervals only.

• The data is still stored in (and the actual values fetched from) the PostgreSQL database
• datasolr does not currently provide automatic indexing

Key Features

• Can replace or work alongside standard datastore_search
• Supports Solr stats on fields (min, max, sum, etc.)
• Special filter _solr_not_empty to ensure fields are not empty
• Resource-specific configuration support
• Extensible through IDataSolr interface
• Data Import Handler support for indexing from PostgreSQL

Differences with datastore_search

• Does not accept double quotes in field names
• Only accepts DISTINCT queries on a single field
• Does not support PostgreSQL full text query syntax
• Implements full text search on fields as wildcard search

Configuration

# Replace datastore_search API calls (default: False)
datasolr.replace_datastore_search = False

# Fallback action when resource is not handled by datasolr
datasolr.fallback = ckanext.datastore.logic.action.datastore_search

# Solr search URL
datasolr.search_url = http://localhost:8080/solr/collection2/select

# Unique field in dataset (default: _id)
datasolr.id_field = _id

# Solr schema field matching id_field
datasolr.solr_id_field = _id

# Field holding resource id for multi-dataset cores
datasolr.resource_id_field = resource_id

# Resource-specific configuration (prefix with resource.<resource_id>)
datasolr.resource.UUID.search_url = http://localhost:8080/solr/collection2/select

License

Developed by the Natural History Museum.