These CKAN Versions are exactely matched:

• 2.10.0
• 2.10.1
• 2.10.2
• 2.10.3
• 2.10.4
• 2.10.5
• 2.10.6
• 2.10.7
• 2.10.8
• 2.10.9
• 2.11.0
• 2.11.1
• 2.11.2
• 2.11.3
• 2.11.4
• 2.12.0
• 2.5.0
• 2.5.1
• 2.5.2
• 2.5.3
• 2.5.4
• 2.5.5
• 2.5.6
• 2.5.7
• 2.5.8
• 2.5.9
• 2.6.0
• 2.6.1
• 2.6.2
• 2.6.3
• 2.6.4
• 2.6.5
• 2.6.6
• 2.6.7
• 2.6.8
• 2.6.9
• 2.7.0
• 2.7.1
• 2.7.10
• 2.7.11
• 2.7.12
• 2.7.2
• 2.7.3
• 2.7.4
• 2.7.5
• 2.7.6
• 2.7.7
• 2.7.8
• 2.7.9
• 2.8.0
• 2.8.1
• 2.8.10
• 2.8.11
• 2.8.12
• 2.8.2
• 2.8.3
• 2.8.4
• 2.8.5
• 2.8.6
• 2.8.7
• 2.8.8
• 2.8.9
• 2.9.0
• 2.9.0a
• 2.9.1
• 2.9.10
• 2.9.11
• 2.9.13
• 2.9.2
• 2.9.3
• 2.9.4
• 2.9.5
• 2.9.6
• 2.9.7
• 2.9.8
• 2.9.9

ckanext-fulltext - Fulltext searching plugin for CKAN

This extension provides plugins that allow CKAN to store and search full text data. It uses a new Solr field to do a full text search and then display the matches in CKAN.

The full text field enables the user to find datasets that contain text he or she is looking for, without the text being part of one of the CKAN fields. That means the full text will be stored separate and apart from other CKAN package data in Solr as well as in the PostgreSQL database.

Additionally you can parse the fulltext of documents using a JCC-Wrapper for Apache Tika.

Plugin Installation

1. Install the extension into your python environment:

   (pyenv) $ pip install -e git+https://github.com/transparenzportalhamburg/ckanext-fulltext.git#egg=ckanext-fulltext
   

2. Your CKAN configuration ini file should contain the following plugin:

   ckan.plugins = inforeg_solr_search
   

3. Add a new field to your conf/schema.xml that acts like a catch-all field for the content of all resources:

   <field name="fulltext" type="textgen" indexed="true" stored="true"/>
   ...
   <copyField source="fulltext" dest="text"/>
   

4. Create a fulltext table:

   paster --plugin=ckanext-fulltext fulltext init_fulltext_table --config=/etc/ckan/default/development.ini
   

Tika-Wrapper Installation (for Ubuntu)

In order to use the tikaparser you have to install jcc. JCC requires a recent cpp compiler, Java JDK 1.7+.

sudo apt-get update
sudo apt-get install build-essential
sudo apt-get install openjdk-7-jdk
pip install jcc

Now install the tikaparser:

cd /path/to/ckanext-fulltext/ckanext/fulltext/parser
python setup.py build
python setup.py install

API usage

Once you’ve downloaded a full text online resource that you want to search in, create a package with a new metadata field full_text_search to store the full text.

Hide extras fields

You can set options in the CKAN config file to specify extras fields which are not visible for any user except sysadmin:

ckan.fulltext.hide.fields = extras_field1 extras_field2 ...
hide.extras.fields = full_text_search extras_field1 extras_field2 ...
hide.main.fields = maintainer_email author_email ...

Copying and License

This material is copyright (c) 2015 Fachliche Leitstelle Transparenzportal, Hamburg, Germany. Licensed under the GNU Affero General Public License (AGPL) v3.0.