Extension Data Extractor


Extension Basics

Title
Data Extractor
Name
ckanext-dataextractor
Type
Public extension
Description
Enables end users to filter and extract resource data for a given date range with admin-configurable filters per resource.
CKAN versions
Download-Url (zip)
Last commit
4 years ago (2021-04-07 20:09:46)
Url to repo
Category
Data Management & Quality


Background Infos

Description (long)
Show details

ckanext-dataextractor

This extension enables the end user to filter and extract resource data for a given date range. Admins can create additional filters for each resource.

Requirements

For example, you might want to mention here which versions of CKAN this extension works with.

Installation

To install ckanext-dataextractor:

  1. Activate your CKAN virtual environment, for example:

    . /usr/lib/ckan/default/bin/activate

  2. Install the ckanext-dataextractor Python package into your virtual environment:

    pip install ckanext-dataextractor

  3. Add dataextractor to the ckan.plugins setting in your CKAN config file (by default the config file is located at /etc/ckan/default/production.ini).

  4. Restart CKAN. For example if you’ve deployed CKAN with Apache on Ubuntu:

    sudo service apache2 reload

Config Settings

ckanext.dataextractor.azure_storage_account_name = ...
ckanext.dataextractor.azure_storage_account_key = ...
ckanext.dataextractor.azure_storage_container_name = ...
ckanext.dataextractor.blob_expiration_days = ...
ckanext.dataextractor.resource_rows_limit = ...          # default: 10
ckanext.dataextractor.pagination_limit = ...             # default: 6
ckanext.dataextractor.default_search_limit = ...         # default: 10000
ckanext.dataextractor.query_timeout = ...                # default: 60000ms
ckanext.dataextractor.enable_full_download = ...         # default: False
ckanext.dataextractor.datastore_root_url = ...
Version
1.2.3
Version release date
2021-04-07
Contact name
Keitaro Inc
Contakt email
Contact Url
(not set)


Installation Guide

Configuration hints

Supports Azure Blob Storage for data extraction. Configurable resource row limits, pagination, search limits, query timeouts and full download options.

Plugins to configure (ckan.ini)
dataextractor
CKAN Settings (ckan.ini)
# ckanext.dataextractor.azure_storage_account_name =
# ckanext.dataextractor.azure_storage_account_key =
# ckanext.dataextractor.azure_storage_container_name =
# ckanext.dataextractor.blob_expiration_days =
# ckanext.dataextractor.resource_rows_limit = 10
# ckanext.dataextractor.pagination_limit = 6
# ckanext.dataextractor.default_search_limit = 10000
# ckanext.dataextractor.query_timeout = 60000
# ckanext.dataextractor.enable_full_download = False
# ckanext.dataextractor.datastore_root_url =
DB migration to be executed
(not set)
<< back to Extensions