These CKAN Versions are exactely matched:

• 2.0
• 2.0.1
• 2.0.2
• 2.0.3
• 2.0.4
• 2.0.5
• 2.0.6
• 2.0.7
• 2.0.8
• 2.1
• 2.1.1
• 2.1.2
• 2.1.3
• 2.1.4
• 2.1.5
• 2.1.6
• 2.10.0
• 2.10.1
• 2.10.2
• 2.10.3
• 2.10.4
• 2.10.5
• 2.10.6
• 2.10.7
• 2.10.8
• 2.10.9
• 2.11.0
• 2.11.1
• 2.11.2
• 2.11.3
• 2.11.4
• 2.12.0
• 2.2
• 2.2.1
• 2.2.2
• 2.2.3
• 2.2.4
• 2.3
• 2.3.1
• 2.3.2
• 2.3.3
• 2.3.4
• 2.3.5
• 2.4.0
• 2.4.1
• 2.4.2
• 2.4.3
• 2.4.4
• 2.4.5
• 2.4.6
• 2.4.7
• 2.4.8
• 2.4.9
• 2.5.0
• 2.5.1
• 2.5.2
• 2.5.3
• 2.5.4
• 2.5.5
• 2.5.6
• 2.5.7
• 2.5.8
• 2.5.9
• 2.6.0
• 2.6.1
• 2.6.2
• 2.6.3
• 2.6.4
• 2.6.5
• 2.6.6
• 2.6.7
• 2.6.8
• 2.6.9
• 2.7.0
• 2.7.1
• 2.7.10
• 2.7.11
• 2.7.12
• 2.7.2
• 2.7.3
• 2.7.4
• 2.7.5
• 2.7.6
• 2.7.7
• 2.7.8
• 2.7.9
• 2.8.0
• 2.8.1
• 2.8.10
• 2.8.11
• 2.8.12
• 2.8.2
• 2.8.3
• 2.8.4
• 2.8.5
• 2.8.6
• 2.8.7
• 2.8.8
• 2.8.9
• 2.9.0
• 2.9.0a
• 2.9.1
• 2.9.10
• 2.9.11
• 2.9.13
• 2.9.2
• 2.9.3
• 2.9.4
• 2.9.5
• 2.9.6
• 2.9.7
• 2.9.8
• 2.9.9

ckanext-datastore-profiler

What is this? This is a public repo for logic and documentation for Toronto’s Open Data Profiler

What is the Profiler Eventually, it will 1. Summarize each attribute in Toronto Open Data datastore resources 2. Assign classifications to each attribute 3. Present those on the Portal’s API (and maybe frontend)

How can I Contribute? - Reach out to opendata@toronto.ca - Reach out on the Civic Tech Toronto Slack

Descriptive Statitics for Integers and Floats:

• mean
• min
• max
• median
• count of distinct values

Descriptive Statitics for Dates and Datetimes:

• earliest date
• latest date
• earliest time
• latest time
• count of distinct values for date
• count of distinct values for date month
• count of distinct values for date year
• count of distinct values for time

Descriptive Statitics for Strings:

• count of distinct values
• count of distinct “words” (string separated by spaces, ignoring things like “this”, “that”, “a” etc
• min and max string length
• min and max word count per string
• count of distinct “masks” (where every letter of a string is turned into an “L” and every digit turned into a “D”)

Requirements

Compatibility with core CKAN versions:

Installation

To install ckanext-datastore-profiler:

1. Activate your CKAN virtual environment, for example:

   . /usr/lib/ckan/default/bin/activate

2. Clone the source and install it on the virtualenv

   git clone https://github.com/open-data-toronto/ckanext-datastore-profiler.git cd ckanext-datastore-profiler pip install -e .