intake
Data catalog, search and load
Decision gist · record as of 2026-08-14
Yes, if you work with multiple data sources or share datasets across a team. Intake reduces boilerplate and centralizes data access logic. However, note the active security advisory (GHSA-37g4-qqqv-7m99) and verify it does not affect your use case before deploying to production. The plugin ecosystem may require additional dependencies for your specific data sources.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later.
- Specific data drivers and plugins may require additional dependencies beyond the base install.
- Low install friction with a pure-Python wheel and four runtime dependencies (fsspec, pyyaml, platformdirs, networkx).
License · maintenance · safety
MIT (permissive) — MIT license permits commercial and private use with minimal restrictions; you must include the license text in distributions.
last release 2026-03-09 (158 days)
1 known vulnerabilities (OSV.dev, 2026-08-14) · 1,351,173 downloads/mo, #4,016 on PyPI
Alternatives
Verify before relying
pip install intake
import intake
# Load a data source from a catalog or direct specification
data = intake.open_csv('file.csv')- Whether GHSA-37g4-qqqv-7m99 affects your intended use case and whether a patch is available.
- Whether the package's plugin/driver ecosystem is mature enough for your data source types.
- Performance characteristics when working with large catalogs or remote datasets.
What it is and what it does
Intake is a data access abstraction layer that lets you describe datasets declaratively—via YAML or Python—and organize them into searchable catalogs. Instead of scattering data-loading logic throughout your code, you define data sources once and reference them by name. It handles the mechanics of connecting to remote storage (S3, GCS, etc.), parsing different formats, and optionally transforming data on load.
The package is built on fsspec for filesystem abstraction, pyyaml for configuration, networkx for dependency graphs, and platformdirs for configuration storage. It's designed for teams sharing datasets and for workflows where reproducibility and data provenance matter. You can search catalogs, load data into memory or stream it, and chain transformations—all without writing custom I/O code for each data source.
Use it for
- Define a shared data catalog in YAML so team members load datasets by name instead of hardcoding paths or credentials.
- Discover and load datasets from a central repository without knowing their exact format or storage location.
- Build reproducible data pipelines by versioning and referencing datasets through a catalog rather than file paths.
- Integrate data from multiple remote sources (cloud storage, APIs, databases) under a unified interface.
- Automate data loading and transformation workflows for machine learning or scientific computing projects.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you work with multiple data sources or share datasets across a team.
Intake reduces boilerplate and centralizes data access logic. However, note the active security advisory (GHSA-37g4-qqqv-7m99) and verify it does not affect your use case before deploying to production. The plugin ecosystem may require additional dependencies for your specific data sources.
Install
intake on PyPI
Before you install
Low install friction with a pure-Python wheel and four runtime dependencies (fsspec, pyyaml, platformdirs, networkx). Maintenance status is active with a recent release.
Requires Python 3.10 or later. Specific data drivers and plugins may require additional dependencies beyond the base install.
License in practice
MIT license permits commercial and private use with minimal restrictions; you must include the license text in distributions.
Quickstart
pip install intake
import intake
# Load a data source from a catalog or direct specification
data = intake.open_csv('file.csv')Verify before relying
- Whether GHSA-37g4-qqqv-7m99 affects your intended use case and whether a patch is available.
- Whether the package's plugin/driver ecosystem is mature enough for your data source types.
- Performance characteristics when working with large catalogs or remote datasets.
Package facts
| License | MIT permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 4 packagesfsspecpyyamlplatformdirsnetworkx |
| Maintenance | Actively maintained 158 days since the last release |
| First released | |
| Downloads | 1,351,173 / month, #4,016 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | 1 GHSA-37g4-qqqv-7m99 |
| Classifiers | Development Status :: 4 - BetaLicense :: OSI Approved :: MIT LicenseOperating System :: OS IndependentProgramming Language :: Python |
Evidence: intake-2.0.9-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “dataset discovery and search”
- intakeIntake provides a declarative data catalog system for describing,…
- cinemagoerCinemagoer retrieves and queries movie, actor, director, and company…
- opendatalabOpenDataLab Python SDK provides programmatic and CLI access to…
Give your agent the search over MCP, or paste the wish link into any chat.
More Database packages
psycopg2-binary is a PostgreSQL database adapter for Python that implements the DB API 2.0 specification, enabling Python applications to connect to and query PostgreSQL databases with thread-safe concurrent operations.
Python client library for connecting to and executing commands against Redis key-value stores, supporting both synchronous and asynchronous operations.
Install it if your application needs to interact with Redis; the only prerequisite is a running Redis server instance.
YDB Python SDK is the official client library for connecting to and querying YDB databases from Python applications.
Install it if you need to connect Python applications to YDB databases.
Connects Python applications to Snowflake data warehouses using the DB API 2.0 specification, enabling SQL queries, data transfers, and warehouse operations.
sqlparse tokenizes SQL text into a tree of statements, clauses, and expressions, and provides functions to split scripts, format queries, and inspect parsed tokens without validating dialect or syntax.
Install it if you need to manipulate, format, or analyze SQL text programmatically.
Provides base adapter protocols and shared functionality that database adapters use to integrate with dbt-core, handling connections, dialect translation, relation caching, and core interface management.
See also dlt · acryl-datahub · petl · odc-stac · construct · unitycatalog-client · pystac-ext-table · openmetadata-ingestion · exasol-error-reporting · google-cloud-datacatalog