data-prep-kit
Open source project for data preparation for GenAI applications
GraphCanon updated 2w · GitHub synced 2w
Decision brief
Curated decision-critical facts for the tool 'data-prep-kit'.
Good fit when
- Use data-prep-kit when you are working with large language models (LLMs) or other GenAI applications and need comprehensive tools for data preparation, including deduplication and fine-tuning.
- Consider it if your project involves handling large-scale data processing.
Avoid when
- Avoid data-prep-kit if the project does not require Python compatibility or if Python versions earlier than 3.10 are in use since this toolkit supports only from Python 3.10 to 3.13.
- Do not use it for tasks unrelated to GenAI applications as its specific features may not be beneficial.
- Requirements:
- Installation requires Python versions from 3.10 to 3.13.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Active (23d since push)
- As of 2w
- Provenance
- Not a fork · Organization account
- As of 2w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/data-prep-kit/data-prep-kitSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Data Prep Kit is designed to provide tools and pipelines for preparing data for large language models (LLM) and other GenAI applications, including deduplication, fine-tuning, and large-scale processing.
Capability facts
- Languages
- html
Source: github.language · Aug 7, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Aug 7, 2026)
The latest version of the Data Prep Kit is available on PyPi for Python 3.10, 3.11, 3.12, and 3.13. It can be installed using:Source link
Tags
README
Installation
The latest version of the Data Prep Kit is available on PyPi for Python 3.10, 3.11, 3.12, and 3.13. It can be installed using:
pip install uv
uv pip install 'data-prep-toolkit-transforms[all]'
This will install all available transforms.
For guidance on creating the virtual environment for installing the data prep kit, click here.
🚀 Getting Started
License
All source files must include a Copyright and License header. If you would like to see the detailed LICENSE click here.
For agents
This page has a .md twin and JSON over the API.