easy-dataset

A powerful tool for creating fine-tuning datasets for Large Language Models

简体中文 | English | Türkçe

Features • Quick Start • Documentation • Contributing • License

If you like this project, please give it a Star⭐️, or buy the author a coffee => Donate ❤️!

Overview

Easy Dataset is an application specifically designed for building large language model (LLM) datasets. It features an intuitive interface, along with built-in powerful document parsing tools, intelligent segmentation algorithms, data cleaning and augmentation capabilities. The application can convert domain-specific documents in various formats into high-quality structured datasets, which are applicable to scenarios such as model fine-tuning, retrieval-augmented generation (RAG), and model performance evaluation.

News

🎉🎉 Easy Dataset Version 1.7.0 launches brand-new evaluation capabilities! You can effortlessly convert domain-specific documents into evaluation datasets (test sets) and automatically run multi-dimensional evaluation tasks. Additionally, it comes with a human blind test system, enabling you to easily meet needs such as vertical domain model evaluation, post-fine-tuning model performance assessment, and RAG recall rate evaluation. Tutorial: https://www.bilibili.com/video/BV1CRrVB7Eb4/

Features

📄 Document Processing & Data Generation

• Intelligent Document Processing: Supports PDF, Markdown, DOCX, TXT, EPUB and more formats with intelligent recognition
• Intelligent Text Splitting: Multiple splitting algorithms (Markdown structure, recursive separators, fixed length, code-aware chunking), with customizable visual segmentation
• Intelligent Question Generation: Auto-extract relevant questions from text segments, with question templates and batch generation
• Domain Label Tree: Intelligently builds global domain label trees based on document structure, with auto-tagging capabilities
• Answer Generation: Uses LLM API to generate comprehensive answers and Chain of Thought (COT), with AI optimization
• Data Cleaning: Intelligent text cleaning to remove noise and improve data quality

🔄 Multiple Dataset Types

• Single-Turn QA Datasets: Standard question-answer pairs for basic fine-tuning
• Multi-Turn Dialogue Datasets: Customizable roles and scenarios for conversational format
• Image QA Datasets: Generate visual QA data from images, with multiple import methods (directory, PDF, ZIP)
• Data Distillation: Generate label trees and questions directly from domain topics without uploading documents

📊 Model Evaluation System

• Evaluation Datasets: Generate true/false, single-choice, multiple-choice, short-answer, and open-ended questi