Home/Data & Retrieval/trafilatura

trafilatura

adbar/trafilatura

Python & Command-line tool for web crawling, scraping and text extraction

GraphCanon updated 2d · GitHub synced 2d · 31 views this month

6.7k stars415 forksLast push 5d Python Apache-2.0

Decision brief

Trafilatura is a Python & command-line tool designed for web crawling, scraping, and text extraction.

Good fit when

- When you need both a programming interface and a command line tool to gather texts from the Web.
- To extract clean text directly in formats like CSV, JSON, HTML, Markdown, TXT, XML without needing to preprocess further.

Avoid when

- If your primary requirement is for real-time data streaming or highly interactive scraping tasks, as trafilatura provides robust but not real-time capabilities.
- For deep web or javascript-heavy sites where dynamic content rendering is necessary; it's more suited for static site and metadata extraction.

Requirements:: Min 4 GB RAM; - Python environment installed on the system.; - Command line access required to use the command-line tool effectively.

Observed Jul 12, 2026 · Source: enrich:decision_facts

trafilatura alternatives Trust report

trafilatura vs Scrapegraph-ai trafilatura vs chatWeb trafilatura vs Scrapling

Verify the decision

Maintenance and security

Full trust report

Maintenance: Very active (3d since push); As of 2d
Provenance: Not a fork · Personal account; As of 2d
Security (OSV): No lockfile; As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install trafilatura

How it fits your stack(9)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Alternative

Both 'Scrapling' and 'trafilatura' provide tools for web scraping and text extraction, with different implementations and focus areas.

Both tools are designed for web data extraction, but Trafilatura focuses on text and metadata extraction using a more traditional approach, while Scrapegraph-AI leverages AI techniques.

Trafilatura and chatWeb both deal with web content extraction. However, chatWeb extends beyond simple extraction to include summarization and question-answering capabilities.

Integrates

Browser-Use automates tasks online with AI interaction; it could integrate with trafilatura for more automated web scraping and extraction processes.

Related

Turn any code or documentation into a queryable knowledge graph

Daytona and trafilatura both deal with running AI tasks but in different contexts; Daytona is for infrastructure to run AI-generated code, while trafilatura focuses on extracting data from the web.

Headroom compresses context for AI agents which could be related to how trafilatura extracts and cleans text content by removing noise from HTML documents.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Scrapling71k★

Scrapegraph-ai30k★

browser-use109k★

graphify108k★

Langchain-Chatchat39k★

langgraph38k★

AlternativeIntegratesRelated

Scrapling71k★

Scrapegraph-ai30k★

browser-use109k★

graphify108k★

Langchain-Chatchat39k★

langgraph38k★

AlternativeIntegratesRelated

Similar tools

Same-category neighbours not already linked as typed edges.

opendataloader-pdf

PDF Parser for AI-ready data

Convert documents to structured data effortlessly

Automation tool for converting documentation and code into Claude AI skills

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Provides functionalities for gathering text and metadata from the Web, including crawling, scraping, and various output formats.

Capability facts

CLI: CLI entrypoint
Source: pyproject.toml:[project.scripts] · Aug 18, 2026
Languages: python
Source: github.language+pyproject.toml · Aug 18, 2026

Categories

Data & Retrieval

Graph entities

AutoGenframework Semantic Kernelframework Smolagentsframework

Tags

article-extractor corpus-builder text-mining web-scraping

README

License

This package is distributed under the Apache 2.0 license.

Versions prior to v1.8.0 are under GPLv3+ license.

For agents

This page has a .md twin and JSON over the API.

/tools/adbar-trafilatura.md GET /api/graphcanon/tools/adbar-trafilatura GET /api/graphcanon/graph?tool=adbar-trafilatura

Was this helpful?

Anonymous feedback helps us improve pages and translations.