---
title: "Glossary: Corpus & data pipeline"
type: "glossary-category"
canonical_url: "https://www.graphcanon.com/glossary/corpus-and-data"
---

# Corpus & data pipeline

_The words for how GraphCanon collects, refreshes, and reasons over its data - starting with the one that probably sent you here._

Key concepts: Corpus, Ingest, Enrich, Freshness

## Backfill

A backfill retroactively fills in missing or newly added fields across records that already exist, rather than only handling new ones.

[Read more](/glossary/corpus-and-data/backfill.md)

## Corpus

A corpus is the full body of data a system works over. In GraphCanon it is every tool, repo, and piece of metadata currently in the graph.

[Read more](/glossary/corpus-and-data/corpus.md)

## Dataset

A dataset is a structured, published collection of records meant to be consumed as data - downloadable and machine-readable.

[Read more](/glossary/corpus-and-data/dataset.md)

## Enrich

Enrichment runs a language model over already-stored data to add or improve derived fields - summaries, tags, decision facts - without fetching from GitHub.

[Read more](/glossary/corpus-and-data/enrich.md)

## Freshness

Freshness is how recently a record was updated. Stale data is the opposite - old enough that it may no longer reflect reality.

[Read more](/glossary/corpus-and-data/freshness.md)

## GitHub sync

GitHub sync re-fetches a tool's public GitHub facts (stars, language, last push) without re-running the language model.

[Read more](/glossary/corpus-and-data/github-sync.md)

## Ingest

Ingesting is the first-time intake of a source into the system - fetching it, parsing it, and adding it to the corpus.

[Read more](/glossary/corpus-and-data/ingest.md)

## Metric snapshot

A metric snapshot is a single dated record of a tool's numbers (like stars and open issues), appended over time to build a history.

[Read more](/glossary/corpus-and-data/metric-snapshot.md)

[All glossary terms](/glossary.md)

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon`](/api/graphcanon)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_