Category
Corpus & data pipeline
The words for how GraphCanon collects, refreshes, and reasons over its data - starting with the one that probably sent you here.
- Corpus
- Ingest
- Enrich
- Freshness
8 terms
Backfill
A backfill retroactively fills in missing or newly added fields across records that already exist, rather than only handling new ones.
Corpus
A corpus is the full body of data a system works over. In GraphCanon it is every tool, repo, and piece of metadata currently in the graph.
Dataset
A dataset is a structured, published collection of records meant to be consumed as data - downloadable and machine-readable.
Enrich
Enrichment runs a language model over already-stored data to add or improve derived fields - summaries, tags, decision facts - without fetching from GitHub.
Freshness
Freshness is how recently a record was updated. Stale data is the opposite - old enough that it may no longer reflect reality.
GitHub sync
GitHub sync re-fetches a tool's public GitHub facts (stars, language, last push) without re-running the language model.
Ingest
Ingesting is the first-time intake of a source into the system - fetching it, parsing it, and adding it to the corpus.
Metric snapshot
A metric snapshot is a single dated record of a tool's numbers (like stars and open issues), appended over time to build a history.