GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
56views this month
Decision brief
Builds real-time controllers using Wasm modules for directing LLM output securely and efficiently.
Good fit when
- When you need to implement secure, fast, and flexible real-time control over the output of large language models via WebAssembly modules.
- For projects where you want tight integration between custom control logic and the underlying LLM inference engine to process text generation dynamically.
Avoid when
- If your use case requires only constrained decoding without additional control logic, consider using LLGuidance library as a more specialized alternative.
- Avoid if you are looking for a less experimental solution, since AICI is noted as a prototype and may not fit production scenarios requiring stability.
- Pricing:
- freemium
- Requirements:
- Requires a compatible LLM inference engine such as llama.cpp, HuggingFace Transformers, or rLLM.
Observed Jul 14, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (605d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for Microsoft. Display-only - separate from trust and ranking.
- Company
- Microsoft·GitHub org profile·Jul 11, 2026
- Employees
- 221,000·Wikidata (P1128 employees)·Jul 11, 2026
- Commercial model
- Pure OSS·GitHub org profile (public repos)·Jul 11, 2026
Install
cargo add aici crates.ioHow it fits your stack(4)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Integrates
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
AICI enables the creation of real-time controllers that constrain and direct Large Language Model (LLM) output via WebAssembly modules running alongside the LLM inference engine.
Capability facts
- Languages
- rust
Source: github.language · Sep 20, 2026
Categories
Graph entities
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 20, 2026)
or be interpreted inside Wasm (Python, JavaScript, ...)Source link
Tags
README
Artificial Intelligence Controller Interface (AICI) LLGuidance library is an actively maintained evolution and specialization of AICI, recommended if all you want is constrained decoding. The Artificial Intelligence Controller Interface (AICI) lets you build Controllers that cons...
For agents
This page has a .md twin and JSON over the API.