aici logo

aici

microsoft/aici

Builds Controllers for Constrained LLM Output in Real-time Using Wasm

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

56views this month

2.1k stars86 forksLast push Jan 22, 2025 Rust MIT

Decision brief

Builds real-time controllers using Wasm modules for directing LLM output securely and efficiently.

Good fit when

  • When you need to implement secure, fast, and flexible real-time control over the output of large language models via WebAssembly modules.
  • For projects where you want tight integration between custom control logic and the underlying LLM inference engine to process text generation dynamically.

Avoid when

  • If your use case requires only constrained decoding without additional control logic, consider using LLGuidance library as a more specialized alternative.
  • Avoid if you are looking for a less experimental solution, since AICI is noted as a prototype and may not fit production scenarios requiring stability.
Pricing:
freemium
Requirements:
Requires a compatible LLM inference engine such as llama.cpp, HuggingFace Transformers, or rLLM.

Observed Jul 14, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (605d since push)
As of Sep 20, 2026
Provenance
Not a fork · Organization account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Backing

Company context for Microsoft. Display-only - separate from trust and ranking.

Company
Microsoft·GitHub org profile·Jul 11, 2026
Employees
221,000·Wikidata (P1128 employees)·Jul 11, 2026
Commercial model
Pure OSS·GitHub org profile (public repos)·Jul 11, 2026

Install

cargo add aici
crates.io

How it fits your stack(4)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

AICI enables the creation of real-time controllers that constrain and direct Large Language Model (LLM) output via WebAssembly modules running alongside the LLM inference engine.

Capability facts

Languages
rust

Source: github.language · Sep 20, 2026

Categories

Graph entities

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 20, 2026)

or be interpreted inside Wasm (Python, JavaScript, ...)
Source link

Tags

README

Artificial Intelligence Controller Interface (AICI) LLGuidance library is an actively maintained evolution and specialization of AICI, recommended if all you want is constrained decoding. The Artificial Intelligence Controller Interface (AICI) lets you build Controllers that cons...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.