GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
47views this month
Decision brief
SwiftInfer specializes in efficient inference and serving of deep-learning models including GPT, LLaMA, and LLaMA2.
Good fit when
- When you need to efficiently serve models from popular frameworks like GPT, LLaMA, or LLaMA2 within a Python environment.
- If your project benefits from an open-source solution licensed under Apache-2.0.
Avoid when
- Avoid if your primary model framework is not supported by SwiftInfer, such as TensorFlow or other non-listed frameworks.
- Do not use if you require a language other than Python for inference serving.
Observed Jul 15, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (985d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install SwiftInferSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
A Python-based repository for efficient inference and serving of artificial intelligence models, specializing in deep-learning frameworks including GPT, LLaMA, and LLaMA2.
Capability facts
- Languages
- python
Source: github.language · Sep 20, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Tags
README
🛠 Installation We use the API in TensorRT LLM to construct the model and run inference. As the API of TensorRT LLM is not stable and changing rapidly, we bind our implementation with the commit whose version is . We may upgrade this repository as TensorRT LLM's APIs become more...
For agents
This page has a .md twin and JSON over the API.