GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
63views this month
Decision brief
Highly optimized transformer encoder and decoder for inferencing, supporting BERT and GPT on various frameworks like TensorFlow, PyTorch.
Good fit when
- When aiming for high performance with GPU-based FP16 computations for BERT or GPT models specifically.
- For integrating highly optimized API into TensorFlow, PyTorch, or Triton backend.
Avoid when
- If looking for active development and latest improvements on LLM Inference as NVIDIA recommends TensorRT-LLM over FasterTransformer now.
- When specific frameworks not including TensorFlow, PyTorch, or Triton are required.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (893d since push)
- As of Sep 7, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 7, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for Nvidia. Display-only - separate from trust and ranking.
- Company
- NVIDIA Corporation·GitHub org profile·Jul 11, 2026
- Employees
- 11,528·Wikidata (P1128 employees)·Jul 11, 2026
- Commercial model
- Pure OSS·GitHub org profile (public repos)·Jul 11, 2026
Install
git clone https://github.com/NVIDIA/FasterTransformerSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Repository for NVIDIA's FasterTransformer, focusing on highly optimized transformer-based encoder and decoder components for inference. Notably supports BERT and GPT models with integration options for TensorFlow, PyTorch, and Triton backend.
Capability facts
- Languages
- c++
Source: github.language · Sep 7, 2026
Categories
Graph entities
Tags
README
Note: FasterTransformer development has transitioned to TensorRT LLM. All developers are encouraged to leverage TensorRT LLM to get the latest improvements on LLM Inference. The NVIDIA/FasterTransformer repo will stay up, but will not have further development. FasterTransformer T...
For agents
This page has a .md twin and JSON over the API.