Home/Inference & Serving/CTranslate2

CTranslate2

OpenNMT/CTranslate2

Fast inference engine for Transformer models

GitHub Website

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

42views this month

4.7k stars534 forksLast push Aug 31, 2026 C++ MIT

Decision brief

CTranslate2 is a fast inference engine for Transformer models, optimized for various hardware accelerations and written in C++.

Good fit when

When you need fast inference for Transformer models with support for hardware accelerations like AVX, AVX2, CUDA, and ROCm.
If your project requires C++ integration and you are looking for a lightweight, high-performance inference engine.

Avoid when

If your hardware does not support the specific accelerations CTranslate2 offers, such as AVX, AVX2, CUDA, or ROCm.
When you prefer a tool that is not written in C++ and does not require a C++ runtime environment.

Requirements:: Min 2 GB RAM; CTranslate2 can be installed via pip, and specific Python wheels are available for AMD ROCm GPUs.

Observed Sep 18, 2026 · Source: enrich:decision_facts

CTranslate2 alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Active (17d since push); As of Sep 18, 2026
Provenance: Not a fork · Organization account; As of Sep 18, 2026
Security (OSV): No lockfile; As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

git clone https://github.com/OpenNMT/CTranslate2

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

transformers

🤗 Transformers: state-of-the-art machine learning models for text, vision, audio, and multimodal models

166k★

llama.cpp

LLM inference in C/C++

129k★

whisper.cpp

C++ port of OpenAI's Whisper model for speech-to-text

54k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

CTranslate2 is a fast inference engine for Transformer models, written in C++, supporting various hardware accelerations and optimizations.

Capability facts

Languages: c++
Source: github.language · Sep 18, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 18, 2026)

The Python module is used to convert models and can translate or generate text with few lin

Source link

README

Installation and usage CTranslate2 can be installed with pip: The Python module is used to convert models and can translate or generate text with few lines of code: See the documentation for more information and examples. If you have an AMD ROCm GPU, we provide specific Python wh...

For agents

This page has a .md twin and JSON over the API.

/tools/opennmt-ctranslate2.md GET /api/graphcanon/tools/opennmt-ctranslate2 GET /api/graphcanon/graph?tool=opennmt-ctranslate2