{"data":{"slug":"opennmt-ctranslate2","name":"CTranslate2","tagline":"Fast inference engine for Transformer models","github_url":"https://github.com/OpenNMT/CTranslate2","owner":"OpenNMT","repo":"CTranslate2","owner_avatar_url":"https://avatars.githubusercontent.com/u/23035727?v=4","primary_language":"C++","stars":4566,"forks":498,"topics":["avx","avx2","cpp","cuda","deep-learning","deep-neural-networks","gemm","inference","intrinsics","machine-translation","mkl","neon","neural-machine-translation","onednn","openmp","opennmt","parallel-computing","quantization","thrust","transformer-models"],"archived":false,"github_pushed_at":"2026-07-03T12:39:06+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/opennmt-ctranslate2","markdown_url":"https://www.graphcanon.com/tools/opennmt-ctranslate2.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/opennmt-ctranslate2","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=opennmt-ctranslate2","description":"Fast inference engine for Transformer models","homepage_url":"https://opennmt.net/CTranslate2","license":"MIT","open_issues":271,"watchers":52,"ai_summary":"CTranslate2 is a high-performance inference engine for Transformer-based models, supporting machine translation and text generation tasks. It offers optimizations for various hardware configurations.","readme_excerpt":"## Installation and usage\n\nCTranslate2 can be installed with pip:\n\n```bash\npip install ctranslate2\n```\n\nThe Python module is used to convert models and can translate or generate text with few lines of code:\n\n```python\ntranslator = ctranslate2.Translator(translation_model_path)\ntranslator.translate_batch(tokens)\n\ngenerator = ctranslate2.Generator(generation_model_path)\ngenerator.generate_batch(start_tokens)\n```\n\nSee the [documentation](https://opennmt.net/CTranslate2) for more information and examples.\n\nIf you have an AMD ROCm GPU, we provide specific Python wheels on the [releases page](https://github.com/OpenNMT/CTranslate2/releases/).","github_created_at":"2019-09-23T08:10:42+00:00","created_at":"2026-07-11T23:10:35.121179+00:00","updated_at":"2026-07-12T06:40:40.09302+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"avx","name":"avx"},{"slug":"avx2","name":"avx2"},{"slug":"cpp","name":"cpp"},{"slug":"cuda","name":"cuda"},{"slug":"deep-learning","name":"deep-learning"},{"slug":"gemm","name":"gemm"},{"slug":"inference","name":"inference"},{"slug":"machine-translation","name":"machine-translation"}],"trust":{"provenance":{"is_fork":false,"github_id":210299376,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T23:10:41.439Z","maintenance":{"label":"Active","score":82,"methodology":"github_public_v1","releases_90d":3,"days_since_push":8,"last_release_at":"2026-07-03T12:39:56Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:10:41.926Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-12T02:58:46.073Z"},"languages":{"value":["c++"],"source":"github.language","observed_at":"2026-07-12T02:58:46.073Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-12T02:58:46.073Z"}}}}