GraphCanon updated Oct 3, 2026 · GitHub synced Oct 3, 2026
55views this month
Decision brief
Forward is an NVIDIA GPU-based high-performance deep learning inference library that converts popular framework models directly into TensorRT for optimized inference.
Good fit when
- When you need to quickly integrate TensorFlow, PyTorch, Keras, or ONNX models on NVIDIA GPUs for inference and require minimal conversion effort.
- For projects that benefit from the explicit support of advanced models like BERT, FaceSwap, and StyleTransfer within CV, NLP, and recommendation domains.
Avoid when
- If your project requires model serving or inference on CPU-only environments, as Forward is optimized for NVIDIA GPUs.
- For users who need extensive customization beyond the supported models (TensorFlow, PyTorch, Keras, ONNX) as expanding support necessitates additional engineering effort.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (1707d since push)
- As of Oct 3, 2026
- Provenance
- Not a fork · Organization account
- As of Oct 3, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/Tencent/ForwardSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Forward is a high-performance deep learning inference acceleration framework developed by Tencent to load models from popular frameworks such as TensorFlow, PyTorch, Keras, and ONNX directly into the TensorRT inference engine. It simplifies model conversion procedures and provides support for various data types (FLOAT/HALF/INT8). The library supports both C++ and Python interfaces.
Capability facts
- Languages
- c++
Source: github.language · Oct 3, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Oct 3, 2026)
- [Forward-Python 使用](#forward-python-使用)Source link
Tags
README
Forward 深度学习推理加速框架 Forward 深度学习推理加速框架 什么是 Forward 为什么选择 Forward 快速上手 Forward 环境依赖 项目构建 Forward Cpp 使用 Forward Python 使用 Forward Bert 使用 更多使用方法 Logging 日志 模型和算子支持 模型 算子 参考资料 贡献 许可证 [English Version] 什么是 Forward Forward 是一款腾讯研发的 GPU 高性能推理加速框架。它提出了一种解析方案，可直接加载主流框架模型（Tensorflow / PyT...
For agents
This page has a .md twin and JSON over the API.