TheWhisper
Enrichment pendingOptimized Whisper models for streaming and on-device use
GraphCanon updated today · GitHub synced today
890
Stars
56
Forks
2
Open issues
11
Watchers
3w
Last push
Python MITCreated Oct 19, 2025
Trust & integrity
Full report- Maintenance
- Active (26d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Organization account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Overview
Optimized Whisper models for streaming and on-device use
Capability facts
- Languages
- python
Source: github.language+pyproject.toml · Jul 11, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Python runtimePython
Source: README excerpt (regex_v1, Jul 11, 2026)
- **Python version**: 3.10-3.12Source link
Tags
README
Install for Apple
pip install .[apple]
Install for Nvidia
pip install .[nvidia]
Install for Nvidia with TheStage AI optmized engines
pip install 'thestage-elastic-models[nvidia]==0.1.7' --index-url https://thestage.jfrog.io/artifactory/api/pypi/pypi-thestage-ai-production/simple --extra-index-url https://pypi.nvidia.com --extra-index-url https://pypi.org/simple
pip install .[nvidia]
pip install thestage
Install for Jetson-Thor with TheStage AI optmized engines
Make sure you have tensorrt==10.13.3.9 installed on your jetson and run:
pip install thestage-elastic-models[thor]==0.1.7 --extra-index-url https://thestage.jfrog.io/artifactory/api/pypi/pypi-thestage-ai-jetson-thor/simple -i https://pypi.jetson-ai-lab.io/sbsa/cu130/+simple/ --extra-index-url https://pypi.org
pip install .
pip install thestage
Then generate access token on TheStage AI Platform in your profile and execute the following command:
thestage config set -t <YOUR_API_TOKEN>
🏗️ Support Matrix and System Requirements
| Feature | whisper-large-v3 (Nvidia) | whisper-large-v3 (Apple) | whisper-large-v3-turbo (Nvidia) | whisper-large-v3-turbo (Apple) |
|---|---|---|---|---|
| Streaming | ✅ | ✅ | ✅ | ✅ |
| Accelerated | ✅ | ✅ | ✅ | ✅ |
| Word Timestamps | ✅ | ✅ | ✅ | ✅ |
| Multilingual | ✅ | ✅ | ✅ | ✅ |
| 10s Chunk Mode | ✅ | ✅ | ✅ | ✅ |
| 15s Chunk Mode | ✅ | ✅ | ✅ | ✅ |
| 20s Chunk Mode | ✅ | ✅ | ✅ | ✅ |
| 30s Chunk Mode | ✅ | ✅ | ✅ | ✅ |
Nvidia GPU Requirements
- Supported GPUs: RTX 4090, RTX 5090, L40s, H100, A100, Jetson-Thor
- Operating System: Ubuntu 20.04+
- Minimum RAM: 2.5 GB (5 GB recommended for large-v3 model)
- CUDA Version: 11.8 or higher
- Driver Version: 520.0 or higher
- Python version: 3.10-3.12
Apple Silicon Requirements
- Supported Chipsets: M1, M1 Pro, M1 Max, M1 Ultra, M2, M2 Pro, M2 Max, M2 Ultra, M3, M3 Pro, M3 Max, M4, M4 Pro, M4 Max
- Operating System: macOS 15.0 (Ventura) or later, iOS 18.0 or later
- Minimum RAM: 2 GB (4 GB recommended for large-v3 model)
- Python version: 3.10-3.12
🏢 Enterprise License Summary
To get commercial license for bigger number of GPUs to use TheStage AI optimized engines please contact us here: Service request
| Platform | Engine Type | Status | License |
|---|---|---|---|
| NVIDIA GPUs (CUDA) | Pytorch HF Transformers | ✅ Stable | Free |
| macOS / Apple Silicon | CoreML Engine + MLX | ✅ Stable | Free |
| NVIDIA GPUs (CUDA) | TheStage AI (Optimized) | ✅ Stable | Free ≤ 4 GPUs/year for small orgs |