{"data":{"slug":"thestageai-thewhisper","name":"TheWhisper","tagline":"Optimized Whisper models for streaming and on-device use","github_url":"https://github.com/TheStageAI/TheWhisper","owner":"TheStageAI","repo":"TheWhisper","owner_avatar_url":"https://avatars.githubusercontent.com/u/121886129?v=4","primary_language":"Python","stars":890,"forks":56,"topics":["apple-silicon","coreml","mlx","nvidia-gpu","on-device-ai","real-time","speech-recognition","speech-to-text","streaming","transcription","translation","voice","voice-ai"],"archived":false,"github_pushed_at":"2026-06-15T10:30:36+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/thestageai-thewhisper","markdown_url":"https://www.graphcanon.com/tools/thestageai-thewhisper.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/thestageai-thewhisper","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=thestageai-thewhisper","description":"Optimized Whisper models for streaming and on-device use","homepage_url":"https://thestage.ai","license":"MIT","open_issues":2,"watchers":11,"ai_summary":null,"readme_excerpt":"### Install for Apple\n```bash\npip install .[apple]\n```\n\n---\n\n### Install for Nvidia\n```bash\npip install .[nvidia]\n```\n\n---\n\n### Install for Nvidia with TheStage AI optmized engines\n```bash\npip install 'thestage-elastic-models[nvidia]==0.1.7' --index-url https://thestage.jfrog.io/artifactory/api/pypi/pypi-thestage-ai-production/simple --extra-index-url https://pypi.nvidia.com --extra-index-url https://pypi.org/simple\npip install .[nvidia]\npip install thestage\n```\n\n---\n\n### Install for Jetson-Thor with TheStage AI optmized engines\n\nMake sure you have `tensorrt==10.13.3.9` installed on your jetson and run:\n\n```bash\npip install thestage-elastic-models[thor]==0.1.7 --extra-index-url https://thestage.jfrog.io/artifactory/api/pypi/pypi-thestage-ai-jetson-thor/simple -i https://pypi.jetson-ai-lab.io/sbsa/cu130/+simple/ --extra-index-url https://pypi.org\npip install .\npip install thestage\n```\n\n\nThen generate access token on [TheStage AI Platform](https://app.thestage.ai) in your profile and execute the following command:\n```bash\nthestage config set -t <YOUR_API_TOKEN>\n```\n-----\n\n---\n\n## 🏗️ Support Matrix and System Requirements\n\n| **Feature** | **whisper-large-v3 (Nvidia)** | **whisper-large-v3 (Apple)** | **whisper-large-v3-turbo (Nvidia)** | **whisper-large-v3-turbo (Apple)** |\n| --- | --- | --- | --- | --- |\n| Streaming | ✅ | ✅ | ✅ | ✅ |\n| Accelerated | ✅ | ✅ | ✅ | ✅ |\n| Word Timestamps | ✅ | ✅ | ✅ | ✅ |\n| Multilingual | ✅ | ✅ | ✅ | ✅ |\n| 10s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n| 15s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n| 20s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n| 30s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n\n---\n\n### Nvidia GPU Requirements\n\n- **Supported GPUs:** RTX 4090, RTX 5090, L40s, H100, A100, Jetson-Thor\n- **Operating System:** Ubuntu 20.04+\n- **Minimum RAM:** 2.5 GB (5 GB recommended for large-v3 model)\n- **CUDA Version:** 11.8 or higher\n- **Driver Version:** 520.0 or higher\n- **Python version**: 3.10-3.12\n\n---\n\n### Apple Silicon Requirements\n\n- **Supported Chipsets:** M1, M1 Pro, M1 Max, M1 Ultra, M2, M2 Pro, M2 Max, M2 Ultra, M3, M3 Pro, M3 Max, M4, M4 Pro, M4 Max\n- **Operating System:** macOS 15.0 (Ventura) or later, iOS 18.0 or later\n- **Minimum RAM:** 2 GB (4 GB recommended for large-v3 model)\n- **Python version**: 3.10-3.12\n\n---\n\n---\n\n## 🏢 Enterprise License Summary\n\nTo get commercial license for bigger number of GPUs to use TheStage AI optimized engines please contact us here: [Service request](https://app.thestage.ai/contact)\n\n| Platform                 | Engine Type               | Status     | License                                 |\n|--------------------------|---------------------------|------------|-----------------------------------------|\n| NVIDIA GPUs (CUDA)       | Pytorch HF Transformers | ✅ Stable  | Free                                    |\n| macOS / Apple Silicon    | CoreML Engine + MLX     | ✅ Stable  | Free                                    |\n| NVIDIA GPUs (CUDA)       | TheStage AI (Optimized) | ✅ Stable  | Free ≤ 4 GPUs/year for small orgs       |\n\n----","github_created_at":"2025-10-19T18:07:02+00:00","created_at":"2026-07-11T12:21:31.673076+00:00","updated_at":"2026-07-11T22:28:04.022713+00:00","categories":[{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[{"slug":"real-time","name":"real-time"},{"slug":"speech-to-text","name":"speech-to-text"},{"slug":"on-device-ai","name":"on-device-ai"},{"slug":"mlx","name":"mlx"},{"slug":"speech-recognition","name":"speech-recognition"},{"slug":"coreml","name":"coreml"},{"slug":"apple-silicon","name":"apple-silicon"},{"slug":"nvidia-gpu","name":"nvidia gpu"}],"trust":{"provenance":{"is_fork":false,"github_id":1079394550,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T12:21:32.506Z","maintenance":{"label":"Active","score":82,"methodology":"github_public_v1","releases_90d":0,"days_since_push":26,"last_release_at":null},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T12:21:33.646Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T22:28:03.946Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-07-11T22:28:03.946Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-11T22:28:03.946Z"}}}}