{"data":{"slug":"thestageai-thewhisper","name":"TheWhisper","tagline":"Optimized Whisper models for streaming and on-device use","github_url":"https://github.com/TheStageAI/TheWhisper","owner":"TheStageAI","repo":"TheWhisper","owner_avatar_url":"https://avatars.githubusercontent.com/u/121886129?v=4","primary_language":"Python","stars":897,"forks":56,"topics":["apple-silicon","coreml","mlx","nvidia-gpu","on-device-ai","real-time","speech-recognition","speech-to-text","streaming","transcription","translation","voice","voice-ai"],"archived":false,"github_pushed_at":"2026-06-15T10:30:36+00:00","maintenance_label":"Slowing","stars_delta_30d":3,"url":"https://www.graphcanon.com/tools/thestageai-thewhisper","markdown_url":"https://www.graphcanon.com/tools/thestageai-thewhisper.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/thestageai-thewhisper","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=thestageai-thewhisper","description":"Optimized Whisper models for streaming and on-device use","homepage_url":"https://thestage.ai","license":"MIT","open_issues":1,"watchers":11,"ai_summary":"TheStageAI/TheWhisper repository provides optimized Whisper models tailored for speech recognition, transcription, and translation tasks. It supports various platforms including Apple Silicon and Nvidia GPUs with detailed setup instructions.","readme_excerpt":"### Install for Apple\n```bash\npip install .[apple]\n```\n\n---\n\n### Install for Nvidia\n```bash\npip install .[nvidia]\n```\n\n---\n\n### Install for Nvidia with TheStage AI optmized engines\n```bash\npip install 'thestage-elastic-models[nvidia]==0.1.7' --index-url https://thestage.jfrog.io/artifactory/api/pypi/pypi-thestage-ai-production/simple --extra-index-url https://pypi.nvidia.com --extra-index-url https://pypi.org/simple\npip install .[nvidia]\npip install thestage\n```\n\n---\n\n### Install for Jetson-Thor with TheStage AI optmized engines\n\nMake sure you have `tensorrt==10.13.3.9` installed on your jetson and run:\n\n```bash\npip install thestage-elastic-models[thor]==0.1.7 --extra-index-url https://thestage.jfrog.io/artifactory/api/pypi/pypi-thestage-ai-jetson-thor/simple -i https://pypi.jetson-ai-lab.io/sbsa/cu130/+simple/ --extra-index-url https://pypi.org\npip install .\npip install thestage\n```\n\n\nThen generate access token on [TheStage AI Platform](https://app.thestage.ai) in your profile and execute the following command:\n```bash\nthestage config set -t <YOUR_API_TOKEN>\n```\n-----\n\n---\n\n## 🏗️ Support Matrix and System Requirements\n\n| **Feature** | **whisper-large-v3 (Nvidia)** | **whisper-large-v3 (Apple)** | **whisper-large-v3-turbo (Nvidia)** | **whisper-large-v3-turbo (Apple)** |\n| --- | --- | --- | --- | --- |\n| Streaming | ✅ | ✅ | ✅ | ✅ |\n| Accelerated | ✅ | ✅ | ✅ | ✅ |\n| Word Timestamps | ✅ | ✅ | ✅ | ✅ |\n| Multilingual | ✅ | ✅ | ✅ | ✅ |\n| 10s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n| 15s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n| 20s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n| 30s Chunk Mode | ✅ | ✅ | ✅ | ✅ |\n\n---\n\n### Nvidia GPU Requirements\n\n- **Supported GPUs:** RTX 4090, RTX 5090, L40s, H100, A100, Jetson-Thor\n- **Operating System:** Ubuntu 20.04+\n- **Minimum RAM:** 2.5 GB (5 GB recommended for large-v3 model)\n- **CUDA Version:** 11.8 or higher\n- **Driver Version:** 520.0 or higher\n- **Python version**: 3.10-3.12\n\n---\n\n### Apple Silicon Requirements\n\n- **Supported Chipsets:** M1, M1 Pro, M1 Max, M1 Ultra, M2, M2 Pro, M2 Max, M2 Ultra, M3, M3 Pro, M3 Max, M4, M4 Pro, M4 Max\n- **Operating System:** macOS 15.0 (Ventura) or later, iOS 18.0 or later\n- **Minimum RAM:** 2 GB (4 GB recommended for large-v3 model)\n- **Python version**: 3.10-3.12\n\n---\n\n---\n\n## 🏢 Enterprise License Summary\n\nTo get commercial license for bigger number of GPUs to use TheStage AI optimized engines please contact us here: [Service request](https://app.thestage.ai/contact)\n\n| Platform                 | Engine Type               | Status     | License                                 |\n|--------------------------|---------------------------|------------|-----------------------------------------|\n| NVIDIA GPUs (CUDA)       | Pytorch HF Transformers | ✅ Stable  | Free                                    |\n| macOS / Apple Silicon    | CoreML Engine + MLX     | ✅ Stable  | Free                                    |\n| NVIDIA GPUs (CUDA)       | TheStage AI (Optimized) | ✅ Stable  | Free ≤ 4 GPUs/year for small orgs       |\n\n----","github_created_at":"2025-10-19T18:07:02+00:00","created_at":"2026-07-11T12:21:31.673076+00:00","updated_at":"2026-09-21T06:00:12.14189+00:00","categories":[{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[{"slug":"apple-silicon","name":"apple-silicon"},{"slug":"coreml","name":"coreml"},{"slug":"mlx","name":"mlx"},{"slug":"nvidia-gpu","name":"nvidia gpu"},{"slug":"on-device-ai","name":"on-device-ai"},{"slug":"real-time","name":"real-time"},{"slug":"speech-recognition","name":"speech recognition"},{"slug":"speech-to-text","name":"speech-to-text"}],"trust":{"provenance":{"is_fork":false,"github_id":1079394550,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-21T06:00:11.342Z","maintenance":{"label":"Slowing","score":36,"methodology":"github_public_v1","releases_90d":0,"days_since_push":97,"last_release_at":null,"stars_delta_30d":3,"open_issues_delta_30d":-1},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T12:21:33.646Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-21T06:00:11.846Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-09-21T06:00:11.846Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-09-21T06:00:11.846Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["Optimized for streaming speech recognition on platforms like Apple Silicon and Nvidia GPUs.","When you need specific real-time performance and word timestamps on supported hardware."],"when_not_to_use":["Avoid if your project requires compatibility with Intel CPUs as it's optimized for Apple and Nvidia.","Not suitable without a GPU or specific hardware that meets the 2.5 GB RAM minimum (Nvidia) or 2 GB (Apple)."],"source":"enrich:decision_facts","observed_at":"2026-07-12T11:49:54.925Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"TheWhisper optimizes Whisper models for streaming and on-device use, supporting various platforms like Apple Silicon, Nvidia GPUs, with real-time capabilities."}]}}