{"data":{"slug":"collabora-whisperlive","name":"WhisperLive","tagline":"A nearly-live implementation of OpenAI's Whisper.","github_url":"https://github.com/collabora/WhisperLive","owner":"collabora","repo":"WhisperLive","owner_avatar_url":"https://avatars.githubusercontent.com/u/4499761?v=4","primary_language":"Python","stars":4124,"forks":564,"topics":["dictation","obs","openai","openvino","openvino-intel","tensorrt","tensorrt-llm","text-to-speech","translation","voice-recognition","whisper","whisper-tensorrt"],"archived":false,"github_pushed_at":"2026-07-06T06:07:36+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/collabora-whisperlive","markdown_url":"https://www.graphcanon.com/tools/collabora-whisperlive.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/collabora-whisperlive","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=collabora-whisperlive","description":"A nearly-live implementation of OpenAI's Whisper.","homepage_url":null,"license":"MIT","open_issues":41,"watchers":41,"ai_summary":null,"readme_excerpt":"## Installation\n- Install PortAudio (required system dependency for microphone input via PyAudio)\n```bash\n bash scripts/setup.sh\n```\nOn Debian/Ubuntu this installs `portaudio19-dev`, on Fedora `portaudio-devel`, on macOS it uses Homebrew (`portaudio`).\n\n- Install 3.12 venv (on Fedora `sudo dnf install -y python3.12 python3.12-pip`)\n\n```bash\npython3.12 -m venv whisper_env\nsource whisper_env/bin/activate\n```\n\n- Install whisper-live from pip\n```bash\n pip install whisper-live\n```\n\n---\n\n## Getting Started\nThe server supports 3 backends `faster_whisper`, `tensorrt` and `openvino`. If running `tensorrt` backend follow [TensorRT_whisper readme](https://github.com/collabora/WhisperLive/blob/main/TensorRT_whisper.md)\n\n---\n\n## Whisper Live Server in Docker\n- GPU\n  - Faster-Whisper\n  ```bash\n  docker run -it --gpus all -p 9090:9090 ghcr.io/collabora/whisperlive-gpu:latest\n  ```\n\n  - TensorRT. Refer to [TensorRT_whisper readme](https://github.com/collabora/WhisperLive/blob/main/TensorRT_whisper.md) for setup and more tensorrt backend configurations.\n  ```bash\n  docker build . -f docker/Dockerfile.tensorrt -t whisperlive-tensorrt\n  docker run -p 9090:9090 --runtime=nvidia --gpus all --entrypoint /bin/bash -it whisperlive-tensorrt\n\n  # Build small.en engine\n  bash build_whisper_tensorrt.sh /app/TensorRT-LLM-examples small.en        # float16\n  bash build_whisper_tensorrt.sh /app/TensorRT-LLM-examples small.en int8   # int8 weight only quantization\n  bash build_whisper_tensorrt.sh /app/TensorRT-LLM-examples small.en int4   # int4 weight only quantization\n\n  # Run server with small.en (pick one engine)\n  python3 run_server.py --port 9090 \\\n                        --backend tensorrt \\\n                        --trt_model_path \"/app/TensorRT-LLM-examples/whisper/whisper_small_en_float16\"\n  # or int8 / int4:\n  # --trt_model_path \"/app/TensorRT-LLM-examples/whisper/whisper_small_en_int8\"\n  # --trt_model_path \"/app/TensorRT-LLM-examples/whisper/whisper_small_en_int4\"\n  ```\n\n  - OpenVINO\n  ```\n  docker run -it --device=/dev/dri -p 9090:9090 ghcr.io/collabora/whisperlive-openvino\n  ```\n\n- CPU\n  - Faster-whisper\n  ```bash\n  docker run -it -p 9090:9090 ghcr.io/collabora/whisperlive-cpu:latest\n  ```","github_created_at":"2023-05-04T16:36:09+00:00","created_at":"2026-07-11T12:07:15.75642+00:00","updated_at":"2026-07-11T12:07:21.104179+00:00","categories":[{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"dictation","name":"dictation"},{"slug":"openvino-intel","name":"openvino-intel"},{"slug":"tensorrt","name":"tensorrt"},{"slug":"text-to-speech","name":"text-to-speech"},{"slug":"openvino","name":"openvino"},{"slug":"tensorrt-llm","name":"tensorrt-llm"},{"slug":"openai","name":"openai"},{"slug":"obs","name":"obs"}],"trust":{"provenance":{"is_fork":false,"github_id":636344889,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T12:07:16.345Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":1,"days_since_push":5,"last_release_at":"2026-06-02T06:25:05Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T12:07:18.537Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T12:07:18.131Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-07-11T12:07:18.131Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-11T12:07:18.131Z"}}}}