{"data":{"slug":"r3gm-sonitranslate","name":"SoniTranslate","tagline":"Synchronized Translation for Videos. Video dubbing","github_url":"https://github.com/R3gm/SoniTranslate","owner":"R3gm","repo":"SoniTranslate","owner_avatar_url":"https://avatars.githubusercontent.com/u/114810545?v=4","primary_language":"Python","stars":1399,"forks":335,"topics":["asr","audio-processing","automatic-dubbing","diarization","document-translator","dubbing","speech-to-text","stt","subtitle-to-speech","text-to-speech","translate-audio","translate-video","translation","tts","video-dubbing"],"archived":false,"github_pushed_at":"2026-04-27T21:47:11+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/r3gm-sonitranslate","markdown_url":"https://www.graphcanon.com/tools/r3gm-sonitranslate.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/r3gm-sonitranslate","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=r3gm-sonitranslate","description":"Synchronized Translation for Videos. Video dubbing","homepage_url":null,"license":"Apache-2.0","open_issues":118,"watchers":25,"ai_summary":"Python-based repository providing functionalities for synchronized translation of videos including video dubbing, speech-to-text translation, and text-to-speech integration.","readme_excerpt":"## Install Locally (Installation tested in Linux)\n\n---\n\n### Getting Started\n\nTo install SoniTranslate, follow these steps:\n\n1. Create a suitable anaconda environment for SoniTranslate and activate it:\n\n```\nconda create -n sonitr python=3.10 -y\nconda activate sonitr\npython -m pip install pip==23.1.2 Setuptools==80.6.0\nconda install pytorch==2.5.1 torchvision==0.20.1 torchaudio==2.5.1 pytorch-cuda=11.8 -c pytorch -c nvidia\n```\n\n2. Clone this github repository and navigate to it:\n```\ngit clone https://github.com/r3gm/SoniTranslate.git\ncd SoniTranslate\n```\n\n3. Install required packages:\n\n```\npip install -r requirements_base.txt -v\npip install -r requirements_extra.txt -v\npip install onnxruntime-gpu\n```\n\n4. Install [ffmpeg](https://ffmpeg.org/download.html). FFmpeg is a free software project that produces libraries and programs for handling multimedia data. You will need it to process audio and video files. You can install ffmpeg with Anaconda by running `conda install -y ffmpeg` in your terminal (recommended). If you have trouble installing ffmpeg via Anaconda, you can use the following link instead: (https://ffmpeg.org/ffmpeg.html). Once it is installed, make sure it is in your PATH by running `ffmpeg -h` in your terminal. If you don't get an error message, you're good to go.\n\n5. Optional install:\n\nAfter installing FFmpeg, you can install these optional packages.\n\n\n[Piper TTS](https://github.com/rhasspy/piper) is a fast, local neural text to speech system that sounds great and is optimized for the Raspberry Pi 4. Piper is used in a variety of projects. Voices are trained with VITS and exported to the onnxruntime.\n\n```\npip install -q piper-tts==1.2.0\n```\n\n[Coqui XTTS](https://github.com/coqui-ai/TTS) is a text-to-speech (TTS) model that lets you generate realistic voices in different languages. It can clone voices with just a short audio clip, even speak in a different language! It's like having a personal voice mimic for any text you need spoken.\n\n```\npip install -q -r requirements_xtts.txt\npip install -q TTS==0.21.1  --no-deps\n```\n\n---\n\n## License\nAlthough the code is licensed under Apache 2, the models or weights may have commercial restrictions, as seen with pyannote diarization.","github_created_at":"2023-06-27T22:32:23+00:00","created_at":"2026-07-11T12:11:46.135506+00:00","updated_at":"2026-07-30T00:00:42.733701+00:00","categories":[{"slug":"data-retrieval","name":"Data & Retrieval","url":"https://www.graphcanon.com/categories/data-retrieval","markdown_url":"https://www.graphcanon.com/categories/data-retrieval.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/data-retrieval"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[{"slug":"asr","name":"asr"},{"slug":"audio-processing","name":"audio-processing"},{"slug":"automatic-dubbing","name":"automatic-dubbing"},{"slug":"diarization","name":"diarization"},{"slug":"speech-to-text","name":"speech-to-text"},{"slug":"text-to-speech","name":"text-to-speech"},{"slug":"translation","name":"translation"},{"slug":"video-dubbing","name":"video-dubbing"}],"trust":{"provenance":{"is_fork":false,"github_id":659463960,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-30T00:00:41.779Z","maintenance":{"label":"Slowing","score":36,"methodology":"github_public_v1","releases_90d":0,"days_since_push":93,"last_release_at":"2024-05-18T13:56:03Z"},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":87,"high_count":0,"last_scan_at":"2026-07-11T12:11:54.715Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-30T00:00:42.261Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-07-30T00:00:42.261Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-07-30T00:00:42.261Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["When working with Linux environments due to tested installation.","For creating localized versions of videos without internet dependency since it offers local TTS models like Piper TTS and Coqui XTTS."],"when_not_to_use":["If your development environment differs significantly from the tested setup in Linux, you might face compatibility issues.","When strict model license constraints are a concern for your project given some bundled models have commercial restrictions."],"source":"enrich:decision_facts","observed_at":"2026-07-16T21:13:59.607Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"SoniTranslate is an open-source synchronized video translation tool that supports speech-to-text and text-to-speech functions for localized video dubbing."}]}}