{"data":{"slug":"optimalscale-lmflow","name":"LMFlow","tagline":"An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.","github_url":"https://github.com/OptimalScale/LMFlow","owner":"OptimalScale","repo":"LMFlow","owner_avatar_url":"https://avatars.githubusercontent.com/u/128913633?v=4","primary_language":"Python","stars":8483,"forks":828,"topics":["chatgpt","deep-learning","instruction-following","language-model","pretrained-models","pytorch","transformer"],"archived":false,"github_pushed_at":"2026-05-22T02:57:26+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/optimalscale-lmflow","markdown_url":"https://www.graphcanon.com/tools/optimalscale-lmflow.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/optimalscale-lmflow","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=optimalscale-lmflow","description":"An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.","homepage_url":"https://optimalscale.github.io/LMFlow/","license":"Apache-2.0","open_issues":87,"watchers":65,"ai_summary":null,"readme_excerpt":"### Deployment\n\nIf you want to deploy your own model locally, we provide a gradio-based UI for building chatbots. \nRunning the following command will launch the demo for robin-7b:\n\n```sh\npip install gradio\npython ./examples/chatbot_gradio.py --deepspeed configs/ds_config_chatbot.json --model_name_or_path YOUR-LLAMA  --lora_model_path ./robin-7b --prompt_structure \"A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.###Human: {input_text}###Assistant:\"       --end_string \"#\" --max_new_tokens 200\n```\n\n---\n\n## License\n\nThe code included in this project is licensed under the [Apache 2.0 license](https://github.com/OptimalScale/LMFlow/blob/main/LICENSE).\nIf you wish to use the codes and models included in this project for commercial purposes, please sign this [document](https://docs.google.com/forms/d/e/1FAIpQLSfJYcci6cbgpIvx_Fh1xDL6pNkzsjGDH1QIcm4cYk88K2tqkw/viewform?usp=pp_url) to obtain authorization.","github_created_at":"2023-03-27T13:56:29+00:00","created_at":"2026-07-11T23:22:08.46499+00:00","updated_at":"2026-07-11T23:22:24.430749+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"chatgpt","name":"chatgpt"},{"slug":"deep-learning","name":"deep-learning"},{"slug":"instruction-following","name":"instruction-following"},{"slug":"language-model","name":"language-model"},{"slug":"pretrained-models","name":"pretrained models"},{"slug":"python","name":"python"},{"slug":"pytorch","name":"pytorch"},{"slug":"transformer","name":"transformer"}],"trust":{"provenance":{"is_fork":false,"github_id":619825247,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T23:22:09.993Z","maintenance":{"label":"Steady","score":60,"methodology":"github_public_v1","releases_90d":0,"days_since_push":50,"last_release_at":"2025-07-11T02:03:22Z"},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":74,"high_count":0,"last_scan_at":"2026-07-11T23:22:10.499Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T23:22:09.712Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-07-11T23:22:09.712Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-07-11T23:22:09.712Z"}}}}