{"data":{"slug":"fauxpilot-fauxpilot","name":"fauxpilot","tagline":"An open-source alternative to GitHub Copilot server","github_url":"https://github.com/fauxpilot/fauxpilot","owner":"fauxpilot","repo":"fauxpilot","owner_avatar_url":"https://avatars.githubusercontent.com/u/120729571?v=4","primary_language":"Python","stars":14713,"forks":641,"topics":[],"archived":false,"github_pushed_at":"2024-04-09T08:42:23+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/fauxpilot-fauxpilot","markdown_url":"https://www.graphcanon.com/tools/fauxpilot-fauxpilot.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/fauxpilot-fauxpilot","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=fauxpilot-fauxpilot","description":"FauxPilot - an open-source alternative to GitHub Copilot server","homepage_url":null,"license":"MIT","open_issues":63,"watchers":118,"ai_summary":"FauxPilot is an open-source project that serves as an alternative to GitHub Copilot by leveraging NVIDIA's Triton Inference Server with the FasterTransformer backend for serving SalesForce CodeGen models locally.","readme_excerpt":"# FauxPilot\n\nThis is an attempt to build a locally hosted alternative to [GitHub Copilot](https://copilot.github.com/). It uses the [SalesForce CodeGen](https://github.com/salesforce/CodeGen) models inside of NVIDIA's [Triton Inference Server](https://developer.nvidia.com/nvidia-triton-inference-server) with the [FasterTransformer backend](https://github.com/triton-inference-server/fastertransformer_backend/).\n\n

\n \n

\n\n## Prerequisites\n\nYou'll need:\n\n* Docker\n* `docker compose` >= 1.28\n* An NVIDIA GPU with Compute Capability >= 6.0 and enough VRAM to run the model you want.\n* [`nvidia-docker`](https://github.com/NVIDIA/nvidia-docker)\n* `curl` and `zstd` for downloading and unpacking the models.\n\nNote that the VRAM requirements listed by `setup.sh` are *total* -- if you have multiple GPUs, you can split the model across them. So, if you have two NVIDIA RTX 3080 GPUs, you *should* be able to run the 6B model by putting half on each GPU.\n\n\n## Support and Warranty\n\nlmao\n\nOkay, fine, we now have some minimal information on [the wiki](https://github.com/moyix/fauxpilot/wiki) and a [discussion forum](https://github.com/moyix/fauxpilot/discussions) where you can ask questions. Still no formal support or warranty though!\n\n\n\n## Setup\n\nThis section describes how to install a Fauxpilot server and clients.\n\n### Setting up a FauxPilot Server\n\nRun the setup script to choose a model to use. This will download the model from [Huggingface/Moyix](https://huggingface.co/Moyix) in GPT-J format and then convert it for use with FasterTransformer.\n\nPlease refer to [How to set-up a FauxPilot server](documentation/server.md).\n\n\n### Client configuration for FauxPilot\n\nWe offer some ways to connect to FauxPilot Server. For example, you can create a client by how to open the Openai API, Copilot Plugin, REST API.\n\nPlease refer to [How to set-up a client](documentation/client.md).\n\n\n## Terminology\n * API: Application Programming Interface\n * CC: Compute Capability\n * CUDA: Compute Unified Device Architecture\n * FT: Faster Transformer\n * JSON: JavaScript Object Notation \n * gRPC: Remote Procedure call by Google\n * GPT-J: A transformer model trained using Ben Wang's Mesh Transformer JAX \n * REST: REpresentational State Transfer","github_created_at":"2022-08-03T02:14:22+00:00","created_at":"2026-07-11T23:20:24.4249+00:00","updated_at":"2026-08-02T18:01:25.635633+00:00","categories":[{"slug":"developer-tools","name":"Developer Tools","url":"https://www.graphcanon.com/categories/developer-tools","markdown_url":"https://www.graphcanon.com/categories/developer-tools.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/developer-tools"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"code-generation","name":"code generation"},{"slug":"fastertransformer","name":"fastertransformer"},{"slug":"github-copilot-alternative","name":"github copilot alternative"},{"slug":"nvidia-triton-inference-server","name":"nvidia triton inference server"},{"slug":"salesforce-codegen-models","name":"salesforce codegen models"}],"trust":{"provenance":{"is_fork":false,"github_id":520708737,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-02T18:01:24.891Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":845,"last_release_at":null},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:20:30.826Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-02T18:01:25.356Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-08-02T18:01:25.356Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-08-02T18:01:25.356Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium","summary":"FauxPilot is free to use under the MIT License. However, users will need to cover costs associated with running it on local hardware, including setting up Docker and having an NVIDIA GPU."},"requirements":{"notes":["Requires docker, docker-compose version >=1.28, an NVIDIA GPU with Compute Capability >=6.0 and sufficient VRAM for the selected model.","Users need to have `curl` and `zstd` installed on their systems for downloading models."],"min_ram_gb":null},"constraints":{"min_ram_gb":null,"pricing_model":"freemium"},"when_to_use":["You have access to a powerful GPU that meets or exceeds the required Compute Capability and VRAM for running the chosen model.","You prefer open-source solutions over proprietary ones, such as GitHub Copilot.","Your use-case benefits from having inference servers hosted on-premises rather than relying on cloud-based APIs."],"when_not_to_use":["If you lack the necessary hardware with the requisite GPU compute capability and VRAM to support running FauxPilot.","For users who do not have experience setting up Docker containers, NVIDIA's Triton Inference Server, or FasterTransformer backend as these are required for operation.","When formal support and warranty services are a requirement, given that FauxPilot offers no such guarantees."],"source":"enrich:decision_facts","observed_at":"2026-07-17T12:18:04.181Z"},"constraint_facets":{"min_ram_gb":null,"pricing_model":"freemium"},"decision_summary":[{"label":"Pricing","value":"freemium - FauxPilot is free to use under the MIT License. However, users will need to cover costs associated with running it on local hardware, including setting up Docker and having an NVIDIA GPU."},{"label":"Requirements","value":"Requires docker, docker-compose version >=1.28, an NVIDIA GPU with Compute Capability >=6.0 and sufficient VRAM for the selected model.; Users need to have `curl` and `zstd` installed on their systems for downloading models."},{"label":"Adopt for","value":"FauxPilot is an open-source alternative to GitHub Copilot, which uses NVIDIA's Triton Inference Server with the FasterTransformer backend to serve SalesForce CodeGen models locally."}]}}