{"data":{"slug":"avarok-cybersecurity-atlas","name":"atlas","tagline":"Pure Rust Inference Engine","github_url":"https://github.com/Avarok-Cybersecurity/atlas","owner":"Avarok-Cybersecurity","repo":"atlas","owner_avatar_url":"https://avatars.githubusercontent.com/u/96390941?v=4","primary_language":"Rust","stars":667,"forks":102,"topics":["cuda","dgx","dgx-spark","gb10","llm-inference","mamba","nvfp4","openai-api","rust","speculative-decoding","ssm","transformers"],"archived":false,"github_pushed_at":"2026-08-25T05:50:51+00:00","maintenance_label":"Very active","stars_delta_30d":57,"url":"https://www.graphcanon.com/tools/avarok-cybersecurity-atlas","markdown_url":"https://www.graphcanon.com/tools/avarok-cybersecurity-atlas.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/avarok-cybersecurity-atlas","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=avarok-cybersecurity-atlas","description":"Pure Rust Inference Engine","homepage_url":"https://atlasinference.io","license":"AGPL-3.0","open_issues":161,"watchers":6,"ai_summary":"Avarok-Cybersecurity/atlas is a inference engine written in Rust, focused on providing efficient and scalable model deployment.","readme_excerpt":"## 🚀 Quick Start\n\nThe whole supported model matrix lives in one Docker image. Pull it, mount your HuggingFace cache, point Atlas at any model ID from the [model table](#models).\n\n> **Defaults below are tuned for maximum accuracy under agentic-coding workloads** — 64K context window, BF16 MTP draft head (highest acceptance rate ⇒ highest end-to-end throughput), prefix caching for multi-turn tool loops, and FP8 KV cache with `auto`-promoted boundary layers. These are the recipes we use to drive opencode / Claude Code / Cline through Atlas on a single Spark.\n\n---\n\n## 🔌 Adding a New Hardware Target\n\nThe full recipe is in [`docs/HARDWARE.md`](docs/HARDWARE.md#adding-a-new-hardware-target). The short version: implement two traits (`ComputeTarget` for the build-time compiler, `GpuBackend` for the runtime), drop kernel sources into `kernels/<your-hw>/`, add one match arm in the registry. There is a `MockGpuBackend` in `spark-runtime` that lets you write and test the entire scaffold without owning the hardware — every layer above the GPU trait is hardware-agnostic, so unit tests can run on a laptop. We bolted the project from \"single CUDA target\" to \"trait-pluggable across vendors\" specifically so that the AMD, Apple, and Intel ports stop being our problem and start being yours.\n\n<a id=\"new-model\"></a>\n\n---\n\n## ⚖️ License and Enterprise Edition\n\nAtlas operates under a **dual-license** model. Both are real, both are intentional, and neither is a teaser for the other.\n\n1. **[Community Edition](LICENSE) — AGPLv3.** Free, open, copyleft. Use it for yourself to run inference on your own hardware, research, hobby projects, side-projects, and/or hosted demos, as examples. If you want to make money from Atlas, purchase a commercial license.\n2. **Enterprise Edition — commercial license.** If you need to ship Atlas inside a closed-source product, run it as a SaaS backend without inheriting the AGPLv3 source-disclosure obligation, or simply want a support relationship with the people who wrote the kernels, contact sales. Enterprise customers also receive prioritized model and hardware ports.\n\nThis split exists for a single reason: a permissive license keeps us building Atlas full-time, and the AGPL community license keeps the project honest. What is in this repository is what we run.","github_created_at":"2026-05-05T16:59:33+00:00","created_at":"2026-07-11T11:44:57.421508+00:00","updated_at":"2026-08-25T06:01:54.071014+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"cuda","name":"cuda"},{"slug":"dgx","name":"dgx"},{"slug":"dgx-spark","name":"dgx-spark"},{"slug":"gb10","name":"gb10"},{"slug":"llm-inference","name":"llm-inference"},{"slug":"mamba","name":"mamba"},{"slug":"nvfp4","name":"nvfp4"},{"slug":"openai-api","name":"openai-api"}],"trust":{"provenance":{"is_fork":false,"github_id":1230084743,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-25T06:01:53.315Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":30,"days_since_push":0,"last_release_at":"2026-08-24T13:05:06Z","stars_delta_30d":57,"open_issues_delta_30d":92},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T11:44:59.011Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-25T06:01:53.763Z"},"languages":{"value":["rust"],"source":"github.language","observed_at":"2026-08-25T06:01:53.763Z"},"license_spdx":{"value":"AGPL-3.0","source":"github.license","observed_at":"2026-08-25T06:01:53.763Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["When aiming for high-performance Rust-based deployment that leverages hardware accelerators like NVIDIA DGX systems and Cuda technology.","If your project requires integration with the OpenAI API or supports Speculative Decoding techniques."],"when_not_to_use":["Avoid if you prefer tools in languages other than Rust for inference engines, since this is purely designed in Rust.","Not ideal if your deployment environment does not support NVIDIA GPU technologies such as DGX, which are key to maximize performance with Atlas."],"source":"enrich:decision_facts","observed_at":"2026-07-14T19:42:11.717Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"Focuses on efficient and scalable model deployment with Rust, supporting various GPU technologies and inference frameworks."}]}}