sarathi-serve
Enrichment pendingA low-latency & high-throughput serving engine for LLMs
GraphCanon updated today · GitHub synced today
509
Stars
64
Forks
16
Open issues
7
Watchers
6mo
Last push
Python Apache-2.0Created Nov 2, 2023
Trust & integrity
Full report- Maintenance
- Slowing (184d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Organization account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Backing
Company and funding context for Microsoft. Display-only - not part of trust score or organic ranking.
- Company
- Microsoft·GitHub org profile·today
- Employees
- 221,000·Wikidata (P1128 employees)·today
- Commercial model
- Pure OSS·GitHub org profile (public repos)·today
Overview
A low-latency & high-throughput serving engine for LLMs
Capability facts
- Languages
- python
Source: github.language · Jul 11, 2026