dstack

Getting Started

Try it now: Chat with LLMs running in TEE at chat.redpill.ai. Click the shield icon to verify attestations from Intel TDX and NVIDIA GPUs.

Deploy your own:

---

# docker-compose.yaml
services:
  vllm:
    image: vllm/vllm-openai:latest
    runtime: nvidia
    command: --model Qwen/Qwen2.5-7B-Instruct
    ports:
      - "8000:8000"

Deploy to a self-hosted TDX machine with the dstackup install -> dstack deploy workflow, or use Phala Cloud for managed infrastructure. AMD SEV-SNP hosts use the same workflow when the selected guest image includes digest.txt.

Setting up dstack on your own hardware? Start with the self-hosted quick onboarding guide