“intel”

gpu-telemetry

GPU Observability with workload attribution. One OTLP agent per node ties hardware metrics (NVIDIA, AMD, Intel Gaudi) to the K8s pod or Slurm job burning the GPU.

WhisperLive

A nearly-live implementation of OpenAI's Whisper.

ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of con

dstack

Open framework for confidential AI

text-generation-inference

Large Language Model Text Generation Inference