BodhiApp

Installation

Bodhi App is currently released only for the Mac platform. You can install it either by downloading the release from the GitHub release page or using Homebrew.

Docker

Bodhi App is available as Docker images with multiple hardware acceleration variants. Each variant is optimized for specific hardware configurations to provide the best performance.

Available Variants

• CPU Variant: Standard CPU-only inference for maximum compatibility (multi-platform: AMD64 + ARM64)
• CUDA Variant: NVIDIA GPU acceleration for faster inference on NVIDIA hardware
• ROCm Variant: AMD GPU acceleration for AMD graphics cards
• Vulkan Variant: Cross-vendor GPU acceleration supporting multiple GPU vendors

Quick Start

CPU Variant (Most Compatible - Auto-detects AMD64/ARM64):

docker run -p 8080:8080 \
  -v ./bodhi_home:/data/bodhi_home \
  -v ./hf_home:/data/hf_home \
  ghcr.io/bodhisearch/bodhiapp:latest-cpu

CUDA Variant (NVIDIA GPU):

docker run --gpus all -p 8080:8080 \
  -v ./bodhi_home:/data/bodhi_home \
  -v ./hf_home:/data/hf_home \
  ghcr.io/bodhisearch/bodhiapp:latest-cuda

ROCm Variant (AMD GPU):

docker run --device=/dev/kfd --device=/dev/dri --group-add video -p 8080:8080 \
  -v ./bodhi_home:/data/bodhi_home \
  -v ./hf_home:/data/hf_home \
  ghcr.io/bodhisearch/bodhiapp:latest-rocm

Vulkan Variant (Cross-vendor GPU):

docker run --device=/dev/dri -p 8080:8080 \
  -v ./bodhi_home:/data/bodhi_home \
  -v ./hf_home:/data/hf_home \
  ghcr.io/bodhisearch/bodhiapp:latest-vulkan

Hardware Requirements

• CPU: Standard x86_64 (AMD64) or ARM64 processor (auto-detected)
• CUDA: NVIDIA GPU with CUDA 12.4+ support and compatible drivers
• ROCm: AMD GPU with ROCm 6.4+ support and compatible drivers
• Vulkan: GPU with Vulkan API support and compatible drivers

Volume Mounts

• /data/bodhi_home: Application data, configuration, and downloaded models
• /data/hf_home: HuggingFace cache directory for model downloads

After starting the container, Bodhi App will be available at http://localhost:8080.

Installation

npm install @bodhiapp/ts-client