krasis logo

krasis

brontoguana/krasis

Hybrid LLM Runtime for Efficient Large Model Inference on Consumer Hardware

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

32views this month

521 stars33 forksLast push Sep 15, 2026 C++ Other

Decision brief

Krasis is designed to offer efficient large model inference on consumer-grade hardware through hybrid CPU-GPU execution and high-performance optimization.

Good fit when

  • - When aiming for efficient operation of larger language models with limited VRAM, as Krasis optimizes memory utilization specifically to support this scenario.
  • - If you seek an alternative runtime that can handle the latest GGUF-supported models without significant compromises in performance compared to other toolkits like llama-cpp.

Avoid when

  • - Avoid using Krasis if your hardware setup does not include both CPU and GPU capabilities, as its hybrid execution relies on utilizing both components for optimal performance.
  • - If you prioritize running lightweight models with minimal memory footprint on low-end devices, Krasis might not be the ideal choice given it is optimized for larger-scale model inference.

Observed Jul 15, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (4d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

git clone https://github.com/brontoguana/krasis

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Krasis is designed to enable efficient running of larger language models with constraints on consumer-grade VRAM. It supports high-performance inference, hybrid CPU-GPU execution, and is an alternative to existing solutions such as llama-cpp.

Capability facts

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Sep 20, 2026

Languages
c++, python

Source: github.language+pyproject.toml · Sep 20, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 20, 2026)

It installs Krasis for the current user, includes its own Python runtime, and
Source link

Tags

README

Install The current release is . Native Windows: Download the Krasis Windows installer. It installs Krasis for the current user, includes its own Python runtime, and adds to the Start Menu. Linux or WSL2: See all releases for older versions and individual wheel/source assets. You...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.