llama2-webui logo

llama2-webui

liltom-eth/llama2-webui

Run Llama 2 locally with gradio UI on GPU or CPU

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

1.9k stars198 forksLast push Mar 22, 2024 Jupyter Notebook MIT

Decision brief

Unverified catalog guidance: llama2-webui - Run Llama 2 models locally via Gradio UI on GPU or CPU.

Good fit when

  • Unverified catalog guidance: - When you want to run Llama 2 models locally with minimal setup across various operating systems like Linux, Windows, and Mac.
  • Unverified catalog guidance: - If your preference is for a tool that supports both CPU and GPU inference, offering flexibility in resource use.

Avoid when

  • Unverified catalog guidance: - Avoid if you are looking for broader support beyond Llama 2 models; this tool is specifically tailored to work with the Llama 2 series.
  • Unverified catalog guidance: - Not recommended if your project strictly requires a web-based deployment without a local server component, as it emphasizes local model inference.
Requirements:
- Ensure you have access to Llama 2 models before proceeding.; - Requires a Python environment capable of running Jupyter Notebooks along with the specified dependencies such as Gradio.

Observed Jul 14, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (911d since push)
As of Sep 19, 2026
Provenance
Not a fork · Personal account
As of Sep 19, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install bitsandbytes==0.38.1

README installation instruction · observed Sep 20, 2026

PyPI

Relationship proposals(1)

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

This repository provides an interface to run Llama 2 models using the Gradio framework for local model inference and deployment

Capability facts

Languages
jupyter notebook, python

Source: github.language+pyproject.toml · Sep 19, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 19, 2026)

- `pip install bitsandbytes==0.38.1`
Source link

Tags

README

Install Issues: may not work on older NVIDIA GPUs. In that case, to use , you may have to downgrade like this: also need a special install for Windows: pip install llama2 wrapper from llama2 wrapper import LLAMA2 WRAPPER, get prompt llama2 wrapper = LLAMA2 WRAPPER() License MIT s...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.