Results for “tokenization”

17 tools

LLMs-from-scratch

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch

99k 15kJupyter Notebook

caveman

JuliusBrussee/caveman

Cuts 65% of tokens in AI coding agent responses.

86k 4.8kJavaScript

rtk

rtk-ai/rtk

CLI proxy reducing LLM token consumption by 60-90%

69k 4.3kRust

headroom

headroomlabs-ai/headroom

Context compression layer for AI agents

57k 4.2kPython

gitleaks

gitleaks/gitleaks

Find secrets with Gitleaks

28k 2.1kGo

toon

toon-format/toon

Token-Oriented Object Notation (TOON)

25k 1.1kTypeScript

9router

decolua/9router

Free AI Coding Router with Token Saver

21k 3.3kJavaScript

OmniRoute

diegosouzapw/OmniRoute

OmniRoute — The Free AI Gateway

13k 1.9kTypeScript

MemOS

MemTensor/MemOS

MemOS: Self-evolving memory OS for LLM & AI Agents

10k 920TypeScript

bifrost

maximhq/bifrost

Fastest enterprise AI gateway with adaptive load balancer, cluster mode, guardrails, and support for over 1000 models.

6.3k 857Go

Baichuan-7B

baichuan-inc/Baichuan-7B

A large-scale pretraining language model for natural language processing tasks.

5.7k 501Python

Baichuan2

baichuan-inc/Baichuan2

A series of large language models developed by Baichuan Intelligent Technology.

4.1k 294Python

GLiNER

urchade/GLiNER

Generalist and Lightweight Model for Named Entity Recognition

3.4k 288Python

SocratiCode

giancarloerra/SocratiCode

SocratiCode - Enterprise-grade codebase intelligence with semantic search and dependency graphs

3.1k 394TypeScript

nextpy

dot-agent/nextpy

Self-modifying framework for building advanced AI agents

2.3k 181Python

Lynkr

Fast-Editor/Lynkr

Optimize LLM token usage with Lynkr, a CLI tool.

520 55JavaScript

vigil-llm

deadbits/vigil-llm

⚡ Security scanner for LLM prompts ⚡

486 55Python