UForm
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and video
GraphCanon updated today · GitHub synced today
Decision brief
UForm is a compact multimodal AI system designed for content understanding and generation across multiple languages and media types with faster processing speeds compared to OpenAI CLIP and LLaVA.
Good fit when
- Need fast content generation across texts, images, and videos within multilingual contexts.
- Prioritize speed in text-image cross-modal tasks where UForm outperforms competing systems.
Avoid when
- Seeking extensive customization options beyond what is offered by UForm's presets.
- Requiring a larger contextual understanding model than UForm's compact design provides.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Slowing (296d since push)
- As of today
- Provenance
- Not a fork · Organization account
- As of today
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install UFormSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
A repository for multimodal AI system that focuses on content understanding and generation with capabilities in text, image, and video processing, featuring speed up to 5x faster than OpenAI CLIP and LLaVA.
Capability facts
- CLI
- CLI entrypoint
Source: package.json:bin|scripts · Aug 23, 2026
- MCP server
- No MCP server detected
Source: repo_scan · Aug 23, 2026
- Languages
- python, javascript
Source: github.language+package.json+pyproject.toml · Aug 23, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Aug 23, 2026)
<a href="https://github.com/unum-cloud/uform/blob/main/python/README.md">Python</a>Source link
Tags
README
UForm
Pocket-Sized Multimodal AI
For Content Understanding and Generation
Multimodal Embeddings from 64 to 768 Dimensions • 1B Parameter Chat
Short Texts • Images • 🔜 Video Clips • 🔜 Long Documents
ONNX • CoreML • PyTorch
Python
•
JavaScript
•
Swift
Welcome to UForm, a multimodal AI library that's as versatile as it is efficient. UForm tiny embedding models will help you understand and search visual and textual content across various languages. UForm small generative models, on the other hand, don't only support conversational and chat use-cases, but are great for fast image captioning and Visual Question Answering (VQA). With compact custom pre-trained transformer models, this can run anywhere from your server farm down to your smartphone.
Features
- Tiny Embeddings: 64-dimensional Matryoshka-style embeddings for extremely fast search.
- Throughput: Thanks to the small size, the inference speed is 2-4x faster than competitors.
- Portable: Models come with native ONNX support, making them easy to deploy on any platform.
- Quantization Aware: Down-cast embeddings from
f32toi8without losing much recall. - Multilingual: Trained on a balanced dataset, the recall is great across over 20 languages.
Models
For accuracy and speed benchmarks refer to the evaluation page.
Embedding Models
| Model | Parameters | Languages | Architecture |
|---|---|---|---|
uform3-image-text-english-large 🆕 | 365 M | 1 | 12 layer BERT, ViT-L/14 |
uform3-image-text-english-base | 143 M | 1 | 4 layer BERT, ViT-B/16 |
uform3-image-text-english-small 🆕 | 79 M |
For agents
This page has a .md twin and JSON over the API.