vespa
vespa-engine/vespa
The AI search platform
Overview
Vespa is an advanced AI-powered search and recommendation engine that supports real-time serving of large-scale data and machine learning models.
Categories
Tags
Relationships
Related
Similar tools
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
rtk
rtk-ai/rtk
CLI proxy reducing LLM token consumption by 60-90%
unsloth
unslothai/unsloth
Unsloth Studio is a web UI for training and running open models locally.
anything-llm
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM.
mem0
mem0ai/mem0
Universal memory layer for AI Agents
Install
git clone https://github.com/vespa-engine/vespaREADME
Search, make inferences in and organize vectors, tensors, text and structured data, at serving time and any scale.
This repository contains all the code required to build and run all of Vespa yourself, and where you can see all development as it happens. All the content in this repository is licensed under the Apache 2.0 license.
A new release of Vespa is made from this repository's master branch every morning CET Monday through Thursday.
- Home page: https://vespa.ai
- Documentation: https://docs.vespa.ai
- Continuous build: https://factory.vespa.ai
- Run applications in the cloud for free: vespa.ai/free-trial
Table of contents
- Background
- Install
- Usage
- Contribute
- Building
- License
Background
Use cases such as search, recommendation and personalization need to select a subset of data in a large corpus, evaluate machine-learned models over the selected data, organize and aggregate it and return it, typically in less than 100 milliseconds, all while the data corpus is continuously changing.
This is hard to do, especially with large data sets that need to be distributed over multiple nodes and evaluated in parallel. Vespa is a platform that performs these operations for you with high availability and performance. It has been in development for many years and is used on several large internet services and apps which serve hundreds of thousands of queries from Vespa per second.
Install
Deploy your Vespa applications to the cloud service: console.vespa-cloud.com, or run your own Vespa instance: https://docs.vespa.ai/en/getting-started.html
Usage
- The application created in the getting started guides linked above is fully functional and production-ready, but you may want to add more nodes for redundancy.
- See developing applications on adding your own Java components to your Vespa application.
- Vespa APIs is useful to understand how to interface with Vespa
- Explore the sample applications
- Follow the Vespa Blog for feature updates / use cases
- Join the Vespa Slack community to ask questions and share feedback
Full documentation is at https://docs.vespa.ai.
Contribute
We welcome contributions! See CONTRIBUTING.md to learn how to contribute.
If you want to contribute to the documentation, see https://github.com/vespa-engine/documentation
Building
You do not need to build Vespa to use it, but if you want to contribute you need to be able to build the code. This section explains how to build and test Vespa. To understand where to make changes, see Code-map.md. Some suggested improvements with pointers to code are in TODO.md.
Development environment
C++ and Java building is supported on AlmaLinux 8. The Java source can also be built on any platform having Java 17 and Maven 3.8+ installed. Use the following guide to set up a complete development environment using Docker for building Vespa, running unit tests and running system tests: [Vespa development on AlmaLinux 8](https://githu