vector
vectordotdev/vector
A high-performance observability data pipeline
Overview
Vector is a high-speed, end-to-end observability solution for collecting, transforming and routing logs and metrics to various vendors. It emphasizes reliability, performance, and flexibility.
Categories
Tags
Similar tools
langflow
langflow-ai/langflow
Langflow is a powerful platform for building and deploying AI-powered agents and workflows.
worldmonitor
koala73/worldmonitor
Real-time global intelligence dashboard
TrendRadar
sansan0/TrendRadar
告别信息过载,你的AI舆情监控助手与热点筛选工具
graphrag
microsoft/graphrag
A modular graph-based Retrieval-Augmented Generation (RAG) system
langfuse
langfuse/langfuse
Langfuse: Open source AI engineering platform for LLM evaluation, observability, and prompt management.
RAG_Techniques
NirDiamant/RAG_Techniques
Advanced RAG Techniques
Install
cargo add vectorREADME
Quickstart • Docs • Guides • Integrations • Chat • Download • Rust Crate Docs
What is Vector?
Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data. [Collect][docs.sources], [transform][docs.transforms], and [route][docs.sinks] all your logs and metrics to any vendors you want today and any other vendors you may want tomorrow. Vector enables dramatic cost reduction, novel data enrichment, and data security where you need it, not where it is most convenient for your vendors. Additionally, it is open source and up to 10x faster than every alternative in the space.
To get started, follow our [quickstart guide][docs.quickstart] or [install Vector][docs.installation].
Vector is maintained by Datadog's Community Open Source Engineering team.
Principles
- Reliable - Built in [Rust][urls.rust], Vector's primary design goal is reliability.
- End-to-end - Deploys as an [agent][docs.roles#agent] or [aggregator][docs.roles#aggregator]. Vector is a complete platform.
- Unified - [Logs][docs.data-model.log], [metrics][docs.data-model.metric] (beta), and traces (coming soon). One tool for all of your data.
Use cases
- Reduce total observability costs.
- Transition vendors without disrupting workflows.
- Enhance data quality and improve insights.
- Consolidate agents and eliminate agent fatigue.
- Improve overall observability performance and reliability.
Community
- Vector is relied on by startups and enterprises like Atlassian, T-Mobile, Comcast, Zendesk, Discord, Fastly, CVS, Trivago, Tuple, Douban, Visa, Mambu, Blockfi, Claranet, Instacart, Forcepoint, and [many more][urls.production_users].
- Vector is downloaded over 100,000 times per day.
- Vector's largest user processes over 500TB daily.
- Vector has over 500 contributors and growing.
Documentation
All user documentation is available at vector.dev/docs.
Other Resources:
- [Vector Calendar][urls.vector_calendar]
- Policies:
- [Code of Conduct][urls.vector_code_of_conduct]
- [Contributing][urls.vector_contributing_policy]
- [Privacy][urls.vector_privacy_policy]
- [Releases][urls.vector_releases_policy]
- [Versioning][urls.vector_versioning_policy]
- [Security][urls.vector_security_policy]
Comparisons
Performance
The following performance tests demonstrate baseline performance between common protocols with the exception of the Regex Parsing test.
| Test | Vector | Filebeat | FluentBit | FluentD | Logstash | SplunkUF | SplunkHF |
|---|---|---|---|---|---|---|---|
| TCP to Blackhole | 86mib/s | n/a | 64.4mib/s | 27.7mib/s | 40. |