Yi

01-ai/Yi

Building the Next Generation of Open-Source and Bilingual LLMs

7.8k
Stars
489
Forks
31
Open issues
108
Watchers
Jupyter Notebook Apache-2.0Last pushed Nov 27, 2024

Overview

A repository for large language models developed by @01-ai, primarily in Jupyter Notebooks. Provides various pre-trained models available on Hugging Face, ModelScope, and wisemodel.

Categories

Tags

Similar tools

Install

git clone https://github.com/01-ai/Yi

README

 English  |   中文



Building the Next Generation of Open-Source and Bilingual LLMs

🤗 Hugging Face • 🤖 ModelScope • 🟣 wisemodel

👩‍🚀 Ask questions or discuss ideas on GitHub

👋 Join us on 👾 Discord or 💬 WeChat

📝 Check out Yi Tech Report

📚 Grow at Yi Learning Hub

💪 Learn at Yi Tech Blog


📕 Table of Contents
  • What is Yi?
    • Introduction
    • Models
      • Chat models
      • Base models
      • Model info
    • News
  • How to use Yi?
    • Quick start
      • Choose your path
      • pip
      • docker
      • llama.cpp
      • conda-lock
      • Web demo
    • Fine-tuning
    • Quantization
    • Deployment
    • FAQ
    • Learning hub
  • Why Yi?
    • Ecosystem
      • Upstream
      • Downstream
        • Serving
        • Quantization
        • Fine-tuning
        • API
    • Benchmarks
      • Base model performance
      • Chat model performance
    • Tech report
      • Citation
  • Who can use Yi?
  • Misc.
    • Acknowledgements
    • Disclaimer
    • License

What is Yi?

Introduction

  • 🤖 The Yi series models are the next generation of open-source large language models trained from scratch by 01.AI.

  • 🙌 Targeted as a bilingual language model and trained on 3T multilingual corpus, the Yi series models become one of the strongest LLM worldwide, showing promise in language understanding, commonsense reasoning, reading comprehension, and more. For example,

    • Yi-34B-Chat model landed in second place (following GPT-4 Turbo), outperforming other LLMs (such as GPT-4, Mixtral, Claude) on the AlpacaEval Leaderboard (based on data available up to January 2024).

    • Yi-34B model ranked first among all existing open-source models (such as Falco