Home/Model Training/CodeBERT

CodeBERT

microsoft/CodeBERT

CodeBERT series models for code pretraining in Python and programming languages

GitHub

GraphCanon updated Oct 8, 2026 · GitHub synced Oct 8, 2026

39views this month

2.8k stars497 forksLast push Jul 9, 2023 Python MIT

Decision brief

CodeBERT is an advanced pre-trained model for programming and natural language tasks in multiple languages like Python and Java.

Good fit when

When you need to work on tasks involving both programming and natural language processing across six different programming languages: Python, Java, JavaScript, PHP, Ruby, Go
For embedding generation from a combination of natural language and code inputs, enhancing cross-language understanding

Avoid when

Avoid for direct mask prediction tasks without MLM (Masked Language Model) fine-tuning as CodeBERT is not natively equipped for such tasks unlike its variant designed with MLM capabilities
Do not consider it if your project requires pre-training models on a wider variety of programming languages beyond the six supported by this model

Requirements:: Install torch and transformers via pip before using CodeBERT for embedding generation or other tasks; Ensure Python and Hugging Face's transformers framework are available, as they form the core execution environment for utilizing this model

Observed Jul 17, 2026 · Source: enrich:decision_facts

CodeBERT alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Dormant (1186d since push); As of Oct 8, 2026
Provenance: Not a fork · Organization account; As of Oct 8, 2026
Security (OSV): No lockfile; As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Backing

Company context for Microsoft. Display-only - separate from trust and ranking.

Company: Microsoft·GitHub org profile·Jul 11, 2026
Employees: 221,000·Wikidata (P1128 employees)·Jul 11, 2026
Commercial model: Pure OSS·GitHub org profile (public repos)·Jul 11, 2026

Install

pip install CodeBERT

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Hands-On-Large-Language-Models

Code for the book 'Hands-On Large Language Models'

29k★

pua

A skill package for enhancing the functionality of AI agents within development environments

19k★

semble

Fast and Accurate Code Search for Agents

6.1k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Provides pretrained CodeBERT series models for tasks involving natural language and programming languages like Python, Java, JavaScript, PHP, Ruby, Go.

Capability facts

Languages: python
Source: github.language · Oct 8, 2026

Graph entities

Microsoftcompany

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Oct 8, 2026)

rogramming-lingual model pre-trained on NL-PL pairs in 6 programming languages (Python, Java, JavaScript, PHP, Ruby, Go).

Source link

README

Code Pretraining Models This repo contains code pretraining models in the CodeBERT series from Microsoft, including six models as of June 2023. CodeBERT (EMNLP 2020) GraphCodeBERT (ICLR 2021) UniXcoder (ACL 2022) CodeReviewer (ESEC/FSE 2022) CodeExecutor (ACL 2023) LongCoder (ICM...

For agents

This page has a .md twin and JSON over the API.

/tools/microsoft-codebert.md GET /api/graphcanon/tools/microsoft-codebert GET /api/graphcanon/graph?tool=microsoft-codebert