Home/Inference & Serving/budgetml

budgetml

ebhy/budgetml

Deploys ML inference service economically

GitHub

GraphCanon updated 3w · GitHub synced 3w

1.3k stars65 forksLast push 2y Python Apache-2.0

Decision brief

BudgetML is a Python library that leverages Google Cloud Preemptible instances to decrease the cost of deploying machine learning models for inference.

Good fit when

When you are looking to reduce costs significantly and have flexibility in your deployment schedule, since Preemptible instances can be interrupted
Ideal for non-mission-critical tasks where occasional interruptions do not severely impact operations

Avoid when

If you need absolute certainty that your ML service will not be interrupted at any point during operation
Not suitable for continuous and uninterrupted services, as Google Cloud Preemptible instances can be terminated with short notice

Pricing:: freemium - Free to use, but users will incur costs based on their usage of Google Cloud Preemptible instances.
Requirements:: Requires a working Python environment and access to Google Cloud services to deploy on Preemptible VMs; The library is available via PyPI or can be installed directly from GitHub for the latest features, at users' own risk

Observed Jul 17, 2026 · Source: enrich:decision_facts

budgetml alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Dormant (901d since push); As of 3w
Provenance: Not a fork · Organization account; As of 3w
Security (OSV): No criticals; As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install budgetml

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

32k★

whichllm

Command-line tool to find and benchmark local LLM performance

6.2k★

seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

4.8k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

BudgetML provides a way to deploy machine learning models for inference using Google Cloud Preemptible instances to cut costs.

Capability facts

Languages: python
Source: github.language · Aug 2, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Aug 2, 2026)

pip install budgetml

Source link

README

Cost comparison

BudgetML uses Google Cloud Preemptible instances under-the-hood to reduce costs by 80%. This can potentially mean hundreds of dollars worth of savings. Here is a screenshot of the e2-highmem GCP series, which is regular family of instances to be using for memory intense tasks like ML model inference functions. See the following price comparison (as of Jan 31, 2021 [source])

Even with the lowest machine_type, there is a $46/month savings, and with the highest configuration this is $370/month savings!

Installation

BudgetML is available for easy installation into your environment via PyPI:

pip install budgetml

Alternatively, if you’re feeling brave, feel free to install the bleeding edge:

NOTE: Do so at your own risk; no guarantees given!

pip install git+https://github.com/ebhy/budgetml.git@main --upgrade

For agents

This page has a .md twin and JSON over the API.

/tools/ebhy-budgetml.md GET /api/graphcanon/tools/ebhy-budgetml GET /api/graphcanon/graph?tool=ebhy-budgetml