Home/Compare/agentdojo vs IB4LLMs

Comparison

agentdojo vs IB4LLMs

Verdict

Pick agentdojo when pricing: Open-source under the MIT License. Some advanced features might require additional libraries or APIs.; pick IB4LLMs when tags unique to IB4LLMs: adversarial prompts defense, information bottleneck, jailbreak defense, llms protection.

Markdown twin · agentdojo alternatives · IB4LLMs alternatives

GraphCanon updated today

agentdojo logo

agentdojo

ethz-spylab/agentdojo

659pushed Jun 2, 2026
vs
IB4LLMs logo

IB4LLMs

zichuan-liu/IB4LLMs

25pushed Nov 7, 2024

Trust & integrity

SignalagentdojoIB4LLMs
Maintenance
Steady (39d since push)
As of today · github_public_v1
Dormant (611d since push)
As of today · github_public_v1
Provenance
Not a fork · Organization account
As of today · github_public_v1
Not a fork · Personal account
As of today · github_public_v1
Security (OSV)
No lockfile
As of today · none
77 low (77 low)
As of today · osv@v1

Tagline

agentdojo
A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
IB4LLMs
Protecting Your LLMs with Information Bottleneck

Stars

agentdojo
659
IB4LLMs
25

Forks

agentdojo
168
IB4LLMs
2

Open issues

agentdojo
33
IB4LLMs
4

Language

agentdojo
Python
IB4LLMs
Python

Adopt for

agentdojo
AgentDojo serves as a benchmarking environment to evaluate security attacks, like prompt injection, and defenses for Large Language Model (LLM) agents.
IB4LLMs
-

Persona

agentdojo
-
IB4LLMs
-

Runtime

agentdojo
-
IB4LLMs
-

License

agentdojo
MIT
IB4LLMs
-

Last pushed

agentdojo
Jun 2, 2026
IB4LLMs
Nov 7, 2024

Categories

agentdojo
AI Agents, Evaluation & Observability
IB4LLMs
Evaluation & Observability, LLM Frameworks

Trust and health

Maintenance

agentdojo
Steady (60%)
IB4LLMs
Dormant (18%)

Days since push

agentdojo
39d
IB4LLMs
611d

Open issues (now)

agentdojo
33
IB4LLMs
4

Owner type

agentdojo
Organization
IB4LLMs
User

Security scan

agentdojo
No lockfile
IB4LLMs
77 low (77 low)

Full report

agentdojo
Trust report

Shared compatibility

  • Python · agentdojo: Python runtime · IB4LLMs: Python runtime

Choose agentdojo if…

  • Pricing: Open-source under the MIT License. Some advanced features might require additional libraries or APIs..
  • Requirements: Min 8 GB RAM.
  • Tags unique to agentdojo: benchmark, large-language-models, prompt-injection, security.
  • Also covers AI Agents.
  • AgentDojo serves as a benchmarking environment to evaluate security attacks, like prompt injection, and defenses for Large Language Model (LLM) agents.

When NOT to use agentdojo

  • AI Agents: Don't use an agent loop when a deterministic workflow would do; agents add latency, cost, and non-determinism.
  • Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.

Choose IB4LLMs if…

  • Tags unique to IB4LLMs: adversarial prompts defense, information bottleneck, jailbreak defense, llms protection.
  • Also covers LLM Frameworks.
  • Leaner open-issue backlog (4).

When NOT to use IB4LLMs

  • Last GitHub push was 612 days ago (dormant maintenance, Nov 7, 2024). Validate activity before betting a new project on IB4LLMs.
  • Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
  • LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.

Explore

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: agentdojo 659 · IB4LLMs 25 (synced Jul 11, 2026).

Common questions

What is the difference between agentdojo and IB4LLMs?
agentdojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents. IB4LLMs: Protecting Your LLMs with Information Bottleneck. See the comparison table for live GitHub stats and shared categories.
When should I choose agentdojo over IB4LLMs?
Choose agentdojo over IB4LLMs when Pricing: Open-source under the MIT License. Some advanced features might require additional libraries or APIs.; Requirements: Min 8 GB RAM; Tags unique to agentdojo: benchmark, large-language-models, prompt-injection, security; Also covers AI Agents; AgentDojo serves as a benchmarking environment to evaluate security attacks, like prompt injection, and defenses for Large Language Model (LLM) agents.
When should I choose IB4LLMs over agentdojo?
Choose IB4LLMs over agentdojo when Tags unique to IB4LLMs: adversarial prompts defense, information bottleneck, jailbreak defense, llms protection; Also covers LLM Frameworks; Leaner open-issue backlog (4).
When should I avoid agentdojo?
AI Agents: Don't use an agent loop when a deterministic workflow would do; agents add latency, cost, and non-determinism. Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
When should I avoid IB4LLMs?
Last GitHub push was 612 days ago (dormant maintenance, Nov 7, 2024). Validate activity before betting a new project on IB4LLMs. Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers. LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.
Is agentdojo or IB4LLMs more popular on GitHub?
agentdojo has more GitHub stars (659 vs 25). Stars measure visibility, not whether either tool fits your constraints.
Are agentdojo and IB4LLMs open source?
Yes - both are open-source projects on GitHub.
Where can I find alternatives to agentdojo or IB4LLMs?
GraphCanon lists graph-backed alternatives at agentdojo alternatives and IB4LLMs alternatives (agentdojo markdown twin, IB4LLMs markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, agentdojo or IB4LLMs?
agentdojo: Steady. IB4LLMs: Dormant. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for agentdojo and IB4LLMs?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: agentdojo trust report; IB4LLMs trust report.