--- title: "auto-evaluator vs claude-mem" type: "comparison" canonical_url: "https://www.graphcanon.com/compare/langchain-ai-auto-evaluator-vs-thedotmack-claude-mem" tools: ["langchain-ai-auto-evaluator", "thedotmack-claude-mem"] --- # auto-evaluator vs claude-mem *GraphCanon updated Jul 12, 2026* ## Verdict Pick auto-evaluator when auto-evaluator is primarily TypeScript; claude-mem is JavaScript; pick claude-mem when claude-mem is primarily JavaScript; auto-evaluator is TypeScript. [auto-evaluator](https://autoevaluator.langchain.com/) reports 782 GitHub stars, 103 forks, and 21 open issues, last pushed Jun 26, 2025. [claude-mem](https://claude-mem.ai) has 87k stars, 7.5k forks, and 252 open issues, last pushed Jul 9, 2026. Figures are from public GitHub metadata via [auto-evaluator's repository](https://github.com/langchain-ai/auto-evaluator) and [claude-mem's repository](https://github.com/thedotmack/claude-mem). | | [auto-evaluator](/tools/langchain-ai-auto-evaluator.md) | [claude-mem](/tools/thedotmack-claude-mem.md) | | --- | --- | --- | | Tagline | auto-evaluator | Persistent Context Across Sessions for Every Agent | | Stars | 782 | 86,816 | | Forks | 103 | 7,500 | | Open issues | 21 | 252 | | Language | TypeScript | JavaScript | | Adopt for | - | claude-mem provides persistent context across sessions, leveraging AI to capture and compress agent activity. | | Persona | - | - | | Runtime | - | - | | License | Other | Claude-Mem is distributed under the Apache License 2.0, allowing it to be freely used in a variety of development and production environments while maintaining clear licensing terms. | | Categories | Inference & Serving | AI Agents, Inference & Serving | ## Trust and health _Sourced signals - not a safety guarantee. No winner column._ | | [auto-evaluator](/tools/langchain-ai-auto-evaluator.md) | [claude-mem](/tools/thedotmack-claude-mem.md) | | --- | --- | --- | | Maintenance | Archived (8%) | Very active (96%) | | Days since push | 380d | 1d | | Archived on GitHub | Yes | No | | Open issues (now) | 21 | 252 | | Owner type | Organization | User | | Full report | [trust report](/tools/langchain-ai-auto-evaluator/trust.md) | [trust report](/tools/thedotmack-claude-mem/trust.md) | ## Decision facts: claude-mem - **Requirements:** Requires Node.js v20.0.0 or higher.; Must have the latest version of Claude Code with plugin support.; Auto-installs Bun (JavaScript runtime and process manager) if not already present.; Requires uv (Python package for vector search), auto-installation supported. - **Adopt for:** claude-mem provides persistent context across sessions, leveraging AI to capture and compress agent activity. - **License detail:** Claude-Mem is distributed under the Apache License 2.0, allowing it to be freely used in a variety of development and production environments while maintaining clear licensing terms. ## Choose when ### Choose auto-evaluator if… - auto-evaluator is primarily TypeScript; claude-mem is JavaScript. - License: auto-evaluator is Other, claude-mem is Apache-2.0. - Tags unique to auto-evaluator: typescript. ### Choose claude-mem if… - claude-mem is primarily JavaScript; auto-evaluator is TypeScript. - License: claude-mem is Apache-2.0, auto-evaluator is Other. - Requirements: Requires Node.js v20.0.0 or higher.; Must have the latest version of Claude Code with plugin support.; Auto-installs Bun (JavaScript runtime and process manager) if not already present.; Requires uv (Python package for vector search), auto-installation supported.. - Tags unique to claude-mem: ai-agents, ai-memory, chromadb, claude. - Also covers AI Agents. - When you require seamless and persistent context continuity between different session interactions with Claude Code or other supported agents. ## When NOT to use auto-evaluator - auto-evaluator is archived on GitHub. Prefer an active alternative unless you maintain a private fork or need a frozen dependency. - Inference & Serving: Self-hosting rarely beats a hosted API on cost until you have steady, high-volume traffic. ## When NOT to use claude-mem - When working in environments where Node.js v20.0.0 or higher cannot be installed, as claude-mem requires this version to operate. - If your specific AI agent or tool does not integrate with the supported frameworks listed (e.g., Claude Code, OpenClaw), making context persistence ineffective for your workflow. ## Common questions ### What is the difference between auto-evaluator and claude-mem? auto-evaluator: auto-evaluator. claude-mem: Persistent Context Across Sessions for Every Agent. See the comparison table for live GitHub stats and shared categories. ### When should I choose auto-evaluator over claude-mem? Choose auto-evaluator over claude-mem when auto-evaluator is primarily TypeScript; claude-mem is JavaScript; License: auto-evaluator is Other, claude-mem is Apache-2.0; Tags unique to auto-evaluator: typescript. ### When should I choose claude-mem over auto-evaluator? Choose claude-mem over auto-evaluator when claude-mem is primarily JavaScript; auto-evaluator is TypeScript; License: claude-mem is Apache-2.0, auto-evaluator is Other; Requirements: Requires Node.js v20.0.0 or higher.; Must have the latest version of Claude Code with plugin support.; Auto-installs Bun (JavaScript runtime and process manager) if not already present.; Requires uv (Python package for vector search), auto-installation supported.; Tags unique to claude-mem: ai-agents, ai-memory, chromadb, claude; Also covers AI Agents; When you require seamless and persistent context continuity between different session interactions with Claude Code or other supported agents. ### When should I avoid auto-evaluator? auto-evaluator is archived on GitHub. Prefer an active alternative unless you maintain a private fork or need a frozen dependency. Inference & Serving: Self-hosting rarely beats a hosted API on cost until you have steady, high-volume traffic. ### When should I avoid claude-mem? When working in environments where Node.js v20.0.0 or higher cannot be installed, as claude-mem requires this version to operate. If your specific AI agent or tool does not integrate with the supported frameworks listed (e.g., Claude Code, OpenClaw), making context persistence ineffective for your workflow. ### Is auto-evaluator or claude-mem more popular on GitHub? claude-mem has more GitHub stars (86,816 vs 782). Stars measure visibility, not whether either tool fits your constraints. ### Are auto-evaluator and claude-mem open source? Yes - both are open-source projects on GitHub (auto-evaluator: Other, claude-mem: Apache-2.0). ### Where can I find alternatives to auto-evaluator or claude-mem? GraphCanon lists graph-backed alternatives at [auto-evaluator alternatives](/tools/langchain-ai-auto-evaluator/alternatives) and [claude-mem alternatives](/tools/thedotmack-claude-mem/alternatives) ([auto-evaluator markdown twin](/tools/langchain-ai-auto-evaluator/alternatives.md), [claude-mem markdown twin](/tools/thedotmack-claude-mem/alternatives.md)), ranked by typed relationship edges rather than popularity votes. ### Is there a machine-readable version of this comparison? Yes. The markdown twin at [this comparison](/compare/langchain-ai-auto-evaluator-vs-thedotmack-claude-mem.md) mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers. ### Which is better maintained, auto-evaluator or claude-mem? auto-evaluator: Archived. claude-mem: Very active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance. ### Where are the full trust reports for auto-evaluator and claude-mem? GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: [auto-evaluator trust report](/tools/langchain-ai-auto-evaluator/trust); [claude-mem trust report](/tools/thedotmack-claude-mem/trust). --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/graph?tool=langchain-ai-auto-evaluator`](/api/graphcanon/graph?tool=langchain-ai-auto-evaluator) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_