{"data":{"slug":"pachyderm-pachyderm","name":"pachyderm","tagline":"Data-Centric Pipelines and Data Versioning","github_url":"https://github.com/pachyderm/pachyderm","owner":"pachyderm","repo":"pachyderm","owner_avatar_url":"https://avatars.githubusercontent.com/u/10432478?v=4","primary_language":"Go","stars":6311,"forks":577,"topics":["analytics","big-data","containers","data-analysis","data-science","distributed-systems","docker","go","kubernetes","pachyderm"],"archived":false,"github_pushed_at":"2025-02-03T22:27:18+00:00","maintenance_label":"Dormant","stars_delta_30d":11,"url":"https://www.graphcanon.com/tools/pachyderm-pachyderm","markdown_url":"https://www.graphcanon.com/tools/pachyderm-pachyderm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/pachyderm-pachyderm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=pachyderm-pachyderm","description":"Data-Centric Pipelines and Data Versioning","homepage_url":"https://www.pachyderm.com/","license":"Apache-2.0","open_issues":940,"watchers":152,"ai_summary":"Pachyderm provides data-centric pipelines and manages data versioning within distributed systems, aiding in analytics and big-data processing.","readme_excerpt":"## Getting Started\nTo start deploying your end-to-end version-controlled data pipelines, run Pachyderm [locally](https://docs.pachyderm.com/latest/set-up/local-deploy/) or you can also [deploy on AWS/GCE/Azure](https://docs.pachyderm.com/latest/set-up/cloud-deploy) in about 5 minutes. \n\nYou can also refer to our complete [documentation](https://docs.pachyderm.com) to see tutorials, check out example projects, and learn about advanced features of Pachyderm.\n\nIf you'd like to see some examples and learn about core use cases for Pachyderm:\n- [Examples](https://github.com/pachyderm/examples)\n- [Use Cases](https://www.pachyderm.com/use-cases/)\n- [Case Studies](https://www.pachyderm.com/case-studies/)","github_created_at":"2014-09-04T07:50:02+00:00","created_at":"2026-07-11T23:27:27.171201+00:00","updated_at":"2026-09-28T06:00:23.911697+00:00","categories":[{"slug":"developer-tools","name":"Developer Tools","url":"https://www.graphcanon.com/categories/developer-tools","markdown_url":"https://www.graphcanon.com/categories/developer-tools.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/developer-tools"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"analytics","name":"analytics"},{"slug":"big-data","name":"big-data"},{"slug":"containers","name":"containers"},{"slug":"data-analysis","name":"data-analysis"},{"slug":"data-science","name":"data-science"},{"slug":"distributed-systems","name":"distributed-systems"},{"slug":"docker","name":"docker"},{"slug":"kubernetes","name":"kubernetes"}],"trust":{"provenance":{"is_fork":false,"github_id":23653453,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-28T06:00:23.122Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":601,"last_release_at":"2025-01-15T21:22:56Z","stars_delta_30d":11,"open_issues_delta_30d":1},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:27:30.562Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-28T06:00:23.610Z"},"languages":{"value":["go"],"source":"github.language","observed_at":"2026-09-28T06:00:23.610Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-09-28T06:00:23.610Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"unknown","summary":"The repository does not specify detailed pricing, but as an open-source tool under the Apache-2.0 license, it is freely available for use and modification."},"requirements":{"notes":["Pachyderm deployment requires a Kubernetes cluster when deployed in production-scale environments."],"min_ram_gb":-1},"constraints":{"min_ram_gb":-1,"pricing_model":"unknown"},"when_to_use":["If you need granular data lineage tracking within your projects, as Pachyderm ensures every transformation is captured.","For applications requiring reproducibility across experiments; Pachyderm provides versioned datasets that can be reliably re-used and compared.","When deploying analytics pipelines at scale in a Kubernetes environment without needing to manage the underlying infrastructure manually."],"when_not_to_use":["If your organization does not require data versioning or cannot benefit from reproducibility features, such as for simple projects with minimal data mutation.","For scenarios where Docker container management overhead is undesirable; Pachyderm relies heavily on containers and Kubernetes, which might complicate smaller-scale workflows.","When immediate integration with non-Kubernetes environments is a must. Pachyderm's tight coupling with Kubernetes introduces additional complexity not present in more standalone tools."],"source":"enrich:decision_facts","observed_at":"2026-07-17T04:20:36.715Z"},"constraint_facets":{"min_ram_gb":-1,"pricing_model":"unknown"},"decision_summary":[{"label":"Pricing","value":"unknown - The repository does not specify detailed pricing, but as an open-source tool under the Apache-2.0 license, it is freely available for use and modification."},{"label":"Requirements","value":"Min -1 GB RAM; Pachyderm deployment requires a Kubernetes cluster when deployed in production-scale environments."},{"label":"Adopt for","value":"Pachyderm offers a robust platform for managing data-centric pipelines and data versioning with advanced features suitable for analytics and big-data processing in distributed systems."}]}}