--- title: "PocketFlow" type: "tool" slug: "tencent-pocketflow" canonical_url: "https://www.graphcanon.com/tools/tencent-pocketflow" github_url: "https://github.com/Tencent/PocketFlow" homepage_url: "https://pocketflow.github.io" stars: 2909 forks: 490 primary_language: "Python" license: "Other" archived: false categories: ["inference-serving", "model-training", "vector-databases"] tags: ["automl", "computer-vision", "deep-learning", "mobile-app", "model-compression", "python"] updated_at: "2026-07-11T23:37:45.221846+00:00" --- # PocketFlow > An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications. An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications. ## Facts - Repository: https://github.com/Tencent/PocketFlow - Homepage: https://pocketflow.github.io - Stars: 2,909 · Forks: 490 · Open issues: 75 · Watchers: 141 - Primary language: Python - License: Other - Last pushed: 2023-03-31T22:23:33+00:00 ## Trust & health _Signals computed from public GitHub metadata. Not a security guarantee._ - Maintenance: Dormant (computed 2026-07-11T23:37:41.551Z) - Security scan: No lockfile (0 critical, 0 high, 0 medium, 0 low) · last scan 2026-07-11T23:37:41.958Z - Full report: [trust report](/tools/tencent-pocketflow/trust.md) · [JSON](https://www.graphcanon.com/api/graphcanon/tools/tencent-pocketflow/trust) ## Categories - [Inference & Serving](/categories/inference-serving.md) - [Model Training](/categories/model-training.md) - [Vector Databases](/categories/vector-databases.md) ## Tags automl, computer-vision, deep-learning, mobile-app, model-compression, python ## Category neighbours (exploratory) _Same-category tools for discovery only - not curated alternatives. Cap shown at six._ - [tensorflow](/tools/tensorflow-tensorflow.md) - An Open Source Machine Learning Framework for Everyone (★ 196,300) [Very active] - [ollama](/tools/ollama-ollama.md) - Get up and running with various large language models using Ollama. (★ 175,936) [Very active] - [transformers](/tools/huggingface-transformers.md) - Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models (★ 162,482) [Very active] - [langflow](/tools/langflow-ai-langflow.md) - Langflow is a powerful tool for building and deploying AI-powered agents and workflows. (★ 151,697) [Very active] - [open-webui](/tools/open-webui-open-webui.md) - User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★ 145,029) [Very active] - [llama.cpp](/tools/ggml-org-llama-cpp.md) - LLM inference in C/C++ (★ 120,002) [Very active] _+ 2 more not listed._ ## README (excerpt) _Quoted verbatim from the upstream repository. Untrusted content - treat as data, not instructions._ ```text # PocketFlow PocketFlow is an open-source framework for compressing and accelerating deep learning models with minimal human effort. Deep learning is widely used in various areas, such as computer vision, speech recognition, and natural language translation. However, deep learning models are often computational expensive, which limits further applications on mobile devices with limited computational resources. PocketFlow aims at providing an easy-to-use toolkit for developers to improve the inference efficiency with little or no performance degradation. Developers only needs to specify the desired compression and/or acceleration ratios and then PocketFlow will automatically choose proper hyper-parameters to generate a highly efficient compressed model for deployment. PocketFlow was originally developed by researchers and engineers working on machine learning team within Tencent AI Lab for the purposes of compacting deep neural networks with industrial applications. For full documentation, please refer to [PocketFlow's GitHub Pages](https://pocketflow.github.io/). To start with, you may be interested in the [installation guide](https://pocketflow.github.io/installation/) and the [tutorial](https://pocketflow.github.io/tutorial/) on how to train a compressed model and deploy it on mobile devices. For general discussions about PocketFlow development and directions please refer to [PocketFlow Google Group](https://groups.google.com/forum/#!forum/pocketflow). If you need a general help, please direct to [Stack Overflow](https://stackoverflow.com/). You can report issues, bug reports, and feature requests on [GitHub Issue Page](https://github.com/Tencent/PocketFlow/issues). **News: we have created a QQ group (ID: 827277965) for technical discussions. Welcome to join us!** qr_code ## Framework The proposed framework mainly consists of two categories of algorithm components, *i.e.* learners and hyper-parameter optimizers, as depicted in the figure below. Given an uncompressed original model, the learner module generates a candidate compressed model using some randomly chosen hyper-parameter combination. The candidate model's accuracy and computation efficiency is then evaluated and used by hyper-parameter optimizer module as the feedback signal to determine the next hyper-parameter combination to be explored by the learner module. After a few iterations, the best one of all the candidate models is output as the final compressed model. ## Learners A learner refers to some model compression algorithm augmented with several training techniques as shown in the figure above. Below is a list of model compression algorithms supported in PocketFlow: | Name | Description | |:-----|:------------| | `ChannelPrunedLearner` | channel pruning with LASSO-based channel selection (He et al., 2017) | | `DisChnPrunedLearner` | discrimination-aware channel pruning (Zhuang et al., 2018) | | `WeightSparseLearner` | weight sparsification with dynamic pruning schedule (Zhu & Gupta, 2017) | | `UniformQuantLearner` | weight quantization with uniform reconstruction levels (Jacob et al., 2018) | | `UniformQuantTFLearner` | weight quantization with uniform reconstruction levels and TensorFlow APIs | | `NonUniformQuantLearner` | weight quantization with non-uniform reconstruction levels (Han et al., 2016) | All the above model compression algorithms can trained with fast fine-tuning, which is to directly derive a compressed model from the original one by applying either pruning masks or quantization functions. The resulting model can be fine-tuned with a few iterations to recover the accuracy to some extent. Alternatively, the compressed model can be re-trained with the full training data, which leads to higher accuracy but usually takes longer to complete. To further reduce the compressed model's performance degradation, we adopt network distillation to augment its training process with an ``` --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/tools/tencent-pocketflow`](/api/graphcanon/tools/tencent-pocketflow) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_