{"data":{"slug":"mrgiovanni-modelsgenesis","name":"ModelsGenesis","tagline":"Foundation models for medical image analysis","github_url":"https://github.com/MrGiovanni/ModelsGenesis","owner":"MrGiovanni","repo":"ModelsGenesis","owner_avatar_url":"https://avatars.githubusercontent.com/u/9360531?v=4","primary_language":"Jupyter Notebook","stars":789,"forks":141,"topics":["3d-model","fine-tuning","foundation-models","pre-trained-model","representation-learning","self-supervised-learning","transfer-learning"],"archived":false,"github_pushed_at":"2025-06-22T18:38:37+00:00","maintenance_label":"Dormant","stars_delta_30d":1,"url":"https://www.graphcanon.com/tools/mrgiovanni-modelsgenesis","markdown_url":"https://www.graphcanon.com/tools/mrgiovanni-modelsgenesis.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/mrgiovanni-modelsgenesis","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=mrgiovanni-modelsgenesis","description":"[MICCAI 2019 Young Scientist Award] [MEDIA 2020 Best Paper Award] Models Genesis, one of the first \"foundation\" models in medical image analysis for multiple downstream tasks","homepage_url":null,"license":"Other","open_issues":28,"watchers":13,"ai_summary":"ModelsGenesis is among the earliest foundation models in medical imaging, supporting multiple downstream tasks through pre-trained representations.","readme_excerpt":"<p align=\"center\"><img width=\"70%\" src=\"figures/logo.png\" /></p>\n\n<div align=\"center\">\n\n\n\n\n</div>\n\nWe have built a set of pre-trained models called <b>Generic Autodidactic Models</b>, nicknamed <b>Models Genesis</b>, because they are created <i>ex nihilo</i> (with no manual labeling), self-taught (learned by self-supervision), and generic (served as source models for generating application-specific target models). We envision that Models Genesis may serve as a primary source of transfer learning for 3D medical imaging applications, in particular, with limited annotated data. \n\n<p align=\"center\"><img width=\"100%\" src=\"figures/patch_generator.png\" /></p>\n<p align=\"center\"><img width=\"85%\" src=\"figures/framework.png\" /></p>\n\n\n## Paper\nThis repository provides the official implementation of training Models Genesis as well as the usage of the pre-trained Models Genesis in the following paper:\n\n<b>Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysis</b> <br/>\n[Zongwei Zhou](https://www.zongweiz.com/)<sup>1</sup>, [Vatsal Sodha](https://github.com/vatsal-sodha)<sup>1</sup>, [Md Mahfuzur Rahman Siddiquee](https://github.com/mahfuzmohammad)<sup>1</sup>,  <br/>\n[Ruibin Feng](https://chs.asu.edu/ruibin-feng)<sup>1</sup>, [Nima Tajbakhsh](https://www.linkedin.com/in/nima-tajbakhsh-b5454376/)<sup>1</sup>, [Michael B. Gotway](https://www.mayoclinic.org/biographies/gotway-michael-b-m-d/bio-20055566)<sup>2</sup>, and [Jianming Liang](https://chs.asu.edu/jianming-liang)<sup>1</sup> <br/>\n<sup>1 </sup>Arizona State University,   <sup>2 </sup>Mayo Clinic <br/>\nInternational Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2019 <br/>\n<b>[Young Scientist Award](http://www.miccai.org/about-miccai/awards/young-scientist-award/)</b>  <br/>\n[paper](http://www.cs.toronto.edu/~liang/Publications/ModelsGenesis/MICCAI_2019_Full.pdf) | [code](https://github.com/MrGiovanni/ModelsGenesis) | [slides](https://docs.wixstatic.com/ugd/deaea1_c5e0f8cd9cde4c3db339d866483cbcd3.pdf) | [poster](http://www.cs.toronto.edu/~liang/Publications/ModelsGenesis/Models_Genesis_Poster.pdf) | talk ([YouTube](https://youtu.be/5W_uGzBloZs), [YouKu](https://v.youku.com/v_show/id_XNDM5NjQ1ODAxMg==.html?sharefrom=iphone&sharekey=496e1494c76ed263653aa3aada61c23e6)) | [blog](https://zhuanlan.zhihu.com/p/86366534)\n\n<b>Models Genesis</b> <br/>\n[Zongwei Zhou](https://www.zongweiz.com/)<sup>1</sup>, [Vatsal Sodha](https://github.com/vatsal-sodha)<sup>1</sup>, [Jiaxuan Pang](https://github.com/MRJasonP)<sup>1</sup>, [Michael B. Gotway](https://www.mayoclinic.org/biographies/gotway-michael-b-m-d/bio-20055566)<sup>2</sup>, and [Jianming Liang](https://chs.asu.edu/jianming-liang)<sup>1</sup> <br/>\n<sup>1 </sup>Arizona State University,   <sup>2 </sup>Mayo Clinic <br/>\nMedical Image Analysis (MedIA) <br/>\n<b>[MedIA Best Paper Award](http://www.miccai.org/about-miccai/awards/medical-image-analysis-best-paper-award/)</b>  <br/>\n[paper](https://arxiv.org/pdf/2004.07882.pdf) | [code](https://github.com/MrGiovanni/ModelsGenesis) | [slides](https://d5b3ebbb-7f8d-4011-9114-d87f4a930447.filesusr.com/ugd/deaea1_5ecdfa48836941d6ad174dcfbc925575.pdf) | [graphical abstract](https://ars.els-cdn.com/content/image/1-s2.0-S1361841520302048-fx1_lrg.jpg)\n\n<p float=\"center\">\n  <img width=\"30%\" src=\"figures/Young_Scientist_Award.JPG\" />\n  <img width=\"60%\" src=\"figures/MedIA_Best_Paper_Award.JPG\" /> \n</p>\n\n## Available implementation\n\n- keras/\n- pytorch/\n\n**&#9733; News: Models Genesis, incorporated with nnU-Net, [rank # 1](https://decathlon-10.grand-challenge.org/evaluation/challenge/leaderboard/) in segmenting liver/tumor and hippocampus.**\n- competition/\n\n\n## Major results from our work\n\n1. **Models Genesis outperform 3D models trained from scratch**\n2. **Models Genesis top any 2D approaches, including ImageNet models and degraded 2D Models Genesis**\n3. **Models Genesis (2D) offer performances equivalent to supervised pre-trained models**\n\nThe par plots pres","github_created_at":"2019-07-24T19:07:19+00:00","created_at":"2026-07-11T11:40:25.8361+00:00","updated_at":"2026-08-24T06:01:14.07423+00:00","categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"3d-model","name":"3d-model"},{"slug":"fine-tuning","name":"fine-tuning"},{"slug":"foundation-models","name":"foundation-models"},{"slug":"pre-trained-model","name":"pre-trained-model"},{"slug":"representation-learning","name":"representation-learning"},{"slug":"self-supervised-learning","name":"self-supervised-learning"},{"slug":"transfer-learning","name":"transfer-learning"}],"trust":{"provenance":{"is_fork":false,"github_id":198694912,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-24T06:01:13.326Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":427,"last_release_at":null,"stars_delta_30d":1,"open_issues_delta_30d":0},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T11:40:27.219Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-24T06:01:13.790Z"},"languages":{"value":["jupyter notebook"],"source":"github.language","observed_at":"2026-08-24T06:01:13.790Z"},"license_spdx":{"value":"Other","source":"github.license","observed_at":"2026-08-24T06:01:13.790Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":{"notes":["Jupyter Notebook environment is required for leveraging ModelsGenesis pre-trained models and conducting fine-tuning."],"requires_docker":false},"constraints":{"requires_docker":false},"when_to_use":["If you are working on downstream tasks in medical image analysis where a robust foundation model enhances accuracy and reduces training time","When focusing on tasks requiring complex representation learning such as 3D models, ModelsGenesis provides a solid base for fine-tuning"],"when_not_to_use":["Avoid if your project requires real-time inference capabilities, as ModelsGenesis focuses more on improving model quality through extensive pre-training rather than optimizing for speed","Not recommended if you are in need of domain-general foundation models that work across various industries, as it is specialized strictly towards medical imaging"],"source":"enrich:decision_facts","observed_at":"2026-07-15T09:50:42.960Z"},"constraint_facets":{"requires_docker":false},"decision_summary":[{"label":"Requirements","value":"Jupyter Notebook environment is required for leveraging ModelsGenesis pre-trained models and conducting fine-tuning."},{"label":"Adopt for","value":"ModelsGenesis is notable for its foundational approach to pre-trained models specific to medical imaging tasks, with awards validating its contribution to the field of transfer learning and self-supervised strategies."},{"label":"License detail","value":"Other: The precise licensing terms must be verified directly from the tool's official documentation or repository to understand usage rights."}]}}