{"data":{"slug":"octoml-octoml-profile","name":"octoml-profile","tagline":"Home for OctoML PyTorch Profiler","github_url":"https://github.com/octoml/octoml-profile","owner":"octoml","repo":"octoml-profile","owner_avatar_url":"https://avatars.githubusercontent.com/u/53242847?v=4","primary_language":null,"stars":114,"forks":10,"topics":[],"archived":false,"github_pushed_at":"2023-04-24T17:58:51+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/octoml-octoml-profile","markdown_url":"https://www.graphcanon.com/tools/octoml-octoml-profile.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/octoml-octoml-profile","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=octoml-octoml-profile","description":"Home for OctoML PyTorch Profiler","homepage_url":null,"license":"Apache-2.0","open_issues":0,"watchers":3,"ai_summary":null,"readme_excerpt":"## Installation and Getting Started\n- Create and activate a python virtual environment. `Python 3.8` is recommended\n  and tested on both `Ubuntu` and `macOS`. `Python 3.10.9` is tested on `macOS`\n  with Apple silicon.\n\n  ```\n  python3 -m venv env\n  source env/bin/activate\n  ```\n- Install dependencies\n\n  PyTorch 2.0 and above is required. Below we install the cpu version for\n  simplicity; CUDA version works too.\n\n  ```\n  pip install --upgrade pip\n  pip install \"torch>=2.0.0\" torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu\n  pip install \"octoml-profile>=0.2.0\"\n  ```\n\n  You've completed installation! (If you have trouble, see [issues with installation](#issues-with-installation))\n\n- Next, try running this very simple example that shows how to integrate octoml-profile into your model code.\n\n  ```python\n  import torch\n  from torch.nn import Linear, ReLU, Sequential\n  from octoml_profile import accelerate, remote_profile\n\n  model = Sequential(Linear(100, 200), ReLU())\n\n  @accelerate\n  def predict(x: torch.Tensor):\n      return model(x)\n\n  with remote_profile():\n      for _ in range(3):\n          x = torch.randn(1, 100)\n          predict(x)\n  ```\n\n- The first time you run this, you'll be prompted to supply your API key.  \n\n  ```\n      ,-\"\"-.\n    /      \\    Welcome to OctoML Profiler!\n    :        ;\n    \\      /    It looks like you don't have an access token configured.\n      `.  .'     Please go to https://profiler.app.octoml.ai/ to generate one\n    '._.'`._.'   and then paste it here.\n\n  Access token: \n  ```\n  (<a href=\"https://profiler.app.octoml.ai/\">Sign up</a> so that you can generate an API token when prompted)\n\n- Once you've provided credentials, running this results in the following\n  output that shows times of the function being executed remotely on each\n  backend.\n\n  ```\n  Function `predict` has 1 profile:\n  - Profile `predict[1/1]` ran 3 times. (1 discarded because compilation happened)\n\n  Instance     Processor           Backend              Backend Time (ms)  Total Time (ms)  Cost ($/MReq)\n  =======================================================================================================\n  r6i.large    Intel Ice Lake CPU  torch-eager-cpu                  0.024            0.086          $0.00\n  g4dn.xlarge  Nvidia T4 GPU       torch-eager-cuda                 0.097            0.159          $0.02\n  g4dn.xlarge  Nvidia T4 GPU       torch-inductor-cuda              0.177            0.239          $0.03\n  -------------------------------------------------------------------------------------------------------\n  Total time above is `remote backend time + local python code time`,\n  in which local python code run time is 0.062 ms.\n  Graph level profile is located at /tmp/octoml_profile_8o45fe39/0/predict_1*\n  ```\n  To see more examples, see [examples/](examples).\n\n---\n\n### Issues with installation\n\n - If you are on macOS with Apple silicon and seeing `symbol not found in flat\n   namespace '_CFRelease'`, it is likely that you created a `venv` with python\n   installed by `conda`. Please make sure to deactivate any `conda`\n   environment(s) and use the system-shipped python on macOS to create `venv`.\n   Or follow the instructions below to create a conda environment.\n\n    ```\n    conda create -n octoml python=3.8\n    conda activate octoml\n    ```\n\n- If you see a version conflict, please install the pip dependencies above with `--force-reinstall`.\n\n- For any other problems, please file a github issue.","github_created_at":"2023-02-14T03:07:21+00:00","created_at":"2026-07-11T23:32:19.144575+00:00","updated_at":"2026-07-11T23:32:27.39018+00:00","categories":[{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[],"trust":{"provenance":{"is_fork":false,"github_id":601425509,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T23:32:23.794Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":1174,"last_release_at":null},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:32:24.352Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T23:32:23.475Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-07-11T23:32:23.475Z"}}}}