octoai

OctoAI — independent third-party profile of a public API surface, by API Evangelist. OctoAI (formerly OctoML) was a Seattle-based AI inference platform founded in 2019 as a University of Washington Allen School spin-out of the Apache TVM project. The company originally focused on machine-learning model optimization and compilation across CPUs, GPUs

GitHub

Official source

Start locally with the CLI guide