Skip to content

Latest commit

 

History

History
79 lines (60 loc) · 2.38 KB

get-started.mdx

File metadata and controls

79 lines (60 loc) · 2.38 KB
title Get Started
description Set up local inference with your agent or install manually
icon rocket

Set up with your agent

Send this prompt to your agent:

Set up local models for me with the Magnitude CLI. Install it with `npm i -g @magnitudedev/cli` (or my package manager), then run `magnitude docs onboarding` and follow the instructions.

Your agent will profile your hardware, walk you through the best local models for it, download the ones you pick, and switch itself over to them.

Install manually

Run these commands in your terminal to start the interactive setup:

```sh npm install -g @magnitudedev/cli magnitude setup ``` ```sh bun add -g @magnitudedev/cli magnitude setup ``` ```sh pnpm add -g @magnitudedev/cli magnitude setup ``` ```sh yarn global add @magnitudedev/cli magnitude setup ```

Interactive setup:

  1. Profiles your processor, memory, and memory bandwidth.
  2. Ranks model, quantization, and context combinations for your hardware.
  3. Shows the speed, intelligence, and memory trade-offs.
  4. Downloads and configures the model you choose.
  5. Connects the model to your chosen harness.
  6. Launches the harness with the model ready to use.

Magnitude supports the Magnitude Harness, Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline.

Magnitude supports macOS and Linux. Windows is supported through WSL.

Start working

Once setup is complete, continue in your harness. If your agent gives you handoff instructions, follow them first. Magnitude runs headlessly in the background, loads the model when your agent requests it, and manages memory and concurrency automatically.

You do not need to learn the Magnitude CLI. Your agent can inspect Magnitude and find, install, or switch local models later. You can also choose between installed models from your harness model dropdown.

Codex and Claude Code connections depend on the Magnitude background service, including when you switch back to their hosted models. Setup registers the service to start automatically when you log in.

Windows

On Windows, install WSL first:

wsl --install

Restart the computer, open WSL, then follow the installation steps above.