VRAM Planner

Plan model placement before loading weights.

Pick a target GPU, add models, and compare the simulated plan with live NVIDIA GPU memory when available.

Target GPU

System RAM (GB)

Spill strategy

Model Catalog

49 models

Select a GPU, then add models from the catalog.

Machine View

Select a GPU to start planning.

Each model is broken down into weights, KV cache, and headroom.

Target GPU