Try your setup
Less guesswork. More headroom.
Choose a model and hardware. Adjust the context and memory assumptions to see what changes.
Will it run?
Memory + speed estimateLoading the local dataset…
estimated tokens / sec
Model weightsKV cacheOverhead
Estimated, not benchmarked. Calculations stay in this browser. See the methodology.