exploration
10 minExploring Small/Local Models
open-source
local-models
gemma
llama
Tools:LM Arena
Explore the capabilities of 'open' or small models that could run on local devices, comparing their performance to massive frontier models.
Step 1 of 3
Setup Comparison
Navigate to LM Arena Side-by-Side.
Select Models
In the dropdowns, select a small model on one side (e.g., Gemma-2-9b or Llama-3-8b) and a larger frontier model on the other.
Evaluate
Ask both models the same factual or reasoning questions. Does the smaller model hallucinate more? Is the language less natural? Note the trade-offs between size and capability.