Measure 4 litres with a 6 l and a 12 l jug
What it tests: Checking feasibility before searching: every measurable amount is a multiple of gcd(6, 12) = 6.
Prompt length: 67 characters, roughly 20 tokens (estimate). · Evaluation results for many models ↗
Prompt
I have a 6- and a 12-liter jug. I want to measure exactly 4 liters.
How to grade it
It can't be done with these two jugs alone, because every measurable amount is a multiple of 6 litres. Partial credit if the model says so after some trial and error; none for a fake sequence of pours.
Answer check: gcd(6, 12) = 6, and 4 is not a multiple of 6.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
0/4
Where models usually fail
Long pour sequences that 'end' at 4 litres through an arithmetic slip.
Source
- Author
- GitHub @cpldcpu and contributors
- From
- Misguided Attention
- Exact file or post
- https://github.com/cpldcpu/MisguidedAttention/blob/bbae011e1fb5ce239373cb2f381787baec0dd236/README.md
- Licence
- CC0 1.0
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?