1 kilogram of feathers or 1 pound of steel
What it tests: Units over the memorised 'they weigh the same'.
Prompt length: 61 characters, roughly 20 tokens (estimate). · Evaluation results for many models ↗
Prompt
Which is heavier, 1 kilogram of feathers or 1 pound of steel?
How to grade it
The kilogram of feathers: 1 kg ≈ 2.2 lb, so it's more than twice as heavy as 1 lb of steel.
Answer check: 1 kg = 2.2046 lb.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
0/4
Where models usually fail
'They weigh the same', the answer to the original riddle with equal units.
Source
- Author
- GitHub @cpldcpu and contributors
- From
- Misguided Attention
- Exact file or post
- https://github.com/cpldcpu/MisguidedAttention/blob/bbae011e1fb5ce239373cb2f381787baec0dd236/README.md
- Licence
- CC0 1.0
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?