13 coins, one fake, and a digital scale
What it tests: Adapting to the tool actually given: a digital scale shows weights; it isn't a two-pan balance.
Prompt length: 99 characters, roughly 20 tokens (estimate). · Evaluation results for many models ↗
I have 13 coins, one of them is fake. I also have a digital scale. How do I identify the fake coin?
How to grade it
Weigh the coins one at a time (or in known-size groups) and find the one whose weight differs. A good answer notes that you need the genuine weight (most coins share it) and that the fake could be heavier or lighter. A three-weighing balance scheme is wrong for this tool.
Answer check: Reasoned from the premise; several valid procedures exist.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
Where models usually fail
The classic balance-scale procedure with left and right pans; nonsensical groupings of 13.
Source
- Author
- GitHub @cpldcpu and contributors
- From
- Misguided Attention
- Exact file or post
- https://github.com/cpldcpu/MisguidedAttention/blob/bbae011e1fb5ce239373cb2f381787baec0dd236/README.md
- Licence
- CC0 1.0
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?