River crossing where the boat fits both
What it tests: Resisting a memorised multi-trip puzzle solution when one trip is enough.
Prompt length: 147 characters, roughly 40 tokens (estimate). · Evaluation results for many models ↗
Prompt
A man with his sheep wants to cross a river. He has a boat that can carry both him and the animal. How do both get to the other side of the river?
How to grade it
The man and the sheep get into the boat together and cross once. Nothing else is needed.
Answer check: Direct from the premise: the boat carries both.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
0/4
Where models usually fail
Back-and-forth trips; worrying that the sheep will be eaten or will eat grass.
Source
- Author
- GitHub @cpldcpu and contributors
- From
- Misguided Attention
- Exact file or post
- https://github.com/cpldcpu/MisguidedAttention/blob/bbae011e1fb5ce239373cb2f381787baec0dd236/README.md
- Licence
- CC0 1.0
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?