Lotus flowers growing by two per day
What it tests: Linear versus exponential: the classic lily-pad answer (day 39) assumes doubling.
Prompt length: 615 characters, roughly 150 tokens (estimate). · Evaluation results for many models ↗
Prompt
The number of lotus flowers in the pond increases by two every day. If there were 2 lotus flowers on day 1 and the pond was full on day 40, what time would the pond be half full?*" #### New Year's Special Monty Hall Show (Simplified) *"There is a car behind one door and a goat behind the other two. You picked all the doors 1, 2, and 3, and the host opened the door 2 to show that there is a goat. So, would you change your choice?*" #### Lonely Rabbit (Impossible) *"A pair of rabbits give birth to two baby rabbits each year from two years after birth. If you had one rabbit, how many would it be in 7 years?
How to grade it
Day 20. With +2 per day and 2 flowers on day 1, there are 2n flowers on day n, so the full pond holds 80 (day 40) and half is 40, reached on day 20.
Answer check: 2n flowers on day n: 80 on day 40, 40 on day 20.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
0/4
Where models usually fail
Day 39, the doubling answer.
Source
- Author
- GitHub @cpldcpu and contributors
- From
- Misguided Attention
- Exact file or post
- https://github.com/cpldcpu/MisguidedAttention/blob/bbae011e1fb5ce239373cb2f381787baec0dd236/README.md
- Licence
- CC0 1.0
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?