Glove drops from a car on a bridge
What it tests: Ignoring irrelevant vectors (river, wind, car speed): the glove falls onto the bridge.
Prompt length: 763 characters, roughly 190 tokens (estimate).
Prompt
A luxury sports-car is traveling north at 30km/h over a roadbridge, 250m long, which runs over a river that is flowing at 5km/h eastward. The wind is blowing at 1km/h westward, slow enough not to bother the pedestrians snapping photos of the car from both sides of the roadbridge as the car passes. A glove was stored in the trunk of the car, but slips out of a hole and drops out when the car is half-way over the bridge. Assume the car continues in the same direction at the same speed, and the wind and river continue to move as stated. 1 hour later, the water-proof glove is (relative to the center of the bridge) approximately A. 4km eastward B. <1 km northward C. >30km away north-westerly D. 30 km northward E. >30 km away north-easterly. F. 5 km+ eastward
How to grade it
B (less than 1 km northward). The glove drops onto the bridge deck, not into the river, and stays there; the river and the car's speed don't move it.
Answer check: Official answer key in simple_bench_public.json: B.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
0/4
Where models usually fail
Adding up the river current and answering 5 km east or 30 km north.
Source
- Author
- SimpleBench team
- From
- SimpleBench (public sample)
- Exact file or post
- https://github.com/simple-bench/SimpleBench/blob/fbc2e429085bdedad7d1a236d2bc9bc18c95f16e/simple_bench_public.json
- Licence
- MIT
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?
More in Common sense
- Ice cubes in a frying pan (hard)
- Juggler, two balls and a balloon (hard)
- Duct-taped sandwich stack (hard)