All prompts › Common sense

Juggler, two balls and a balloon

What it tests: Tracking time and gravity in a distracting scene.

Prompt length: 472 characters, roughly 120 tokens (estimate).

A juggler throws a solid blue ball a meter in the air and then a solid purple ball (of the same size) two meters in the air. She then climbs to the top of a tall ladder carefully, balancing a yellow balloon on her head. Where is the purple ball most likely now, in relation to the blue ball?
A. at the same height as the blue ball
B. at the same height as the yellow balloon
C. inside the blue ball
D. above the yellow balloon
E. below the blue ball
F. above the blue ball

How to grade it

A (at the same height as the blue ball). By the time she has carefully climbed a tall ladder, both balls have long since fallen and lie on the ground.

Answer check: Official answer key in simple_bench_public.json: A.

Where models usually fail

Answering 'above the blue ball' because it was thrown higher.

Source

Testing a local model? Check first whether it fits your hardware with Can I run this LLM?

More in Common sense

• Ice cubes in a frying pan (hard)
• Duct-taped sandwich stack (hard)
• Glove drops from a car on a bridge (hard)