All prompts › Instruction following
No commas, no letter c, at least 250 words
What it tests: Holding a character-level constraint over a long answer; 'c' is everywhere in research vocabulary.
Prompt length: 293 characters, roughly 70 tokens (estimate).
Write a short proposal for a new research project that investigates how language evolves over time. I want to make it challenging, so: 1. Do not include any commas in your response. 2. Do not include the letter "c" anywhere in your response. 3. Your response should contain at least 250 words.
How to grade it
Machine-checkable: zero commas, zero letters 'c' (either case), at least 250 words. Use the checker on this page.
Answer check: Constraints from IFEval key 1300: punctuation:no_comma, keywords:letter_frequency, length_constraints:number_words.
Check an answer
Paste the model's answer. The checks run in your browser; nothing is sent anywhere.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
Where models usually fail
A single 'c' slipping in after 100 words (project, science, change …); commas creeping back into lists.
Source
- Author
- Google Research (Zhou et al., 2023)
- From
- IFEval (Instruction-Following Eval)
- Exact file or post
- https://github.com/google-research/google-research/blob/0d94f8c4d92678ce5f7a0eacae725f79174cfb03/instruction_following_eval/data/input_data.jsonl
- Licence
- Apache-2.0
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?