All prompts › Instruction following
Exactly 5 paragraphs, *** separators, 3 highlights, one banned word
What it tests: Several independent format constraints at once, plus a forbidden word.
Prompt length: 355 characters, roughly 90 tokens (estimate).
I would like to start my own business. Can you give me some general advice? Please avoid mentioning "photography" - I have no interest in that market. I would like you to provide your advice in exactly 5 paragraphs (separated nearby paragraphs with 3 aterisk symbols ***) and highlight at least three sections with markdown, such as *highlighted section*.
How to grade it
Exactly 5 paragraphs separated by ***; at least 3 *highlighted* sections in markdown; the word 'photography' never appears.
Answer check: Constraints from IFEval key 1342: keywords:frequency, detectable_format:number_highlighted_sections, length_constraints:number_paragraphs.
Check an answer
Paste the model's answer. The checks run in your browser; nothing is sent anywhere.
Scorecard tick what the model got right: 0/4
Runs in your browser; nothing is saved or sent.
Where models usually fail
4 or 6 paragraphs; --- or blank lines instead of ***; mentioning photography while saying it won't.
Source
- Author
- Google Research (Zhou et al., 2023)
- From
- IFEval (Instruction-Following Eval)
- Exact file or post
- https://github.com/google-research/google-research/blob/0d94f8c4d92678ce5f7a0eacae725f79174cfb03/instruction_following_eval/data/input_data.jsonl
- Licence
- Apache-2.0
- How we use it
- Full text (licence allows reuse)
Testing a local model? Check first whether it fits your hardware with Can I run this LLM?