Inverse_IFEval
- Type
- dataset
- Venue
- m-a-p
- Year
- 2026
- Source
- huggingface
- Access
- free
- Added
- 2026-07-17T19:57:59.557238+00:00
- Verified
- 2026-07-17T19:57:59.557238+00:00
Summary
Inverse IFEval is a novel benchmark designed to evaluate large language models' (LLMs) ability to follow counterintuitive instructions that deliberately deviate from conventional training paradigms. The dataset challenges models to override their ingrained training conventions and faithfully execute instructions that conflict with standard cognitive patterns or annotation norms.
Keywords
hf-dataset json text datasets pandas mlcroissant polars instruction_following has-paper
Research notes
- downloads=247; likes=26