Edit from markup (garden)

How 21 models handled “Edit from markup (garden)” from our eval suite, FLUX.2 Klein 9B Image Generator first, then newest model first.

What we look for

Edits only the marked up area. Removes markup. Knows plant names and appearances.

Prompt

“Change the plant in the marked up area to Nepeta faassenii. Then remove the markup.”

Input

Tests for

Image editing, world knowledge