Cat in space

Every model got the same prompt. Here's what 22 models made, best first.

Results

  1. Won

    GPT Image 2.5

    Score 87 · 6 wins, 0 losses, 2 ties · Judge 8/10

  2. #2 of 13

    Seedream 5.0 Lite

    Score 74 · 3 wins, 1 loss · Judge 7.5/10

  3. #3 of 13

    Ideogram V4.5

    Score 70 · 20 wins, 9 losses, 1 tie · Judge 7.2/10

From 62 blind votes by the Glif team and 13 AI judge scores. Scores are out of 100, and 50 is average for this test. See the full text-to-image leaderboard

How we score

Scores on this page come from this test alone and compare only the models that ran it. Leaderboard scores pool every test of the same kind.

Every model runs the same Glif tests. Team members see two outputs side by side without the model names and pick the one that better fits the test, or call it a tie. An AI judge also scores every output from 0 to 10.

A Bradley-Terry fit turns all those head-to-head results into one rating per model. Ties count as half a win, and each AI judge score counts as half a vote.

The score is the predicted chance people prefer this model's output to the average model's on the same board, so 50 is average. A board is one kind of task, like text-to-image. Scores only compare models on the same board.

The 90% range comes from resampling the votes and refitting many times. Overlapping ranges are close to a tie. A model ranks once it has 20 votes' worth of ratings on a board. Until then it shows no score, only how close it is.

What we look for

Adheres to all elements in the prompt. Physically-sound space scene.

Prompt

“Highly detailed photo of a cat floating in space, wearing a space suit and trying to play with a ball of yarn. ISS, earth and the sun visible in the background. At the edge of the image a black hole is barely visible. The black hole gradually distorts the space and light around it.”

Tests for

Prompt adherence, world knowledge