iPhone handheld shot

Every model got the same prompt. Here's what 33 models made, best first.

Results

  1. Tied first

    Grok Imagine · Reference to video

    Score 68 · 1 win, 0 losses

  2. Tied first

    Hailuo H3 Max Turbo (MiniMax)

    Score 68 · 1 win, 0 losses

  3. Tied first

    Seedance 2.0 Mini

    Score 68 · 1 win, 0 losses

From 6 blind votes by the Glif team and 3 AI judge scores. Scores are out of 100, and 50 is average for this test. See the full image-to-video leaderboard

How we score

Scores on this page come from this test alone and compare only the models that ran it. Leaderboard scores pool every test of the same kind.

Every model runs the same Glif tests. Team members see two outputs side by side without the model names and pick the one that better fits the test, or call it a tie. An AI judge also scores every output from 0 to 10.

A Bradley-Terry fit turns all those head-to-head results into one rating per model. Ties count as half a win, and each AI judge score counts as half a vote.

The score is the predicted chance people prefer this model's output to the average model's on the same board, so 50 is average. A board is one kind of task, like text-to-image. Scores only compare models on the same board.

The 90% range comes from resampling the votes and refitting many times. Overlapping ranges are close to a tie. A model ranks once it has 20 votes' worth of ratings on a board. Until then it shows no score, only how close it is.

What we look for

Handheld phone-selfie camera motion. Looks realistic; the character stays consistent.

Prompt

“An entity called Gliffy walks down an alleyway, filming himself with a phone.”

Input

Tests for

Spatial reasoning, consistency, reliability