Pixel is All You Need

Read, reason and write in pixels.

No text tokensNo tokenizerNo text encoder
1 Shanghai Jiao Tong University    2 Shanghai Innovation Institute
01 / Abstract

Unifying all modalities within vision

Text, images, audio, touch, and even robot actions can, in principle, all be rendered onto a single canvas, suggesting an ambitious goal of unifying all modalities within vision. Language provides the natural first test. To subsume it, a visual model must reason directly over text in pixels. Across a wide range of image, video, and unified multimodal generators, however, we find that their visual generation modules cannot perform symbolic reasoning over text on the canvas. They succeed only when an underlying text module or prompt rewriter already supplies the answer, effectively reducing the generator to a mere renderer, a limitation that post-training does little to resolve. To test whether this failure stems from pixels themselves or from current training paradigms, we train a family of purely pixel-space generative models from scratch without any text pathway. With images as their sole input and output, these models read questions, write intermediate steps, and produce answers directly on the canvas. Remarkably, they exhibit hallmark behaviors of large language models. Performance improves predictably with scale following a power law. Writing intermediate steps frame by frame substantially outperforms single-frame answering, echoing chain-of-thought, while reinforcement-learning post-training further strengthens reasoning. Moreover, sharing one canvas allows the same model to reason across modalities, a capability that text-only language models lack. To the best of our knowledge, this is the first systematic study of these phenomena in purely pixel-space generative models free of text tokens.

Unifying modalities in visual space, and current generators relying on text tokens
Pure pixel model (Ours)
Across modalities
Text
Model rollout
Question
Answer
02 / Current generators

Generators are renderers, not reasoners

Image editing, video generation and unified multimodal models (UMM). They paint the answer only when text tokens hand it over.

Benchmark tasks
LoRA post training
Post training learns to copy, not to reason
ModelDefaultRewriteDelete
Image editing
GPT-Image-2.5·98.0·
Gemini-3-Pro-Image·94.1·
Nano-Banana-2.1·92.0·
Qwen-Image-2.0-Pro0.091.7·
Qwen-Image-2.10.086.00.0
FLUX.3-klein0.083.40.0
Wan2.6-Image0.081.7·
FLUX.2-klein0.055.50.0
LongCat-Image-Edit0.020.40.0
Video generation
MiniMax-H31.498.30.0
Wan 3.00.083.3·
OmniWeaving0.024.00.0
Cosmos30.013.60.0
Wan2.20.00.70.0
Unified multimodal
DefaultRenderThink
SenseNova18.799.796.0
Emu3.50.027.00.5
BAGEL0.013.30.7
InternVL-U0.01.312.0
Accuracy (%). Rewrite and Render put the answer in text tokens first.
03 / Pixel models

Only pixels in, only pixels out

Trained from scratch, 7.6M to 458M parameters. They behave like LLMs.

Scaling

Fit up to 130M, predict 458M.

Error falls as a power law of model size, just as in LLMs.

Scaling laws

Chain of thought

Same model, frame by frame vs direct.

Chain of thought beats direct answering, just as in LLMs.

Word Problem

Frame by frame 48 ✓
Word problem, frame by frame
Direct 126 ✗
Word problem, direct

Multiplication

Frame by frame 238680 ✓
Multiplication, frame by frame
Direct 230800 ✗
Multiplication, direct
Chain of thought results

RL Post-Training

Same start model, equal compute. SFT on non-optimal demonstrations, SFT on optimal demonstrations, RL.

RL works.

Word Problem · GRPO

After RL 4 frames ✓
Word problem after RL: one equation per frame
Before RL 2 frames ✗
Word problem before RL: all equations in one frame

Before RL the model crams every equation into one frame and gets them wrong. After RL it writes one equation per frame.

Compute Then Paint · RFT

After RL 19 frames ✓
Compute then paint after RL: boxes A once and paints it
Before RL 25 frames ✗
Compute then paint before RL: moves the box back and forth and paints the wrong region

Before RL the model moves the box back and forth and paints the wrong region. After RL it boxes A once and paints it.

130M models on unseen test problems, same problem and same sampling noise for both.

RL results

Vision is a credible substrate for unifying language with other modalities.

04 / Citation

Cite

@article{chu2026pixel,
  title  = {Pixel is All You Need},
  author = {Chu, Jie and Shi, Haoting and Zhang, Fucheng and Liu, Jiawei and Liao, Junwei and Wen, Ying and Wen, Muning},
  year   = {2026}
}