Perceive-to-Reason: Teaching Vision Models to See Before They Think

Paper: 2607.01191 Authors: Hongxing Li, Xiufeng Huang, Dingming Li, Wenjing Jiang, Zixuan Wang, Haolei Xu, Hanrong Zhang, Haiwen Hong, Longtao Huang, Hui Xue Categories: cs.CV

The Gap

Fine-grained visual reasoning — answering questions about tiny details in high-resolution images — remains surprisingly hard for vision-language models. The core issue: when critical visual cues are small and buried in a 4K or 8K image, models struggle to both find them and reason about them simultaneously.

Prior approaches tried to fix this in two ways. First, repeated cropping: feeding the model multiple cropped regions and hoping it stumbles onto the right evidence. Second, test-time visual search: external tools that scan the image and propose regions of interest. Both have the same fundamental flaw — they don’t explicitly separate *what to look at from what to conclude. The model has to simultaneously figure out where to focus and what that focus means, a dual burden that degrades both tasks.

The logical path from gap to contribution:

High-resolution images with small critical details
                    |
                    v
Models fail when perception + reasoning are entangled
                    |
                    v
Prior fixes: cropping / visual search (implicit coupling)
                    |
                    v
Hypothesis: Explicitly decoupling will help both stages
                    |
                    v
Method: P2R (Perceiver -> Reasoner) + PRA-GRPO training
                    |
                    v
Evidence: +6-10% on high-res benchmarks, transfers to general tasks
                    |
                    v
Conclusion: Decoupling perception from reasoning is a viable paradigm

The Increment

One sentence: Before this paper, models fumbled with perception and reasoning as one tangled task; after, they have a clean two-stage pipeline where perception feeds annotated evidence to reasoning — and a reinforcement learning strategy that trains each stage to excel at its specific role.

Core Mechanism

P2R (Perceive-to-Reason) works as a two-stage pipeline built on top of Qwen3-VL-Instruct models. In stage one, the Perceiver takes the high-resolution image and the question, then outputs bounding boxes around question-relevant regions. This produces an annotated image with visual markers highlighting where the answer-relevant evidence lives. In stage two, the Reasoner receives both the original image and the cropped evidence regions, then generates the final answer. The key insight: by explicitly localizing evidence first, the Reasoner can focus purely on logical inference rather than also hunting for visual clues.

The training innovation is PRA-GRPO (Perception-Reasoning Alternating GRPO). Standard GRPO treats the model as a monolithic agent. PRA-GRPO instead alternates between two training modes. In perception-focused updates, the model is rewarded primarily for correct localization — did it box the right region? In reasoning-focused updates, the reward emphasizes answer correctness given perfect evidence. This role-aware alternation means the model learns each skill separately while using only final-answer supervision (no bounding box annotations needed during training).

Input: High-res Image + Question
                |
                v
    +---------------------------+
    |      PERCEIVER STAGE      |
    |  (localize evidence)      |
    |                           |
    |  Image + Question -->     |
    |    Bounding Boxes         |
    +---------------------------+
                |
                v
    Annotated Image + Cropped Regions
                |
                v
    +---------------------------+
    |      REASONER STAGE       |
    |  (infer answer)           |
    |                           |
    |  Evidence + Question -->  |
    |    Final Answer           |
    +---------------------------+
                |
                v
    Training: PRA-GRPO alternates
    between perception rewards
    and reasoning rewards

Think of it like a crime scene investigation. The old approach hands a detective a blurry photo and says “solve the case” — they have to simultaneously scan every detail, remember what’s relevant, and piece together the story. Exhausting and error-prone. P2R separates the work: first, a forensic technician (Perceiver) carefully examines the scene, circles the fingerprints, marks the footprints, highlights the torn fabric on the fence. They produce an annotated evidence board. Then a lead detective (Reasoner) walks in, looks at the organized evidence board, and makes the logical connections to solve the case. Neither person has to do both jobs. The technician gets good at spotting clues; the detective gets good at connecting them. PRA-GRPO is like alternating training sessions — Monday you drill evidence collection, Tuesday you drill deduction — so each skill sharpens independently, even though you only check whether the final case was solved correctly.

Key Concepts

• Perception-Reasoning Decoupling: Vision-language models traditionally process images and text in one forward pass, mixing “what do I see” with “what does it mean.” This paper argues these are fundamentally different cognitive operations. Perception is about spatial attention — scanning, filtering, locating. Reasoning is about logical inference — combining evidence, applying world knowledge, drawing conclusions. When forced together, neither gets done well. The decoupling is simple but load-bearing: by making perception an explicit first step with its own output (bounding boxes), the model can allocate capacity appropriately.

• PRA-GRPO (Perception-Reasoning Alternating GRPO): GRPO is a reinforcement learning method where the model generates multiple candidate outputs and gets rewarded based on which ones are correct. PRA-GRPO adds a twist: it alternates which part of the pipeline gets the training signal. In perception phase, the reward weights localization quality higher. In reasoning phase, it weights answer correctness higher. Crucially, this works with only final-answer supervision — you don’t need annotated bounding boxes during training. The model learns to localize because good localization leads to better answers.

Framework Shift

Before (mainstream):                    After (this paper):

  Image + Question                      Image + Question
       |                                      |
       v                                      v
  +----------+                         +-------------+
  |  Single  |                         |  Perceiver  |
  |  Model   |                         | (localize)  |
  |          |                         +------+------+
  | (search  |                                |
  |  + reason|                                v
  |  together|                         Annotated Evidence
  |  )       |                                |
  +----+-----+                         +------v------+
       |                               |  Reasoner   |
       v                               | (infer)     |
    Answer                             +------+------+
                                               |
                                               v
                                            Answer

From tangled end-to-end processing to explicit two-stage pipeline, the core shift is making perception a discrete, inspectable first step rather than an implicit subtask hidden inside the model’s attention patterns.

Expert Assessment

Problem choice: This is a real gap. High-resolution visual reasoning is genuinely underserved — most VLM research focuses on standard-resolution benchmarks, and the few approaches to high-res images (tiling, cropping) are engineering hacks rather than principled solutions. The paper sits at a productive intersection of multimodal reasoning and efficient visual attention, an area that will only grow as image resolutions increase and applications demand fine-grained understanding.

Method maturity: Mixed. The two-stage decoupling is a clean, principled insight — arguably the kind of thing that should have been tried earlier. PRA-GRPO is clever but somewhat brute-force; the alternation schedule introduces hyperparameters that the paper doesn’t deeply investigate. The reliance on bounding boxes as the perception output is also a constraint — some evidence might be better represented as segmentation masks or saliency maps. Simpler approaches like attention-based evidence extraction might work but weren’t thoroughly compared.

Experimental integrity: Generally solid. The benchmarks (V-Star, HR-Bench-4K/8K) are appropriate and the improvements are substantial (6-10% over backbone). The ablation studies show that both the decoupling and PRA-GRPO contribute. However, the paper could be stronger on two fronts: (1) it doesn’t compare against recent visual search methods at matched compute budgets — the repeated-cropping baselines seem like strawmen; (2) the “extends to broader multimodal tasks” claim is supported with limited experiments. The 2B/4B/8B scale comparison is nice but expected to show proportional gains.

Writing quality: The paper reads well and the motivation is clear. The weakest section is the related work — it briefly mentions prior approaches without deeply engaging with why they fail in specific scenarios. A stronger related work section that identifies precise failure modes of competing methods would elevate the argument. The PRA-GRPO section could also benefit from more intuition before diving into the algorithm.

Verdict: weak accept — The core insight (decouple perception and reasoning) is sound and the results are strong, but the method has room for simplification and the experimental comparison could be tighter.

Takeaways

Three concrete things to steal:

1. The decoupling principle: If your model does two qualitatively different things (find evidence, then reason about it), consider making them explicit stages with distinct outputs. This applies beyond vision — in document QA, for instance, you could separate “locate relevant passages” from “answer based on passages.”

2. Role-aware RL alternation: If you’re using GRPO or similar methods for multi-step tasks, alternating which step gets the training signal can outperform treating the whole pipeline as one agent. This is cheaper than collecting step-level supervision.

3. Bounding boxes as intermediate representations: Even for tasks that don’t require spatial output, forcing the model to produce bounding boxes can serve as a bottleneck that improves downstream reasoning. It’s a form of structured intermediate supervision that’s free (you only need final-answer labels).