Search Beyond What Can Be Taught: Teaching Generators When to Look Things Up

Paper: 2607.05382 Authors: Haozhe Wang, Weijia Feng, Jinpeng Yu, Che Liu, Ping Nie, Fangzhen Lin, Jiaming Liu, Ruihua Huang, Jimmy Lin, Wenhu Chen Categories: cs.CV, cs.AI

The Gap

Visual generators like DALL-E, Midjourney, and FLUX have gotten impressively good at rendering. But here’s the dirty secret: they confidently hallucinate on anything outside their training data — new characters, trending memes, post-cutoff events, niche entities. Existing benchmarks (DrawBench, GenAI-Bench, T2I-CompBench) mostly test compositional skill and aesthetic quality, not factual grounding against the real world. Nobody has seriously stress-tested whether generators know what they don’t know.

The naive fix — just bolt a search engine onto the pipeline — sounds obvious. But the authors show it backfires: indiscriminate retrieval injects noise into prompts the generator already handles well, actually hurting quality. The missing piece is understanding where the generator’s knowledge ends and external knowledge must begin — a boundary that is specific to each generator and shifts over time as the visual world evolves.

Visual generators trained on fixed corpora
            |
            v
User requests are open-ended & long-tailed
            |
            v
Generator confidently hallucinates unknowns
            |
            v
+-- Naive search augmentation --+
|                                |
v                                v
Retrieves for ALL prompts    Misses the boundary
injects noise into           between known & unknown
prompts generator already    --> hurts quality
handles well                 --> 21-28/100 score
            |
            v
+-- Core insight --+
|                   |
v                   v
Knowledge boundary   Boundary is discoverable
is generator-        through teach-then-search
specific & evolving  co-training
            |
            v
Monotonic improvement even with minimal co-training

The Increment

One sentence: Before this paper, nobody had a benchmark for world-knowledge grounding in visual generation or a principled way to teach generators *when to search; after it, we have both — plus evidence that co-training on the knowledge boundary enables recursive self-improvement.

Core Mechanism

The method has three moving parts: (1) a benchmark that reveals the problem, (2) a search corpus that makes the problem reproducible offline, and (3) a co-training framework that teaches the generator to distinguish what it knows from what it doesn’t.

First, SearchGen-20K contains 20,839 prompts organized into twelve failure categories (new characters, trending entities, post-cutoff events, rare objects, etc.) across twenty-two domains. SearchGen-Bench is the evaluation subset. SearchGen-Corpus-1M is a pre-executed multimodal search corpus — the authors ran searches ahead of time so researchers can reproduce results without live API calls. This is a practical choice that removes a huge source of nondeterminism.

The co-training framework works in two alternating phases. In the “teach” phase, the generator is trained on prompts it already has the capacity to internalize from its own parameters — easy or familiar queries where external context is unnecessary. This establishes a baseline of what the generator can do. In the “search” phase, the generator is trained on prompts that require external knowledge, with retrieved context injected into the prompt. The key insight is that these two phases create a natural boundary: prompts the generator handles well in the teach phase are “inside” the boundary; prompts it fails on without search are “outside.” Over training iterations, the generator learns to route accordingly.

+-------------------+     +-------------------+
|   TEACH PHASE     |     |  SEARCH PHASE     |
|                   |     |                   |
| Prompt from       |     | Prompt that       |
| known-distrib     |     | requires external |
|                   |     | knowledge         |
|   v               |     |   v               |
| Generator         |     | Search engine     |
| learns from       |     | retrieves context |
| parameters only   |     |   v               |
|   v               |     | Context injected  |
| Establishes what  |     | into prompt       |
| it CAN render     |     |   v               |
|                   |     | Generator learns  |
|                   |     | to use external   |
|                   |     | info selectively  |
+--------+----------+     +--------+----------+
         |                         |
         v                         v
    Knowledge boundary emerges:
    what's internal vs what needs retrieval
         |
         v
    Co-trained router decides
    per-prompt: trust params or search?

Structural metaphor — the head chef and the cookbook:

Imagine training a head chef. You start by letting them cook dishes they already know by heart — pasta carbonara, Caesar salad, the classics. This is the teach phase: you’re establishing what’s in their head. Then you introduce dishes they’ve never made — a rare Peruvian ceviche, a trendy Korean fusion dish. You hand them a cookbook (the search corpus) for these. This is the search phase.

Now here’s the critical part: if you just hand the chef the cookbook for every dish, including the ones they already know, they get confused. They start second-guessing their instincts on carbonara because the cookbook’s recipe is slightly different. This is exactly what naive search does — it poisons prompts the generator already handles well.

The co-training is like a sous-chef who watches which dishes the head chef nails without the cookbook and which ones they botch. Over time, the sous-chef learns to only slide the cookbook across the counter when it’s actually needed. That sous-chef is the knowledge boundary — learned, not hard-coded, and it evolves as the chef (generator) improves.

Key Concepts

• Knowledge Boundary: Every trained model has a fuzzy line separating what it can render correctly from what it will hallucinate. This isn’t a fixed property of the model — it depends on the specific prompt. A generator might nail “Eiffel Tower at sunset” (common in training) but fail on “the new Apple Park campus auditorium” (rare, post-training). The boundary is invisible by default; you only discover it by testing. This paper’s contribution is making that boundary *discoverable through systematic benchmarking and co-training. Think of it like the edge of a map in an old video game — you don’t know where it ends until you walk there.

• Agentic Visual Generation: The idea that a generator shouldn’t be a single monolithic model, but an *agent that can decide when to use tools (search, retrieval, verification) and when to rely on its own parameters. This is the visual generation analog of tool-augmented LLMs like those using code interpreters or web browsing. The “agentic” part is the decision-making: the system chooses whether to search, what to search for, and how to integrate the result. Without this agency, you’re just concatenating search results onto prompts blindly.

• Teach-then-Search Co-training: A two-phase training loop that alternates between (a) training on tasks the model can handle alone, reinforcing its existing knowledge, and (b) training on tasks that require external information, teaching it to incorporate retrieved context. The boundary between phases is itself learned, not prescribed. This creates a virtuous cycle: as the model improves in phase (a), fewer prompts need phase (b), and the model focuses its external-knowledge capacity on genuinely hard cases.

Framework Shift

Before (mainstream approach):        After (this paper):
                                     
+-----------+                        +-----------+
|  Prompt   |                        |  Prompt   |
+-----------+                        +-----------+
      |                                   |
      v                                   v
+-----------+                        +------------------+
| Generator | (closed book)          | Am I confident?  |
+-----------+                        +--------+---------+
      |                                   yes/ \no
      v                                  /     \
   Image                           +----v--+ +-v------+
                                   |Render | | Search |
                                   | alone | | first  |
                                   +-------+ +---+----+
                                                 |
                                                 v
                                           +-----------+
                                           | Render    |
                                           | w/context |
                                           +-----------+
                                     
OR (naive search):
                                     
+-----------+                        Generator learns
|  Prompt   |                        its own knowledge
+-----------+                        boundary via
      |                              co-training,
      v                              then routes
+----------+                         accordingly
| Search   |
| EVERYTIME |
+----------+
      |
      v
+-----------+
| Generator |
| (w/noise) |
+-----------+

From monolithic generation (with or without blind search) to self-aware agentic generation, the core shift is that the model learns when it needs help rather than always or never asking for it.

Expert Assessment

Problem choice: This is a genuinely important gap. The long-tail knowledge problem in visual generation is real and underexplored. Most benchmarks reward compositional fidelity and aesthetics, not factual accuracy. The authors correctly identify that the problem isn’t just “add search” — it’s about *selective retrieval. This sits at a natural intersection of retrieval-augmented generation (well-studied for text) and visual generation (barely touched). Strong problem selection.

Method maturity: The insight is clever but the implementation is relatively straightforward — alternating training phases with a retrieval oracle. The “co-training” framing sounds more sophisticated than it is; in practice, it’s curriculum learning with a retrieval gate. There’s a risk that the knowledge boundary discovery relies heavily on the quality of the failure categorization in SearchGen-20K. Simpler approaches like confidence-threshold-based routing might work comparably but are not explored as baselines. The paper would benefit from ablations on what exactly makes co-training better than, say, a simple uncertainty estimator.

Experimental integrity: The benchmark is well-designed with twelve failure categories and twenty-two domains — this is thorough. The 21-28/100 baseline scores on SearchGen-Bench are striking and credible; frontier generators *do hallucinate on unfamiliar entities. However, the paper claims “monotonic improvement” from even minimal co-training, which sounds almost too clean. I’d want to see more stress-testing: what happens with adversarial prompts near the boundary? How sensitive is the system to the ratio of teach-to-search prompts? The pre-executed corpus (SearchGen-Corpus-1M) is a solid contribution for reproducibility, though it introduces a static snapshot that may drift from live search.

Writing quality: The paper is well-structured and the motivation is clearly articulated. The failure taxonomy (twelve categories) is a highlight. Where the authors cut corners: the related work section treats retrieval-augmented generation for text too superficially given how directly relevant it is. The transition from “boundary exists” to “boundary is discoverable via co-training” could use a more rigorous theoretical justification — right now it reads more as an empirical observation than a principled argument. Section 4 (the co-training framework) would benefit from pseudocode or a more formal algorithm description.

Verdict: weak accept — The problem is real and underappreciated, the benchmark is a genuine contribution, and the co-training insight is useful even if not deeply novel. But the method feels incremental rather than transformative, and the theoretical grounding is thin.

Takeaways

1. Benchmark the knowledge boundary, not just aesthetics. If you’re building or evaluating visual generators, stop only measuring compositionality and style. Create stress tests for factual grounding — trending entities, post-cutoff events, long-tail objects. This paper’s twelve-category failure taxonomy is directly reusable.

2. Blind retrieval augmentation hurts — gate it. If you’re adding search to any generative pipeline (visual or text), don’t retrieve for every input. Build a confidence-aware router that only retrieves when the model signals uncertainty. The teach-then-search alternation is a simple recipe for training such a router.

3. Pre-execute your retrieval corpus. The idea of running searches ahead of time and bundling the results into a static corpus for reproducibility is underrated. It eliminates latency, nondeterminism, and API costs during experimentation. Steal this for any retrieval-augmented project.

4. The knowledge boundary is model-specific and moving. Don’t assume a one-size-fits-all retrieval strategy. Different models (even different checkpoints) have different knowledge boundaries. Any retrieval-augmented system should be evaluated *per model, not assumed to transfer.