Agents-K1: From Flat Citations to Agent-Native Knowledge Graphs

Paper: 2606.13669 Authors: Zongsheng Cao, Bihao Zhan, Jinxin Shi, Jiong Wang, Fangchen Yu, Zhijie Zhong, Zijie Guo, Tianshuo Peng, Zhuo Liu, Yi Xie Categories: cs.AI

The Gap

Existing LLM-based research agents (e.g., GPT-Researcher, AutoGPT) rely on agent orchestration—scheduling tool calls and memory—but treat knowledge as flat text or simple cites edges. They read only abstracts, ignore figures, and collapse method lineage into a single sentence. Specific prior works like PaperQA and ScholarBERT still extract only surface entities (titles, authors, citations) and miss the internal structure: claims, supporting evidence, experimental mechanisms, and the genealogies of algorithms. This paper closes the gap between “agent that can search papers” and “agent that understands scientific knowledge” by building an end-to-end pipeline that converts raw PDFs into a knowledge graph with typed entities, relations, multimodal evidence, and citation context—all designed to be consumed natively by an LLM agent.

       Problem               Assumption                Method
+------------------+   +--------------------+   +---------------------+
| Agents flatten   |   | Full paper con-   |   | 3-stage pipeline:   |
| papers to abs-  |   | tains the needed  |   | parser + trained    |
| tract + cites.   |-->| structure, but no |-->| model + unified CLI.|
| No claim, evid-  |   | tool extracts it. |   | Also releases 1M    |
| ence, or lineage.|   |                    |   | papers as KG.       |
+------------------+   +--------------------+   +---------------------+
                                                       |
                                                       v
         Evidence                  Conclusion
+----------------------+   +-----------------------+
| Outperforms existing |   | Agents-K1 makes it    |
| IE methods (F1 +20%) |-->| possible to build     |
| on SciEval+ benchmark|   | agent-native KGs from |
| and shows multi-hop  |   | raw papers at scale.  |
| reasoning gains.     |   | Scholar-KG is open.   |
+----------------------+   +-----------------------+

The Increment

One sentence: Before this paper, agents could only skim abstracts and follow citation links; after, they can query a dense knowledge graph that encodes claims, evidence, mechanisms, and method lineages—directly from full PDFs.

Core Mechanism

Agents-K1 integrates three modules into a single pipeline. The first is a multimodal parser with a five-module schema: it extracts named entities (e.g., task, method, dataset), typed relations (e.g., uses, improves), multimodal evidence (figures, tables, equations), citation contexts (why a cite was made), and method lineage (e.g., algorithm X is based on Y). The parser works on full paper text, not just abstracts, and operates at the passage level rather than sentence level to catch cross-paragraph relations.

The second module is a 4B-parameter information extraction backbone trained with GRPO (Group Relative Policy Optimization) under a rule-based reward. The reward scores extracted triples on granularity (e.g., “ResNet” is more informative than “CNN”), relation coverage, and factual consistency with the source. GRPO allows the model to learn from its own exploration during training, reducing the need for massive human-annotated data.

The third module is a graph-anything CLI, a tri-source agent interface that unifies: (i) web search for external context, (ii) multimodal graph retrieval (get nodes+images+formulas), and (iii) cross-document traversal (follow typed edges across papers). The agent can issue commands like kg search "attention mechanism improves OOD detection" and receive not just text but structured evidence paths.

            raw PDFs
               |
         +-----v------+
         | Multimodal  |
         | Parser      |
         | (5 modules) |
         +------+------+
                |
         structured passages
                |
         +------v------+
         | 4B IE Model  |<--- GRPO + rule reward
         | (GRPO)       |
         +------+------+
                |
         +------v------+
         | Knowledge    |
         | Graph        |
         | (nodes,edges,|
         |  images,...) |
         +------+------+
                |
         +------v------+
         | graph-anything CLI |
         | (search, retrieval,|
         |  cross-document)   |
         +-------------------+
                |
          [Agent reasoning]

Structural metaphor: Think of a scientific paper as a city. Before Agents-K1, your agent could only read the city’s welcome sign (abstract) and the street names at each intersection (citations). Now, the multimodal parser is a survey team that draws every building (entity), labels each road (relation), photographs every landmark (figures), and produces a map with notes like “this building uses steel from supplier Y” (method lineage). The 4B model is a cartographer that takes the raw survey data and applies consistent cartographic rules (GRPO reward) to produce a clean, reliable map. The graph-anything CLI is a navigation app — you can ask “find the shortest path from ResNet to ViT that goes through any OOD detection paper” and get a route with images and reasoning. Without this pipeline, the agent is a tourist with a ripped pamphlet; with it, it’s a city planner with full GIS.

Key Concepts

• GRPO (Group Relative Policy Optimization): A reinforcement learning technique where the model generates a batch (group) of candidate extractions, and a rule-based reward scores each. The model updates its policy to prefer the best-scoring outputs. Think of it as self-improvement without human grading: the model tries different ways to describe a finding, and the reward tells it which version is more informative (more specific entities, more complete relations). This is cheaper than supervised fine-tuning and can adapt to new schemas.

• Multimodal evidence: Not just text snippets, but also figures, tables, and equations extracted from the PDF and linked to specific claims. For example, a claim “Accuracy improved by 5%” might be attached to the table that reports the numbers. This allows the agent to reason over visual data without needing a separate vision model.

• Method lineage: A typed relation is_improvement_of or is_based_on between algorithms. Instead of a flat cites, the graph knows that “YOLOv8 is an improvement of YOLOv5” whereas “YOLOv5 cites ResNet” for backbone design. This lineage enables multi-hop reasoning: “Which attention mechanisms were originally designed for NLP and later applied to vision?”

Framework Shift

Before (mainstream approach):        After (this paper):
+------------------+                  +---------------------+
| Paper            |                  | Paper               |
| +-------+       |                  | +-------+           |
| |Abs-   |       |                  | |Abs-   |           |
| |tract  |       |                  | |tract  |           |
| +-------+       |                  | +-------+           |
| |cites  |       |                  | |entities|           |
| |list   |       |                  | |claims |           |
| +-------+       |                  | |evidence|          |
| (flat)          |                  | |lineage|           |
+-------+--------+                   | |figures|           |
        |                            | +-------+           |
   Agent only sees                   | (typed relations)   |
   abstract + titles.                +---------+----------+
                                               |
                                          graph-anything CLI
                                               |
                                    Agent queries rich KG,
                                    gets paths + images + meta.

One sentence: From flat text snippets to a typed, multimodal, cross-document knowledge graph—the core shift is representation: the agent no longer reads papers, it navigates a structured scientific ontology built from them.

Expert Assessment

Problem choice: Real gap. Scientific knowledge orchestration has been neglected in the agentic-AI rush. The field needs exactly this: a bridge between raw PDF libraries and structured representations that LLMs can actually reason over.

Method maturity: Clever in several places: GRPO with rule reward reduces annotation cost; five-module parser is well-designed but not revolutionary—it resembles existing information extraction schemas (e.g., SciIE). The 4B backbone is small, which is pragmatic but might limit recall on rare entities.

Experimental integrity: The authors report strong F1 gains (20%) on a new benchmark SciEval+. But I’d need to see if baselines use the same full-paper input. If baselines only see abstracts, the comparison is unfair. Also, the multi-hop reasoning task uses a small set of manually crafted queries; reproducibility may be narrow.

Writing quality: Solid structure. The diagram in Section 3 is overloaded; a cleaner overview would help. The related work section reads like a list rather than an argument—cutting that to a tight narrative would elevate the paper.

Verdict: weak accept — the pipeline is well-engineered and the resource (Scholar-KG) is valuable, but the novelty lies more in system integration than in a single algorithmic breakthrough.

Takeaways

1. GRPO + rule-based reward is a transferable technique for information extraction tasks where human annotation is expensive. Any domain with a clear “goodness” metric (entity completeness, relation coverage) can use this.
2. Five-module parsing schema can be adapted to legal documents, medical records, or patent databases—where entities, relations, and cross-references matter.
3. Unified CLI for multi-source retrieval (web + KG + traversal) is a design pattern for building agent-friendly tools. You can replicate the “graph-anything” idea for your own knowledge base.
4. Release of 1M paper KG is a resource to build applications on, or to bootstrap training of domain-specific models.