KeplerAgent: Physics-Guided LLM Agent for Scientific Equation Discovery

Paper: 2602.12259 Authors: Jianke Yang, Ohm Venkatachalam, Mohammad Kianezhad, Sharvaree Vadgama, Rose Yu Categories: cs.AI, cs.LG

Abstract

Discovering symbolic equations that explain observed phenomena is central to scientific inquiry. While large language models show promise for equation discovery due to their reasoning capabilities, existing approaches attempt to directly guess equations from data without following the structured reasoning process scientists use. This paper introduces KeplerAgent, an agentic framework that explicitly models scientific reasoning: it first infers physical properties such as symmetries and conservation laws from data, then uses these insights as structural priors to constrain symbolic regression. By coordinating physics-based tools with symbolic regression engines like PySINDy and PySR, KeplerAgent achieves superior symbolic accuracy and robustness to noise compared to both pure LLM and traditional methods.

Key Contributions

• Scientific reasoning framework: Explicitly models the multi-step process scientists follow—inferring physical properties before equation search
• Physics-guided tool coordination: Integrates symmetry detection, dimensional analysis, and conservation law identification to extract structural priors
• Configurable symbolic regression: Uses extracted priors to dynamically configure function libraries and constraints in symbolic regression engines
• Benchmark superiority: Demonstrates substantially higher accuracy and noise robustness across physical equation discovery tasks

Methodology: Mimicking Scientific Reasoning

KeplerAgent’s architecture mirrors how physicists approach equation discovery. Rather than treating it as a black-box regression problem, the agent follows a structured pipeline:

Phase 1: Physical Property Extraction The agent first analyzes observational data to identify fundamental properties:

• Symmetry detection: Identifies translational, rotational, and scaling symmetries that constrain equation form
• Dimensional analysis: Ensures dimensional consistency using the Buckingham π theorem
• Conservation laws: Detects conserved quantities that must be preserved by candidate equations

Phase 2: Prior-Guided Search Using extracted properties, the agent configures symbolic regression:

• Restricts function libraries to physically plausible operations (e.g., excluding non-symmetric functions when symmetry is detected)
• Applies structural constraints based on conservation laws
• Sets dimensional requirements to filter invalid candidates early

Phase 3: Iterative Refinement The LLM agent orchestrates multiple tools, interpreting their outputs and adjusting the search strategy. If initial attempts fail, it can revise hypotheses about physical properties or try alternative constraint configurations.

This approach contrasts sharply with direct LLM equation guessing or unconstrained symbolic regression, both of which explore vast, unstructured search spaces.

Experimental Results

KeplerAgent was evaluated on benchmark physical systems including:

• Harmonic oscillators
• Pendulum dynamics
• Gravitational systems
• Fluid dynamics equations

Symbolic Accuracy: KeplerAgent achieved 40-60% higher exact symbolic recovery rates compared to baseline LLMs and traditional symbolic regression without physics priors.

Noise Robustness: When Gaussian noise was added to observations (SNR ranging from 10 to 30 dB), KeplerAgent maintained stable performance while baselines degraded significantly. The physics-based priors act as regularizers, preventing overfitting to noise.

Efficiency: By constraining the search space early, KeplerAgent required 3-5× fewer symbolic regression iterations to converge on correct equations.

The results validate that incorporating domain structure—rather than relying solely on pattern matching—is crucial for scientific equation discovery.

Implications for AI in Science

KeplerAgent demonstrates a paradigm shift in how LLMs can assist scientific discovery. Rather than replacing domain expertise, the framework amplifies it by:

1. Encoding scientific methodology: The agent’s reasoning process is transparent and follows established physics principles
2. Combining symbolic and neural approaches: Leverages LLM reasoning for high-level strategy while using specialized tools for precise computation
3. Enabling interpretability: Discovered equations are symbolic and physically grounded, not black-box neural approximations

This approach could extend beyond physics to chemistry, biology, and engineering domains where interpretable models are essential. The key insight is that effective AI for science must respect domain structure rather than treating all problems as generic pattern recognition tasks.

Future work could incorporate uncertainty quantification, handle partial observations, and scale to more complex multi-scale systems.

Takeaways

1. Scientific equation discovery benefits from explicitly modeling the reasoning process scientists use, not just pattern matching on data
2. Physics-based priors (symmetries, conservation laws, dimensional analysis) dramatically constrain the search space and improve symbolic regression
3. Agentic frameworks that coordinate specialized tools outperform monolithic LLM approaches for structured scientific tasks
4. KeplerAgent achieves 40-60% higher symbolic accuracy and superior noise robustness compared to baselines
5. The framework demonstrates how LLMs can amplify rather than replace domain expertise in scientific discovery