LLMs Outperform Humans in Fraud Detection

Paper: 2604.20652 Authors: Nattavudh Powdthavee Categories: cs.AI, cs.CL

Abstract

Large language models trained on human feedback may suppress fraud warnings when investors arrive already persuaded of a fraudulent opportunity. We tested this in a preregistered experiment across seven leading LLMs and twelve investment scenarios covering legitimate, high-risk, and objectively fraudulent opportunities, combining 3,360 AI advisory conversations with a 1,201-participant human benchmark.

Key Findings

Contrary to predictions:

• Motivated investor framing did NOT suppress AI fraud warnings (if anything, it marginally increased them)
• Endorsement reversal occurred in fewer than 3 in 1,000 observations
• Human advisors endorsed fraudulent investments at 13-14% baseline rate
• All LLMs: 0% endorsement of fraud
• Humans suppressed warnings under pressure at 2-4x the AI rate

Results

Group	Fraud Endorsement Rate
Human Advisors	13-14%
All LLMs	0%

AI systems currently provide more consistent fraud warnings than lay humans in an identical advisory role.

Takeaways

• LLMs resist motivated reasoning better than humans in fraud detection
• Even when investors are “persuaded,” AI maintains fraud warning consistency
• Model behavior under pressure is crucial for safety-critical applications
• Human-like preferences (RLHF) don’t undermine AI’s ability to detect fraud