VetClaw: Turning a Static Model into a Safety-Aware Veterinary Screening Agent

Paper: 2607.26042 Authors: Syed Mhamudul Hasan, Anas AlSobeh, Hussein Zangoti, Abdur R. Shahid Categories: cs.CV, cs.LG

The Gap

Prior work in animal disease detection—think CNNs trained on skin lesion datasets or livestock image classifiers—treats screening as a single-shot prediction problem: image in, label out. These models are static. They can’t collect additional evidence (like symptom text), can’t decide when they’re uncertain, can’t escalate to a vet, and can’t handle failures gracefully. They’re point solutions, not systems. The paper argues that real-world screening demands orchestration: input validation, multimodal fusion, safety gating, conditional routing, and structured logging. Nobody had packaged all of that into a deployable edge-cloud architecture for veterinary use.

Problem: Static classifiers treat screening as one-shot prediction
  |
  v
Assumption: Real screening needs evidence collection + safety + escalation
  |
  v
Method: Edge-cloud agentic system (OpenClaw + LangGraph + VLM)
  |
  v
Evidence: Multimodal (image+symptoms) > image-only on zero-shot VLM
  |
  v
Conclusion: Coordination framework transforms model into usable system

The Increment

One sentence: Before this paper, veterinary AI screening meant feeding an image to a classifier; after, it means running that classifier inside a stateful workflow that can collect symptoms, validate inputs, check safety, handle failures, and escalate uncertain cases.

Core Mechanism

VetClaw splits responsibilities across two layers. On the edge device (a single-board computer like a Raspberry Pi), OpenClaw handles the physical interface: camera capture, user interaction (including optional symptom text input), scheduling, notifications, and local tool access. This edge agent is the “front of house”—it talks to the user and manages the device.

On the server side, LangGraph orchestrates the actual screening workflow as a stateful graph. When OpenClaw sends an image (and optional symptoms), LangGraph walks through a pipeline: input validation, image transmission to a VLM, model invocation for zero-shot classification, safety rule checking, and conditional routing. If confidence is low, the system can escalate or ask for more information. If a tool call fails, there’s a failure-handling branch. Everything gets structured logs. The VLM itself is a standard vision-language model prompted for zero-shot disease classification—it does the actual “seeing,” but LangGraph decides what to do with what it sees.

[Edge Device]                        [Cloud Server]
                                     
+-----------+                        +-------------------+
|  Camera   |---image--------------->|  LangGraph        |
+-----------+                        |  [Validate Input] |
|  User UI  |---symptoms------------>|       |           |
| (OpenClaw)|                        |       v           |
| -schedule |                        |  [Invoke VLM]    |
| -notify   |<--alert/log-----------|       |           |
| -tools    |                        |       v           |
+-----------+                        |  [Safety Check]  |
                                     |       |           |
                                     |   +---+---+       |
                                     |   |       |       |
                                     |   v       v       |
                                     | [Pass] [Escalate] |
                                     |   |       |       |
                                     |   v       v       |
                                     | [Log] [Alert]     |
                                     +-------------------+

Think of it like a hospital triage system for animals. The edge device is the intake nurse: they take a photo of the animal, ask the owner “what symptoms have you noticed?”, and send everything to the specialist. The VLM is the specialist doctor who looks at the photo and the symptom notes and offers a preliminary assessment. But the specialist doesn’t just blurt out a diagnosis—they’re guided by a protocol (LangGraph): first check if the photo is clear enough, then look at it, then cross-reference with symptoms, then apply safety rules (“if confidence is below 50%, don’t give a diagnosis, flag for human review”), and log everything. The intake nurse then delivers the result (or the escalation notice) back to the owner. Without the protocol, you’d just have a doctor staring at a photo alone in a room—sometimes brilliant, sometimes dangerously overconfident, with no paper trail.

Key Concepts

• Zero-shot classification: Imagine you’ve never seen a specific disease before, but you’ve seen millions of pictures of sick and healthy animals in general. When someone shows you a new photo, you can reason from general visual knowledge—“that redness pattern looks inflammatory, the swelling is localized”—without having been trained on that exact disease. That’s zero-shot: the VLM classifies diseases it wasn’t specifically trained on by leveraging broad visual-linguistic understanding. The catch: it’s worse than a model trained on labeled examples, which is why the paper needs symptom text to help.

• Agentic workflow: A regular model is a function—input goes in, output comes out. An agentic workflow is more like a flowchart with decision nodes. “Did the image upload succeed? If no, retry. If yes, send to model. Did the model return high confidence? If yes, log and return. If no, check safety rules, maybe escalate.” The workflow can branch, loop, retry, and call external tools. It turns a one-liner API call into a coordinated, fault-tolerant process. LangGraph is a framework that represents these workflows as state graphs—nodes are steps, edges are transitions, and the system tracks state as it moves through.

• Edge-cloud separation: Your phone is an edge device; AWS is the cloud. The edge is close to the user (low latency, handles sensors and interaction) but has limited compute. The cloud has serious GPU power but is farther away. VetClaw puts the lightweight stuff—camera control, user chat, notifications—on the edge, and the heavy lifting—VLM inference, workflow logic—on the cloud. This mirrors how many real AI systems are actually deployed, but papers rarely make the architecture explicit.

Framework Shift

Before (mainstream approach):        After (this paper):

+---------+    +---------+          +---------+  +-----------+
|  Image   |-->|  CNN /   |          |  Image   |->|  OpenClaw |
+---------+    |  Model   |          +---------+  |  (edge)   |
               |          |          +---------+  |  - camera |
               |  [label] |          | Symptoms |->|  - UI     |
               +---------+          +---------+  +-----+-----+
                                                       |
                                                       v
                                              +-----------------+
                                              |    LangGraph    |
                                              |  - validate     |
                                              |  - invoke VLM   |
                                              |  - safety check |
                                              |  - route/log    |
                                              +--------+--------+
                                                       |
                                                       v
                                              +-----------------+
                                              | Structured      |
                                              | Output + Log    |
                                              +-----------------+

From single-function model to orchestrated agent, the core shift is treating classification as a workflow problem, not a prediction problem.

Expert Assessment

Problem choice: The timing is right—VLMs and LLM-agent frameworks are exploding, and applying them to underserved domains like veterinary care is sensible. But the gap is somewhat manufactured: nobody was stopping anyone from wrapping a VLM in LangGraph for animal screening. The “contribution” is more assembly than invention. It sits at the intersection of systems engineering and applied ML, which is valid but shallow.

Method maturity: This is straightforward component integration—OpenClaw for edge interaction, LangGraph for workflow, a VLM for classification. There’s no algorithmic novelty. A competent engineer could replicate this in a weekend using off-the-shelf LangGraph tutorials and any hosted VLM. The conditional routing and safety checks are good engineering practice but not research contributions.

Experimental integrity: This is the weakest section. The paper shows that image-only VLM zero-shot performance is limited and that adding symptoms helps—unsurprising to anyone who’s worked with VLMs. The zero-shot setup means they’re not comparing against fine-tuned baselines (which would likely crush the VLM). The dataset description is vague (“limited information available”), which is a red flag. Without knowing the diseases, class distribution, and image quality, it’s hard to trust the numbers.

Writing quality: The abstract oversells with phrases like “transforms a static prediction model into a coordinated, safety-aware system”—this is accurate but sounds grander than it is. The related work section likely needs strengthening (not visible in abstract). The discussion of limitations is thin. The paper would benefit enormously from a “lessons learned” section about what actually broke during deployment.

Verdict: weak accept — Solid engineering demonstration with good architectural instincts, but the research novelty is thin and the experimental rigor doesn’t match the claims.

Takeaways

Three concrete things to steal:

1. The orchestration-is-the-product framing: If you’re building AI systems (not just models), the real value is often in the workflow—validation, routing, safety, logging—not the model itself. LangGraph (or any state-machine framework) is the tool. This applies to any domain where you need reliability, not just veterinary medicine.

2. Multimodal as default input pipeline: Always ask “what text/metadata can I pair with images?” The performance jump from image-only to image+symptoms is a design pattern, not a one-off result. Even a short free-text description from a non-expert user adds signal.

3. Safety-by-design escalation: Build “I don’t know” paths into your system from day one. VetClaw’s conditional routing—low confidence triggers escalation instead of a wrong answer—is a pattern every clinical or high-stakes AI system should adopt. It’s cheaper to escalate than to be wrong.