Explainable RL for Air Traffic Control: A Preliminary Saliency Map Approach

Paper: 2607.22525 Authors: Anduel Mehmeti, Gabriella Gigante, Salvatore Venticinque Categories: cs.AI

The Gap

Existing research in Explainable AI (XAI) has largely focused on supervised learning — image classifiers, medical diagnosis, tabular models. Meanwhile, Reinforcement Learning is being explored for high-stakes sequential decision-making (autonomous driving, robotics, air traffic control), but RL agents remain opaque black boxes. The field of Explainable RL (XRL) exists but is sparse, especially in safety-critical aviation domains. Prior XRL work has touched on game-playing agents and simulated robotics, but almost nobody has asked: “Can we make an RL agent’s route-planning decisions in Air Traffic Control interpretable to a human controller?”

The core limitation: ATC is a domain where human trust isn’t optional — it’s a regulatory and safety prerequisite. Yet no prior work systematically applies explainability techniques to RL-based ATC assistance. This paper attempts to bridge that gap with a simple but unexplored combination.

Problem: RL agents deployed in ATC are black boxes
   |
   v
Assumption: Saliency maps can reveal which input features
   |        drive RL route-planning decisions
   v
Method: Train RL agent in simplified ATC environment
   |     for no-fly-zone avoidance routing
   v
Evidence: Saliency maps highlight spatial features
   |      (no-fly zone proximity, flight path geometry)
   |      as dominant decision factors
   v
Conclusion: Explainability via saliency is feasible
            as a first step toward trustworthy ATC AI

The Increment

One sentence: Before this paper, nobody had demonstrated even a basic saliency-map explanation for RL-based route planning in an air traffic control context; after it, we have a proof-of-concept that the idea isn’t broken and the explanations look plausible.

Core Mechanism

The system has three main components working in sequence. First, a simplified ATC environment is constructed — essentially a 2D airspace with defined flight corridors, no-fly zones, and aircraft that need routing decisions. This environment serves as the decision arena where the RL agent operates. The state space encodes spatial information about aircraft positions, no-fly zone boundaries, and available route options. The action space consists of alternative route selections, and the reward function penalizes violations of no-fly zones while rewarding safe, efficient routing.

Second, a standard RL algorithm (likely a deep Q-network or policy gradient variant) trains an agent within this environment. The agent learns a policy — a mapping from states to actions — that avoids no-fly zones. During training, the agent explores different routing strategies and receives feedback through rewards, gradually converging on competent behavior. The key point: the agent learns what to do, but not why in human-interpretable terms.

Third, post-hoc explainability is applied. A saliency map technique computes the gradient of the agent’s output action with respect to the input state features. This gradient tells you: “If I nudge this input pixel/feature slightly, how much does the agent’s preferred action change?” Features that cause large changes get bright spots on the saliency map. The authors then visualize these maps overlaid on the airspace, showing which parts of the environment the agent “pays attention to” when making routing decisions.

[ATC Environment]
        |
        v
[State: aircraft pos, no-fly zones, routes]
        |
        v
[RL Agent (trained policy)]
        |
        +---> [Action: route selection]
        |
        v
[Saliency Map Computation]
        |
        +---> grad(output action, input state)
        |
        v
[Visualization: heatmap over airspace]
        |
        v
[Human controller sees: "agent focuses on
 no-fly zone proximity and route geometry"]

Structural metaphor — the dog walker and the leash signals: Imagine an experienced dog walker guiding a dog through a city with construction zones (no-fly zones). The dog (RL agent) has learned to navigate around obstacles, but the walker (human controller) can’t read the dog’s mind. Now imagine the leash is equipped with force sensors — you can see exactly where the dog is pulling hardest. When the dog nears a construction zone, the leash jerks toward the safe path; when the route is clear, the tension is low. The saliency map is the force sensor readout: it doesn’t explain the dog’s full reasoning, but it shows you *what the dog is reacting to at each moment. The bright spots on the map are the leash jerks — they reveal the environmental features that dominate the agent’s attention. The construction barriers near the dog light up; distant open roads don’t. This isn’t a complete explanation (you still don’t know why the dog chose left over right), but it’s enough for the walker to build trust: “OK, the dog sees the construction zone and is steering away. That’s what I’d want.”

Key Concepts

• Saliency Map: Imagine you’re looking at a photo and someone asks “what caught your eye?” A saliency map answers that question for a neural network. You take the network’s decision (e.g., “turn left”) and compute how sensitive that decision is to each tiny piece of the input. If changing one pixel of the airspace map would flip the decision, that pixel gets a bright color. If a pixel doesn’t matter at all, it stays dark. The result is a heatmap showing the “hot spots” the network cares about. It’s not telling you *why the network cares — just where its attention is. Think of it like a heat-vision camera for decision importance.

• Reinforcement Learning in Safety-Critical Domains: Regular supervised learning is like a student who memorizes answer keys — it learns from labeled examples. Reinforcement Learning is more like training a dog through rewards and corrections — the agent tries actions, gets feedback (rewards for avoiding no-fly zones, penalties for violations), and learns a strategy over time. In safety-critical domains, this is both powerful and scary: the agent can discover creative solutions humans didn’t think of, but it can also learn strange behaviors that happen to work in training but fail catastrophically in deployment. That’s exactly why explainability matters here — you need to verify the agent’s “reasoning” isn’t brittle.

• Post-hoc Explainability: This is the “explain after the fact” approach. You train your model however you want (often a black box), then apply explanation tools afterward — like writing an after-action report. The alternative is “inherently interpretable” models (like decision trees) where the reasoning is transparent by design. Post-hoc methods are popular because they let you use the most powerful models (deep RL) and bolt on explanations later. The catch: the explanation might not accurately reflect what the model is *actually doing internally — it’s more like a plausible narrative than ground truth.

Framework Shift

Before (mainstream approach):        After (this paper):

  RL Agent for ATC                   RL Agent for ATC
       |                                  |
       v                                  v
  [Black Box Decision]               [Black Box Decision]
       |                                  |
       v                                  |
  Trust us.                             v
  It works.                       +-- Saliency Map --+
  No questions.                   |                  |
                                  v                  v
                             "Agent looks at    "No-fly zone
                              route geometry"    proximity is
                                                 critical input"
                                      |
                                      v
                                  [Controller can
                                   verify attention
                                   matches expectations]

From “trust the black box” to “peek at what the agent sees,” the core shift is adding a visual explanation layer between RL decisions and human controllers to enable preliminary trust calibration.

Expert Assessment

Problem choice: The gap is real — XRL for ATC is genuinely underexplored, and the trust problem in safety-critical AI is legitimate and important. However, this feels like a manufactured incremental gap rather than a fundamental one. The broader XRL community has been working on similar ideas (saliency for RL) in other domains; this paper simply ports a known technique to a new application area. The novelty is in the *domain, not the method.

Method maturity: This is a straightforward application of existing tools — standard RL training plus gradient-based saliency maps. There’s nothing technically wrong with that, but it’s the simplest possible explainability approach for RL. More sophisticated XRL techniques exist (SHAP for RL, attention mechanisms, counterfactual explanations, reward decomposition) that could provide richer explanations. The saliency map approach tells you “where the agent looks” but not “what it’s planning” or “what would change its mind.” It’s like the minimum viable explanation.

Experimental integrity: Several red flags. The environment is described as “simplified” — which is fine for a proof-of-concept, but the degree of simplification isn’t clear from the abstract. How many aircraft? How complex are the no-fly zones? Does the agent face realistic traffic density? Without knowing the environment complexity, it’s hard to judge whether the results are meaningful or artifacts of toy problems. There’s no mention of baselines (other RL algorithms? other XAI methods?), no quantitative evaluation of explanation quality (do controllers actually find the saliency maps useful? were user studies conducted?), and no comparison with inherently interpretable RL approaches.

Writing quality: The abstract is heavy on motivation and light on specifics. The phrase “preliminary explainability approach” signals the authors know this is early-stage work. The writing prioritizes framing and justification over technical detail. If the experimental section were rewritten to include (a) environment complexity metrics, (b) quantitative saliency analysis, and (c) even a small user study with ATC personnel, the paper would be substantially stronger. Currently, it reads more like a workshop proposal than a completed study.

Verdict: weak accept — The problem space is legitimate and underexplored, and someone needed to make this first attempt. But the contribution is essentially “we applied a well-known XAI technique to a simplified version of a new domain and it produced plausible-looking heatmaps.” That’s valuable as a starting point, but not as a research contribution with lasting impact. Best suited for a workshop or position paper, not a top venue.

Takeaways

What you can steal: The framing itself is transferable. If you work in any safety-critical RL domain (healthcare treatment planning, autonomous vehicle navigation, industrial control), the template of “train RL agent + apply saliency maps + present to domain expert” is a quick way to get your foot in the door with explainability. It’s low effort, low risk, and can be done in a week.

What’s missing: The paper would be much more valuable if it included a controller-in-the-loop study. The real question isn’t “do saliency maps exist?” but “do saliency maps actually change a controller’s trust calibration?” That’s the experiment that would make this line of research compelling.

Honest bottom line: If you’re already working on XRL, you can skip this. If you’re an ATC researcher wondering “should I care about explainability?”, this paper gives you a starting bibliography and a proof-of-concept to build from. It’s a door-opener, not a destination.