FedTSV: Fair Federated Learning Through Trajectory Shapley Value

Paper: 2605.30336 Authors: Daniel Kuznetsov, Ziqi Wang Categories: cs.LG

The Gap

Federated learning lets multiple clients train a shared model without exposing their private data. The server aggregates local updates—typically using FedAvg, which averages client gradients with fixed weights (often proportional to dataset size). This works when clients are homogeneous and honest. But real deployments face heterogeneous data distributions, varying compute resources, and potentially adversarial clients sending poisoned updates. Fixed weights can’t distinguish a helpful client from a harmful one, leading to biased models and slow convergence.

Prior work tried contribution-based weighting (e.g., Shapley values computed per round), but these methods treat each round in isolation, ignoring how a client’s contribution evolves over the training trajectory. They also lack temporal consistency—a client’s value can swing wildly between rounds due to noise, making aggregation unstable.

This paper asks: Can we measure client contributions across the entire optimization trajectory, not just per-round snapshots, and use that to adaptively weight aggregation in a temporally stable way?

Problem: Fixed weights ignore heterogeneity & adversaries
   |
   v
Assumption: Client value = influence on global model trajectory
   |
   v
Method: Trajectory Shapley Value (TSV) + adaptive weighting
   |
   v
Evidence: Faster convergence, robust to poisoning, fairer rewards
   |
   v
Conclusion: Trajectory-aware contribution metrics stabilize FL

The Increment

One sentence: Before, federated aggregation used static weights blind to client quality; after, FedTSV dynamically adjusts weights based on each client’s cumulative influence on the model’s optimization path.

Core Mechanism

FedTSV introduces Trajectory Shapley Value (TSV), a metric that evaluates each client’s contribution not in isolation but across multiple training rounds. Instead of asking “how much did client i help this round?”, TSV asks “how much did client i’s participation improve the model’s trajectory toward the validation objective?”

The method works in three stages. First, during training, the server tracks the global model’s state at each round. Second, after a window of T rounds, the server computes TSV for each client by measuring how the model’s validation performance changes when that client’s updates are included versus excluded from the trajectory. This uses a Shapley-style marginal contribution calculation, but applied to sequences of updates rather than single-round contributions. Third, the server converts TSV scores into aggregation weights for the next window, giving higher weight to clients whose historical contributions improved validation performance.

Round t-T  ...  Round t-1  ...  Round t
   |              |              |
   v              v              v
[Client updates] [Client updates] [Client updates]
   |              |              |
   +------+-------+-------+------+
          |
          v
   Trajectory evaluation:
   For each client i, compute marginal
   contribution to validation loss
   over [t-T, t]
          |
          v
   TSV(i) = Shapley value on trajectory
          |
          v
   Weight(i) = f(TSV(i))  [for rounds t+1 onward]

Think of FedTSV like a sports team evaluating players. A traditional approach (FedAvg) pays everyone the same salary regardless of performance—maybe adjusted for seniority (dataset size). A per-round Shapley approach is like judging each player by their performance in the last game alone: noisy and reactive. FedTSV is like a coach reviewing game footage over the entire season. Each player’s value is measured by how the team’s win trajectory changed when they were on the field versus benched. A player who consistently moves the team toward victory gets more playing time (higher aggregation weight) in future games. The key insight: a player’s value isn’t their stats in one game, but their cumulative impact on the team’s path to the championship (validation objective).

Key Concepts

• Shapley Value: Imagine you and two friends start a business. At the end of the year, you need to split the profit fairly. But each person contributed differently—maybe you brought the idea, one friend brought capital, another brought customers. Shapley value is a method from cooperative game theory that answers: “What’s each person’s fair share?” It works by considering all possible orders in which people could have joined the business, computing each person’s marginal contribution in each order (profit with them minus profit without them), then averaging across all orders. In federated learning, the “business” is the global model, “people” are clients, and “profit” is validation performance. Traditional Shapley computes this per round. TSV extends it across multiple rounds, treating the entire training trajectory as the “game.”

• Trajectory vs Snapshot Evaluation: A snapshot evaluation judges a client by their impact in a single round—like rating a driver by one traffic light. A trajectory evaluation judges them by their entire route—did they get you to the destination faster overall? In federated learning, a client might send a noisy update in round 5 that looks bad in isolation, but when combined with their updates in rounds 3, 4, and 6, they steer the model toward better generalization. Trajectory evaluation captures this cumulative effect, filtering out per-round noise and rewarding consistent positive influence.

Framework Shift

Before (FedAvg):                    After (FedTSV):

Server                              Server
  |                                   |
  +---> Fixed weights                 +---> TSV evaluation
  |     (e.g., by data size)          |     (trajectory-based)
  v                                   v
Aggregate all clients equally     Aggregate with dynamic weights
  |                                   |
  v                                   v
Global model update               Global model update
(blind to client quality)         (responsive to contribution)


Client contributions:             Client contributions:
  Round 1: [A, B, C]                Round 1-5: [A, B, C]
  Round 2: [A, B, C]                     |
  Round 3: [A, B, C]                     v
  (each round independent)          Evaluate trajectory impact
                                         |
                                         v
                                    Adjust weights for Round 6+

From static, per-round aggregation to dynamic, trajectory-aware weighting, the core shift is treating federated learning as a sequential decision problem where past contributions inform future trust.

Expert Assessment

Problem choice: Real gap. Heterogeneous and adversarial clients are well-documented pain points in federated learning deployments (medical consortia, mobile devices). Prior Shapley-based methods exist but suffer from per-round instability—this paper’s trajectory framing is a natural evolution, not a manufactured problem.

Method maturity: Clever insight with practical tradeoffs. The trajectory window introduces a hyperparameter (window size T) and computational overhead (Shapley calculation scales poorly with client count). The paper uses sampling approximations, which is standard, but doesn’t deeply explore how window size affects different data heterogeneity regimes. A simpler baseline—exponential moving average of per-round Shapley—isn’t compared, which would help isolate the value of trajectory framing versus just temporal smoothing.

Experimental integrity: Baselines are fair (FedAvg, FedProx, per-round Shapley). The poisoning experiments (label-flipping, gradient noise) show clear robustness gains. However, the datasets are small-scale (MNIST, CIFAR-10), and the client counts (10-20) are modest. Real federated settings often have hundreds or thousands of clients, where Shapley computation becomes prohibitive. The paper acknowledges this but doesn’t provide wall-clock time comparisons or scalability analysis. The validation set used for TSV computation is assumed clean—what happens if the validation set is also poisoned?

Writing quality: The method section is dense and could benefit from a worked example with concrete numbers. The related work section lumps together contribution metrics, fairness, and robustness without clearly delineating how TSV differs from each prior approach. The experimental section would be stronger if it included ablations on window size and sampling budget. The conclusion oversells generality (“principled foundation for fairness-aware federated optimization”) when the method is really about contribution-based weighting, not fairness in the algorithmic fairness sense (e.g., demographic parity).

Verdict: weak accept — Solid incremental contribution with clear practical value, but limited by scalability concerns and modest experimental scope. The trajectory framing is the right idea; execution needs more depth.

Takeaways

For practitioners: If you’re running federated learning with known heterogeneous or adversarial clients, FedTSV’s trajectory-based weighting is worth trying. The key transferable idea: don’t judge participants by their last action—judge them by their cumulative impact on your objective over a window. This applies beyond FL: in ensemble learning, you could weight models by their trajectory contribution to validation loss; in online learning, you could weight experts by their cumulative regret reduction.

For researchers: The trajectory Shapley framing opens a design space. You could replace validation loss with other utilities (fairness metrics, robustness proxies). You could explore different trajectory lengths (adaptive windows based on convergence rate). The computational bottleneck is Shapley approximation—can you use influence functions or other gradient-based shortcuts to estimate trajectory contributions without exhaustive sampling?

Steal this: The idea of “temporal consistency in contribution metrics.” If you’re designing any system that aggregates inputs from multiple sources over time (crowdsourcing, multi-agent RL, ensemble methods), consider whether your contribution metric is stable across time or just reacting to the last observation. Trajectory-based evaluation is a general pattern for filtering noise and rewarding sustained positive impact.