FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learning

Paper: 2606.12406 Authors: Steven Oh, Jason Jingzhou Liu, Tony Tao, Philip Han, Kenneth Shaw, Satoshi Funabashi, Ruslan Salakhutdinov, Deepak Pathak Categories: cs.RO, cs.AI, cs.LG, eess.SY

The Gap

Existing work on force-aware manipulation either assumes dedicated joint-torque sensors (e.g., KUKA iiwa, Franka Emika) or relies on model-based disturbance observers that require accurate dynamics models and system identification (e.g., De Luca et al., 2006; Wahrburg et al., 2018). For low-cost commodity robot arms (e.g., WidowX, Interbotix), these approaches fail: sensors are absent, and model-based methods degrade under unmodeled friction, backlash, and nonlinearities. The community has thus treated force feedback as a luxury for the rich.

This paper breaks that assumption by asking: can we learn to “feel” external forces using only the existing proprioceptive signals (joint positions, velocities, currents) from a cheap robot, with minimal data and training?

The logic chain:

Problem: Contact-rich manipulation without force sensors
   |
   v
Assumption: Low-cost arms lack torque sensors, 
model-based observers are brittle
   |
   v
Method: Neural External Torque Estimation (NEXT) 
trained on 10min free-motion data + 
Force-Informed Re-Sampling Training (FIRST) 
for policy learning
   |
   v
Evidence: 17% improvement over prior force-aware 
policies on 5 long-horizon tasks; 
estimates match dedicated sensor accuracy
   |
   v
Conclusion: Commodity arms can now do 
force-aware teleoperation and policy learning 
without hardware modification

The Increment

One sentence: Before this paper, force sensing on commodity arms required expensive hardware or fragile models; after this paper, a 1-minute neural network training + 10 minutes of waving the arm in free space gives you comparable torque estimation, unlocking force-feedback teleoperation and improved behavior cloning.

Core Mechanism

NEXT is a lightweight MLP that takes as input the current joint positions, velocities, and motor currents (easily readable on any robot) and outputs an estimated external torque for each joint. The training data is trivial to collect: simply move the robot arm freely in the air for 10 minutes, recording these signals. During free motion, the true external torque is zero (no contact), so the network learns to predict the null external torque from the arm’s own dynamics. At test time, any deviation from this learned baseline indicates an external disturbance.

Why does this work? Because the arm’s intrinsic torque — due to inertia, Coriolis, friction, gravity — is a deterministic function of the kinematic state and motor currents. The network implicitly learns this inverse dynamics mapping, using the motor current as a proxy for the motor torque command. The key insight is that the external torque is the residual: the difference between what the motors are actually doing (current) and what the dynamics model predicts they should be doing (learned from free motion). The network directly outputs that residual.

FIRST then uses the estimated torque signal to re-weight the training data for behavior cloning. In contact-rich tasks, the transition from “no contact” to “contact” (pre-contact and contact segments) is short but critical. Prior BC methods either train on all transitions equally or use hand-crafted heuristics. FIRST up-samples these segments by a factor proportional to the detected external torque magnitude, forcing the policy to focus on the delicate force-torque interactions right before and during contact.

[ASCII diagram of NEXT + FIRST pipeline]

Data: pos, vel, current (joint i) ...
   |
   v
[NEXT MLP]
   |  (10min free motion training)
   v
Estimated external torque (joint i)
   |
   +---> Used for teleoperation (force feedback to human)
   |
   +---> Used for FIRST: compute per-timestep weight
           |
           v
[Behavior Cloning]  <-- weighted loss on pre-contact/contact

Think of NEXT as a calibration technician who works for a cheap robot arm. The technician doesn’t know the arm’s exact physics — no equations, no CAD models. But they watch the arm flail around freely for 10 minutes, memorizing the pattern: “when the arm is at this angle and moving this way, the motors should be drawing this much current, and there should be zero external torque.” Once memorized, if the arm suddenly feels a push, the technician says: “That’s not in my free-motion memory — something from outside is applying torque.” That’s exactly what NEXT does, but with a neural network instead of a human.

FIRST is like a film editor who watches hours of expert demonstrations of a careful assembly task. The editor notices that the most crucial moments are the split-second before the peg touches the hole and the instant of insertion — those contain the information about compliant motion. So the editor adds extra copies of those frames into the training reel. The final policy, trained on this augmented footage, becomes much more sensitive to force transitions.

Key Concepts

• External Torque Estimation as Residual Learning: Most robots have motor current sensors that reflect both the torque needed to move the arm’s own mass/friction and any external force. If you can model the “empty” dynamics (no contact), the external torque is just the difference. NEXT directly learns to output that residual, bypassing the need for an explicit dynamics model. Example: if the arm is held still and someone pushes it, the motor current changes to resist motion. The network sees: “current high, but position not moving as expected → external torque positive.”

• Data Efficiency via Free Motion Exploitation: Training a full dynamics model (inertia, friction, etc.) typically requires system ID experiments or complex simulations. Instead, NEXT uses the simple observation that during free motion, external torque = 0 by construction. This self-supervised labeling eliminates the need for ground-truth torque sensors. The 10-minute data collection is just “wave the arm around randomly” — no script, no special equipment. This is clever because it turns the lack of sensors into an advantage: the absence of contact becomes the training signal.

• Re-Weighting for Contact Awareness (FIRST): In behavior cloning, the loss is typically computed over all transitions equally. But for contact-rich tasks, the rarely-occurring contact events are information-dense. FIRST computes a weight w_t = 1 + alpha ** |tau_ext_t|, where tau_ext_t is from NEXT. This amplifies the loss for timesteps with high external torque (i.e., during contact). The weight transitions smoothly, so the policy doesn’t get a shock from binary weighting. This is analogous to focal loss for object detection, but in time-series and task-specific.

Framework Shift

Before, force-aware policy learning for commodity arms required either:

• Assumes dedicated force/torque sensor exists (costly)
• Uses model-based observer with risk of poor dynamics

Before (mainstream approach):
  Arm without F/T sensor
   |
   v
[Model-based Disturbance Observer]
   | requires accurate dynamics model,
   | friction parameters, inertia, etc.
   | (hard to obtain on cheap arms)
   v
Poor torque estimate or fragile
   |
   v
Policy learning: either ignore force
  or hand-tune thresholds

After this paper, force awareness is a data-driven add-on:

After (this paper):
  Arm without F/T sensor
   |
   v
[Collect 10min free-motion data]
   | (positions, velocities, currents)
   v
[Train NEXT in 1 minute] (MLP)
   |
   v
Accurate external torque estimate
   |
   +---> [FIRST re-sampling]
   |      v
   |    Policy learning: weighted BC
   |
   +---> [Teleoperation with force feedback]
   |
   v
Significantly better contact-rich results
  without hardware cost

One sentence: From *fragile model-based or expensive sensor-based force estimation to data-driven, sensor-free, 1-minute training — the core shift is treating external torque as a neural residual learned from free motion, then using that signal to focus policy training on contact-rich segments.

Expert Assessment

Problem choice: Real and timely. The robotics community desperately needs to bring force feedback to low-cost hardware for broader deployment in labs, homes, and education. The gap is not manufactured.

Method maturity: Clever insight, but not revolutionary. The “residual learning from free motion” idea has been explored in some form (e.g., learning inverse dynamics for contact detection), but the combination with a re-sampling training strategy for BC is novel. The simplicity is a strength — it’s easy to reproduce. No brute force; they avoided complex networks or large datasets.

Experimental integrity: Baselines seem fair: they compare against standard BC (no force), a model-based observer, and a prior learning-based method (probably from their own previous work FACTR). The 17% improvement is on task progress metric (not just success rate), which is meaningful. However, the results are only on 5 tasks, all with the same arm (likely WidowX or similar). More diversity of arms and tasks would strengthen the claim. Also, they didn’t compare against a direct method like using a FT sensor on the same arm (which would be the gold standard). Red flag: the paper claims “comparable to dedicated joint-torque sensors” but only shows a plot, no rigorous statistical test.

Writing quality: The paper is well-structured, with clear problem motivation and method explanation. But the section on training details is thin — they don’t specify network architecture (number of layers, size), hyperparameters, or training procedure. This makes reproduction harder. Rewriting the “Training Details” subsection to include explicit hyperparameters would elevate the paper significantly.

Verdict: weak accept — Good problem, clean solution, decent experiments, but missing a few crucial implementation details and lacking cross-platform validation.

Takeaways

1. Free-motion data as a cheap calibration method: Any robot that reports joint positions, velocities, and motor currents can calibrate an external torque estimator with minimal effort. Practitioners can implement this today — just wave the arm, train a small MLP, and get a working force sensor.

2. Re-weighting trajectories for contact-rich BC: The idea of up-sampling pre-contact and contact segments is simple and effective. It can be applied to any BC pipeline where force or contact signals are available (estimated or real). It doesn’t depend on NEXT specifically.

3. Force feedback for teleoperation on low-cost arms: The paper demonstrates that you can now close the force loop in human teleoperation without hardware. This opens up bimanual manipulation, remote assembly, and surgical training on cheap robots.

4. The data-efficiency lesson: 10 minutes of free motion + 1 minute training is astonishingly efficient. This suggests that the mapping from proprioception to external torque is low-dimensional and can be captured by a small network. For other domains (e.g., legged robots), similar free-motion calibration might work for ground reaction force estimation.