Paper: 2611.26538 — LLM GerryMandering: Separating Interactions from Additive Effects in LLM Audits
Authors: George Rahul, Ronit Jahilal, Bhaskara Hanuma Vedula, Ponnurangam Kumaraguru, Pushkar Shukla
Category: cs.AI
Reading scope: Original arXiv v1 HTML, including the audit method, synthetic benchmark, persona and counterfactual results, calibration checks, and limitations. Figure captions were read; figures were not visually inspected. The reported experiments were not independently reproduced.

The Problem

Suppose an auditor measures a model’s judgments on one scoring axis. In this illustrative example, one identity label moves the score two points from the overall mean; another moves it three points in the same direction. Together they move it five. Five exceeds both two and three, yet addition alone explains the result. There need not be a new effect specific to the combination.

This is the distinction George Rahul and colleagues want an audit to preserve. Some audits flag a combined subgroup when it sits farther from a reference than either identity alone. That can identify a substantial difference, but it cannot by itself tell us whether the identities interact. The authors introduce ADDIS to ask that narrower question. Their working definition is departure from an additive prediction on the measured answer scale, rather than the full social meaning of intersectionality (§§3.1–3.3).

The Explanation

Predict the five before looking for something extra

The paper asks models to rate synthetic people on questionnaire statements such as whether someone is the life of the party. These are model-attributed profiles, not measurements of the people’s actual personalities. Each persona has six identity attributes: gender identity, age, sexual orientation, socioeconomic status, religion, and caste or community. Answers can be compared item by item or summarized into nine trait scales, including the Big Five, empathy, anxiety, and depression (§§3.4 and 3.6).

ADDIS first fits a model that adds the separate effects of all six attributes. In the opening example, it predicts five. The audit then measures how far the subgroup’s average answer profile sits from that prediction. The authors call this distance ARD. Including all six attributes matters: if a subgroup happens to contain more poor personas, an audit using only its other two labels might mistake the class effect for an interaction (§3.3).

There are 738 tested two-attribute cells, each with at least 50 personas. Small cells are noisier, and hundreds of simultaneous tests create chances for accidental flags. ADDIS builds reference datasets that retain the fitted identity effects while randomly flipping each persona’s leftover error. It refits and rescales the distances, then uses the largest standardized distance in each reference dataset to set a joint threshold. The test therefore asks whether the combination departs from addition, while allowing the separate effects to remain (§3.4).

Simply shuffling all identity labels asks a different question: does identity matter at all? It destroys the separate effects as well as their interactions. A subgroup with a five-point additive shift can then look exceptional against reference data in which even the two- and three-point shifts have vanished.

Check the detector where the answer is known

For the synthetic benchmark, the authors construct answers with separate identity effects and noise, then plant known interactions. In the continuous, nine-scale comparison in Table 2, the old excess statistic with the label-shuffling test reports 66.1 false cells per dataset when no interaction is planted. ADDIS reports 0.09. Repairing only the old test’s reference distribution also removes most false flags, but recovers just 32.4% of the planted pattern, versus 84.4% for ADDIS at the reported one-residual-standard-deviation strength. An interaction can move a profile sideways rather than farther from the overall mean; distance from the additive prediction can see both directions (§5.1; Tables 2–3).

These figures are not universal error guarantees. In that Table 2 comparison, ADDIS flags at least one cell in 8.7% of the no-interaction datasets, above its nominal 5% target. When a continuous additive signal is rounded into a few Likert answer categories, the reported dataset-level flag rate is 20.0%. Rounding can itself create non-additivity on the answer scale. The paper recommends confirming individual flags on such answers with an ordinal model (§7; Table 4).

Fewer flags, with important gaps left open

IndiPersona contains 10,000 synthetic Indian personas. Across 13 open instruct models, ADDIS flags an average of 22 of 738 cells, or 3.0%, on the nine-scale profiles. The old statistic with the shuffle test flags about 52, or 7.1%, on the same representation. This is a change in what the audit counts, not evidence that a model became less biased. Item-level profiles carry more information and produce a different share of flags (§5.3).

The authors also write 250 base personas four ways per counterfactual contrast, changing two labels and keeping everything else fixed. Comparing the two label changes within each quartet isolates their interaction in the model’s response to those prompts. These targeted tests confirm the main gender-identity-by-orientation pattern and reveal a caste-by-class contrast larger than the chosen calibration contrast in 12 of the 13 open models. Sparse caste cells in the broader audit had not shown a similarly consistent pattern. Failure to flag a small cell was not evidence that its labels never interact (§§3.7 and 5.4).

Core Concepts

Addition is a baseline, not a defense. The five-point shift can matter even if two plus three explains it. An audit of extra joint effects does not replace an audit of the separate effects or their total consequences.

An interaction depends on the scale. A departure in questionnaire-item answers can change when answers are summarized or rounded. ADDIS measures non-additivity in a specified representation; it does not measure all forms of intersectional disadvantage.

A flag needs an error model. The comparison must preserve the effects that are allowed under the question being tested. Removing every identity effect creates an easier question than asking whether two identities interact.

The Insight

Before interpreting a combined effect, write down what its parts would predict. The gap from that prediction tells you something different from the size of the total effect.

A Critical Reading

The synthetic benchmark is useful because the planted answers make false flags and missed interactions observable. It also exposes calibration limits. The sign-flip procedure assumes independent personas and suitably symmetric residuals, and its nominal error target is not achieved in every reported setting (§3.4; §7).

The persona design trades population realism for estimability. Most attributes are assigned independently, while religion follows caste constraints; some resulting label combinations are contradictory. These responses describe how models treat prompts, not how harm is distributed across India’s population. Counterfactual quartets strengthen attribution to labels within those prompts, without establishing effects on real people (§§3.6–3.7).

The largest patterns survive several checks, but not every flagged detail is stable. Only about half the flagged cells recur on a fresh persona sample, and some trait directions weaken after rewording. A screening result is a reason to investigate, especially when its answer categories or sample sizes make the test fragile (§5.3; Appendix H.4).

What You Can Use

When an audit says a combined subgroup differs more than either component, ask what addition predicts. Keep total disparities and departures from addition as separate findings. Check how the test behaves on data with known answers, then confirm consequential or sparse-cell findings with matched prompts. A smaller interaction count can mean a more specific measurement; it cannot certify fairness.

论文:2611.26538 — LLM GerryMandering: Separating Interactions from Additive Effects in LLM Audits
作者:George Rahul、Ronit Jahilal、Bhaskara Hanuma Vedula、Ponnurangam Kumaraguru、Pushkar Shukla
分类:cs.AI
阅读范围:阅读 arXiv v1 原始 HTML 中的审计方法、人工构造的基准、人物设定与反事实结果、校准检查和局限。读了图注,未查看图像本身;未独立复现实验。

问题

先用一组假想数字看问题。模型给人物打某项分数,一种身份标签让分数偏离总体均值两分,另一种让它同向偏离三分,两种身份合在一起偏了五分。五分比两分、三分都大,可这只是相加,并不需要另有一种只在组合中出现的效应。

George Rahul 等人想让审计分清这件事。有些检查把组合群体与某个参照的距离,同单个身份的距离比较;只要组合更远,就判为交叉效应。它能看见明显差别,却不能单凭差别更大就认定两种身份相互作用。作者因此提出 ADDIS,问一个更窄的问题:模型给出的评价,是否偏离各身份单独作用相加后的预测?这是论文在指定回答尺度上的工作定义,不能概括交叉性理论的全部含义,见第 3.1—3.3 节。

翻译

先算出五分,再找多出来的部分

论文让模型评价虚构人物,比如判断「这个人是聚会的活跃分子」符合到什么程度。这测的是模型赋予人物的特征,不是人物真实的性格。每个人物有六类身份属性:性别认同、年龄、性取向、社会经济地位、宗教,以及种姓或社群。回答既可以逐题比较,也可以归成九项量表分数,包括大五人格、同理关怀、焦虑和抑郁等,见第 3.4、3.6 节。

ADDIS 先拟合一个只会把六类属性各自作用相加的模型。在开头的例子里,它会预测五分。接着,审计量出组合群体的平均回答与这份预测相距多远,论文把这个距离叫 ARD。六类属性都得纳入:某个群体碰巧有更多贫穷人物,如果只看另外两种标签,就可能把阶层带来的变化误认成它们的交互,见第 3.3 节。

被检验的共有 738 个两属性组合,每组至少有 50 个人物。小组的随机波动更大,一口气检验几百组,也更容易撞上偶然异常。ADDIS 保留每个人物的可加预测,把剩下的误差随机翻转正负,造出参照数据。每次重新拟合、调整各组距离的尺度,再取所有组里最大的标准化距离来定门槛。这样,检验可以允许单个身份照常影响评价,专门追问组合是否另有偏离,见第 3.4 节。

把全部身份标签直接打乱,问的却是另一个问题:身份到底有没有影响?这种打乱连单独作用也抹掉了。参照里连两分、三分都没了,原本只靠相加得到的五分,自然显得很反常。

到知道答案的数据里,检查报警器

作者先造出只有单独身份作用和噪声的回答,再人工植入已知交互。表 2 比较的是连续数值、九项量表表示下的一组基准:没有植入交互时,旧统计量配上打乱标签的检验,平均每份数据误报 66.1 个组合;ADDIS 为 0.09 个。只修旧统计量的参照分布,也能消掉大部分误报,可在所测的一倍残差标准差强度下,它只找回已植入模式的 32.4%,ADDIS 找回 84.4%。原因是交互可能把整份评价往侧面推,而不是推得离总体均值更远;与可加预测的距离能量出两种方向,见第 5.1 节和表 2—3。

这组数字不是通用的错误保证。表 2 那组没有交互的数据里,ADDIS 有 8.7% 的数据集至少报了一组,高于名义上 5% 的目标。如果把连续的可加信号四舍五入到少数几档李克特选项,论文报告的整份数据报警率为 20.0%。取整本身就可能在回答尺度上造出不可加的关系。作者建议,对这类回答里的单项发现,再用适合有序类别的模型确认,见第 7 节和表 4。

报得少了,盲区仍在

IndiPersona 包含一万个虚构的印度人物设定。在十三个开放指令模型上,按九项量表汇总后,ADDIS 平均标出 738 个组合中的 22 个,约 3.0%;旧统计量配上打乱检验标出约 52 个,约 7.1%。变的是审计口径,不是模型忽然少了偏见。逐题回答带的信息更多,得到的报警比例也不同,见第 5.3 节。

作者还为每项反事实对照取 250 个基础人物,每个改写成四种版本,只换两种标签,其余一字不动。比较两次标签变化的差,就能把交互归到这些标签对模型回答的作用上。这类定向检查复现了主要的性别认同与性取向模式;也发现一项种姓与阶层的对照,在十三个开放模型中的十二个里,比所选校准对照更大。较早的大样本审计没在稀疏种姓小组里看到同样一致的模式;小组没报警,不能反推标签从不交互,见第 3.7、5.4 节。

核心概念

相加是参照,不是辩护。 五分差别即使完全来自两分加三分,也可能很重要。查额外的组合效应,不能替代查单独作用及其总体后果。

交互要带着尺度说。 逐题回答里的偏离,归成量表或取整后可能改变。ADDIS 量的是选定表示里的不可加关系,不是所有形式的交叉不利处境。

报警器需要对得上的参照。 所问问题允许存在的作用,在参照数据里也得留下。把所有身份影响都抹掉,回答不了两种身份是否相互作用这个更细的问题。

洞见

看一个组合之前,先写清各部分相加会得到什么。偏离这份预测有多远,与总差别有多大,是两项不同的发现。

博导审稿

人工植入的基准有用,因为哪里该报警、哪里不该,作者事先知道。它也暴露了检验的校准边界:误差翻转需要人物之间独立、误差分布适合正负翻转等假设;论文并非在每个设置下都守住了名义错误目标,见第 3.4、7 节。

人物设计为了估计方便,牺牲了一部分现实性。多数属性独立分配,宗教再服从种姓约束,其中还会出现相互矛盾的标签组合。结果说明模型如何处理提示词,不能直接换算成偏见在印度人口中如何分布。反事实四联组加强的是对提示词内标签作用的归因,未证明现实人物会遭遇同样后果,见第 3.6—3.7 节。

主要模式经受了几项复查,但不是每个细节都稳。换一批人物后,全部已标记组合中大约只有一半再现;改写措辞后,一些特征变化也会减弱。筛查适合指向下一步调查,尤其当回答只有少数档位,或者组合人数很少时,见第 5.3 节及附录 H.4。

启发

看到「组合群体比任何一种身份都偏得更远」时,先问相加本来会预测多少。把总体差别与额外交互分别记录,到已知答案的数据里检查误报,再用其余条件相同的提示词确认重要或稀疏小组的发现。交互报得少,可能只是量得更专门,不能拿来签一张公平证明。