Paper: 2608.12278 Authors: Avijit Roy, Proma Roy Categories: cs.CL, cs.AI, cs.CY
The Gap
The multilingual NLP literature has been circling this problem for years, but mostly one layer at a time. The Joshi et al. language-resource taxonomy told us which languages are data-poor. Scaling-law work told us that performance tracks tokens seen. Tokenizer-fairness papers (Petrov et al., Ahia et al.) showed that non-Latin scripts pay more tokens — and therefore more money and less context — for the same meaning. The ICT4D and HCI4D literature has documented connectivity gaps for two decades. And a large body of work proposes fixes: multilingual pretraining, cross-lingual transfer, machine-translated instruction data, adapters, distillation.
What’s missing is the composition. Each of those literatures treats its own bottleneck as the bottleneck, and each proposed fix implicitly assumes the other layers are neutral. Translate-and-fine-tune assumes the tokenizer is fine. Efficient tokenizers assume the corpus is fine. Both assume the user can reach a server. Nobody has laid the four layers end to end for a single concrete language and asked: what does the product of these losses look like, and what does that imply for how we deploy?
This paper does that for Bengali — roughly 4% of humanity, under 0.5% of web text — with AI-assisted education in low-connectivity Bangladesh as the deployment scenario. Its claim is not “Bengali needs more data.” It’s that scarcity is manufactured downstream of allocation decisions, and that the standard remedy set is aimed at the wrong layer.
[PROBLEM] "AI tutors will close the access gap
in under-resourced communities"
|
v
[ASSUMPTION UNDER TEST] the stack below the model
(web -> corpus -> tokenizer -> benchmark -> pipes)
is neutral plumbing; only model quality varies
|
v
[METHOD] audit each layer for one language (Bengali),
then compose the losses
+------------+------------+------------+------------+
| | | | |
web corpus tokenizer benchmark delivery
presence share (abugida) coverage (network)
| | | | |
v v v v v
[EVIDENCE]
0.5% web 67 : 1 higher eval sets 36.5% rural
vs 4% pop EN:BN fertility thin / EN- vs 71.4%
tokens per word centric urban online
| | | | |
+------------+-----+------+------------+------------+
v
[CONCLUSION]
losses are multiplicative, not additive
== scarcity is a STRUCTURAL barrier, not a bug to patch
== offline-first is equity infrastructure, not a downgrade
The Increment
One sentence: Before this paper, “low-resource language” named a property of a dataset; after it, the same phrase names a chain of five design decisions whose penalties multiply, with a specific number attached to each link for one of the world’s largest languages.
Core Mechanism
There is no model and no training run here — the “method” is a compositional audit, and it’s worth being clear-eyed about that. The authors instrument five successive filters between global text and a rural Bengali-speaking student, and quantify the attenuation at each one.
The first filter is production and indexing: Bengali is roughly 4% of the world’s speakers but under 0.5% of measured web content, an order-of-magnitude gap that no crawler can fix because the text was never published in a crawlable form. The second is curation: after dedup, language-ID, and quality heuristics, major multilingual corpora land at a 67
English-to-Bengali token ratio — worse than the raw web gap, because quality filters trained on English-style text discard non-English pages disproportionately. The third is tokenization: Bengali is an alphasyllabary, where consonant-vowel units carry diacritics and conjuncts, and BPE vocabularies fitted mostly on Latin text shatter these into many subword pieces. Higher fertility means each Bengali word consumes more of a fixed context window, costs more per API call, and gives the model a noisier, more fragmented signal per unit of meaning.The fourth filter is measurement: because benchmarks are thin or absent for Bengali, whatever damage the first three filters do is not visible in the reported numbers that drive research priorities. That’s the feedback loop — invisible harm doesn’t get budgeted against. The fifth is delivery: even a perfect model reaches nobody through a cloud-only, always-online architecture when rural individual internet penetration sits at 36.5% against 71.4% urban. The paper’s structural point is that these compose multiplicatively. A 67
token deficit combined with a fertility multiplier above 1 yields an effective deficit meaningfully worse than 67 in terms of words of Bengali the model ever saw, and worse again in terms of words it can hold in context at inference time. GLOBAL TEXT PRODUCTION
========================================== all languages
|
| (1) who publishes on the crawlable web?
v
Bengali share of web text ..... under 0.5%
| (speakers ~ 4%)
| (2) dedup + quality filters tuned on EN
v
corpus tokens EN : BN == 67 : 1
|
| (3) tokenizer fitted mostly on Latin script
v
abugida shattered into many subword pieces
| fertility multiplier f > 1
v
EFFECTIVE deficit ~ 67 * f : 1
. fewer Bengali words per context window
. higher cost per unit of meaning
. weaker learning signal per token
|
| (4) benchmarks are EN-centric / sparse for BN
v
the damage above is NOT MEASURED
| -> no pressure to reallocate
| -> loop back to step (2)
v
(5) DEPLOYMENT: cloud-only, always-online assumed
|
+--> urban user (71.4% online) ....... service
+--> rural user (36.5% online) ....... SILENCE
Think of it as a municipal water system. The reservoir is the crawlable web: for Bengali it was never filled to the level the population would suggest, and no pump fixes an empty reservoir. The treatment plant is corpus curation, and its filters were calibrated for a different water chemistry, so it rejects more Bengali than it should — the 67
ratio is what leaves the plant, not what entered the reservoir. The intake pipe is the tokenizer, and here the pipe diameter is wrong for the shape of the material: an abugida flows through a Latin-fitted BPE pipe in fragments, so even the water that made it through arrives at reduced pressure. The water meter is the benchmark suite, and it only has a gauge on the English main — so when pressure drops on the Bengali line, no one at the utility sees a reading, and next year’s maintenance budget goes to the line that is metered. Finally the last mile is connectivity: the urban neighborhood has pipes to 71% of homes, the rural one to 36%. Upgrading the treatment plant — which is what “better multilingual models” amounts to — improves nothing for a household with no pipe. That’s the paper’s argument for offline-first: it is last-mile plumbing, and no amount of upstream quality substitutes for it.Key Concepts
-
Token fertility: How many pieces a tokenizer chops a word into. Take “internationalization” in English — a good English tokenizer might split it into three or four pieces. Now take a Bengali word written with conjunct consonants and vowel diacritics. A tokenizer whose vocabulary was learned mostly from English text has never seen those combinations often enough to give them their own entries, so it falls back to tiny fragments, sometimes byte by byte. Say English averages 1.3 tokens per word and Bengali averages 3 or 4. Three consequences follow immediately, and they’re all the same fact wearing different hats: your 8k context window holds a third as much Bengali *content; a per-token API bill charges you triple for the same sentence; and the model’s next-token prediction task is diluted across fragments that carry no independent meaning. Fertility is where a data problem becomes a cost problem and a capability problem at once.
-
Alphasyllabary (abugida): Bengali script isn’t an alphabet where letters sit in a row, and isn’t a syllabary with one symbol per syllable. Each consonant carries an inherent vowel, which you *modify with a mark that can attach above, below, before, or after the consonant — and consonant clusters fuse into new composite glyphs. So a single visual unit may be several Unicode codepoints, and the linear byte order does not match the reading order. Subword algorithms designed around “words are sequences of letters separated by spaces” have no purchase on this. It’s not that Bengali is harder; it’s that the default tool encodes an assumption about writing systems that Bengali doesn’t satisfy.
-
Structural versus technical scarcity: A technical limitation is something you fix by trying harder within the current setup — better crawler, bigger model, more GPUs. A structural barrier is one produced by the setup itself, so effort inside it reproduces the problem. Bengali’s corpus share is structural: it results from which languages hosting and publishing infrastructure served first, which languages quality filters were tuned on, which languages benchmark authors could recruit annotators for. The practical test is this — if you tripled everyone’s compute budget tomorrow, would the gap close or scale? Under the paper’s account it scales, because the ratio is preserved.
Framework Shift
Before (mainstream approach): After (this paper):
[ MODEL QUALITY ] [ web presence ] 4% -> 0.5%
^ |
| "the language gap v
| lives in the model" [ corpus share ] 67 : 1
| |
+------+------+ v
| | [ tokenizer ] * f
more data fine-tune |
(translate) + adapters v
[ benchmark ] gap unmeasured
everything below the model | ^
== neutral plumbing v | feedback
deployment == someone [ connectivity ] loop
else's problem 36.5% / 71.4%
|
one dial to turn v
reaches the student?
five dials, in series,
losses MULTIPLY;
the last one gates all
the others
From a model-centric to a pipeline-centric account of language inequity, the core shift is that fairness is no longer a property you can train into weights — it is the product of five infrastructure decisions in series, and the cheapest lever (offline-first delivery) sits at the layer nobody in NLP owns.
Expert Assessment
Problem choice: Real gap, and well chosen. Bengali is the ideal stress case precisely because it is *not a small language — it defeats the comfortable intuition that resource scarcity tracks speaker count. Roughly 4% of humanity with under 0.5% of web text is a fact that should bother anyone who believes markets allocate data attention efficiently. Where this sits in the field’s trajectory: it is a synthesis paper arriving after the individual measurements exist, which is a legitimate and undersupplied genre. The compositional framing — losses multiply, and measurement failure creates a feedback loop that protects the other three failures from correction — is the genuinely useful contribution.
Method maturity: This is the paper’s weak flank and you should know it before you cite it. There is no new measurement instrument, no experiment, no model. The four numbers are aggregations of existing public sources (web-content surveys, published corpus statistics, ITU/national telecom penetration figures). Every individual claim has prior art: the tokenizer penalty is Petrov et al. and Ahia et al. 2023, the resource taxonomy is Joshi et al. 2020, the connectivity divide is two decades of ICT4D. The increment is the composition plus the policy reframing, which is real but thin for a full paper. The simplest thing being overlooked is also the most damning: the authors could have *run the tokenizer comparison themselves in an afternoon — measure fertility for Bengali across five production tokenizers, then show downstream task accuracy under a fixed context budget rather than a fixed token budget. That single table would convert the central “multiplicative” claim from an argument into a result.
Experimental integrity: There are no baselines to be unfair to, which is its own kind of red flag for a cs.CL submission. The numbers themselves need caveats the abstract does not give. “67
in major multilingual corpora” is highly sensitive to *which corpora — mC4, OSCAR, CulturaX, and ROOTS give materially different ratios, and ROOTS in particular was deliberately constructed to be less skewed. Quoting one ratio as if it characterizes the field invites the reader to over-generalize. Similarly, “under 0.5% of web content” comes from surveys with known methodological problems: they sample indexed, top-level-domain-identified pages and systematically miss content in apps, social platforms, and messaging — which is plausibly where a large share of contemporary Bengali text actually lives. That undercount cuts both ways for the argument, and honest treatment would say so. The 36.5% / 71.4% split is the most solid figure here.Writing quality: The diagnosis is crisp and the four-failure taxonomy is genuinely memorable — that part earns its keep. The corner-cutting is all in the last section. “Directions for linguistics and AI research aimed at reducing these structural inequalities” is where position papers go to die, and I’d bet the mortgage this one contains recommendations at the granularity of “build better benchmarks” and “invest in local data collection.” If I could force one rewrite: turn the offline-first argument into an actual specification. What model size fits on the phones rural Bangladeshi students have? What’s the sync protocol under intermittent 2G? Which distillation target preserves Bengali morphology when the teacher’s tokenizer is already fragmenting it? What happens to safety filtering when there’s no server-side check? The paper asserts offline-first is equity infrastructure but does not do the engineering that would make the assertion actionable — and that engineering is where the interesting problems are.
Verdict: weak accept — a well-framed and needed synthesis whose central multiplicative claim is argued rather than measured, which makes it a strong fit for a cs.CY or NLP-for-social-good venue and a borderline one anywhere that expects results.
Takeaways
Concrete things worth stealing:
-
Audit compositionally, not layer by layer. Any fairness or accessibility question in a deployed system has this shape: several filters in series, each optimized by a team that assumes the others are neutral. The technique is to name every filter, quantify attenuation at each, and multiply. Transfers directly to accessibility, medical imaging across skin tones, ASR across accents, recommender coverage of niche catalogs.
-
The unmeasured layer is the protected layer. This is the sharpest transferable idea in the paper. If your metrics don’t instrument a failure mode, that failure mode is structurally immune to your prioritization process — not neglected, *protected. When you inherit a system, the first question is which parts have no gauge on them.
-
Fixed token budget is the wrong comparison; fixed content budget is the right one. If you evaluate multilingual systems, stop comparing at equal tokens. Equal tokens means unequal information for high-fertility scripts, and your evaluation will silently flatter your system. Report words or characters, and report cost per unit of meaning, not per token. This applies to context-window claims and pricing pages too.
-
Reframe offline-first as an equity requirement, not a degraded mode. Useful in product argument even outside language: “works without a server” is a fairness property when your users’ connectivity is bimodal. It changes what you’re allowed to put behind a network call.
-
Speaker count does not predict resource level. Kill that heuristic. Publishing infrastructure, script support history, and annotator labor markets predict it better. If you’re picking languages to support, the interesting targets are the large-population, low-web-presence quadrant — highest impact per unit of data work.
What’s not here: nothing you can implement from the paper directly. No tokenizer, no dataset, no architecture, no offline runtime. Treat it as a framing document and a citation source for the four numbers — with the corpus-choice and web-survey caveats attached.
论文: 2608.12278 作者: Avijit Roy, Proma Roy 分类: cs.CL, cs.AI, cs.CY
缺口
多语言 NLP 这些年一直在绕着这个问题转，但每次只处理一层。
Joshi 等人的语言资源分级告诉我们哪些语言数据贫乏。 Scaling law 的工作告诉我们性能跟随见过的 token 数。 分词公平性的论文（Petrov 等、Ahia 等）指出非拉丁文字表达同样的意思要花更多 token——于是更贵、上下文更短。 ICT4D 与 HCI4D 领域记录联网差距已有二十年。 而修补方案也一大堆：多语言预训练、跨语言迁移、机翻指令数据、adapter、蒸馏。
缺的是复合。 每一条文献都把自己那层瓶颈当成唯一瓶颈，每个修补方案都隐含假设其他层是中性的。 “翻译加微调”假设分词器没问题。 “高效分词器”假设语料库没问题。 两者都假设用户能连上服务器。 没有人把四层首尾接起来、针对一门具体语言问一句：这些损耗的乘积长什么样，它对部署方式意味着什么？
这篇论文对孟加拉语做了这件事——约占人类 4%，却占不到网络文本的 0.5%——场景设定为低联网率的孟加拉国的 AI 辅助教育。 它的主张不是”孟加拉语需要更多数据”，而是：稀缺是在资源分配决策的下游被制造出来的，而标准解法瞄错了层。
[问题] "AI 家教能弥合欠发达社区的
教育获取差距"
|
v
[被检验的假设] 模型之下的整条栈
(网络 -> 语料 -> 分词 -> 评测 -> 管道)
是中性的水管，只有模型质量在变
|
v
[方法] 对单一语言(孟加拉语)逐层审计，
再把损耗复合起来
+-----------+-----------+-----------+-----------+
| | | | |
网络存在 语料占比 分词器 评测覆盖 交付
度 (元音附标) (网络)
| | | | |
v v v v v
[证据]
0.5% 网络 67 : 1 每词切分 评测集稀薄 农村 36.5%
vs 4% 人口 英:孟 token 片数更多 / 以英为中心 vs 城市 71.4%
| | | | |
+-----------+----+------+-----------+-----------+
v
[结论]
损耗是相乘而非相加
== 稀缺是"结构性壁垒"，不是可打补丁的 bug
== 离线优先是公平基础设施，不是降级方案
增量
一句话: 这篇论文之前，“低资源语言”描述的是一个数据集的属性；之后，同一个词描述的是五个设计决策组成的链条，惩罚逐级相乘，而且世界上最大的语言之一在每一环上都被贴了具体数字。
核心机制
这里没有模型、没有训练——所谓”方法”就是一次复合式审计，这点得说清楚。
作者在”全球文本”与”农村孟加拉语学生”之间装了五道连续的滤网，并量化每一道的衰减。
第一道是生产与索引：孟加拉语约占全球说话人 4%，却占可测网络内容不到 0.5%，这一个数量级的差距任何爬虫都补不上，因为那些文本从未以可爬取的形式被发表过。 第二道是筛选：经过去重、语言识别与质量启发式之后，主流多语言语料落在英语比孟加拉语 67：1 的 token 比上——比原始网络差距还要糟，因为按英文风格调过的质量过滤器会不成比例地丢掉非英语页面。 第三道是分词：孟加拉文是元音附标文字（abugida），辅音带固有元音、靠附加符号修饰，辅音还会连写成合体字；主要在拉丁文本上拟合出来的 BPE 词表会把这些击碎成大量子词碎片。 切分率（fertility）更高意味着：每个孟加拉词吃掉更多固定上下文窗口、每次 API 调用更贵、模型在单位语义上拿到的信号更碎更嘈杂。
第四道是测量：因为孟加拉语的评测集稀薄或缺失，前三道造成的损害不会出现在那些主导研究优先级的报告数字里。 这就是反馈回路——看不见的伤害不会被列进预算。 第五道是交付：在纯云端、默认常连的架构下，即使模型完美也送不到人手上，因为农村个人联网率 36.5%，城市 71.4%。
论文的结构性论点是：这些是相乘的。 67：1 的 token 赤字乘上一个大于 1 的切分率因子，意味着模型真正见过的孟加拉语”词数”赤字远差于 67：1；推理时能塞进上下文的词数，又要再差一层。
全球文本生产
========================================== 所有语言
|
| (1) 谁在可爬取的网络上发表内容?
v
孟加拉语网络文本占比 ..... 不到 0.5%
| (说话人 ~ 4%)
| (2) 去重 + 按英文调参的质量过滤
v
语料 token 英 : 孟 == 67 : 1
|
| (3) 主要在拉丁文字上拟合的分词器
v
元音附标文字被打碎成大量子词
| 切分率乘数 f > 1
v
有效赤字 ~ 67 * f : 1
. 同一上下文窗口装的孟加拉词更少
. 单位语义的成本更高
. 单 token 的学习信号更弱
|
| (4) 评测以英文为中心 / 孟语稀薄
v
上面的损害"没有被测量"
| -> 没有重新分配资源的压力
| -> 回到步骤 (2)
v
(5) 部署: 假设纯云端、常连网
|
+--> 城市用户 (71.4% 联网) ....... 有服务
+--> 农村用户 (36.5% 联网) ....... 沉默
把它想成一套城市自来水系统。
水库是可爬取的网络：对孟加拉语来说，它从来没被灌到与人口相称的水位，而空水库不是加泵能解决的。 净水厂是语料筛选，它的滤材是按另一种水质标定的，所以拒掉的孟加拉语比应该拒的多——67：1 是出厂的水量，不是进水库的水量。 进水管是分词器，这里管径与材料形状不匹配：元音附标文字流经按拉丁文字配的 BPE 管道时是碎的，所以侥幸过关的水到达时压力也已下降。 水表是评测套件，而表只装在英语主管上——所以孟加拉语支线掉压时，水务局看不到读数，明年的检修预算自然给了那条有表的管线。 最后是最后一公里的联网率：城市片区通到 71% 的住户，农村片区只有 36%。
升级净水厂——这正是”更好的多语言模型”的实质——对一户根本没有管道的家庭毫无改善。 这就是论文主张离线优先的理由：它是最后一公里的管道工程，上游水质再好也替代不了它。
关键概念
-
切分率 (token fertility): 分词器把一个词切成几片。 拿英文 “internationalization”，好的英文分词器大概切成三四片。 再拿一个带合体辅音和元音附标的孟加拉语词。 一个词表主要从英文学来的分词器，从没见过这些组合足够多次以给它们独立条目，于是退化成极小的碎片，有时逐字节切。 假设英文平均每词 1.3 个 token，孟加拉语平均 3 到 4 个。 三个后果立刻跟着来，而它们其实是同一件事的三顶帽子：你的 8k 上下文窗口只装得下三分之一的孟加拉语内容；按 token 计费的账单同一句话收你三倍；模型的下一 token 预测任务被稀释到一堆本身没有独立语义的碎片上。 切分率就是”数据问题”同时变成”成本问题”和”能力问题”的那个转折点。
-
元音附标文字 (alphasyllabary / abugida): 孟加拉文既不是字母横排的字母文字，也不是一符一音节的音节文字。 每个辅音自带一个固有元音，你用一个符号去修饰它，这个符号可能挂在辅音的上、下、前、后；而辅音丛会融合成新的合体字形。 所以一个视觉单元可能对应好几个 Unicode 码位，而线性字节顺序与阅读顺序并不一致。 按”词是被空格分开的字母序列”设计的子词算法在这里完全抓不住东西。 不是孟加拉语更难，而是默认工具把一个关于书写系统的假设编码进去了，而孟加拉语不满足这个假设。
-
结构性稀缺 vs 技术性稀缺: 技术性限制是你在现有设定内更努力就能解决的——更好的爬虫、更大的模型、更多 GPU。 结构性壁垒是被这套设定本身生产出来的，所以在里面努力只会复制问题。 孟加拉语的语料占比是结构性的：它源于托管与发表基础设施先服务了哪些语言、质量过滤器在哪些语言上调过参、评测作者能为哪些语言招到标注员。 实用判据是这个——如果明天把所有人的算力预算翻三倍，差距是缩小还是等比放大？ 按本文的论述是放大，因为比例被保留了。
框架转变
之前（主流方法）： 之后（本文方法）：
[ 模型质量 ] [ 网络存在度 ] 4% -> 0.5%
^ |
| "语言差距 v
| 住在模型里" [ 语料占比 ] 67 : 1
| |
+----+----+ v
| | [ 分词器 ] * f
更多数据 微调 |
(机翻) + adapter v
[ 评测 ] 差距未被测量
模型之下一切 | ^
== 中性水管 v | 反馈
部署 == 别人的事 [ 联网率 ] 回路
36.5% / 71.4%
只有一个旋钮 |
v
送到学生手上了吗?
五个旋钮串联，
损耗相乘;
最后一个卡住前面全部
一句话：从”以模型为中心”到”以管道为中心”地解释语言不平等，核心转变是——公平不再是能训进权重里的属性，而是五个串联的基础设施决策的乘积，而最便宜的那根杠杆（离线优先的交付）恰好落在 NLP 圈没人负责的那一层。
专家评审
选题眼光: 真缺口，而且选得好。 孟加拉语是理想的压力测试案例，恰恰因为它不是小语种——它击碎了”资源稀缺跟说话人数量成正比”这个让人安心的直觉。 占人类约 4%、却占网络文本不到 0.5%，这个事实应该让任何相信市场能有效分配数据关注度的人不舒服。 在领域轨迹上的位置：这是一篇在各项单点测量都已存在之后到来的综合性论文，这是一个正当且供给不足的体裁。 真正有用的贡献是那个复合式框架——损耗相乘，而且测量失败构成的反馈回路让另外三重失败免于被纠正。
方法成熟度: 这是论文的软肋，引用之前你得知道。 没有新的测量工具，没有实验，没有模型。 四个数字都是对既有公开来源的汇总（网络内容调查、已发表的语料统计、ITU 与本国电信渗透率数据）。 每一条单独的主张都有前人：分词惩罚是 Petrov 等与 Ahia 等 2023，资源分级是 Joshi 等 2020，联网鸿沟是二十年的 ICT4D。 增量在于复合与政策重构，这是真的，但撑一篇完整论文偏薄。 被忽略的最简单做法同时也是最致命的一点：作者本可以用一个下午亲自跑那个分词对比——测五个生产级分词器在孟加拉语上的切分率，然后在固定上下文预算而非固定 token 预算下给出下游任务准确率。 就这一张表，就能把核心的”相乘”主张从论证变成结果。
实验诚意: 没有基线可谈公平不公平，这对一篇 cs.CL 投稿本身就是个警示信号。 数字本身也需要摘要没给的限定。 “主流多语言语料中 67：1”对哪些语料极度敏感——mC4、OSCAR、CulturaX 和 ROOTS 给出的比例差别很大，尤其 ROOTS 是刻意构造得更均衡的。 拿单一比例当作整个领域的特征，会诱导读者过度推广。 同样，“网络内容不到 0.5%“来自方法论已知有问题的调查：它们采样的是被索引、可按顶级域识别的页面，系统性地漏掉 App、社交平台和即时通讯里的内容——而当代孟加拉语文本很可能有很大一部分正住在那里。 这个低估对论证是双刃的，诚实的处理应当说明这点。 36.5% / 71.4% 这组是这里最扎实的数字。
写作功力: 诊断部分利落，四重失败的分类法确实好记——这部分值回票价。 偷懒全在最后一节。 “面向减少这些结构性不平等的语言学与 AI 研究方向”是立场论文的坟场，我敢押房子赌这里面的建议粗到”构建更好的评测”和”投资本地数据收集”这个粒度。 如果只能强制重写一处：把离线优先的论证变成真正的规格说明。 孟加拉国农村学生手上的手机能装多大的模型？ 在断续 2G 下的同步协议是什么？ 当教师模型的分词器本身就在碎化孟加拉语形态时，哪种蒸馏目标能保住形态信息？ 服务端没有检查时，安全过滤怎么办？ 论文断言离线优先是公平基础设施，却没做那些能让断言变成可执行方案的工程——而有意思的问题恰恰都在那里。
判决: 弱接收 —— 一篇框架扎实、也确实需要的综合工作，但其核心的”相乘”主张是论证出来的而非测量出来的；这让它非常适合 cs.CY 或 NLP for social good 类场地，在任何期待实验结果的地方则是临界。
要点总结
值得”偷”走的具体东西：
-
做复合式审计，而不是逐层审计。 任何部署系统里的公平性或可达性问题都是这个形状：若干串联的滤网，每一道由一个假设其他道是中性的团队各自优化。 技巧是：点名每一道滤网、量化每一道的衰减、然后相乘。 可直接迁移到无障碍设计、跨肤色的医学影像、跨口音的语音识别、推荐系统对长尾品类的覆盖。
-
没被测量的那一层就是受保护的那一层。 这是全文最锋利的可迁移观点。 如果你的指标没给某种失败模式装表，那这种失败模式对你的优先级流程就是结构性免疫的——不是被忽视，是被保护。 接手一个系统时，第一个问题应该是：哪些部分身上没有表。
-
固定 token 预算是错的对照，固定内容预算才是对的。 如果你评测多语言系统，别再在等量 token 下比较。 等量 token 对高切分率的文字意味着不等量信息，你的评测会悄悄地美化你的系统。 报词数或字符数，报单位语义的成本而不是单 token 的成本。 这同样适用于上下文窗口的宣传口径和定价页面。
-
把离线优先重构成公平性需求，而不是降级模式。 即使在语言之外的产品论证里也好用：当你的用户联网状况是双峰分布时，“不连服务器也能用”就是一个公平性属性。 它会改变哪些东西允许被放到网络调用后面。
-
说话人数量不预测资源水平。 砍掉这个启发式。 发表基础设施、文字支持的历史、标注劳动力市场，三者的预测力都更强。 如果你在挑要支持的语言，有意思的目标是”人口大、网络存在度低”那个象限——单位数据工作的影响力最高。
这里没有的：任何你能直接照着实现的东西。 没有分词器、没有数据集、没有架构、没有离线运行时。 把它当作一份框架文档和那四个数字的引用来源——并且把语料选择与网络调查方法论那两条限定一起带上。