Directed Social Regard: Measuring Who Gets Praised and Who Gets Blamed in the Same Message

Paper: 2605.00776 Authors: Scott Friedman, Ruta Wheelock, Sonja Schmer-Galunder, Drisana Iverson, Jake Vasilakes, Joan Zheng, Jeffrey Rye, Vasanth Sarathy, Christopher Miller Categories: cs.CL, cs.AI

The Gap

Existing sentiment analysis treats each message as having one overall emotional tone—positive, neutral, or negative. But real political rhetoric and online discourse routinely mixes pro-social sentiment (advocacy, compassion) and anti-social sentiment (threats, blame) toward different targets in the same sentence. “We must protect our children from those dangerous policies” contains both care (for children) and hostility (toward policies/policymakers). Standard tools miss this entirely: they can’t report that both sentiments coexist, and they can’t tell you who receives which sentiment.

Prior work on aspect-based sentiment (ABSA) identifies targets but still assigns one polarity per target. Moral framing research in social science recognizes that messages invoke care, harm, fairness, and other moral dimensions simultaneously, but lacks computational tools to extract these at scale from text.

Problem: Mixed sentiments toward multiple targets in one message
    |
    v
Assumption: Sentiment is multi-dimensional (care/harm/fairness)
            and target-specific (spans, not whole documents)
    |
    v
Method: Two-stage transformer pipeline
        Stage 1: Detect target spans
        Stage 2: Score each span on 3 regard axes
    |
    v
Evidence: Annotation study (κ > 0.6), validation on 6 datasets
    |
    v
Conclusion: DSR captures sentiment complexity that
            correlates with real-world social science labels

The Increment

One sentence: Before this paper, sentiment analysis told you if a message was positive or negative; after, you can see that the same message praises group A, blames group B, and offers help to group C—all at once.

Core Mechanism

The method has two stages. Stage 1 is a span detection model: given a message, it identifies which text spans are targets of sentiment (people, groups, policies, events). Stage 2 is a regard scoring model: for each detected span, it scores the message’s sentiment toward that span along three axes—Advocacy/Opposition (-1 to +1), Aid/Harm (-1 to +1), and Victimization/Blame (-1 to +1). Both stages use transformer encoders fine-tuned on annotated data.

The key architectural choice is context-aware scoring: when scoring a span, the model sees the entire message, not just the span in isolation. This lets it capture how sentiment toward one target is expressed relative to others. For example, “We must protect our children from those dangerous policies” scores high on Aid for “children” and high on Opposition for “policies,” but only because the model sees both spans in context.

Input message
    |
    v
[Stage 1: Span Detection Transformer]
    |
    +---> Span A: "children"
    +---> Span B: "policies"
    |
    v
[Stage 2: Regard Scoring Transformer]
    |
    +---> Span A in full message context
    |       |
    |       +---> Advocacy/Opposition: +0.2
    |       +---> Aid/Harm: +0.8
    |       +---> Victimization/Blame: +0.6
    |
    +---> Span B in full message context
            |
            +---> Advocacy/Opposition: -0.7
            +---> Aid/Harm: -0.3
            +---> Victimization/Blame: -0.1

Think of it like a courtroom transcript analyzer. Stage 1 is the clerk who highlights every person or entity mentioned in testimony. Stage 2 is the analyst who reads the full testimony and, for each highlighted name, writes down: “Is the speaker defending or attacking this person? Are they describing help or harm toward them? Are they portraying them as victim or perpetrator?” The analyst doesn’t just look at the sentence containing the name—they read the whole testimony to understand the speaker’s stance. That’s why “our children” gets a high Aid score: not because the phrase itself is positive, but because the surrounding rhetoric frames them as needing protection.

Key Concepts

• Regard axes (Advocacy/Opposition, Aid/Harm, Victimization/Blame): Traditional sentiment is one-dimensional: good or bad. Regard is three-dimensional because social and political messages do three distinct things simultaneously. Advocacy/Opposition captures whether you support or resist an entity’s goals or existence (“We stand with refugees” vs “We must stop illegal immigration”). Aid/Harm captures whether you describe helping or hurting them (“providing shelter” vs “causing suffering”). Victimization/Blame captures whether you frame them as wronged or wrongdoer (“innocent victims” vs “those responsible”). A message can score high on Aid but low on Advocacy (e.g., humanitarian aid to a group you politically oppose), or high on Victimization but low on Aid (acknowledging harm without offering help). These dimensions come from moral psychology research showing that people evaluate actions along multiple moral foundations, not a single good/bad axis.

• Span-level vs document-level sentiment: Most sentiment tools give one score per document. But “I love my country and hate its corrupt leaders” contains opposite sentiments. Span-level analysis means identifying “my country” and “its corrupt leaders” as separate targets, then scoring each independently. The technical challenge: spans aren’t independent—“corrupt” modifies “leaders,” not “country,” even though both are nearby. The model must learn which sentiment-bearing words attach to which targets. This is why Stage 2 sees the full message: to resolve these attachment ambiguities using context.

Framework Shift

Before (standard sentiment):        After (DSR):

Message                             Message
  |                                   |
  v                                   v
[Classifier]                        [Span Detector]
  |                                   |
  v                                   +---> Target A
Overall score: +0.3                   +---> Target B
(slightly positive)                   |
                                      v
                                    [Regard Scorer]
                                      |
                                      +---> Target A: [+0.8, +0.6, +0.4]
                                      +---> Target B: [-0.7, -0.5, -0.3]
                                    
One number for whole text           Three numbers per target

From monolithic document polarity to per-target, multi-dimensional regard profiles—the core shift is decomposing sentiment into who feels what toward whom.

Expert Assessment

Problem choice: Real gap. Political communication researchers have been manually coding this kind of targeted sentiment for decades (content analysis of campaign ads, legislative speeches). Automating it is valuable. The framing through moral disengagement theory (Bandura) and moral foundations (Haidt) is well-motivated, not just feature engineering for its own sake.

Method maturity: Solid engineering, not groundbreaking architecture. Two-stage pipeline is the obvious approach once you frame the problem this way. The interesting choice is the three-axis design—why these three and not others? The paper justifies it through social science theory, but the axes are somewhat correlated (Advocacy and Aid have ρ ≈ 0.6 in their data), suggesting some redundancy. A more parsimonious model might collapse to two dimensions. The context-aware scoring is essential and well-executed.

Experimental integrity: Annotation study is thorough (multiple annotators, reasonable agreement κ > 0.6 on a hard task). Validation on six third-party datasets is the right move—shows the model captures something real, not just fitting to its own annotations. But: no comparison to adapted ABSA baselines. They compare to document-level sentiment tools, which is almost a strawman—of course those fail at span-level tasks. A fairer baseline would be an ABSA model extended to multi-dimensional output. The correlations with external datasets are modest (ρ ≈ 0.3–0.5), which is honest reporting but suggests the model is noisy.

Writing quality: The paper front-loads motivation and theory, which is good for interdisciplinary work but makes the technical contribution feel buried. Section 4 (model architecture) is too brief—glosses over how span boundaries are predicted and how the three scores are jointly trained. The validation study (Section 5) is the strongest part, showing the model’s outputs align with human-coded topics in pre-existing datasets. If I were revising, I’d expand Section 4 with ablations (does context window size matter? what if you score spans independently?) and move some of the social science background to an appendix.

Verdict: weak accept — Useful contribution to a real problem, solid execution, but incremental architecturally and missing key baselines. The value is in the problem formulation and the validated dataset, not the modeling innovation.

Takeaways

For practitioners: The three-axis framing (Advocacy, Aid, Victimization) is reusable beyond this paper. If you’re analyzing political text, customer feedback, or online discourse, ask: “Who is being supported/opposed? Who is being helped/harmed? Who is being framed as victim/perpetrator?” These are orthogonal questions, and collapsing them into one sentiment score loses information. Even if you don’t use this exact model, structuring your annotation schema this way will surface patterns that binary sentiment misses.

For researchers: The two-stage pipeline (detect targets, then score in context) is a template for any task where document-level labels are too coarse. The key insight: don’t score spans in isolation—always condition on the full message. This applies to stance detection, argument mining, and any task where local meaning depends on global framing.

Caveat: The model requires span annotations, which are expensive. If you’re starting from scratch, you’ll need to annotate hundreds of messages with target spans and regard scores. The paper’s annotation guidelines are detailed, but expect inter-annotator agreement to be modest (κ ≈ 0.6) because the task is genuinely hard. Budget accordingly.