CLEF HIPE-2026: Evaluating Person-Place Relation Extraction from Multilingual Historical Texts

Paper: 2602.17663 Authors: Juri Opitz, Corina Raclé, Emanuela Boros, Andrianos Michail, Matteo Romanello, Maud Ehrmann, Simon Clematide Categories: cs.AI, cs.CL, cs.IR

Abstract

HIPE-2026 represents the third iteration of the Historical Information Processing Evaluation lab series, focusing on person-place relation extraction from multilingual historical documents. The lab addresses the challenge of identifying semantic associations between persons and locations in noisy, OCR-processed texts spanning multiple languages and historical periods. Systems must classify two distinct relation types: $at$ relations indicating historical presence (“Has the person ever been at this place?”) and $isAt$ relations denoting contemporaneous location (“Is the person located at this place around publication time?”). The evaluation framework introduces a novel three-dimensional assessment combining accuracy metrics, computational efficiency measurements, and domain generalization capabilities, making it particularly relevant for real-world digital humanities applications.

Key Contributions

• Introduction of semantic relation extraction tasks to the HIPE series, moving beyond named entity recognition to structured knowledge extraction
• Definition of two temporally-grounded relation types ($at$ and $isAt$) requiring sophisticated reasoning over temporal and geographical context
• Novel three-fold evaluation methodology assessing accuracy, computational efficiency, and cross-domain generalization simultaneously
• Multilingual benchmark spanning multiple languages and historical periods, addressing the diversity of historical document collections
• Direct alignment with downstream applications in knowledge graph construction, biographical reconstruction, and spatial humanities analysis

Task Design and Challenges

The HIPE-2026 lab tackles several fundamental challenges in historical text processing. Historical documents present unique difficulties: OCR errors from degraded source materials, spelling variations across time periods, inconsistent naming conventions, and limited contextual information. The relation extraction task requires systems to not only identify person and place mentions but also determine their semantic relationship while reasoning about temporal constraints.

The distinction between $at$ and $isAt$ relations introduces temporal reasoning requirements. The $at$ relation captures any historical association between a person and location, regardless of timing—a biographical fact that may span years or decades. In contrast, $isAt$ relations demand precise temporal grounding, identifying whether a person was located at a place around the document’s publication time. This temporal specificity requires systems to interpret publication dates, temporal expressions, and contextual clues within the text.

The multilingual aspect adds another layer of complexity. Historical texts in different languages exhibit distinct linguistic patterns, naming conventions, and cultural contexts. Systems must generalize across these variations while maintaining accuracy, a challenge that tests both language-specific adaptation and cross-lingual transfer capabilities.

Evaluation Framework

HIPE-2026’s three-dimensional evaluation profile represents a significant methodological contribution. Traditional relation extraction benchmarks focus primarily on accuracy metrics like precision, recall, and F1 scores. This lab extends evaluation to include computational efficiency and domain generalization, reflecting real-world deployment constraints.

The accuracy dimension assesses standard performance metrics on relation classification, measuring how well systems identify and classify person-place associations. This includes both entity-level evaluation (correctly identifying relation participants) and relation-level evaluation (correctly classifying relation types).

Computational efficiency evaluation addresses practical scalability concerns. Historical document collections often contain millions of pages, making processing speed and resource consumption critical factors. The lab measures inference time, memory usage, and throughput, encouraging development of systems that balance accuracy with computational practicality.

Domain generalization assessment evaluates how well systems transfer across different historical periods, document types, and languages. This tests robustness beyond the training distribution, a crucial capability for digital humanities applications where labeled data may be scarce for specific domains or time periods.

Implications for Digital Humanities

The HIPE-2026 lab directly addresses needs in digital humanities research and cultural heritage applications. Knowledge graph construction from historical sources requires accurate relation extraction to build structured representations of historical events, social networks, and geographical patterns. The lab’s focus on person-place relations provides essential building blocks for these knowledge bases.

Historical biography reconstruction benefits from automated extraction of location information. Tracking individuals’ movements and associations across documents enables researchers to construct detailed biographical timelines and understand historical mobility patterns. The temporal distinction between $at$ and $isAt$ relations supports both long-term biographical analysis and event-specific location tracking.

Spatial analysis in digital humanities relies on georeferenced historical data. Extracting person-place associations enables researchers to visualize historical networks, analyze migration patterns, and study the geographical distribution of historical actors. The multilingual scope supports comparative studies across different cultural and linguistic contexts.

The emphasis on computational efficiency acknowledges the scale of historical document collections. Libraries and archives hold vast quantities of digitized materials, and practical systems must process these collections in reasonable timeframes with available computational resources. By evaluating efficiency alongside accuracy, the lab encourages development of deployable solutions rather than purely research-oriented systems.

Takeaways

1. HIPE-2026 extends historical text processing evaluation from entity recognition to semantic relation extraction, addressing a critical gap in structured knowledge extraction from historical sources.

2. The two-relation taxonomy ($at$ and $isAt$) introduces temporal reasoning requirements, distinguishing between historical biographical facts and contemporaneous location information.

3. The three-dimensional evaluation framework (accuracy, efficiency, generalization) reflects real-world deployment constraints and encourages development of practical, scalable systems.

4. Multilingual coverage across multiple historical periods provides a comprehensive benchmark for cross-lingual and cross-temporal generalization in historical NLP.

5. Direct alignment with digital humanities applications—knowledge graphs, biographical reconstruction, spatial analysis—ensures the lab’s relevance to end-user needs in cultural heritage and historical research.