ORPHEAS: Greek-English Embedding Model for RAG

Paper: 2604.20666 Authors: Ioannis E. Livieris, Athanasios Koursaris, et al. Categories: cs.CL, cs.AI

Abstract

Effective retrieval-augmented generation across bilingual Greek-English applications requires embedding models capable of capturing both domain-specific semantic relationships and cross-lingual semantic alignment. Existing multilingual embedding models distribute their representational capacity across numerous languages, limiting optimization for Greek with its morphological complexity.

Key Innovation: ORPHEAS

A specialized Greek-English embedding model trained with a knowledge graph-based fine-tuning methodology applied to a diverse multi-domain corpus. This enables language-agnostic semantic representations while preserving Greek-specific morphological and terminological structures.

Why Specialized Models?

1. Multilingual models spread capacity: 100+ languages means less capacity per language
2. Greek morphological complexity: Greek has rich inflection and compound word formation
3. Domain-specific terminology: Technical terms need specialized encoding

Results

Outperforms state-of-the-art multilingual embedding models on:

• Monolingual Greek retrieval benchmarks
• Cross-lingual Greek-English retrieval benchmarks

Domain-specialized fine-tuning on morphologically complex languages does not compromise cross-lingual retrieval capability.

Takeaways

• Language-pair specialized models can outperform general multilingual models
• Knowledge graph-based fine-tuning enables robust cross-lingual alignment
• Morphological complexity is not a barrier to effective cross-lingual retrieval