Paper deep dive
CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations
Suzan Awinat, Alfonso Ortega del Puente
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 90%
Last extracted: 7/20/2026, 3:50:42 AM
Summary
The paper introduces CAMMAR, a representation learning framework for Arabic that addresses 'semantic smearing' by organizing meaning into nested lexical, cultural, and metaphorical embedding subspaces. Using a staged curriculum and Al-Jurjani's theory of nazum, CAMMAR separates these semantic layers to enable a training-free geometric measure of metaphoricity. Evaluated on a new span-annotated Arabic metaphor dataset, the model achieves high detection accuracy (AUC up to 0.84) when trained with paired supervision, demonstrating that figurative meaning can be disentangled from literal and cultural contexts within a single encoder architecture.
Entities (8)
Relation Signals (7)
CAMMAR → implements → nested embedding subspaces
confidence 95% · CAMMAR... organizes meaning into nested lexical, cultural, and metaphorical embedding subspaces
CAMMAR → uses → NeoAraBERT-MSA
confidence 92% · We use NeoAraBERT-MSA... as the shared encoder
CAMMAR → achievesmetric → AUC 0.84
confidence 90% · the geometric readout detects metaphor well above chance... AUC up to 0.84
CAMMAR → basedontheory → Al-Jurjani
confidence 90% · The design implements compositional principles of Al-Jurjani's theory of nazum
CAMMAR → mitigates → semantic smearing
confidence 90% · We introduce CAMMAR... to address 'semantic smearing'
CAMMAR → evaluatedon → Classical Arabic poetry
confidence 85% · treating figurative-rich classical poetry... as one domain
CAMMAR → evaluatedon → Arabic Wikipedia
confidence 85% · trains... on Arabic Wikipedia
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Metaphor in Arabic is a culturally grounded mechanism for constructing meaning, encoding cultural knowledge that shapes interpretation. Yet current Arabic language models typically collapse lexical, cultural, and metaphorical information into a single representational space, a phenomenon we term "semantic smearing". We introduce CAMMAR (Culture-Aware Matryoshka for Metaphorical Arabic Representations), a representation learning framework that organizes meaning into nested lexical, cultural, and metaphorical embedding subspaces through a staged semantic curriculum. The design implements compositional principles of Al-Jurjani's theory of nazum, modeling figurative meaning as compositionally grounded in prior semantic relations, and yields a training-free geometric measure of metaphoricity based on the distance between lexical and metaphorical representations. Evaluated on a new span-annotated Arabic metaphor set as word-matched figurative/literal pairs, the geometric readout detects metaphor well above chance when the inter-layer geometry is shaped by paired supervision (AUC up to 0.84; figurative outscores its literal counterpart for the same word in 82.6\% of pairs), but sits at chance under an unsupervised domain contrast alone, a clean separation between a legible-under-supervision regime and a non-emergent one. A controlled ablation shows that grounding the lexical layer in morphological roots gives a small but consistent gain, an effect absent from direct probing that reflects the layer's quality as a measurement anchor. We will release the datasets, cultural concept inventory, and code upon acceptance.
Tags
Links
- Source: https://arxiv.org/abs/2607.15847v1
- Canonical: https://arxiv.org/abs/2607.15847v1
Trouble viewing inline? Open PDF directly →
Full Text
53,875 characters extracted from source content.
Expand or collapse full text
CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations Suzan Awinat Department of Computer Engineering Autonomous University of Madrid (UAM) School of Science and Technology IE University Madrid, Spain suzan.tayseer@estudiante.uam.es &Alfonso Ortega de la Puente Department of Computer Science Oviedo University Asturias, Spain Corresponding author. Abstract Metaphor in Arabic is a culturally grounded mechanism for constructing meaning, encoding cultural knowledge that shapes interpretation. Yet current Arabic language models typically collapse lexical, cultural, and metaphorical information into a single representational space, a phenomenon we term "semantic smearing". We introduce CAMMAR (Culture-Aware Matryoshka for Metaphorical Arabic Representations), a representation learning framework that organizes meaning into nested lexical, cultural, and metaphorical embedding subspaces through a staged semantic curriculum. The design implements compositional principles of Al-Jurjānī’s theory of naẓm (), modeling figurative meaning as compositionally grounded in prior semantic relations, and yields a training-free geometric measure of metaphoricity based on the distance between lexical and metaphorical representations. Evaluated on a new span-annotated Arabic metaphor set as word-matched figurative/literal pairs, the geometric readout detects metaphor well above chance when the inter-layer geometry is shaped by paired supervision (AUC up to 0.84; figurative outscores its literal counterpart for the same word in 82.6% of pairs), but sits at chance under an unsupervised domain contrast alone, a clean separation between a legible-under-supervision regime and a non-emergent one. A controlled ablation shows that grounding the lexical layer in morphological roots gives a small but consistent gain, an effect absent from direct probing that reflects the layer’s quality as a measurement anchor. We will release the datasets, cultural concept inventory, and code upon acceptance. CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations Suzan Awinat†thanks: Corresponding author. Department of Computer Engineering Autonomous University of Madrid (UAM) School of Science and Technology IE University Madrid, Spain suzan.tayseer@estudiante.uam.es Alfonso Ortega de la Puente Department of Computer Science Oviedo University Asturias, Spain 1 Introduction Metaphor is one of the most persistent challenges in Natural Language Processing. Despite the recent progress of large language models (LLMs) on most generative and discriminative benchmarks, multiple evaluations have shown that figurative-language understanding remains substantially below human level, particularly under culturally dense or rhetorically complex contexts (Zhang et al., 2025b; Sanchez-Bayona and Agerri, 2025; Mangiaterra et al., 2026). The problem is especially acute for Arabic. Recent benchmarks designed specifically for Arabic figurative language report systematic failures across both general-purpose and Arabic-specialized models. Fann or Flop (Al Ghallabi et al., 2025) shows that state-of-the-art LLMs cannot reliably capture the interpretive depth of Classical Arabic poetry across historical eras. Attia et al. (2026) document a drop of more than 14 points in accuracy when 22 LLMs are evaluated on the pragmatic use of culturally grounded Arabic idioms compared to multiple-choice understanding of the same expressions. These findings suggest that the gap is not a matter of scale, but of how metaphorical meaning is represented internally. We hypothesize that one important structural cause is the following. Standard dense embeddings compress lexical meaning, cultural symbolism, and metaphorical abstraction into a single shared space a phenomenon we call semantic smearing. This is acute for Arabic, where one triconsonantal root generates both concrete lexical items and conventionalized metaphorical extensions: – gives both asad (lion, the animal) and its figurative sense of bravery and leadership. The Arabic rhetorical tradition (al-Balāgha, ) has distinguished literal (ḥaqīqa) from metaphorical (majāz) meaning for over a millennium. Its foundational figure, Al-Jurjani (1078), argues that meaning resides not in individual lexical items but in their relations: his concept of naẓm () holds that meaning emerges from structured composition, and his treatment of metaphor (Al-Jurjani, 1954) grounds figurative interpretation in a relation (’alāqa) between the figurative reading and its literal anchor, a view elaborated by Al-Zamakhshari (1882) and Al-Sakkaki (1983) and paralleled by modern accounts of metaphor as cross-domain projection (Lakoff and Johnson, 1980). We operationalize this compositional, relational view within a representation-learning framework. We propose CAMMAR (Culture-Aware Matryoshka for Metaphorical Arabic Representations), which organizes Arabic figurative meaning into three nested embedding subspaces of decreasing dimensionality: outer lexical, middle cultural, inner metaphorical, sharing one Arabic backbone and trained by a three-phase curriculum that protects earlier structure while building later abstraction. Unlike standard Matryoshka Representation Learning (Kusupati et al., 2024), which supervises all prefixes identically, CAMMAR assigns progressively abstract objectives to progressively inner prefixes. From this structure we derive a continuous metaphorical weight WmetW_met, read out at inference as a geometric divergence between the outer and inner layers, giving an interpretable per-word metaphoricity estimate with no supervised classifier. We evaluate CAMMAR on an author-verified span-annotated Arabic metaphor test set. Our experiments examine whether metaphoricity is legible in the inter-layer geometry and under what supervision, and whether grounding the lexical layer in morphological roots improves the readout. Our contributions are: • CAMMAR, a sequential nested supervision framework that imposes a curriculum of progressively abstract semantic objectives along the nested prefixes of a single Arabic encoder. • A formalization of semantic smearing in figurative-language embeddings, together with a hierarchical regularization strategy that mitigates it through controlled freezing across training phases. • A geometric metaphorical weight WmetW_met that estimates per-word metaphoricity through prefix divergence, without requiring example-level metaphor annotations at training time. • A small but carefully constructed author-verified evaluation set for Arabic metaphor at the target-word level, to be released alongside the model. 2 Related Work CAMMAR sits at the intersection of computational metaphor processing, Arabic cultural-semantic modeling, and nested representation learning. Computational metaphor processing. Neural metaphor processing (Shutova and Ekaterina, 2010) has moved from feature engineering toward contextual representations (Do Dinh and Gurevych, 2016; Choi et al., 2021), with recent work treating metaphoricity as a context-sensitive discrepancy between a word’s literal meaning and its context (He et al., 2024; Jia and Li, 2024). CAMMAR shares this intuition but internalizes it within a single nested embedding rather than across two models. The framing is motivated by evaluations showing scale alone does not solve metaphor: LLMs rely on surface heuristics (Sanchez-Bayona and Agerri, 2025), achieve low detection F1 (Boisson et al., 2024), and misjudge novel metaphors (Mangiaterra et al., 2026). Arabic figurative language and the cultural gap. In Arabic, metaphor is entangled with morphology and inherited symbolism. Benchmarks show state-of-the-art models failing on Classical Arabic poetry (Al Ghallabi et al., 2025) and on culturally grounded idioms and proverbs (Magdy et al., 2025; Attia et al., 2026; Zibin et al., 2025). Prior Arabic metaphor work is largely supervised binary classification on small datasets, or symbolic resources (Banou et al., 2025) that treat figuration as a downstream application. To our knowledge no prior work models Arabic figurative meaning through a hierarchical learned representation separating lexical, cultural, and figurative content within one geometry. Cross-lingual studies reinforce that figurative meaning depends on language-specific cultural grounding rather than surface transfer (Sanchez-Bayona and Agerri, 2026; Tourajmehr et al., 2025). Nested representation learning. Matryoshka Representation Learning (Kusupati et al., 2024) nests embeddings under a single identical objective, encouraging compactness, not specialization; Lai et al. (2026) show identical-supervision prefixes differ only in gradient magnitude, giving no directional differentiation. Extensions add sequential training and adaptive dimension selection (Zhang et al., 2025a) and strong Arabic nested embeddings (Nacar and Koubaa, 2024), but their curriculum is over compression ratios; CAMMAR’s is over semantic abstractions, assigning different objectives to different prefixes. Closest in spirit, CAMEL (Zhang et al., 2024) disentangles literal and metaphorical meaning across two encoders with cross-domain attention, whereas CAMMAR organizes it within one nested embedding; we adopt CAMEL’s self-paced contrastive temperature schedule in Phase 3. 3 Methodology 3.1 Overview We propose CAMMAR, which organizes figurative meaning into three nested embedding subspaces of decreasing dimensionality, outer zlexz_lex biased toward lexical surface form, middle zcultz_cult toward culturally conditioned meaning, inner zmetz_met toward figurative abstraction, sharing parameters through a single Arabic backbone and trained by a three-phase curriculum that protects earlier structure while building later abstraction (Fig. 1). This operationalizes Al-Jurjani’s (1078) naẓm: the metaphorical layer acquires content only through its dependence on the cultural and lexical layers that constitute it, and the controlled freezing across phases reflects al-Jurjānī’s insistence that figurative interpretation remains grounded in, rather than displacing, prior semantic relations. The layers nest generatively: zmetz_met is computed from zcultz_cult, which is computed from zlexz_lex, so figurative interpretation is routed through cultural meaning ( as optical mirage → deceptive promise → false hope) rather than read directly off lexical form. We add one non-Jurjānīan element: an explicit cultural-substrate layer modeling the shared knowledge that Classical Arabic interpretation presupposes. A key property is that the projection heads operate at the token level, producing one nested embedding per token, which is what enables per-target-word metaphoricity estimation against a span-annotated gold set. The same heads can also be applied to a pooled representation for sentence-level analysis, but all training objectives and the evaluation in this work are token-level. We describe the architecture in §3.2, the curriculum and objectives in §3.3-§3.4, the metaphor weight in §3.5, and the evaluation protocol in §3.6. Figure 1: End-to-end CAMMAR pipeline: paired figurative/literal inputs are encoded by a shared NeoAraBERT backbone, projected into nested lexical (zlexz_lex), cultural (zcultz_cult), and metaphorical (zmetz_met) subspaces, trained by a three-phase curriculum with controlled freezing, and read out geometrically for span-level evaluation on matched pairs. The architecture is entirely token-level; target-word representations aggregate token embeddings over the annotated span. 3.2 Architecture Backbone. We use NeoAraBERT-MSA (Abou Chakra et al., 2026) as the shared encoder, a 28-layer transformer (d=768d=768) with a 65k SentencePiece vocabulary, pretrained on Modern Standard Arabic with robust coverage of both contemporary and Classical Arabic important for our metaphor corpus, which spans both registers. We denote the encoder output for an input sequence x=(x1,…,xL)x=(x_1,…,x_L) as token-level hidden states ht∈ℝdh_t ^d, t=1,…,Lt=1,…,L. Nested projection heads. Each token state is projected into three nested semantic subspaces of decreasing dimensionality: zlex(t) z_lex(t) =Wlex(ht)∈ℝ768, =W_lex(h_t) ^768, (1) zcult(t) z_cult(t) =Wcult(zlex(t))∈ℝ384, =W_cult(z_lex(t)) ^384, (2) zmet(t) z_met(t) =Wmet(zcult(t))∈ℝ192. =W_met(z_cult(t)) ^192. (3) The composition zmet=Wmet∘Wcult∘Wlexz_met=W_met W_cult W_lex enforces a semantic nesting: information passes through the lexical and cultural layers before reaching the metaphorical one. Each head is linear, followed by GELU and layer normalization, kept shallow to preserve a tractable geometric interpretation. All objectives and evaluation operate on these token-level embeddings; the heads may also be applied to a pooled representation for sentence-level analysis. In our convention the outer (largest) layer is most concrete and inner layers progressively more abstraction through compression, the inverse of the dimension-as-specificity convention in some MRL work (e.g., Lai et al., 2026). Because the three layers live in different coordinate frames, the readout cannot compare zlexz_lex and zmetz_met directly. We introduce a readout projector gm→l:ℝ192→ℝ768g_m :R^192 ^768 (linear map then layer normalization) that maps zmetz_met back into the lexical frame, so metaphoricity is a within-frame divergence (§3.5). It is trained only in Phase 3 and excluded from the hierarchical regularizer; otherwise the readout would collapse to a constant. Hierarchical re-projection. To regularize the geometry across layers, we add two learned re-projections πlex:ℝ384→ℝ768 _lex:R^384 ^768 and πcult:ℝ192→ℝ384 _cult:R^192 ^384, used by RhierR_hier (§3.4) and not at inference: a well-organized nested representation should allow approximate reconstruction of the outer layer from the inner one. 3.3 Sequential Semantic Curriculum CAMMAR is trained in three phases of increasing abstraction (Fig. 3): lexical grounding (Phase 1, training the encoder and WlexW_lex), cultural context (Phase 2, training WcultW_cult and πlex _lex with earlier layers frozen), and figurative abstraction (Phase 3, training WmetW_met and πcult _cult with all else frozen). The encoder is fine-tuned only in Phase 1. This controlled freezing preserves earlier-phase structure while building more abstract representations on top; without it, a single end-to-end objective homogenizes the subspaces, as observed for standard MRL (Kusupati et al., 2024; Zhang et al., 2025a; Lai et al., 2026). 3.4 Phase-Specific Objectives Phase 1: lexical grounding. The first phase trains the encoder and WlexW_lex to capture lexical and morphological structure on Arabic Wikipedia (100k passages subsampled from ∼ 5.2M), combining two objectives. The first is masked language modeling: we mask 15% of input tokens following the standard BERT scheme (Devlin et al., 2019) and predict the masked token identity from the lexical projection via ℒMLM=−∑t∈ℳlogp(xt∣zlex(t))L_MLM=- _t p(x_t z_lex(t)), tying the lexical layer to surface-form prediction. The second is a root-consistency loss. Arabic is templatic: words sharing a triconsonantal root frequently share a core semantic field. We obtain roots from a morphological analyzer (ALMA/SINATools, with a CAMeL Tools fallback), computed offline and cached, rather than from a substring heuristic, since roots are not substrings of inflected forms. At the token level we apply a supervised-contrastive (InfoNCE-style) loss ℒrootL_root over zlexz_lex that pulls together stem tokens sharing a root and pushes apart tokens with different roots (positives P(i)P(i) = in-batch tokens sharing i’s root; alternate roots treated as equivalent). The total Phase 1 loss is ℒ1=ℒMLM+αℒrootL_1=L_MLM+ _root. Phase 2: cultural association. The cultural layer must encode the conventional associations an Arabic speaker activates upon encountering a culturally loaded item ( ↦ generosity; ↦ courage), since these associations are the ground (jāmi') on which the figurative reading is built. We therefore train WcultW_cult not as a document-topic classifier but as an anchor-to-association retriever (Appendix Fig. 4), on an Anchor Context Cultural Association Bank: short passages (1-3 sentences) in which an anchor entity is paired with the cultural concept its context activates, drawn from biographies, adab anthologies, proverb collections, poetry commentary, and heritage texts.111We deliberately learn cultural associations distributionally from text rather than from a symbolic knowledge graph; Future Work (§7) discusses a graph-based extension as future work. Concepts are drawn from a fixed inventory C of 74 conventional cultural associations (e.g. generosity, courage, treachery, patience), including a literal class for non-activating contexts; the fixed inventory makes both same-concept negatives and concept-level evaluation well-posed. Let u=poolt∈azcult(t)u=pool_t∈ a\,z_cult(t) be the anchor-span-pooled cultural vector and pkp_k a learnable prototype for concept k∈k . The primary objective is an InfoNCE anchor-to-concept retrieval ℒa2cL_a2c that matches u u to its gold prototype p^k+ p_k^+ against all prototypes in C, augmented by a supervised-contrastive term over structured hard negatives the same anchor in an unrelated context, the same concept under a different anchor, and purely literal contexts and a uniformity penalty ℒunifL_unif that prevents the projection from collapsing onto a low-rank cone. We apply the hierarchical regularizer Rhiercult=∥πlex(zcult)−zlex∥22R_hier^cult= _lex(z_cult)-z_lex _2^2 as in Phase 1, and freeze the encoder and WlexW_lex so the literal layer is preserved. The full objective is ℒ2=ℒa2c+λsclℒscl+λunifℒunif+βRhiercultL_2=L_a2c+ _sclL_scl+ _unifL_unif+β R_hier^cult. Concept labels for training are LLM-proposed (distant supervision); reported cultural-layer results use a human-verified gold subset disjoint from training at the lemma and root level. We present the cultural layer as a method and resource; its empirical evaluation (held-out concept retrieval) is reported in §5. Phase 3: figurative abstraction. Phase 3 trains the metaphorical layer WmetW_met and the readout projector gm→lg_m with the encoder, WlexW_lex, and WcultW_cult frozen, in one of two arms (§5.1). Arm U (unsupervised) derives supervision from corpus identity, treating figurative-rich classical poetry (∼ 330k passages) as one domain and a sampled Arabic Wikipedia literal control (∼ 30% as many) as another, and separating them in zmetz_met with a domain-contrastive InfoNCE objective (van den Oord et al., 2018) and a uniformity penalty (Wang and Isola, 2020); the contrastive temperature follows a self-paced schedule adapted from Zhang et al. (2024). Arm S (supervised) instead optimizes a paired margin objective on labeled metaphor/literal pairs sharing a target word, requiring Wmet(fig)−Wmet(lit)≥mW_met(fig)-W_met(lit)≥ m. Both arms apply the hierarchical regularizer Rhiermet=∥πcult(zmet)−zcult∥22R_hier^met= _cult(z_met)-z_cult _2^2, which keeps the metaphorical layer anchored to the cultural layer, and neither uses a classifier head: metaphoricity is read out geometrically (§3.5). Loss terms, corpus details, and hyperparameters are given in Appendix B. 3.5 Metaphorical Weight CAMMAR estimates metaphoricity geometrically as the divergence between the lexical layer and the metaphorical layer mapped back into the lexical frame by the readout projector gm→lg_m (§3.2). For an input x, Wmet(x)=1−cos(zlex(x),gm→l(zmet(x))),W_met(x)=1- \! (z_lex(x),\;g_m (z_met(x)) ), (4) with both arguments in ℝ768R^768. A value near zero means the metaphorical layer stays aligned with its lexical anchor (literal); a value approaching one means the two have diverged (figurative). At the token level we apply the same readout per token 1−cos(zlex(t),gm→l(zmet(t)))1- (z_lex(t),g_m (z_met(t))) and mean-aggregate over the stem subword tokens of a target word to obtain its per-word weight Wmet(w∣c)W_met(w c), our primary evaluation signal. It is a measurement, not a trained classifier: given the heads and the readout projector, it is computed at inference time with no example-level labels and no additional learned head. 3.6 Evaluation Protocol We construct a span-annotated gold test set through an LLM-assisted, author-curated pipeline: an LLM proposes contextualized sentences for hand-curated seed target words, the author inspects each at generation time (discarding/regenerating any that misuse the target word, use dialect, or are ungrammatical), and each metaphorical record is paired with a literal companion using the same target word. Full protocol and prompts are in Appendix A. Our evaluation is paired (Fig. 5). Since the gold set is uniformly figurative, with negatives supplied by each record’s literal companion, we score over the 184 matched pairs: the balanced ROC AUC, and the within-pair difference ΔWmet=Wmet(w∣cmet)−Wmet(w∣clit) W_met=W_met(w c_met)-W_met(w c_lit), tested against zero with the one-sided Wilcoxon signed-rank test. As a supplementary analysis, we probe each layer for its intended specialization with ℓ2 _2-regularized logistic probes (Appendix C). 4 Experimental Setup Backbone. CAMMAR is built on U4RASD/NeoAraBERT_MSA (300M parameters), a NeoAraBERT-family encoder pretrained on Modern Standard Arabic. Subspace dimensionalities follow the nesting dlex=768⊃dcult=384⊃dmet=192d_lex=768⊃ d_cult=384⊃ d_met=192 (§3). Training. All phases use AdamW (weight decay 0.01), gradient clipping at norm 1.0, linear warmup with cosine decay, and mixed-precision training, with the per-layer similarity computations in the Phase-3 objectives kept in fp32 for numerical stability. Phase 1 (lexical) trains the encoder and WlexW_lex with masked language modeling on a 100k-sentence Arabic Wikipedia subsample for 2 epochs at learning rate 510−5510^-5, batch size 32. We train two Phase-1 variants that differ only in this phase: Model A uses MLM alone, and Model B adds the token-level root-consistency loss (αroot=0.3 _root=0.3) with roots from the ALMA analyzer cached offline. Phase 2 (cultural) freezes the encoder and WlexW_lex and trains WcultW_cult on the Anchor Context Cultural Association Bank (§3.4). Phase 3 (figurative) freezes the encoder, WlexW_lex, and WcultW_cult, and trains WmetW_met and the readout projector gm→lg_m for 15 epochs at learning rate 210−5210^-5, batch size 32, temperature 0.07. We run two Phase-3 arms from each Phase-1 model: Arm U optimizes a label-free token-level domain contrast (poetry vs. an arwiki literal control at a 0.3 ratio) with a uniformity term; Arm S optimizes a paired margin objective on labeled metaphor/literal pairs (Wmet(fig)−Wmet(lit)≥mW_met(fig)-W_met(lit)≥ m, m=0.1m=0.1). The readout projector is re-initialized from a fixed seed at the start of each arm and is excluded from the hierarchical regularizer (§3.2). All runs use seed 42 on a single NVIDIA RTX 3090 (24GB). Supervised-head reference. As an upper-bound reference (Table 1, last row), we train a linear metaphor-detection head on zmetz_met at the target-word span on a 563-example supplementary set (50 seed words, disjoint by target word from the gold set), frozen backbone and heads; this is a trained classifier, not a geometric readout, and is reported only to bound what a supervised detector reaches on the same data. Evaluation set. The gold test set is scored as 184 matched pairs (§3.6); roots are resolved with the ALMA cache, gold target words are disjoint from all training data at the lemma and root level, and the set is used only at evaluation time. Baselines. We do not report comparisons against alternative architectures (vanilla MRL, SMEC-style nested training, or a directly fine-tuned supervised baseline); see Limitations for discussion. 5 Results We evaluate on the gold set (§4): 184 matched pairs sharing a target word, so the comparison holds word identity fixed and isolates figurative vs. literal usage. WmetW_met is read out at the target-word span on this held-out set. We test two questions in a 2222 comparison: whether metaphoricity is legible in the geometry and under what supervision (Arm U vs. Arm S), and whether root grounding improves the readout (Model A vs. Model B), with every other ingredient held identical. Geometric WmetW_met (gold) Phase 1 Phase 3 arm AUC paired p A (MLM) U (unsupervised) 0.479 0.870.87 A (MLM) S (supervised) 0.795 1.110−191.110^-19 B (MLM+root) U (unsupervised) 0.415 1.01.0 B (MLM+root) S (supervised) 0.840 4.010−244.010^-24 Supervised head (upper bound) 0.99 <10−30<10^-30 Table 1: Geometric metaphor detection on the 184-pair gold set, as a 2222 ablation over the Phase-1 objective (root grounding) and the Phase-3 arm (supervision of the geometry). AUC is the balanced ROC AUC over the paired fig/lit records; p is the one-sided Wilcoxon signed-rank test on the within-pair difference ΔWmet W_met. The supervised classifier head (not a geometric readout) is shown as an upper-bound reference. All Phase-3 runs use 15 epochs. 5.1 Metaphoricity is legible in the geometry, but only under supervision Table 1 reveals a clear separation between the two arms. Arm S detects metaphor well above chance: Model A achieves AUC 0.7950.795 with 78.3%78.3\% concordance (median ΔWmet=+0.052 W_met=+0.052, p=1.110−19p=1.110^-19), and Model B reaches AUC 0.8400.840 with 82.6%82.6\% concordance (median ΔWmet=+0.062 W_met=+0.062, p=4.010−24p=4.010^-24). By contrast, Arm U remains at chance for both models (AUC 0.4790.479 and 0.4150.415; p=0.87p=0.87 and 1.01.0). Because the paired design controls the target word, register, and context (e.g., used metaphorically versus literally), the Arm S advantage cannot be explained by lexical or genre confounds. This contrast supports the central claim of frame (2): metaphoricity is legible in the divergence between lexical and metaphorical layers (Fig. 2), but it does not emerge from label-free domain contrast. Instead, paired supervision must shape the geometry before the training-free readout can recover it, consistent with evidence that unsupervised contrastive objectives may solve their proxy task while weakly encoding the downstream property (van den Oord et al., 2018; Wang and Isola, 2020). We therefore characterize CAMMAR as a supervised-contrastive geometry with a training-free readout. While a supervised classifier reaches AUC 0.990.99 (Table 1), the geometric readout recovers a strong paired effect (p<10−19p<10^-19) without requiring a classifier at inference time. 5.2 Root grounding gives a small, consistent gain At a matched 15-epoch budget, the root-grounded Model B outperforms the MLM-only Model A in the supervised-geometry arm by a modest but consistent margin: +0.045+0.045 AUC (0.8400.840 vs. 0.7950.795), +4.3+4.3 points of pair concordance (82.6%82.6\% vs. 78.3%78.3\%), a larger median effect (+0.062+0.062 vs. +0.052+0.052), and a smaller p-value (4.010−244.010^-24 vs. 1.110−191.110^-19). The improvement is small in absolute AUC but moves every metric in the same direction, which is the pattern expected of a real effect rather than run-to-run noise. In the unsupervised arm, where the geometry carries no metaphor signal to begin with, root grounding makes no difference (both at chance). The benefit is anchor quality, not visible root clustering. A direct diagnostic complicates the naive reading of this result. Probing the lexical layer for root organization mean within-root versus across-root cosine separation, and nearest-neighbor root purity shows that Models A and B are near-identical and both only weakly root-organized (separation +0.037+0.037 vs. +0.026+0.026; N purity 0.140.14 vs. 0.110.11, against a chance of 0.040.04), with the projection in fact discarding part of the root signal already present in the raw encoder (+0.07+0.07 separation). In other words, the root objective does not make zlexz_lex visibly cluster by root any more than MLM alone does, yet it still improves downstream metaphor detection. We read this as evidence that root grounding improves the anchor quality of zlexz_lex its suitability as the reference frame against which zmetz_met is measured through a mechanism not captured by cosine clustering of the layer in isolation. This probe-versus-task divergence is a cautionary methodological point: a representation can be a better anchor for a downstream geometric readout without being more separable under direct probing. 5.3 The cultural layer learns its associations but generalizes weakly We evaluate the cultural layer as concept retrieval on a human-verified gold set of 169 anchor-context records. Although it fits its training associations almost perfectly (retrieval accuracy ≈1.0≈ 1.0), generalization to held-out anchors remains limited: top-1 retrieval reaches 0.0590.059 versus a 0.0140.014 chance rate (4.24.2 lift), increasing to 19%19\% at top-5. Allowing credit for any valid concept among an anchor’s multiple associations raises top-1 accuracy only to 0.0950.095. Thus, the cultural layer reliably memorizes training associations but does not yet generalize robustly to unseen anchors. We present it as a method and resource, leaving robust cultural generalization as future work, likely requiring broader per-concept coverage or partial encoder adaptation in Phase 2. 6 Discussion The decisive factor is not the readout but whether paired supervision shapes the geometry: label-free domain contrast solves its proxy objective yet transfers only at chance to metaphoricity, consistent with unsupervised contrastive learning where proxy objectives weakly encode the target property (van den Oord et al., 2018; Wang and Isola, 2020). We therefore characterize CAMMAR as a supervised-contrastive geometry with a training-free readout, with root grounding strengthening the lexical layer as a measurement anchor rather than improving its standalone separability. We remain cautious in interpretation: the readout falls short of a supervised classifier (AUC 0.990.99), and both the supervision pairs and gold set comprise LLM-generated sentences from the same pipeline, so shared artifacts cannot be excluded. Even so, for Arabic, where large sentence-level metaphor corpora are scarce, metaphoricity can be measured directly from inter-layer geometry using paired supervision over only dozens of words, without a classifier. 7 Conclusion Figurative meaning in Arabic is often flattened by representations that conflate lexical, cultural, and metaphorical information. We introduced CAMMAR, which separates meaning into three nested embedding subspaces trained through a sequential semantic curriculum with controlled freezing, rather than the identical-supervision scheme of standard Matryoshka representation learning. The design operationalizes Al-Jurjani’s (1078) theory of naẓm and yields a geometric, training-free metaphoricity readout WmetW_met. On a gold set of 184 word-matched figurative/literal pairs, WmetW_met detects metaphor well above chance under supervised-contrastive training (AUC up to 0.8400.840, p<10−23p<10^-23) but remains at chance under unsupervised domain contrast. Root grounding provides a small but consistent gain (+0.045+0.045 AUC) visible only in the geometric readout, not direct probing. We will release the model, gold set, and construction pipeline upon acceptance. Future directions. The gold set could be expanded from classical rhetorical sources (Balāgha textbooks and the poetic-commentary shurūḥ tradition); the cultural layer could be deepened on the substrates Arabic figuration draws on and on multiple parallel cultural reservoirs, enabling models of cross-cultural divergence. The concept inventory is, by design, the node set of a future Cultural Knowledge Graph: turning the Bank’s distributional associations into explicit typed relations (symbolizes, embodies, contrasts-with) would add multi-hop cultural inference. Limitations Scale and baselines. The gold set yields 184 figurative/literal minimal pairs sufficient for the paired tests we report, but smaller than English benchmarks such as VUA-MIPVU, and we prioritize span-level annotation quality over scale. We also do not compare against alternative architectures (a vanilla MRL ablation without the sequential curriculum, SMEC-style nested training, or a directly fine-tuned supervised baseline). Our results therefore establish that CAMMAR’s nested geometry carries a real, supervision-legible metaphoricity signal, but not that it exceeds what a simpler architecture would achieve on the same data; both comparisons are direct next steps. Supervision proxy and a one-dimensional readout. Arm U derives its signal from corpus identity (figurative-leaning poetry vs. a literal-leaning Wikipedia control), which is only a proxy for figurativity: poetry contains denotative description and encyclopedic prose contains conventionalized figuration, so the unsupervised arm conflates figurative abstraction with stylistic register consistent with its chance-level result. Separately, WmetW_met is a single scalar that captures how figurative a word is but does not distinguish the classical metaphor categories (isti’āra, kināya); recovering those would require additional structured supervision. Coverage and backbone. All training corpora and the gold set are restricted to Modern Standard and Classical Arabic; we do not evaluate dialectal varieties, whose figuration draws on different source domains. All results use a single backbone, NeoAraBERT-MSA (Abou Chakra et al., 2026); the architecture makes no backbone-specific assumptions, but transfer across encoders is unverified. The cultural layer is evaluated as concept retrieval on a disjoint, human-verified gold set (§5); it learns its training associations but generalizes only weakly to held-out anchors (top-1 4.24.2 chance), and is not yet used as direct cultural-metaphor supervision. Strengthening this generalization through broader per-concept coverage or partial encoder adaptation in Phase 2 is left to future work. Annotation subjectivity. The gold set was built through an LLM-assisted pipeline with inline curation by a native Arabic speaker: every generated sentence was inspected at generation time and unsuitable ones discarded and regenerated. Because verification was inline rather than an independent post-hoc pass, we report no separate acceptance rate or inter-annotator agreement; the resource reflects single-curator judgment, and independent multi-annotator validation is left to future work. Ethics Statement Data sources and licensing. Our training corpora consist of Arabic Wikipedia and publicly available classical Arabic poetry and heritage texts, used for non-commercial research. The cultural association data and the span-annotated metaphor set were generated with large language models and curated by the authors; we do not redistribute any copyrighted source text, and released artifacts will contain only model-generated sentences and our own annotations. Use of large language models. The metaphor gold set and the cultural association bank were produced through LLM-assisted generation (with Anthropic, OpenAI, or Google backends) followed by human curation. LLM-generated text can carry the biases and factual errors of its source models; we mitigate this through inline native-speaker review. Cultural representation. CAMMAR encodes conventional cultural associations (e.g. figures and symbols of generosity, courage, or treachery) drawn predominantly from a Modern Standard and Classical Arabic literary tradition. This is a partial and historically situated view of “Arabic culture”: it underrepresents dialectal, regional, and contemporary figuration, and the fixed concept inventory reflects choices made by the authors. The cultural layer should not be read as a complete or normative model of cultural meaning, and we caution against deploying it in settings where such associations could reinforce stereotypes about groups or individuals. Intended use and risks. CAMMAR is a research framework for studying how figurative meaning is represented; it is not a deployed system for high-stakes decisions. Its metaphoricity readout is a continuous geometric measurement, not a verified classifier, and the cultural layer generalizes only weakly to unseen anchors (§5.3); both should be used with appropriate caution and not as ground truth about whether a given utterance is figurative or what it culturally connotes. Reproducibility and release. To support reproducibility, we report seeds, hyperparameters, and corpus statistics (§4, Appendix B) and will release the datasets, the cultural concept inventory, and code upon acceptance, with documentation of the generation and curation pipeline (Appendix A). All experiments were run on a single consumer GPU, keeping the computational and environmental footprint modest. References C. Abou Chakra, H. Hamoud, O. Rakan Al Mraikhat, Q. Abu Obaida, M. Ballout, and F. A. Zaraket (2026) NeoAraBERT: a modern foundation model for arabic embeddings with diacritics-aware tokenization and pos-targeted masking. In Findings of the Association for Computational Linguistics: ACL 2026, San Diego, California, United States. Note: Accepted paper External Links: Link Cited by: §3.2, Limitations. W. Al Ghallabi, R. Thawkar, S. Ghaboura, K. P. More, O. Thawakar, H. Cholakkal, S. Khan, and R. M. Anwer (2025) Fann or flop: a multigenre, multiera benchmark for Arabic poetry understanding in LLMs. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng (Eds.), Suzhou, China, p. 20224–20244. External Links: Link, Document, ISBN 979-8-89176-332-6 Cited by: §1, §2. A. a. Al-Jurjani (1078) Dalail al-ijaz. Dar al-Khanji, Cairo, Egypt. External Links: Link Cited by: §1, §3.1, §7. A. a. Al-Jurjani (1954) Asrar al-balgha. Maṭba’at Wizārat al-Ma’ārif, Istanbul. Note: Originally composed ca. 1078 CE. The classic critical edition by Hellmut Ritter, based on three Istanbul manuscript witnesses (Husrev Paşa 654, Feyzullah 1771, Hamidiye 1238) and the Rashid Rida printed edition. Contains a 27-page English-language editorial introduction by Ritter (p. 1–27). Cite this work for the metaphor/isti’āra discussions and the ḥaqīqa/majāz distinction; cite jurjani:dalail for the foundational naẓm doctrine. External Links: Link Cited by: §1. Y. B. A. B. Al-Sakkaki (1983) Miftah al-ulum. Dar al-Kutub al-Ilmiyya, Beirut. External Links: Link Cited by: §1. J. A. Al-Zamakhshari (1882) Asas al-balagha. Dar al-Kutub al-Ilmiyya, Beirut. External Links: Link Cited by: §1. M. Attia, A. Muhamed, M. Alkhamissi, T. Solorio, and M. T. Diab (2026) Beyond understanding: evaluating the pragmatic gap in LLMs’ cultural processing of figurative language. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), V. Demberg, K. Inui, and L. Marquez (Eds.), Rabat, Morocco, p. 7238–7265. External Links: Link, Document, ISBN 979-8-89176-380-7 Cited by: §1, §2. Z. Banou, S. El Filali, E. H. Benlahmar, L. Eljiani, and F. Alaoui (2025) Developing a multi-layer ontology construction framework for Arabic language processing: focus on figurative language potential. IEEE Access 13, p. 138535–138550. External Links: Document Cited by: §2. J. Boisson, A. Ushio, H. Borkakoty, K. Rezaee, D. Antypas, Z. Siddique, N. White, and J. Camacho-Collados (2024) How are metaphors processed by language models? the case of analogies. In Proceedings of the 28th Conference on Computational Natural Language Learning, L. Barak and M. Alikhani (Eds.), Miami, FL, USA, p. 365–387. External Links: Link, Document Cited by: §2. M. Choi, S. Lee, E. Choi, H. Park, J. Lee, D. Lee, and J. Lee (2021) MelBERT: metaphor detection via contextualized late interaction using metaphorical identification theories. In Proceedings of NAACL, p. 1763–1773. Cited by: §2. J. Devlin, M. Chang, K. Lee, and K. Toutanova (2019) BERT: pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT, p. 4171–4186. Cited by: §3.4. E. Do Dinh and I. Gurevych (2016) Token-level metaphor detection using neural networks. In Proceedings of the Fourth Workshop on Metaphor in NLP, p. 28–33. Cited by: §2. X. He, L. Yu, S. Tian, Q. Yang, and J. Long (2024) SC-net: multimodal metaphor detection using semantic conflicts. In Neurocomputing, Vol. 594. External Links: ISBN 0925-2312, Link Cited by: §2. K. Jia and R. Li (2024) Metaphor detection with context enhancement and curriculum learning. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), Duh (Ed.), Mexico City, Mexico, p. 2726–2737. External Links: Link, Document Cited by: §2. A. Kusupati, G. Bhatt, A. Rege, M. Wallingford, A. Sinha, V. Ramanujan, W. Howard-Snyder, K. Chen, S. Kakade, P. Jain, and A. Farhadi (2024) Matryoshka representation learning. External Links: 2205.13147, Link Cited by: §1, §2, §3.3. R. Lai, L. Chen, W. Chen, and R. Chen (2026) Matryoshka representation learning for recommendation with layer- and hardness-adaptive negative sampling. ACM Transactions on Intelligent Systems and Technology 17 (4), p. 88:1–88:25. External Links: Document Cited by: §2, §3.2, §3.3. G. Lakoff and M. Johnson (1980) The metaphorical structure of the human conceptual system. Cognitive Science 4 (2), p. 195–208. External Links: Document, Link Cited by: §1. S. M. Magdy, S. Y. Kwon, F. Alwajih, S. T. Abdelfadil, S. Shehata, and M. Abdul-Mageed (2025) JAWAHER: a multidialectal dataset of Arabic proverbs for LLM benchmarking. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), L. Chiruzzo, A. Ritter, and L. Wang (Eds.), Albuquerque, New Mexico, p. 12320–12341. External Links: Link, Document, ISBN 979-8-89176-189-6 Cited by: §2. V. Mangiaterra, C. B. di San Pietro, P. Canal, and V. Bambini (2026) Metaphors’ journeys across time and genre: tracking the evolution of literary metaphors with temporal embeddings. External Links: 2602.13701, Link Cited by: §1, §2. O. Nacar and A. Koubaa (2024) Enhancing semantic similarity understanding in arabic nlp with nested embedding learning. External Links: 2407.21139, Link Cited by: §2. E. Sanchez-Bayona and R. Agerri (2025) Metaphor and large language models: when surface features matter more than deep understanding. In Findings of the Association for Computational Linguistics: ACL 2025, W. Che, J. Nabende, E. Shutova, and M. T. Pilehvar (Eds.), Vienna, Austria, p. 17462–17477. External Links: Link, Document, ISBN 979-8-89176-256-5 Cited by: §1, §2. E. Sanchez-Bayona and R. Agerri (2026) Meta4XNLI: a cross-lingual parallel corpus for metaphor detection and interpretation. Vol. 52. External Links: Document Cited by: §2. Shutova and Ekaterina (2010) Models of metaphor in NLP. Proceedings of the 48th Annual Meeting of the ACL, p. 688–697. Cited by: §2. A. Tourajmehr, M. R. Modarres, and Y. Yaghoobzadeh (2025) Evaluating the creativity of LLMs in Persian literary text generation. In Findings of the Association for Computational Linguistics: EMNLP 2025, C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng (Eds.), Suzhou, China, p. 14762–14774. External Links: Link, Document, ISBN 979-8-89176-335-7 Cited by: §2. A. van den Oord, Y. Li, and O. Vinyals (2018) Representation learning with contrastive predictive coding. ArXiv abs/1807.03748. External Links: Link Cited by: §3.4, §5.1, §6. T. Wang and P. Isola (2020) Understanding contrastive representation learning through alignment and uniformity on the hypersphere. In Proceedings of the 37th International Conference on Machine Learning, ICML’20. Cited by: §3.4, §5.1, §6. B. Zhang, L. Chen, T. Liu, and B. Zheng (2025a) SMEC:rethinking matryoshka representation learning for retrieval embedding compression. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng (Eds.), Suzhou, China, p. 26209–26222. External Links: Link, Document, ISBN 979-8-89176-332-6 Cited by: §2, §3.3. D. Zhang, X. Lu, M. Zhuang, S. Yang, and H. Chen (2025b) Multimodal metaphor recognition based on chain-of-cognition prompting. Cognitive Systems Research 91, p. 101356. External Links: ISSN 1389-0417, Document, Link Cited by: §1. L. Zhang, L. Jin, G. Xu, X. Li, C. Xu, K. Wei, N. Liu, and H. Liu (2024) CAMEL: capturing metaphorical alignment with context disentangling for multimodal emotion recognition. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38, p. 9341–9349. External Links: ISBN 978-1-57735-887-9, Link, Document Cited by: §2, §3.4. Zibin, A., Binhaidara, N., Al-Shahwan, and H. et al. (2025) Metaphor interpretation in jordanian arabic, emirati arabic and classical arabic: artificial intelligence vs. humans. Cognitive Systems Research 12, p. 942. External Links: Document, Link Cited by: §2. Appendix A Gold Set Construction Protocol The span-annotated metaphor gold set is built in four stages (G1-G4) through an LLM-assisted pipeline with inline single-curator verification. The same infrastructure (a provenance-tracked record store, a pluggable LLM call supporting manual paste-back and automated backends, and diacritic-tolerant span location) is reused for the Cultural Association Bank (§3.4). G1: Seed collection. We curate a list of seed target words, each a single content word with a well-attested metaphorical sense in Modern Standard or Classical Arabic. Every seed carries its target word, a literal gloss, a metaphorical gloss (with an optional Arabic rhetorical note), and its source and target conceptual domains (e.g. : source animal, target human courage). Seeds are drawn from standard rhetorical inventories and lexicographic sources; classical-poetry candidate verses are additionally collected as raw material for verse-based target extraction. G2: LLM-assisted proposal generation. For each seed, an LLM is prompted to produce several contextualized sentences in which the target word is used in its metaphorical sense. Generation runs in either a manual mode (the rendered prompt is shown and the model’s reply pasted back) or an automated mode (Anthropic, OpenAI, or Google backends), with identical downstream parsing. Three prompt templates are used: a target-word contextualization prompt that elicits metaphorical sentences for a seed; a paired-literal-companion prompt that, given a metaphorical sentence, elicits a literal-sense sentence using the same target word; and a verse target-extraction prompt that identifies a metaphorically-used target word and its span within a classical verse. Generation is resumable, tracking completed seeds by provenance. G3: Inline curation. Every proposed sentence is inspected at generation time by a native-speaker curator. A sentence is discarded (and regenerated) if it misuses or omits the target word, lapses into dialect, is ungrammatical, or fails to realize the intended figurative sense. Accepted sentences have their target span located automatically (with a diacritic-relaxed fallback) and validated against the surface form. Dialectal sentences are filtered by a heuristic marker list as a second guard. G4: Finalization. Each metaphorical record is paired with a literal companion sharing the same target word, linked by record identifier, so that evaluation can control for word identity. Records carry the sentence text, the target span (character offsets, surface form, and analyzer-derived root), an expected label, pairing links, and full generation provenance. The final set comprises 1,098 sentences 914 metaphorical and 184 literal over 184 target words, scored as 184 word-matched figurative/literal pairs (§3.6). Verification is by a single curator inline during generation; multi-annotator agreement is left to future work. Target words in the gold set are disjoint from all training corpora at the lemma and root level. Appendix B Hyperparameter Details Phase Key settings 1 (lexical) MLM; 2 ep; lr 510−5510^-5; bs 32; Model B adds root SupCon, αroot=0.3 _root=0.3 2 (cultural) frozen enc. + WlexW_lex; anchor→ InfoNCE + SupCon + uniformity; τ=0.07τ=0.07 3 (figurative) frozen enc./WlexW_lex/WcultW_cult; 15 ep; lr 210−5210^-5; bs 32; τ=0.07τ=0.07; Arm S margin m=0.1m=0.1; Arm U λunif=0.1 _unif=0.1 all AdamW, wd 0.01, clip 1.0, warmup+cosine, fp16 (fp32 similarities), seed 42, RTX 3090 Table 2: Training hyperparameters per phase. Appendix C Layer-Specialization Probing To test whether the three layers carry their intended content, we probe each layer zkz_k for three tasks: lexical (predict the target word’s root), cultural (predict the concept from the inventory, §3.4), and figurative (predict metaphoric use). We standardize embeddings, fit an ℓ2 _2-regularized logistic regression (C=1C=1), and report 5-fold stratified accuracy. The per-layer specialization is Δk=acc(zk,Tk⋆)−12∑T≠Tk⋆acc(zk,T), _k=acc(z_k,T_k )- 12\! _T≠ T_k \!acc(z_k,T), (5) with Tk⋆T_k the task aligned to zkz_k, and the global index Δ=13∑kΔk = 13 _k _k; positive Δ means each layer leads on its own task. Appendix D Supplementary Figures Figure 2: Distribution of the geometric metaphoricity readout WmetW_met over the 184 matched figurative/literal pairs (token-level, target-word span). Left: Arm U (unsupervised domain contrast) places figurative and literal uses in overlapping distributions (AUC near chance). Right: Arm S (supervised paired margin) separates them (AUC 0.8400.840 for Model B). Dashed lines mark class medians. The contrast visualizes the central finding: metaphoricity is legible in the inter-layer geometry only when paired supervision shapes it. Figure 3: Training data flow across CAMMAR’s three phases. Phase 1 uses Arabic Wikipedia for masked language modeling, with an optional token-level root-consistency objective (Model B) using analyzer-derived roots. Phase 2 builds the cultural layer from the Anchor Context Cultural Association Bank, training anchor-to-concept retrieval with a frozen encoder. Phase 3 trains the metaphorical layer in one of two arms: an unsupervised domain contrast (poetry vs. an arwiki literal control) or a supervised paired margin objective on labeled metaphor/literal pairs. The dashed arrow indicates the sequential curriculum. Figure 4: The cultural layer (Phase 2, §3.4). An Association Bank passage pairs a culturally loaded anchor entity (e.g. ) with the surrounding context that activates its conventional association. The frozen encoder and WcultW_cult head produce a token-level cultural representation pooled over the anchor span (zcultz_cult), which is matched by InfoNCE retrieval against a fixed inventory of 74 concept prototypes (here, generosity). The full Phase-2 objective additionally includes a supervised-contrastive term over structured hard negatives and a uniformity penalty; the encoder and zlexz_lex are frozen so the literal layer is preserved. The figure shows the retrieval path only. Figure 5: CAMMAR’s evaluation pipeline at the token level. Each paired gold record consists of a metaphorical sentence and a literal companion sharing the same target word. Both sentences are encoded through CAMMAR’s token path, after which the per-target-word metaphorical weight WmetW_met is computed by aggregating per-token cosine distances over the target span. The paired difference ΔWmet W_met should be reliably positive across the paired subset, tested with the Wilcoxon signed-rank test.