Paper deep dive
Beyond Independent Labels: Schwartz-Geometry Decoding for Human Value Detection
VĂctor Yeste, Paolo Rosso
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 91%
Last extracted: 7/7/2026, 4:36:28 PM
Summary
The paper investigates human value detection as a sentence-level multi-label classification task over the 19 refined Schwartz values. It challenges the standard independent-label assumption by operationalizing Schwartz theory's circular motivational continuum as an explicit output-space geometry. The authors compare training-time geometry-aware objectives (GeoLoss, GeoSmooth) with a post-hoc Schwartz-aware energy decoder using a DeBERTa-v3-base classifier. Results show that while training-time objectives yield limited gains, the post-hoc decoder significantly improves theory-aware coherence metrics without sacrificing Macro-F1 or Micro-F1, specifically for the true Schwartz ordering. An LLM diagnostic with Qwen2.5-72B-Instruct further demonstrates that theory-aware decoding offers a lightweight, controllable alternative to prompting large models.
Entities (17)
Relation Signals (14)
Schwartz values â areorganizedas â Circular motivational continuum
confidence 95% · Schwartz theory, however, describes them as a circular motivational continuum
Paolo Rosso â isauthorof â Beyond Independent Labels: Schwartz-Geometry Decoding for Human Value Detection
confidence 95% · Paolo Rosso1,3
VĂctor Yeste â isauthorof â Beyond Independent Labels: Schwartz-Geometry Decoding for Human Value Detection
confidence 95% · Beyond Independent Labels: Schwartz-Geometry Decoding for Human Value Detection VĂctor Yeste1,2,â
Schwartz-aware energy decoder â improves â Theory-aware coherence metrics
confidence 92% · the decoder makes label sets more coherent with the continuumâon theory-aware coherence metrics we introduce
TouchĂ©24-ValueEval â isa â ValueEval dataset
confidence 90% · We use the Touché24-ValueEval data family
ValgrAI â isaffiliationof â Paolo Rosso
confidence 90% · 3Valencian Graduate School and Research Network of Artificial Intelligence (ValgrAI)
Universitat PolitĂšcnica de ValĂšncia â isaffiliationof â VĂctor Yeste
confidence 90% · 1PRHLT Research Center, Universitat PolitÚcnica de ValÚncia, Spain
Universidad Europea de Valencia â isaffiliationof â
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Human value detection is commonly formulated as sentence-level multi-label classification over the 19 refined Schwartz values, typically predicted as independent labels. Schwartz theory, however, describes them as a circular motivational continuum, in which adjacent values are compatible and opposing values are in tension. We ask whether this structure can be operationalized as an explicit output-space geometry and used as a soft bias rather than a hard constraint. On a DeBERTa-v3-base classifier, we compare two ways of injecting it: training-time geometry-aware objectives and a post-hoc Schwartz-aware energy decoder that scores whole label sets jointly. Across five seeds, training-time geometry gives only limited gains-no larger for the true continuum than for a random ordering-whereas the decoder makes label sets more coherent with the continuum-on theory-aware coherence metrics we introduce-at no cost to Macro-F1 or Micro-F1 (held fixed by its selection rule). The gain is specific to the true Schwartz ordering: it does not appear for a random permutation or an empirical co-occurrence graph through the identical decoder. A bounded Qwen2.5-72B-Instruct diagnostic shows that supplying the continuum at inference shifts behavior but does not match supervised structured prediction. Theory-aware decoding thus offers a lightweight, controllable way to make value detection faithful to its label space.
Tags
Links
- Source: https://arxiv.org/abs/2607.05052v1
- Canonical: https://arxiv.org/abs/2607.05052v1
Trouble viewing inline? Open PDF directly â
Full Text
68,850 characters extracted from source content.
Expand or collapse full text
Beyond Independent Labels: Schwartz-Geometry Decoding for Human Value Detection VĂctor Yeste1,2,â Paolo Rosso1,3 1PRHLT Research Center, Universitat PolitĂšcnica de ValĂšncia, Spain 2School of Science, Engineering and Design, Universidad Europea de Valencia, Spain 3Valencian Graduate School and Research Network of Artificial Intelligence (ValgrAI) âCorresponding author: vicyesmo@upv.es Abstract Human value detection is commonly formulated as sentence-level multi-label classification over the 19 refined Schwartz values, typically predicted as independent labels. Schwartz theory, however, describes them as a circular motivational continuum, in which adjacent values are compatible and opposing values are in tension. We ask whether this structure can be operationalized as an explicit output-space geometry and used as a soft bias rather than a hard constraint. On a DeBERTa-v3-base classifier, we compare two ways of injecting it: training-time geometry-aware objectives and a post-hoc Schwartz-aware energy decoder that scores whole label sets jointly. Across five seeds, training-time geometry gives only limited gainsâno larger for the true continuum than for a random orderingâwhereas the decoder makes label sets more coherent with the continuumâon theory-aware coherence metrics we introduceâat no cost to Macro-F1 or Micro-F1 (held fixed by its selection rule). The gain is specific to the true Schwartz ordering: it does not appear for a random permutation or an empirical co-occurrence graph through the identical decoder. A bounded Qwen2.5-72B-Instruct diagnostic shows that supplying the continuum at inference shifts behavior but does not match supervised structured prediction. Theory-aware decoding thus offers a lightweight, controllable way to make value detection faithful to its label space. 1 Introduction Human values underlie moral, social, political, and cultural language, and detecting them in text supports work across NLP and computational social science. The task is commonly posed as sentence-level multi-label classification: given a sentence, predict which refined human values it expresses (Kiesel et al., 2023; Mirzakhmedova et al., 2024). The dominant modeling approach treats the values as independent labels. This is convenient but theoretically incomplete: the refined Schwartz theory defines the values not as independent categories but as a circular motivational continuum, in which neighboring values are compatible and values on opposite arcs are in tension (Schwartz et al., 2012; Schwartz, 2017; Schwartz and Cieciuch, 2022). We ask whether this theory can be made operational in value detection without overconstraining it. The goal is not a hard rule that opposite values can never co-occurâreal texts express conflict, compromise, and trade-offs (Schwartz et al., 2017; Skimina et al., 2018)âbut a soft inductive bias: can a model preserve predictive performance while producing label sets that are more coherent with the Schwartz continuum? The question is timely. Recent work on the same task shows that strong flat encoders are hard to beat (Ma et al., 2023; Molazadeh Oskuee et al., 2023; Yeste and Rosso, 2026b), while hard architectural uses of the theory, such as presence gates or higher-order hierarchies, can introduce recall bottlenecks or error propagation (Yeste and Rosso, 2026a). It is also sharpened by instruction-tuned LLMs, which can be prompted with the theory directly (Sun, 2024; Zhu et al., 2025), raising the question of whether supervised structure is still needed. We encode the 19 refined values as a circular output-space geometryâan angular position per value and a circular distance matrixâand use it in two ways: a training-time penalty and a post-hoc structured decoder over a DeBERTa-v3-base classifier. Across five seeds, training-time geometry yields only limited, non-theory-specific gains, whereas the Schwartz decoder improves theory-aware coherence at no cost to F1, and only for the true continuumânot a random permutation or an empirical co-occurrence graph. A bounded 72B LLM diagnostic shows that prompting the theory shifts behavior but does not match the supervised decoder. We make four contributions: (i) we formulate sentence-level detection of the 19 refined Schwartz human values as a circular output-space geometry, with a family of theory-aware coherence metrics derived from it; (i) we compare training-time geometry-aware objectives with a post-hoc Schwartz-aware energy decoder on the same classifier, finding that only the decoder yields label sets more coherent with the continuum; (i) we isolate the role of the true geometry through direct random and empirical control comparisons with paired significance tests; and (iv) we add a bounded LLM diagnostic testing whether prompted theory can replace supervised structured prediction. By coherence we mean a concrete, measurable property of the predicted label set: fewer false positives on the far side of the circle and confusions concentrated among nearby values rather than opposing ones (operationalized in Section 5). Together, the results support theory-aware decoding as a lightweight, controllable way to make value detection more faithful to the psychological structure of its label space. 2 Related Work Human value detection. Identifying the human values behind arguments was introduced by Kiesel et al. (2022) and scaled into the ValueEval shared task and an extended benchmark family (Kiesel et al., 2023; Mirzakhmedova et al., 2024). Rooted in argument mining (Lawrence and Reed, 2019), the setting also supports downstream argumentation and deliberation analysis (Plenz et al., 2024). More broadly, detecting values and morality in text is a central goal of computational social science, as in work grounded in Moral Foundations Theory, its annotated corpora, and its links to language models (Graham et al., 2009; Hoover et al., 2020; Zangari et al., 2025). These moral and value signals also support downstream tasks such as hate-speech detection and identifying violent radicalization (Vargas et al., 2026; Yin et al., 2026). Beyond argument mining, recent work measures the (often subjective) expression of basic Schwartz human values directly in social-media posts (Epstein et al., 2026), underscoring that value attributions are annotator- and context-dependent. Strong shared-task systems rely on transformer encodersâoften DeBERTaâtogether with class-imbalance handling, threshold tuning, and ensembling (Ma et al., 2023; Molazadeh Oskuee et al., 2023; Kandru et al., 2023; Tsunokake et al., 2023; Aydin et al., 2024). Recent work on sentence-level detection of the refined values further reports that such direct encoders and calibration (Guo et al., 2017) are strong, while presence gates and higher-order hierarchies can introduce recall bottlenecks or error propagation (Yeste and Rosso, 2026a, b). Across this line, however, the values are typically predicted as independent labels or organized by a hard hierarchy, and the motivational geometry of the label space is left implicit. We instead make that geometry an explicit, soft component of the output space. Schwartz values and motivational structure. The refined Schwartz theory, building on the original circular value model (Schwartz, 1992), arranges 19 basic values on a circular motivational continuum in which adjacent values share compatible goals and opposing values express tension (Schwartz et al., 2012; Schwartz, 2017)âa structure with broad cross-cultural psychometric support and predictive links to behavior (Schwartz and Cieciuch, 2022; Cieciuch and Schwartz, 2013; Bardi and Schwartz, 2003). This makes the label space theoretically structured rather than arbitrary. We use the continuum as an inductive bias and evaluation lens, not as a hard constraint on what a text may express, since real arguments can voice value tensions and trade-offs (Schwartz et al., 2017; Skimina et al., 2018). Circular, continuous structure of this kind is not unique to values: affective constructs are organized as a circumplex (Russell, 1980) or an emotion wheel (Plutchik, 1980), and such structured label spaces are increasingly modeled in NLP (Demszky et al., 2020), which motivates treating the continuum as an output-space geometry rather than as unordered classes. Structured multi-label prediction. Multi-label learning has long modeled label dependence (Tsoumakas and Katakis, 2007)âthrough classifier chains (Read et al., 2011), neural sequence-generation decoders (Yang et al., 2018), label-correlation and embedding methods, and graph-based structures (Zhang and Zhou, 2014; Huang et al., 2024; Tarekegn et al., 2024). A complementary line casts prediction as structured inference or energy minimization over label configurations, from conditional random fields and collective classification (Lafferty et al., 2001; Ghamrawi and McCallum, 2005) to structured prediction energy networks (Belanger and McCallum, 2016); our decoder shares this view but fixes the pairwise term from theory rather than learning it. In these approaches the dependencies are typically learned from training co-occurrence or label semantics. Our work keeps a strong local classifier and adjusts only the final prediction with a structured decoding objective; the distinguishing feature is that the structure is derived from a psychological theory and tested directly against random and empirical control geometries. LLMs for value classification. Prompted large language models are increasingly applied to value and moral classificationâcomparing prompting with fine-tuning, value identification and annotation (Sun, 2024; Zhu et al., 2025; Milkova and Rudnev, 2026; Yeste and Rosso, 2026c; de la Cruz FernĂĄndez et al., 2025), probing Schwartz value priorities (Segerer, 2025), assessing moral abilities against human labels (Bulla et al., 2025), analyzing values in real-world interactions (Huang et al., 2025), and ensembling detectors (Rodrigues et al., 2024). Rather than benchmarking many models, we include one bounded diagnostic asking whether supplying the continuum at inference time can match incorporating it through supervised training and decoding. 3 Task and Schwartz Geometry 3.1 Task and Data We study sentence-level human value detection as multi-label classification over the 19 refined Schwartz values. Given a sentence x, a model predicts a binary vector yâ0,119yâ\0,1\^19, where yk=1y_k=1 indicates that value vkv_k is expressed in x. We use the TouchĂ©24-ValueEval data family (Kiesel et al., 2023; Mirzakhmedova et al., 2024), segmented and annotated at the sentence level following recent work on refined-value detection (Yeste and Rosso, 2026b).111The corpus is distributed under a restricted Data Usage Agreement via Zenodo (The ValuesML Team, TouchĂ©24-ValueEval, 2024, https://doi.org/10.5281/zenodo.13283288). Each value carries two stance annotations, attained and constrained. Because our object of study is the geometry of value presence rather than stance, we collapse the two stances into a single presence indicator: yk=1y_k=1 iff value vkv_k is annotated as attained or constrained, and 0 otherwise. This yields a standard binary multi-label target compatible with sigmoid outputs and threshold-based decoding. We use the official train/validation/test partition, split by document (Text-ID) so no document is shared across splits and sentence-level overlap cannot inflate test performance (Table 1). About half of all sentences express at least one value (50.8â51.5% across splits), and value-positive sentences are predominantly single-label (â1.1â\!1.1 values each); multi-value sentences are a non-negligible minority (e.g., 901 test sentences). Per-label support is strongly imbalanced, from Humility (0.24%) to Security: societal (8.6%; full distribution in Appendix B). All hyperparameters and thresholds are selected on validation only; the test split is used once. Train Dev Test Documents 1,603 523 522 Sentences 44,758 14,904 14,569 â„1â„\!1 value 23,062 7,600 7,402 (% of split) 51.5 51.0 50.8 >1>\!1 value 2,640 876 901 Values / positive sent. 1.13 1.13 1.14 Table 1: Dataset statistics. Splits are partitioned by document, with no Text-ID shared across splits. The label space is the 19 refined Schwartz values in all splits. 3.2 Circular Value Geometry 12345678910111213141516171819Opennessto changeSelf-enhancementConservationSelf-transcendence 1. Self-direction: thought 8. Face 15. Benevolence: dependability 2. Self-direction: action 9. Security: personal 16. Benevolence: caring 3. Stimulation 10. Security: societal 17. Universalism: concern 4. Hedonism 11. Tradition 18. Universalism: nature 5. Achievement 12. Conformity: rules 19. Universalism: tolerance 6. Power: dominance 13. Conformity: interpersonal 7. Power: resources 14. Humility Figure 1: The refined Schwartz value continuum used as the output-space geometry. The 19 values are placed in canonical order around the circle and colored by higher-order region; Hedonism (4), Face (8) and Humility (14) bridge adjacent regions. Adjacent values are motivationally compatible, while values on opposite arcs are in tension. The four dashed radial lines mark the two bipolar dimensions (openness to change vs. conservation; self-enhancement vs. self-transcendence). The refined Schwartz theory arranges the 19 values on a circular motivational continuum: adjacent values share compatible motivational goals, whereas values on opposite arcs express conflicting motivations (Schwartz et al., 2012; Schwartz, 2017; Schwartz and Cieciuch, 2022)âa compatibility-and-conflict structure with confirmatory empirical support (Schwartz and Boehnke, 2004). The continuum spans four higher-order regionsâopenness to change, self-enhancement, conservation, and self-transcendenceâwith Hedonism, Face, and Humility bridging adjacent regions (Figure 1). We fix this canonical order as the backbone of an output-space geometry. We place value vkv_k at angle Ξk=2âÏâk/19 _k=2Ï k/19, kâ0,âŠ,18kâ\0,âŠ,18\, on the unit circle, with embedding ek=(cosâĄÎžk,sinâĄÎžk)e_k=( _k, _k). The normalized circular distance between two values is the shorter arc between their positions, dâ(vi,vj) d(v_i,v_j) =minâĄ(|ΞiâΞj|, 2âÏâ|ΞiâΞj|)Ï = \! (| _i- _j|,\,2Ï-| _i- _j| )Ï (1) =219âminâĄ(|iâj|, 19â|iâj|), = 219\, \! (|i-j|,19-|i-j| ), so that d=0d=0 for identical values and d approaches 11 for diametrically opposed values. Because 19 is odd there is no exact antipode, and the maximum attainable distance is 18/19â0.9518/19â 0.95. The resulting 19Ă1919Ă 19 matrix D is the single quantity from which every geometry-aware term in the paper is derived. From D we read off two relations used later by the objectives, decoder, and metrics: neighbor compatibilityâpairs within two steps on the circle (1â€minâĄ(|iâj|,19â|iâj|)â€21†(|i-j|,19-|i-j|)†2), expected to co-occur more plausiblyâand opposite tensionâpairs with d>0.75d>0.75 (at least eight steps apart), treated as conflicting and requiring stronger evidence to be predicted jointly. We stress that this geometry is a soft inductive bias, not a hard constraint: the refined structure has broad cross-cultural psychometric support (Schwartz and Cieciuch, 2022), but real texts can express tension or compromise, so opposing values are penalized rather than forbidden. To test whether any benefit is specific to the true Schwartz structure rather than to structure in general, we compare D against two controls built with the same machinery. A random circular geometry applies Equation 1 to a seeded random permutation of the 19 values, preserving the circular form but destroying the theory-derived ordering. An empirical co-occurrence geometry uses distances 1âJaccardâ(i,j)1-Jaccard(i,j) from training-split label co-occurrence (Huang et al., 2024), capturing data-derived dependency rather than motivational theory. 4 Methods All supervised systems share one architecture: a DeBERTa-v3-base encoder (He et al., 2023) with a linear head mapping the pooled sentence representation to 19 logits z, with p=Ïâ(z)p=Ï(z). They differ only in (i) the training objective and (i) an optional post-hoc decoding step; the encoder, optimization, data protocol, and seeds are held fixed (Section 5), so differences reflect the objective or decoder, not model capacity. We use the distance matrix D and its neighbor and opposite relations throughout. Our main method is the post-hoc decoder of Section 4.3; training-time geometry (Section 4.2) is an alternative way to inject the same structure. We use three adjectives with distinct scopes: theory-aware (faithful to Schwartz theory by any mechanism), geometry-aware (any method using the distance matrix D, including the controls), and Schwartz-aware (specifically the true continuum). 4.1 Independent Supervised Baselines The primary baseline trains the classifier with binary cross-entropy (BCE) over the 19 labels, treating them as independent. As an imbalance-aware baseline we also train with asymmetric loss (ASL) (Ridnik et al., 2021), which adds two terms to BCE: it clips and down-weights easy negative labels through a focal-style modulation, focusing learning on positives and hard negatives. This is motivated by the strong label imbalance in the data (Appendix B). At inference, both baselines convert probabilities to labels with per-label thresholds Ï tuned on validation, y^k=â[pkâ„Ïk] y_k=1[p_kâ„ _k]. 4.2 Geometry-Aware Training Training-time variants inject the geometry directly into the objective, leaving inference unchanged. GeoLoss adds to a base loss âbaseâBCE,ASLL_baseâ\BCE,ASL\ a distance-weighted penalty λâxâ[âi,jyiâDiâjâpj/âiyi]λ\,E_x [ _i,jy_iD_ijp_j / _iy_i ], so that probability mass placed on values far from the gold set on the circle is penalized in proportion to its circular distance. GeoSmooth instead replaces the binary targets with geometry-smoothed soft targets y~j=maxiâĄyiâexpâĄ(âDiâj2/Ï) y_j= _i\,y_i (-D_ij^2/Ï) (clamped to retain the original positives) before applying the base loss, giving nearby values a small amount of soft supervision; GeoSmooth is thus a distance-aware form of label smoothing (Szegedy et al., 2016; Pereyra et al., 2017; MĂŒller et al., 2019; DĂaz and Marathe, 2019). Both λ and Ï are tuned on validation. The same machinery defines our structure controls by swapping the matrix D: random GeoLoss uses a seeded random circular permutation, and empirical structure uses the co-occurrence distances of Section 3. If any structure helps, the random control should help too; if data-derived dependency suffices, the empirical control should match the true geometry. 4.3 Schwartz-Aware Energy Decoder Our main method keeps the trained classifier fixed and replaces independent thresholding with a structured decoder applied to its probabilities. Intuitively, it picks the label set that keeps the labels the classifier already supports, rewards co-selecting compatible neighbors, and penalizes co-selecting opposing valuesâa structured alternative to thresholding each label in isolation. For a sentence x, the decoder selects the label set that maximizes a structured scoreâequivalently, the negative of an energy in the sense of energy-based models (LeCun et al., 2006)âthat combines classifier evidence with the Schwartz geometry, y^=argâmaxyââ(x)[ y= *arg\,max_y (x) [ âkykâukâ(x) _ky_k\,u_k(x) (2) +12ââiâ jyiâyjâWiâj + 12 _iâ jy_iy_j\,W_ij âÎł(âkykâ1)+]. -Îł\, ( _ky_k-1 )_+\, ]. The unary term ukâ(x)=Ïâ1â(pkâ(x))âÏâ1â(Ïk)u_k(x)=Ï^-1(p_k(x))-Ï^-1( _k) is the classifierâs log-odds margin over the validation-tuned threshold, so it is positive exactly when pkâ„Ïkp_kâ„ _k. The pairwise weights Wiâj=αâNiâjâÎČâOiâjW_ij=α N_ij-ÎČ O_ij combine the neighbor-compatibility matrix N (a soft weight that is largest for immediate neighbors and decays to zero beyond two steps) and the opposite mask O (one for pairs with Diâj>0.75D_ij>0.75): with α,ÎČâ„0α,ÎČâ„ 0, co-selecting neighbors is rewarded and co-selecting opposing values is penalized. The final term is a cardinality penalty (Îłâ„0Îłâ„ 0, applied beyond the first label) that discourages over-large sets. When α=ÎČ=Îł=0α=ÎČ=Îł=0 the maximizer reduces exactly to BCE thresholding, so the decoder is a strict generalization of the baseline. To keep the maximization exact and cheap, â(x)Y(x) is restricted to a small pool of high-scoring labels (threshold-positive, high-probability, and top-ranked), capped at a few candidates and a few decoded labels per sentence; exact cut-offs are in Section 5. The weights (α,ÎČ,Îł)(α,ÎČ,Îł) are tuned on validation under a Pareto criterion: among settings that retain Macro-F1 within a small tolerance of the best validation Macro-F1, we select the one that minimizes a validation geometry cost (a label-set coherence measure defined in Section 5). This is, by construction, the reason the decoder improves theory-aware coherence while preserving F1: F1 preservation is enforced by the Pareto constraint rather than discovered empirically. The test set is decoded once with the selected weights. The identical decoder is run with the Schwartz, random, and empirical geometries (N, O derived from each), providing the same controls as in training. Like other structured multi-label methods it adjusts a strong local classifierâs output, but its pairwise structure is theory-derived rather than learned from data (Read et al., 2011; Zhang and Zhou, 2014). 4.4 LLM Diagnostic To test whether the theory can instead be supplied at inference time to a large language model, we include a bounded diagnostic with Qwen2.5-72B-Instruct (Qwen et al., 2025) under two prompts. Both state the task, the attained/constrained-to-presence convention, and the 19 value definitions, and require a strict JSON label list drawn only from the allowed values; they differ only in that the continuum prompt additionally describes the circular ordering and the expectation that nearby values are compatible while opposing values usually conflict. Decoding is deterministic (temperature 0). Outputs are parsed against the exact allowed label set, and we record an invalid-output rate for responses that cannot be parsed without repair. This isolates theory injected through prompting from theory injected through training or decoding; full prompts are in Appendix E. 5 Experimental Setup Data and protocol. All systems use the sentence-level splits of Section 3 with the document-level partition. Hyperparameters and thresholds are selected on validation; the test split is evaluated once. Each supervised configuration is run with five seeds (42, 7, 1701, 11, 1984), and we report mean and standard deviation over seeds. Backbone and optimization. All supervised systems fine-tune deberta-v3-base with AdamW (Loshchilov and Hutter, 2019). Base hyperparameters are selected once on validation by grid search over learning rate (6,7,8,9,10Ă10â6\6,7,8,9,10\Ă 10^-6) and weight decay (0.10,âŠ,0.20\0.10,âŠ,0.20\), yielding 10â510^-5 and 0.150.15; effective batch size (16), sequence length (1024 tokens), and gradient clipping (1.01.0) are fixed. We train up to 30 epochs with early stopping (patience 3) and tune per-label thresholds Ï on validation by sweeping [0,1][0,1] in steps of 0.010.01 to maximize each labelâs F1. Hyperparameter selection. Objective- and decoder-specific hyperparameters are likewise selected on validation. For ASL we search Îłnegâ2,3,4,5 _negâ\2,3,4,5\ and clip â0,0.03,0.05,0.1â\0,0.03,0.05,0.1\ with Îłpos=0 _pos=0; for GeoLoss λâ0.01,0.05,0.1,0.2λâ\0.01,0.05,0.1,0.2\; and for GeoSmooth Ïâ0.1,0.2,0.5,1.0Ïâ\0.1,0.2,0.5,1.0\. The energy decoder uses fixed component magnitudes (neighbor α=0.1α=0.1, opposite ÎČ=0.2ÎČ=0.2, cardinality Îł=0.02Îł=0.02) and a two-step neighbor window. The candidate pool for each sentence is the union of the threshold-positive labels, labels with probability above half the tuned threshold or above 0.010.01, and the eight highest-probability labels; it is capped at eight candidates and the decoded set at five labels. Validation selection under the Pareto rule of Section 4.3 (retain validation Macro-F1 within 99%99\% of thresholding, then minimize the validation geometry cost) determines which components are active; in our final runs it keeps the neighbor and opposite terms but sets the cardinality term to Îł=0Îł=0. Metrics. We report three standard metricsâMacro-F1, Micro-F1, and threshold-free Macro-AUPRCâtogether with a family of theory-aware metrics that we introduce for this label space (in the spirit of distance-weighted and ordinal error measures such as the earth moverâs distance (Rubner et al., 2000; Hou et al., 2016) and of hierarchical-classification evaluation (Kosmopoulos et al., 2015)), derived from the circular geometry. Because probabilities and discrete label sets call for different theory-aware measures, the supervised models and the decoder are scored with different ones (hence the differing theory-aware columns in Tables 2 and 3). For supervised models, which emit probabilities, we report the expected circular error: the gold-normalized, distance-weighted probability mass placed away from the gold values (lower is better), i.e. the quantity penalized by GeoLoss. For the structured decoder, which emits label sets, we report label-set metrics: the opposite-error rate, the share of false-positive labels that are opposite (D>0.75D>0.75) to every gold value (lower is better); the neighbor-error rate, the share falling within two steps of a gold value (near-miss errors); and the confusion-distance correlation between label-pair circular distance and confusion frequency. The decoder geometry cost sums these threeâtwo rates in [0,1][0,1] and a correlation in [â1,1][-1,1], equally weightedâso a lower value is more coherent. All three are corpus-level quantities computed once per configuration, so selection picks a single global (α,ÎČ,Îł)(α,ÎČ,Îł) under the Macro-F1 constraint, not a per-sentence rule. As the composite is dimensionally heterogeneous, we report its components separately (Section 6.2) and treat the Schwartz-vs-control contrast, not the absolute cost, as the primary evidence. Significance testing. For decoder and LLM comparisons we use paired, sample-level bootstrap tests (Dror et al., 2018) (2,000 resamples) on the shared test set, reporting two-sided p-values at the 0.050.05 level. This includes the direct Schwartz-vs-control tests on decoder geometry cost. For the supervised systems (Table 2), which we summarize by five per-seed scores, we instead use a paired seed-level bootstrap against the BCE baseline over the shared seeds. Full deltas and p-values for both families of tests are tabulated in Appendix C. LLM diagnostic. The diagnostic runs Qwen2.5-72B-Instruct (4-bit quantization) with deterministic decoding (temperature 0, at most 128 new tokens) under the two prompts of Appendix E. Responses are parsed against the exact 19-label set; unparseable responses are counted in the invalid-output rate and contribute no labels. Reproducibility. To preserve anonymity, we describe software and release plans in general terms. Configurations, training and decoding scripts, tuned thresholds, and model predictions will be released as a project artifact after review.222Code, configurations, tuned thresholds, and model predictions are available at https://github.com/VictorMYeste/schwartz-geometry-value-detection. 6 Results 6.1 Training-Time Geometry Gives Limited Gains Table 2 reports the supervised systems. BCE is a strong, stable baseline (Macro-F1 0.29340.2934).333For reference, prior work on the same sentence-level task reports a comparable direct-classifier Macro-F1 (â0.281â\!0.281, deberta-base, fixed 0.50.5 threshold) (Yeste and Rosso, 2026b); the setups are not strictly comparable (we use deberta-v3-base with tuned per-label thresholds), so we read this only as a check that our baseline is competitive. Asymmetric loss does not help here: it is slightly weaker on every standard metric and much less stable across seeds (Macro-F1 0.2833±0.01930.2833\!±\!0.0193; circular error 0.374±0.1810.374\!±\!0.181). The three GeoLoss-based variants (empirical, random, and Schwartz) all fall within one standard deviation of BCE on the standard metrics, and the Schwartz GeoLoss gain over BCE is not significant (paired bootstrap, p=0.19p=0.19 for Macro-F1). They reduce expected circular error slightly (to 0.1270.127â0.1310.131 from 0.1340.134), but the random control reduces it as much as the true geometry, so the effect is not specific to the Schwartz structure. GeoSmooth is the clear exception: in this formulation the soft targets destabilize training and collapse performance (Macro-F1 0.16510.1651, significantly below BCE, p<0.001p<0.001). These conclusions are unchanged when the objectives are paired with the imbalance-aware ASL base instead of BCE: all variants remain below their BCE counterparts and GeoSmooth again collapses (Appendix A). Training-time geometry thus yields no consistent or theory-specific gain, motivating the post-hoc decoder. Method Macro-F1 â Micro-F1 â Macro-AUPRC â Circ. err. â BCE 0.2934 ± 0.0037 0.3425 ± 0.0060 0.2353 ± 0.0067 0.1342 ± 0.0138 ASL 0.2833 ± 0.0193 0.3306 ± 0.0219 0.2235 ± 0.0240 0.3735 ± 0.1812 Empirical structure 0.2945 ± 0.0053 0.3401 ± 0.0048 0.2356 ± 0.0074 0.1269 ± 0.0101 Random GeoLoss 0.2949 ± 0.0058 0.3439 ± 0.0085 0.2353 ± 0.0059 0.1273 ± 0.0105 Schwartz GeoLoss 0.2958 ± 0.0051 0.3421 ± 0.0086 0.2356 ± 0.0051 0.1305 ± 0.0096 Schwartz GeoSmooth 0.1651 ± 0.0063 0.1656 ± 0.0105 0.1182 ± 0.0053 0.6988 ± 0.0758 Table 2: Supervised test results (mean ± std, five seeds). â /â = higher/lower is better. BCE and the three GeoLoss variants coincide within seed noise on standard metrics; GeoSmooth collapses. Best per column bold. 6.2 Schwartz Decoding Improves Label-Set Coherence The decoder is the main positive result. Applied to the BCE classifier (Table 3), the Schwartz decoder leaves predictive performance essentially unchangedâMacro-F1 0.2934â0.29430.2934\!â\!0.2943, Micro-F1 0.3425â0.34300.3425\!â\!0.3430, neither significantâwhile lowering the decoder geometry cost (the corpus-level sum of opposite-error rate, neighbor-error rate, and confusionâdistance correlation; Section 5) from 0.56340.5634 to 0.54800.5480. Two caveats keep this honest: the F1 preservation is guaranteed by the Pareto selection rule (Section 4.3), not discovered, and the reduction against the decoderâs own thresholding baseline is a sanity checkâthe substantive evidence is the controlled comparison of Section 6.3. The reduction is driven by the opposite-error rate (0.5092â0.50720.5092\!â\!0.5072) and the confusionâdistance correlation (â0.137ââ0.154-0.137\!â\!-0.154); the neighbor-error rate rises slightly (0.191â0.1950.191\!â\!0.195; Section 7). The edits are small and surgical: the decoder changes only 2.45%±0.26%2.45\%\!±\!0.26\% of test sentences (â357â\!357 of 14,56914,569), so the average set size barely moves (0.804â0.8030.804\!â\!0.803 labels per sentence; total predicted labels 11,718â11,69911,718\!â\!11,699, â0.16%â\!0.16\%). With the validation-selected cardinality weight at Îł=0Îł=0, the coherence gain is not an artifact of predicting more or fewer labels. The claim is thus deliberately narrow: more theory-coherent label sets at no measurable cost to F1. Decoder Macro-F1 â Micro-F1 â Opp. err. â Geom. cost â BCE thresholding 0.2934 ± 0.0037 0.3425 ± 0.0060 0.5092 ± 0.0096 0.5634 ± 0.0120 + empirical decoder 0.2935 ± 0.0037 0.3428 ± 0.0063 0.5100 ± 0.0092 0.5628 ± 0.0119 + random decoder 0.2935 ± 0.0038 0.3429 ± 0.0062 0.5099 ± 0.0091 0.5625 ± 0.0115 + Schwartz decoder 0.2943 ± 0.0034 0.3430 ± 0.0063 0.5072 ± 0.0098 0.5480 ± 0.0130 Table 3: Structured decoder on the BCE classifier (mean ± std, five seeds), run under each geometry; Opp. err. and Geom. cost lower-is-better. F1 is preserved everywhere, but only the Schwartz geometry materially lowers geometry cost. Best bold. 6.3 The True Schwartz Geometry Matters The decoder rows of Table 3 already show that the random and empirical geometries barely move the geometry cost; the cleanest test, however, is a direct paired comparison. Relative to the controls run through the identical decoder, the Schwartz geometry lowers the decoder geometry cost by 0.01450.0145 (vs. random; 95%95\% bootstrap CI [0.0074,0.0231][0.0074,0.0231]) and 0.01480.0148 (vs. empirical; CI [0.0074,0.0231][0.0074,0.0231]), significant in all five seeds (p<0.001p<0.001; the per-seed tests share the same direction, so we report them without multiple-comparison correction), whereas the corresponding Macro-F1 and Micro-F1 differences are negligible (â€0.001â€\!0.001) and significant in none. Matching the label count, the circular form, or the empirical co-occurrence structure is therefore not sufficient: the coherence gain comes from the Schwartz ordering itself. 6.4 Prompted LLMs Do Not Replace Supervised Structured Prediction Table 4 compares the two prompted Qwen2.5-72B-Instruct configurations with the supervised systems. Both prompts trail the supervised models by a wide, significant margin on standard metrics: Qwen reaches Macro-F1 0.24300.2430/0.23960.2396 and Micro-F1 0.27300.2730/0.26430.2643 (definitions/continuum) against 0.29340.2934/0.34250.3425 for BCE thresholding (5/5 seeds, p<0.001p<0.001 on both). This is not a formatting artifactâthe invalid-output rate is below 0.2%0.2\% under both prompts. Adding the Schwartz continuum to the prompt does shift geometry-aware behavior, lowering the geometry cost from 0.57570.5757 to 0.56330.5633 (p=0.01p=0.01) and roughly doubling the average number of predicted labels (1.07â1.501.07\!â\!1.50), though it slightly lowers F1. The continuum-prompted cost (0.56330.5633) essentially matches untuned BCE thresholding (0.56340.5634) but not the decoderâs (0.54800.5480): prompting reaches the baselineâs coherence, not the decoderâs. The comparison is intentionally asymmetricâzero-shot prompting against a classifier fine-tuned on â45â\!45k in-domain sentencesâso it is a bounded probe of whether prompting suffices, and the supervised win is expected. Prompted theory thus moves behavior in the expected direction without matching supervised structured prediction. System Macro-F1 â Micro-F1 â Geom. cost â Inval. % â Qwen definitions 0.2430 0.2730 0.5757 0.08 Qwen continuum 0.2396 0.2643 0.5633 0.14 BCE thresholding 0.2934 0.3425 0.5634 â BCE + Schwartz decoder 0.2943 0.3430 0.5480 â Table 4: LLM diagnostic vs. supervised systems (LLM: single deterministic run; supervised: five-seed mean). âInval. %â: share of responses not parsable without repair. The continuum prompt lowers geometry cost but not below the decoder, and both prompts trail supervised F1. Best per column bold. 7 Analysis and Discussion A consistent pattern across our experiments is that the Schwartz geometry helps as a post-hoc decoder but not when injected into the training loss. We read this as a division of labor. The supervised encoder already learns strong local evidence for each value, so a geometry penalty on the loss mostly perturbs an already-good objectiveâand for GeoSmooth the cross-value soft targets, in this particular formulation, are aggressive enough to destabilize training and collapse performance. Independent thresholding, by contrast, discards label dependencies at the final decision step, which is exactly where the decoder operates: it reconciles per-label evidence into a coherent set without altering the learned representations. The same view explains why the training-time circular-error gains are small and not theory-specificâa random ordering helps as much as the true one (Table 2)âwhile the decoderâs neighbor and opposite terms act on the discrete label set, where the ordering does matter. The controlled comparison isolates this effect: only the true Schwartz ordering lowers the decoder geometry cost, whereas a random circular permutation and an empirical co-occurrence graph do not. Qualitatively, the decoder edits predictions in the two ways the theory anticipates. It suppresses opposite-side false positivesâfor a sentence whose gold label is Power: dominance, thresholding also fires Benevolence: dependability and Universalism: concern, two self-transcendence values on the far arc, which the decoder removesâand it completes near-neighbor sets, as when thresholding emits only Power: dominance for a gold Power: resources and the decoder adds the adjacent true value. Both edits raise sample-level F1 while reducing distant activations; Appendix D tabulates these and further examples. The neighbor-error rate needs care, as it enters the minimized cost yet the decoder completes neighbor sets. It counts only false-positive neighbors (within two steps of a gold value): completing a correct neighbor removes a near-miss and lowers it, while adding a wrong one raises it. Because the decoder adds some unsupported neighbors, the corpus rate rises slightly (0.191â0.1950.191\!â\!0.195) and the net gain comes from the opposite-error and confusion-distance terms. This is why we minimize the composite, not any single term, and read the controlled contrast as decisive. We are deliberate about what improves. The decoder targets the structured label set, not per-label calibration, so its gains surface in label-set coherence rather than probability-mass metrics or large F1 jumps; Macro-F1 and Micro-F1 stay within seed noise. The contribution is thus a more theory-consistent decision layer at no measurable cost to accuracy, not a new state of the artâby design, since the Schwartz circle is a soft bias and real texts express genuine value conflict that a coherence objective should discourage only when unsupported, not forbid. This soft, post-hoc use of the theory aligns with findings that hard architectural encodings of Schwartz structure are brittle on this task (Yeste and Rosso, 2026a, b): our decoder leaves the flat classifier intact and adds structure only as a final, tunable adjustment. The LLM diagnostic points the same way from the other side: prompting the continuum steers Qwen2.5-72B-Instruct toward more geometry-coherent behavior but trades away F1 and stays well below the supervised systems. The controllable supervised decoder is thus the more reliable way to make predictions respect the value spaceâs structure. 8 Limitations, Ethics, and Conclusion Limitations. Our scope is deliberately narrow: one dataset family (TouchĂ©24-ValueEval), English, sentence-level inputs, and one backbone (DeBERTa-v3-base); we do not test other languages, domains, longer contexts, or larger encoders. The improvement we measure is coherence, not accuracyâthe decoder lowers theory-aware costs while leaving Macro-F1 and Micro-F1 within seed noiseâso its value is more consistent, interpretable label sets, not higher standard scores. The decoder geometry cost is a composite we define rather than an established benchmark, and the circular operationalization (equal angular spacing, canonical order, opposite threshold D>0.75D>0.75, two-step neighbor window) is one reasonable choice among several; a mis-specified geometry could in principle suppress genuine value conflict, which the soft penalty discourages but does not forbid. Because the decoder reranks candidate sets from the classifierâs own probabilities, it cannot recover values the base model never surfaces and inherits any miscalibration of those probabilities and thresholds. Finally, the LLM diagnostic uses a single model and two prompts under deterministic decoding; it is a bounded probe whose numbers may shift with the model, prompt, or decoding. Ethics. Human value detection can support research on social, political, and moral language, but it can also be misused to profile individuals or infer sensitive beliefs. Sentence-level value attributions are uncertain and culturally variable, and our systems should be read as tools for aggregate analysis and annotation support, not as verdicts about individual speakers. Theory-aware decoding improves structural consistency with the Schwartz taxonomy; it does not remove annotation noise, ambiguity, or cross-cultural differences in how values are expressed, and it should not be treated as evidence that a person holds a value. Conclusion. Human value detectors need not treat the refined Schwartz values as independent labels. Injecting the circular structure into the training loss is informative but not decisiveâGeoLoss matches the baseline within noise and GeoSmooth degrades itâwhereas a post-hoc Schwartz-aware decoder, holding Macro-F1 and Micro-F1 fixed by its selection rule, makes label sets measurably more coherent with the continuum, and only when the geometry is the true one (random and empirical controls do not; significant in all five seeds). Prompting an LLM with value definitions or the continuum shifts behavior but does not close the gap to supervised structured prediction. What sets this apart from prior work is where and how the theory enters: unlike hard hierarchies or architectural gates on this task, which can bottleneck recall (Yeste and Rosso, 2026a, b), and unlike structured decoders that learn label dependencies from data co-occurrence (Read et al., 2011; Zhang and Zhou, 2014), we fix the pairwise structure from theory, keep it a soft bias rather than a hard constraint, and apply it post-hoc to an untouched classifier, then test it directly against random and empirical control geometries; to measure this faithfulness we also introduce a family of theory-aware coherence metrics. More broadly, a psychological theory is most useful here as a soft, controllable output-space bias applied at decoding time. We conjecture, but do not test, that the recipe could extend to other label spaces with known scientific structure (e.g. circumplex or wheel models of emotion); that transfer is left to future work. Acknowledgments The authors used Claude Opus 4.8 and Claude Fable 5 for language polishing, structural editing, and assistance in drafting prose from author-provided notes, tables, and verified experimental results. The authors reviewed and edited all generated text and are responsible for all claims, analyses, and citations. These models were also used to assist with code organization and result-extraction scripts; all code and outputs were manually inspected by the authors. References A. N. Aydin, S. Shaar, and C. Cardie (2024) Edward said at touchĂ©: human value detection using transformers and upsampling. In CLEF 2024 Working Notes, Cited by: §2. A. Bardi and S. H. Schwartz (2003) Values and behavior: strength and structure of relations. Personality and Social Psychology Bulletin 29 (10), p. 1207â1220. External Links: Document Cited by: §2. D. Belanger and A. McCallum (2016) Structured prediction energy networks. In Proceedings of the 33rd International Conference on Machine Learning (ICML), p. 983â992. Cited by: §2. L. Bulla, S. De Giorgis, M. MongiovĂŹ, and A. Gangemi (2025) Large language models meet moral values: a comprehensive assessment of moral abilities. Computers in Human Behavior Reports 17, p. 100609. External Links: ISSN 2451-9588, Document Cited by: §2. J. Cieciuch and S. H. Schwartz (2013) Applying the refined values theory to past data: what can researchers gain?. Journal of Cross-Cultural Psychology 44 (8), p. 1215â1234. External Links: Document Cited by: §2. E. de la Cruz FernĂĄndez, M. Karanik, and S. Ossowski (2025) Value Lens: using large language models to understand human values. In European Conference on Artificial Intelligence (ECAI), Frontiers in Artificial Intelligence and Applications, Vol. 413, p. 5175â5178. External Links: Document Cited by: §2. D. Demszky, D. Movshovitz-Attias, J. Ko, A. Cowen, G. Nemade, and S. Ravi (2020) GoEmotions: a dataset of fine-grained emotions. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL), p. 4040â4054. External Links: Link Cited by: §2. R. DĂaz and A. Marathe (2019) Soft labels for ordinal regression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), p. 4738â4747. Cited by: §4.2. R. Dror, G. Baumer, S. Shlomov, and R. Reichart (2018) The hitchhikerâs guide to testing statistical significance in natural language processing. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia, p. 1383â1392. External Links: Link Cited by: §5. Z. Epstein, F. Jahanbakhsh, T. Piccardi, I. Gallegos, D. Zhao, J. Ugander, and M. S. Bernstein (2026) Whose values? measuring the (subjective) expression of basic human values in social media posts. Proceedings of the International AAAI Conference on Web and Social Media 20 (1), p. 738â759. External Links: Document Cited by: §2. N. Ghamrawi and A. McCallum (2005) Collective multi-label classification. In Proceedings of the 14th ACM International Conference on Information and Knowledge Management (CIKM), p. 195â200. External Links: Document Cited by: §2. J. Graham, J. Haidt, and B. A. Nosek (2009) Liberals and conservatives rely on different sets of moral foundations. Journal of Personality and Social Psychology 96 (5), p. 1029â1046. External Links: Document Cited by: §2. C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger (2017) On calibration of modern neural networks. In Proceedings of the 34th International Conference on Machine Learning (ICML), p. 1321â1330. Cited by: §2. P. He, J. Gao, and W. Chen (2023) DeBERTaV3: improving DeBERTa using ELECTRA-style pre-training with gradient-disentangled embedding sharing. In The Eleventh International Conference on Learning Representations (ICLR), External Links: Link Cited by: §4. J. Hoover, G. Portillo-Wightman, L. Yeh, S. Havaldar, A. M. Davani, Y. Lin, B. Kennedy, M. Atari, Z. Kamel, M. Mendlen, G. Moreno, C. Park, T. E. Chang, J. Chin, C. Leong, J. Y. Leung, A. Mirinjian, and M. Dehghani (2020) Moral Foundations Twitter Corpus: a collection of 35k tweets annotated for moral sentiment. Social Psychological and Personality Science 11 (8), p. 1057â1071. External Links: Document Cited by: §2. L. Hou, C. Yu, and D. Samaras (2016) Squared earth moverâs distance-based loss for training deep neural networks. arXiv preprint arXiv:1611.05916. External Links: 1611.05916 Cited by: §5. S. Huang, E. Durmus, M. McCain, K. Handa, A. Tamkin, J. Hong, M. Stern, A. Somani, X. Zhang, and D. Ganguli (2025) Values in the wild: discovering and analyzing values in real-world language model interactions. arXiv preprint arXiv:2504.15236. Cited by: §2. S. Huang, W. Hu, B. Lu, Q. Fan, X. Xu, X. Zhou, and H. Yan (2024) Application of label correlation in multi-label classification: a survey. Applied Sciences 14 (19), p. 9034. External Links: Document Cited by: §2, §3.2. P. Kandru, B. Singh, A. Maity, K. Aditya Hari, and V. Varma (2023) Tenzin-gyatso at SemEval-2023 task 4: identifying human values behind arguments using DeBERTa. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), External Links: Link Cited by: §2. J. Kiesel, M. Alshomary, N. Handke, X. Cai, H. Wachsmuth, and B. Stein (2022) Identifying the human values behind arguments. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland, p. 4459â4471. External Links: Link Cited by: §2. J. Kiesel, M. Alshomary, N. Mirzakhmedova, M. Heinrich, N. Handke, H. Wachsmuth, and B. Stein (2023) SemEval-2023 Task 4: ValueEval: identification of human values behind arguments. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), Toronto, Canada, p. 2287â2304. External Links: Link Cited by: §1, §2, §3.1. A. Kosmopoulos, I. Partalas, E. Gaussier, G. Paliouras, and I. Androutsopoulos (2015) Evaluation measures for hierarchical classification: a unified view and novel approaches. Data Mining and Knowledge Discovery 29 (3), p. 820â865. External Links: Document Cited by: §5. J. D. Lafferty, A. McCallum, and F. C. N. Pereira (2001) Conditional random fields: probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML), p. 282â289. Cited by: §2. J. Lawrence and C. Reed (2019) Argument mining: a survey. Computational Linguistics 45 (4), p. 765â818. External Links: Document Cited by: §2. Y. LeCun, S. Chopra, R. Hadsell, M. Ranzato, and F. J. Huang (2006) A tutorial on energy-based learning. In Predicting Structured Data, Cited by: §4.3. I. Loshchilov and F. Hutter (2019) Decoupled weight decay regularization. In International Conference on Learning Representations (ICLR), External Links: Link Cited by: §5. L. Ma, Z. Sun, J. Jiang, and X. Li (2023) PAI at SemEval-2023 task 4: a general multi-label classification system with class-balanced loss function and ensemble module. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), External Links: Link Cited by: §1, §2. M. Milkova and M. Rudnev (2026) Measuring human value expression in social media texts: calibrated LLM annotation and encoder transfer. arXiv preprint arXiv:2606.11018. Cited by: §2. N. Mirzakhmedova, J. Kiesel, M. Alshomary, M. Heinrich, N. Handke, X. Cai, V. Barriere, H. Wachsmuth, and B. Stein (2024) The TouchĂ©23-ValueEval dataset for identifying human values behind arguments. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Torino, Italy, p. 16121â16134. External Links: Link Cited by: §1, §2, §3.1. M. Molazadeh Oskuee, M. Rahgouy, H. Babaei Giglou, and C. D. Seals (2023) TM Scanlon at SemEval-2023 task 4: leveraging pretrained language models for human value argument mining with contrastive learning. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), External Links: Link Cited by: §1, §2. R. MĂŒller, S. Kornblith, and G. Hinton (2019) When does label smoothing help?. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 32. Cited by: §4.2. G. Pereyra, G. Tucker, J. Chorowski, Ć. Kaiser, and G. E. Hinton (2017) Regularizing neural networks by penalizing confident output distributions. arXiv preprint arXiv:1701.06548. External Links: 1701.06548 Cited by: §4.2. M. Plenz, P. Heinisch, A. Frank, and P. Cimiano (2024) PAKT: perspectivized argumentation knowledge graph and tool for deliberation analysis. In Robust Argumentation Machines, P. Cimiano, A. Frank, M. Kohlhase, and B. Stein (Eds.), Cham, p. 89â107. External Links: ISBN 978-3-031-63536-6, Document Cited by: §2. R. Plutchik (1980) A general psychoevolutionary theory of emotion. In Emotion: Theory, Research, and Experience, R. Plutchik and H. Kellerman (Eds.), Vol. 1, p. 3â33. External Links: Document Cited by: §2. Qwen, A. Yang, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Li, D. Liu, F. Huang, H. Wei, H. Lin, J. Yang, J. Tu, J. Zhang, J. Yang, J. Yang, J. Zhou, J. Lin, K. Dang, K. Lu, K. Bao, K. Yang, L. Yu, M. Li, M. Xue, P. Zhang, Q. Zhu, R. Men, R. Lin, T. Li, T. Tang, T. Xia, X. Ren, X. Ren, Y. Fan, Y. Su, Y. Zhang, Y. Wan, Y. Liu, Z. Cui, Z. Zhang, and Z. Qiu (2025) Qwen2.5 technical report. arXiv preprint arXiv:2412.15115. Cited by: §4.4. J. Read, B. Pfahringer, G. Holmes, and E. Frank (2011) Classifier chains for multi-label classification. Machine Learning 85 (3), p. 333â359. External Links: Document Cited by: §2, §4.3, §8. T. Ridnik, E. Ben-Baruch, N. Zamir, A. Noy, I. Friedman, M. Protter, and L. Zelnik-Manor (2021) Asymmetric loss for multi-label classification. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), p. 82â91. Cited by: §4.1. D. D. Rodrigues, M. Recamonde-Mendoza, and V. P. Moreira (2024) Beyond single models: leveraging LLM ensembles for human value detection in text. In Proceedings of the 15th Brazilian Symposium in Information and Human Language Technology (STIL), p. 372â381. External Links: Link Cited by: §2. Y. Rubner, C. Tomasi, and L. J. Guibas (2000) The earth moverâs distance as a metric for image retrieval. International Journal of Computer Vision 40 (2), p. 99â121. External Links: Document Cited by: §5. J. A. Russell (1980) A circumplex model of affect. Journal of Personality and Social Psychology 39 (6), p. 1161â1178. External Links: Document Cited by: §2. S. H. Schwartz and K. Boehnke (2004) Evaluating the structure of human values with confirmatory factor analysis. Journal of Research in Personality 38 (3), p. 230â255. External Links: Document Cited by: §3.2. S. H. Schwartz, J. Cieciuch, M. Vecchione, E. Davidov, R. Fischer, C. Beierlein, A. Ramos, M. Verkasalo, J. Lönnqvist, K. Demirutku, O. Dirilen-Gumus, and M. Konty (2012) Refining the theory of basic individual values. Journal of Personality and Social Psychology 103 (4), p. 663â688. External Links: Document Cited by: §1, §2, §3.2. S. H. Schwartz, J. Cieciuch, M. Vecchione, C. Torres, O. Dirilen-Gumus, and T. Butenko (2017) Value tradeoffs and behavior in five countries: validating 19 refined values. European Journal of Social Psychology 47 (3), p. 241â258. External Links: Document Cited by: §1, §2. S. H. Schwartz and J. Cieciuch (2022) Measuring the refined theory of individual values in 49 cultural groups: psychometrics of the revised Portrait Value Questionnaire. Assessment 29 (5), p. 1005â1019. External Links: Document Cited by: §1, §2, §3.2, §3.2. S. H. Schwartz (1992) Universals in the content and structure of values: theoretical advances and empirical tests in 20 countries. In Advances in Experimental Social Psychology, M. P. Zanna (Ed.), Vol. 25, p. 1â65. External Links: Document Cited by: §2. S. H. Schwartz (2017) The refined theory of basic values. In Values and Behavior: Taking a Cross Cultural Perspective, S. Roccas and L. Sagiv (Eds.), p. 51â72. External Links: Document Cited by: §1, §2, §3.2. R. Segerer (2025) Cultural value alignment in large language models: a prompt-based analysis of Schwartz values in Gemini, ChatGPT, and DeepSeek. arXiv preprint arXiv:2505.17112. Cited by: §2. E. Skimina, J. Cieciuch, S. H. Schwartz, E. Davidov, and R. Algesheimer (2018) Testing the circular structure and importance hierarchy of value states in real-time behaviors. Journal of Research in Personality 74, p. 42â49. External Links: Document Cited by: §1, §2. P. Sun (2024) Fine-tuning vs prompting, can language models understand human values?. arXiv preprint arXiv:2403.09720. External Links: 2403.09720 Cited by: §1, §2. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna (2016) Rethinking the Inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), p. 2818â2826. Cited by: §4.2. A. N. Tarekegn, M. Ullah, and F. A. Cheikh (2024) Deep learning for multi-label learning: a comprehensive survey. arXiv preprint arXiv:2401.16549. Cited by: §2. G. Tsoumakas and I. Katakis (2007) Multi-label classification: an overview. International Journal of Data Warehousing and Mining 3 (3), p. 1â13. External Links: Document Cited by: §2. M. Tsunokake, A. Yamaguchi, Y. Koreeda, H. Ozaki, and Y. Sogawa (2023) Hitachi at SemEval-2023 task 4: exploring various task formulations reveals the importance of description texts on human values. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), External Links: Link Cited by: §2. F. Vargas, J. Trager, D. Alves, S. Thapa, M. Guida, B. Atil, D. Dementieva, A. Smart, and A. Agrawal (2026) Self-explaining hate speech detection with moral rationales. arXiv preprint arXiv:2601.03481. Cited by: §2. P. Yang, X. Sun, W. Li, S. Ma, W. Wu, and H. Wang (2018) SGM: sequence generation model for multi-label classification. In Proceedings of the 27th International Conference on Computational Linguistics (COLING), p. 3915â3926. External Links: Link Cited by: §2. V. Yeste and P. Rosso (2026a) Do Schwartz higher-order values help sentence-level human value detection? a study of hierarchical gating and calibration. arXiv preprint arXiv:2602.00913. External Links: 2602.00913 Cited by: §1, §2, §7, §8. V. Yeste and P. Rosso (2026b) Human values in a single sentence: moral presence, hierarchies, and transformer ensembles on the Schwartz continuum. arXiv preprint arXiv:2601.14172. External Links: 2601.14172 Cited by: §1, §2, §3.1, §7, §8, footnote 3. V. Yeste and P. Rosso (2026c) More context, larger models, or moral knowledge? a systematic study of Schwartz value detection in political texts. arXiv preprint arXiv:2605.22641. External Links: 2605.22641 Cited by: §2. M. Yin, M. Wan, Z. Lin, and J. Jiang (2026) Moralization-aware identity fusion for detecting violent radicalization in social media. Information Processing & Management 63 (2, Part A), p. 104413. External Links: ISSN 0306-4573, Document Cited by: §2. L. Zangari, C. M. Greco, D. Picca, and A. Tagarelli (2025) A survey on moral foundation theory and pre-trained language models: current advances and challenges. AI & SOCIETY 40 (6), p. 4973â4998. External Links: ISSN 1435-5655, Document Cited by: §2. M. Zhang and Z. Zhou (2014) A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering 26 (8), p. 1819â1837. External Links: Document Cited by: §2, §4.3, §8. W. Zhu, Y. Xie, G. Song, and X. Zhang (2025) EAVIT: efficient and accurate human value identification from text data via llms. In Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, IJCAI â25. External Links: ISBN 978-1-956792-06-5, Link, Document Cited by: §1, §2. Appendix A Geometry-Aware Training on the ASL Base Table 5 repeats the geometry-aware objectives on the imbalance-aware ASL base. The picture is unchanged: every variant trails the BCE-based systems (Table 2), the GeoLoss variants do not even beat the plain ASL baseline, and Schwartz GeoSmooth again collapses, more severely than under BCE. Training-time geometry is thus not decisive regardless of base loss, and the GeoSmooth instability is not specific to BCE. Method (ASL base) Macro-F1 â Micro-F1 â Macro-AUPRC â Circ. err. â ASL (baseline) 0.2833 ± 0.0193 0.3306 ± 0.0219 0.2235 ± 0.0240 0.3735 ± 0.1812 + empirical structure 0.2879 ± 0.0048 0.3322 ± 0.0067 0.2306 ± 0.0042 0.1750 ± 0.0167 + random GeoLoss 0.2703 ± 0.0040 0.3189 ± 0.0028 0.2136 ± 0.0044 0.1299 ± 0.0058 + Schwartz GeoLoss 0.2763 ± 0.0054 0.3235 ± 0.0090 0.2197 ± 0.0050 0.1273 ± 0.0057 + Schwartz GeoSmooth 0.2081 ± 0.0146 0.2383 ± 0.0173 0.1513 ± 0.0107 0.8776 ± 0.1307 Table 5: Geometry-aware training on the ASL base (test, mean ± std over five seeds). All variants trail the BCE-based systems of Table 2; the GeoLoss variants do not beat the plain ASL baseline, and GeoSmooth collapses. F1 and AUPRC are higher-is-better; circular error is lower-is-better. Best per column in bold. Appendix B Per-Label Distribution Table 6 reports per-value support over the full corpus, in canonical Schwartz order. Support spans roughly two orders of magnitude (Humility to Security: societal), motivating the imbalance-aware baseline (Section 4) and validation-tuned per-label thresholds. Value Region Support (%) Self-direction: thought O 1.24 Self-direction: action O 3.52 Stimulation O 2.64 Hedonism O/SE 0.82 Achievement SE 6.38 Power: dominance SE 4.53 Power: resources SE 5.07 Face SE/C 1.83 Security: personal C 2.07 Security: societal C 8.64 Tradition C 1.36 Conformity: rules C 6.19 Conformity: interpersonal C 1.35 Humility C/ST 0.24 Benevolence: dependability ST 1.95 Benevolence: caring ST 2.28 Universalism: concern ST 4.89 Universalism: nature ST 2.15 Universalism: tolerance ST 1.04 Table 6: Per-label support as a percentage of all corpus sentences (N=74,231N=74,231), in canonical Schwartz order. Regions: O = openness to change, SE = self-enhancement, C = conservation, ST = self-transcendence; Hedonism (O/SE) and Face (SE/C) bridge two regions. Appendix C Full Significance Tests Table 7 reports the paired seed-level bootstrap (Section 5) behind Table 2: the mean test-set delta of each supervised variant against BCE over the five shared seeds, with two-sided p-values. No GeoLoss variant differs significantly from BCE on a standard metric; only the empirical control significantly reduces circular error, and GeoSmooth is significantly worse on every metric. Table 8 reports the paired sample-level bootstrap behind Section 6.3: per-seed tests of the Schwartz decoder against each control geometry on the shared test set. The geometry-cost reduction is significant in every seed against both controls, while the F1 differences are significant in none. Macro-F1 Micro-F1 Macro-AUPRC Circ. err. Method (vs. BCE) Î p Î p Î p Î p ASL â0.0101-0.0101 0.170 â0.0119-0.0119 0.193 â0.0118-0.0118 0.170 +0.2393+0.2393 <<0.001 Empirical structure +0.0012+0.0012 0.721 â0.0024-0.0024 0.186 +0.0002+0.0002 0.878 â0.0073-0.0073 0.008 Random GeoLoss +0.0015+0.0015 0.488 +0.0014+0.0014 0.640 â0.0001-0.0001 0.775 â0.0069-0.0069 0.097 Schwartz GeoLoss +0.0025+0.0025 0.191 â0.0004-0.0004 0.809 +0.0003+0.0003 0.882 â0.0037-0.0037 0.164 Schwartz GeoSmooth â0.1282-0.1282 <<0.001 â0.1769-0.1769 <<0.001 â0.1172-0.1172 <<0.001 +0.5646+0.5646 <<0.001 Table 7: Paired seed-level bootstrap for the supervised systems of Table 2: mean test delta vs. BCE over the five shared seeds (2,000 resamples; two-sided p). Positive Î favors the variant on F1/AUPRC; negative Î favors it on circular error. Significant p (<0.05<0.05) in bold. Control Metric Î Sig. Max p Random Geom. cost â0.0145-0.0145 5/5 <<0.001 Random Opp. err. â0.0027-0.0027 4/5 0.96 Random Macro-F1 +0.0008+0.0008 0/5 0.83 Random Micro-F1 +0.0002+0.0002 0/5 0.77 Empirical Geom. cost â0.0148-0.0148 5/5 <<0.001 Empirical Opp. err. â0.0028-0.0028 4/5 0.96 Empirical Macro-F1 +0.0008+0.0008 0/5 0.79 Empirical Micro-F1 +0.0002+0.0002 0/5 0.80 Table 8: Paired sample-level bootstrap for the decoder-control comparison of Section 6.3, run per seed (2,000 resamples). Î = Schwartz â- control, averaged over seeds (negative is better for cost and error); âSig.â counts seeds with two-sided p<0.05p<0.05; âMax pâ is the largest per-seed p-value, in bold when significant (<0.05<0.05). The 95%95\% confidence intervals for the geometry-cost deltas appear in Section 6.3. Appendix D Qualitative Decoder Edits Table 9 lists representative test sentences whose label sets the Schwartz decoder edits, covering the two edit types discussed in Section 7: completing a nearby true value and removing opposite-side false positives (the third and fourth rows are the two examples described there). Each row shows the gold labels, the thresholding output, the decoded output, and the sentence-level F1 change. Sentence (abridged) Gold Thresholding + Schwartz decoder F1 âŠfake advertisements and websites are designed with elements such as discounts and vacation opportunities that consumers tend to be easily persuaded ⊠Security: societal; Conformity: rules Security: personal Security: personal; Security: societal; Conformity: rules 0.00 â 0.80 He stressed that the countries of the region should eventually join the EU, of course within the framework of conditionality ⊠Conformity: interpersonal Self-direction: action; Conformity: rules Conformity: rules; Conformity: interpersonal 0.00 â 0.67 While in the field of regulatory reform it is possible to mark the progress of the parties towards a compromise, when it comes to raising the retirement age for women ⊠Power: dominance Power: dominance; Benevolence: dependability; Universalism: concern Power: dominance 0.50 â 1.00 Provided, however, that the allied countries âremain united in maintaining and increasing sanctions pressure.â Power: resources Power: dominance Power: dominance; Power: resources 0.00 â 0.67 Table 9: Representative decoder edits on the test set, drawn from individual seed runs. The first two rows complete nearby true values (the second also removes an opposite-side false positive); the last two remove opposite-side false positives or complete an adjacent value, matching the two examples discussed in Section 7. F1 is the sentence-level F1 before â after decoding. Appendix E LLM Diagnostic Prompts Both prompts are built from the fixed template below, reproduced verbatim from the experiment code; the only per-sentence variation is the target sentence. The continuum prompt inserts the marked block between the definitions and the output rules; the definitions prompt omits it. Definitions follow canonical Schwartz order. Italic parenthetical annotations are ours, not part of the prompt. You are a sentence-level classifier for human values. Task: identify which of the 19 refined Schwartz values are expressed in the target sentence. The labels collapse attained and constrained cases into value presence: predict a label if the sentence expresses that value in either form. Allowed labels and definitions: - Self-direction: thought: freedom to cultivate oneâs own ideas and abilities. - Self-direction: action: freedom to determine oneâs own actions. - Stimulation: excitement, novelty, and change. - Hedonism: pleasure and sensuous gratification. - Achievement: success according to social standards. - Power: dominance: power through exercising control over people. - Power: resources: power through control of material and social resources. - Face: maintaining oneâs public image and avoiding humiliation. - Security: personal: safety in oneâs immediate environment. - Security: societal: safety and stability in the wider society. - Tradition: maintaining and preserving cultural, family, or religious traditions. - Conformity: rules: compliance with rules, laws, and formal obligations. - Conformity: interpersonal: avoidance of upsetting or harming other people. - Humility: recognising oneâs insignificance in the larger scheme of things. - Benevolence: dependability: being a reliable and trustworthy member of the in-group. - Benevolence: caring: devotion to the welfare of in-group members. - Universalism: concern: commitment to equality, justice, and protection for all people. - Universalism: nature: preservation of the natural environment. - Universalism: tolerance: acceptance and understanding of those who are different from oneself. Schwartz-continuum structure: (continuum prompt only) - The refined values are arranged around this motivational circle: Self-direction: thought -> Self-direction: action -> Stimulation -> Hedonism -> Achievement -> Power: dominance -> Power: resources -> Face -> Security: personal -> Security: societal -> Tradition -> Conformity: rules -> Conformity: interpersonal -> Humility -> Benevolence: dependability -> Benevolence: caring -> Universalism: concern -> Universalism: nature -> Universalism: tolerance. - Nearby labels on the circle usually express compatible motivations. - Labels on the opposite side of the circle usually express motivational conflict. - Multi-label outputs are allowed, especially for nearby or conceptually compatible values. - Avoid predicting distant/opposing values together unless the sentence clearly expresses both. Output rules: - Return exactly one JSON object with this schema: "labels": ["Label name", "..."]. - Use only exact labels from the allowed list. Do not invent labels. - If no listed value is expressed, return "labels": []. - Do not include explanations, markdown, comments, or text outside the JSON object. Target sentence: [sentence] (the target sentence is substituted here)