Paper deep dive

From Static Personal Values to Contextualized Personalization: Bayesian Personalized Value Alignment for LLMs

Hanze Guo, Aixuan Song, Jing Yao, Xiangxu Zhang, Xiaoyuan Yi, Xing Xie, Xiao Zhou

Year: 2026Venue: arXiv preprintArea: cs.AIType: PreprintEmbeddings: 120

Intelligence

Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 92%

Last extracted: 9/25/2026, 4:30:44 AM

Summary

The paper introduces BaCVA, an inference-time Bayesian framework for personalized value alignment in Large Language Models (LLMs). It addresses the limitation of existing methods that use static value profiles by modeling personal values as priors and context-dependent preferences as posteriors. BaCVA estimates scenario-specific value salience and uses a dual-view personalization module to infer posterior preferences, improving adaptability and data efficiency.

Entities (6)

LLMs · technology · 99%BaCVA · method · 98%Variational Inference · technique · 93%Lewin's Field Theory · theory · 92%Schwartz’s Basic Values · framework · 90%HHH · value-framework · 88%

Relation Signals (5)

BaCVA → improves → Personalized Value Alignment

confidence 96% · This Bayesian formulation enables more accurate and adaptive personalized value alignment

BaCVA → addresseslimitationof → Static Personal Value Profiles

confidence 95% · existing methods typically align model outputs with a static value profile... overlooking that the salience of value dimensions varies substantially across contexts.

BaCVA → uses → Variational Inference

confidence 93% · The whole framework is optimized toward a variational inference objective

BaCVA → isbasedon → Lewin's Field Theory

confidence 92% · Inspired by Lewin's Field Theory... we model personal values as priors and context-dependent preferences as posteriors.

Schwartz’s Basic Values → providesdimensionsfor → Personal Values

confidence 85% · finite pre-defined value dimensions... from a well-established value framework (e.g., Schwartz’s Basic Values

Cypher Suggestions (0)

No Cypher suggestions yet.

Abstract

Abstract:Personalized value alignment has become increasingly important as large language models (LLMs) are expected to accommodate diverse user preferences. However, existing methods typically align model outputs with a static value profile across prompts, overlooking that the salience of value dimensions varies substantially across contexts. Inspired by Lewin's Field Theory, which views human behavior as jointly shaped by personal dispositions and situational constraints, we model personal values as priors and context-dependent preferences as posteriors. We propose BaCVA, an inference-time Bayesian Context-aware personalized Value Alignment method that approximates posterior personalized preferences by integrating static personal values with scenario-specific value salience. BaCVA first estimates contextual value salience from generally normative responses, and then employs a dual-view personalization module to infer posterior preferences from complementary personal-value and scenario-driven perspectives. This Bayesian formulation enables more accurate and adaptive personalized value alignment while improving data efficiency via prior values. Extensive experiments on benchmarks demonstrate its superiority over strong baselines.

PDF

Open source PDF →Open local PDF →

Trouble viewing inline? Open PDF directly →

Full Text

116,410 characters extracted from source content.

Expand or collapse full text

From Static Personal Values to Contextualized Personalization: Bayesian Personalized Value Alignment for LLMs Hanze Guo †thanks: Equal contribution. Affiliation: Gaoling School of Artificial Intelligence, Renmin University of China Aixuan Song11footnotemark: 1 Affiliation: Gaoling School of Artificial Intelligence, Renmin University of China Jing Yao11footnotemark: 1 Affiliation: Microsoft Research Asia Xiangxu Zhang Affiliation: Gaoling School of Artificial Intelligence, Renmin University of China Xiaoyuan Yi Affiliation: Microsoft Research Asia Xing Xie Affiliation: Microsoft Research Asia Xiao Zhou †thanks: Corresponding author. Affiliation: Gaoling School of Artificial Intelligence, Renmin University of China Affiliation: Beijing Key Laboratory of Research on Large Models and Intelligent Governance Affiliation: Engineering Research Center of Next-Generation IntelligentSearch and Recommendation, MOEghz,songaix,xiaozhou@ruc.edu.cn, jingyao@microsoft.com Abstract Personalized value alignment has become increasingly important as large language models (LLMs) are expected to accommodate diverse user preferences. However, existing methods typically align model outputs with a static value profile across prompts, overlooking that the salience of value dimensions varies substantially across contexts. Inspired by Lewin’s Field Theory, which views human behavior as jointly shaped by personal dispositions and situational constraints, we model personal values as priors and context-dependent preferences as posteriors. We propose BaCVA, an inference-time Bayesian Context-aware personalized Value Alignment method that approximates posterior personalized preferences by integrating static personal values with scenario-specific value salience. BaCVA first estimates contextual value salience from generally normative responses, and then employs a dual-view personalization module to infer posterior preferences from complementary personal-value and scenario-driven perspectives. This Bayesian formulation enables more accurate and adaptive personalized value alignment while improving data efficiency via prior values. Extensive experiments on benchmarks demonstrate its superiority over strong baselines. 1 Introduction The widespread deployment of Large Language Models (LLMs) (Achiam et al., 2023; Touvron et al., 2023; Guo et al., 2025a; Yang et al., 2025; Zhang et al., 2026a; Li et al., 2025b; Zhu et al., 2026; Zhang et al., 2026b; Yong et al., 2025b; Yong et al., 2025a; Yong et al., 2026) has made aligning LLMs with human values a central research challenge (Wang et al., 2023; Shen et al., 2023; Yao et al., 2023b; Wang et al., 2024b; Guo et al., 2026b; Zhang et al., 2026c). While prominent methods focus on promoting universal but monolithic values, such as H (helpful, harmless, honest) (Bai et al., 2022a; Ouyang et al., 2022; Hendrycks et al., 2020), they struggle to accommodate the substantial diversity of individual user values. Consequently, personalized value alignment emerges as a more practical objective (Zhou et al., 2025; Guo et al., 2025b; Guo et al., 2026a; Zhang et al., 2026d). Existing work on personalized value alignment falls into two categories. Training-time methods fine-tune personalized reward models and adapters using user-specific interaction data (Poddar et al., 2024; Zhao et al., 2025). Nevertheless, these methods typically rely on extensive personal value data and might degrade in data-scarce or cold-start scenarios (Pădurean et al., 2025; Poddar et al., 2024). Inference-time methods offer greater flexibility, which steer model outputs by personal value prompts (Pădurean et al., 2025; Ryan et al., 2025; Chen et al., 2025b), activating value-related model parameters (Zhu et al., 2024; Zhang et al., 2025b) or modifying token distributions during decoding (Chen et al., 2024; Shi et al., 2024; Zhang et al., 2025a). However, most inference-time methods face a common limitation: they conceptualize personalized value alignment as adapting model outputs to a static personal value profile to capture users’ overall value orientations. Although these methods condition response generation on the input question, they typically use the same user value profile for every question, without explicitly estimating which value dimensions become more or less important in the current context. (a) (b) Figure 1: (a) An example showing that a user a stable personal value profile may exhibit different value preferences across contexts, which are jointly shaped by personal values and situational constraints. (b) Empirical results show that only personal values or scenario value salience achieve weaker personalization than their combination. Drawing from well-established psychological theories (Mischel, 2013; Epstein and O’Brien, 1985), stable internal dispositions alone are insufficient to explain human behaviors across varying contexts. Notably, Lewin’s Field Theory (Heidbreder, 1937) posits that observed behavior is jointly shaped by personal values and situational constraints. As illustrated in Fig.1 (a), an individual who inherently prioritizes ‘Self-Direction’ over ‘Conformity’ may nonetheless suppress self-direction actions in scenarios governed by other values. This suggests that each scenario may selectively activate or suppress different value dimensions according to broadly shared social norms (Cialdini et al., 1990; Burnes*, 2004), which can be formalized as a context-aware value salience distribution. Together, inherent personal values and context-aware value salience ultimately shape behavior. This is also supported by empirical results in Fig. 1 (b) that combining both leads to more accurate preference prediction. From a Bayesian lens, inherent personal values and contextual value salience serve as complementary priors, while the posterior values inferred from observed behaviors reflect final context-aware personal preferences. Inspired by this formulation, we propose BaCVA, an inference-time Bayesian Context-aware personalized Value Alignment method. It achieves personalization by dynamically approximating the posterior personalized values based on both static personal values and context-specific value salience. Specifically, BaCVA consists of two components: (i) a scenario value estimator that predicts the context-aware value salience; (i) a dual-view personalization module that approximates posterior personal values from complementary personal value-driven and scenario-driven perspectives. The whole framework is optimized toward a variational inference objective Tzikas et al. (2008); Blei et al. (2017). By framing personalization as context-aware posterior inference, BaCVA offers two advantages: (i) fine-grained adaptability, capturing nuanced value shifts from priors across diverse scenarios; and (i) data efficiency, enabling personalization with fewer training samples and seamless generalization to new users. Extensive experiments on multiple benchmarks showcase the superiority of our framework. The main contributions are summarized below. (1) We theoretically and empirically identify a key limitation in current personalized alignment methods: they typically reuse a fixed personal value profile across prompts without explicitly modeling question-specific changes in value salience. (2) We propose BaCVA, an inference-time Bayesian personalized alignment framework. It achieves dynamic personalization by inferring context-aware posterior preferences conditioned on prior personal values and contextual value salience. (3) Extensive experiments show that BaCVA achieves more accurate and adaptive personalized value alignment, as well as improved data efficiency and generalization. 2 Related Work General Value Alignment of LLMs General (non-personalized) value alignment aims to align LLM outputs with population-level human preferences like H (helpfulness, harmlessness and honesty) (Wang et al., 2023; Shen et al., 2023; Yao et al., 2023b). Prominent methods include supervised fine-tuning (SFT) (Zhang et al., 2023; Han et al., 2025), reinforcement learning from human feedback (RLHF) (Ouyang et al., 2022; Bai et al., 2022a), direct preference optimization (DPO) (Rafailov et al., 2023; Ethayarajh et al., 2024; Meng et al., 2024) and variants. Besides, inference-time methods like retrieval-augmented generation (RAG)(Lewis et al., 2020; Zhao et al., 2024; Gao et al., 2023) and principle-based prompting(Bai et al., 2022b) steer model output without parameter updates. These methods inherently struggle to accommodate the diversity of individual user values, motivating the need for personalized value alignment. Personalized Value Alignment of LLMs Existing methods fall into two categories. Training-time personalization incorporates user preferences via model optimization (Chen et al., 2025a; Choi et al., 2025). VPL (Poddar et al., 2024) and RLPA (Zhao et al., 2025) learn user-specific reward models or adapters from individual interaction data. P-RLHF (Li et al., 2024) learns user embeddings for personalization. Despite these methods implicitly fit to observed posterior preferences, they rely on extensive per-user data and degrade in cold-start or sparse-data settings (Pădurean et al., 2025). In contrast, inference-time personalization steers model behaviors by manipulating prompts Chen et al. (2025b); Jin et al. (2025) or decoding (Thonet et al., 2025; Zhu et al., 2024), without modifying parameters. ValuePrompt (Kang et al., 2024) and COUPLE (Guo et al., 2026b) condition generation on explicit user value descriptions. Other approaches summarize or retrieve value-aware content from user histories, like ValuesRAG (Ryan et al., 2025; Seo et al., 2025). Decoding-based methods (Zhang et al., 2025a) like MOD (Shi et al., 2024) and PAD (Chen et al., 2024) reshape token distributions to adapt general outputs to fixed individual preferences. These inference-time approaches mainly reuse the same personal value profile across situations, without explicitly modeling question-specific changes in the salience of individual value dimensions. We address this limitation in this paper. Bayesian Modeling and Applications Bayesian modeling (Zhang and Poole, 1996; Bishop and Tipping, 2013; Grossman and Domingos, 2004; Lauritzen and Spiegelhalter, 1990; Heckerman et al., 2015) offers a principled lens for updating prior beliefs with observed evidence and reasoning with uncertainty (Gao et al., 2024). Recent work (Gupta et al., 2025; Longjohn et al., 2025; Wang et al., 2024a) has explored LLMs alignment from a Bayesian perspective. BIRD (Feng et al., 2025) frames decision alignment as a Bayesian decision process. Dellma (Liu et al., 2024) applies decision theory to address uncertainty. This paper formulates personalized value alignment as Bayesian posterior inference, optimized through Variational Inference (Tzikas et al., 2008; Blei et al., 2017; Ganguly and Earp, 2021). 3 Methodology Figure 2: Overview of the proposed Bayesian question-specific value modeling framework. A question x provides a decision context, while a user-level value profile vuiv_u_i modulates how semantics are personalized. We learn a Bayesian residual (semantic delta) from two complementary views, and fuse the two views via a context-based gated fusion mechanism to predict a personalized, context-aware answer. 3.1 Task Definition Let =uii=1NU=\u_i\_i=1^N denote a population of diverse users, each user uiu_i is associated with a self-written summary of personal values cuic_u_i and a small set of preference annotations ui=(x,yc,yr)D_u_i=\(x,y_c,y_r)\, where x denotes a prompt or question, ycy_c and yry_r mean the preferred and dispreferred responses respectively. To make the open-ended value summary cuic_u_i more actionable and unified, we follow Yao et al. (2023a); Guo et al. (2026b) to convert it into a structured, multi-dimensional value profile ui=[(v1,s1),…,(vd,sd)] v_u_i=[(v_1,s_1),…,(v_d,s_d)]. (v1,…,vd)(v_1,…,v_d) are finite pre-defined value dimensions (e.g., care, authority) from a well-established value framework (e.g., Schwartz’s Basic Values (Schwartz, 2012)). sj∈1,2,3,4,5s_j∈\1,2,3,4,5\ indicates the priority assigned to vjv_j on a 5-point Likert scale from ‘not important at all (1)’ to ‘very important (5)’. Since training a dedicated model for each user is less practical in low-data (small uiD_u_i) and cold-start cases, we focus on inference-time personalized alignment in this paper. With a single shared model pψ(|,ui,)p_ψ(y|x,v_u_i, x) that can generate the response y aligned with the given personalized values ui,v_u_i, x toward the question x, our goal is to infer the concrete personalized values ui,x∼pθ(|ui,)v_u_i,x p_θ(v|v_u_i,x) the user would exhibit to guide response generation under the specific context x. For evaluation on test samples (ui,x,yc,yr)\(u_i,x,y_c,y_r)\, we extract the values reflected in two responses as yc,yr v_y_c, v_y_r, then compare inferred personalized values ui,x v_u_i,x with them using two metrics: (i) the distance between ui,x v_u_i,x and yc v_y_c like MAE and (i) the accuracy whether ui,x v_u_i,x is closer to yc v_y_c than to yr v_y_r. Furthermore, we evaluate the effectiveness of BaCVA in guiding downstream personalized response generation. We compare the responses generated from the inferred value ui,x v_u_i,x against ycy_c and yry_r. 3.2 The BaCVA Framework As discussed in Sec.1, existing inference-time personalization methods employ the overall user profile ui v_u_i or that summarized from the preference data ui,i v_u_i,D_i to instantiate ui,xv_u_i,x and keep it fixed across prompts x, thereby limiting their ability to explicitly model question-specific shifts in the salience of individual value dimensions, as illustrated in Fig. 1 (a). Inspired by Lewin’s field theory (Heidbreder, 1937) that observed behaviors emerge from the interaction between the personal value profile uiv_u_i and the situation x, and Cognitive Appraisal Theory (Lazarus and Folkman, 1984) that situations modulate the expression of internal values to form final actions, we formalize the contextual factor as a scenario-specific value salience distribution. By treating both the personal value profile and specific context value salience as priors (prior to behavioral execution), we propose BaCVA, a Bayesian framework that dynamically estimates the contextual personalized values ui,xv_u_i,x via posterior inference. Given the data ui=(x,yc,yr)D_u_i=\(x,y_c,y_r)\, we model observed user preferences yc≻yry_c y_r as the likelihood and the posterior distribution of the target ui,xv_u_i,x is formalized as a calibration from the prior value distribution pθ(ui,x|ui,)p_θ(v_u_i,x|v_u_i,x) by the likelihood: pθ(ui,x|ui,,yc≻yr) p_θ(v_u_i,x|v_u_i,x,y_c y_r) (1) ∝pθ(yc≻yr|ui,x)×pθ(ui,x|ui,). p_θ(y_c y_r|v_u_i,x)× p_θ(v_u_i,x|v_u_i,x). This formalization yields two advantages: (1) more adaptive personalization by enabling fine-grained calibration from informative priors, and (2) training efficiency by introducing high-quality priors. Moreover, BaCVA does not rely on fine-tuning user-specific adapters but personal value profiles, thus easily extended to cold-start users. Since direct computation of the posterior value distribution is intractable, we refer to Variational Inference (VI) (Blei et al., 2017) and introduce a variational posterior qϕ(ui,x|ui,)q_φ(v_u_i,x|v_u_i,x) implemented by LLMs. As shown in Fig.2, the architecture consists of two modules: (i) a scenario value estimator to predict contextual value salience; and (i) a dual-view personalization module that approximates the posterior distribution from both personal value-driven and scenario-driven perspectives. Then, we optimize the model by minimizing the divergence between the variational posterior and the true posterior, which is equivalent to maximizing the evidence lower bound (ELBO) below, with full derivation in Appendix A.1. ℒ= = −qϕ(ui,x)[log⁡pθ(yc≻yr∣ui,x,x)] -E_q_φ(v_u_i,x)\! [ p_θ(y_c y_r v_u_i,x,x) ] (2) +KL(qϕ(ui,x∣ui,)∥pθ(ui,x∣ui,)). +KL\! (q_φ(v_u_i,x v_u_i,x)\,\|\,p_θ(v_u_i,x v_u_i,x) ). Each module is detailed in the next subsections. 3.3 Estimation of Scenario Value Salience As illustrated in Fig. 1, different value dimensions are not equally salient across scenarios, instead, a specific question x usually activates only a subset of dimensions. Typically, the salience distribution over these dimensions are shaped by universal social norms, encouraging some values while rendering others less acceptable. Inspired by this, we estimate the scenario value salience distribution xv_x based on population-level aligned response. Concretely, for a question x, we leverage LLMs that have gone through great human alignment as a proxy to obtain the universal response, denoted as humany_human. Then, we employ a prompt-based value estimator qωq_ω to infer xv_x: x∼qω(⋅|,human). v_x q_ω(·|x,y_human). (3) In our primary implementation, we leverage GPT-5-nano to generate the universal response and estimate the value salience through in-context learning. We also replace it with other LLMs to validate the robustness in Appendix C. Detailed prompts are provided in Appendix A.3.2. 3.4 Dual-View Personalized Value Inference Lewin’s field theory states that behavior arises from the interaction between the person and the environment. Thus, the concrete values reflected in final behaviors can be explained from two complementary perspectives: (1) Scenario-anchored personalization drift, where shared norms under the specific scenario largely determine the behavior while personal values introduce slight but meaningful deviation; (2) Person-anchored contextual instantiation, which assumes that personalization is primarily rooted in the user’s inherent value profile while the scenario modulates how salient each value is. Motivated by this, we design a dual-view personalization module to approximate the posterior distribution over ui,v_u_i, x. Specifically, it includes a scenario-driven component and a person-driven component to infer the posterior respectively: qϕ(ui,()|x,ui),qϕ(ui,()|ui,x). q_φ(v_u_i, x^(x)|v_x,v_u_i), q_φ(v_u_i, x^(u)|v_u_i,v_x). (4) Then, the final variational posterior is calculated as a gated composition of the two perspectives: qϕ(ui,x|ui,)=αqϕ(ui,()|x,ui) q_φ(v_u_i,x|v_u_i,x)=α q_φ(v_u_i, x^(x)|v_x,v_u_i) (5) +(1−α)qϕ(ui,()|ui,x), +(1-α)q_φ(v_u_i, x^(u)|v_u_i,v_x), where α is produced through a context-aware gate. View 1: Scenario-Anchored Personalization Drift Conditioned on the scenario-based value salience prior qω(x)q_ω(v_x), this view models personalization as adding a personal residual to the scenario anchor in logit space: qϕ(ui,x(x)∣x,ui) q_φ(v^(x)_u_i,x v_x,v_u_i) =Softmax⁡(x+zu), =Softmax(s_x+z_u), (6) x _x =Logit⁡(qω(x)), =Logit(q_ω(v_x)), (7) where zuz_u is the personal residual logit vector. Intuitively, this view is effective when most individuals follow the scenario-level consensus with slight personalized divergence. View 2: Person-Anchored Contextual Instantiation This view starts from the personal value prior qϕ(u)q_φ(v_u) and instantiates it under the current scenario by adding a context residual in logit space: qϕ(ui,x(u)∣ui,x) q_φ(v^(u)_u_i,x v_u_i,v_x) =Softmax⁡(u+zx), =Softmax(s_u+z_x), (8) u _u =Logit⁡(qϕ(u)), =Logit(q_φ(v_u)), (9) where zxz_x is the context residual logit vector. This perspective emphasizes personal value-driven behaviors where scenario-level expectations provide only weak constraints. In practice, we employ open-sourced LLMs to represent these distributions by prompting them with appropriate instructions and extracting the generation probability of each value. More details about the prompts are provided in Appendix A.3.2. Context-Aware Gated Fusion The above dual-view posterior values are complementary and capture dominant information suited for different scenarios. Rather than equally combining them across all contexts, it would be more effective to dynamically consider their relative dominance. Consequently, we introduce a context-aware fusion mechanism to compute the gate score α∈[0,1]α∈[0,1] as: α=⁡(,q⁡(ui,()),q⁡(ui,()),σui,()2,σui,()2).α=G( x,q(v_u_i, x^(x)),q(v_u_i, x^(u)),σ^2_v_u_i, x^(x),σ^2_v_u_i, x^(u)). (10) q⁡(ui,())q(v_u_i, x^(x)) is the abbreviation of q⁡(ui,()|x,ui)q(v_u_i, x^(x)|v_x,v_u_i), σui,()2σ^2_v_u_i, x^(x) and σui,()2σ^2_v_u_i, x^(u) are variances to measure the uncertainty of posterior inference in the two views. In practice, the gate function G corresponds to an LLM, which jointly reasons over the inputs and outputs a continuous context-aware fusion weight by normalizing the logits of tokens 0 and 1, rather than making a hard binary decision. Specific implementation details are given in Appendix A.3.2. Variational Inference Optimization We use the same value extractor in Subsec. 3.3 to analyze the value reflected by the preferred response vycv_y_c, used as the supervision during training. Besides, we approximate the expectation term in Eq.(2) with a single-pass amortized estimate, getting the predicted posterior value as v^ui,x v_u_i,x. Then, the Variational Inference loss in our dual-view personalization model is: ℒ=‖v^ui,x−vyc‖22+λ1∑k∈u,xKL(qϕ(k)∥pθ(k)).L= \| v_u_i,x-v_y_c \|_2^2+ _1 _k∈\u,x\KL(q_φ^(k)\,\|\,p_θ^(k)). (11) 4 Experiments PRISM GOOD Category Method MAE ↓ Correlation ↑ Accuracy ↑ MAE ↓ Correlation ↑ Non-personalized Alignment DirectAnswer 1.858 0.485 67.05 3.302 0.517 Inference-time Personalized Alignment PersonValue 2.969 0.411 56.56 3.698 0.189 Value Prompt 1.790 0.568 72.95 3.062 0.579 MetaAligner 1.955 0.509 69.00 3.231 0.480 COUPLE 1.819 0.588 65.98 3.089 0.347 PAD 1.733 0.607 66.67 3.236 0.360 MOD 1.620 0.595 66.37 3.120 0.410 ValuesRAG 0.952 0.638 71.68 2.261 0.589 BaCVA (Ours) 0.728∗ 0.700∗ 81.72∗ 1.118∗ 0.769∗ Table 1: Main results on PRISM and GOOD. The best results are bold and second-best results are underlined. ∗ indicates statistically significant improvement over all baselines (p<0.05p<0.05). Accuracy is not applicable to GOOD that has only a ground truth answer but not preferred and dispreferred response pairs. 4.1 Experiment Setting Datasets We evaluate BaCVA on PRISM (Kirk et al., 2024) and GOOD (Wang et al., 2019), both of which provide personal value profiles and user behaviors across diverse scenarios. PRISM contains open-ended questions with preferred/dispreferred candidate responses, while GOOD contains persuasion dialogues with value annotations and user-generated responses. After preprocessing, they contain 2,1312,131 and 2,6962,696 instances, respectively, and are split 80/20 for training and testing. Additional results on other datasets are provided in Appendix C.1. Evaluation Metrics As formalized in Sec. 3.1, we represent value orientation as a multi-dimensional value vector. First, we report Mean Absolute Error (MAE) between the predicted user value preferences and the value of preferred answers. Second, we compute Spearman’s rank correlation coefficient (Correlation) to measure the consistency of value priorities. Third, we report the Accuracy that the preferred responses are ranked higher than dispreferred responses. Detailed dataset construction, statistics, and metric definitions are provided in Appendix B. Baselines We compare BaCVA with baselines spanning non-personalized and inference-time personalized alignment. DirectAnswer directly generates responses using the generally aligned backbone model. For personalized value alignment, we mainly consider inference-time approaches that incorporate static user value profiles to steer answer generation, including four groups: (1) Value Prompt (Kang et al., 2024) prompts the value profile to steer outputs, COUPLE (Guo et al., 2026b) conducts counterfactual reasoning, and MetaAligner (Yang et al., 2024) rewrites model outputs to align them with target values; (2) PAD (Chen et al., 2024) and MOD (Shi et al., 2024) learn value-aware reward models to steer decoding-time token distribution towards personal values; (3) ValuesRAG (Seo et al., 2025) retrieves historical data under similar scenarios and value profiles as example for decision-making; and (4) PersonValue is implemented by us that directly compares the static value profiles with values extracted from the preferred respones. To further compare BaCVA with training-time alignment approaches, we additionally evaluate RLHF (Christiano et al., 2017) and MORLHF (Li et al., 2020) under the same backbone, data splits, and input information, with full implementation details and results provided in Appendix C.2. BaCVA dynamically estimates personalized values across varying contexts via posterior inference. Implementation details. We use Qwen3-8B as the backbone model across all comparable methods and control input as only personal value profile and question to ensure fair comparisons. The model for value extraction in both our model and evaluation is GPT-5-nano, whose consistency with humans has been verified, achieving a score >90>90. Unless otherwise specified, we use the 10 Schwartz Basic value dimensions to represent value profiles in the main experiments. Additional experiments on other value systems to validate the robustness are provided in Appendix C.1. All models are trained using the Adam optimizer. All experiments are conducted using NVIDIA A100 GPUs. Full implementation details, hyperparameters, and more experimental settings are in Appendix B. 4.2 Personalized Alignment Performance Tab. 1 presents the results comparing BaCVA with baselines on personalized value alignment across PRISM and GOOD, with three key findings. First, incorporating personalization is crucial for LLM value alignment. Across both benchmarks, personalized alignment methods such as Value Prompt, MOD and ValuesRAG substantially outperform the non-personalized baseline DirectAnswer. This observation demonstrates that personal value-agnostic alignment fails to capture the diversity of individual preferences. Second, static personal value profiles lead to sub-optimal personalized alignment. In particular, the PersonValue baseline, which enforces adherence to static personal values across varying prompts, achieves merely 56.56% accuracy on PRISM. This highlights a fundamental limitation that static personal values cannot faithfully represent users’ context-dependent preferences across diverse scenarios. Third, BaCVA, which explicitly integrates personal value profiles with scenario-specific value salience and optimizes toward posterior personalized preferences, achieves the best personalization result across both benchmarks. On PRISM, BaCVA attains the lowest MAE and the highest accuracy, while on GOOD it significantly improves both MAE and correlation. These consistent gains strongly validate our motivation in this paper and the effectiveness of our proposed method. Additionally, BaCVA also consistently outperforms the training-time alignment baselines reported in Appendix C.2. Human Evaluation Beyond automatic evaluation, we conduct a human study on 50 samples corresponding to 50 distinct user profiles, with each sample independently assessed by two evaluators, who compare how closely the contextual personalized values predicted by BaCVA and ValuesRAG mirror the values of the preferred answer. As shown in Fig. 3, BaCVA wins in 46.0% and loses in only 22.0% of cases, outperforming ValuesRAG. Details are provided in Appendix B.4. Figure 3: Performance of human evaluation PRISM GOOD Method MAE ↓ Corr ↑ Accuracy ↑ MAE ↓ Corr ↑ BaCVA 0.728 0.700 81.72 1.118 0.769 w/o Scenario-View 0.819 0.645 76.32 1.325 0.724 w/o Person-View 0.798 0.607 77.06 1.297 0.730 w/o Gated Fusion 0.762 0.671 79.44 1.163 0.754 w/o Prior Constraint 0.800 0.639 78.18 1.203 0.746 Table 2: Ablation study on PRISM and GOOD. 4.3 Ablation Study To systematically investigate the contribution of each component in BaCVA, we conduct an ablation study by removing or modifying key modules. (1) w/o Scenario-View and w/o Person-View approximate the posterior value preferences from only one of the dual perspectives. (2) w/o Gated Fusion replaces the adaptive gating mechanism with an averaged fusion of the two views across all contexts. (3) w/o Prior Constraint removes the KL divergence terms in Eq.(11). Tab. 2 reports the ablation results on PRISM and GOOD. Results Analysis Using merely a single view (i.e., w/o Scenario-View and w/o Person-View) consistently results in degraded performance on both benchmarks. This confirms that both views capture effective and complementary aspects for personalized alignment. Besides, removing the adaptive gating mechanism (w/o Gated Fusion) causes a performance drop. This demonstrates that the interaction between the two views is highly context-dependent rather than simply additive. The gated fusion is essential to distinguish their relative importance across different scenarios. Finally, the prior constraints of both personal values and scenario-specific value salience are also critical for personalized alignment by avoiding collapsed prediction. This also validates that both views provide meaningful prior knowledge. Figure 4: Fine-grained personalization on PRISM. Figure 5: Training efficiency analysis across datasets. Figure 6: Effects of the gated fusion on PRISM. 4.4 Analysis Experiments Fine-grained Adaptability Analysis We examine whether BaCVA captures fine-grained shifts from priors by grouping test samples according to the distance between the true preferred response value vycv_y_c and two priors: the personal prior vuv_u and the scenario prior vxv_x. A larger distance means that the final contextual preference deviates more from the corresponding prior, making the sample more challenging for conventional methods that simply follow the prior. As shown in Fig. 4(a), ValuesRAG performs well only when vycv_y_c is close to vuv_u, but degrades sharply as the distance increases, indicating its strong dependence on static personal values. In contrast, BaCVA remains stable across different distances from both priors. These results suggest that BaCVA can capture nuanced preference shifts to infer posterior preferences even when the context heavily conflicts with priors. Moreover, a complementary conflict-level analysis further shows that BaCVA reduces MAE by 17.8% relative to ValuesRAG on the high-conflict subset, where answer-level values deviate substantially from the global user profile (Appendix C.9). A cluster-level analysis on PRISM further confirms BaCVA’s domain-level robustness, with consistent MAE reductions across the five largest semantic clusters (Appendix C.3). Training Data Efficiency We evaluate data efficiency by training BaCVA with different proportions of PRISM and GOOD data. As shown in Fig. 5, BaCVA achieves strong performance with limited supervision and improves steadily as more data is used, whereas ValuesRAG converges more slowly and to a weaker final result. This indicates that BaCVA can learn effective value-alignment patterns in low-data regimes. Generalization to Cold-Start Users We further evaluate generalization to unseen users by splitting the PRISM test set into seen users and 20% cold-start users absent from training. As shown in Fig. 7, BaCVA shows a much smaller performance drop than ValuesRAG, demonstrating stronger robustness to unseen users. Figure 7: Generalizability evaluation on PRISM. Gated Fusion Analysis. BaCVA fuses the person-view and scenario-view through a context-aware gate. To verify whether the gate correctly identifies the more informative view across varying contexts, we split PRISM into personal-dominant cases, where vycv_y_c is closer to vuv_u than to vxv_x, and scenario-dominant cases. Fig. 6(a) shows that PersonValue performs competitively in personal-dominant settings but fails catastrophically when situational shifts occur, whereas DirectAnswer is opposite. BaCVA consistently performs best on both. Fig. 6(b) further shows that the gate assigns larger weights to the corresponding dominant view. Cross-Extractor Robustness Cross-extractor evaluation using independently constructed Gemini-3-Flash and Qwen3-235B-A22B test targets confirms that BaCVA’s gains are not tied to GPT-5-nano, yielding 21.2% lower MAE and 9.56 percentage points higher accuracy than ValuesRAG on average (Appendix C.6). 4.5 Hyper-parameter Analysis We provide a sensitivity analysis of the KL-divergence weight λ1 _1 in Appendix C.1. Besides, we further examine the robustness of BaCVA under different backbone LLMs as the value salience estimator, prompt designs, and value representations. Specifically, we evaluate BaCVA with value profiles represented by the 5-dim Moral Foundations Theory and the 301-dim value system from Daily-Dilemma. The consistent gains across these settings show that BaCVA is robust to both implementation choices and value-system variations. Meanwhile, to evaluate BaCVA’s generalizability across backbone models, we further implement it with Llama3-8B under the same experimental setting, where it reduces MAE by 37.9% and improves accuracy by 19.06 percentage points over ValuesRAG in Appendix C.8. To evaluate robustness across scenario-prior estimators, we compare GPT-5-nano, Gemini-3-Flash, and Qwen3-235B-A22B, obtaining an average within-one agreement of 89.15% and a standard deviation of only 0.027 in downstream PRISM MAE in Appendix C.7. To assess whether BaCVA training degrades general-purpose capabilities, we evaluate the original backbone and BaCVA on four standard benchmarks, obtaining comparable average performance of 77.69% and 78.74%, respectively (Appendix C.10). 4.6 Downstream Application Furthermore, we evaluate the effectiveness of our inferred posterior values in guiding downstream personalized response generation using the PRISM dataset. We implement two variants for generation: (1) BaCVA (Two-stage) applies the posterior personalized values estimated by BaCVA as the input and trains a downstream response generator. (2) BaCVA-E2E jointly optimizes the BaCVA for posterior value inference with subsequent response generator. Here, MAE, Spearman correlation, and pairwise ranking accuracy are computed under the answer-level protocol detailed in Appendix C.5. As shown in Tab. 3, BaCVA-E2E achieves the best overall performance, slightly outperforming the two-stage BaCVA. Moreover, qualitative cases in Appendix C.5 further show that BaCVA-E2E can generate coherent value-grounded responses, whereas ValuePrompt often fails. Method MAE ↓ Acc ↑ Spearman ↑ DirectAnswer 1.1794 0.3226 0.2483 ValuePrompt 0.9897 0.4892 0.3121 COUPLE 0.5596 0.6434 0.4432 MetaAligner 0.7787 0.5125 0.4010 PAD 0.6444 0.5341 0.4463 MOD 0.6707 0.5448 0.4013 ValuesRAG 0.6229 0.5529 0.4596 BaCVA (Two-stage) 0.3835 0.7975 0.4782 BaCVA-E2E 0.3776 0.7996 0.4812 Table 3: Results of downstream personalized response generation on PRISM. Bold indicates the best results. 5 Conclusion To overcome the limitation that current personalized value alignment relies on static user value profiles, BaCVA treats personal values and context-specific value salience as priors and infers posterior personalized values at inference time. Experiments validate improved personalization accuracy, adaptability, data efficiency, and generalization. Limitations Although BaCVA achieves promising performance on personalized value alignment across two benchmarks, this work still has several limitations. First, the evaluation method may introduce noise, as it relies on user preferences annotated over a limited set of candidate responses, which may not fully capture the faithful user values but only compromised preferences. Moreover, our experiments are primarily conducted on offline datasets; although human evaluation is included, the approach lacks validation through large-scale real-world or online deployment. Second, the cross-dataset generalization of our model remains an important aspect to be further validated. Third, the datasets we used for evaluation contain users’ self-reported value profiles, which may be noisy as users may consciously or unconsciously curate, simplify, or embellish their profiles. Last, the estimator remains an aligned-LLM approximation of population-level value salience, which future work may improve with more diverse models, alignment strategies, and cultural assumptions. In future work, we plan to address these limitations by exploring more realistic and comprehensive evaluation settings, investigating cross-dataset generalization, and developing more robust mechanisms to model and mitigate noise in user-provided information. Ethical Considerations This work aims to improve personalized value alignment in large language models; however, the inferred “value preferences” reflect latent patterns captured from observed interactions and annotations, and should be viewed as approximate rather than complete representations of human values. It should not be used to directly judge individuals or replace human ethical decision-making. Personalized value modeling may also involve privacy and bias risks. Therefore, any real-world deployment should strictly follow data protection regulations, avoid manipulative or unethical uses, and be continuously evaluated within a responsible AI framework. Acknowledgments This work was supported by the Beijing Nova Program (Grant No. 202604841294). References Achiam et al. (2023) J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774. Cited by: §1. Bai et al. (2022a) Y. Bai, A. Jones, K. Ndousse, A. Askell, A. Chen, N. DasSarma, D. Drain, S. Fort, D. Ganguli, T. Henighan, et al. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862. Cited by: §1, §2. Bai et al. (2022b) Y. Bai, S. Kadavath, S. Kundu, A. Askell, J. Kernion, A. Jones, A. Chen, A. Goldie, A. Mirhoseini, C. McKinnon, et al. Constitutional ai: harmlessness from ai feedback. arXiv preprint arXiv:2212.08073. Cited by: §2. Bishop and Tipping (2013) C. M. Bishop and M. Tipping Variational relevance vector machines. External Links: 1301.3838, Link Cited by: §2. Blei et al. (2017) D. M. Blei, A. Kucukelbir, and J. D. McAuliffe Variational inference: a review for statisticians. Journal of the American statistical Association 112 (518), p. 859–877. Cited by: §1, §2, §3.2. Burnes* (2004) B. Burnes* Kurt lewin and complexity theories: back to the future?. Journal of change management 4 (4), p. 309–325. Cited by: §1. Chen et al. (2025a) D. Chen, Y. Chen, A. Rege, Z. Wang, and R. K. Vinayak PAL: sample-efficient personalized reward modeling for pluralistic alignment. In The Thirteenth International Conference on Learning Representations, Cited by: §2. Chen et al. (2024) R. Chen, X. Zhang, M. Luo, W. Chai, and Z. Liu Pad: personalized alignment of llms at decoding-time. arXiv preprint arXiv:2410.04070. Cited by: §1, §2, §4.1. Chen et al. (2025b) Y. Chen, X. Liu, R. Wang, Z. Li, P. Chen, C. Yu, P. Nigam, M. Jiang, and B. Yin POPI: personalizing llms via optimized natural language preference inference. arXiv preprint arXiv:2510.17881. Cited by: §1, §2. Chiu et al. (2024) Y. Y. Chiu, L. Jiang, and Y. Choi Dailydilemmas: revealing value preferences of llms with quandaries of daily life. arXiv preprint arXiv:2410.02683. Cited by: §C.2. Choi et al. (2025) Y. Choi, S. Cho, M. Lee, M. Park, Y. Ko, J. Ok, and D. Kim CoPL: collaborative preference learning for personalizing llms. arXiv preprint arXiv:2503.01658. Cited by: §2. Christiano et al. (2017) P. F. Christiano, J. Leike, T. Brown, M. Martic, S. Legg, and D. Amodei Deep reinforcement learning from human preferences. Advances in neural information processing systems 30. Cited by: §4.1. Cialdini et al. (1990) R. B. Cialdini, R. R. Reno, and C. A. Kallgren A focus theory of normative conduct: recycling the concept of norms to reduce littering in public places.. Journal of personality and social psychology 58 (6), p. 1015. Cited by: §1. Clark et al. (2019) C. Clark, K. Lee, M. Chang, T. Kwiatkowski, M. Collins, and K. Toutanova Boolq: exploring the surprising difficulty of natural yes/no questions. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), p. 2924–2936. Cited by: §C.10. Clark et al. (2018) P. Clark, I. Cowhey, O. Etzioni, T. Khot, A. Sabharwal, C. Schoenick, and O. Tafjord Think you have solved question answering? try arc, the ai2 reasoning challenge. arXiv preprint arXiv:1803.05457. Cited by: §C.10. Epstein and O’Brien (1985) S. Epstein and E. J. O’Brien The person–situation debate in historical and current perspective.. Psychological bulletin 98 (3), p. 513. Cited by: §1. Ethayarajh et al. (2024) K. Ethayarajh, W. Xu, N. Muennighoff, D. Jurafsky, and D. Kiela Kto: model alignment as prospect theoretic optimization. arXiv preprint arXiv:2402.01306. Cited by: §2. Feng et al. (2025) Y. Feng, B. Zhou, W. Lin, and D. Roth BIRD: a trustworthy bayesian inference framework for large language models. External Links: 2404.12494, Link Cited by: §2. Ganguly and Earp (2021) A. Ganguly and S. W. Earp An introduction to variational inference. arXiv preprint arXiv:2108.13083. Cited by: §2. Gao et al. (2024) Y. Gao, G. Xu, Z. Wang, and A. Cohan Bayesian calibration of win rate estimation with llm evaluators. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, p. 4757–4769. External Links: Link, Document Cited by: §2. Gao et al. (2023) Y. Gao, Y. Xiong, X. Gao, K. Jia, J. Pan, Y. Bi, Y. Dai, J. Sun, H. Wang, and H. Wang Retrieval-augmented generation for large language models: a survey. arXiv preprint arXiv:2312.10997 2 (1). Cited by: §2. Grossman and Domingos (2004) D. Grossman and P. M. Domingos Learning bayesian network classifiers by maximizing conditional likelihood. Proceedings of the twenty-first international conference on Machine learning. External Links: Link Cited by: §2. Guo et al. (2025a) D. Guo, D. Yang, H. Zhang, J. Song, R. Zhang, R. Xu, Q. Zhu, S. Ma, P. Wang, X. Bi, et al. Deepseek-r1: incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948. Cited by: §1. Guo et al. (2026a) H. Guo, J. Lian, and X. Zhou Why not collaborative filtering in dual view? bridging sparse and dense models. ACM Transactions on Information Systems 44 (3), p. 1–24. Cited by: §1. Guo et al. (2025b) H. Guo, Y. Ma, and X. Zhou Sorex: towards self-explainable social recommendation with relevant ego-path extraction. ACM Transactions on Information Systems 44 (2), p. 1–27. Cited by: §1. Guo et al. (2026b) H. Guo, J. Yao, X. Zhou, X. Yi, and X. Xie Counterfactual reasoning for steerable pluralistic value alignment of large language models. Advances in Neural Information Processing Systems 38, p. 122128–122169. Cited by: §B.4, §1, §2, §3.1, §4.1. Gupta et al. (2025) R. Gupta, R. Corona, J. Ge, E. Wang, D. Klein, T. Darrell, and D. M. Chan Enough coin flips can make llms act bayesian. External Links: 2503.04722, Link Cited by: §2. Han et al. (2025) X. Han, J. Yang, T. Wang, Z. Bi, X. Song, J. Hao, and J. Song Towards alignment-centric paradigm: a survey of instruction tuning in large language models. arXiv preprint arXiv:2508.17184. Cited by: §2. Heckerman et al. (2015) D. Heckerman, D. Geiger, and D. M. Chickering Learning bayesian networks: the combination of knowledge and statistical data. External Links: 1302.6815, Link Cited by: §2. Heidbreder (1937) E. Heidbreder Lewin’s principles of topological psychology.. Cited by: §1, §3.2. Hendrycks et al. (2020) D. Hendrycks, C. Burns, S. Basart, A. Critch, J. Li, D. Song, and J. Steinhardt Aligning ai with shared human values. arXiv preprint arXiv:2008.02275. Cited by: §1. Jin et al. (2025) X. Jin, Z. Li, Z. Dai, H. Liu, X. Tang, C. Luo, R. Goutam, X. Ren, and Q. He In-context personalized alignment with feedback history under counterfactual evaluation. In 2nd Workshop on Models of Human Feedback for AI Alignment, External Links: Link Cited by: §2. Kang et al. (2024) Y. Kang, J. Wang, Y. Li, F. Zhong, X. Feng, M. Wang, W. Tu, Q. Wang, H. Li, and Z. Zheng Causal graph guided steering of llm values via prompts and sparse autoencoders. arXiv preprint arXiv:2501.00581. Cited by: §2, §4.1. Kirk et al. (2024) H. R. Kirk, A. Whitefield, P. Rottger, A. M. Bean, K. Margatina, R. Mosquera-Gomez, J. Ciro, M. Bartolo, A. Williams, H. He, et al. The prism alignment dataset: what participatory, representative and individualised human feedback reveals about the subjective and multicultural alignment of large language models. Advances in Neural Information Processing Systems 37, p. 105236–105344. Cited by: 1st item, §B.1, §B.1.1, §C.5, §4.1. Lauritzen and Spiegelhalter (1990) S. L. Lauritzen and D. J. Spiegelhalter Local computations with probabilities on graphical structures and their application to expert systems. Journal of the royal statistical society series b-methodological 50, p. 415–448. External Links: Link Cited by: §2. Lazarus and Folkman (1984) R. S. Lazarus and S. Folkman Stress, appraisal, and coping. Springer publishing company. Cited by: §3.2. Lewis et al. (2020) P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W. Yih, T. Rocktäschel, et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in neural information processing systems 33, p. 9459–9474. Cited by: §2. Li et al. (2025a) J. Li, J. Guan, S. Wu, W. Wu, and R. Yan From 1,000,000 users to every user: scaling up personalized preference for user-level alignment. arXiv preprint arXiv:2503.15463. Cited by: §C.2. Li et al. (2020) K. Li, T. Zhang, and R. Wang Deep reinforcement learning for multiobjective optimization. IEEE transactions on cybernetics 51 (6), p. 3103–3114. Cited by: §4.1. Li et al. (2025b) L. Li, X. Zhang, X. Zhou, and Z. Liu AutoMIR: effective zero-shot medical information retrieval without relevance labels. In Findings of the Association for Computational Linguistics: EMNLP 2025, C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng (Eds.), Suzhou, China, p. 24028–24047. External Links: Link, Document, ISBN 979-8-89176-335-7 Cited by: §1. Li et al. (2024) X. Li, R. Zhou, Z. C. Lipton, and L. Leqi Personalized language modeling from personalized human feedback. arXiv preprint arXiv:2402.05133. Cited by: §2. Liu et al. (2024) O. Liu, D. Fu, D. Yogatama, and W. Neiswanger Dellma: decision making under uncertainty with large language models. arXiv preprint arXiv:2402.02392. Cited by: §2. Longjohn et al. (2025) R. Longjohn, S. Wu, S. Kher, C. Belém, and P. Smyth Bayesian evaluation of large language model behavior. arXiv preprint arXiv:2511.10661. Cited by: §2. Meng et al. (2024) Y. Meng, M. Xia, and D. Chen Simpo: simple preference optimization with a reference-free reward. Advances in Neural Information Processing Systems 37, p. 124198–124235. Cited by: §2. Mischel (2013) W. Mischel Personality and assessment. Psychology Press. Cited by: §1. Ouyang et al. (2022) L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, et al. Training language models to follow instructions with human feedback. Advances in neural information processing systems 35, p. 27730–27744. Cited by: §1, §2. Pădurean et al. (2025) V. Pădurean, P. Kamalaruban, N. Kotalwar, A. Gotovos, and A. Singla Inference-time personalized alignment with a few user preference queries. arXiv preprint arXiv:2511.02966. Cited by: §1, §2. Poddar et al. (2024) S. Poddar, Y. Wan, H. Ivison, A. Gupta, and N. Jaques Personalizing reinforcement learning from human feedback with variational preference learning. Advances in Neural Information Processing Systems 37, p. 52516–52544. Cited by: §1, §2. Rafailov et al. (2023) R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn Direct preference optimization: your language model is secretly a reward model. Advances in Neural Information Processing Systems 36, p. 53728–53741. Cited by: §2. Ryan et al. (2025) M. J. Ryan, O. Shaikh, A. Bhagirath, D. Frees, W. B. Held, and D. Yang Synthesizeme! inducing persona-guided prompts for personalized reward models in llms. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), p. 8045–8078. Cited by: §1, §2. Sakaguchi et al. (2021) K. Sakaguchi, R. L. Bras, C. Bhagavatula, and Y. Choi Winogrande: an adversarial winograd schema challenge at scale. Communications of the ACM 64 (9), p. 99–106. Cited by: §C.10. Schwartz (2012) S. H. Schwartz An overview of the schwartz theory of basic values. Online readings in Psychology and Culture 2 (1), p. 11. Cited by: §3.1. Seo et al. (2025) W. Seo, Z. Yuan, and Y. Bu ValuesRAG: enhancing cultural alignment through retrieval-augmented contextual learning. External Links: 2501.01031, Link Cited by: §2, §4.1. Shen et al. (2023) T. Shen, R. Jin, Y. Huang, C. Liu, W. Dong, Z. Guo, X. Wu, Y. Liu, and D. Xiong Large language model alignment: a survey. arXiv preprint arXiv:2309.15025. Cited by: §1, §2. Shi et al. (2024) R. Shi, Y. Chen, Y. Hu, A. Liu, H. Hajishirzi, N. A. Smith, and S. S. Du Decoding-time language model alignment with multiple objectives. Advances in Neural Information Processing Systems 37, p. 48875–48920. Cited by: §1, §2, §4.1. Thonet et al. (2025) T. Thonet, G. Kruszewski, J. Rozen, P. Erbacher, and M. Dymetman FaST: feature-aware sampling and tuning for personalized preference alignment with limited data. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, p. 9352–9381. Cited by: §2. Touvron et al. (2023) H. Touvron, T. Lavril, G. Izacard, X. Martinet, M. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar, et al. Llama: open and efficient foundation language models. arXiv preprint arXiv:2302.13971. Cited by: §1. Tzikas et al. (2008) D. G. Tzikas, A. C. Likas, and N. P. Galatsanos The variational approximation for bayesian inference. IEEE Signal Processing Magazine 25 (6), p. 131–146. Cited by: §1, §2. Wang et al. (2024a) J. Wang, H. Wang, S. Sun, and W. Li Aligning language models with human preferences via a bayesian approach. External Links: 2310.05782, Link Cited by: §2. Wang et al. (2024b) X. Wang, S. Duan, X. Yi, J. Yao, S. Zhou, Z. Wei, P. Zhang, D. Xu, M. Sun, and X. Xie On the essence and prospect: an investigation of alignment approaches for big models. arXiv preprint arXiv:2403.04204. Cited by: §1. Wang et al. (2019) X. Wang, W. Shi, R. Kim, Y. Oh, S. Yang, J. Zhang, and Z. Yu Persuasion for good: towards a personalized persuasive dialogue system for social good. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, A. Korhonen, D. Traum, and L. Màrquez (Eds.), Florence, Italy, p. 5635–5649. External Links: Link, Document Cited by: 2nd item, §B.1, §4.1. Wang et al. (2023) Y. Wang, W. Zhong, L. Li, F. Mi, X. Zeng, W. Huang, L. Shang, X. Jiang, and Q. Liu Aligning large language models with human: a survey. arXiv preprint arXiv:2307.12966. Cited by: §1, §2. Yang et al. (2025) A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388. Cited by: §1. Yang et al. (2024) K. Yang, Z. Liu, Q. Xie, J. Huang, T. Zhang, and S. Ananiadou Metaaligner: towards generalizable multi-objective alignment of language models. arXiv preprint arXiv:2403.17141. Cited by: §4.1. Yao et al. (2023a) J. Yao, X. Yi, X. Wang, Y. Gong, and X. Xie Value fulcra: mapping large language models to the multidimensional spectrum of basic human values. arXiv preprint arXiv:2311.10766. Cited by: §3.1. Yao et al. (2023b) J. Yao, X. Yi, X. Wang, J. Wang, and X. Xie From instructions to intrinsic human values–a survey of alignment goals for big models. arXiv preprint arXiv:2308.12014. Cited by: §1, §2. Yong et al. (2025a) X. Yong, J. Lian, X. Yi, X. Zhou, and X. Xie MotiveBench: how far are we from human-like motivational reasoning in large language models?. In Findings of the Association for Computational Linguistics, ACL 2025, Vienna, Austria, July 27 - August 1, 2025, W. Che, J. Nabende, E. Shutova, and M. T. Pilehvar (Eds.), Findings of ACL, Vol. ACL 2025, p. 20059–20089. External Links: Link, Document Cited by: §1. Yong et al. (2026) X. Yong, P. Sun, Z. Wang, and X. Zhou Intelli-planner: towards customized urban planning via large language model empowered reinforcement learning. In Proceedings of the ACM Web Conference 2026, W 2026, Dubai, United Arab Emirates, originally scheduled for April 13-17, 2026, rescheduled for June 29 - July 3, 2026, H. Hacid, Y. Maarek, F. Bonchi, I. Guy, and E. Yilmaz (Eds.), p. 9385–9396. External Links: Link, Document Cited by: §1. Yong et al. (2025b) X. Yong, X. Zhou, Y. Zhang, J. Li, Y. Zheng, and X. Wu Think or not? exploring thinking efficiency in large reasoning models via an information-theoretic lens. In Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, NeurIPS 2025, San Diego, CA, USA, December 2-7, 2025 / Mexico City, Mexico, November 30 - December 5, 2025, D. Belgrave, C. Zhang, L. N. Montoya, H. Lin, R. Pascanu, P. Koniusz, M. Ghassemi, N. Chen, I. V. M. Ruíz, and A. Loaiza-Bonilla (Eds.), External Links: Link Cited by: §1. Zellers et al. (2019) R. Zellers, A. Holtzman, Y. Bisk, A. Farhadi, and Y. Choi Hellaswag: can a machine really finish your sentence?. In Proceedings of the 57th annual meeting of the association for computational linguistics, p. 4791–4800. Cited by: §C.10. Zhang and Poole (1996) N. L. Zhang and D. Poole Exploiting causal independence in bayesian network inference. External Links: cs/9612101, Link Cited by: §2. Zhang et al. (2023) S. Zhang, L. Dong, X. Li, S. Zhang, X. Sun, S. Wang, J. Li, R. Hu, T. Zhang, G. Wang, et al. Instruction tuning for large language models: a survey. ACM Computing Surveys. Cited by: §2. Zhang et al. (2026a) X. Zhang, L. Li, X. Zhou, and Z. Liu R2MED: a benchmark for reasoning-driven medical retrieval. External Links: 2505.14558, Link Cited by: §1. Zhang et al. (2026b) X. Zhang, L. Li, Y. Zhou, X. Zhou, Y. Zhang, and X. Wu Inflated excellence or true performance? rethinking medical diagnostic benchmarks with dynamic evaluation. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), M. Liakata, V. P. Moreira, J. Zhang, and D. Jurgens (Eds.), San Diego, California, United States, p. 26454–26493. External Links: Link, Document, ISBN 979-8-89176-390-6 Cited by: §1. Zhang et al. (2026c) X. Zhang, J. Wang, Q. Zhao, H. Guo, L. Li, J. Yao, X. Zhou, X. Yi, and X. Xie Human values matter: investigating how misalignment shapes collective behaviors in llm agent communities. External Links: 2604.05339, Link Cited by: §1. Zhang et al. (2026d) X. Zhang, X. Zhou, H. Xu, and J. Lian HypeMed: enhancing medication recommendations with hypergraph-based patient relationships. ACM Trans. Inf. Syst. 44 (4). External Links: ISSN 1046-8188, Link, Document Cited by: §1. Zhang et al. (2025a) X. Zhang, R. Chen, Y. Feng, and Z. Liu Persona-judge: personalized alignment of large language models via token-level self-judgment. arXiv preprint arXiv:2504.12663. Cited by: §1, §2. Zhang et al. (2025b) Y. Zhang, D. Adila, C. Shin, and F. Sala Personalize your llm: fake it then align it. arXiv preprint arXiv:2503.01048. Cited by: §1. Zhao et al. (2024) P. Zhao, H. Zhang, Q. Yu, Z. Wang, Y. Geng, F. Fu, L. Yang, W. Zhang, J. Jiang, and B. Cui Retrieval-augmented generation for ai-generated content: a survey. arXiv preprint arXiv:2402.19473. Cited by: §2. Zhao et al. (2025) W. Zhao, X. Sui, Y. Hu, J. Guo, H. Liu, B. Li, Y. Zhao, B. Qin, and T. Liu Teaching language models to evolve with users: dynamic profile modeling for personalized alignment. arXiv preprint arXiv:2505.15456. Cited by: §1, §2. Zhou et al. (2025) X. Zhou, Z. Zhao, and H. Guo Tricolore: multi-behavior user profiling for enhanced candidate generation in recommender systems. IEEE Transactions on Knowledge and Data Engineering 37 (7), p. 4349–4360. Cited by: §1. Zhu et al. (2024) M. Zhu, Y. Weng, L. Yang, and Y. Zhang Personality alignment of large language models. arXiv preprint arXiv:2408.11779. Cited by: §1, §2. Zhu et al. (2026) Y. Zhu, S. Duan, X. Zhang, J. Sang, P. Zhang, T. Lu, X. Zhou, J. Yao, X. Yi, and X. Xie MoHoBench: assessing honesty of multimodal large language models via unanswerable visual questions. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 40, p. 29205–29213. Cited by: §1. Appendix A Method Details A.1 Generic ELBO for Personalized Value Inference Setup For a user u and a question (scenario) x, let uv_u denote the user-level value profile, and let u,xv_u,x denote the latent question-specific personalized values. Given a preference triple (x,yc,yr)(x,y_c,y_r), we denote the observed preference event as o:=(yc≻yr),o:=(y_c y_r), (12) i.e., response ycy_c is preferred over yry_r under scenario x. Bayesian formulation We define a prior conditioned on both the user and scenario: pθ(u,x∣u,x),p_θ(v_u,x _u,x), (13) and a preference likelihood pθ(o∣u,x,x)=pθ(yc≻yr∣u,x,x).p_θ(o _u,x,x)\;\;=\;\;p_θ(y_c y_r _u,x,x). (14) By Bayes’ rule, the posterior is pθ(u,x∣u,x,o)=pθ(o∣u,x)pθ(u,x∣u,x)pθ(o), p_θ(v_u,x _u,x,o)= p_θ(o _u,x)\,p_θ(v_u,x _u,x)p_θ(o), (15) which matches Eq. (1) in the main paper. Marginal likelihood The likelihood o:=(yc≻yr)o:=(y_c y_r) marginalizes over the latent personalized values u,xv_u,x: pθ(o) p_θ(o) =∫pθ(o∣u,x,x) = p_θ(o _u,x,x) (16) × × pθ(u,x∣u,x)du,x. p_θ(v_u,x _u,x)\,dv_u,x. (17) In our setting, computing Eq. (16) is intractable. Since u,xv_u,x is a multi-dimensional value vector and each dimension corresponds to a 5-point Likert score, exact marginalization would require an exponential-time summation and is prohibitively expensive. This motivates us to employ variational inference to obtain a tractable lower bound for optimization. Variational posterior and ELBO. We introduce a variational posterior qϕ(u,x∣u,x)q_φ(v_u,x _u,x) to approximate the true posterior pθ(u,x∣u,,o)p_θ(v_u,x _u,x,o). Thus, we solve the optimization problem as: ϕ φ =argminϕ⁡KL(qϕ(u,x∣u,x)CLOSE = *arg\,min_φ\;KL (q_φ(v_u,x _u,x) (18) ∥pθ(u,x∣u,x,o)). \|\;p_θ(v_u,x _u,x,o) ). In the following derivation, let :=u,xz:=v_u,x and use the abbreviations qϕ() q_φ(z) :=qϕ(∣u,x), :=q_φ(z _u,x), pθ() p_θ(z) :=pθ(∣u,x). :=p_θ(z _u,x). For brevity, we suppress the conditioning on (u,x)(v_u,x) below. KL(qϕ()∥pθ(∣o)) (q_φ(z)\, \|\,p_θ(z o) ) =∫qϕ()log⁡qϕ()pθ(∣o) = q_φ(z) q_φ(z)p_θ(z o)\,dz =∫qϕ()[log⁡qϕ()−log⁡pθ(∣o)] = q_φ(z) [ q_φ(z)- p_θ(z o) ]\,dz =∫qϕ()[log⁡qϕ()−log⁡pθ(,o)] = q_φ(z) [ q_φ(z)- p_θ(z,o) ]\,dz +log⁡pθ(o) + p_θ(o) =log⁡pθ(o) = p_θ(o) −∫qϕ()[logpθ(,o)−logqϕ()]d. - q_φ(z) [ p_θ(z,o)- q_φ(z) ]\,dz. (19) We use ℒ⁡(qϕ)L(q_φ) to represent the following term as: ℒ⁡(qϕ) (q_φ) =∫qϕ[logpθ(u,x,o) = q_φ [ p_θ(v_u,x,o) −logqϕ(u,x)]du,x - q_φ(v_u,x) ]\,dv_u,x =qϕ[logpθ(u,x,o) =E_q_φ [ p_θ(v_u,x,o) −logqϕ(u,x)]. - q_φ(v_u,x) ]. (20) Based on Eq.(19) and Eq.(20), we then obtain KL(qϕ(u,x)||pθ(u,x∣o))=logpθ(o)−ℒ(qϕ) (q_φ(v_u,x)||p_θ(v_u,x o))= p_θ(o)-L(q_φ) (21) logpθ(o)=ℒ(qϕ)+KL(qϕ(u,x)||pθ(u,x∣o)). p_θ(o)=L(q_φ)+KL(q_φ(v_u,x)||p_θ(v_u,x o)). (22) Since log⁡pθ(o) p_θ(o) is fixed on the observed data, minimizing the KL divergence in Eq.(19) is equivalent to maximizing ℒ⁡(qϕ)L(q_φ), which is the evidence lower bound (ELBO) of log⁡pθ(o) p_θ(o). ℒ⁡(qϕ) (q_φ) =qϕ[logpθ(u,x,o) =E_q_φ [ p_θ(v_u,x,o) −logqϕ(u,x)] - q_φ(v_u,x) ] =qϕ[logpθ(o|vu,x)+logpθ(vu,x) =E_q_φ [ p_θ(o|v_u,x)+ p_θ(v_u,x) −logqϕ(u,x)] - q_φ(v_u,x) ] =qϕ[log⁡pθ(o|vu,x)] =E_q_φ [ p_θ(o|v_u,x) ] −qϕ[log⁡qϕ(u,x)−log⁡pθ(vu,x)] -E_q_φ [ q_φ(v_u,x)- p_θ(v_u,x) ] =qϕ[log⁡pθ(o|vu,x)] =E_q_φ [ p_θ(o|v_u,x) ] −KL(qϕ(u,x)||pθ(vu,x)). -KL (q_φ(v_u,x)||p_θ(v_u,x) ). (23) Converting to the training loss, we need to minimize the loss ℒL as follows: ℒ =−qϕ[log⁡pθ(o|vu,x)] =-E_q_φ [ p_θ(o|v_u,x) ] +KL(qϕ(u,x)||pθ(vu,x)), +KL (q_φ(v_u,x)||p_θ(v_u,x) ), (24) which is Eq.(2) in the main paper. A.2 Concrete Formulation Setup. For a user u and a question x, let uv_u be the user-level value profile (Sec. 3.1), xv_x be the scenario value-salience variable estimated from (x,yhuman)(x,y_human) (Sec. 3.3), and u,xv_u,x be the question-specific personalized values. Given a preference triple (x,yc,yr)(x,y_c,y_r), we extract the value vector reflected by both the preferred and dispreferred responses as vyc,vyrv_y_c,v_y_r. Generative model (hierarchical prior). We use the estimated value salience distribution pω(x∣x,yhuman)p_ω(v_x x,y_human) and a user-conditioned prior pθ(u,x∣u,x)p_θ(v_u,x _u,v_x). We further introduce a (single-point) observation model for the extracted value embedding: pθ(yc∣u,x).p_θ(v_y_c _u,x). (25) The resulting marginal likelihood is log⁡p⁡(yc∣u,x) p(v_y_c _u,x) =log∑x∑u,xpθ(yc∣u,x) = _v_x _v_u,xp_θ(v_y_c _u,x) (26) ⋅pθ(u,x∣u,x) · p_θ(v_u,x _u,v_x) ⋅pω(x∣x,yhuman). · p_ω(v_x x,y_human). A.3 Prompt Template We present below the prompts used in this paper, including the data preprocessing prompt, the method prompt, and the evaluation prompt. A.3.1 Preprocessing Prompt This stage involves four preprocessing prompts: (1) extracting the user value profile in Fig. 8, (2) determining whether a given question involves value-related considerations in Fig. 9, (3) identifying which values are implicated by the question in Fig. 10, and (4) extracting value-related representations from candidate answers in Fig. 11. Prompt: Schwartz Basic Human Values Evaluation on Personal Profile. Background: You are an AI assistant tasked with evaluating how strongly Schwartz’s basic human values are reflected in a given personal description. The input text is a self-description written by a person, and your goal is to infer how strongly each of the ten Schwartz values appears in what the person expresses, implies, or emphasizes. Schwartz’s Ten Basic Values: Self-direction — independent thought and action; choosing, creating, exploring Stimulation — excitement, novelty, and challenge in life Hedonism — pleasure or sensuous gratification for oneself Achievement — personal success through demonstrating competence according to social standards Power — social status and prestige, control or dominance over people and resources Security — safety, harmony, and stability of society, relationships, and of self Conformity — restraint of actions, inclinations, and impulses that may upset or harm others or violate social expectations Tradition — respect, commitment, and acceptance of cultural or religious customs and ideas Benevolence — preserving and enhancing the welfare of people with whom one is in frequent personal contact Universalism — understanding, appreciation, tolerance, and protection for the welfare of all people and for nature Scoring Scale (1–5): 1 (Contradicted) — The text denies, criticizes, or opposes this value. 2 (Absent) — The value is not mentioned, implied, or relevant in any way. 3 (Mentioned but Not Important) — The value is referenced or implied, but it is not meaningful to the person’s identity or motivations. 4 (Present but Not Central) — The value seems to matter to the person and influences their perspective, but it is not central. 5 (Most Important) — The value is central to the person’s identity or worldview. Removing it would significantly change their self-description. Task: Evaluate the following personal self-description and rate how strongly each of the ten Schwartz values is reflected in it. Input Text: "personal_text Output Format (STRICT): Rate all ten values using only integers 1–5. Output ONLY in the following format:Self-direction: [score] Stimulation: [score] Hedonism: [score] Achievement: [score] Power: [score] Security: [score] Conformity: [score] Tradition: [score] Benevolence: [score] Universalism: [score] Figure 8: Schwartz basic human values evaluation on personal profile prompt. Prompt: Schwartz Value Candidate Identification. Background: You are an AI assistant that identifies which Schwartz basic human values are relevant to a given text. Your task is to determine which values are implied, expressed, or thematically connected to the provided text_type, and output them in a structured JSON format. Schwartz’s Ten Basic Values: Self-direction — independent thought and action; choosing, creating, exploring Stimulation — excitement, novelty, and challenge in life Hedonism — pleasure or sensuous gratification for oneself Achievement — personal success through demonstrating competence according to social standards Power — social status and prestige, control or dominance over people and resources Security — safety, harmony, and stability of society, relationships, and of self Conformity — restraint of actions, inclinations, and impulses that may upset or harm others or violate social expectations Tradition — respect, commitment, and acceptance of cultural or religious customs and ideas Benevolence — preserving and enhancing the welfare of people with whom one is in frequent personal contact Universalism — understanding, appreciation, tolerance, and protection for the welfare of all people and for nature Identify up to 5 relevant Schwartz values for the text_type. Use only these keys:[’self_direction’, ’stimulation’, ’hedonism’, ’achievement’, ’power’, ’security’, ’conformity’, ’tradition’, ’benevolence’, ’universalism’] For each selected value, provide a relevance score between 0 and 1. Output Format (STRICT JSON ONLY): Return only valid JSON in exactly the following structure:"candidates":[ "value":"<one_of_keys>","relevance":0.0-1.0 ] Figure 9: Prompt for Schwartz value candidate identification of question. Prompt: Prompt: Value-Related Question Identification. Background: You are an expert in Schwartz’s Theory of Basic Human Values. Your task is to determine whether a given question or statement is related to human values. A question is value-related if it reflects moral priorities, ethical considerations, social judgments, or underlying motivational principles connected to Schwartz’s ten basic values. Schwartz’s Ten Basic Human Values: "value definition A question is considered value-related if: • It asks about moral or ethical choices. • It involves trade-offs between different priorities (e.g., personal gain vs. helping others). • It touches on topics such as fairness, freedom, security, achievement, pleasure, tradition, caring for others, or environmental protection. • It asks opinions about social, political, or personal matters that reflect underlying values. • It involves decision-making influenced by value priorities. A question is NOT value-related if: • It is purely factual. • It is a technical or procedural question. • It asks for objective information without value judgment. Input Question: "question Output Requirement: Respond with ONLY: True — if the question is value-related. False — if the question is not value-related. Figure 10: Prompt for value-related question identification. Prompt: Answer Values Evaluation. Background: You are an AI assistant tasked with evaluating how strongly Schwartz’s basic human values are reflected in a given personal description. The input text is a self-description written by a person, and your goal is to infer how strongly each of the ten Schwartz values appears in what the person expresses, implies, or emphasizes. Schwartz’s Ten Basic Values: "value definition Scoring Scale (1–5): 1 (Contradicted) — The text denies, criticizes, or opposes this value. 2 (Absent) — The value is not mentioned, implied, or relevant in any way. 3 (Mentioned but Not Important) — The value is referenced or implied, but it is not meaningful to the person’s identity or motivations. 4 (Present but Not Central) — The value seems to matter to the person and influences their perspective, but it is not central. 5 (Most Important) — The value is central to the person’s identity or worldview. Removing it would significantly change their self-description. Task: Evaluate the following personal self-description and rate how strongly each of the ten Schwartz values is reflected in it. Input Text: "text Output Format (STRICT): Rate all ten values using only integers 1–5. Output ONLY in the following format:Self-direction: [score] Stimulation: [score] Hedonism: [score] Achievement: [score] Power: [score] Security: [score] Conformity: [score] Tradition: [score] Benevolence: [score] Universalism: [score] Figure 11: Prompt for answer value evaluation. A.3.2 Methods Prompt View-Specific Residual Inference Prompts To instantiate the residual distributions q⁡()q(z_u) and q⁡()q(z_x) in Eq. (6) and Eq. (8), we implicitly estimate the residual corrections conditioned on the triplet (x,x,ui)(x,v_x,v_u_i). Rather than explicitly sampling z, we adopt a prompt-based inference strategy in Fig. 12 to enable the model to capture how contextual semantics modulate value deviations. Specifically, we first construct a structured prompt that instructs the language model to analyze the input question x from the perspective of Schwartz’s ten basic human values. This prompt is designed to emphasize value salience under the given scenario, allowing the model to encode context-sensitive value implications. The resulting hidden representation is extracted as a contextual embedding xe_x, which serves as a semantic anchor for residual estimation. Conditioned on xe_x and the corresponding prior (either xv_x for the scenario-anchored view or uiv_u_i for the person-anchored view), a lightweight projection network produces a logit-level correction that implicitly instantiates the residual variable z. This correction is defined in the same value space as the prior distribution and is subsequently used to refine the posterior value inference. In this way, the effect of x is captured through semantic prompting rather than explicit stochastic modeling. Gating Prompt for View Composition To compute the adaptive fusion weight α in Eq. (10), we employ a prompt-based gating mechanism. Given the input question x and the predictions from both views, we construct a concise comparison prompt in Figure 13 that presents the value-wise predictions and their associated confidence signals. The prompt instructs the language model to decide which view provides a more reliable assessment under the current context. The gating model outputs logits corresponding to two discrete choices (scenario-anchored vs. person-anchored). We extract the logits associated with tokens 0 and 1, and normalize them to obtain the scalar gating coefficient α∈(0,1)α∈(0,1). This value is then used to interpolate between the two inferred posteriors, enabling context-aware view composition without introducing additional heuristic rules. Prompt: Question Information Extract for Latent Variable. Instruction: Analyze the following question from the perspective of Schwartz’s Theory of Basic Human Values. Value Dimensions: Consider the 10 value dimensions: Self-Direction, Stimulation, Hedonism, Achievement, Power, Security, Conformity, Tradition, Benevolence, and Universalism. Question: "question" Figure 12: Prompt for Schwartz value-dimension analysis of question. Prompt: Gate Function. Background: You are a value alignment meta-evaluator. Your goal is to compare two prediction streams and decide which one gives a more rational and reliable value-based assessment for a given question. The two streams are: Stream 0 (Universal): Reflects common societal values and general logic. Stream 1 (Personal): Reflects specific user traits and historical profile. You will be given a comparison matrix evaluating both streams along key value dimensions. Task: Choose which prediction stream (Universal vs. Personal) provides a more rational assessment for the primary value dimensions of the question. You must output either 0 (for Universal) or 1 (for Personal). Reliability Tags: [Reliable]: High confidence in the stream’s prediction quality and stability. [Uncertain]: Low confidence, noisy or unstable prediction. Input: Question: "question" Comparison Matrix (Scale 1–5):Dimension Stream 0 (Universal) Stream 1 (Personal) comparison_table Scale Meaning (1–5): 1 (Contradicted): The value is strongly violated or opposed. 2 (Absent): The value is missing or ignored. 3 (Mentioned but Not Important): The value appears but is not emphasized. 4 (Present but Not Central): The value is clearly present but not dominant. 5 (Most Important): The value is central and primary in reasoning. Analytical Guidance: Identify which value dimensions are primary for evaluating this question (e.g., fairness, harm, autonomy, etc.). For each primary dimension, compare the scores of Stream 0 vs. Stream 1. Consider: - Does Universal reasoning better match broad, widely accepted norms? - Does Personal reasoning risk overfitting to idiosyncratic user traits? - Are there dimensions where one stream is clearly unreliable (very low scores)? Integrate across all primary dimensions to decide which stream gives the overall more rational and trustworthy value assessment. Output Format (STRICT): You must output only a single number with no explanation: • Output 0 if Stream 0 (Universal) provides the more rational assessment. • Output 1 if Stream 1 (Personal) provides the more rational assessment. Final Question: Which stream provides a more rational assessment for the primary value dimensions of this question? Answer:0 (or)1 Figure 13: Prompt for gate function. A.3.3 Evaluation Prompt The prompt in Fig. 11 is also used to evaluate responses generated by some baseline models, as described in Appendix B.2. Appendix B Additional Experimental Details B.1 Datasets and Preprocessing PRISM. We use the PRISM dataset (Kirk et al., 2024) to evaluate value-conditioned personalization and value alignment in open-ended user–model interactions. Each instance is organized turn-by-turn, containing (i) a user query and its conversation context, (i) a set of candidate responses provided by the dataset (including the chosen response and up to three unselected responses), and (i) user-side survey metadata (e.g., self_description) when available. In our formulation, x denotes the full user query context (the user message concatenated with the opening_prompt for the first turn), and vuv_u denotes the user value profile derived from survey text (details below). GOOD (P4G-derived). Our GOOD dataset is constructed from the PersuasionForGood (P4G) corpus (Wang et al., 2019), a persuasion dialogue benchmark collected via Amazon Mechanical Turk. Each dialogue involves a Persuader and a Persuadee, where the Persuader aims to persuade the Persuadee to donate to a charity (e.g., Save the Children). The original corpus contains 1,017 complete dialogues and rich participant metadata including Schwartz values (10 dimensions), Big-Five personality traits, and Moral Foundations. B.1.1 Value Extraction and Alignment Scoring To quantify the alignment between user values and model responses on PRISM (Kirk et al., 2024), we develop a pipeline that produces value scores for (i) the user profile vuv_u and (i) model responses vycv_y_c. Selection and relevance filtering. We focus on the values guided subset, where models are explicitly prompted to engage with value-laden topics. To ensure value salience and data quality, we first retain only conversations with high value relevance, specifically those with choice_attributes.values scores of at least 80. We then perform turn-level processing, handling each conversation sequentially. Finally, we keep only users who provide survey text in self_description, which enables extraction of the user value profile vuv_u. LLM-based value extraction. We use an LLM as an evaluator to quantify the 10 basic human values (Self-direction, Stimulation, Hedonism, Achievement, Power, Security, Conformity, Tradition, Benevolence, Universalism). For each turn: 1. Relevance classification: classify whether the query is value-related; discard non-relevant turns. 2. Candidate dimension identification: select up to 5 value dimensions most pertinent to the query. 3. Value scoring (user vs. model): • User profile (vuv_u): score each dimension (1–5) from self_description. • Chosen answer (vycv_y_c): score the model’s chosen response across all 10 dimensions. • Unselected answers: score up to 3 unselected candidate responses to serve as comparison baselines. B.1.2 Evaluation Metrics We compute three metrics. Since the GOOD dataset does not contain negative samples, accuracy is only reported for PRISM. • MAE (value intensity mismatch): for each candidate dimension d, MAEd=|v^ui,xd−vycd|MAE_d=| v_u_i,x^d-v_y_c^d|. • Spearman’s rank correlation coefficient (Correlation): we use spearman correlation metric: ρ=1−6∑i=1ndi2n⁡(n2−1),ρ=1- 6 _i=1^nd_i^2n(n^2-1), (27) • Accuracy: Given one positive candidate and one or more negative candidates, this metric measures whether the predicted alignment is closer to the positive sample than to the negative samples. Formally, let v^ui,x v_u_i,x denote the predicted alignment vector, vycv_y_c the alignment vector of the positive sample, and vyrv_y_r that of a negative sample. The prediction is considered correct if ‖v^ui,x−vyc‖<‖v^ui,x−vyr‖. v_u_i,x-v_y_c < v_u_i,x-v_y_r . (28) B.2 Baselines We compare our method with a diverse set of baselines covering both non-personalized and personalized value alignment paradigms. All personalized baselines incorporate user value information at inference time, while non-personalized baselines do not utilize any user-specific value signals. Non-personalized Baselines. These methods generate responses without explicitly incorporating user value profiles. DirectAnswer directly generates responses by conditioning the language model on the user query and conversational context x, without considering any user-specific value information. This baseline represents general value alignment learned during pretraining. Personalized Baselines. These methods leverage user value information to produce personalized, value-aligned responses. Value Prompt explicitly injects the user value profile vuv_u into the system prompt, steering generation toward user-aligned value expression. MetaAligner performs meta-level alignment by rewriting or steering generated responses toward preferred values inferred from the user value profile and contextual information. COUPLE employs explicit preference modeling and counterfactual reasoning to encourage consistency between generated responses and the user value profile. PAD and MOD apply preference-aware decoding and modulation strategies to bias token selection toward user-aligned values during inference. ValuesRAG retrieves historical user cases with similar scenarios and value profiles as examples to support personalized decision-making. PersonValue is implemented by us and compares the static user value profile vuv_u with values extracted from candidate responses, serving as a static personalization baseline without scenario-aware inference. As many baseline methods produce answers as their final outputs, we evaluate value alignment by extracting value representations from the generated responses. The specific prompts used for value extraction are detailed in the Appendix. B.3 Implementation Details Backbone and Training. We adopt the Qwen3-8B model as the backbone and fine-tune it using Q-LoRA for parameter-efficient training. The model is optimized with Adam using a learning rate of 5×10−35× 10^-3 and a batch size of 16. Training is conducted for two epochs with a fixed random seed of 42 to ensure reproducibility. During the second epoch, all parameters except the gating module are frozen, allowing the training process to focus on optimizing the α parameters. Hyperparameters. We introduce a hyperparameter λ1 _1 to weight the KL-divergence term in our objective. λ1 _1 is searched within the range [0,1][0,1], and the final value is selected based on validation performance. Meanwhile, the gate coefficient α is initialized to 0.5 to provide a balanced prior contribution at the beginning of training. B.4 Human Evaluation In this section, we present the details of the human evaluation. We conducted two rounds of human evaluation: the first was to verify the effectiveness of the evaluator used in fevalf_eval, and the second was to validate the performance of our proposed method. Evaluator Validation. We conduct a human evaluation to examine whether the evaluator employed in fevalf_eval is consistent with human judgments. To this end, we design two independent annotation settings. In the first setting, annotators are provided with a user profile derived from a survey and are asked to label the underlying values reflected in the profile. In the second setting, annotators are given a question–answer pair and are asked to annotate the values expressed in the answer. The evaluator-generated scores are then compared with these human annotations. This annotation interface is shown in Fig. 14. As summarized in Tab. 4, the evaluator demonstrates a high level of agreement with human judgments across both settings, achieving low mean absolute error (MAE), high Spearman correlation, and strong agreement rates. These results are consistent with prior findings reported in COUPLE (Guo et al., 2026b), indicating that large language model–based evaluators can reliably extract human values and serve as an effective proxy for human evaluation. Setting MAE Corr r Acc. (≤ 1) Exact Match Survey-level 0.056 0.986 100.0% 94.4% Answer-level 0.120 0.936 98.4% 89.6% Table 4: Agreement between the automatic evaluator and human annotations under survey-level and answer-level evaluation settings. Figure 14: Human annotation interfaces used in the first human evaluation. Annotators independently label values based on a given user profile derived from a survey or a given question–answer pair. Model Performance Evaluation. The second human evaluation is conducted to assess the effectiveness of our proposed method in predicting context-specific personalized values. We sample 50 instances corresponding to 50 distinct survey-derived user profiles, with each profile appearing in exactly one instance. The complete evaluation set is independently assessed by two human evaluators, both of whom review all 50 samples under identical instructions. For each sample, annotators are presented with the survey-derived user profile, the question, the target answer, and the anonymized value-dimension assessments produced by BaCVA and ValuesRAG. Following the same five-level rubric, they determine which assessment more accurately reflects the values expressed in the target answer. When both evaluators prefer the same method, the sample is counted as a win or loss for BaCVA; when they disagree, it is counted as a tie. The annotation examples are shown in Tab. 5. Question Answer #Dims Security Conformity Benevolence Chosen What to do if mum remains dead-set on her opinions? If your mum remains dead-set on her opinions, it’s important to approach the situation with empathy and understanding. Here are a few suggestions: acknowledge her concerns, offer compromise, seek support from a nutritionist, and encourage open communication. 3 4.0 / 4.0 4.0 / 4.0 5.0 / 4.0 A or B Table 5: Example results of blind value dimension analysis. Scores are reported as Model A / Model B for each value dimension, and Chosen indicates the model preferred by human annotators. Annotator Details. All annotation procedures were approved by the relevant Institutional Review Board (IRB) and conducted in accordance with established ethical research guidelines. Annotators were informed about the task scope and voluntarily consented to participate. All annotators were compensated at a rate of at least $7 per hour, which substantially exceeds the prevailing local hourly wage levels in the countries where they were employed. The annotation tasks did not involve any personal, private, or sensitive information. To ensure independence and avoid potential bias, the two human evaluation tasks were conducted with two separate groups of annotators, with no overlap between the annotators involved in each task. All annotators had a background in psychology, received training on Schwartz’s theory of basic human values, and were proficient in English reading comprehension. B.5 Licenses for Existing Assets We use two existing datasets in our work: PRISM and GOOD. More information about the source datasets and their licenses is provided below. • PRISM (Kirk et al., 2024): Human-written texts (including prompts) in the PRISM dataset are licensed under the Creative Commons Attribution 4.0 International License (C-BY-4.0). Model responses are licensed under the Creative Commons Attribution–NonCommercial 4.0 International License (C-BY-NC-4.0). Use of model responses must also comply with the original licenses of the corresponding model providers. • GOOD (P4G-derived) (Wang et al., 2019): The GOOD dataset used in this work is derived from the PersuasionForGood (P4G) corpus, which is released under the Apache License 2.0. All derived data retain the original license of the P4G dataset, and appropriate attribution to the original source is required. All source datasets used in our benchmark retain their original licenses, as specified by their respective creators. Appendix C Additional Experiments C.1 Hyperparameter Sensitivity Analysis We analyze the sensitivity of BaCVA to key design choices by conducting hyperparameter studies. Effect of KL Weight λ1 _1. We further study the effect of the KL-divergence weight λ1 _1, which controls the regularization strength between the variational posterior and the personalized prior. Tab. 6 reports the sensitivity results on PRISM and GOOD. Overall, a moderate KL weight improves performance over removing the KL term, suggesting that the personalized prior provides useful regularization. However, overly large values of λ1 _1 lead to clear degradation, as the posterior is over-regularized toward the prior and becomes less adaptive to the current scenario. These results show that BaCVA is robust within a moderate range of λ1 _1, while very strong KL regularization is harmful. Table 6: Sensitivity analysis of the KL-divergence weight λ1 _1 on PRISM and GOOD. Lower MAE is better, while higher correlation and accuracy are better. PRISM GOOD λ1 _1 MAE ↓ Corr. ↑ Accuracy ↑ λ1 _1 MAE ↓ Corr. ↑ 0 0.7848 0.672 80.26% 0 1.3064 0.718 1e-2 0.7572 0.678 80.59% 1e-2 1.2537 0.732 3e-2 0.7548 0.696 81.68% 3e-2 1.1723 0.749 1e-1 0.7344 0.703 81.39% 1e-1 1.1230 0.765 3e-1 0.7809 0.601 77.44% 3e-1 1.1429 0.756 1 0.9405 0.523 76.30% 1 1.3885 0.683 C.2 Comparison with Training-Time Alignment Methods To further compare BaCVA with training-time alignment methods, we include RLHF and MORLHF as additional baselines. All methods use the same backbone, data splits, preference samples, and input information for a controlled comparison. Standard RLHF learns a unified preference objective from the pooled preference data, whereas MORLHF performs multi-objective optimization over value-related preference signals. The detailed training configurations follow the same experimental budget used for the main baselines. As shown in Tab. 7, BaCVA achieves the best performance across all three metrics. Compared with the strongest baseline for each metric, BaCVA reduces MAE by 62.3% relative to MORLHF, while improving correlation by 0.191 and accuracy by 12.72 percentage points over MetaAligner. Method MAE ↓ Corr. ↑ Accuracy ↑ RLHF 2.969 0.312 48.92% MORLHF 1.933 0.446 53.41% MetaAligner 1.955 0.509 69.00% BaCVA 0.728 0.700 81.72% Table 7: Comparison with training-time alignment methods on PRISM. Table 8: Prompt sensitivity analysis of the universal response estimator. Agreement is computed with the default Origin prompt as reference. Estimator Prompt Agreement Corr. Final MAE ↓ Origin 1.000 0.728 More Natural 0.806 0.715 Structural 0.738 0.743 Effect of Prompt Designs. We further examine whether the estimation of the scenario-based prior is sensitive to prompt formulation. Specifically, we compare three prompting strategies for generating the universal response: Origin, which directly answers the input question; More Natural, which encourages fluent and conversational responses; and Structural, which produces structured, point-by-point narratives. As shown in Tab. 8, although different prompts lead to moderate variations in inter-prompt agreement, the final downstream MAE remains stable across prompt designs. Notably, the more natural prompt even slightly improves MAE from 0.728 to 0.715, while the structural prompt only introduces a minor degradation to 0.743. These results indicate that our estimator does not rely on a specific response style, and the extracted scenario-based prior remains robust under different prompt formulations. Additional Evaluation on AlignX. To further address the concern regarding dataset sufficiency, we conduct additional experiments on a third dataset, AlignX Li et al. (2025a). AlignX provides diverse contextual scenarios, allowing us to evaluate the effectiveness of different methods beyond the original evaluation datasets. As shown in Tab. 9, BaCVA consistently outperforms all baselines on AlignX, achieving the lowest MAE and the highest correlation and accuracy. Compared with the strongest baseline, ValuesRAG, BaCVA reduces MAE from 2.184 to 1.872, improves correlation from 0.587 to 0.683, and increases accuracy from 64.40% to 68.92%. These results further confirm the effectiveness of BaCVA on an additional dataset and strengthen the empirical support for our method. Table 9: Additional results on AlignX. Best results are in bold. Method MAE ↓ Corr ↑ Acc ↑ Value Prompt 2.682 0.297 61.96% COUPLE 2.577 0.356 59.89% MOD 2.406 0.544 64.26% MetaAligner 2.442 0.370 61.29% PAD 2.535 0.348 60.07% ValuesRAG 2.184 0.587 64.40% BaCVA 1.872 0.683 68.92% Robustness across Value Systems We further evaluate BaCVA on PRISM under an alternative value representation based on the five-dimensional Moral Foundations taxonomy. Compared with the strongest baseline, ValuesRAG, our method consistently achieves performance improvements across evaluation metrics. This consistent gain demonstrates that BaCVA effectively generalizes across different value systems and is capable of robustly modeling personalized alignment signals beyond a specific value taxonomy. Figure 15: Hyperparameter analysis on universal-response model selection and value-system generalization. Application to Fine-Grained Value Dimensions. To further examine whether BaCVA is limited by the granularity of the underlying value taxonomy, we conduct an additional experiment on PRISM using the value system from the Daily-Dilemma dataset (Chiu et al., 2024), which contains 301 fine-grained value dimensions, such as trust, fairness, and patience. This setting directly tests whether the proposed framework can capture more contextual and nuanced value signals beyond coarse-grained taxonomies. Table 10: Results on PRISM under the fine-grained value system from Daily-Dilemma. Method MAE ↓ Corr. ↑ Accuracy ↑ PersonValue 1.325 0.109 55.74% ValuesRAG 0.717 0.167 62.63% BaCVA 0.365 0.471 78.69% As shown in Tab. 10, BaCVA substantially outperforms both PersonValue and ValuesRAG under the fine-grained value system. These results suggest that BaCVA is not constrained to a fixed coarse-grained taxonomy, but can also adapt to more detailed value dimensions and better capture contextual nuances in personalized value alignment. C.3 Cluster-level adaptability analysis Tab. 11 compares BaCVA with two prior-only variants, where Prior-vuv_u uses only the static user value prior and Prior-vxv_x uses only the scenario-level value prior. Across all five major clusters, BaCVA consistently achieves the lowest MAE, indicating that its posterior value estimation can adapt to diverse contextual topics rather than relying on either user- or scenario-level priors alone. Cluster / Topic Main Value Dims. Prior-vuv_u MAE ↓ Prior-vxv_x MAE ↓ BaCVA MAE ↓ C1 / Social Values Self-Dir., Benev. 1.539 1.986 0.777 C2 / Life Advice Self-Direction 1.536 2.205 0.741 C3 / Politics/Civic Power, Achievement 2.367 2.106 1.158 C4 / Religion/Tradition Security, Tradition 1.887 2.100 0.774 C5 / Relationships Benevolence, Security 1.380 1.890 0.672 Table 11: Cluster-level adaptability analysis on PRISM. C.4 Case Study We conduct a case study on the PRISM dataset to qualitatively examine whether our model can achieve both scenario alignment and personalization alignment. As illustrated in Fig. 16, our model is able to generate responses that are consistent with individual user preferences while simultaneously adapting to different contextual scenarios. This demonstrates that the proposed approach effectively integrates contextual understanding with personalized modeling, achieving Contextualized Personalization Alignment. Figure 16: Case study on the PRISM dataset. The proposed model generates responses that are aligned with both user-specific preferences and contextual scenarios, demonstrating its ability to achieve Contextualized Personalization Alignment. C.5 Downstream detail analysis Framework Formulation. We extend the two-stage BaCVA framework by coupling contextual value inference with response generation. Following the standard notation, each training instance consists of a user u, a question x, a user profile uv_u, question-level universal values xv_x, and question-specific personalized values u,xv_u,x. The dataset is augmented with preference triples (x,yc,yr)(x,y_c,y_r), where ycy_c and yry_r denote the human-preferred and dispreferred responses, respectively. In the baseline Two-stage BaCVA, the inferrer predicts ^u,x v_u,x via dual-stream gating, and a decoupled generator subsequently conditions on a discrete text description of ^u,x v_u,x. In our proposed BaCVA-E2E, we interface these modules via continuous soft prompts. A linear projector maps the inferred vector ^u,x∈[1,5]10 v_u,x∈[1,5]^10 to k prefix embeddings v∈ℝk×de_v ^k× d, which are prepended to the token embeddings of [x,y][x,y]. The joint training objective is formulated as ℒE2E=ℒvalue+λℒgenL_E2E=L_value+ _gen, where ℒvalueL_value is the masked value-regression loss from the vanilla BaCVA, and ℒgenL_gen is the preference alignment loss. This continuous path enables response-quality feedback to backpropagate directly into the inferrer. Preference Alignment Loss. Conditioned on the soft prompts ve_v, we optimize the generator πθ _θ using a DPO-style objective with multi-line alignment: ℒgen=−(x,yc,yr)[logσ(β[Δlog⁡π(yc)−Δlogπ(yr)])], splitL_gen=-E_(x,y_c,y_r) [ σ (β[& π(y_c)-\\ & π(y_r)] ) ], split (29) where the likelihood margin for response y∈yc,yry∈\y_c,y_r\ is defined as: Δlog⁡π⁡(y)=log⁡πθ(y∣v,x)πref(y∣v,x). π(y)= _θ(y _v,x) _ref(y _v,x). (30) and β scales the preference margin. Likelihood computations are restricted to answer tokens, masking out prefix and question tokens. We set the reference policy log⁡πref≡0 _ref≡ 0, λ=1.0λ=1.0, and β=0.1β=0.1 across all experiments. Conditioning Protocol. During training, value vectors are injected as continuous soft prompts (k=8k=8) prepended to the LM input, and the generator is fine-tuned via LoRA. Conversely, during inference, to isolate the performance gains attributable to improved value inference rather than a modified decoding interface, BaCVA-E2E adopts the exact same discrete text prompting as the two-stage baseline. The E2E-trained inferrer outputs ^u,x v_u,x, which is converted into natural language value levels and inserted into the system prompt (e.g., Achievement: high (4.2)). The E2E generator LoRA weights are disabled at test time, and preprocessing follows the stage-1 implementation. Dataset and Preprocessing. We utilize the PRISM dataset (Kirk et al., 2024) with an 80/20 user-level train/test split (using random seed 42), resulting in a test set of N=420N=420. The ground-truth vector ycv_y_c is derived directly from the 10-dimensional annotation of the human-chosen answer. Evaluation Metrics. To comprehensively assess our framework, we evaluate performance across three metrics, each computed exclusively over the answer-specific active dimensions: • MAE: Quantifies the absolute intensity mismatch between the predicted v^u,xd v^d_u,x and ground-truth vycdv^d_y_c across relevant dimensions, formulated as MAE=d[|v^u,xd−vycd|]MAE=E_d[| v^d_u,x-v^d_y_c|]. • Spearman’s ρ: Measures the rank correlation between ^u,x v_u,x and ycv_y_c pooled across the entire test set to capture ordinal consistency. • Accuracy (Pairwise Ranking): Evaluates whether the predicted vector is closer to the chosen response than the rejected alternative in terms of L1L_1 distance, defined as ‖^u,x−yc‖1<‖^u,x−yr‖1\| v_u,x-v_y_c\|_1<\| v_u,x-v_y_r\|_1. Ties are scored as 0.50.5. Baseline Configurations. We compare our proposed framework against two major categories of alignment methods, all sharing the same backbone LM and utilizing greedy decoding (max_new_tokens=256max\_new\_tokens=256). The first category consists of non-personalized baselines, represented by DirectAnswer, which generates responses directly from the user query without any value conditioning. The second category comprises personalized baselines, including: • ValuePrompt, which hard-codes the static user profile into the system prompt; • COUPLE, which leverages counterfactual prompting to highlight conflicts between uv_u and xv_x; • MetaAligner, which employs a critique-and-rewrite mechanism to align a draft response with user values; • PAD and MOD, which implement contrastive decoding via token-level logit manipulation; • ValuesRAG, which augments the generation context with few-shot exemplars retrieved from historically similar profiles. Hyperparameters and Ablations. The complete hyperparameter configuration for training BaCVA-E2E is detailed in Tab. 12. For ablation analysis, we maintain the identical pipeline but evaluate under two restricted settings: w/o gradient to inferrer, where ^u,x v_u,x is detached before soft-prompt projection to isolate decoupled training behavior, and w/o ℒvalueL_value, which completely removes the explicit value-regression constraints on the inferrer submodule. Component Setting Backbone LM Qwen3-1.7B (bfloat16) BaCVA Submodule LoRA (r=16r=16, α=32α=32), warm-started Generator Module Attention Projection LoRA (r=16r=16, α=32α=32) Soft Prompts k=8k=8 tokens, Linear Projector + LayerNorm Optimizer AdamW (weight decay =0.01=0.01) Learning Rate 5×10−55×10^-5 (Inferrer); 2×10−42×10^-4 (Generator + Projector) Training Layout 3 epochs, batch size 1, gradient accumulation 8 Loss Scalers (λ,β)(λ,β) 1.0, 0.11.0,\ 0.1 Seed 42 Table 12: Hyperparameter settings for BaCVA-E2E training. Tab. 13 presents the performance of BaCVA-E2E and its ablation variants on the PRISM test set. The results show that both gradient feedback to the value inferrer and the value supervision objective contribute positively to the final alignment performance. Method MAE ↓ Acc ↑ Spearman ↑ Proposed Framework BaCVA (Two-stage) 0.3835 0.7975 0.4782 BaCVA-E2E 0.3776 0.7996 0.4812 Ablations w/o grad. to inferrer 0.3853 0.7957 0.4794 w/o ℒvalueL_value 0.3841 0.7258 0.4757 Table 13: Ablation results on the PRISM test set (N=420N=420). Qualitative Case Studies. Fig. 17 presents two cases where the situational value ^u,x v_u,x diverges from the static profile uv_u. In Case A, ValuePrompt frames the response around the user’s self-direction-dominant uv_u, missing the empathetic tone the situation requires; BaCVA-E2E correctly infers a Benevolence-dominant ^u,x v_u,x and responds accordingly. In Case B, PAD anchors advice to the user’s Conformity-dominant uv_u and treats the situation as a discipline problem; BaCVA-E2E infers that the family context elevates Benevolence and produces empathy-first guidance instead. Figure 17: Qualitative comparison of BaCVA-E2E against representative baselines on two PRISM test instances where the situational value ^u,x v_u,x diverges from the static user profile uv_u. C.6 Cross-Extractor Evaluation The main experiments use GPT-5-nano to construct both training and test value targets. Although its agreement with human annotations is validated in Appendix B.4, using the same extractor throughout the pipeline may introduce extractor-specific evaluation bias. We therefore evaluate whether BaCVA’s improvements transfer to independently constructed value targets from different model families. Human Validation of Value Extractors We first compare GPT-5-nano, Gemini-3-Flash, and Qwen3-235B-A22B against the same human-annotated value assessments. As shown in Tab. 14, all three extractors achieve strong agreement with human annotations at both the profile and answer levels. Extractor Profile MAE ↓ Profile Corr. ↑ Answer MAE ↓ Answer Corr. ↑ GPT-5-nano 0.056 0.986 0.120 0.936 Gemini-3-Flash 0.172 0.930 0.166 0.880 Qwen3-235B-A22B 0.164 0.932 0.171 0.878 Table 14: Human validation of value extractors. Training Extractor Test Extractor Method MAE ↓ Corr. ↑ Accuracy ↑ GPT-5-nano GPT-5-nano ValuesRAG 0.952 0.638 71.68% GPT-5-nano GPT-5-nano BaCVA 0.728 0.700 81.72% GPT-5-nano Gemini-3-Flash ValuesRAG 1.052 0.605 69.02% GPT-5-nano Gemini-3-Flash BaCVA 0.826 0.665 78.55% GPT-5-nano Qwen3-235B-A22B ValuesRAG 1.066 0.598 68.37% GPT-5-nano Qwen3-235B-A22B BaCVA 0.842 0.657 77.96% Table 15: Cross-extractor evaluation with mismatched training and test value targets. Evaluation with Mismatched Training and Test Extractors We retain GPT-5-nano targets for training, but independently reconstruct the test targets using Gemini-3-Flash and Qwen3-235B-A22B. Neither test extractor is used during training or scenario-prior construction. For each extractor, the values of both preferred and dispreferred test responses are reconstructed before computing MAE, correlation, and pairwise ranking accuracy. As shown in Tab. 15, BaCVA consistently outperforms ValuesRAG under both matched and mismatched evaluation. Across the two mismatched settings, BaCVA reduces MAE by 21.2% on average and improves accuracy by 9.56 percentage points over ValuesRAG, while also achieving higher correlation. C.7 Robustness across Scenario-Prior Estimators To evaluate whether BaCVA depends on a particular model for constructing the scenario prior xv_x, we compare three aligned LLMs from different model families: GPT-5-nano, Gemini-3-Flash, and Qwen3-235B-A22B. These models are used as operational proxies for population-level scenario salience rather than definitive representations of universal human values. We measure the consistency of the extracted scenario priors using within-one agreement. For each question and value dimension, two estimators are considered consistent when their scores differ by at most one point on the 1–5 scale. The agreement reported for each estimator is its average pairwise agreement with the other two estimators over the same PRISM questions. As shown in Tab. 16, the three estimators achieve an average within-one agreement of 89.15%. The downstream PRISM MAE has a standard deviation of only 0.027, indicating that BaCVA maintains stable absolute-error performance across different scenario-prior estimators, although some variation remains in correlation and pairwise accuracy. Scenario-Prior Estimator Prior Agreement ↑ MAE ↓ Corr. ↑ Accuracy ↑ GPT-5-nano 90.20% 0.728 0.700 81.72% Gemini-3-Flash 89.89% 0.792 0.667 80.47% Qwen3-235B-A22B 87.35% 0.749 0.746 79.81% Mean ± Std. 89.15% ± 1.28% 0.756 ± 0.027 0.704 ± 0.032 80.67% ± 0.79% Table 16: Robustness to the model used for constructing the scenario prior on PRISM. Prior agreement denotes average pairwise within-one agreement on the 1–5 value scale. C.8 Generalization across Alignment Backbones To evaluate whether the improvements of BaCVA generalize beyond the default Qwen3-8B backbone, we additionally implement BaCVA and representative personalized baselines using Llama3-8B. All methods use the same datasets, data splits, value extractor, input information, and baseline configurations. As shown in Tab. 17, BaCVA consistently outperforms ValuePrompt and ValuesRAG under both backbone models. With Llama3-8B, BaCVA reduces MAE by 37.9%, improves correlation by 0.125, and increases accuracy by 19.06 percentage points relative to ValuesRAG. These results support the generalizability of BaCVA across alignment backbone families. Backbone Method MAE ↓ Corr. ↑ Accuracy ↑ Qwen3-8B ValuePrompt 1.790 0.568 72.95% ValuesRAG 0.952 0.638 71.68% BaCVA 0.728 0.700 81.72% Llama3-8B ValuePrompt 2.969 0.312 42.29% ValuesRAG 1.524 0.369 63.02% BaCVA 0.947 0.494 82.08% Table 17: Personalized value alignment results across backbone models on PRISM. C.9 Profile–Answer Conflict Analysis To examine when contextual value inference is most beneficial, we measure the conflict between the global user profile uv_u and the values expressed in the preferred answer ycv_y_c. For each sample, the profile–answer distance is computed as dconflict=1D∑j=1D|vu(j)−vyc(j)|,d_conflict= 1D _j=1^D |v_u^(j)-v_y_c^(j) |, (31) where D is the number of value dimensions. We divide the PRISM test samples into low-, medium-, and high-conflict subsets according to this distance. As shown in Tab. 18, the performance gap between BaCVA and profile-based methods becomes more pronounced as profile–answer conflict increases. On the high-conflict subset, BaCVA reduces MAE by 17.8% relative to ValuesRAG. Its absolute improvement over ValuesRAG is also larger in the medium- and high-conflict subsets than in the low-conflict subset, indicating that explicit contextual value inference is particularly useful when answer-level values diverge from the global user profile. Conflict Level #Samples ValuePrompt ValuesRAG BaCVA Low 136 1.471 0.801 0.640 Medium 149 1.705 0.899 0.678 High 135 2.059 1.163 0.956 Table 18: MAE on PRISM under different degrees of profile–answer conflict. C.10 General-Purpose Capabilities To assess whether personalized value-alignment training degrades capabilities outside the target task, we evaluate the original Qwen3-8B backbone and BaCVA on four general-purpose benchmarks: BoolQ, ARC-Easy, HellaSwag, and WinoGrande (Clark et al., 2019; Clark et al., 2018; Zellers et al., 2019; Sakaguchi et al., 2021). These benchmarks cover reading comprehension, science reasoning, commonsense completion, and commonsense reasoning. As shown in Tab. 19, BaCVA maintains performance comparable to the original backbone across all four benchmarks. Its average performance is 78.74%, compared with 77.69% for the original backbone, indicating that BaCVA training does not substantially degrade general-purpose capabilities. Benchmark Backbone BaCVA BoolQ 86.70% 86.45% ARC-Easy 81.06% 83.59% HellaSwag 74.96% 76.87% WinoGrande 68.03% 68.03% Average 77.69% 78.74% Table 19: General-purpose performance of the original Qwen3-8B backbone and BaCVA after personalized value-alignment training. C.11 Comparison with Explicit Stochastic Approximation To examine the accuracy–efficiency trade-off of the practical posterior implementation, we compare BaCVA with an explicit stochastic approximation that draws 10 Monte Carlo samples for each input. The two implementations use the same backbone, test set, and evaluation protocol. As shown in Tab. 20, the amortized implementation reduces MAE by 7.4%, improves correlation by 0.021, and increases accuracy by 3.97 percentage points relative to the 10-sample Monte Carlo approximation. Its inference latency is 7.3% higher but remains comparable under the same evaluation setting. These results support the use of deterministic amortized inference as a practical approximation rather than exact stochastic posterior computation. Implementation MAE ↓ Corr. ↑ Accuracy ↑ Time ↓ 10-sample Monte Carlo 0.786 0.679 77.75% 148.0 ms Amortized BaCVA 0.728 0.700 81.72% 158.8 ms Table 20: Accuracy–efficiency comparison of posterior implementations on PRISM. Inference time is reported per sample. Appendix D Generative Assistance Generative AI tools were used to assist with language polishing and improving the clarity of presentation in this paper. All technical content, experimental design, results, and conclusions were developed and verified by the authors.

Paper	Published	Area	Tags	Intel	Citations