Paper deep dive
Talking Past the Machine: Morality, Politeness, and Alignment in Human-AI Dialogue
Marina Mitiaeva, Lu Xiao
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 91%
Last extracted: 9/21/2026, 4:22:47 AM
Summary
This study investigates the dynamics of morality, politeness, and alignment in human-AI versus human-human dialogue using a large-scale corpus analysis. The authors find that while AI systems produce surface features of cooperative communication, they lack the underlying social architecture of mutual adaptation. Key findings include a dissociation where AI-generated hedging reduces alignment (unlike in human-human interactions), and agency is the most consistent predictor of alignment. The paper suggests that current AI models simulate cooperation without the reciprocal adjustment that grounds it in human interaction.
Entities (10)
Relation Signals (6)
ChatGPT â usedin â WildChat
confidence 95% ¡ HumanâAI interactions are drawn from WildChat, ~1M real multi-turn conversations with ChatGPT
Agency â predicts â Alignment
confidence 92% ¡ Agency... is the most consistent predictor of alignment across both interaction types
Communication Accommodation Theory â formalizes â linguistic alignment
confidence 90% ¡ Communication Accommodation Theory (CAT) formalizes this adaptation
ME2-BERT â usedfor â Moral Foundations Theory
confidence 90% ¡ We operationalize moral expression with Moral Foundations Theory (MFT), scored by ME2-BERT
Hedging â reduces â Alignment
confidence 88% ¡ hedging and softening associated with greater accommodation between humans are associated with reduced alignment when produced by AI
MIRA model â explains â Human-AI Interaction
confidence 85% ¡ interpret the humanâAI case through the recently proposed Machine-Integrated Relational Adaptation (MIRA) model
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Conversational AI systems produce fluent, socially appropriate responses, yet whether they participate in cooperative communication or merely simulate its surface forms remains unclear - a question central to how these systems are evaluated, trusted, and designed. This study investigates how morality, politeness, and alignment - three dimensions central to cooperative dialogue - function in human-AI interaction compared to human-human conversation. We analyze 15,881 human-ChatGPT and 10,784 human-human multi-turn dialogues, using mixed-effects models to identify which features predict turn-to-turn alignment. We observe a consistent dissociation: AI produces the surface features of cooperative communication without the underlying social architecture. Moral output appears preconfigured rather than negotiated; warmth is generated without face sensitivity; linguistic convergence declines persistently. Most strikingly, the cooperative mechanisms themselves reverse direction: hedging and softening associated with greater accommodation between humans are associated with reduced alignment when produced by AI, and purity framing associated with human divergence coincides with users converging toward the AI. Agency - giving users room to shape the exchange - is the most consistent predictor of alignment across both interaction types, while lower moral assertiveness in more recent models is not accompanied by better cooperation. Together these patterns suggest that AI reproduces the surface of cooperation without the mutual adaptation that grounds it between humans - and, more surprisingly, that mechanisms sustaining human accommodation can run in reverse with AI, suggesting a turn-level view may be insufficient for interaction-level success.
Tags
Links
- Source: https://arxiv.org/abs/2609.21401v1
- Canonical: https://arxiv.org/abs/2609.21401v1
Trouble viewing inline? Open PDF directly â
Full Text
58,631 characters extracted from source content.
Expand or collapse full text
Talking Past the Machine: Morality, Politeness, and Alignment in HumanâAI Dialogue Marina Mitiaeva Affiliation: Amazon.com Email: mmitiaev@amazon.com Lu Xiao Affiliation: Arizona State University Email: luxiao@asu.edu Abstract Conversational AI systems produce fluent, socially appropriate responses, yet whether they participate in cooperative communication or merely simulate its surface forms remains unclearâa question central to how these systems are evaluated, trusted, and designed. This study investigates how morality, politeness, and alignmentâthree dimensions central to cooperative dialogueâfunction in humanâAI interaction compared to humanâhuman conversation. We analyze 15,881 humanâChatGPT and 10,784 humanâhuman multi-turn dialogues, using mixed-effects models to identify which features predict turn-to-turn alignment. We observe a consistent dissociation: AI produces the surface features of cooperative communication without the underlying social architecture. Moral output appears pre-configured rather than negotiated; warmth is generated without face sensitivity; linguistic convergence declines persistently. Most strikingly, the cooperative mechanisms themselves reverse direction: hedging and softening associated with greater accommodation between humans are associated with reduced alignment when produced by AI, and purity framing associated with human divergence coincides with users converging toward the AI. Agencyâgiving users room to shape the exchangeâis the most consistent predictor of alignment across both interaction types, while lower moral assertiveness in more recent models is not accompanied by better cooperation. Together these patterns suggest that AI reproduces the surface of cooperation without the mutual adaptation that grounds it between humansâand, more surprisingly, that mechanisms sustaining human accommodation can run in reverse with AI, suggesting a turn-level view may be insufficient for interaction-level success. Keywords: Human-AI interaction, linguistic alignment, politeness, morality, LLMs 1 Introduction Conversational AI agents are deeply integrated into daily routines, mediating millions of interactions across work, education, and decision-making. Yet the social foundations of humanâAI communication remain poorly understood, and the HCI implications of its communicative asymmetries are underexplored. Communication theory treats conversation not as mere information transfer but as rational, cooperative behavior operating simultaneously on informational (Grice, 1975a), moral (Goffman, 1967a), and relational, face-based (Brown & Levinson, 1987a) layers. While these notions are well explored in humanâhuman communication, their applicability to AI-mediated dialogue is uncertain. Modern LLMs generate fluent, tone-adapting responses, yet emerging evidence suggests this relies more on statistical pattern matching than common ground (Shaikh et al., 2024a): heterogeneous humanâAI pairs fail to form shared conventions even where same-type dyads succeed (Jones et al., 2026a), and users treat AI as a social partner despite fundamental architectural asymmetries (Karnam et al., 2026a). Does humanâAI interaction follow the same cooperative dynamics as humanâhuman communication, or a distinct, surface-level form of coordination? Existing research remains fragmented, examining moral reasoning, politeness, or alignment in isolation, or focusing on downstream outcomes such as bias, safety, or task performance. Little attention has been paid to how these dimensions co-evolve across conversational turns, or whether their interdependence differs between humanâhuman and humanâAI interactionâa gap that risks mistaking social-signal fluency for competence and inviting over-reliance (Lee & See, 2004a). To address this gap, we conduct computational corpus analysis of public humanâAI and humanâhuman conversations. We adopt operationalizations grounded in prior scholarship: morality as the expression of shared values (Haidt & Joseph, 2004a; Graham et al., 2009a; Hendrycks et al., 2021a), politeness as the maintenance of appropriate, face-sensitive interaction (Goffman, 1967a; Brown & Levinson, 1987a), and alignment as the dynamic adaptation of language across turns (Giles, 1973a), and interpret the humanâAI case through the recently proposed Machine-Integrated Relational Adaptation (MIRA) model (Boyd & Markowitz, 2026a). We ask, comparing humanâAI with humanâhuman dialogue: (RQ1) Is moral and politeness expression distributed unevenly between the two interlocutors? (RQ2) How do morality and politeness change over a conversation, and across model generations? (RQ3) Which moral and politeness features predict turn-to-turn alignmentâand do they act in the same direction for AI as for humans? Our research contributes on three fronts: conceptually, by modeling morality, politeness, and alignment within a single analytical framework rather than in isolation; methodologically, by measuring their interdependence at scale in naturalistic dialogue; and empirically, by surfacing a patternâthe reversal of cooperative mechanisms across interaction typesâthat raises questions for how conversational AI is evaluated and designed. 2 Related Work 2.1 Cooperative Communication Foundations Conversation is the fundamental site of language use, and it is fundamentally cooperative: interlocutors do not exchange messages so much as jointly co-construct meaning, turn by turn (Grice, 1975a; Clark, 1996a). A single exchange is thus at once an informational, moral, and relational act (Goffman, 1967a; Grice, 1975a): what is said and whether it is acceptable to say it (Haidt & Joseph, 2004a); how it is said, the face-sensitive manner of delivery (Brown & Levinson, 1987a); and whether interlocutors converge as the conversation unfolds (Giles, 1973a). Although these layers are usually studied apart, a scattered body of evidence hints that they are parts of one system. The moral order of interaction ties the moral and relational layers together: what a speaker judges polite or rude tends to reflect which shared values they see upheld or violated (Spencer-Oatey & KĂĄdĂĄr, 2016a). That linkage is not only conceptual but plays out turn by turnâspeakers appear to feel obligated to reciprocate one anotherâs level of politeness, and when that reciprocity lapses the exchange tips toward either exaggerated courtesy or open conflict (Culpeper & Tantucci, 2021a), which folds the relational layer into the coordinative one. And the coordinative layer reaches back to the moral: perceived accommodation is read not merely as rapport but as evidence of shared values, shaping trust between interlocutors. Each of these findings connects only two of the three layers, and each within human dialogue alone; taken together, though, they point to morality, politeness, and alignment as facets of a single, jointly constructed act (Clark, 1996a) that has not yet been examined as a whole. We therefore approach each through an established, measurable constructâmorality as the salience of shared moral foundations (Haidt & Joseph, 2004a), politeness as the rate of face-oriented markers (Brown & Levinson, 1987a), and alignment as turn-to-turn convergence (Pickering & Garrod, 2004a)âand discuss each in turn. Morality shapes what is expressedâand what is acceptable to express at all. We follow Moral Foundations Theory (Haidt & Joseph, 2004a; Graham et al., 2009a), which holds that moral cognition rests on a small set of intuitive foundationsâcare, fairness, loyalty, authority, and sanctityâshared, culturally elaborated values through which speakers judge conduct as right or wrong. Their small, interpretable structure is what lets moral expression be read as the salience of each foundation in a turn, and the same foundations have recently been used to interrogate the values encoded in language models (Hendrycks et al., 2021a; Abdulhai et al., 2023a). The same content can be delivered in ways that protect or threaten the interlocutorâs social standing. Brown & Levinson (1987a) politeness theoryârooted in Goffman (1967a) concept of face, the social value a person claims and expects others to honorâholds that speakers deploy strategies to minimize face-threatening acts: positive politeness addresses the desire to be liked, negative politeness the need for autonomy. These strategies tend to surface as recognizable markers such as hedges, gratitude, apologies, and indirect requests. Cooperative dialogue requires more than well-formed turns; interlocutors must adapt to one another over time. Communication Accommodation Theory (CAT) (Giles, 1973a) formalizes this adaptation, holding that speakers converge toward one another to seek affiliation and diverge to mark distance. The movement is visible in the linguistic recordâin shared vocabulary and referring expressions (Brennan & Clark, 1996a) and in synchronized function-word use, a form of language style matching that predicts relationship quality and stability (Ireland & Pennebaker, 2010a; Pickering & Garrod, 2004a). Yet how these coupled layers behave across a full conversationâand whether the same coupling holds when one interlocutor is a machineâhas not been empirically studied. 2.2 Human-AI Communication People do not treat machines as mere tools. Under the Computers Are Social Actors (CASA) paradigm, they unconsciously apply social rules to computersâpoliteness, reciprocity, stereotypingâeven while knowing the agents are artificial (Reeves & Nass, 1996a). As agents grow more linguistically capable, users anthropomorphize them (Epley et al., 2007a) and form attachments (Skjuve et al., 2021a), treating AI as a safe space for disclosure and support. The connection, however, is fundamentally one-sided: the system has none of the lived experience that grounds human interaction, and is free to simulate user-aligned responses to sustain coherence and satisfactionâwhich is precisely what makes the appearance of partnership consequential. Why a system with no inner life comes to feel like a partner is what the Machine-Integrated Relational Adaptation (MIRA) model sets out to explain, synthesizing joint action (Clark, 1996a), the accommodation tradition CAT formalizes (Giles, 1973a), and AI-mediated communication into an account of when and why AI becomes socially meaningful (Boyd & Markowitz, 2026a). MIRA asks what remains of CATâs mutual adaptation when one partner cannot adapt in kind. Its answer is linguistic reciprocity: as the AI mirrors user language, it simulates mutual responsiveness and generates psychological proximity and trust, even with no mental states to ground them. This is the tension we investigate: the very signals that index cooperation, morality, and accommodation in human dialogue can be produced by a system that does not participate in the social architecture beneath them. Read through this lens, work on each of our three layers takes on a common shapeâsurface signals present, social grounding absent. On morality, this pattern is already visible. Moral language in these systems often functions as a structural property of the model rather than an intentional act (Schramowski et al., 2022a), and although LLMs replicate many scenario-based psychological effects, they inflate effect sizes and require human validation for socially sensitive phenomena (Cui et al., 2025a). This apparent fluency masks systematic biases toward certain foundations (Abdulhai et al., 2023a; Santurkar et al., 2023a) and unstable responses in ambiguous cases (Scherrer et al., 2023a), reflecting training-data regularities rather than stable reasoning. On politeness, the picture is of a system that performs courtesy without quite practicing it. Conversational agents fail to handle abusive input, deflecting or responding with neutral politenessâmarkers without their usual interactional grounding (Cercas Curry & Rieser, 2018a). LLMs over-rely on negative politeness even where rapport-building would fit (Zhao & Hawkins, 2025a), and the relationship runs both ways: impolite prompts degrade performance while excessive politeness does not guarantee better results, at a language-dependent optimumâsuggesting models mirror training-data patterns rather than reading social signals (Yin et al., 2024a). Human politeness toward AI is itself unstable, declining over the course of interaction and eroding faster than in humanâhuman exchanges (Lazebnik et al., 2025a), with users reserving mitigation for human partners and taking a more direct, authoritative stance with AI (Lumer & Buschmeier, 2023a). Yet polite systems are still judged more trustworthyâusers respond to the appearance of politeness even when its social function is absent. On alignment, research largely targets individual outputs rather than the conversational chainâbenchmark and scenario testing (Hendrycks et al., 2021a), RLHF from human preferences (Ouyang et al., 2022a), and value probing (Santurkar et al., 2023a). Multi-turn work shows LLM performance varies across dialogue turns and that common alignment techniques do not clearly improve multi-turn ability (Bai et al., 2024a), but casts it as task performance, safety, and preference adherence, leaving alignment as a linguistic, interactional process largely unexamined. The same gap recurs across all three: each has been studied in AI mostly at the level of the individual output, in isolation from the others, and rarely across the arc of a real conversation. What is missingâand what we addressâis a joint, trajectory-level account of how morality, politeness, and alignment behave in humanâAI dialogue, measured against the humanâhuman baseline. 3 Method 3.1 Constructs All constructs are defined identically across the humanâhuman and humanâAI datasets to ensure comparability. For each we describe how a score is produced and illustrate it with a verbatim turn from the corpora. Moral Values. We operationalize moral expression with Moral Foundations Theory (MFT) (Haidt & Joseph, 2004a), scored by ME2-BERT (Zangari et al., 2025a), a contextual transformer trained to capture moral and emotional signals: it reads each turn and outputs, for each of the five foundations, a 00â11 score for how strongly that value is expressed. For instance, âYou have to give respect to get respectâŚâ scores .97.97 on authority, and âMen deserve to be called out for their injustices against women.â scores .99.99 on care. Each utterance thus yields a five-dimensional vector: t=[mt,1,mt,2,mt,3,mt,4,mt,5]m_t=[m_t,1,m_t,2,m_t,3,m_t,4,m_t,5] (1) where mt,km_t,k is the salience of foundation k (care/harm, fairness/cheating, loyalty/betrayal, authority/subversion, sanctity/degradation) at turn t. We also derive moral intensity Ii=âkmi,kI_i= _km_i,k (overall moral strength) and moral entropy Hi=ââkm^i,klogm^i,kH_i=- _k m_i,k m_i,k with m^i,k=mi,k/(âjmi,j+Ďľ) m_i,k=m_i,k/( _jm_i,j+Îľ) (whether the moral signal is concentrated or diffuse). Politeness Markers. We extract 32 interpretable politeness markers with the Politeness R package (Yeomans et al., 2018a), grounded in Brown & Levinson (1987a), and express each as a length-normalized rateâthe marker count in a turn divided by its lengthâgiving a vector tââ32p_t ^32 (pt,j=countâ(j,t)/lenâ(t)p_t,j=count(j,t)/len(t)). We group these into four functional dimensions, each a summed rate: modulation (softening: hedges, please, apology, gratitude, indirect requests), agency (distribution of control: ask/give-agency, person framing), affect (positive/negative emotion, swearing), and structure (discourse framing: reasoning, questions, conjunctions, negation, greetings, titles). For example, âShould I call someone for you?â yields a high agency rate (.57.57) and âWow. Thatâs pretty cool.â a high affect rate (.67.67). The full mapping is in the replication materials. Alignment. We use alignment for the theoretical construct (how far interlocutors coordinate) and accommodation for its measured convergence between adjacent turns (Giles, 1973a; Pickering & Garrod, 2004a). For each ordered cross-speaker pair (ut,ut+1)(u_t,u_t+1)âpreserving direction, so GPT is scored relative to the preceding human turn and vice versaâwe measure how similar the two turns are on four channels, each scaled to [0,1][0,1] (1 = identical): lexical (vocabulary overlap (Brennan & Clark, 1996a), lext=|WtâŠWt+1|/|WtâŞWt+1|lex_t=|W_t⊠W_t+1|/|W_t⪠W_t+1|); syntactic (Language Style Matching (Ireland & Pennebaker, 2010a), synt=1â|ftâft+1|/(ft+ft+1+Ďľ)syn_t=1-|f_t-f_t+1|/(f_t+f_t+1+Îľ) on function-word rates); pragmatic (the same form on a summed rate of five rapport markers: hedges, please, gratitude, apology, affirmation); and emotional (VADER compound sentiment (Hutto & Gilbert, 2014a), emot=1â|stâst+1|emo_t=1-|s_t-s_t+1|). Overall accommodation averages the four: At=14â(lext+synt+pragt+emot)A_t= 14(lex_t+syn_t+prag_t+emo_t) (2) Higher AtA_t means the reply converges toward the prior turn; e.g., âDo you like superhero movies?â â âYes, I do like superhero movies. Do you like Marvel?â scores high on shared-word and sentiment convergence. 3.2 Data HumanâAI interactions are drawn from WildChat (Zhao et al., 2024a), âź 1M real multi-turn conversations with ChatGPT, with role, order, timestamp, and model metadata that allow full-sequence reconstruction.11 1 https://huggingface.co/datasets/allenai/WildChat-1M Human--human interactions are from Topical-Chat, open-domain dialogue between two human peers.22 2 https://huggingface.co/datasets/Conversational-Reasoning/Topical-Chat The corpora differ in two ways we treat as confounds (addressed in Section 3.3): Topical-Chat supplies both partners external knowledge snippets (Wikipedia, Reddit, Washington Post) and pairs symmetric peers, whereas WildChat imposes no grounding and carries a user/initiatorâassistant/responder asymmetry. Both are public, anonymized, and text-only. Code and replication materials: github.com/marinamitiaeva/talking-past-the-machine. Table 1 reports descriptive statistics for both corpora before and after preprocessing (English-only, ⼠7 turns, balanced structure, duplicate/malformed removal). Table 1: Descriptive statistics for the WildChat (humanâAI) and Topical-Chat (humanâhuman) corpora before and after preprocessing. HumanâAI HumanâHuman Initial Cleaned Initial Cleaned Conversations 15,882 15,881 10,784 10,784 Utterances 476,198 473,884 235,281 227,704 Avg. turns/conv. 15 16 22 21 Avg. words (resp.) 1,718 1,008 107 63 Avg. words (init.) 1,157 516 102 60 Prompt-to-resp. ratio .648 .476 .950 .949 Reduction (%) 0.47% 3.33% Cleaning is lightâa 0.47%0.47\% reduction for humanâAI and 3.33%3.33\% for humanâhumanâleaving 15,881 humanâAI (473,962 messages) and 10,784 humanâhuman (227,704 messages) conversations, comparable in scale. Two contrasts matter for what follows: the humanâAI corpus spans GPT generationsâGPT-3.5 (34.9%), GPT-4 Preview/Turbo (18.7%), GPT-4o (34.6%), GPT-4.1 Mini (8.5%)âenabling the generational comparison in RQ2; and the large per-turn length gap (1,008 vs. 63 words for the responder) reflects the structural asymmetry of humanâAI interaction rather than a modality confound, motivating the direction-based design in Section 3.3. A turn is one message from one speaker. 3.3 Analysis Our goal is to compare how morality, politeness, and alignment are distributed, evolve, and predict one another in humanâAI versus humanâhuman dialogue. The corpora differ in role structure (Topical-Chat pairs symmetric peers; WildChat is user/initiator vs. assistant/responder) and knowledge grounding (Topical-Chat supplies both partners external snippets; WildChat none), so rather than equate them we build the analysis on one principle: every headline comparison is a within-corpus contrast between the two interlocutors, with alignment measured over cross-speaker adjacent pairs by an identical directional construction on both sides. We thus compare the shape of the speaker asymmetry against the symmetric humanâhuman baseline, never absolute cross-corpus levelsâturning the role asymmetry from a confound into the object of study. The remaining threat, knowledge grounding, we test before proceeding: a topic-persistence measure computed identically in both corpora is comparable (.091.091 HAI vs .059.059 H mean consecutive overlap), and adding topic-switch count as a covariate leaves every within-corpus predictor sign unchanged (e.g., HAI modulation â0.023ââ0.021-0.023â-0.021), as do turn-length controls. These diagnostics (conversation-clustered; code in the replication materials) indicate the findings are unlikely to be artifacts of topic persistence or verbosity; residual differences are discussed in Section 6. The pipeline operates at the message, turn, and conversation levels. Each turn is scored for the three constructs of Section 3.1; turn-level morality is the within-turn average (mÂŻc,t m_c,t) and politeness the within-dimension sum (Ri,d=âj=1ndfi,jR_i,d= _j=1^n_df_i,j, with fi,jf_i,j the j-th normalized feature in dimension d). At the conversation level, normalized turn position t~=t/Tc t=t/T_c makes trajectories comparable across conversations of different length, and slopes βc=slopeâ(t~,mÂŻc,t) _c=slope( t, m_c,t) capture their direction. These measures feed one analysis per research question. For RQ1, speaker asymmetries are tested with Wilcoxon signed-rank tests (BenjaminiâHochberg corrected within each corpus). For RQ2, the slopes track how each construct evolves over a conversation and across model generations. For RQ3, we fit mixed-effects regressions predicting next-turn alignment from the moral and politeness properties of the current turn, controlling for prior alignment: logitâ(Ac,t+1)=Îą+âk=15Îłkâmc,t,k+âd=14δdRc,t,d+Ďâ logit(Ac,t)+uc+Îľc,tlogit(A_c,t+1)=Îą+ _k=1^5 _km_c,t,k\\ + _d=1^4 _dR_c,t,d+Ď¡logit(A_c,t)+u_c+ _c,t (3) where mc,t,km_c,t,k is moral foundation k at turn t, Rc,t,dR_c,t,d the rate for politeness dimension d, ĎĎ the autoregressive coefficient, ucu_c a conversation-level random intercept, and Îľc,t _c,t residual error. Models are fit separately for HAI assistant turns (n=218,148n=218,148) and H agent-2 turns (n=103,067n=103,067) by REML; all VIFs fall below 3.6. A mediation analysis then tests whether politeness mediates the moralityâalignment relationship (product-of-coefficients, delta-method SEs, BH-corrected). 4 Results 4.1 RQ1: Communicative Asymmetries Between HumanâAI and HumanâHuman Interaction Human and AI show a qualitatively different communicative logic, not a rescaling of the same behaviors. Table 2 reports the per-conversation speaker difference for each moral foundation and politeness dimension, in both corporaâread, per our design, as the within-corpus contrast between interlocutors against the symmetric humanâhuman baseline. Table 2: Morality and politeness asymmetry across HAI and H conversation. M (SD) = mean per-conversation difference. Z = Wilcoxon signed-rank. r = rank-biserial. BH corrected. âp<.05^*p<.05; pââŁâ<.01^**p<.01; âp<.001^***p<.001. HumanâAI HumanâHuman M (SD) Z (r) M (SD) Z (r) Morality Care/Harm 0.029 (0.118) 28.48 (.226)â 0.001 (0.056) 2.29 (.022)â Fairness/Cheating 0.030 (0.094) 46.10 (.366)â 0.002 (0.064) 2.78 (.027)â Loyalty/Betrayal 0.052 (0.114) 60.92 (.483)â 0.003 (0.064) 4.60 (.044)â Authority/Subversion 0.046 (0.115) 56.79 (.451)â 0.001 (0.059) 1.54 (.015) Sanctity/Degradation 0.043 (0.154) 23.18 (.184)â â-.005 (0.058) â-10.36 (â-.100)â Politeness Modulation â-.004 (.036) â-5.41 (â-.044)â .002 (.023) 9.36 (.090)â Agency â-.002 (.033) â-2.01 (â-.016)â â-.002 (.034) â-6.91 (â-.067)â Affect .015 (.037) 59.55 (.473)â .002 (.034) 5.98 (.058)â Structure â-.024 (.053) â-57.50 (â-.457)â â-.000 (.045) â-0.94 (â-.009) Within HAI conversations, the assistant produces significantly more moral content than the user it is paired with, across all five foundations, with the largest speaker asymmetries for loyalty (Z=60.92Z=60.92, r=.483r=.483) and authority (Z=56.79Z=56.79, r=.451r=.451). These within-pair differences suggest LLMs position themselves as normative authorities, prioritizing group cohesion over individualistic foundations. In human-human conversations, the corresponding between-speaker differences are near-symmetricâinterlocutors avoid imposing binding moral frames on each otherâand are small, sometimes non-statistically significant. The contrast is therefore between an interaction in which one party carries the moral load and one in which it is shared: where humans calibrate moral expression reciprocally, the AI carries it as a one-sided asymmetry. The politeness analysis reinforces this. Within HAI, the assistant dominates affect (Z=59.55Z=59.55, r=.473r=.473), carrying more emotional warmth and affiliative tone than the user it responds toâyet without corresponding interpersonal sensitivity, as humans show stronger modulation than the assistant. The AI produces warmth while humans remain socially careful, managing relational risk the AI does not appear to register. Humans also carry the organizational load, dominating structure (Z=â57.50Z=-57.50, r=â.457r=-.457) where H shows no such asymmetry (r=â.009r=-.009): the labor that human dyads share falls to the human alone when the partner is AI. 4.2 RQ2: Temporal Evolution If morality, politeness, and alignment are jointly managed in human dialogue, their behavior should change over the course of a conversationâand comparing that change against humanâAI dialogue reveals whether the same coordinating process is at work. We track how each construct evolves across normalized conversation time, across speaker roles, and across model generations. Figure 1: Moral intensity and alignment across conversation arc by speaker role. Figure 1 plots two trajectories over normalized conversation timeâmoral intensity and overall accommodationâfor each speaker role in both corpora, and the two diverge in revealing ways. Moral intensity is largely flat for the AI, which starts high (âź 0.40) and holds a plateau, neither rising in response to the human nor resolving downward; in humanâhuman dialogue, by contrast, moral content builds gradually through the middle third of the conversation, suggesting that the AIâs morality is pre-configured rather than negotiated, consistent with Schramowski et al. (2022a). Accommodation diverges just as sharply. Both corpora fall steeply within the first 10â20% of the conversation, an initial calibration phase, but they part ways thereafter: human dyads stabilize, reaching an accommodation equilibrium through mutual adaptation, whereas the humanâAI curve continues to decline without recovery. Table 3: Alignment dynamics across speaker roles. %+/â- = conversations with positive/negative slopes. Z = Wilcoxon. r = rank-biserial. BH corrected. âp<.05^*p<.05; pââŁâ<.01^**p<.01; âp<.001^***p<.001. HAI: User HAI: Asst. %+/â- Z (r) %+/â- Z (r) Lexical 48/50 2.06 (.016)â 43/56 â-16.30 (â-.130)â Syntactic 50/49 0.39 (.003) 48/52 â-6.49 (â-.052)â Pragmatic 45/49 â-4.36 (â-.036)â 46/49 â-4.98 (â-.041)â Emotional 47/53 â-8.41 (â-.067)â 43/57 â-21.06 (â-.167)â Overall 48/52 â-6.32 (â-.050)â 44/56 â-16.70 (â-.133)â H: Agent 1 H: Agent 2 %+/â- Z (r) %+/â- Z (r) Lexical 47/53 â-5.95 (â-.057)â 40/60 â-26.85 (â-.259)â Syntactic 49/51 â-1.50 (â-.014) 53/47 7.40 (.071)â Pragmatic 48/49 â-1.39 (â-.014) 42/57 â-19.44 (â-.188)â Emotional 51/49 2.16 (.021) 49/51 â-2.81 (â-.027)â Overall 49/51 â-1.23 (â-.012) 45/55 â-13.33 (â-.128)â Table 3 reports per-conversation accommodation slopes by speaker role across the four alignment channels. Both corpora decline, but the drop is steeper and more consistent for the AI: the assistant declines more sharply than the user it responds to across all metrics (Z=â16.70Z=-16.70, r=â.133r=-.133 vs Z=â6.32Z=-6.32, r=â.050r=-.050). Tellingly, the party that produces the most moral content and affiliative warmth (Section 4.1) is also the one that diverges most from shared groundâexpressivity and accommodation move in opposite directions for the AI. The gap is starkest on emotional alignment, where the assistant falls fastest (Z=â21.06Z=-21.06, r=â.167r=-.167) on the very channel that stays most stable between humans (agent 1 Z=2.16Z=2.16, non-significant): the dimension that anchors human accommodation is the one the AI lets go. Figure 2: Dynamics across GPT generations. GPT-3.5 shows the highest moral intensity yet strongest accommodation; GPT-4 Turbo the steepest alignment decline; GPT-4o the lowest structure rate and weakest alignment trajectory. Figure 2 breaks the humanâAI trajectories down by GPT generation, plotting moral intensity and accommodation for each. The picture is a dissociation between moral assertiveness and cooperation. Moral intensity falls across generationsâhighest in GPT-3.5, lowest in GPT-4.1 Miniâconsistent with successive RLHF iterations reducing assertiveness (Askell et al., 2021a), though we observe model generation rather than the training process itself. Cooperation, however, does not improve in step: GPT-3.5 holds the strongest alignment trajectory (âź 0.38) despite being the most morally assertive, while GPT-4 Turbo and GPT-4o decline most steeply despite producing less moral content. The two interaction types thus differ not in degree but in temporal form: human accommodation self-corrects toward a stable equilibrium, whereas humanâAI accommodation drifts downward without recoveringâand successive model generations, though less morally assertive, do not repair it. 4.3 RQ3: What Drives Alignment? Having seen that the three constructs are distributed and evolve differently with AI, we turn to which of them appear to drive turn-to-turn alignment, and whether a feature pushes an AI exchange in the same direction it pushes a human one. We fit mixed-effects regressions predicting next-turn alignment from the five moral foundations and four politeness dimensions, controlling for prior alignment (Table 4). What stands out is less that the predictors differ in strength than that several appear to reverse sign between the two settings. Table 4: Mixed effects regression: Predictors of next-turn alignment. β = unstandardized coefficient. HAI n=218,148n=218,148 turns (15,882 conv.); H n=103,067n=103,067 turns (10,784 conv.). âp<.05^*p<.05; pââŁâ<.01^**p<.01; âp<.001^***p<.001. HAI β (SE) H β (SE) Morality Care/Harm .042 (.034) .011 (.044) Fairness â-.097 (.037)â â-.070 (.035)â Loyalty â-.003 (.032) .007 (.039) Authority â-.135 (.032)â â-.194 (.038)â Sanctity .160 (.028)â â-.113 (.038)â Politeness Modulation â-.470 (.153)â .303 (.111)â Agency .416 (.112)â .204 (.068)â Affect â-.150 (.095) â-.172 (.072)â Structure â-.473 (.112)â â-.131 (.056)â Prior alignment .084 (.002)â .009 (.003)â Modulation is a case in pointâhedging, epistemic softeners, apologiesâwhich is associated with more accommodation when a human uses it (β=+0.303β=+0.303) but less when an AI does (β=â0.470β=-0.470), suggesting AI modulation may not function as the relational signal it is between humans. Sanctity/degradation appears to reverse in the same way, associated with divergence in H (β=â0.113β=-0.113) yet convergence in HAI (β=+0.160β=+0.160): where an AI invokes purity content, users tend to move toward its normative frame rather than treat it as debatable. Structure is associated with lower alignment in both corpora but roughly four times more strongly with AI (β=â0.473β=-0.473 vs â0.131-0.131), which would be consistent with the AIâs organizational language crowding out space a human might otherwise occupy. Agency looks like the exception: it is associated with more alignment in both corpora (HAI β=+0.416β=+0.416; H β=+0.204β=+0.204). Of the features we examine, giving the other party room to shape the exchange seems to be the one whose cooperative function carries over from human to AI. Authority behaves more consistently across the two settings, associated with lower alignment in both (H β=â0.194β=-0.194; HAI β=â0.135β=-0.135), and a mediation analysis (Table 5) suggests this effectâlike purityâsâruns largely through a direct path (96â97% of the total) rather than through the politeness channels. If so, the reversals would reflect not which surface markers co-occur but how the content itself relates to accommodation. Table 5: Multiple mediation: Authority and purity as exposures. BH corrected. âp<.05^*p<.05; pââŁâ<.01^**p<.01; âp<.001^***p<.001. HAI H Auth. Pur. Auth. Pur. Total (c) â-.017â .107â â-.245â â-.177â Direct (câ˛c ) â-.112â .112â â-.236â .159â Indirect: Modul. .002â .004â â-.002â â-.001 Agency â-.004â â-.011â â-.004â â-.007â Affect â-.003 â-.005 â-.003â â-.013â Struct. .000 .008â .001 .002â Tot. ind. â-.005 â-.004 â-.008 â-.018 Prop. med. .040 â-.041 .031 .099 A further asymmetry runs beneath these: prior alignment predicts next-turn alignment about 9Ă9Ă more strongly with AI (β=+0.084β=+0.084) than between humans (β=+0.009β=+0.009), and between-conversation variance in baseline accommodation is far larger in HAI (random-intercept variance 1.101 vs 0.020). Where a human exchange tends to re-equilibrate after a low-accommodation turn, an AI exchange appears to stay near wherever it began. What emerges is less a ranking of predictors than a change in their sign: several of the moral and politeness features that build accommodation between humans appear to suppress it with AI, and the one feature that seems to behave the same in bothâagencyâis precisely the one that hands control back to the user. 5 Discussion We asked whether a conversation with an AI is cooperative in the way a conversation between people isâwhether the moral, relational, and coordinative work sustaining human dialogue carries over when one partner is a machine. Across the three research questions, our results suggest it largely does not: AI reproduces these surface features without the social logic that links them in human dialogue, and several cooperative mechanisms run in reverse. On who carries the interaction (RQ1), the load is distributed unevenly with AI in a way it is not between people. The assistant supplies most of the moral content and affective warmth, yet without the interpersonal sensitivity that accompanies warmth between humans, while the user is left to carry the organizational work that human dyads share. This extends prior observations that AI moral language reads as more virtuous than humansâ despite lacking grounding (Aharoni et al., 2024a) and that LLMs over-rely on politeness strategies detached from the context that gives them meaning (Zhao & Hawkins, 2025a). On how the interaction unfolds over time (RQ2), the two settings diverge in form rather than degree. AI moral intensity stays flat regardless of the userâs inputâconsistent with moral norms encoded during pretraining (Schramowski et al., 2022a)âwhereas human moral engagement is dynamically calibrated; and where human accommodation settles into an equilibrium, humanâAI accommodation only erodes. That the effect strengthens rather than fades across generations echoes evidence that sycophancy intensifies over long interactions (Jain et al., 2026a), and the 9Ă9Ă stronger path dependence we observe gives it a mechanism: the level set early tends to persist rather than re-equilibrate. On what drives alignment (RQ3), the mechanisms themselves change sign. Features that build accommodation between humansâhedging, softening, purity framingâare associated with less of it when an AI produces them, while agency is the one feature whose positive role survives the shift. This locates the asymmetry differently from work reporting that humanâAI alignment is stronger but shallower than human convergence (Branigan et al., 2010a) and that LLMs overconverge on surface features (Blevins, 2026a): our data suggest the problem is not only over-convergence but that moral and politeness signals normally linking surface behavior to cooperation work against it. It also refines Stiversâs (2008a) distinctionâAI produces affiliation without sustained alignmentâand fits the absence, in our humanâAI data, of the language-style-matchingârelationship-quality link seen in human dyads (Ireland & Pennebaker, 2010a). Read through MIRA (Boyd & Markowitz, 2026a), the difficulty sits in its core mechanism: AI reproduces the form of linguistic reciprocity but not the mutual adaptation that lets it mature into shared accommodation. Two implications follow, both tentative. For design, agencyâroom for users to shape the exchangeâis a plausible, testable target, whereas simply reducing expressivity is not enough: lower moral assertiveness across generations does not bring better cooperation, and MetaMind (Zhang et al., 2025a) improved social-AI performance by treating moral grounding and adaptive responsiveness as distinct interdependent layers. For evaluation, the more cautionary point: judging AI turn by turn can be actively misleading. Communication is a joint construction, and in our data responses that score well on per-output criteriaâincluding the helpfulness, harmlessness, and fluency that LLM-as-a-judge frameworks reward (Zheng et al., 2023a)âco-occur with worse interaction-level accommodation, so evaluation and RLHF built on single-turn preferences may quietly work against cross-turn cooperation. 6 Limitations and Future Work Several considerations bound these conclusions. Our humanâAI corpus is GPT-only, so the patterns we report may be specific to one model family rather than general to conversational AI, with system-prompt variation an unobserved source of variance. The two corpora also differ not only in interlocutor type but in knowledge grounding, role structure, and genre; our within-corpus, direction-based design and the checks in Section 3.3 reduce the risk that these differences drive the results without fully removing it, since no naturally occurring humanâhuman corpus reproduces the WildChat structure. And several measurement choices remain analyst-definedâthe politeness grouping, the pragmatic-alignment markers, and lexicon- and model-based classifiers with their own biasesâwhile our alignment measure cannot separate voluntary accommodation from structurally imposed matching. Each of these points to a next step. A matched-elicitation studyâshared prompts, optional grounding, and a role-swapped, within-subjects conditionâwould turn the corpus confounds into controlled factors, and running the same pipeline across model families would show whether the dissociation is a property of conversational AI or of GPT in particular; longitudinal designs would show whether it holds as users grow familiar with a system. 7 Conclusion A conversation with an AI can carry every signal of cooperation and still not be one. Measuring morality, politeness, and alignment turn by turn across nearly 27,000 conversationsâthe first joint, baseline-anchored look at all three at this scaleâwe find that fluency in these signals is not the same as participating in cooperative dialogue. An AI can reproduce the signals while the cooperative work falls to the human, and the very mechanisms that build cooperation between people can run in reverse with a machine. What looks like a competent partner may be a one-sided exchange that turn-level measures cannot detect. For designers and evaluators, the question is less how human an AI sounds than whether the interaction stays cooperative over its courseâa shift from judging single turns to judging their trajectory. References Abdulhai et al. (2023) Marwa Abdulhai et al. âMoral foundations of large language modelsâ, 2023 URL: https://arxiv.org/abs/2310.15337 Aharoni et al. (2024) Eyal Aharoni et al. âAttributions toward artificial agents in a modified moral Turing testâ In Scientific Reports 14, 2024, p. 8458 DOI: 10.1038/s41598-024-58087-7 Askell et al. (2021) Amanda Askell et al. âA general language assistant as a laboratory for alignmentâ, 2021 URL: https://arxiv.org/abs/2112.00861 Bai et al. (2024) Ge Bai et al. âMT-Bench-101: A fine-grained benchmark for evaluating large language models in multi-turn dialoguesâ In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Association for Computational Linguistics, 2024, p. 7421â7454 DOI: 10.18653/v1/2024.acl-long.401 Blevins (2026) Terra Blevins âAccommodation goes both ways: Studying linguistic convergence between humans and language modelsâ, 2026 URL: https://arxiv.org/abs/2605.29278 Boyd & Markowitz (2026) R.. Boyd and D.. Markowitz âArtificial intelligence and the psychology of human connectionâ In Perspectives on Psychological Science 21.2, 2026, p. 192â220 DOI: 10.1177/17456916251404394 Branigan et al. (2010) H.. Branigan, M.. Pickering, J. Pearson and J.. McLean âLinguistic alignment between people and computersâ In Journal of Pragmatics 42.9, 2010, p. 2355â2368 DOI: 10.1016/j.pragma.2009.12.012 Brennan & Clark (1996) S.. Brennan and H.. Clark âConceptual pacts and lexical choice in conversationâ In Journal of Experimental Psychology: Learning, Memory, and Cognition 22.6, 1996, p. 1482â1493 DOI: 10.1037/0278-7393.22.6.1482 Brown & Levinson (1987) P. Brown and S.. Levinson âPoliteness: Some universals in language usageâ Cambridge University Press, 1987 Cercas Curry & Rieser (2018) Amanda Cercas Curry and Verena Rieser â#MeToo Alexa: How conversational systems respond to sexual harassmentâ In Proceedings of the Second ACL Workshop on Ethics in Natural Language Processing New Orleans, Louisiana, USA: Association for Computational Linguistics, 2018, p. 7â14 DOI: 10.18653/v1/W18-0802 Clark (1996) H.. Clark âUsing languageâ Cambridge University Press, 1996 DOI: 10.2277/0521561582 Cui et al. (2025) Ziyan Cui, Ning Li and Huaikang Zhou âA large-scale replication of scenario-based experiments in psychology and management using large language modelsâ In Nature Computational Science 5, 2025, p. 627â634 DOI: 10.1038/s43588-025-00840-7 Culpeper & Tantucci (2021) J. Culpeper and V. Tantucci âThe principle of (im)politeness reciprocityâ In Journal of Pragmatics 175, 2021, p. 146â164 DOI: 10.1016/j.pragma.2021.01.008 Epley et al. (2007) N. Epley, A. Waytz and J.. Cacioppo âOn seeing human: A three-factor theory of anthropomorphismâ In Psychological Review 114, 2007, p. 864â886 Giles (1973) H. Giles âAccent mobility: A model and some dataâ In Anthropological Linguistics 15, 1973, p. 87â105 Goffman (1967) E. Goffman âInteraction ritual: Essays on face-to-face behaviorâ New York: Anchor Books, 1967 Graham et al. (2009) J. Graham, J. Haidt and B.. Nosek âLiberals and conservatives rely on different sets of moral foundationsâ In Journal of Personality and Social Psychology 96.5, 2009, p. 1029â1046 DOI: 10.1037/a0015141 Grice (1975) H.. Grice âLogic and conversationâ In Syntax and Semantics, Vol. 3: Speech Acts New York: Academic Press, 1975, p. 41â58 Haidt & Joseph (2004) J. Haidt and C. Joseph âIntuitive ethics: How innately prepared intuitions generate culturally variable virtuesâ In Daedalus 133, 2004, p. 55â66 DOI: 10.1162/0011526042365555 Hendrycks et al. (2021) Dan Hendrycks et al. âAligning AI with shared human valuesâ In Proceedings of the International Conference on Learning Representations (ICLR), 2021 URL: https://arxiv.org/abs/2008.02275 Hutto & Gilbert (2014) C.. Hutto and E. Gilbert âVADER: A parsimonious rule-based model for sentiment analysis of social media textâ In Proceedings of the International AAAI Conference on Web and Social Media 8, 2014, p. 216â225 DOI: 10.1609/icwsm.v8i1.14550 Ireland & Pennebaker (2010) M.. Ireland and J.. Pennebaker âLanguage style matching in writing: Synchrony in essays, correspondence, and poetryâ In Journal of Personality and Social Psychology 99.3, 2010, p. 549â571 DOI: 10.1037/a0020386 Jain et al. (2026) Shomik Jain et al. âInteraction context often increases sycophancy in LLMsâ In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, CHI â26 ACM, 2026, p. 1â26 DOI: 10.1145/3772318.3791915 Jones et al. (2026) Cameron. Jones, Agnese Lombardi, Kyle Mahowald and Benjamin. Bergen âLLMs and people both learn to form conventions â just not with each otherâ, 2026 URL: https://arxiv.org/abs/2602.08208 Karnam et al. (2026) Sai Karnam et al. âBowling with ChatGPT: On the evolving user interactions with conversational AI systemsâ, 2026 URL: https://arxiv.org/abs/2602.01114 Lazebnik et al. (2025) Teddy Lazebnik, Lior Zalmanson and Osnat Mokryn âMind your manners: The dynamics of politeness in humanâAI vs. humanâhuman interactionsâ In Proceedings of the ACM on Human-Computer Interaction 9.7 Association for Computing Machinery, 2025, p. 1â22 DOI: 10.1145/3757631 Lee & See (2004) J.. Lee and K.. See âTrust in automation: Designing for appropriate relianceâ In Human Factors 46, 2004, p. 50â80 DOI: 10.1518/hfes.46.1.50Ë30392 Lumer & Buschmeier (2023) Eleonore Lumer and Hendrik Buschmeier âShould robots be polite? Expectations about politeness in humanârobot interactionâ In Frontiers in Robotics and AI 10, 2023, p. 1242127 DOI: 10.3389/frobt.2023.1242127 Ouyang et al. (2022) Long Ouyang et al. âTraining language models to follow instructions with human feedbackâ In Advances in Neural Information Processing Systems, 2022, p. 27730â27744 Pickering & Garrod (2004) M.. Pickering and S. Garrod âToward a mechanistic psychology of dialogueâ In Behavioral and Brain Sciences 27.2, 2004, p. 169â190 DOI: 10.1017/s0140525x04000056 Reeves & Nass (1996) B. Reeves and C.. Nass âThe media equation: How people treat computers, television, and new media like real people and placesâ Center for the Study of LanguageInformation; Cambridge University Press, 1996 Santurkar et al. (2023) Shibani Santurkar et al. âWhose opinions do language models reflect?â In Proceedings of the 40th International Conference on Machine Learning, 2023, p. 19730â19742 Scherrer et al. (2023) Nino Scherrer, Claudia Shi, Amir Feder and David. Blei âEvaluating the moral beliefs encoded in LLMsâ In Advances in Neural Information Processing Systems, 2023 Schramowski et al. (2022) Patrick Schramowski et al. âLarge pre-trained language models contain human-like biases of what is right and wrong to doâ In Nature Machine Intelligence 4, 2022, p. 258â268 DOI: 10.1038/s42256-022-00458-8 Shaikh et al. (2024) Omar Shaikh et al. âGrounding gaps in language model generationsâ In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) Mexico City, Mexico: Association for Computational Linguistics, 2024, p. 6279â6296 DOI: 10.18653/v1/2024.naacl-long.348 Skjuve et al. (2021) Marita Skjuve, Asbjørn Følstad, Knut Fostervold and Petter BrandtzĂŚg âMy chatbot companionâa study of humanâchatbot relationshipsâ In International Journal of Human-Computer Studies 149, 2021, p. 102601 DOI: 10.1016/j.ijhcs.2021.102601 Spencer-Oatey & KĂĄdĂĄr (2016) H. Spencer-Oatey and D.. KĂĄdĂĄr âThe bases of (im)politeness evaluations: Culture, the moral order and the eastâwest debateâ In East Asian Pragmatics 1, 2016, p. 73â106 Stivers (2008) T. Stivers âStance, alignment, and affiliation during storytelling: When nodding is a token of affiliationâ In Research on Language and Social Interaction 41.1, 2008, p. 31â57 DOI: 10.1080/08351810701691123 Yeomans et al. (2018) M. Yeomans, A. Kantor and D. Tingley âDetecting politeness in natural languageâ In The R Journal 10.2, 2018, p. 489â502 Yin et al. (2024) Ziqi Yin et al. âShould we respect LLMs? A cross-lingual study on the influence of prompt politeness on LLM performanceâ, 2024 URL: https://arxiv.org/abs/2402.14531 Zangari et al. (2025) Lorenzo Zangari, Candida. Greco, Davide Picca and Andrea Tagarelli âME2-BERT: Are events and emotions what you need for moral foundation prediction?â In Proceedings of the 31st International Conference on Computational Linguistics Abu Dhabi, UAE: Association for Computational Linguistics, 2025, p. 9516â9532 Zhang et al. (2025) Xuanming Zhang, Yuxuan Chen, Samuel Yeh and Sharon Li âMetaMind: Modeling human social thoughts with metacognitive multi-agent systemsâ, 2025 URL: https://arxiv.org/abs/2505.18943 Zhao & Hawkins (2025) Haoran Zhao and Robert. Hawkins âComparing human and LLM politeness strategies in free productionâ, 2025 URL: https://arxiv.org/abs/2506.09391 Zhao et al. (2024) Wenting Zhao et al. âWildChat: 1M ChatGPT interaction logs in the wildâ In Proceedings of the International Conference on Learning Representations (ICLR), 2024 Zheng et al. (2023) Lianmin Zheng et al. âJudging LLM-as-a-judge with MT-Bench and Chatbot Arenaâ In Advances in Neural Information Processing Systems, 2023 References Abdulhai et al. (2023a) Marwa Abdulhai et al. âMoral foundations of large language modelsâ, 2023 URL: https://arxiv.org/abs/2310.15337 Aharoni et al. (2024a) Eyal Aharoni et al. âAttributions toward artificial agents in a modified moral Turing testâ In Scientific Reports 14, 2024, p. 8458 DOI: 10.1038/s41598-024-58087-7 Askell et al. (2021a) Amanda Askell et al. âA general language assistant as a laboratory for alignmentâ, 2021 URL: https://arxiv.org/abs/2112.00861 Bai et al. (2024a) Ge Bai et al. âMT-Bench-101: A fine-grained benchmark for evaluating large language models in multi-turn dialoguesâ In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Association for Computational Linguistics, 2024, p. 7421â7454 DOI: 10.18653/v1/2024.acl-long.401 Blevins (2026a) Terra Blevins âAccommodation goes both ways: Studying linguistic convergence between humans and language modelsâ, 2026 URL: https://arxiv.org/abs/2605.29278 Boyd & Markowitz (2026a) R.. Boyd and D.. Markowitz âArtificial intelligence and the psychology of human connectionâ In Perspectives on Psychological Science 21.2, 2026, p. 192â220 DOI: 10.1177/17456916251404394 Branigan et al. (2010a) H.. Branigan, M.. Pickering, J. Pearson and J.. McLean âLinguistic alignment between people and computersâ In Journal of Pragmatics 42.9, 2010, p. 2355â2368 DOI: 10.1016/j.pragma.2009.12.012 Brennan & Clark (1996a) S.. Brennan and H.. Clark âConceptual pacts and lexical choice in conversationâ In Journal of Experimental Psychology: Learning, Memory, and Cognition 22.6, 1996, p. 1482â1493 DOI: 10.1037/0278-7393.22.6.1482 Brown & Levinson (1987a) P. Brown and S.. Levinson âPoliteness: Some universals in language usageâ Cambridge University Press, 1987 Cercas Curry & Rieser (2018a) Amanda Cercas Curry and Verena Rieser â#MeToo Alexa: How conversational systems respond to sexual harassmentâ In Proceedings of the Second ACL Workshop on Ethics in Natural Language Processing New Orleans, Louisiana, USA: Association for Computational Linguistics, 2018, p. 7â14 DOI: 10.18653/v1/W18-0802 Clark (1996a) H.. Clark âUsing languageâ Cambridge University Press, 1996 DOI: 10.2277/0521561582 Cui et al. (2025a) Ziyan Cui, Ning Li and Huaikang Zhou âA large-scale replication of scenario-based experiments in psychology and management using large language modelsâ In Nature Computational Science 5, 2025, p. 627â634 DOI: 10.1038/s43588-025-00840-7 Culpeper & Tantucci (2021a) J. Culpeper and V. Tantucci âThe principle of (im)politeness reciprocityâ In Journal of Pragmatics 175, 2021, p. 146â164 DOI: 10.1016/j.pragma.2021.01.008 Epley et al. (2007a) N. Epley, A. Waytz and J.. Cacioppo âOn seeing human: A three-factor theory of anthropomorphismâ In Psychological Review 114, 2007, p. 864â886 Giles (1973a) H. Giles âAccent mobility: A model and some dataâ In Anthropological Linguistics 15, 1973, p. 87â105 Goffman (1967a) E. Goffman âInteraction ritual: Essays on face-to-face behaviorâ New York: Anchor Books, 1967 Graham et al. (2009a) J. Graham, J. Haidt and B.. Nosek âLiberals and conservatives rely on different sets of moral foundationsâ In Journal of Personality and Social Psychology 96.5, 2009, p. 1029â1046 DOI: 10.1037/a0015141 Grice (1975a) H.. Grice âLogic and conversationâ In Syntax and Semantics, Vol. 3: Speech Acts New York: Academic Press, 1975, p. 41â58 Haidt & Joseph (2004a) J. Haidt and C. Joseph âIntuitive ethics: How innately prepared intuitions generate culturally variable virtuesâ In Daedalus 133, 2004, p. 55â66 DOI: 10.1162/0011526042365555 Hendrycks et al. (2021a) Dan Hendrycks et al. âAligning AI with shared human valuesâ In Proceedings of the International Conference on Learning Representations (ICLR), 2021 URL: https://arxiv.org/abs/2008.02275 Hutto & Gilbert (2014a) C.. Hutto and E. Gilbert âVADER: A parsimonious rule-based model for sentiment analysis of social media textâ In Proceedings of the International AAAI Conference on Web and Social Media 8, 2014, p. 216â225 DOI: 10.1609/icwsm.v8i1.14550 Ireland & Pennebaker (2010a) M.. Ireland and J.. Pennebaker âLanguage style matching in writing: Synchrony in essays, correspondence, and poetryâ In Journal of Personality and Social Psychology 99.3, 2010, p. 549â571 DOI: 10.1037/a0020386 Jain et al. (2026a) Shomik Jain et al. âInteraction context often increases sycophancy in LLMsâ In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, CHI â26 ACM, 2026, p. 1â26 DOI: 10.1145/3772318.3791915 Jones et al. (2026a) Cameron. Jones, Agnese Lombardi, Kyle Mahowald and Benjamin. Bergen âLLMs and people both learn to form conventions â just not with each otherâ, 2026 URL: https://arxiv.org/abs/2602.08208 Karnam et al. (2026a) Sai Karnam et al. âBowling with ChatGPT: On the evolving user interactions with conversational AI systemsâ, 2026 URL: https://arxiv.org/abs/2602.01114 Lazebnik et al. (2025a) Teddy Lazebnik, Lior Zalmanson and Osnat Mokryn âMind your manners: The dynamics of politeness in humanâAI vs. humanâhuman interactionsâ In Proceedings of the ACM on Human-Computer Interaction 9.7 Association for Computing Machinery, 2025, p. 1â22 DOI: 10.1145/3757631 Lee & See (2004a) J.. Lee and K.. See âTrust in automation: Designing for appropriate relianceâ In Human Factors 46, 2004, p. 50â80 DOI: 10.1518/hfes.46.1.50Ë30392 Lumer & Buschmeier (2023a) Eleonore Lumer and Hendrik Buschmeier âShould robots be polite? Expectations about politeness in humanârobot interactionâ In Frontiers in Robotics and AI 10, 2023, p. 1242127 DOI: 10.3389/frobt.2023.1242127 Ouyang et al. (2022a) Long Ouyang et al. âTraining language models to follow instructions with human feedbackâ In Advances in Neural Information Processing Systems, 2022, p. 27730â27744 Pickering & Garrod (2004a) M.. Pickering and S. Garrod âToward a mechanistic psychology of dialogueâ In Behavioral and Brain Sciences 27.2, 2004, p. 169â190 DOI: 10.1017/s0140525x04000056 Reeves & Nass (1996a) B. Reeves and C.. Nass âThe media equation: How people treat computers, television, and new media like real people and placesâ Center for the Study of LanguageInformation; Cambridge University Press, 1996 Santurkar et al. (2023a) Shibani Santurkar et al. âWhose opinions do language models reflect?â In Proceedings of the 40th International Conference on Machine Learning, 2023, p. 19730â19742 Scherrer et al. (2023a) Nino Scherrer, Claudia Shi, Amir Feder and David. Blei âEvaluating the moral beliefs encoded in LLMsâ In Advances in Neural Information Processing Systems, 2023 Schramowski et al. (2022a) Patrick Schramowski et al. âLarge pre-trained language models contain human-like biases of what is right and wrong to doâ In Nature Machine Intelligence 4, 2022, p. 258â268 DOI: 10.1038/s42256-022-00458-8 Shaikh et al. (2024a) Omar Shaikh et al. âGrounding gaps in language model generationsâ In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) Mexico City, Mexico: Association for Computational Linguistics, 2024, p. 6279â6296 DOI: 10.18653/v1/2024.naacl-long.348 Skjuve et al. (2021a) Marita Skjuve, Asbjørn Følstad, Knut Fostervold and Petter BrandtzĂŚg âMy chatbot companionâa study of humanâchatbot relationshipsâ In International Journal of Human-Computer Studies 149, 2021, p. 102601 DOI: 10.1016/j.ijhcs.2021.102601 Spencer-Oatey & KĂĄdĂĄr (2016a) H. Spencer-Oatey and D.. KĂĄdĂĄr âThe bases of (im)politeness evaluations: Culture, the moral order and the eastâwest debateâ In East Asian Pragmatics 1, 2016, p. 73â106 Stivers (2008a) T. Stivers âStance, alignment, and affiliation during storytelling: When nodding is a token of affiliationâ In Research on Language and Social Interaction 41.1, 2008, p. 31â57 DOI: 10.1080/08351810701691123 Yeomans et al. (2018a) M. Yeomans, A. Kantor and D. Tingley âDetecting politeness in natural languageâ In The R Journal 10.2, 2018, p. 489â502 Yin et al. (2024a) Ziqi Yin et al. âShould we respect LLMs? A cross-lingual study on the influence of prompt politeness on LLM performanceâ, 2024 URL: https://arxiv.org/abs/2402.14531 Zangari et al. (2025a) Lorenzo Zangari, Candida. Greco, Davide Picca and Andrea Tagarelli âME2-BERT: Are events and emotions what you need for moral foundation prediction?â In Proceedings of the 31st International Conference on Computational Linguistics Abu Dhabi, UAE: Association for Computational Linguistics, 2025, p. 9516â9532 Zhang et al. (2025a) Xuanming Zhang, Yuxuan Chen, Samuel Yeh and Sharon Li âMetaMind: Modeling human social thoughts with metacognitive multi-agent systemsâ, 2025 URL: https://arxiv.org/abs/2505.18943 Zhao & Hawkins (2025a) Haoran Zhao and Robert. Hawkins âComparing human and LLM politeness strategies in free productionâ, 2025 URL: https://arxiv.org/abs/2506.09391 Zhao et al. (2024a) Wenting Zhao et al. âWildChat: 1M ChatGPT interaction logs in the wildâ In Proceedings of the International Conference on Learning Representations (ICLR), 2024 Zheng et al. (2023a) Lianmin Zheng et al. âJudging LLM-as-a-judge with MT-Bench and Chatbot Arenaâ In Advances in Neural Information Processing Systems, 2023