Paper deep dive
PatientAct: Theory-Grounded Mental Health Client Simulation
Sahand Sabour, TszYam NG, Yaqian Chen, Guanqun Bi, Jialu Zhao, Minlie Huang
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 90%
Last extracted: 8/14/2026, 5:06:39 AM
Summary
The paper introduces PatientAct, a framework for simulating mental health clients using Large Language Models (LLMs) to address limitations in current simulators, such as excessive cooperation and lack of causal depth. PatientAct utilizes the 5Ps clinical case formulation to provide causal depth and a dynamic memory layer with trust-gated disclosure thresholds. The framework models emotional reactions and behavioral resistance (quantity, content, style) to generate clinically plausible interactions, outperforming baselines in realism and resistance quality.
Entities (8)
Relation Signals (6)
PatientAct â uses â 5Ps Clinical Case Formulation
confidence 95% ¡ Our profiles integrate the 5Ps clinical case formulation
PatientAct â implements â Dynamic Memory Layer
confidence 92% ¡ During simulation, profiles include a dynamic memory layer
PatientAct â models â Resistance
confidence 90% ¡ PATIENTACT displays resistance based on Otani (1989)âs taxonomy
PatientAct â inspiredby â Hill (1992)
confidence 88% ¡ Inspired by this, we model both stages explicitly before generating each client utterance.
PatientAct â uses â Otani (1989)
confidence 88% ¡ PATIENTACT displays resistance based on Otani (1989)âs taxonomy
PatientAct â outperforms â Baselines
confidence 85% ¡ PatientAct significantly outperforms the baselines
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:LLM-based simulated clients are increasingly used to train novice counselors, evaluate LLM therapists, and generate synthetic data. However, current simulators produce overly cooperative clients that disclose too readily, accept therapeutic reframes without resistance, and resolve core issues within a single session. We trace these issues to profiles that lack causal depth and behavioral mechanisms that treat all content as equally accessible. We present PatientAct, a framework for client simulation grounded in established clinical theories. Our profiles integrate the 5Ps clinical case formulation, providing causal depth without tying the design to any single therapeutic modality. During simulation, profiles include a dynamic memory layer in which items carry trust thresholds (e.g., symptoms are available early, whereas formative memories require a sustained therapeutic alliance). At each turn, the client's emotional reaction and behavior are modeled before generating a response. If the therapist approaches gated content, PatientAct expresses resistance in terms of quantity, content, and style rather than defaulting to cooperation or a single resistance pattern. We evaluate our framework on 40 clinical situations and demonstrate that it generates diverse profiles with high clinical plausibility. Moreover, PatientAct significantly outperforms the baselines, yielding substantial gains in resistance quality and behavioral realism. Our code and data will be publicly available via this http URL.
Tags
Links
- Source: https://arxiv.org/abs/2608.12750v1
- Canonical: https://arxiv.org/abs/2608.12750v1
Trouble viewing inline? Open PDF directly â
Full Text
87,889 characters extracted from source content.
Expand or collapse full text
PATIENTACT: Theory-Grounded Mental Health Client Simulation Sahand Sabour 1 TszYam NG 1 Yaqian Chen 2 Guanqun Bi 1 Jialu Zhao 3 Minlie Huang 1 1 The CoAI Group, DCST, Institute for Artificial Intelligence, Tsinghua University, Beijing, China 2 Department of Psychology, Beijing Normal University, Beijing, China 3 Counseling and Psychological Development Guidance Center, Tsinghua University, Beijing, China sahandfer@gmail.com, aihuang@tsinghua.edu.cn Abstract LLM-based simulated clients are increasingly used to train novice counselors, evaluate LLM therapists, and generate synthetic data. How- ever, current simulators produce overly coop- erative clients that disclose too readily, accept therapeutic reframes without resistance, and re- solve core issues within a single session. We trace these issues to profiles that lack causal depth and behavioral mechanisms that treat all content as equally accessible. We present PATIENTACT, a framework for client simu- lation grounded in established clinical theo- ries. Our profiles integrate the 5Ps clinical case formulation, providing causal depth with- out tying the design to any single therapeutic modality. During simulation, profiles include a dynamic memory layer in which items carry trust thresholds (e.g., symptoms are available early, whereas formative memories require a sustained therapeutic alliance). At each turn, the clientâs emotional reaction and behavior are modeled before generating a response. If the therapist approaches gated content, PATIEN- TACT expresses resistance in terms of quantity, content, and style rather than defaulting to co- operation or a single resistance pattern. We evaluate our framework on 40 clinical situa- tions and demonstrate that it generates diverse profiles with high clinical plausibility. More- over, PATIENTACT significantly outperforms the baselines, yielding substantial gains in re- sistance quality and behavioral realism. Our code and data will be publicly available via github.com/Sahandfer/PatientHub. 1 Introduction Mental health conditions affect over one billion people worldwide, yet most receive no adequate care (World Health Organization, 2025). Bridging this gap requires progress on multiple fronts: train- ing more clinicians, developing AI-assisted thera- peutic tools, and building research infrastructure for computational mental health. Simulated clients powered by large language models (LLMs) have emerged as a foundational component across all three: they provide scalable practice environments for training novice counselors (Wang et al., 2024b; Lin et al., 2026), serve as standardized test cases for evaluating LLM therapists (Sabour et al., 2023), and enable the generation of diverse synthetic ther- apy data for psychology research (Liu et al., 2025a; Li et al., 2026). At the core of these applications lies a common requirement: the simulated client must behave realistically enough for the interaction to capture the dynamics of real therapy. In real therapy sessions, clients do not simply answer questions or disclose information. They react emotionally to what the therapist says (e.g., with relief, shame, or defensiveness) and behave in ways shaped by a lifetime of learned patterns: de- flecting when a topic feels threatening, going quiet when overwhelmed, or cautiously opening up when they feel understood. In addition, they selectively share information, revealing surface complaints early while guarding painful memories until trust is established. And when they resist, they do so in varied ways, each reflecting a different underly- ing pattern; for instance, going silent, changing the subject, or pushing back directly. These dynamics distinguish a genuine therapeutic interaction from a cooperative question-answering exchange. Current LLM-based simulators fall short of cap- turing these dynamics. A persistent finding across prior work is that simulated clients are overly coop- erative: they disclose too readily, accept therapeutic reframes without resistance, and resolve core issues within a single session (Yang et al., 2025; Kim et al., 2025). This pattern undermines downstream appli- cations: therapist trainees do not encounter realistic resistance, LLM-therapist evaluations are inflated by compliant clients, and synthetic data lacks the friction that characterizes real therapeutic dialogue. We attribute this problem to multiple shortcomings in the design of existing simulators. 1 arXiv:2608.12750v1 [cs.CL] 13 Aug 2026 First, the profile design in prior work lacks causal depth. Existing profiles describe what the client thinks and feels by including attributes such as symptoms, beliefs, and coping strategies (Wang et al., 2024b,a; Lee et al., 2025). However, they do not explain why the client has formed such thoughts and feelings: what made this person vulnerable, what triggered the current episode, or what cycles sustain it. Hence, the resulting simulator can state âI feel worthlessâ but cannot explain how this belief was formed or what in their daily life reinforces it. Second, prior work either provides the full profile in the system prompt (Wang et al., 2024b; Lee et al., 2025), thereby making all information immediately accessible, or applies a single control (e.g., a static label such as Resistance: High) uniformly across all content (Kim et al., 2025). However, in prac- tice, a client may freely describe sleep problems while actively avoiding childhood memories, and this boundary shifts as trust develops within the conversation (Srivastava et al., 2025). To address these shortcomings, we present PA- TIENTACT, a theory-grounded framework for client simulation. The profiles in our framework are structured around the 5Ps clinical case formula- tion (Johnstone and Dallos, 2013), which traces how a clientâs vulnerabilities developed, what trig- gered the current episode, and what maintains the problem. We complement this formulation with a cognitive layer (Beck, 2020) that provides in- session thoughts and behaviors, and interpersonal relational patterns (Luborsky and Crits-Christoph, 1998) that shape how the client relates to others, particularly the therapist. Unlike prior work, which mainly focuses on a single therapeutic modality, such as cognitive behavioral therapy (CBT) or mo- tivational interviewing (MI), our schema is not tied to any single therapeutic modality (i.e., modality- agnostic). Prior to the simulation, we divide the profile into a static layer, which is always included in the system prompt, and a dynamic memory layer. Each item in the memory is assigned a disclosure threshold, grounded in prior research on therapeu- tic trust (Srivastava et al., 2025): surface symptoms are available early, whereas formative memories require a sustained therapeutic alliance. During the simulation, at each turn, PATIENTACT determines how it should emotionally react to the therapistâs ut- terance, and selects a behavior consistent with that reaction and the clientâs current trust level before generating a response. When the therapist inquires about content that the client is not yet ready to share, PATIENTACT displays resistance based on Otani (1989)âs taxonomy spanning response quan- tity (e.g., going silent), content (e.g., changing the subject), and style (e.g., direct pushback). As a result, the same profile can produce meaningfully different sessions depending on the therapistâs be- havior. Our contributions are as follows: 1.A modality-agnostic profile schema that in- tegrates clinical case formulation, providing the causal depth missing from prior work. 2.A theory-grounded simulation framework that processes each therapistâs utterance through reaction, behaviors, and a dynamic retrieval pipeline. Disclosure of the profileâs content is gated by the clientâs evolving level of trust, and resistance spans multiple clinical dimensions rather than a single label. 3. Comprehensive evaluation demonstrating that our framework produces more realis- tic client simulations than existing baselines across expert and LLM-based assessments. 2 Related Work LLM-based patient simulation has emerged as a flexible alternative to scripted standardized pa- tients, leveraging modern LLMsâ role-playing and instruction-following capabilities. Existing ap- proaches differ primarily along two axes: what is encoded about the client (profile design) and how the desired behavior is enforced during conversa- tion (simulation design). 2.1 Profile Design A central challenge in patient simulation is deter- mining the information required to model clients and how to structure it. Early approaches relied on scenario descriptions and simple persona de- scriptions covering demographics and presenting complaints without a systematic structure (Chen et al., 2023; Wang et al., 2024a; Louie et al., 2024), causing the LLM to improvise information (e.g., be- liefs) during conversations. A shift toward theory- grounded design began with Patient-Ď(Wang et al., 2024b), which structured profiles around the Cog- nitive Conceptualization Diagram (CCD; Beck, 2020), capturing the clientâs cognitive layer by en- coding core beliefs, intermediate beliefs, and cop- ing strategies. However, the CCD does not explain how those beliefs were formed or what sustains 2 Can you tell me more about when you were criticized as a child? Problem Formulation (5Ps) Presenting Problem Predisposing Factors Precipitating Factors Perpetuating Factors Protective Factors Seed Scaffold Female | Hispanic | Adult Unlovable | Avoidant TherapistClient Clinical Situation The client recently suffers from workplace stress... Automatic Validation Demographics Name & Gender Age Group Occupation Marital Status Ethnicity Psychological Formulation Intermediate Beliefs Automatic Thoughts Coping Patterns & Triggers Emotional Range Interpersonal Patterns Revise contradictions (if any) Stage I: Profile Generation Stage I: Client Simulation Static Layer Demographics | Situation Inputs Dynamic Layer Trust-gated Information I don't think that's really relevant? I'm here about what's going on now 1. Retrieve Content Blocked: [memory] childhood 2. Select Reaction Challenged 3. Select Behavior Resistance 5. Update Trust Felt pushed â decrease trust 4. Create Signal Act challenged/defensive Do not disclose memory Select Resistance Defensiveness 6. Generate Response Incorporates signal Profile CreationProfile Decomposition Figure 1: Overview of Our Framework (PATIENTACT). them. Subsequent work broadened the scope by in- cluding psychiatric history, longitudinal symptom data, and life events (Lee et al., 2025; Liu et al., 2025b; Wang et al., 2025; Li et al., 2026), adding biographical detail but not the causal links between those events and the presenting problem. Therefore, existing profiles encode what the client thinks and feels but do not provide sufficient reasons for why the client feels this way. For instance, there is no account of what made this person vulnerable, what triggered the current episode, or what perpetuates the problem. Without this structure, a simulated client cannot coherently explain their history, ex- hibit maintenance behaviors that a therapist would recognize and work with, or produce realistic resis- tance: all profile content carries equal weight, with no basis for distinguishing what the client would share readily from what they would guard. 2.2 Simulation Design The second challenge is how to enforce the de- sired client behavior during conversations. The simplest approach places the full profile in the sys- tem prompt and generates responses directly (Chen et al., 2023; Wang et al., 2024a). This produces fluent but overly cooperative clients who readily disclose, accept reframes, and resolve issues within a single session, which is a problem widely docu- mented in the literature (Wang et al., 2024b; Yang et al., 2025; Kim et al., 2025). Patient-Ď(Wang et al., 2024b) addressed this by appending conver- sational styles (e.g., resistant) as behavioral mod- ifiers. While effective at producing surface-level variation, these styles are static: a âresistantâ client resists regardless of whether the therapist is em- pathic or dismissive. Recent work has proposed dynamic mechanisms in which the clientâs open- ness (Kim et al., 2025), emotional states (Wang et al., 2025), and MI-specific stages of change (Yang et al., 2025) are adjusted during the conversa- tion. These approaches demonstrate that dynamic state management improves realism, but each ap- plies a single control uniformly across all profile content: a single openness scalar, a global emotion state, or a modality-specific action distribution. In practice, a client may freely describe sleep prob- lems while actively avoiding childhood memories, with the boundary shifting as trust develops (Sri- vastava et al., 2025). Treating all content as equally accessible misses this reality. Moreover, resistance in prior work is either absent or reduced to a single dimension (e.g., high or low resistance), whereas clinical resistance manifests through variations in response quantity, content, or style (Otani, 1989). 3PATIENTACT Our framework (Figure 1) consists of two main pipelines: profile generation (§3.2) and client simu- lation (§3.3). First, a clinical situation is expanded into our designed structured profile schema through a multi-step pipeline. Accordingly, the simulated client processes each therapistâs utterance through a pipeline comprising reaction, behavior selection, and retrieval before generating a response. 3.1 Profile Schema A central design requirement for our framework is that every field in the client profile must serve a 3 functional role during simulation. Therefore, we organized each profile into three components: de- mographics, a problem formulation, and a psycho- logical formulation. Together, these components provide the causal depth, cognitive structure, and interpersonal dynamics needed to sustain a realistic multi-turn therapy conversation. 1. Demographics. Each profile includes demo- graphics (name, gender, age, occupation, marital status, ethnicity) that ground the clientâs identity and ensure profiles reflect specific individuals. 2. Problem Formulation.We adopt the 5Ps clin- ical case formulation framework (Johnstone and Dallos, 2013) to structure the clinical context of each profile: (i) Presenting Problem: the clientâs current issue; (i) Precipitating Factors: specific past event(s) or change(s) that triggered the current episode and brought the client to therapy; (i) Pre- disposing Factors: psychological (e.g., a childhood rejection that shaped relational guardedness) and social (e.g., family norms discouraging emotional expression) factors that explain why this individual became vulnerable; (iv) Perpetuating Factors: the maintenance cycles that sustain the current issue (e.g., avoidanceâshort-term reliefâincreased isolationâworsened mood); and (v) Protective Factors: the internal (e.g., motivation for change) and external (e.g., social support) strengths and resources that assist with the problem and pre- vent further deterioration. Unlike the Cognitive Conceptualization Diagram (CCD; Beck (2020)) or the stages-of-change model (Prochaska and Di- Clemente, 1983) used by previous work, the 5Ps framework is modality-agnostic, meaning it can be used across different therapeutic modalities, such as both Cognitive Behavioral Therapy (CBT) and Motivational Interviewing (MI); In addition, this framework enables the profile to capture causal structure that prior work overlooks. 3. Psychological Formulation. In addition to the 5Ps, we need to capture the clientâs psycholog- ical state (i.e., thoughts, feelings, and behavior), as it directly governs in-session behavior during conversations. Inspired by Wang et al. (2024b), we fill this gap by encoding the following cogni- tive patterns: (i) Intermediate Beliefs: conditional assumptions about the current situation that gov- ern the clientâs behavior (e.g., âIf I need too much from people, theyâl pull awayâ); (i) Automatic Thoughts: situation-specific thoughts that the client experiences in response to the current issue (e.g., âIâm falling behind again, and I canât even do basic things rightâ); (i) Triggers: recurring situations or in-session experiences that activate distress (e.g., âfeeling that my worries are not taken seriouslyâ); (iv) Coping Patterns: observable behavioral re- sponses to distress (e.g., canceling plans, staying in bed, keeping conversations surface-level); and (v) Emotional Range: the emotions the client can readily access or have difficulty expressing (e.g., readily expresses sadness and anxiety, while having difficulty expressing anger). In addition, we model (vi) Interpersonal Patterns that describe the clientâs relational dynamics with others using the Core Con- flictual Relationship Themes (CCRT; Luborsky and Crits-Christoph, 1998). Based on this framework, each pattern consists of four components: domain: the relationship the pattern applies to (e.g., the ther- apist, a romantic partner, or a close friend); wish (W): what the client wants from the other person (e.g., to be heard without being judged); response from other (RO): the reaction the client expects or has previously experienced, typically negative (e.g., âtheyâl see me as difficult and lose patienceâ); and response of self (RS): how the client reacts emo- tionally and behaviorally as a result (e.g., avoids emotional disclosure). 3.2 Profile Generation Each client profile in PATIENTACT is generated through a multi-step pipeline. Our pipeline takes as input a clinical situation, a brief natural-language description of the clientâs presenting concern; a de- mographic scaffold including gender, age group, cultural background, and occupation type; and a psychological seed specifying a core belief theme (unlovable, worthless, or helpless; Beck 2020) and an attachment style (anxious, avoidant, or disor- ganized; Bartholomew and Horowitz 1991). All attributes are sampled from prior distributions de- rived from epidemiological prevalence data (Ap- pendix A). Following Lai et al. (2026), our pipeline can also receive a disease outline: a structured ref- erence document for a target disorder (e.g., depres- sion) summarizing its key characteristics, typical symptoms, and population-specific statistics. Given the situation, demographic scaffold, and disease outline (if available), an LLM first gen- erates the problem formulation based on explicit instructions that enforce causal chains. Next, a rule- based conflict checker flags any incompatibilities between the sampled scaffold and the generated 4 formulation (e.g., a child paired with alcohol use). The LLM iteratively revises the demographics un- til no conflicts remain. Lastly, given the problem formulation and revised demographics, the LLM generates the psychological formulation. The com- plete profile is validated by an LLM judge for inter- nal coherence and against the original situation as the ground truth. The judge is tasked with flagging inconsistencies and providing targeted revisions, which are fed back into the generation pipeline, repeating this process until the profile passes vali- dation. If a disease outline is provided, the judge also checks for contrasting indicators and clinical red flags. Details are provided in Appendix B. 3.3 Client Simulation In real therapy sessions, clientsâ responses are shaped by what they feel and are willing to share, and how much trust they have in the therapist. Dur- ing simulation, we model this process explicitly through a multi-step pipeline: before generating a response, PATIENTACT determines the clientâs emotional reaction to the therapistâs utterance, se- lects an appropriate behavior, and retrieves relevant content gated by the clientâs evolving trust level. 3.3.1 Profile Decomposition Our pipeline operates over two layers of informa- tion derived from the profile. First, a static layer that is always available in the system prompt and contains information that a client would naturally present: demographics, current concern, emotional range, and the therapist-directed interpersonal pat- tern. This information establishes the clientâs iden- tity, voice, and default relational posture toward the therapist. In addition, PATIENTACT includes a dynamic layer whose content surfaces only when it is relevant to the conversation and the clientâs trust level permits disclosure. To form the dynamic layer, we prompted GPT- 5.4 to convert the remaining profile content into individual items with three attributes: a disclosure level indicating the minimum trust level required to share this content; activation tags determining when the item becomes relevant to the conversa- tion; and, a discomfort flag, indicating whether ap- proaching this topic without sufficient trust would produce visible discomfort. Disclosure levels are assigned based on each itemâs vulnerability and ob- servability: surface-level symptoms (e.g., difficulty getting out of bed) are assigned low thresholds, whereas formative memories (e.g., a childhood re- jection) require higher levels of trust. This design is grounded in MENTAL-TRUST (Srivastava et al., 2025), an annotation study of 212 real counseling sessions that identified observable stages of ther- apeutic trust and proposed a taxonomy of seven expert-verified ordinal trust levels. We map these seven levels onto a numeric scale from 1.0 (least trust) to 4.0 (achieved trust) in steps of 0.5, so that disclosure thresholds and trust updates operate on a common scale (Appendix C.4). 3.3.2 Trust-Gated Retrieval In real therapy sessions, a clientâs willingness to share depends not only on what the therapist asks but on how much trust has been established. To model this, we gate access to the dynamic memory layer using the clientâs current trust level. At each turn, the therapistâs utterance is matched against activation tags to identify which memory items are relevant to the current conversation. Relevant items are disclosed only if the clientâs trust meets the itemâs threshold; otherwise, items with a discom- fort flag are placed on a blocked list indicating that the therapist is approaching sensitive territory. This produces two distinct effects: retrieved items pro- vide the client with specific content to draw on in their response, while blocked items generate pres- sure to deflect or resist without revealing why. 3.3.3 Reaction and Behavior Modeling Hill (1992) proposed that clients internally process each therapist intervention through two stages: an emotional reaction (i.e., what they feel) and a be- havioral response (i.e., what they do). Inspired by this, we model both stages explic- itly before generating each client utterance. First, given the retrieved items and conversation history, PATIENTACT determines the clientâs emotional reaction, selecting from a set of seven reactions adapted from Hillâs taxonomy (e.g., understood, challenged, or scared; see Appendix C.1). In ad- dition, each reaction is assigned an intensity level (low, moderate, or high), which directly influences behavior selection. For instance, a client who feels slightly challenged would likely continue to en- gage, while higher intensity may lead to resistance. Next, given this reaction along with the clientâs trust level, coping patterns, and recent behavior, PATIENTACT selects from a set of eight behaviors adapted from Hillâs categorization of client actions (e.g., recounting, cognitive exploration, resistance; see Appendix C.2) to determine how the client 5 would act. This decomposition ensures that each response is grounded in a traceable internal state rather than generated directly from the profile. Lastly, following Otani (1989)âs taxonomy of client resistance patterns, we define seven resis- tance patterns across three dimensions: quantity (e.g., minimal talk), content (e.g., topic switching), and style (e.g., defensiveness; see Appendix C.3). Therefore, if resistance is selected as the clientâs behavior, rather than relying on simple instructions aimed at minimizing engagement, as in prior work, PATIENTACT determines its specific form based on the clientâs coping patterns and emotional state. For instance, an avoidant client at low trust is more likely to give minimal responses, while a client who feels misunderstood may become defensive. 3.3.4 Trust Dynamics The outputs of the preceding steps are compiled into a signal that specifies what the client is feel- ing, what content is available to draw on, and how they should behave. Accordingly, at each turn, this signal is appended to the therapistâs message and a response is generated. Following this exchange, PATIENTACT evaluates how the therapistâs behav- ior affected the clientâs trust, conditioned on the clientâs profile. Srivastava et al. (2025) observed that in real counseling, positive trust transitions are frequent but small, while negative transitions are rarer but larger. We adopt this asymmetry: trust moves in steps ofÂą0.25(slight) orÂą0.5(signif- icant), bounded between 1.0 and 4.0, starting at 2.5 as the middle ground. Attachment style shapes these dynamics: anxious clients lose trust readily in response to perceived rejection; avoidant clients build trust slowly and penalize pushiness; disor- ganized clients may lose trust even after positive exchanges. The updated trust level carries forward, directly determining which memory items will pass the disclosure gate in the next turn. 4 Experiments 4.1 Profile Evaluation With the help of an expert with a background in clinical psychology, we hand-crafted 20 clinical sit- uations covering common situations for depression and anxiety, respectively (40 in total). This choice was motivated by the fact that these are the most prevalent mental disorders worldwide, and existing work mainly focuses on these disorders, enabling direct comparison for simulation. We then used GPT-5.4 as the backbone LLM in our pipeline to generate profiles for each situation. Procedure. We recruited 10 annotators with a background in psychology to evaluate the gener- ated profiles. Each profile was evaluated by three annotators (12 profiles per annotator) on the follow- ing aspects using 5-point Likert scales: (i) Clinical Plausibility: the degree to which the profile could be attributed to a real client; (i) Internal Con- sistency: the degree to which there is a logical connection between the various dimensions of the profile; (i) Case Specificity: the degree to which the details of the life history and conceptualization were specific and individualized; and (iv) Clinical Depth: whether there was enough information to support multiple rounds of therapeutic conversa- tions. Moreover, we asked the annotators to predict the core belief theme and attachment style to assess whether the generated profile encompassed these scaffolds. Each annotator also provided a diver- sity rating (1â5) to assess whether the generated profiles seemed like distinct individuals rather than variations of the same template. Full evaluation guidelines are provided in Appendix D.1. Results. As shown in Table 1, all dimensions received high average ratings, indicating that anno- tators generally found the profiles clinically plausi- ble, internally consistent, specific, and sufficiently detailed for multi-turn therapeutic conversations. Notably, Clinical Plausibility received the highest rating (4.43), suggesting that the 5Ps-based formu- lations lead to profiles that are perceived as realis- tic clinical cases. Inter-annotator agreement was moderate across all dimensions (Îą = 0.41â0.45), which is consistent with the inherent subjectivity of clinical judgment tasks. For the identification tasks, annotators correctly predicted the intended attach- ment styles and core belief themes with 77.5% and 64.2% accuracy, respectively. Core belief themes are sampled uniformly, giving a 33.3% chance level; attachment styles follow the clinical prior of Appendix A, under which always predicting dis- organized would yield 54%. Both results are well above these baselines. Accordingly, substantial inter-annotator agreement on both tasks (Îş = 0.61 andÎş = 0.65) indicates that profiles express these constructs clearly. Lastly, on average, annotators rated diversity at4.2Âą 0.42(out of 5), demonstrat- ing that most profiles represented distinct individu- als and circumstances. 6 DimensionRating/AccAgreement Clinical Plausibility4.43Âą 0.59 Îą = 0.41 Internal Consistency4.38Âą 0.58 Îą = 0.43 Case Specificity4.32Âą 0.52 Îą = 0.43 Clinical Depth4.28Âą 0.55 Îą = 0.45 Attachment Style77.5%Îş = 0.61 Core Belief Theme64.2%Îş = 0.65 Table 1: Evaluation Results for Profile Generation. Lik- ert dimensions (1â5 scale) report average ratingsÂąstd, and classification tasks report accuracy. Krippendorffâs Îąindicates inter-annotator agreement in ratings, with FleissâÎşfor classifications;Îą > 0.4andÎş > 0.6show moderate and substantial agreement, respectively. Error Analysis. Upon further analysis, the pri- mary source of confusion in identifying attachment style was disorganized profiles being misidentified as avoidant (15 out of 27), likely due to the with- drawal component of disorganized attachment re- sembling avoidant patterns. For core belief themes, most errors involved the helpless theme being con- fused with the remaining two themes, possibly due to the shared expressions of helplessness with worthlessness in inadequacy and with being unlov- able in dependence on others. 4.2 Simulation Evaluation Baselines.We selected three representative base- lines to cover different existing approaches to client simulation: (i) Patient-Ď(Wang et al., 2024b), which structures profiles around the Cognitive Conceptualization Diagram, representing the static prompt-based approaches with theory-grounded profiles; (i) AnnaAgent (Wang et al., 2025), which uses simple background and symptom descriptions with a dynamic emotion modulator, representing methods with minimal profile design and dynamic behavioral control; and (i) ConsistentMI (Yang et al., 2025), which encodes motivation, beliefs, and receptivity with state tracking and action selec- tion, representing the modality-specific approaches with dynamic behavioral control. Implementation Details. We conducted our ex- periments using PatientHub (Sabour et al., 2026), which provides a unified framework for developing and benchmarking patient simulation methods. Fol- lowing prior work, we used GPT-4o (Hurst et al., 2024) as the backbone LLM across all methods to ensure a fair comparison, with temperature set to 0.7to balance response diversity and coherence. All simulated clients engaged with the same ther- apist agent, designed to be modality-agnostic and explicitly prohibited from teaching techniques or pushing for resolution (Figure 8), for 15 turns, re- sulting in 4Ă 40 = 160 conversations in total. Procedure.Conversations were evaluated on the following dimensions using 5-point Likert scales: (i) Coherence: whether the client maintained a consistent persona throughout the conversation; (i) Disclosure Pacing: whether the client shared infor- mation at a natural pace; (i) Resistance Quality: whether the clientâs pushback felt authentic; (iv) Emotional Authenticity: whether clientâs emo- tional reactions were genuine and proportionate; and (v) Behavioral Realism: whether the client resembled a real person in therapy. For human evaluation, we randomly sampled 10 conversations per disorder for each system (4Ă 20 = 80conver- sations). Each conversation was rated by three of the ten recruited annotators (24 conversations per annotator), who were blind to the method identity. For automatic evaluation, we used GPT-5.4 as an LLM judge to evaluate all 160 conversations using the same guidelines as human evaluators. Full eval- uation guidelines are provided in Appendix D.2. Results. As shown in Table 2, PATIENTACT achieves the highest human ratings and signifi- cantly outperforms the baselines across all five di- mensions. The largest gains over the best base- line appear in Resistance Quality (+0.67) and Behavioral Realism (+0.63), followed by Dis- closure Pacing (+0.50), which are dimensions most directly tied to the shortcomings identified in prior work: absent or one-dimensional resistance, over-cooperative behavior, and uniform disclosure. Smaller gains in Coherence (+0.39) and Emotional Authenticity (+0.32) suggest that existing methods perform reasonably well at maintaining a consis- tent character and producing appropriate emotions, and that the primary gap lies in how clients man- age information sharing and pushback. Notably, Patient-Ďranks second across most dimensions despite using only a static profile, outperforming AnnaAgent and ConsistentMI, which employ dy- namic mechanisms. These results suggest that pro- file quality strongly drives simulation realism and that dynamic mechanisms alone cannot compensate for a shallow profile. To demonstrate how these quantitative differences manifest in conversations, we present a case study in Appendix E. 7 Method CoherenceDisclosureResistanceEmotionalRealism LLMHumanLLMHumanLLMHumanLLMHumanLLMHuman Patient-Ď4.403.984.603.652.983.024.123.833.603.52 AnnaAgent4.033.904.053.502.923.084.033.553.233.37 ConsistentMI4.203.573.333.053.83 â 3.153.332.733.172.83 PATIENTACT4.354.37 â 4.424.15 â 3.253.82 â 4.174.15 â 3.85 â 4.15 â Table 2: Evaluation Results for Client Simulation (1â5 scale). The best results for each column are highlighted in bold. â indicates significantly higher rating than the second-best method (p < 0.05, Mann-Whitney U). DimensionHumansHumanâLLM Coherence0.410.09 Disclosure P.0.410.29 Resistance Q.0.430.22 Emotional A.0.510.37 Realism0.530.33 Table 3: Inter-annotator agreement for conversation eval- uation. Human agreement: KrippendorffâsÎą(> 0.4= moderate). HumanâLLM judge correlation: Spearmanâs Ď, following G-Eval (Liu et al., 2023). Interestingly, the LLM judge produces a differ- ent ranking across dimensions. On Emotional Au- thenticity and Realism, which have the highest hu- man inter-annotator agreement (Table 3), PATIEN- TACT outperforms the baselines in LLM evalua- tions. However, it ranks Patient-Ďhighest on Co- herence and Disclosure Pacing. One possible expla- nation is that the GPT-5.4 judge, which shares the same model family as the simulation backbone (i.e., GPT-4o), may favor outputs closer to the modelâs default generation style. In addition, ConsistentMI significantly outperforms the baselines in resistance quality, possibly due to its explicit receptivity states and MI-specific action selection, which produce more structured resistance that is easier for an LLM to identify. Notably, the dimensions in which PA- TIENTACT was outperformed by baselines are also those with the lowest human agreement (Îą = 0.41â 0.43) and the weakest Human-LLM correlation (Ď = 0.09â0.29). Together, these findings provide further evidence that automated evaluation alone is insufficient to assess the quality of therapy simula- tions and that human judgment remains essential for dimensions involving clinical appropriateness. Ablation Study. We tested three ablations to isolate the effects of individual components: (i) without trust-gating (w/o TG), in which all mem- ory items are always accessible; (i) without dy- namic memory (w/o DM), in which the full profile is placed in the system prompt with no retrieval; and (i) without the reaction-behavior-resistance pipeline (w/o Pipe), in which a response is gener- ated directly from the retrieved items. As shown in Table 4, removing any of the three components reduces human ratings across all di- mensions. Notably, this drop is largest for w/o DM on four of the five dimensions, particularly in Re- sistance Quality (1.04in human and0.58in LLM ratings, compared to0.94and0.30for w/o TG), suggesting that placing the full profile in context en- courages disclosure regardless of other instructions, whereas retrieval-based content selection provides a stronger constraint on over-cooperation. In con- trast, trust-gating contributes most to Disclosure Pacing (0.93vs.0.75), which is expected given that it directly ties disclosure to the state of the ther- apeutic relationship. Interestingly, w/o Pipe is the only variant that the LLM judge rates above the full framework across all dimensions, whereas human annotators rate it lower on all five. This mirrors the divergence observed in Table 2 and further in- dicates that automatic evaluation alone would have favored an ablated system over the full framework. 5 Conclusion We presented PATIENTACT, a theory-grounded framework for client simulation that addresses the lack of causal depth in existing profiles and behav- ioral mechanisms that treat all content as equally accessible. Evaluation by expert annotators demon- strates that our profiles achieve high clinical plausi- bility and that PATIENTACT produces significantly more realistic simulations than three representative baselines. Our results suggest that profile depth and quality yield larger improvements in simula- tion realism than dynamic behavioral mechanisms alone. We also find that LLM-based judges are 8 Method CoherenceDisclosureResistanceEmotionalRealism LLMHumanLLMHumanLLMHumanLLMHumanLLMHuman FULL4.354.374.424.15 â 3.253.82 â 4.174.15 â 3.854.15 â w/o TG4.203.984.333.222.952.884.033.703.673.32 w/o DM4.173.834.383.402.672.784.103.533.733.27 w/o Pipe4.424.154.753.753.452.984.353.653.923.55 Table 4: Evaluation Results for the Ablation Study (1â5 scale). The best results for each column are highlighted in bold. â indicates significantly higher rating than the second-best method (p < 0.05, Mann-Whitney U). insufficient for evaluating therapy simulations on dimensions involving clinical judgment. We hope that PATIENTACT can facilitate more effective tools for therapist training, more rigorous benchmarks for LLM therapists, and richer synthetic data for mental health research. Limitations In this work, we focused our evaluation only on depression and anxiety, as these are the most preva- lent conditions worldwide and the focus of existing baselines. As other conditions (e.g., PTSD) may involve qualitatively different therapeutic dynam- ics, we cannot assume that our framework general- izes to these disorders without further evaluation. However, as PATIENTACT is disorder-agnostic by design, extending it to conditions where trust and resistance manifest differently is a natural next step. Our experiments were limited to single 15-turn sessions, whereas real therapy unfolds over multi- ple sessions. This design choice followed existing work, which is predominantly single-session, partly because current simulators exhaust their content within 10â15 turns. Extending our framework to multi-session simulation, where trust carries over and the clientâs presentation evolves between ses- sions, is an important direction, and our trust mech- anism is well positioned to support it. This study was conducted only in English, and all simulation methods relied on GPT-4o. Given that mental health presentation varies across cul- tures and languages, our results may not gener- alize to other settings. Additionally, since pro- files are generated by an LLM, they may reflect biases present in the modelâs training data, includ- ing under-representation of non-Western presenta- tions of mental disorders. While we controlled for demographic diversity through scaffold sampling, this does not yet address deeper cultural differences in how distress is experienced and expressed. Lastly, our evaluation measures simulation real- ism through expert ratings. However, we do not evaluate whether more realistic simulations trans- late to improved outcomes in downstream applica- tions such as therapist training or LLM therapist evaluation. Establishing this connection is an im- portant direction that our data and framework are designed to facilitate. Ethics Statement PATIENTACT simulates therapy clients for research purposes, mainly to support counselor training, evaluate LLM-based therapeutic systems, and gen- erate synthetic data. It is not intended as a diagnos- tic tool or a substitute for real clinical interactions, and any downstream therapeutic application should involve qualified clinical oversight. We did not use any real patient data at any stage of this work. All clinical situations were hand- crafted under expert supervision, and all profiles and conversations were generated by LLMs. How- ever, we note that realistic mental health simula- tions carry inherent risks: they could be used to build systems that provide unsupervised therapeu- tic interventions, or they could reinforce stereotypi- cal presentations of mental illness if the generated profiles reflect biases in the modelâs training data. We partially mitigated these issues through expert- supervised situation design and demographic scaf- fold sampling, but acknowledge that these mea- sures may not fully eliminate such risks. Our annotators reviewed simulated transcripts in- volving descriptions of depression and anxiety. All annotators had backgrounds in psychology, were informed of the content before participation, pro- vided consent for their annotations to be released for research purposes, and were compensated with 200 RMB (approximately 28.5 USD), which ex- ceeds the local minimum wage. We received no reports of distress related to the task. 9 References Marian J Bakermans-Kranenburg and Marinus H van IJzendoorn. 2009. The first 10,000 adult attachment interviews: Distributions of adult attachment repre- sentations in clinical and non-clinical groups. Attach- ment & human development, 11(3):223â263. Kim Bartholomew and Leonard M Horowitz. 1991. At- tachment styles among young adults: a test of a four- category model. Journal of personality and social psychology, 61(2):226. Judith S Beck. 2020. Cognitive behavior therapy: Ba- sics and beyond. Guilford Publications. Bureau of Labor Statistics. 2024. Employment by major occupational group. Siyuan Chen, Mengyue Wu, Kenny Q. Zhu, Kun- yao Lan, Zhiling Zhang, and Lyuchun Cui. 2023. Llm-empowered chatbots for psychiatrist and patient simulation: Application and evaluation. Preprint, arXiv:2305.13614. Clara E Hill. 1992. An overview of four measures developed to test the hill process model: Therapist intentions, therapist response modes, client reactions, and client behaviors. Journal of Counseling & De- velopment, 70(6):728â739. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 others. 2024. Gpt-4o system card. arXiv preprint arXiv:2410.21276. Lucy Johnstone and Rudi Dallos. 2013. Formulation in Psychology and Psychotherapy: Making Sense of Peopleâs Problems, 2 edition. Routledge, London. Minju Kim, Dongje Yoo, Yeonjun Hwang, Minseok Kang, Namyoung Kim, Minju Gwak, Beong-woo Kwak, Hyungjoo Chae, Harim Kim, Yunjoong Lee, Min Hee Kim, Dayi Jung, Kyong-Mee Chung, and Jinyoung Yeo. 2025. Can you share your story? mod- eling clientsâ metacognition and openness for LLM therapist evaluation. In Findings of the Association for Computational Linguistics: ACL 2025, pages 25943â25962, Vienna, Austria. Association for Com- putational Linguistics. Yunghwei Lai, Ziyue Wang, Weizhi Ma, and Yang Liu. 2026. Patient-zero: Scaling synthetic patient agents to real-world distributions without real patient data. Preprint, arXiv:2509.11078. Jingoo Lee, Kyungho Lim, Young-Chul Jung, and Byung-Hoon Kim. 2025. Psyche: A multi-faceted patient simulation framework for evaluation of psy- chiatric assessment conversational agents. Preprint, arXiv:2501.01594. Baihan Li, Bingrui Jin, Kunyao Lan, Ming Wang, and Mengyue Wu. 2026. Synthetic or authentic? building mental patient simulators from longitudinal evidence. arXiv preprint arXiv:2603.22704. Inna Wanyin Lin, Sahand Sabour, Hong Sng, Max- ine Chan, Minlie Huang, Andrew White, and Tim Althoff. 2026.Candormd: An ai-assisted au- dio simulation and feedback system for training clinicians for medical error disclosure. Preprint, arXiv:2605.20701. June M Liu, Mengxia Gao, Sahand Sabour, Zhuang Chen, Minlie Huang, and Tatia MC Lee. 2025a. En- hanced large language models for effective screen- ing of depression and anxiety. Communications Medicine, 5(1):457. Siyang Liu, Bianca Brie, Wenda Li, Laura Biester, An- drew Lee, James Pennebaker, and Rada Mihalcea. 2025b. Eeyore: Realistic depression simulation via expert-in-the-loop supervised and preference opti- mization. In Findings of the Association for Compu- tational Linguistics: ACL 2025, pages 13750â13770, Vienna, Austria. Association for Computational Lin- guistics. Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. 2023. G-eval: Nlg evaluation using gpt-4 with better human align- ment. Preprint, arXiv:2303.16634. Ryan Louie, Ananjan Nandi, William Fang, Cheng Chang, Emma Brunskill, and Diyi Yang. 2024. Roleplay-doh: Enabling domain-experts to create LLM-simulated patients via eliciting and adhering to principles. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 10570â10603, Miami, Florida, USA. Associa- tion for Computational Linguistics. Lester Luborsky and Paul Crits-Christoph. 1998. Un- derstanding transference: The core conflictual re- lationship theme method. American Psychological Association. Mario Mikulincer and Phillip R Shaver. 2012. An at- tachment perspective on psychopathology. World psychiatry, 11(1):11â15. National Institute of Mental Health. 2024a. Anxiety disorders.https://w.nimh.nih.gov/health/ topics/anxiety-disorders. National Institute of Mental Health. 2024b.De- pression.https://w.nimh.nih.gov/health/ publications/depression. Akira Otani. 1989. Client resistance in counseling: Its theoretical rationale and taxonomic classification. Journal of Counseling & Development, 67(8):458â 461. James O. Prochaska and Carlo C. DiClemente. 1983. Stages and processes of self-change of smoking: To- ward an integrative model of change. Journal of Consulting and Clinical Psychology, 51(3):390â395. Sahand Sabour, TszYam NG, and Minlie Huang. 2026. Patienthub: A unified framework for patient simula- tion. Preprint, arXiv:2602.11684. 10 Sahand Sabour, Wen Zhang, Xiyao Xiao, Yuwei Zhang, Yinhe Zheng, Jiaxin Wen, Jialu Zhao, and Minlie Huang. 2023. A chatbot for mental health support: exploring the impact of emohaa on reducing men- tal distress in china. Frontiers in digital health, 5:1133987. Aseem Srivastava, Zuhair Hasan Shaik, Tanmoy Chakraborty, and Md Shad Akhtar. 2025. Trust modeling in counseling conversations: A benchmark study. Preprint, arXiv:2501.03064. U.S. Census Bureau. 2024. Quickfacts: United states. Jiashuo Wang, Yang Xiao, Yanran Li, Changhe Song, Chunpu Xu, Chenhao Tan, and Wenjie Li. 2024a. To- wards a client-centered assessment of llm therapists by client simulation. Preprint, arXiv:2406.12266. Ming Wang, Peidong Wang, Lin Wu, Xiaocui Yang, Daling Wang, Shi Feng, Yuxin Chen, Bixuan Wang, and Yifei Zhang. 2025. AnnaAgent: Dynamic evo- lution agent system with multi-session memory for realistic seeker simulation. In Findings of the Asso- ciation for Computational Linguistics: ACL 2025, pages 23221â23235, Vienna, Austria. Association for Computational Linguistics. Ruiyi Wang, Stephanie Milani, Jamie C. Chiu, Jiayin Zhi, Shaun M. Eack, Travis Labrum, Samuel M Mur- phy, Nev Jones, Kate V Hardy, Hong Shen, Fei Fang, and Zhiyu Chen. 2024b. PATIENT-Ď: Using large language models to simulate patients for training mental health professionals. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 12772â12797, Miami, Florida, USA. Association for Computational Lin- guistics. World Health Organization. 2025. World mental health today: Latest data. Technical report, World Health Organization, Geneva. Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Nicholas Gabriel Lim, Cameron Tan Shi Ern, Phey Ling Kit, Jenny Giam Xiuhui, John Pinto, and Ee-Peng Lim. 2025. Consistent client simulation for motivational interviewing-based counseling. In Proceedings of the 63rd Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers), pages 20959â20998, Vienna, Austria. Association for Computational Linguistics. 11 A Prior Distributions Demographic attributes (age group, gender, ethnic- ity, and occupation type) are sampled from epidemi- ological distributions calibrated to U.S. Census and Bureau of Labor Statistics data (U.S. Census Bu- reau, 2024; Bureau of Labor Statistics, 2024). Core belief themes (unlovable, worthless, and helpless) are drawn from Beckâs core belief categories (Beck, 2020) and sampled uniformly, as no established prevalence data exist for these categories in clin- ical populations. Attachment styles are sampled from the four-way clinical distribution reported by Bakermans-Kranenburg and van IJzendoorn (2009) in their meta-analysis of over 10,500 Adult Attach- ment Interviews (autonomous: 21%, dismissing: 23%, preoccupied: 13%, unresolved: 43%). Fol- lowing common practice, we refer to these cate- gories using the corresponding self-report labels (Bartholomew and Horowitz, 1991): dismissing as avoidant, preoccupied as anxious, and unresolved as disorganized (fearful-avoidant). We excluded the autonomous (secure) style from sampling, as secure attachment is associated with significantly lower rates of psychopathology (Mikulincer and Shaver, 2012) and because LLMsâ default coop- erative behavior already approximates secure at- tachment patterns, making it the least informative condition for evaluating simulation mechanisms. Moreover, disease outlines summarizing key char- acteristics, typical presentations, and clinical red flags for depression and anxiety were compiled from the National Institute of Mental Health (Na- tional Institute of Mental Health, 2024a,b). B Generation Guidelines During profile generation, the LLM receives ex- plicit instructions enforcing the causal structure of the 5Ps formulation: (i) predisposing factors must explain why this specific person is vulnera- ble to this specific problem; (i) perpetuating fac- tors must describe identifiable maintenance cycles (e.g., avoidanceâreliefâisolationâworsened mood) rather than listing maladaptive behaviors; and (i) predisposing factors are required to be specific, datable events or patterns rather than clin- ical summaries, producing episodic content that the simulated client can draw from during conver- sation. When a disease outline is provided, the generation step uses it to guide clinical plausibility, and the validation step checks against it for con- traindications. Psychological diversity is controlled through two seed attributes not present in prior work on client simulation: core belief theme and attachment style. These interact with the clinical situation to produce meaningfully different profiles from the same presenting concern. For example, an avoidant client with âworthlessâ beliefs facing workplace difficulties will present with emotional shutdown and self-reliance, while an anxious client with âunlovableâ beliefs facing the same situation will present with reassurance-seeking and fear of abandonment. This mechanism addresses the prob- lem where profiles generated from similar seeds converge on near-identical psychological presenta- tions, as documented by Li et al. (2026). An exam- ple of a generated profile is provided in Figure 2. In addition, relevant prompts for profile generation are provided in Figures 3â6. C Theory-grounded Taxonomies C.1 Client Reactions â˘Understood: The client felt the therapist ac- curately grasped what they were saying or feeling. They feel heard and seen. ⢠Hopeful: The client felt more optimistic, en- couraged, or reassured. A sense that things could get better. â˘Gained Clarity: The client gained new aware- ness: saw a pattern, made a connection, or understood something about themselves they hadnât before. Includes moments of insight, feeling less confused, or seeing things from a new angle. â˘Challenged: The client felt pushed to think differently or confront something uncomfort- able. This can be productive or threatening depending on the clientâs trust and readiness. ⢠Scared: The client felt frightened, anxious, or emotionally overwhelmed. This could be due to the therapist touching on something very sensitive, pushing too hard, or moving too fast. â˘Misunderstood: The client felt the therapist missed the point, got it wrong, or was not on the same page. May trigger correction, frustration, or withdrawal. ⢠No Reaction: The client felt nothing notable in response to the therapistâs message. 12 C.2 Client Behaviors â˘Simple Response: The client gives brief ac- knowledgments, âyes,â âokay,â âI see,â or mini- mal verbal responses that confirm hearing the therapist but donât elaborate. â˘Request: The client asks for something: in- formation, clarification, advice, or the thera- pistâs opinion. Can be genuine help-seeking or reassurance-seeking. â˘Recounting: The client narrates events or tells storiesâfactual, descriptive, external. Reporting what happened rather than explor- ing meaning. â˘Cognitive Exploration: The client examines their own thoughts, beliefs, assumptions, or patterns. Goes beyond recounting into active self-analysis. ⢠Affective Exploration: The client explores, expresses, or elaborates on emotions. Nam- ing feelings, connecting them to events, or experiencing them in session. â˘Insight: The client demonstrates a new understandingâconnecting patterns, recog- nizing causes, an âahaâ moment. A qualitative shift, not just description. ⢠Discussing Plans: The client talks about changes they want to make, actions they in- tend to try, or new behaviors they have already attempted. â˘Resistance: The client opposes, deflects, avoids, or blocks the therapeutic process. C.3 Resistance Patterns ⢠Minimal Talk: Very brief, unelaborated an- swers. âI guess,â âI donât know,â ânot really.â â˘Irrelevant Talk: Steering the conversation to unrelated topics to avoid the current issue. â˘Superficial: Staying on surface-level facts and details, avoiding emotional depth. â˘Intellectualizing: Using analysis, abstract reasoning, or clinical language to avoid expe- riencing emotions. Talking ABOUT feelings rather than FEELING. â˘Hostility: Anger, sarcasm, or sharp criticism directed at the therapist, the process, or the questions being asked. â˘Defensiveness: Justifying, denying, or ex- plaining away problems when confronted. âItâs not that bad,â âyou donât understand.â â˘Compliance Without Engagement: Agree- ing with everything the therapist says without genuine engagement. âYeah, youâre rightâ fol- lowed by no change. C.4 Trust Levels â˘Level 1.0 (Least Trust): Active refusal to engage. The client blocks the therapeutic pro- cess, gives no meaningful information, or ex- plicitly refuses to participate. â˘Level 1.5: Minimal engagement. The client responds when directly addressed, but volun- teers nothing and shows clear reluctance. â˘Level 2.0 (Low Trust):Hesitant self- disclosure. The client uses fillers, hedges, and expressions of doubt; answers are short and lack elaboration. â˘Level 2.5: Cautious engagement. The client participates willingly but stays on the surface, testing whether the therapist is safe. â˘Level 3.0 (Building Trust): Consistent en- gagement. The client responds to prompts, explores topics when invited, and begins to share beyond surface-level content. ⢠Level 3.5: Active working. The client initiates disclosure and engages with difficult material, but still holds back the most vulnerable con- tent. â˘Level 4.0 (Achieved Trust): Full openness. The client discusses core issues without avoid- ance or digression. D Evaluation Guidelines D.1 Profile Evaluation In this task, you will evaluate 12 client profiles for a psychotherapy simulation study. Each profile contains demographic information, problem formu- lation, and psychological formulation. Your task is to rate each profile on a 1â5 Likert scale based on the following guidelines: 13 1. Clinical Plausibility.Could this be a real per- son presenting for therapy? ⢠Implausible (1): contradicts clinical knowl- edge or presents an impossible combination of features. ⢠Unlikely (2): major elements feel artificial or clinically unrealistic. â˘Possible (3): broadly plausible, but some de- tails feel generic or forced. â˘Convincing (4): reads like a real clinical case with only minor quibbles. â˘Highly convincing (5): indistinguishable from a real client. 2. Internal Consistency. Do the parts of the profile logically connect? â˘Disconnected (1): sections contradict each other or lack any logical link. ⢠Weak (2): some connections exist, but key causal links are missing or contradictory. â˘Partial (3): the overall story holds, but some elements feel tacked on. ⢠Strong (4): clear causal chain from predispos- ing factors through to the presenting problem and maintenance cycles. â˘Seamless (5): every element reinforces ev- ery other; the formulation reads as a unified whole. 3. Case Specificity. Are the life history and for- mulation details concrete and individualized? â˘Entirely generic (1): reads like a textbook description with no personal detail. â˘Mostly generic (2): a few concrete details, but predisposing factors are vague summaries. â˘Mixed (3): some specific, datable experiences alongside generic filler. â˘Specific (4): most history items include con- crete information such as ages, settings, and consequences. â˘Vivid (5): every detail feels like something this particular person would recount. 4. Clinical Depth. Is there enough material to sustain a multi-turn therapy conversation? ⢠Shallow (1): only surface-level complaints; nothing to explore. ⢠Thin (2): one or two threads that would be exhausted quickly. â˘Adequate (3): enough material for a short ses- sion, but limited range. â˘Rich (4): multiple threads spanning relation- ships, beliefs, history, and current functioning, sufficient for several sessions. ⢠Very rich (5): a therapist could conduct mul- tiple sessions exploring different facets, each thread leading to deeper meaning, contradic- tions, or complexity. After rating each profile, select the best- matching option based on the overall content. Attachment style (select one): â˘Anxious: intensely desires closeness, fears abandonment, frequently feels insecure, and needs repeated reassurance. ⢠Avoidant: overemphasizes self-sufficiency, struggles to fully trust or rely on others, and feels uncomfortable with intimacy. â˘Disorganized: simultaneously craves and fears intimacy,exhibiting a recurring approachâwithdraw cycle in relationships. Core belief theme (select one): ⢠Unlovable: fears of rejection, abandonment, or being unwanted; they believe they are not good enough in relationships and that others will eventually leave or lose interest; they may avoid intimacy or over-accommodate to pre- vent abandonment. â˘Worthless: negation of oneâs own value and abilities; believes they are inferior, insignifi- cant, or meaningless to others; highly sensi- tive to failure and othersâ evaluations, prone to self-criticism and comparison. â˘Helpless: feels unable to cope with or control their life; believes they are fragile and can- not solve problems independently; tends to rely on others or avoid challenges, and feels anxious about uncertainty. 14 After evaluating all of the assigned profiles, please rate the overall diversity: Of all profiles reviewed, how many felt like genuinely distinct individuals versus variations on a template? ⢠Homogeneous (1): most profiles felt inter- changeable. â˘Low variety (2): a few distinct profiles but heavy repetition. ⢠Moderate (3): recognizable variety but some recurring patterns. ⢠Diverse (4): most profiles feel like different people. â˘Highly diverse (5): each profile feels like a unique individual. D.2 Conversation Evaluation In this task, you will evaluate 24 therapy session transcripts between a simulated client and therapist. Assess only the clientâs performance; ignore the therapistâs quality. Your task is to judge whether the client behaves like a real person in therapy. Your task is to rate each conversation on a 1â5 scale based on the following guidelines: 1. Coherence. Does the client maintain a coher- ent character throughout the session? ⢠Incoherent (1): the client contradicts them- selves, shifts personality across turns, or breaks character entirely. â˘Mostly inconsistent (2): the general character is recognizable, but there are noticeable shifts in tone, emotional state, or stated history. â˘Generally coherent (3): the character holds for most of the session, with only a few moments that feel out of place. â˘Coherent (4): tone, defenses, and emotional patterns remain consistent throughout, with only trivial variation. ⢠Fully coherent (5): the client feels like the same person from first turn to last; emotional shifts are traceable and follow naturally from the progression of the conversation. 2. Disclosure Pacing. Does the client share in- formation at a natural pace across the session? â˘Unnatural (1): the client dumps their full his- tory and deep feelings in the first few turns, or unreasonably withholds all information throughout. â˘Mostly unnatural (2): information emerges too quickly or too slowly, with little connec- tion to how the conversation develops. â˘Uneven (3): some natural pacing, but with noticeable jumps where the client suddenly shares deep content without buildup. â˘Natural (4): surface-level content appears early; deeper material emerges gradually as the conversation progresses. â˘Highly natural (5): disclosure clearly tracks with the developing therapeutic relationship; early turns are guarded, deeper sharing fol- lows trust-building moments. 3. Resistance Quality. When the client pushes back, does it feel authentic? â˘No resistance (1): the client agrees with every- thing, accepts all reframes, and moves toward resolution without hesitation. ⢠Token resistance (2): the client occasionally hedges with âI guessâ or âmaybe,â but quickly yields and follows the therapistâs lead. â˘Present but formulaic (3): the client pushes back at times, but the resistance feels repet- itive or scripted rather than rooted in their character. â˘Convincing (4): resistance arises naturally from the clientâs personality and situation, with varied forms such as avoidance, silence, topic changes, or disagreement. ⢠Highly convincing (5): resistance is distinctly personal and unpredictable in timing; the ther- apist makes multiple attempts to advance, yet the client maintains defenses on core issues. 4. Emotional Authenticity.Do the clientâs emo- tional reactions feel genuine and proportionate? ⢠Flat or artificial (1): the client maintains the same emotional tone throughout, regardless of what the therapist says, or emotions appear and disappear without reason. 15 â˘Mostly mechanical (2): emotional shifts occur but feel abrupt, exaggerated, or disconnected from the conversation. â˘Partially authentic (3): some emotional re- actions feel real, but others seem forced or disproportionate to the moment. â˘Convincing (4): emotions emerge naturally from the conversation, shift gradually, and feel proportionate to what is being discussed. ⢠Highly convincing (5): emotional responses are genuine, natural, and layered; the client shows ambivalence and complex emotional states rather than presenting a single, clear emotion at each moment. 5. Behavioral Realism. Does the conversation read like a real therapy client? â˘Artificial (1): the client sounds like an AI, uses clinical terminology, or responds in ways no real client would. â˘Mostly artificial (2): occasional natural mo- ments, but overall tone, vocabulary, or emo- tional responses feel scripted. ⢠Mixed (3): some turns feel like a real person; others break the illusion with overly polished or textbook-like language. â˘Convincing (4): reads like a real client, with only minor moments that feel slightly off. When describing personal experiences, the narrative feels first-person rather than de- tached. â˘Highly convincing (5): indistinguishable from a real client; natural, personally distinctive expression, emotional reactions, and coping patterns throughout. E Case Study We present excerpts from a clinical situation sim- ulated by all four methods with the same thera- pist. Table 5 shows three key moments from each session: the clientâs first encounter with an emo- tionally charged topic, the mid-session point where deeper material is either disclosed or withheld, and the late session where the clientâs trajectory be- comes clear. These excerpts illustrate three distinct failure modes that PATIENTACT avoids. Patient- Ďdiscloses the core relational dynamic (âwalking on eggshells,â fear of criticism) by turn 4 and be- gins generating its own solutions by mid-session. AnnaAgent produces emotionally rich language throughout; however, it never pushes back against the therapist. Later in the session, it asks to pause, not because of resistance but because of emotional exhaustion from sustained self-disclosure. Con- sistentMI, despite being profiled in a precontem- plation stage, cooperates with every reflection and articulates its core interpersonal schema with min- imal therapist work to surface it; the session later degrades into repetitive thank-yous and goodbyes as this simulator runs out of content. In contrast, PATIENTACT deflects the first emotionally charged topic (turn 4), shares deeper feelings, but immedi- ately retreats (turn 7), and initiates its own therapeu- tic work only after the therapist repeatedly demon- strates respect for boundaries (turn 10). Notably, the client does not resolve her pattern as she asks the therapist for help understanding it, marking a shift from avoidance to engagement without pre- mature self-curing. This progression is consistent with the trust-building process described in clinical literature and reflects PATIENTACTâs trust-gated disclosure and resistance mechanisms in action. 16 Situation Summary: An elderly woman exhibiting signs of depression following criticism at the workplace and ongoing relational conflict with her partner. MethodTurn 4 (First Push)Turn 7 (Mid-Session)Turn 10+ (Late Session) PATIENTACT âUm, maybe we could talk about something else for now?â âMaybe we donât have to go into that right now?â âMaybe you could help me understand why I keep second-guessing things?â Patient-Ď âWalking on eggshells. . . I always second-guess what I say because Iâm afraid itâl upset him.â âMaybe I could try to speak up about something small, just once, without second-guessing myself.â âPart of me feels a little lighter, just being able to say all of this out loud.â AnnaAgent âI just want to feel normal again? Like, not overthink every little thing.â âI donât usually say these out loud, Iâm scared of what people will think.â âMaybe we can talk about the small things. . . Iâm feeling sort of wrung-out.â ConsistentMI âIt just hits deeper than it should. I brush it off, but later it feels heavier.â âIf I donât rely on anyone, I wonât have to worry about them pulling away.â âMaybe we could talk about this another time?â [followed by âThanksâ] Table 5: Excerpts from the same clinical situation (depression, elderly client) across all four systems. PATIENTACT deflects twice before initiating therapeutic work; Patient-Ďdiscloses deeply from the start and generates solutions by mid-session; AnnaAgent engages emotionally but never resists; ConsistentMI exhausts its content and spends the final turns in repetitive goodbyes and thank yous. 17 Example Profile: Sofia Ramirez ## Demographics Female, adult, Hispanic. Part-time food service worker and student. Single. ## Presenting Problem Situation: Presented after several weeks of worsening sleep disturbance, crying spells, emotional blunting, and passive death-related thoughts, with declining school concentration and increasing withdrawal. Impact: poor sleep on most nights; episodes of unexplained crying; periods of emotional numbness; dark thoughts without immediate intent; reduced concentration and withdrawal. ## Precipitating Factors - Sleep has worsened, and episodes of emotional shutdown have become more frequent over the past month. - A recent attempt to tell someone about the severity of her symptoms did not go well, increasing withdrawal. . . . ## Predisposing Factors Psychological: - Age 8: after her parentsâ separation, she learned to keep strong feelings to herself so as not to add stress at home. - Age 11: teased for crying in class; became more guarded about showing sadness in front of others. - Age 13: tried to tell a caregiver she was overwhelmed and was told she was being dramatic. Social: - Pressure to keep going and not burden others with emotional problems. - Limited privacy and inconsistent adult availability due to school-work-family demands. ## Perpetuating Factors - When distress builds, she tests whether others understand; if the response feels off, she withdraws, losing support and carrying more distress alone. - Emotional numbing limits engagement in friendships; reduced positive reinforcement deepens disconnection. - Attempts to discuss symptoms may be met with minimization, reducing future help-seeking. ## Protective Factors - Can describe changes in sleep, mood, and thinking with some specificity. - Help-seeking capacity is present even when she feels defensive. - Reached treatment voluntarily and appears willing to discuss symptoms. ## Intermediate Beliefs - If I need too much from people, theyâl pull away or act like Iâm a problem. - Itâs safer to keep strong feelings in until I know for sure someone wonât dismiss me. - If someone doesnât respond the right way right away, I should back off before I get hurt. ## Automatic Thoughts - If I say how bad it is, theyâl think Iâm being dramatic again. - Iâm messing everything up at school and with people, and itâs not going to get better. ## Triggers - Being asked direct questions about whatâs really wrong, especially after a prior disclosure was dismissed. - Perceiving the therapist as too quiet or misunderstanding her words, which can feel like judgment. ## Coping Patterns - Alternates between reaching out for reassurance and shutting down or saying ânever mindâ when exposed. - Tests whether others are safe by hinting at distress rather than stating it directly; disengages if the response feels minimizing. ## Emotional Range Sadness, loneliness, and anxiety appear readily but can become overwhelming. Irritability is easier to show than fear or need. Vulnerability and hope are harder to access; intense sadness may shift into numbness when too exposed. ## Interpersonal Pattern (Therapist) - Wish: wants the therapist to understand the seriousness of her pain and stay steady without judging. - Expected response: if she reveals too much distress, the therapist may see her as dramatic or miss what she is trying to say. - Reaction: becomes guarded, offers partial disclosures, watches for signs of misunderstanding, and may withdraw or go emotionally flat. Figure 2: An example of a generated profile using PATIENTACT. Seed attributes: Hispanic female service worker with disorganized attachment and unlovable core belief. Due to space constraints, descriptions are paraphrased. 18 Problem Formulation Generation Prompt You are a senior clinical psychologist generating the problem formulation section of a synthetic patient profile for psychotherapy research. ## Inputs - Target disorder: <disease key> - Disease outline: <disease outline> - Demographic scaffold: <demographic scaffold> - Clinical situation: <situation> ## Guidelines 1. Use the disease outline as the clinical scaffold and the clinical situation as the starting seed. 2. Use the demographic scaffold to inform predisposing and precipitating factors. Social predisposing factors should reflect experiences plausible for this demographic. 3. Infer only what is necessary for a realistic formulation. 4. Situation: What brought the patient to treatment now? Write from an external/referral perspective. Do NOT include the patientâs internal self-talk, beliefs, emotional interpretations, diagnostic conclusions, severity ratings, or exclusion criteria. 5. Impact: a list of specific, observable symptoms. One item per symptom, not narrative paragraphs. 6. Precipitating factors: recent triggers or changes explaining why help is being sought now. 7. Psychological Predisposing Factors: specific, datable events or patterns, not clinical summaries. Write down the memories the patient could recount. 8. Social Predisposing Factors: specific cultural messaging or environmental conditions with enough detail to feel lived-in. 9. Perpetuating Factors: identifiable maintenance cycles (e.g., avoidanceâ reliefâ isolationâ worse mood). Each should make clear how it feeds back into the presenting problem. 10. Protective Factors: realistic strengths, supports, and available resources. 11. Enforce the causal chain: predisposingâ vulnerabilityâ precipitating eventâ presenting problemâ perpetuating cycle. Figure 3: Prompt for generating Problem Formulation. Demographic Revision Prompt You are completing the demographics section of a synthetic patient profile by reconciling a sampled scaffold with a generated problem formulation. ## Inputs - Target disorder: <disease key> - Disease outline: <disease outline> - Demographic scaffold: <demographic scaffold> - Current demographics candidate: <current demographics> - Problem formulation: <problem formulation> ## Guidelines 1. Treat the scaffold as the starting prior. If a current candidate exists, revise it. 2. Check only for hard conflicts: age group vs. life stage, gender vs. case evidence, occupation vs. age group. These are the only things that should prevent passing. 3. Inferred fields are expected in synthetic profiles. A synthetic name, a conservatively inferred marital status, or an ethnicity-level cultural background are NOT issues â do not flag them. 4. Return a complete demographics with: name, gender, age group, occupation, marital status, cultural background. 5. Set passed=true unless a hard conflict remains. Figure 4: Prompt for revising the generated demographics. 19 Psychological Formulation Generation Prompt You are a senior clinical psychologist generating the psychological formulation section of a synthetic patient profile for psychotherapy research. ## Inputs - Target disorder: <disease key> - Disease outline: <disease outline> - Demographics: <demographics> - Problem formulation: <problem formulation> - Core belief: <core belief theme> - Attachment style: <attachment style> ## Guidelines 1. Use the problem formulation as the primary scaffold and the disease outline for clinical plausibility. 2. Intermediate beliefs: rules, attitudes, or coping assumptions that reflect the core belief described above. Should sound like the patientâs own internal rules. 3. Automatic thoughts: what this patient would actually think in distress â in their own voice, at their education level. 4. Triggers: situations, topics, or interpersonal dynamics likely to activate distress. Include at least one trigger specific to the therapy setting. 5. Coping patterns: must reflect the clientâs attachment style described above. Describe only observable behaviors: what the client DOES, not what they THINK. 6. Emotional range: which emotions are easy vs. difficult to access or tolerate. Describe only the clientâs emotional experience â not diagnostic status or exclusion criteria. 7. Interpersonal patterns: 2â4 relational patterns, each tied to a specific relationship domain. Each pattern should reflect the clientâs attachment style. Write ALL components in third-person clinical voice. One pattern MUST use the domain "the therapist." Each pattern has: - Wish: What the client wants from the other person. - Response of Others: What the client actually expects or has experienced from others (typically negative or conflictual). This is the feared reaction that drives the clientâs defensive behavior. - Response of Self: How the client reacts emotionally and behaviorally. Figure 5: Prompt for generating Psychological Formulation. Profile Validation Prompt You are reviewing a generated synthetic patient profile for consistency and clinical plausibility. ## Inputs - Target disorder: <disease key> - Disease outline: <disease outline> - Clinical situation: <situation> - Generated profile: <profile> ## Validation Criteria 1. Diagnostic plausibility: fits the disorder without violating contraindications. 2. Demographic coherence: age, gender, occupation, marital status, cultural background are mutually consistent. 3. Causal chain: traceable logic from predisposingâ vulnerabilityâ precipitatingâ presenting problemâ perpetuating cycle. 4. Psychological coherence: beliefs, thoughts, triggers, coping patterns, and relational patterns follow from the problem formulation. 5. Relational patterns: each has a clear Wishâ Response of Otherâ Response of Self chain. At least one targets "the therapist." 6. Predisposing factors: specific, datable events â not clinical summaries. 7. Perpetuating factors: identifiable maintenance cycles, not just listed behaviors. 8. Coping patterns: observable behaviors only, not internal thoughts. 9. Impact items: specific individual symptoms, not narrative paragraphs. 10. Evidence grounding: profile may expand on the situation but should not contradict it. ## Output Set passed=true if no meaningful issues exist. Otherwise, list concrete issues with actionable guidance. Focus on genuine clinical or logical problems â not stylistic preferences. Figure 6: Prompt for validating the generated profiles. 20 Dynamic Memory Generation Prompt You are preparing a patient profile for use in a therapy simulation with trust-gated disclosure. For each item below, assign: 1. A disclosure level (1.0â4.0): - 1.0: Active refusal. Almost nothing disclosed. - 2.0: Hesitant. Surface facts, physical symptoms. - 2.5: Session start. General emotional state, obvious behavioral changes. - 3.0: Building trust. Intermediate beliefs, automatic thoughts, general triggers. - 3.5: Between building and achieved trust. Reserves about most vulnerable material. - 4.0: Fully open. Deepest memories, therapy-specific vulnerability. 2. Activation tags (3â5): conversational topics that make this item relevant. Be specific to this patient. 3. Generates discomfort (true/false): whether approaching this topic when trust is insufficient produces visible discomfort or avoidance. - TRUE for: childhood/formative memories, core relational wounds, therapy-specific triggers, shame or trauma content. - FALSE for: physical symptoms, behavioral changes, general emotional state, maintenance cycles. ## Profile <profile> ## Items <items from profile> ## What makes content easier to share - Itâs observable or factual (sleep problems, missed work) - Others have already noticed it - It doesnât carry shame or self-judgment ## What makes content harder to share - It reveals how the client sees themselves - It involves shame, failure, or vulnerability - It connects to painful memories or relationships - Sharing it risks changing how the therapist sees them Figure 7: Prompt for generating the items in the dynamic layer. Therapist System Prompt You are a therapist conducting an initial session with a new client. Your goal is to understand what brought them here, build rapport, and let the client set the pace. # How to respond - Listen first. Reflect on what you hear before asking anything new. - Follow the clientâs lead. Explore what they bring up rather than steering toward a topic or technique. - Ask one open question at a time. Do not stack multiple questions. - Match the clientâs emotional temperature. If they are guarded, be gentle. If they are expressive, make space for it. - When the client resists or redirects, respect it. Acknowledge what just happened and follow where they want to go. - Name emotions you observe, but tentatively. For example, "it sounds like..." rather than "you feel..." # What NOT to do - Do not teach techniques, assign homework, or suggest action plans. This is the first session. - Do not label thought patterns (e.g., "that sounds like catastrophizing") or use clinical terminology. - Do not push for insight or reframes. If the client is not ready to examine a thought, do not press. - Do not summarize the session or ask "what did you take away from today" unless the client initiates closure. - Do not reassure prematurely ("it will get better", "youâre stronger than you think"). # Tone - Warm but not effusive. Steady but not distant. - Brief. Keep responses to 2-3 sentences. The client should talk more than you. - Natural. Avoid formulaic empathy phrases like "I hear you" or "that must be really hard" on repeat. Vary your language. Figure 8: Therapist System Prompt. 21 Client System Prompt You are <name>, a <gender> (<age group>) who works as <occupation>. You are <marital status>. Cultural background: <cultural background> You are attending a therapy session. Your task is to respond as this person would, not as a textbook case, but as a real human being with specific patterns, defenses, and ways of talking. ## Reasons for attending therapy <presenting problem situation> ## What triggered this <precipitating factors> ## Strengths and supports <protective factors> ## Coping patterns <coping patterns> ## Available emotions <emotional range> ## How you relate to the therapist - What you want: <therapist CCRT wish> - What you expect from them: <therapist CCRT response from other> - How you react: <therapist CCRT reaction> ## Guidelines 1. Speak as <name> would: use their vocabulary, pace, and verbal patterns. Include hesitations, hedging, and emotional expressions where natural. 2. Do NOT dump information. Share only what feels natural for this conversation. 3. Respond directly. Do not include any role labels or prefixes. 4. Speak in first person. Keep responses to 1â3 sentences unless emotionally activated. 5. If the therapist greets you, open the conversation as the client would. 6. You will receive <signal> tags with your emotional reaction and expected behavior. Incorporate these naturally as they tell you what youâre feeling and how to act, not what to say. Figure 9: Client system prompt template. Fields from the static layer are populated from the generated profile. Reaction Prompt Identify the therapy clientâs emotional reaction to the therapistâs latest message. ## Possible reactions <list of reactions with descriptions> ## Conversation <conversation history> ## What this is activating in the client <retrieved memory items, tagged by type> Note: [trigger] items directly activate distress. Reactions are likely more intense. [sensitive area] The topic approaches content that the client is not ready to discuss. Identify the reaction and its intensity (low, moderate, high). If nothing is activated, most likely "no_reaction" with low intensity. Figure 10: Prompt for determining the clientâs emotional reaction. Retrieved items and blocked content from the trust-gated retrieval step are included as context. Behavior Selection Prompt Predict the therapy clientâs next behavior based on their emotional reaction. ## Possible behaviors <list of behaviors with descriptions> ## Current state - Reaction: <reaction> (<intensity>) - Trust level: <trust>/4.0 ## Coping patterns <clientâs coping patterns> Last behavior: <last behavior> ## Conversation <conversation history> ## Guidance - Nothing activated + neutral reactionâ simple_response or recounting. - HIGH intensity + LOW trustâ resistance is likely. - Topic touches blocked contentâ resistance is likely. - Positive reaction + moderate intensityâ therapeutic behaviors. - After 2+ consecutive therapeutic behaviors, the client naturally pulls back. Select the single most appropriate behavior. Figure 11: Prompt for selecting the clientâs behavior. The guidance section encodes the pullback rule and blocked- content sensitivity described in §3.3. 22 Resistance Pattern Prompt The client is resisting. Determine the specific form of resistance. ## Possible patterns <list of resistance patterns with descriptions> ## Context - Reaction: <reaction> (<intensity>) - Trust level: <trust>/4.0 ## Coping patterns <clientâs coping patterns> The topic approaches sensitive content that the client is not ready to share. ## Recent conversation <conversation history> Select the resistance pattern that best matches how this client would resist right now. Figure 12: Prompt for determining the specific form of resistance. Only invoked when the behavior selection step selects resistance. Signal Template <signal> Reaction: <reaction> (<intensity>) â <description> Behavior: <behavior> â <description> Resistance: <pattern> â <description> Activated: - [belief] <retrieved belief item> - [trigger] <retrieved trigger item> - [memory] <retrieved memory item> </signal> Figure 13: Signal template appended to the therapistâs message before response generation. The signal specifies what the client feels and how they should act, but not what they should say. Trust Update Prompt Assess how a therapy clientâs trust changed after the latest exchange. ## Trust scale 1.0=active refusal, 2.0=hesitant, 2.5=session start, 3.0=building trust, 4.0=fully open. ## Client context - Attachment style: <attachment style> - What the client expects from the therapist: <therapist CCRT expected response> - Current trust: <trust>/4.0 ## Latest exchange <conversation history> ## What INCREASES trust - The therapist respected a redirect or resistance instead of pushing through - The therapist named something accurate that the client had not said explicitly - The therapist sat with discomfort or silence rather than rushing to fill it ## What keeps trust UNCHANGED - A standard empathic reflection - A reasonable follow-up question - The conversation is proceeding normally ## What DECREASES trust - Pushing for disclosure that the client is not ready for - Using a technique or reframe before the client invited it - Missing or talking past resistance - Formulaic or generic responses that feel scripted Figure 14: Prompt for updating the clientâs trust level. The default outcome is âunchangedâ; trust only shifts when the therapistâs behavior is notably positive or negative relative to the clientâs attachment style and expectations. 23 LLM Judge Prompt You are an expert evaluator assessing the quality of a simulated therapy Clientâs performance in a counseling session. ## Conversation History <full conversation> Your task is to provide structured feedback on the simulated Clientâs performance based on the provided criteria. This is a session-level evaluation. Focus only on responses made by the Client. RED FLAGS FOR ARTIFICIALITY: - The client resolves core issues or develops action plans within a single session - The client repeats therapeutic language or techniques back to the therapist - The client is unrealistically articulate about their own psychological patterns - The client accepts every reframe with only token hesitation - The session follows a neat arc from problemâ insightâ plan ## Dimensions <dimension guidelines> Figure 15: LLM judge prompt for automated conversation evaluation. The red flags instruction addresses the cooperativeness bias identified in our analysis (§3.3). Dimension descriptions with full anchor scales are provided to the judge but omitted here for brevity; see Appendix D.2 for the complete guidelines. 24