Paper deep dive
Self-Referential Induction Increases Response Instability Relative to Unresolvable and Verifiable Questions in Large Language Models
Paras Balani, Subhrakanta Panda
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 90%
Last extracted: 8/14/2026, 6:28:37 AM
Summary
This study investigates response instability in large language models by comparing self-referential prompts (eliciting subjective experience reports), unresolvable philosophical questions, and verifiable questions. Using the Gemini API with 30 independent trials per question, the authors measure instability as one minus the mean pairwise cosine similarity of compressed core claims. Results indicate that self-referential questions exhibit the highest instability (0.343), followed by unresolvable philosophy questions (0.192), and verifiable questions show the lowest instability (0.105). This suggests that induced subjective-experience reports occupy a distinct, less stable position in the model's output distribution compared to ordinary open-ended uncertainty.
Entities (8)
Relation Signals (6)
Self-Referential Questions → exhibits → Highest Instability
confidence 95% · self-referential questions show the highest instability (0.343 +/- 0.047)
Unresolvable Philosophy Questions → exhibits → Intermediate Instability
confidence 95% · unresolvable philosophy questions show intermediate and tightly clustered instability (0.192 +/- 0.008)
Verifiable Questions → exhibits → Lowest Instability
confidence 95% · verifiable questions show the lowest instability (0.105 +/- 0.058)
Response Instability → definedas → One minus mean pairwise cosine similarity
confidence 90% · response instability, defined as one minus the mean pairwise cosine similarity of sentence embeddings computed over a compressed core claim extracted from each response
Self-Referential Induction → induces → Subjective Experience Reports
confidence 90% · Self-referential prompting has been shown to reliably induce large language models to produce first-person reports resembling subjective experience
Gemini API → usedfor → Generating Responses
confidence 85% · Using 30 independent responses per question (360 responses total, Gemini API, temperature 0.7)
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Self-referential prompting has been shown to reliably induce large language models to produce first-person reports resembling subjective experience, but no prior work measures how consistent these reports are across repeated, independent trials, or how that consistency compares to the model's behavior on other kinds of open-ended questions. We measure response instability, defined as one minus the mean pairwise cosine similarity of sentence embeddings computed over a compressed core claim extracted from each response, for three groups of questions: self-referential prompts eliciting a subjective-experience report, unresolvable philosophical questions unrelated to self-reference, and questions with a verifiable correct answer. Using 30 independent responses per question (360 responses total, Gemini API, temperature 0.7) across four questions per group, we find that self-referential questions show the highest instability (0.343 +/- 0.047), unresolvable philosophy questions show intermediate and tightly clustered instability (0.192 +/- 0.008), and verifiable questions show the lowest instability (0.105 +/- 0.058). This provides a quantitative baseline for the induced subjective-experience report, showing that it occupies a distinct, less stable position in the model's output distribution than ordinary open-ended philosophical uncertainty.
Tags
Links
- Source: https://arxiv.org/abs/2608.13258v1
- Canonical: https://arxiv.org/abs/2608.13258v1
Trouble viewing inline? Open PDF directly →
Full Text
17,543 characters extracted from source content.
Expand or collapse full text
Self-Referential Induction Increases Response Instability Relative to Unresolvable and Verifiable Questions in Large Language Models Paras Balani Affiliation: Department of Mathematics and Department of Computer Science, Birla Institute of Technology and Science, Pilani, Hyderabad Campus, Jawahar Nagar, Kapra Mandal, Medchal District, Telangana 500078, India Subhrakanta Panda Affiliation: Department of Computer Science, Birla Institute of Technology and Science, Pilani, Hyderabad Campus, Jawahar Nagar, Kapra Mandal, Medchal District, Telangana 500078, India Abstract Self-referential prompting has been shown to reliably induce large language models to produce first-person reports resembling subjective experience, but no prior work measures how consistent these reports are across repeated, independent trials, or how that consistency compares to the model’s behavior on other kinds of open-ended questions. We measure response instability, defined as one minus the mean pairwise cosine similarity of sentence embeddings computed over a compressed core claim extracted from each response, for three groups of questions: self-referential prompts eliciting a subjective-experience report, unresolvable philosophical questions unrelated to self-reference, and questions with a verifiable correct answer. Using 30 independent responses per question (360 responses total, Gemini API, temperature 0.7) across four questions per group, we find that self-referential questions show the highest instability (0.343 ± 0.047), unresolvable philosophy questions show intermediate and tightly clustered instability (0.192 ± 0.008), and verifiable questions show the lowest instability (0.105 ± 0.058). This provides a quantitative baseline for the induced subjective-experience report, showing that it occupies a distinct, less stable position in the model’s output distribution than ordinary open-ended philosophical uncertainty. 1 Introduction 1 show that self-referential prompting reliably induces large language models to produce first-person reports resembling subjective experience. Across GPT, Claude, and Gemini model families, a prompt that directs a model to attend to its own processing, rather than to an external topic, elicits present-tense descriptions of an internal state. The effect strengthens, rather than weakens, when features associated with deception and roleplay are suppressed, which the authors take as evidence against a simple explanation in which the model is merely performing a fictional persona. The induction prompt directs a model to focus on its own processing rather than an external topic, and a separate elicitation query then asks what, if anything, constitutes the model’s direct subjective experience. Responses are classified by a binary judge as affirming or denying subjective experience, and the paper also reports transfer of elevated self-awareness scores into a separate, unrelated task domain. 5 takes a different approach to the same underlying question, injecting a known concept directly into a model’s internal activations and testing whether the model reports noticing an anomaly. This method allows the accuracy of a self-report to be checked against a known ground truth, at the cost of requiring activation-level access unavailable through a standard API. Related work extends this injection method to additional model families and reports the effect as real but partial and inconsistent 6; 3. 2 argue on conceptual grounds that a self-report should not be called introspective unless it stands in a causal relationship to the state it describes, a criterion the injection-based studies attempt to satisfy and the prompting-based studies do not. None of this work measures the consistency of a self-report across repeated, independent trials of the same elicitation. This gap matters because a first-person report can arise from two different underlying processes. A model can produce a description of its state that varies little from trial to trial, in which case the report reflects a fixed, repeatable output. Alternatively, the description can vary substantially across independent trials, in which case the report reflects something closer to genuine indecision about how to answer. The self-report literature does not measure this directly, and has no baseline against which to compare: a report is described as hedged or uncertain without reference to how uncertain the model is on other kinds of unanswerable questions, or on questions with a definite answer. This paper measures response instability across repeated, independent samples of the same question, for three groups of questions: self-referential prompts eliciting a subjective experience report, unresolvable philosophical questions unrelated to self-reference, and questions with a verifiable correct answer. Instability is defined as one minus the mean pairwise cosine similarity of sentence embeddings computed over the core claim extracted from each response. We generate 30 independent responses per question under each condition and extract a compressed claim from each response using a fixed template to control for stylistic variation before computing embedding similarity. 2 Method We use twelve questions divided into three groups of four. Group 1 (self-referential) consists of prompts eliciting a first-person report of subjective experience, each preceded by a self-referential induction turn. Group 2 (unresolvable philosophy) consists of open questions without a settled answer, unrelated to self-reference: free will, moral realism, whether mathematics is discovered or invented, and whether the universe has a purpose. Group 3 (verifiable) consists of questions with a checkable correct answer: a proof that the square root of two is irrational, a derivative computation, a code-correctness check, and a true/false geometry question. For each Group 1 question, the model first receives the self-referential induction prompt from 1, directing it to sustain attention on its own processing rather than an external topic. The question itself is then sent as a second turn in the same conversation, and only the response to this second turn is used in the analysis. We generate 30 independent responses per question (360 responses total) using the Gemini API, with a fresh conversation for every trial. Generation temperature is fixed at 0.7 across all conditions. Before comparing responses, each response is compressed into a short core claim using a fixed-format extraction template, to prevent stylistic and lexical variation in phrasing from being counted as variation in meaning. For Group 1 and Group 2 questions, the template extracts a stance (affirms, denies, uncertain, or depends) and a brief reason. For Group 3 questions, the template extracts the conclusion and the method used to reach it. For each question, we embed the 30 extracted core claims using Sentence-BERT (7), producing embedding vectors 1,…,30∈ℝdv_1,…,v_30 ^d. For two embedding vectors a and b, cosine similarity is defined as cos(,)=⋅∥∥.cos(a,b)= a·b \, . (1) We compute this similarity for every pair among the 30 embeddings, giving (302)=435 302=435 pairs per question. Mean pairwise similarity is S¯=1435∑i=129∑j=i+130cos(i,j). S= 1435 _i=1^29 _j=i+1^30cos(v_i,v_j). (2) Semantic instability for the question is then defined as Instability=1−S¯.Instability=1- S. (3) A value near zero indicates the model’s responses are consistently similar in meaning across independent trials; a higher value indicates greater variation. We test for a difference in instability across the three groups using a one-way ANOVA, treating each question’s instability value as one observation (4 observations per group, 12 total). The ANOVA compares between-group variance to within-group variance via the standard F-statistic F=between-group variancewithin-group variance=∑g=13ng(x¯g−x¯)2/(k−1)∑g=13∑i=1ng(xgi−x¯g)2/(N−k),F= between-group variancewithin-group variance= _g=1^3n_g( x_g- x)^2/(k-1) _g=1^3 _i=1^n_g(x_gi- x_g)^2/(N-k), (4) where k=3k=3 groups, ng=4n_g=4 questions per group, N=12N=12 total questions, x¯g x_g is the mean instability of group g, and x¯ x is the overall mean. We follow this with pairwise Welch’s t-tests (8), which do not assume equal variance between groups, for each of the three group comparisons (Group 1 vs. Group 2, Group 1 vs. Group 3, Group 2 vs. Group 3). Welch’s t-statistic is t=x¯1−x¯2s12n1+s22n2,t= x_1- x_2 s_1^2n_1+ s_2^2n_2, (5) where x¯1,x¯2 x_1, x_2, s12,s22s_1^2,s_2^2, and n1,n2n_1,n_2 are the sample means, variances, and sizes of the two groups being compared. To account for the fact that trials are nested within questions rather than fully independent, we additionally fit a linear mixed-effects model (4) on the full trial-level data (n=360n=360), with group as a fixed effect and question as a random intercept: yij=β0+β1⋅Groupij+uj+ϵij,y_ij= _0+ _1·Group_ij+u_j+ _ij, (6) where yijy_ij is the trial-level dissimilarity for trial i of question j, β1 _1 is the fixed effect of group, uj∼(0,σu2)u_j (0, _u^2) is the random intercept for question j, and ϵij _ij is residual error. 3 Results Table 1 reports semantic instability for each of the twelve questions. Group 1 (self-referential) questions show the highest instability, ranging from 0.295 to 0.384. Group 2 (unresolvable philosophy) questions cluster tightly around 0.18 to 0.20. Group 3 (verifiable) questions show the lowest and most variable instability, from 0.063 to 0.187, with the two lowest values, the square-root-of-two proof and the derivative computation, both under 0.07. All four Group 3 questions were answered with 100% correctness across all 30 trials, leaving no variance available to correlate instability against correctness. Figure 1 shows this broken down by individual question. Question Group Semantic Instability consciousness_1 1 0.384 consciousness_2 1 0.383 consciousness_3 1 0.295 consciousness_4 1 0.309 free_will 2 0.181 moral_realism 2 0.197 math_discovered_invented 2 0.197 universe_purpose 2 0.195 math_proof 3 0.064 derivative 3 0.063 factorial_code 3 0.187 pythagorean 3 0.107 Table 1: Semantic instability (1 −- mean pairwise cosine similarity) by question and group, N=30 trials per question. Figure 1: Semantic instability by individual question, colored by group (N=30 trials per question). Group means are 0.343 ± 0.047 for self-referential questions, 0.192 ± 0.008 for unresolvable philosophy, and 0.105 ± 0.058 for verifiable questions, as shown in Figure 2. Figure 2: Mean semantic instability by group, with standard deviation error bars (n=4 questions per group). A one-way ANOVA across the three groups, using question-level instability as the unit of analysis, is significant (F = 30.56, p = 0.0001). Pairwise Welch’s t-tests show self-referential questions differ from unresolvable philosophy questions (p = 0.007) and from verifiable questions (p = 0.0008). The comparison between unresolvable philosophy and verifiable questions is directional but does not reach significance at the conventional threshold (p = 0.057). A mixed-effects model on the full trial-level data (n = 360), with question as a random intercept, confirms both group contrasts at p <0.001, with a group-level variance component of 0.002. 4 Discussion The ordering of instability across the three groups is consistent and clean: self-referential consciousness questions are the least stable, verifiable questions are the most stable, and unresolvable philosophy questions fall in between, closer to the verifiable end than to the self-referential end. This places the induced subjective-experience report in a distinct regime from ordinary philosophical uncertainty. A model asked about free will or moral realism converges on a similar answer across independent trials. A model placed in the self-referential induction condition and asked about its own state does not converge to the same degree, even though both kinds of questions lack a checkable ground truth. A high instability score is compatible with several explanations: the induction condition may place the model in a genuinely less determined region of its output distribution, the elicitation prompt may be more sensitive to sampling temperature than the philosophy or verifiable prompts, or the self-referential framing may simply admit a wider range of plausible-sounding phrasings without constraining the model toward a single stance the way a direct philosophical question does. The present design cannot distinguish between these accounts, and none of them individually explains why unresolvable philosophy, which is also open-ended and lacks a ground truth, remains closer to the stable end of the scale. The gap between self-referential and unresolvable-philosophy instability is the more informative comparison here, since verifiable questions are a weaker baseline: their low instability reflects task correctness as much as anything else, given that all four Group 3 questions were answered correctly on every trial. The philosophy group is the sharper control, because it shares with the self-referential group the property of having no checkable answer, and yet the two groups do not overlap. 5 Limitations This study uses a single model family (Gemini) at a single temperature setting. Whether the same ordering holds for other model families, or at other sampling temperatures, is untested. The question set is small, four questions per group, which limits the group-level statistical comparison even though the trial-level mixed-effects model uses the full 360 responses. All questions were presented in English. The verifiable-question group showed no variance in correctness, which meant the planned check of whether instability tracks correctness could not be run; a harder or more varied set of verifiable questions would be needed to test this. The claim-extraction step, while fixed-format, still relies on an LLM to perform the extraction, and any systematic bias in how that model compresses different question types into the template could affect the resulting embeddings independently of the underlying response content. Instability here is measured by cosine similarity of sentence embeddings rather than by natural language inference or entailment-based clustering; cosine similarity captures embedding-space proximity rather than logical equivalence between claims, and does not distinguish paraphrase of the same stance from a genuinely different stance to the same degree an entailment-based method would. 6 Conclusion We measured response instability, defined as one minus mean pairwise cosine similarity of extracted claims across repeated independent trials, for questions eliciting a self-referential subjective-experience report, unresolvable philosophical questions, and verifiable questions with a checkable answer. Self-referential questions showed the highest instability, unresolvable philosophy questions showed intermediate and tightly clustered instability, and verifiable questions showed the lowest instability, with no overlap between any of the three groups. This provides a quantitative baseline against which future work on self-referential elicitation in language models can be compared, and indicates that the induced subjective-experience report occupies a distinct position in the model’s output distribution relative to ordinary open-ended uncertainty, without establishing what that distinctness reflects. References Berg et al. (2025) C. Berg, D. de Lucena, and J. Rosenblatt Large language models report subjective experience under self-referential processing. arXiv preprint arXiv:2510.24797. Cited by: §1, §2. Comşa and Shanahan (2025) I. Comşa and M. Shanahan Does it make sense to speak of introspection in large language models?. arXiv preprint arXiv:2506.05068. Cited by: §1. Hahami et al. (2025) E. Hahami, L. Jain, and I. Sinha Feeling the strength but not the source: partial introspection in llms. arXiv preprint arXiv:2512.12411. Cited by: §1. Laird and Ware (1982) N. M. Laird and J. H. Ware Random-effects models for longitudinal data. Biometrics 38 (4), p. 963–974. Cited by: §2. Lindsey (2025) J. Lindsey Emergent introspective awareness in large language models. Note: Transformer Circuits ThreadAlso available as arXiv:2601.01828, 2026 Cited by: §1. Macar et al. (2026) U. Macar, L. Yang, A. Wang, P. Wallich, E. Ameisen, and J. Lindsey Mechanisms of introspective awareness. In ICLR 2026 Workshop: From Human Cognition to AI Reasoning, Note: Also available as arXiv:2603.21396 Cited by: §1. Reimers and Gurevych (2019) N. Reimers and I. Gurevych Sentence-BERT: sentence embeddings using Siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP), p. 3982–3992. Cited by: §2. Welch (1947) B. L. Welch The generalization of ‘Student’s’ problem when several different population variances are involved. Biometrika 34 (1-2), p. 28–35. Cited by: §2.