Paper deep dive
Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs
Toqeer Ehsan, Nico Penttilä, Richard Schmidt, Arash Hajikhani, Victoria Palacin
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 92%
Last extracted: 9/17/2026, 3:41:54 AM
Summary
This paper presents a multi-judge committee approach for detecting hallucinated character spans in Vision-Language Model (VLM) outputs, submitted to the SHROOM-Visions shared task. The method employs fine-tuned VLMs (Gemma-4, Mistral-Small, Qwen3-VL) as independent annotators, combining their predictions via character-level majority voting. Additionally, the authors explore activation probes on internal model states. The committee approach ranks first in three of four languages (French, Italian, Chinese) and places on the podium in all languages and metrics, demonstrating that model disagreement correlates with human annotator disagreement.
Entities (9)
Relation Signals (9)
Vroom-Vroom → participatesin → SHROOM-Visions
confidence 98% · This paper describes our submission to the SHROOM-Visions shared task
Vroom-Vroom → achievesrank → first
confidence 95% · The approach ranks first in three of four languages
Vroom-Vroom → uses → Qwen3-VL
confidence 95% · We used five VLM judges from four backbone families: ... Qwen3-VL... We employ several fine-tuned vision-language models as independent annotators
Vroom-Vroom → uses → Gemma 4
confidence 95% · We used five VLM judges from four backbone families: Gemma-4... We employ several fine-tuned vision-language models as independent annotators
Vroom-Vroom → uses → Mistral-Small
confidence 95% · We used five VLM judges from four backbone families: ... Mistral-Small... We employ several fine-tuned vision-language models as independent annotators
Vroom-Vroom → usestechnique → Character-level majority voting
confidence 95% · combine their span predictions through character-level majority voting
SHROOM-Visions → usesdataset → SHEEP
confidence 90% · a supervised hallucination detection challenge that is built on a multi-annotator, span-level benchmark... SHEEP dataset
Vroom-Vroom → usestechnique →
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:This paper describes our submission to the SHROOM-Visions shared task on detecting and classifying hallucinated character spans in vision-language model outputs across four languages. We employ several fine-tuned vision-language models as independent annotators and combine their span predictions through character-level majority voting, and additionally explore activation probes. The approach ranks first in three of four languages and places on the podium in every language and metric. Our analysis indicates that disagreement among diverse models tracks disagreement among human annotators.
Tags
Links
- Source: https://arxiv.org/abs/2609.17327v2
- Canonical: https://arxiv.org/abs/2609.17327v2
Trouble viewing inline? Open PDF directly →
Full Text
41,130 characters extracted from source content.
Expand or collapse full text
Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs Toqeer Ehsan Nico Penttilä Richard Schmidt Arash Hajikhani Victoria Palacin Affiliation: Reliable Intelligence Team, Physical AI, VTT Technical Research Centre of Finland Email: firstname.lastname@vtt.fi Abstract This paper describes our submission to the SHROOM-Visions shared task on detecting and classifying hallucinated character spans in vision-language model outputs across four languages. We employ several fine-tuned vision-language models as independent annotators and combine their span predictions through character-level majority voting, and additionally explore activation probes. The approach ranks first in three of four languages and places on the podium in every language and metric. Our analysis indicates that disagreement among diverse models tracks disagreement among human annotators. 1 Introduction Vision-Language Models (VLMs) are increasingly used to answer questions, describe scenes, and read text in images. Like text-only models, they often produce fluent and confident outputs that are factually unsupported. In visual settings, such errors take distinct forms: invention, miscounting, relational errors, misinterpretation, or character-recognition errors Liu et al. (2024); Bai et al. (2025b). Their growing role in deployed systems motivates automatic and span-precise error detection as a safeguard Huang et al. (2025); Zhang et al. (2025). Figure 1: Illustration of hallucination predictions from multi-layer probe and VLM ensemble against human annotations. Predicting hallucination at the character level is particularly challenging, as human evaluators likewise disagree on whether a span is hallucinated and where it begins and ends Mickus et al. (2024); Vázquez et al. (2025). This disagreement, reflecting inherent ambiguity, sets a practical upper bound on detector performance. We present multiple detection approaches in the context of the SHROOM-Visions (Vázquez et al., 2026) shared task11 1 https://helsinki-nlp.github.io/shroom/2026, a supervised hallucination detection challenge that is built on a multi-annotator, span-level benchmark covering English, French, Italian, and Chinese (Mickus et al., 2026). Systems are compared for each language using character-level overlap and confidence correlation against the human annotator’s gold set of real VLM responses. Figure 1 illustrates a human hallucination annotation alongside model predictions. We explore two parallel approaches: fine-tuned VLMs treated as independent judges combined through character-level voting, and VLM activation probes trained on internal states. Our contributions are twofold: (i) a committee aggregating multi-model span predictions into character-level probabilities; (i) evidence that multi-model diversity reflects annotation disagreement. Our strategy ranks first in three of four languages. 2 Related Work Vision hallucination benchmarks: We situate the SHEEP dataset among vision-hallucination datasets along two axes: sourcing of ground truth and hallucination definition. Automated ground truth creation, including synthetic vision-responses (Xie et al., 2026; Zhang et al., 2024a) or error-in-caption augmentation (Shekhar et al., 2017), has been criticized for distributional mismatch (Mickus et al., 2026). In contrast, human-sourced annotations of naturally occurring hallucinations, to which SHEEP belongs, can capture authentic and emerging hallucination types, but at the price of annotation and span inconsistencies. This can partially be addressed with the explicitness of the hallucination definition. Existing benchmarks separate descriptive errors, which violate image-grounded features, from errors in visual reasoning (Guan et al., 2024; Seth et al., 2025). With SHEEP belonging to the former descriptive group, additional variation comes with the definition of boundaries, particularly including factually correct elaboration (Gunjal et al., 2024), the handling of hard-to-verify, specialized world knowledge, or the inclusion of decoding errors, such as repetition, template, or code switching errors (Ye-Bin et al., 2025), that SHEEP captures under OTHER. Vision hallucination detection: A smaller body of model-free approaches uses reference captions under a closed-world assumption to identify violations (Rohrbach et al., 2018) or use between-rollout consistency as uncertainty proxy (Zhang et al., 2023). In contrast, an extensive body of literature has been concerned with utilizing a secondary VLM to detect hallucinations, either through (i) VLM-as-a-Judge configurations or by (i) Analysis of Internal Representation. Instruction-following variants include factual decomposition (Jing et al., 2024), inter-judge consistency (Zhang et al., 2024b), or VLM synthesis with smaller attribute models (Li et al., 2025). Interpretability-based methods include uncertainty calibration (Geng et al., 2024; Li et al., 2024), which is less effective for hallucinations driven by the language modeling prior (Shoby et al., 2026), but more prominently, supervised methods using visual attention-based attributes (Wang et al., 2026), embedding representations (Chen et al., 2024), or between-layer dynamics (Nath et al., 2026). 3 Methodology EDA and training split: To inform subsequent architecture, training, and prompt design, we performed exploratory data analysis (EDA), surfacing differences at both the hallucination and annotation levels. We find that the annotations are skewed toward invention and mischaracterization as dominant classes (80-88% of all errors), with severe correlation of error occurrence, where the 10th percentile with the most erroneous responses holds above 50% of all error characters. Most challenging is inter-annotator disagreement: 80-86% of hallucination characters are marked by only one of three annotators across languages, motivating the subsequent qualitative analysis of annotation patterns. For the SHEEP dataset, hallucinations are defined as "unsupported by or contradictory to the […] input image" (Mickus et al., 2026), leaving considerable uncertainty regarding both boundary specifications and the verifiability of specialized parametric knowledge. Regarding hallucination boundaries, one inconsistency is the marking of accompanying, factually correct descriptive elaboration of incorrectly identified attributes. Another concerns hard-to-verify but factually correct general knowledge. Prominent examples include the correct inference of geolocations that, while theoretically grounded in the image, are hard to verify without a literal display and were subsequently annotated as hallucinations. Examples are displayed in Figures 2 and 3. To account for the data distribution and the reuse of source images, we perform a train, development, test split that groups by image ID and stratifies by error type on a span, not character level. 3.1 Vision-Language Judges For the training sets and few-shot examples, we converted each annotation into an inline representation, i.e., <hall label="LABEL" prob="PROB">hallucinated text</hall>. This allowed VLM judges to produce predictions in the same format as their input. We simplified the gold annotations by removing overlapping spans and mapped agreement scores to three probability classes: approximately 0.330.33, 0.670.67, and 1.01.0. We retained samples whose spans are all between one and one hundred characters, excluding unusually long spans. Predicted markup was converted back to character offsets, with each span assigned the probability of its confidence class. For each evaluation item, we retrieved six in-context examples from the training set using weighted cosine similarity.22 2 Image embeddings: openai/clip-vit-large-patch14, and response and prompt embeddings: BAAI/bge-m3. We used a 50:30:20 ratio for image, response, and prompt similarity, respectively, and selected demonstrations containing at least three hallucination spans. For fine-tuning, we constructed three distinct training sets to decorrelate the VLM judges. We used five VLM judges from four backbone families: Gemma-4 Gemma Team (2026), Mistral-Small Mistral AI (2025), Qwen3-VL Bai et al. (2025a), and a second Qwen variant Qwen Team (2026), providing diverse inductive biases. In the few-shot setting, each model received the image, question, and response with six in-context demonstrations retrieved by similarity, and inserted inline markup around unsupported spans. In the fine-tuning setting, we adapted each model with LoRA Hu et al. (2022) on inline-annotated data, using a distinct sample per model. All judges produced responses with identified hallucination labels and confidence probabilities. Prompt templates, retrieval details, and LoRA hyperparameters are provided in Appendix D. 3.2 Internal State Probing Probing refers to the family of techniques where language models’ internal activations are extracted and analyzed. Prior work has successfully used probes to study representation of values Shen et al. (2025) and concepts Abdelwahab et al. (2026) of LLMs; they are a popular approach in LLM monitoring McKenzie et al. (2025) and existing work has found that internal states are a promising direction for detecting hallucinations Orgad et al. (2025); Kossen et al. (2024); Bar-Shalom et al. (2025); Han et al. (2025); Kim et al. (2025). Inspired by these results, our team trained multiple classes of probes of ranging complexity on the internal states of both Qwen3-VL-4B33 3 https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct and Qwen3-VL-8B44 4 https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct. All of the probes feature transformer encoder layers and down projection before the classification heads in order to facilitate horizontal information flow between tokens to better incorporate the span-based nature of the task. We refer to this variant as Multi-layer, since the probe input is a learned mixture of all layers rather than a single selected layer. So given fl∈ℜn×Df^l∈ ^n× D being the hidden state extracted from layer l from the pretrained VLM, the classification heads operate on zl=projection(encoder(fl))z^l=projection(encoder(f^l)). zl∈ℜn×d,d<<Dz^l∈ ^n× d,d<<D is then fed to classification head(s) to produce per-token hallucination estimations y^=head(zθl),y^∈ℜn×5,y^i,j∈[0,1] y=head(z_θ^l), y∈ ^n× 5, y_i,j∈[0,1]. The probes were optimized with binary cross entropy loss. We initially trained a linear classification head to estimate per-type probability of the token being hallucinated only on the response token positions. Switching the probe’s linear layer to a two-layer perceptron yielded small improvements on the baseline. A large improvement was achieved by compressing the image-token position embeddings to a smaller number of mean-pooled tokens and then cross attending over the mean-pooled representations. Increasing the number of compressed tokens yielded diminishing improvements after 256 tokens. We next added auxiliary heads with their respective losses to the training. Namely, we added start and end boundary logits, sample level logit and a per-token hallucination logit to the existing hallucination type classification head, with the final prediction being gated by the product of the sample level logit and per-token hallucination logit. We refer to this variant as Multi-stage, since the type prediction is gated by two preceding decisions rather than produced in a single step. Finally, we incorporated the per-position residual stream changes in the input to the probe, inspired by existing work Kim et al. (2025) and the intuition that hallucinations may manifest as language priors overriding the visually grounded representations. This was implemented by adding a difference of layers hl=fl−fl−1,l∈Lh^l=f^l-f^l-1,l∈ L to the hidden states: fL=[[f0,0],[f1,f1−f0],…[fl,fl−fl−1]]f^L=[[f^0,0],[f^1,f^1-f^0],...[f^l,f^l-f^l-1]], passing fLf^L through layer-wise encoder hL=encoder(fL)h^L=encoder(f^L) from which we acquire scores for each layer sl=whl+bs^l=wh^l+b and further pass them through softmax al=exp(sl)Σkexp(sk)a^l= exp(s^l) _kexp(s^k) which are used to create a weighted average of the layers which gets down-projected and functions as the replacement of flf^l when creating the input z to the classification heads: zL=projection(encoder(projection(∑alhl)))z^L=projection(encoder(projection(Σ a^lh^l))). Approach Cor_lbl Cor IoU Model EN FR IT ZH EN FR IT ZH EN FR IT ZH Gemma-4-ft 0.3772 0.3897 0.4153 0.4575 0.4276 0.4556 0.4952 0.5173 0.3734 0.4124 0.4422 0.4751 Mistral-small-ft 0.3384 0.3414 0.3750 0.3912 0.3734 0.4031 0.4625 0.4451 0.3229 0.3589 0.4224 0.4136 Qwen3.6-ft 0.3738 0.3759 0.3729 0.4359 0.4127 0.4287 0.4445 0.4774 0.3691 0.3842 0.3935 0.4395 Qwen3-vl-ft-3shot 0.3904 0.3639 0.3751 0.4497 0.4344 0.4272 0.4729 0.5042 0.3721 0.3825 0.4166 0.4599 VLMs Gemma-4-6shot 0.3117 0.3329 0.3222 0.4155 0.3890 0.4149 0.4256 0.4991 0.3706 0.4099 0.4207 0.4659 Votes ≥ 1 0.3227 0.3569 0.3671 0.3927 0.4125 0.4722 0.4911 0.4944 0.3575 0.4230 0.4225 0.4421 Votes ≥ 2 0.3872 0.3979 0.4246 0.4669 0.4594 0.4827 0.5355 0.5407 0.3932 0.4322 0.4756 0.4936 Votes ≥ 3 0.3903 0.4019 0.4125 0.4709 0.4437 0.4776 0.5047 0.5229 0.3786 0.4145 0.4443 0.4737 Committee Votes ≥ 4 0.3803 0.3755 0.3999 0.4575 0.4220 0.4221 0.4665 0.4938 0.3588 0.3664 0.4075 0.4496 Multi-layer (4B) 0.3176 0.3230 0.3410 0.3903 0.4044 0.4034 0.4503 0.4864 0.3801 0.3835 0.4017 0.4551 Multi-stage (4B) 0.3314 0.3267 0.3429 0.4007 0.4101 0.4087 0.4538 0.4881 0.3813 0.3929 0.4033 0.4607 Multi-layer (8B) 0.3170 0.2967 0.3251 0.3940 0.3940 0.4133 0.4558 0.4842 0.3744 0.3978 0.4081 0.4594 Probes Multi-stage (8B) 0.3236 0.3242 0.3404 0.4076 0.3933 0.4290 0.4655 0.4977 0.3764 0.4091 0.4173 0.4616 Table 1: Language-wise scores against all three metrics on the test split of SHROOM-Visions’ train set. Multi-layer probes read a learned softmax-weighted combination of all layers including residual-stream differences; Multi-stage probes add boundary, sample-level, and token-level heads and gate the type prediction on the latter two (§3.2). 3.3 Committee Aggregation Judges often disagree on span boundaries, so we first project each judge’s spans onto characters: for character c, judge j’s confidence pj(c)p_j(c) and label ℓj(c) _j(c) are those of its highest-confidence covering span, and pj(c)=0p_j(c)=0 where no span covers c. Judges can then be compared position by position irrespective of their segmentation. We count the judges flagging each character, v(c)=∑j=1Nj(c)v(c)= _j=1^NI_j(c), and sum their confidences: prob[c]=1N∑j=1Nj(c)pj(c),prob[c]= 1N _j=1^NI_j(c)p_j(c), (1) where j(c)I_j(c) indicates whether judge j flags c and N is the number of judges. Dividing by N combines agreement with confidence; normalizing by v(c)v(c) would give the same value to a character flagged by one judge and by five, and the finer probability scale benefits the rank-based metrics. The predicted label is the category with the highest summed confidence. We retained characters with v(c)≥2v(c)≥ 2 and merged maximal runs sharing a label and probability into spans, mirroring the gold labels, the union of three annotators. The rule is deliberately inclusive, since most gold spans carry only one annotator. Adding high-recall probes did not improve performance. 4 Results and Discussion We evaluate using three metrics: correlation between predicted and empirical per-character hallucination probabilities (Cor), its per-label variant (Cor_lbl), and character-level intersection-over-union (IoU). Table 1 reports per-language results on the labeled test split for individual judges, committee variants with different vote thresholds and the best performing probes. No judge performs best across all settings. Fine-tuned Gemma-4 and Qwen3-VL are strongest in most languages, but different judges lead on specific metrics. Probe scores are closely correlated with one another, suggesting that performance depends on the underlying activations rather than the probe architecture. The committee outperforms every individual judge on Cor and IoU, the only exception being English Cor_lbl, where Qwen3-vl-ft-3shot scores slightly higher. With votes ≥ 2, it achieves the best Cor and IoU across all four languages, showing that aggregation recovers recall lost by fine-tuned judges while suppressing single-judge false positives. The threshold shows a consistent pattern: the two-vote setup performs best for Cor and IoU, whereas the stricter votes ≥ 3 slightly improves Cor_lbl in three of four languages by increasing label precision at the cost of coverage. The addition of the probes to the ensemble does not yield improvements overall due to the high correlation of errors with existing approaches. 4.1 Evaluation on the Challenge Set Table 2 shows the scores of the VLM committee on the unseen challenge set from the shared task for all languages. The votes ≥ 2 configuration ranks first in French, Italian, and Chinese on the correlation metrics and second in English, placing on the podium for every language and metric. English performs the worst, as its longer responses reduce annotator agreement and limit achievable scores. Although the margin on the seen split is small, the votes ≥ 3 configuration degrades performance for every language and metric on the challenge set, indicating a genuine difference rather than noise. Votes Metrics EN FR IT ZH Avg. Cor_lbl 0.4251 0.4738 0.4511 0.5040 0.4635 Cor 0.5334 0.5873 0.5628 0.6083 0.5730 ≥ 2 IoU 0.4486 0.5150 0.4793 0.5344 0.4943 Cor_lbl 0.4064 0.4509 0.4393 0.4988 0.4489 Cor 0.4965 0.5417 0.5300 0.5812 0.5373 ≥ 3 IoU 0.4063 0.4644 0.4447 0.5112 0.4566 Table 2: Language-wise scores on the SHROOM-Visions challenge set from the VLM judge committee with votes ≥ 2 and ≥ 3. Scores with votes ≥ 2 are from shared task rankings. 4.2 Label-wise Analysis System Inv. MisCh. OCR MisC. Oth. Gemma-4-ft 0.208 0.178 0.446 0.409 0.082 Mistral-small-ft 0.144 0.157 0.249 0.266 0.106 Qwen3.6-ft 0.182 0.112 0.399 0.365 0.036 Qwen3-vl-ft 0.186 0.176 0.280 0.365 0.039 Gemma-4-6shot 0.194 0.181 0.379 0.320 0.057 Cor_lbl Committee (≥ 2) 0.235 0.208 0.449 0.399 0.089 Gemma-4-ft 0.335 0.316 0.502 0.409 0.204 Mistral-small-ft 0.282 0.259 0.341 0.266 0.231 Qwen3.6-ft 0.276 0.231 0.534 0.364 0.133 Qwen3-vl-ft 0.324 0.293 0.430 0.362 0.208 Gemma-4-6shot 0.338 0.329 0.454 0.383 0.273 Cor Committee (≥ 2) 0.397 0.363 0.550 0.441 0.296 Gemma-4-ft 0.176 0.144 0.406 0.342 0.095 Mistral-small-ft 0.116 0.131 0.228 0.212 0.109 Qwen3.6-ft 0.143 0.091 0.369 0.309 0.036 Qwen3-vl-ft 0.148 0.145 0.244 0.300 0.036 Gemma-4-6shot 0.203 0.145 0.338 0.246 0.063 IoU Committee (≥ 2) 0.199 0.168 0.404 0.315 0.086 Gemma-4-ft 0.332 0.342 0.379 0.334 0.331 Mistral-small-ft 0.361 0.357 0.440 0.446 0.328 Qwen3.6-ft 0.352 0.366 0.378 0.349 0.355 Qwen3-vl-ft 0.348 0.342 0.422 0.356 0.354 Gemma-4-6shot 0.498 0.466 0.447 0.475 0.394 MAEp↓ Committee (≥ 2) 0.309 0.318 0.310 0.305 0.336 Table 3: Label-wise scores on the test split of SHROOM-Visions’ train set. Cor_lbl, Cor and IoU are higher-is-better; MAEp is the mean absolute difference between predicted and gold character probabilities (lower is better). Table 3 breaks the official metrics down by hallucination label and adds MAEp, the mean absolute difference between predicted and gold character probabilities. The committee is strongest overall on all four measures, most clearly on the correlation metrics: it obtains the best Cor on every label and the best Cor_lbl on three of five, raising Cor. A single judge emits only three confidence values, confining it to a coarse grid, whereas averaging over the committee yields a finer range closer to the empirical annotator agreement, reducing the MAEp. The picture is mixed for IoU, which depends only on which characters are marked: individual judges remain competitive on invention, OCR and miscounting, and the committee’s advantage comes from suppressing spans that only one judge proposes rather than from marking more text. Performance on other is low throughout, consistent with it being the least frequent and least consistently annotated category. 4.3 VLM Judge vs. Annotator Agreement Judge agreement tracks human agreement. Table 4 groups characters by how many judges flagged them. The mean number of annotators who marked them rises monotonically from 0.110.11 at zero votes to 2.072.07 at five, with a Spearman correlation of 0.390.39 over characters and 0.510.51 at the record level. This supports our claim that model diversity reflects annotator disagreement and motivates the two-vote (≥ 2) threshold. Judges flagging Mean annotators Characters 0 0.109 633,649 1 0.453 86,999 2 0.743 19,838 3 1.205 9,171 4 1.535 5,968 5 2.072 5,260 Table 4: Mean number of annotators marking a character, grouped by how many judges flagged it. 4.4 Committee vs. Probes The two approaches trade accuracy against cost: the committee needs five forward passes through large fine-tuned VLMs, while a probe adds only a lightweight head over hidden states from a single pass. Probes match individual judges on IoU but trail the committee on the correlation metrics, making them preferable when the inference budget is the binding constraint. 5 Conclusion We present a committee approach to multilingual hallucination span detection in vision-language models. Fine-tuned and few-shot judges independently identify unsupported spans, which are combined through character-level voting. Only corroborated spans are retained, while averaged confidences provide the probabilities used by the correlation metric. The system ranks first in three of four languages. The results show that activation probes can detect hallucinations from language model hidden states, but the results are highly dependent on the model from which the activations are collected. Currently, it is unclear whether probes offer mechanistic insight into hallucination or merely exploit surface linguistic features. Limitations Our committee inherits the limitations of its individual judges. Long, fluent hallucinations not confidently detected by multiple models may fall below the two-vote threshold and remain undetected, particularly in the longer English responses where performance is weakest. We also do not explore image preprocessing: images vary considerably in resolution and are passed to the judges without normalization or aspect-ratio-aware transformation, which may affect grounding. The voting threshold is tuned on the labeled test split and applied unchanged to the challenge set, but may not generalize to other models, languages, or annotation schemes. Confidence scores are based on three discrete agreement classes rather than continuous estimates, limiting how precisely uncertainty can be represented. Finally, our analysis is limited to the four task languages and selected judges, and the aggregated predictions may not capture the full complexity of human annotator disagreement. Acknowledgments This research was part of the Postdoctoral Programme for Research Institutes in Finland, funded by the Finnish Government. We used Claude (Anthropic) to assist with drafting and editing the paper and with code generation. All decisions, experiments, and results were designed and verified by the authors. Data and Code Availability Our VLM committee code is available at https://github.com/toqeerehsan/vlm_hallucination_detect and the fine-tuned checkpoints(v3) at https://huggingface.co/QSTS-VTT. The SHEEP dataset is distributed by the task organizers. References Abdelwahab et al. (2026) M. Abdelwahab, M. Y. Collins, S. Chen, Y. C. Zhao, Z. Mahmood, J. Zhu, S. Ali, and J. Rose What are They Thinking? Delineation, Probing, and Tracking of Concepts in LLMs. In Proceedings of the 6th Workshop on Trustworthy NLP (TrustNLP 2026), K. Chang, N. Mehrabi, S. Krishna, A. Das, J. Dhamala, Y. T. Cao, T. Kumarage, A. Ramakrishna, C. Christodoulopoulos, Y. Wan, A. Galystan, A. Kumar, and R. Gupta (Eds.), San Diego, California, p. 121–179. External Links: Link, Document, ISBN 979-8-89176-418-7 Cited by: §3.2. Bai et al. (2025a) S. Bai, Y. Cai, R. Chen, et al. Qwen3-VL Technical Report. arXiv preprint arXiv:2511.21631. Cited by: §3.1. Bai et al. (2025b) Z. Bai, P. Wang, T. Xiao, T. He, Z. Han, Z. Zhang, and M. Z. Shou Hallucination of Multimodal Large Language Models: A Survey. arXiv preprint arXiv:2404.18930. Cited by: §1. Bar-Shalom et al. (2025) G. Bar-Shalom, F. Frasca, Y. Galron, Y. Ziser, and H. Maron Beyond Token Probes: Hallucination Detection via Activation Tensors with ACT-ViT. In Advances in Neural Information Processing Systems, D. Belgrave, C. Zhang, H. Lin, R. Pascanu, P. Koniusz, M. Ghassemi, and N. Chen (Eds.), Vol. 38, p. 85531–85561. External Links: Link Cited by: §3.2. Chen et al. (2024) C. Chen, K. Liu, Z. Chen, Y. Gu, Y. Wu, M. Tao, Z. Fu, and J. Ye INSIDE: LLMs’ Internal States Retain the Power of Hallucination Detection. External Links: 2402.03744, Link Cited by: §2. Gemma Team (2026) Gemma Team Gemma 4 Technical Report. External Links: 2607.02770 Cited by: §3.1. Geng et al. (2024) J. Geng, F. Cai, Y. Wang, H. Koeppl, P. Nakov, and I. Gurevych A Survey of Confidence Estimation and Calibration in Large Language Models. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), K. Duh, H. Gomez, and S. Bethard (Eds.), Mexico City, Mexico, p. 6577–6595. External Links: Link, Document Cited by: §2. Guan et al. (2024) T. Guan, F. Liu, X. Wu, R. Xian, Z. Li, X. Liu, X. Wang, L. Chen, F. Huang, Y. Yacoob, D. Manocha, and T. Zhou Hallusionbench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vol. , p. 14375–14385. External Links: Document Cited by: §2. Gunjal et al. (2024) A. Gunjal, J. Yin, and E. Bas Detecting and preventing hallucinations in large vision language models. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence, AAAI’24/IAAI’24/EAAI’24. External Links: ISBN 978-1-57735-887-9, Link, Document Cited by: §2. Han et al. (2025) J. Han, N. Band, M. Razzak, J. Kossen, T. G. Rudner, and Y. Gal Simple Factuality Probes Detect Hallucinations in Long-Form Natural Language Generation.. In EMNLP (Findings), p. 16209–16226. Cited by: §3.2. Hu et al. (2022) E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations (ICLR), Cited by: §D.1, §3.1. Huang et al. (2025) L. Huang, W. Yu, W. Ma, W. Zhong, Z. Feng, H. Wang, Q. Chen, W. Peng, X. Feng, B. Qin, and T. Liu A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions. ACM Transactions on Information Systems 43 (2), p. 1–55. Cited by: §1. Jing et al. (2024) L. Jing, R. Li, Y. Chen, and X. Du FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2024, Y. Al-Onaizan, M. Bansal, and Y. Chen (Eds.), Miami, Florida, USA, p. 5042–5063. External Links: Link, Document Cited by: §2. Kim et al. (2025) H. Kim, T. A. Lamb, A. Bibi, P. Torr, and Y. Gal Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Ambiguous Prompts and Unanswerable Questions. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng (Eds.), Suzhou, China, p. 32310–32322. External Links: Link, Document, ISBN 979-8-89176-332-6 Cited by: §3.2, §3.2. Kossen et al. (2024) J. Kossen, J. Han, M. Razzak, L. Schut, S. Malik, and Y. Gal Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs. External Links: 2406.15927, Link Cited by: §3.2. Li et al. (2024) Q. Li, J. Geng, C. Lyu, D. Zhu, M. Panov, and F. Karray Reference-free Hallucination Detection for Large Vision-Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2024, Y. Al-Onaizan, M. Bansal, and Y. Chen (Eds.), Miami, Florida, USA, p. 4542–4551. External Links: Link, Document Cited by: §2. Li et al. (2025) W. Li, Z. Huang, H. Li, L. Lu, Y. Lu, X. Tian, X. Shen, and J. Ye Visual Evidence Prompting Mitigates Hallucinations in Large Vision-Language Models. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), W. Che, J. Nabende, E. Shutova, and M. T. Pilehvar (Eds.), Vienna, Austria, p. 4048–4080. External Links: Link, Document, ISBN 979-8-89176-251-0 Cited by: §2. Liu et al. (2024) H. Liu, W. Xue, Y. Chen, D. Chen, X. Zhao, K. Wang, L. Hou, R. Li, and W. Peng A Survey on Hallucination in Large Vision-Language Models. arXiv preprint arXiv:2402.00253. Cited by: §1. McKenzie et al. (2025) A. McKenzie, U. Pawar, P. Blandfort, W. Bankes, D. Krueger, E. S. Lubana, and D. Krasheninnikov Detecting High-Stakes Interactions with Activation Probes. In Advances in Neural Information Processing Systems, D. Belgrave, C. Zhang, H. Lin, R. Pascanu, P. Koniusz, M. Ghassemi, and N. Chen (Eds.), Vol. 38, p. 127556–127594. External Links: Link Cited by: §3.2. Mickus et al. (2026) T. Mickus, C. Savelli, E. Calò, E. Raimond, S. Frank, H. Luo, F. Giobergia, V. Segonne, C. Li, A. Sinha, L. Vaiani, J. Tiedemann, and R. Vázquez Can Humans Dream of Electric Sheep? Human-Written Samples for Fine-Grained Vision-and-Language Hallucination Benchmarking. External Links: 2608.01021, Link Cited by: §1, §2, §3. Mickus et al. (2024) T. Mickus, E. Zosa, R. Vázquez, T. Vahtola, J. Tiedemann, V. Segonne, A. Raganato, and M. Apidianaki SemEval-2024 Task 6: SHROOM, a Shared-Task on Hallucinations and Related Observable Overgeneration Mistakes. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), Mexico City, Mexico, p. 1979–1993. Cited by: §1. Mistral AI (2025) Mistral AI Mistral-Small-3.1-24B-Instruct-2503. Note: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503 Cited by: §3.1. Nath et al. (2026) S. Nath, A. Basu, S. Dasgupta, and S. Das HalluShift++: Bridging Language and Vision through Internal Representation Shifts for Hierarchical Hallucinations in MLLMs. In Proceedings of the Sixteenth Indian Conference on Computer Vision, Graphics and Image Processing, ICVGIP ’25, New York, NY, USA. External Links: ISBN 9798400719301, Link, Document Cited by: §2. Orgad et al. (2025) H. Orgad, M. Toker, Z. Gekhman, R. Reichart, I. Szpektor, H. Kotek, and Y. Belinkov LLMs know more than they show: on the intrinsic representation of llm hallucinations. Y. Yue, A. Garg, N. Peng, F. Sha, and R. Yu (Eds.), Vol. 2025, p. 66880–66913. External Links: Link Cited by: §3.2. Qwen Team (2025) Qwen Team Qwen3-vl technical report. arXiv preprint arXiv:2511.21631. Cited by: §D.1. Qwen Team (2026) Qwen Team Qwen3.6-27B: Flagship-Level Coding in a 27B Dense Model. External Links: Link Cited by: §D.1, §3.1. Rohrbach et al. (2018) A. Rohrbach, L. A. Hendricks, K. Burns, T. Darrell, and K. Saenko Object Hallucination in Image Captioning. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, E. Riloff, D. Chiang, J. Hockenmaier, and J. Tsujii (Eds.), Brussels, Belgium, p. 4035–4045. External Links: Link, Document Cited by: §2. Seth et al. (2025) A. Seth, D. Manocha, and C. Agarwal HALLUCINOGEN: Benchmarking Hallucination in Implicit Reasoning within Large Vision Language Models. In Proceedings of the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP 2025), B. Eikema, R. Vázquez, J. Berant, M. de Marneffe, B. Plank, A. Shelmanov, S. Swayamdipta, J. Tiedemann, C. Zerva, and W. Aziz (Eds.), Suzhou, China, p. 89–102. External Links: Link, Document, ISBN 979-8-89176-349-4 Cited by: §2. Shekhar et al. (2017) R. Shekhar, S. Pezzelle, Y. Klimovich, A. Herbelot, M. Nabi, E. Sangineto, and R. Bernardi FOIL it! Find One mismatch between Image and Language caption. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), R. Barzilay and M. Kan (Eds.), Vancouver, Canada, p. 255–265. External Links: Link, Document Cited by: §2. Shen et al. (2025) S. Shen, M. Singh, L. Logeswaran, M. Lee, H. Lee, and R. Mihalcea Revisiting LLM Value Probing Strategies: Are They Robust and Expressive?. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng (Eds.), Suzhou, China, p. 131–145. External Links: Link, Document, ISBN 979-8-89176-332-6 Cited by: §3.2. Shoby et al. (2026) A. Shoby, T. D. Huy, T. D. Nguyen, M. K. Ho, Q. Chen, A. van den Hengel, P. L. Nguyen, J. W. Verjans, and V. M. H. Phan Overthinking Causes Hallucination: Tracing Confounder Propagation in Vision Language Models. External Links: 2603.07619, Link Cited by: §2. Vázquez et al. (2025) R. Vázquez, T. Mickus, E. Zosa, T. Vahtola, J. Tiedemann, A. Sinha, V. Segonne, F. Sanchez Vega, A. Raganato, J. Libovický, J. Karlgren, S. Ji, J. Helcl, L. Guillou, O. De Gibert, J. Bengoetxea, J. Attieh, and M. Apidianaki SemEval-2025 Task 3: Mu-SHROOM, the Multilingual Shared-Task on Hallucinations and Related Observable Overgeneration Mistakes. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), Vienna, Austria, p. 2472–2497. Cited by: §1. Vázquez et al. (2026) R. Vázquez, A. Sinha, C. Li, A. Shelmanov, A. Vazhentsev, C. Savelli, E. Calò, E. Raimond, S. Frank, H. Luo, F. Giobergia, V. Segonne, L. Vaiani, J. Tiedemann, and T. Mickus Overview of shroom-visions 2026: a shared task on hallucination detection in large vision-language models. External Links: 2608.25662, Link Cited by: §1. Wang et al. (2026) Z. Wang, S. YANG, B. Peng, Z. Tang, Y. Li, B. Dong, and J. Dong Same attention, different truths: put logit-lens over visual attention to detect and mitigate lvlm object hallucination. In Proceedings - 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2026, p. 25315–25325 (English). Note: IEEE/CVF Conference on Computer Vision and Pattern Recognition 2026 (CVPR 2026) ; Conference date: 03-06-2026 Through 07-06-2026 Cited by: §2. Xie et al. (2026) Y. Xie, K. Aggarwal, A. Ahmad, and S. Lau Controlled Automatic Task-Specific Synthetic Data Generation for Hallucination Detection. External Links: 2410.12278, Link Cited by: §2. Ye-Bin et al. (2025) M. Ye-Bin, N. Hyeon-Woo, W. Choi, and T. Oh BEAF: Observing BEfore-AFter Changes to Evaluate Hallucination in Vision-Language Models. In Computer Vision – ECCV 2024, A. Leonardis, E. Ricci, S. Roth, O. Russakovsky, T. Sattler, and G. Varol (Eds.), Cham, p. 232–248. External Links: ISBN 978-3-031-73247-8 Cited by: §2. Zhang et al. (2024a) D. Zhang, V. Gangal, B. Lattimer, and Y. Yang Enhancing Hallucination Detection through Perturbation-Based Synthetic Data Generation in System Responses. In Findings of the Association for Computational Linguistics: ACL 2024, L. Ku, A. Martins, and V. Srikumar (Eds.), Bangkok, Thailand, p. 13321–13332. External Links: Link, Document Cited by: §2. Zhang et al. (2023) J. Zhang, Z. Li, K. Das, B. Malin, and S. Kumar SAC3^3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistency. In Findings of the Association for Computational Linguistics: EMNLP 2023, H. Bouamor, J. Pino, and K. Bali (Eds.), Singapore, p. 15445–15458. External Links: Link, Document Cited by: §2. Zhang et al. (2024b) R. Zhang, H. Zhang, and Z. Zheng VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation. External Links: 2411.11919, Link Cited by: §2. Zhang et al. (2025) Y. Zhang, Y. Li, L. Cui, D. Cai, L. Liu, T. Fu, X. Huang, E. Zhao, Y. Zhang, Y. Chen, L. Wang, A. T. Luu, W. Bi, F. Shi, and S. Shi Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models. Computational Linguistics 51 (4), p. 1373–1418. Cited by: §1. Appendix A SHEEP examples: penalizing elaboration and world knowledge See Figure 2. Figure 2: The three selected samples from the SHEEP dataset, showing penalization of factually correct elaboration for hallucinated attributes. Appendix B SHEEP examples: penalizing world knowledge See Figure 3. Figure 3: The three selected samples from the SHEEP dataset, showing penalization of factually correct, but hard to verify world knowledge. Appendix C Probing details C.1 Base model initialization The underlying Qwen models from which the embeddings were extracted from were initialized with the image from the dataset, a system prompt, a user prompt consisting of the prompt from the dataset and the response from the dataset. The system prompt used for extracting the hidden states was the following. You are an image-grounded hallucination detector. Given an image, a query and a response, identify hallucinated spans in the response and assign labels. Labels: A. invention : entities, objects, properties, or events not present in the image. B. mischaracterization : incorrect description of content that is visible. C. OCR : misreading of text visible in the image. D. miscounting : incorrect reporting of quantities of visible items. E. other : the hallucination does not fit in classes A-D. The user prompt contained the inputs, with most importantly the response being started and ended with easily identifiable token sequences. C.2 Training The probes were trained with a learning rate of 1×10−41× 10^-4, with a batch size of 24 and with weight decay of 0.01. The weight factors for the different BCE-losses were 1.0 for hallucination type loss, 0.1 for the boundary (start/end) loss, 0.5 for the sample level hallucination loss and 0.25 for the token-level hallucination loss. Appendix D VLM judge configurations D.1 Fine-tuning We adapt each backbone with LoRA Hu et al. (2022), using rank 6464, α=16α=16, and dropout 0.050.05, together with rsLoRA and LoRA+ at a ratio of 44. Training runs for two epochs with a learning rate of ×10−55\!×\!10^-5, warmup ratio 0.050.05, batch size 11, gradient accumulation over 88 steps, and a maximum sequence length of 61926192. We use bf16 without quantization. The judges are based on Gemma 4, Mistral-Small, Qwen3-VL Qwen Team (2025), and Qwen3.6 Qwen Team (2026), with each fine-tuned on a distinct data subset. The committee also includes one few-shot Gemma 4 judge. D.2 Prompt You are a hallucination-span annotator for vision-language model outputs. You are given: an IMAGE, a PROMPT that was asked about it, and a RESPONSE that a vision-language model produced. Parts of the RESPONSE are often hallucinated — that is, not supported by the image. Your job: MARK hallucinations with <hall> tags inserted around every hallucinated span and return the RESPONSE text EXACTLY as given, character for character. Change NOTHING else — do not fix typos, spacing, markdown, or line breaks. Do not add words. Do not add any preamble, reasoning, or explanation. Output ONLY the annotated response text. Tag format: <hall label="LABEL" prob="PROBCLASS">hallucinated text</hall> LABEL is exactly one of (never "None", never empty): invention - entity/object/property/event not present in the image mischaracterization - content is visible but described incorrectly OCR - text visible in the image is misread miscounting - a quantity of visible items is reported incorrectly other - a hallucination that fits none of the above PROBCLASS is exactly one of prob1..prob3 (never "None"): how likely a panel of three human annotators would agree the span is hallucinated (higher = clearer): prob1 - ˜0.3333 (weak) , prob2 - ˜0.6667 , prob3 - ˜1.0 (blatant). How to annotate: - Be thorough: check every claim against the image (colors, counts, object/species identity, brands, text, spatial relations, materials, details) and MARK anything not clearly supported. - Mark a doubtful span with low-confidence (prob1) class rather than leaving unmarked. - Mark the SMALLEST text carrying the error (a word or short phrase), not the whole sentence. - Tags may nest (in rare cases), but never partially cross, never repeat the same tag on the same text, and never wrap markdown like **. - Leave the response untagged ONLY if every claim is supported. - Keep the response in its original language.