Paper deep dive
SLAPBench: Benchmarking Multimodal Large Language Models for Four-Finger SLAP Fingerprint Verification
Bibesh Pyakurel, M. G. Sarwar Murshed
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 94%
Last extracted: 7/20/2026, 2:47:48 AM
Summary
The paper introduces SLAPBench, a benchmark for evaluating Multimodal Large Language Models (MLLMs) on four-finger SLAP fingerprint verification using NIST SD302b. It evaluates five models (InternVL3-8B, Qwen2.5-VL-7B, Qwen3-VL-8B, Gemma-3-12B, Claude Opus 4.8) under zero-shot, task-description, and similarity-scoring prompts. Key findings include positive-bias collapse in open-source models under binary prompting, with Claude Opus 4.8 being the only model to resist collapse. Similarity scoring reveals significant capability gaps, with Qwen3-VL-8B achieving perfect separation (AUC=1.0) but potentially exploiting near-duplicate detection rather than true biometric matching.
Entities (22)
Relation Signals (32)
SLAPBench → usesdataset → NIST SD302b
confidence 98% · SLAPBench... built from NIST SD302b
SLAPBench → usesdataset → NIST SD302b
confidence 98% · SLAPBench, the first benchmark for MLLM-based four-finger SLAP fingerprint verification, built from NIST SD302b
Qwen3-VL-8B-Instruct → achieves → Area Under the Curve
confidence 95% · Qwen3-VL-8B-Instruct attains perfect separation (AUC = 1.000)
Claude Opus 4.8 → achieves → False Accept Rate
confidence 95% · Claude Opus 4.8 alone resists collapse... giving the best binary result (FAR = 20.2%)
Qwen2.5-VL-7B-Instruct → achievesmetric → AUC = 0.567
confidence 95% · Qwen2.5-VL-7B near random (0.567)
Qwen3-VL-8B-Instruct → achievesmetric → AUC = 1.000
confidence 95% · Qwen3-VL-8B attains perfect separation (AUC = 1.000)
Claude Opus 4.8 → achievesmetric → AUC = 0.953
confidence 95% · Claude reaches AUC = 0.953
Gemma-3-12b-it → achievesmetric → AUC = 0.837
confidence 95% · Gemma-3-12B 0.837
InternVL3-8B-Instruct → →
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Four-finger SLAP fingerprints are flat live-scan impressions of the index, middle, ring, and little fingers of one hand, used for identity verification in border control and law enforcement. No benchmark has evaluated whether multimodal large language models (MLLMs) can verify identity from SLAP images. We introduce SLAPBench, the first benchmark for MLLM-based four-finger SLAP fingerprint verification, built from NIST SD302b with 7,832 pairs (176 mated, 7,656 non-mated). We evaluate four open-source MLLMs (InternVL3-8B, Qwen2.5-VL-7B, Qwen3-VL-8B, Gemma-3-12B) and the proprietary Claude Opus 4.8 under zero-shot, task-description, and similarity-scoring prompts. Prompting governs verification behavior. Task-description prompting collapses all four open-source models to near-100% False Accept Rate (FAR), and Gemma-3-12B collapses under zero-shot as well; Claude Opus 4.8 alone resists collapse under both binary prompts, giving the best binary result (FAR = 20.2%). Similarity scoring removes collapse across the open-source models and exposes wide capability gaps: Claude reaches AUC = 0.953 and Gemma-3-12B 0.837, while InternVL3-8B is inverted (AUC = 0.590) and Qwen2.5-VL-7B near random (0.567). Qwen3-VL-8B attains perfect separation (AUC = 1.000), which we treat as a diagnostic rather than as capability: SD302b holds one SLAP capture per finger position, so mated pairs are cross-resolution. A matched-resolution control leaves the perfect score intact, ruling out the resolution shortcut; what cannot be excluded within SD302b is near-duplicate detection, since a mated pair is one capture rendered twice. A fairness probe over gender, race, and age suggests disparity grows as discrimination weakens. SLAPBench establishes the first SLAP-specific MLLM baseline and shows that prompting governs collapse while model capability governs discrimination.
Tags
Links
- Source: https://arxiv.org/abs/2607.15517v1
- Canonical: https://arxiv.org/abs/2607.15517v1
Trouble viewing inline? Open PDF directly →
Full Text
48,363 characters extracted from source content.
Expand or collapse full text
SLAPBench: Benchmarking Multimodal Large Language Models for Four-Finger SLAP Fingerprint Verification Bibesh Pyakurel and M. G. Sarwar Murshed Computer Science Department, University of Wisconsin–Green Bay, Green Bay, WI, USA Abstract. Four-finger SLAP fingerprints are flat live-scan impressions of the index, middle, ring, and little fingers of one hand. They are widely used for identity verification in high-stakes settings, including border control, immigration screening, law enforcement, criminal background checks, and national identity management. Despite this operational importance, no benchmark has evaluated whether multimodal large language models (MLLMs) can verify identity from SLAP finger- print images. We introduce SLAPBench, the first benchmark for MLLM-based four-finger SLAP fingerprint verification, built from NIST Special Database 302b (SD302b), an operational nail-to-nail fingerprint dataset containing 201 participants captured at 500 and 1000 PPI across multiple devices. We construct 7,832 verification pairs using an impostor- heavy all-pairs protocol, comprising 176 mated and 7,656 non-mated pairs. We evaluate four open-source MLLMs, InternVL3-8B-Instruct, Qwen2.5-VL-7B-Instruct, Qwen3-VL-8B-Instruct, and Gemma-3-12B- IT, alongside the proprietary Claude Opus 4.8 model under three prompting strategies: zero-shot, task-description, and continuous similarity scoring. Prompt design has a substantial effect on verification behavior. Task-description prompting causes all open-source models to collapse to near-100% False Accept Rate (FAR), while Gemma-3-12B-IT also collapses under zero-shot prompting. Claude Opus 4.8 is the only model that avoids collapse under both binary prompts and achieves the best binary result, with FAR = 20.2%. Continuous similarity scoring removes collapse across the open-source models and exposes clear differences in discrimination. Claude Opus 4.8 achieves AUC = 0.953 and EER = 11.8%, followed by Gemma-3-12B-IT with AUC = 0.837 and EER = 15.1%. InternVL3-8B-Instruct shows inverted calibration (AUC = 0.590), and Qwen2.5-VL-7B-Instruct remains near random (AUC = 0.567). Qwen3-VL-8B-Instruct obtains perfect separation (AUC = 1.000, EER = 0.0%); however, we treat this as a diagnostic rather than as evidence of biometric capability. Because SD302b pro- vides only one SLAP capture per finger position, mated pairs must be formed across resolutions, raising the concern that a model could exploit resolution rather than identity. We run a matched-resolution control that makes both classes cross-resolution, and the perfect separation persists (AUC = 1.000), which rules the resolution shortcut out. What remains, and cannot be tested within SD302b, is that a mated pair is one capture arXiv:2607.15517v1 [cs.CV] 17 Jul 2026 2B. Pyakurel and M. G. S. Murshed rendered twice, so the model may instead be detecting near-duplicate images. We therefore read this as a cautionary finding about how MLLM biometric benchmarks are assembled. Finally, a stratified analysis over gender, race, and age suggests that demographic disparity increases when model discrimination is weak, although subgroup sizes limit this to an initial fairness probe. Overall, SLAPBench establishes the first SLAP-specific MLLM verification baseline and shows that prompting governs collapse, while model capability governs whether meaningful fingerprint discrimination can be recovered. Keywords: Fingerprint verification· SLAP fingerprint· Multimodal large language models· Biometric benchmark· NIST SD302b· Similarity scoring· Positive-bias collapse· Protocol confound 1 Introduction Four-finger SLAP fingerprints are flat live-scan impressions acquired by simulta- neously capturing the index, middle, ring, and little fingers of one hand. These impressions are widely used for identity verification in high-stakes operational settings, including border control, immigration screening, law enforcement, crim- inal background checks, and national identity management. In U.S. border op- erations, SLAP impressions support traveler identity verification against large- scale biometric repositories such as the DHS Automated Biometric Identification System (IDENT) [9]. Despite their operational importance, SLAP fingerprints remain largely un- explored in recent evaluations of multimodal large language models (MLLMs). Existing fingerprint-oriented MLLM benchmarks primarily evaluate individual rolled or plain fingerprint impressions [4]. For example, FPBench evaluates 20 MLLMs across eight fingerprint tasks, but its evaluations are based on single-finger rolled or plain impressions drawn from Fingerprint Verification Competition (FVC) datasets and NIST SD302d/SD301a [4]. These settings differ substantially from SLAP verification. A four-finger SLAP image contains multiple fingers in a single frame and exhibits variation in ridge clarity, contact pressure, finger placement, inter-finger spacing, and local distortion. Consequently, SLAP verification requires not only fine-grained ridge comparison but also spatial reasoning over the relative structure and correspondence of multiple fingers. NIST Special Database 302b (SD302b) provides a particularly relevant basis for studying this problem. Unlike curated benchmarks designed primarily for controlled algorithmic evaluation, SD302b reflects operational live-scan acquisi- tion and includes images captured across multiple devices and resolutions. This makes it a challenging and deployment-relevant testbed for evaluating whether general-purpose MLLMs can perform identity verification from four-finger SLAP fingerprint images. A second open question concerns the role of prompting. Prior biometric MLLM benchmarks for face and fingerprint recognition have reported positive- SLAPBench: MLLMs for Four-Finger SLAP Verification3 bias collapse, in which a model repeatedly predicts “same person” regardless of the input pair [4,14]. On a balanced verification set, such behavior can yield 50% accuracy while concealing a critical failure mode. In high-stakes biometric ap- plications, however, this behavior would be unacceptable because it corresponds to accepting every comparison as genuine. Binary forced-choice prompting is commonly used in biometric MLLM evaluation, but it remains unclear whether this format induces similar collapse on SLAP fingerprint images, or whether alternative prompt designs can mitigate the problem. To address these gaps, we introduce SLAPBench, an evaluation benchmark for MLLM-based four-finger SLAP fingerprint verification. SLAPBench is in- tended as an evaluation probe of current MLLM behavior, not as a proposed deployment system for operational biometric verification. Our goal is to char- acterize how these models succeed and fail on SLAP-format fingerprint images, and to examine how prompting strategy affects verification behavior, collapse, and discriminative performance. This paper makes the following contributions: 1. SLAPBench, the first benchmark for MLLM evaluation on four-finger SLAP fingerprint verification, built on NIST SD302b, an operational dataset that no prior fingerprint MLLM work has used. 2. A reproducible evaluation protocol of 7,832 fixed pairs (176 mated, formed across resolution because SD302b provides a single SLAP capture per finger position; 7,656 non-mated, covering all 88 2 subject combinations per FRGP), released as a fixed pair manifest with demographic metadata that supports a stratified analysis across gender, race, and age. 3. Systematic evidence of positive-bias collapse on SLAP data. Five of ten binary prompting configurations collapse to accepting nearly every pair as genuine. All four open-source models collapse under task-description prompting and Gemma-3-12B collapses under zero-shot as well, while the proprietary Claude Opus 4.8 resists collapse under both prompts. Collapse is therefore largely a property of the prompt format, but a sufficiently capable model can overcome it. 4. A similarity-scoring prompt that exposes model capability. Scoring eliminates collapse in all four open-source models, yet discrimination still ranges from functional (Claude Opus 4.8, Gemma-3-12B) to near-random or inverted (Qwen2.5-VL-7B, InternVL3-8B). Scoring is thus necessary but not sufficient, and model architecture sets the ceiling (Table 1). 5. A cautionary analysis of a perfect benchmark score. Qwen3-VL-8B attains AUC = 1.000 under scoring. A matched-resolution control that re- moves resolution as a class cue leaves the perfect separation intact, which ex- cludes the resolution shortcut; the single-capture design of SD302b nonethe- less leaves near-duplicate detection in place, and no configuration of the dataset can separate it from identity matching. We offer this as evidence that near-perfect MLLM biometric results warrant a protocol audit before they are read as capability. 6. Public release of the evaluation code, the fixed pair manifest, the raw result CSVs, and the per-pair score files, so that every number reported here can 4B. Pyakurel and M. G. S. Murshed be recomputed. Code and data: https://github.com/bibeshpyakurel/ SLAPBench. 2 Related Work Fingerprint recognition. Classical pipelines of acquisition, enhancement, fea- ture extraction, and matching [6] have been advanced at each stage by deep learning: FingerNet unifies ridge-orientation and minutiae extraction [15], Deep- Print learns fixed-length embeddings for scalable verification [3], and commercial matchers such as VeriFinger [10] provide operational FAR/FRR baselines. SLAP segmentation is studied separately [7]; to our knowledge no prior work evaluates end-to-end MLLM performance on SLAP images. MLLM biometric benchmarks. FaceXBench [8] evaluates 28 models on 5,000 face-task questions and finds chain-of-thought prompting consistently degrades performance, a caution against assuming more context helps. Fac- eRecBench [14] benchmarks 27 MLLMs on face verification and reports two findings we revisit for fingerprints: many models collapse to 50% accuracy by always accepting or rejecting, and the best model carries the strongest demographic bias; a follow-up extends this to heterogeneous face recognition with similar capability gaps [13]. FPBench [4] is closest to us, evaluating 20 MLLMs on eight single-finger fingerprint tasks under MCQ prompting. We differ in three ways: four-finger SLAP images requiring spatial reasoning; continuous similarity scoring alongside binary classification; and the operational SD302b dataset. Across these benchmarks, response collapse recurs and has been attributed to training-data priors favouring “same” together with the ambiguity of biometric comparison in language; we give the first quantitative account on SLAP images and show that continuous scoring removes it. 3 Dataset and Data Preparation 3.1 NIST Special Database 302b NIST SD302b [9] is a subset of the Nail-to-Nail (N2N) Fingerprint Challenge dataset collected by the Intelligence Advanced Research Projects Activity (IARPA). The database contains fingerprint images from 201 participants captured using multiple devices at two resolutions: 500 PPI (standard oper- ational resolution) and 1000 PPI (high resolution for research). Participants span diverse demographics including age (range: 18–70), gender, race, and occupational background (work type), enabling stratified fairness analysis. We focus exclusively on FRGP 13 (right four-finger SLAP) and FRGP 14 (left four-finger SLAP) images captured by Device R. Device R images in SD302b are captured natively at 1000 PPI, and the corresponding 500 PPI versions are supplied for compatibility with 500 PPI fingerprint algorithms. The 500 PPI image is therefore a downsampled version of the same capture rather than a second, independent impression. We confirmed this directly against the SLAPBench: MLLMs for Four-Finger SLAP Verification5 distributed file structure: each (subject, FRGP) combination is represented by exactly one capture, available at two resolutions, and SD302b offers no repeat SLAP impression for any subject and finger position. This database property, not a choice of ours, fixes the form of a mated pair: a same-capture cross-resolution comparison between the native 1000 PPI image and its 500 PPI counterpart, not two independent impressions (Sections 4.1 and 6). Data preparation. Following the SD302b documentation we exclude errata- flagged subjects (labeling errors), roll images (devices U, V), FRGP 15 thumb- slaps, and pre-cropped segmented crops, and keep only subjects with both R- 500 and R-1000 captures. Of the 201 participants, 92 have Device R four-finger SLAP at both FRGP 13/14 and both resolutions; removing errata/incomplete subjects leaves 88 clean subjects. The verification experiment therefore uses 352 Device R images (88 subjects × 2 FRGP × 2 resolutions). For each image we record image-level metadata, per-finger segmentation ground truth (bounding boxes and rotation angle θ from the SD302b segmentation CSVs), and participant demographics. Ground-truth segmentation. SD302b ships per-image segmentation CSVs giving bounding-box coordinates and a rotation angle for each finger (dedicated SLAP segmentation systems address the same step [7]); a representative overlaid image appears in Fig. S1. For verification we use the full SLAP images without cropping, as operational pipelines do. Because a single frame holds four over- lapping fingers of similar morphology, any two SLAP images look globally alike whether mated or not, which underlies the positive-bias collapse analyzed in Section 6. 4 Evaluation Protocol and Methodology 4.1 Pair Construction We construct mated and non-mated verification pairs following the all-pairs pro- tocol used in FaceRecBench [14] and FPBench [4]. Mated (genuine) pairs. For each FRGP∈13, 14, we pair each subject’s native 1000 PPI image with the corresponding downsampled 500 PPI version of the same capture. With 88 clean subjects, this yields 88 mated pairs per FRGP and 176 mated pairs in total, fixed by the structure of the database rather than by a sampling decision. Non-mated (impostor) pairs. For each FRGP, we form all pairings of distinct subjects. With 88 subjects, this yields 88 2 = 3,828 unique non-mated pairs per FRGP, and 3,828× 2 = 7,656 non-mated pairs in total. The resulting 7,832 pairs (176 mated + 7,656 non-mated), released as a fixed manifest, form an intentionally impostor-heavy protocol; as is standard in biometrics, we emphasize FAR, FRR, AUC, EER, and TAR at low FAR rather than overall accuracy, which the non-mated majority dominates. Resolution structure and its consequence. Mated pairs are cross- resolution (1000 PPI vs. 500 PPI), whereas non-mated pairs are drawn from 6B. Pyakurel and M. G. S. Murshed the 500 PPI pool and are therefore same-resolution (500 PPI vs. 500 PPI). The two classes consequently differ in a property that has nothing to do with identity, and a model could in principle separate them by reading resolution or appearance statistics instead of comparing ridge structure. We state this plainly at the outset because it governs how the strongest results in Section 5 may be read. To settle it we also build a matched-resolution variant in which the non-mated pairs are formed as 1000 PPI vs. 500 PPI, so both classes share the same resolution structure; Section 6.3 reports that the strongest result is unchanged under this control, so the ranking is not an artefact of resolution mismatch. The collapse results are not affected either, for the reason given in Section 6.5: FAR is computed on non-mated pairs, which are same-resolution by construction and involve no cross-resolution comparison at all. Each pair record also carries demographic metadata (age, gender, and race of both subjects), which supports the stratified analysis in Section 5.3. 4.2 Models The four open-source models span the systems that lead recent fingerprint and face benchmarks: InternVL3-8B-Instruct [16] (bfloat16,∼16 GB), a top open- source performer in FPBench; Qwen2.5-VL-7B-Instruct [11], the architecture strongest in FaceRecBench; its successor Qwen3-VL-8B-Instruct [12]; and Gemma-3-12B-IT [5], the largest local model. The latter three use 4-bit NF4 quantization (∼6–8 GB). We add Claude Opus 4.8 [1] (Anthropic API, undis- closed weights) as a high-capability proprietary reference. Exact identifiers are InternVL3-8B-Instruct, Qwen2.5-VL-7B-Instruct, Qwen3-VL-8B-Instruct, Gemma-3-12B-IT, and claude-opus-4-8; all runs were collected in June 2026. The open-source models run via HuggingFace transformers on a sin- gle NVIDIA RTX 4080 SUPER (16.9 GB) with deterministic decoding (temperature= 0); Claude is queried as independent stateless requests. The two images and the text prompt are the only inputs to any model: no filenames, subject IDs, resolution labels, or demographics appear in a request, so no model has access to ground-truth identity at inference. 4.3 Prompting Strategies We evaluate three prompting strategies, using a fixed system prompt “You are an expert fingerprint examiner.” across all settings. Before inference, every im- age is converted to grayscale, contrast-normalized (autocontrast), and resized to 448× 448 pixels, identically for all five models; this common preprocessing also equalizes the pixel dimensions of the 500 and 1000 PPI images, though it does not remove the underlying near-duplicate relationship between a mated pair (Section 6). Under zero-shot the model receives the two images and the bi- nary question “Do these two images belong to the same person? (A) Yes (B) No.” Task description prepends a sentence explaining that repeated captures of one finger vary slightly while ridge patterns persist, before the same binary question. Similarity scoring instead asks for a single integer from 0 (certainly different) SLAPBench: MLLMs for Four-Finger SLAP Verification7 Table 1: SLAPBench verification results on NIST SD302b (7,832 pairs: 176 genuine + 7,656 impostor). Models are ordered by similarity-scoring AUC. Binary prompt- ing reports accuracy and FAR for zero-shot (ZS) and task-description (TD); red cells mark collapsed configurations (FAR≥95%, the model answers “same person” on nearly every pair), the green cell marks the single strongest binary configuration. Similarity scoring reports mean confidence on genuine (Gen) and impostor (Imp) pairs, sep- aration ∆, EER, AUC (shaded green→red for strong→random discrimination), and TAR at FAR = 0.1%. Low binary accuracy in collapsed runs (≈2–6%) reflects the 43:1 impostor-to-genuine imbalance; FAR, AUC, and EER are the meaningful measures. Claude Opus 4.8 is the only model that resists collapse under both prompts and at- tains the strongest binary configuration (ZS FAR 20.2%). Binary PromptingSimilarity Scoring (0–100) # ModelZS Acc ZS FAR TD Acc TD FAR Gen Imp∆ EER AUC TAR 0.1% 1 Qwen3-VL-8B74.1%26.5%3.3%98.9% 100.0 63.8 +36.2 0.00%1.000 100.0% 2 Claude Opus 4.8 80.3%20.2%50.2%50.9%91.3 48.4 +42.9 11.75%0.95356.8% 3 Gemma-3-12B5.7%96.4%2.3%100.0%75.8 63.3 +12.5 15.10%0.83723.3% 4 InternVL3-8B29.3%72.3%2.2%100.0%57.7 79.1 −21.4 48.09%0.5900.0% 5 Qwen2.5-VL-7B 32.0%69.6%2.2%100.0%95.0 90.1 +4.9 43.34%0.5670.0% to 100 (certainly the same). The three templates are reproduced verbatim in Fig. S3. 4.4 Response Parsing and Metrics For binary prompts we parse responses with the three-step fallback of VLMEvalKit [2] (leading A/B; then A/B anywhere; then keyword matching on SAME/YES/GENUINE vs. DIFFERENT/NO/IMPOSTOR), marking anything unmatched INVALID. For the scoring prompt we take the first integer via regex and clamp it to [0, 100]. We report standard verification metrics: for binary prompts, accuracy, FAR, FRR, and collapse detection (any answer chosen >95% of the time); for scoring, mean confidence on mated and non-mated pairs, their separation ∆, EER, and AUC from a threshold sweep over [0, 100]. 5 Results 5.1 Binary Prompting: Collapse Under Task Description Positive-bias collapse appears in five of ten binary configurations, with FAR reaching 96.4–100% (Table 1). All four open-source models collapse under the task-description prompt, and Gemma-3-12B collapses under zero-shot as well. The proprietary Claude Opus 4.8 is the sole exception, resisting collapse under both prompts. All five collapsed runs sit at 2.2–5.7% accuracy rather than 50%: accepting all 7,832 pairs scores only the 176 mated pairs (2.25%) correct, so FAR, at 96.4– 100%, is the meaningful measure of a complete verification failure. 8B. Pyakurel and M. G. S. Murshed 020406080100 Confidence: same person (0–100) 0.0 0.2 0.4 0.6 0.8 1.0 Fraction of pairs (within class) AUC = 1.000 EER = 0.0% Δ = +36.2 Qwen3-VL-8B Impostor (n=7,656) Genuine (n=176) 020406080100 Confidence: same person (0–100) AUC = 0.953 EER = 11.7% Δ = +42.9 Claude Opus 4.8 Impostor (n=7,656) Genuine (n=176) 020406080100 Confidence: same person (0–100) AUC = 0.837 EER = 15.1% Δ = +12.5 Gemma-3-12B Impostor (n=7,656) Genuine (n=176) 020406080100 Confidence: same person (0–100) AUC = 0.590 EER = 48.1% Δ = -21.4 InternVL3-8B Impostor (n=7,656) Genuine (n=176) 020406080100 Confidence: same person (0–100) AUC = 0.567 EER = 43.3% Δ = +4.9 Qwen2.5-VL-7B Impostor (n=7,656) Genuine (n=176) Fig. 1: Score distributions under the similarity-scoring prompt (7,832 pairs). Bars give the fraction of pairs within each class, normalized separately to offset the 176:7,656 mated-to-non-mated imbalance; dashed lines mark per-class means; each panel is an- notated with AUC, EER and mean separation ∆. Scores are discrete, so no contin- uous density is fitted. The first three models discriminate; InternVL3-8B is inverted (∆ = −21.4, with a bimodal mated distribution) and Qwen2.5-VL-7B is compressed, piling both classes near 95. Under zero-shot prompting, four models avoid collapse (FAR 20.2–72.3%, Table 1). Claude Opus 4.8 gives the strongest binary result overall (80.3% accuracy, FAR 20.2%), ahead of the best open-source model, Qwen3- VL-8B (74.1%, FAR 26.5%); InternVL3-8B and Qwen2.5-VL-7B trail at FAR 72.3% and 69.6%. Gemma-3-12B is the exception, collapsing even under zero- shot (FAR 96.4%). Across these non-collapsed runs nearly every mated pair is accepted (FRR≤0.6%), so “different” answers fall almost exclusively on impostor pairs. Adding domain context (TD) collapses all four open-source models to near- 100% FAR, including Qwen3-VL-8B which had the best open-source ZS result. Claude Opus 4.8 is the lone exception: under TD it remains balanced (50.2% accuracy, FAR 50.9%, answering “same person” on only 52% of pairs), neither collapsing nor degrading to the open-source failure mode. For the open- source models, prompting complexity increases the false accept rate rather than reducing it, confirming the FaceXBench and FPBench observation that addi- tional context does not help and actively hurts in biometric binary tasks [4,8]. 5.2 Similarity Scoring: Discriminative Signal Revealed The similarity-scoring prompt eliminates collapse across all four open-source models: no model produces a single constant output, and mated and non-mated pairs occupy distinguishable (though not always separable) score ranges. Figure 1 shows the distributions for all five models, and the scoring block of Table 1 gives the metrics. The models split into two tiers (Table 1). Qwen3-VL-8B separates the classes completely (AUC = 1.000, EER = 0.0%); a result this clean calls for scrutiny rather than celebration, and we examine it in Section 6.3. Claude Opus 4.8 is the strongest graded discriminator (AUC = 0.953), with the widest mated-to-non-mated gap of any model (+42.9 points), and Gemma-3-12B is functional but weaker (AUC = 0.837). The other two fail in opposite ways: InternVL3-8B is inverted, reporting higher confidence on impostors than on SLAPBench: MLLMs for Four-Finger SLAP Verification9 0.00.20.40.60.81.0 False Accept Rate (FAR) 0.0 0.2 0.4 0.6 0.8 1.0 True Accept Rate (TAR) ROC Curves — Similarity-Scoring Prompt 0.000.010.020.030.040.05 FAR 0.0 0.2 0.4 0.6 0.8 1.0 TAR Low-FAR region (FAR ≤ 0.05) Qwen3-VL-8B (AUC = 1.000) Claude Opus 4.8 (AUC = 0.953) Gemma-3-12B (AUC = 0.837) InternVL3-8B (AUC = 0.590) Qwen2.5-VL-7B (AUC = 0.567) FAR = 0.1% Fig. 2: ROC curves under the similarity-scoring prompt (7,832 pairs) for the four open-source models and the proprietary Claude Opus 4.8. The inset magnifies the low- FAR region (FAR≤ 0.05). The dotted vertical line marks FAR = 0.1%. Qwen3-VL-8B (AUC = 1.000) achieves perfect discrimination, Claude Opus 4.8 (AUC = 0.953) and Gemma-3-12B (AUC = 0.837) are clearly functional, while InternVL3-8B and Qwen2.5- VL-7B perform near random (AUC = 0.590 and 0.567). genuine matches (∆ = −21.4, AUC = 0.590), while Qwen2.5-VL-7B is com- pressed, over 90% confident on nearly every pair regardless of identity (∆ = +4.9, AUC = 0.567). Both are near chance and neither admits a threshold that accepts a mated pair before an impostor, so both reach TAR = 0.0% at FAR = 0.1%. Per-hand behaviour is symmetric for every model, so we omit the FRGP 13/14 split. Scoring therefore eliminates collapse in all four open-source models without guaranteeing meaningful discrimination: Qwen3-VL-8B, Claude, and Gemma separate the classes, whereas InternVL3-8B and Qwen2.5-VL-7B stay effectively random. The binary collapse in Table 1 is thus a prompt-format ar- tifact; whether discriminative capability can be unlocked by scoring depends on model architecture. Two real pairs in Fig. S2 illustrate this: on a mated pair only InternVL3-8B fails (returning 9), and on a non-mated pair only InternVL3-8B (85) and Qwen2.5-VL-7B (95) falsely accept. Figure 2 plots the full ROC curves for the four open-source models and Claude Opus 4.8. The inset shows the low-FAR operating region (FAR ≤ 0.05), where Qwen3-VL-8B achieves TAR = 100% even at FAR = 0.1%. The TAR 0.1% column of Table 1 reports TAR at FAR = 0.1%, the standard operational strin- gency target in border biometrics. InternVL3-8B and Qwen2.5-VL-7B reach 0% here because their score distributions offer no threshold that holds FAR be- low 0.1% while still accepting any mated pair, a direct consequence of inverted calibration (InternVL3) and compressed scoring (Qwen2.5). 10B. Pyakurel and M. G. S. Murshed MaleFemale 0.5 0.6 0.7 0.8 0.9 1.0 AUC 1.001.00 0.94 0.96 0.81 0.85 AUC by Gender WhiteBlack 0.5 0.6 0.7 0.8 0.9 1.0 1.001.00 0.95 0.96 0.81 0.97 AUC by Race Qwen3-VL-8BClaude Opus 4.8Gemma-3-12B Fig. 3: Per-subgroup AUC by gender and race for the three discriminating models (age bands and exact values in Table S1). Qwen3-VL-8B is uniformly perfect; Claude Opus 4.8 varies by ≤1.5 AUC points across gender; Gemma-3-12B shows the largest disparities. The Black group is small (n i = 272), so Gemma’s high value there should be read with caution. 5.3 Demographic Fairness FaceRecBench reports that the best face-verification MLLM also carries the strongest demographic bias [14]; we test the pattern on SLAP by recomputing similarity-scoring performance within gender, race, and age subgroups for the three discriminating models (Fig. 3; full protocol and per-subgroup table in Appendix B). The pattern runs opposite to FaceRecBench’s: on SLAP data the stronger models look fairer. Claude Opus 4.8 varies by at most 1.5 AUC points across gender, whereas the weakest discriminator, Gemma-3-12B, shows the widest spread; Qwen3-VL-8B is uniformly perfect, equally consistent with a group-invariant representation and with the non-identity shortcut of Section 6.3. To the extent the small subgroups support any reading, disparity tracks model weakness rather than strength. We treat this as an initial, hypothesis-generating probe on a single database rather than an audit. 6 Discussion 6.1 Why Binary Prompts Collapse on SLAP Data Collapse follows a consistent signature: every collapsed run has FRR = 0% and FAR ≥ 96.4%, the mark of a model whose prior for “same person” is so strong that no visual evidence moves it toward “B.” Two structural factors make this prior stronger for SLAP than for the single-finger images of FPBench. First, any two SLAP images share the same gross morphology (four fingers, similar spacing, skin texture, and orientation), so their global similarity is far higher than between two isolated rolled impressions, whether the pair is mated or not; the surface-level similarity prior is thus satisfied for every pair regardless of identity. Second, the task-description prompt, which states that “the same person’s fingers produce SLAPBench: MLLMs for Four-Finger SLAP Verification11 slightly different images each time,” increases collapse: it primes a schema in which variation is a property of mated pairs and lowers the “same” threshold across all inputs, the model having read “same person” twice before seeing either image. The lesson for benchmark design is that naturalistic domain descriptions can worsen collapse by legitimizing visual differences. This also explains the exception. Claude Opus 4.8 resists collapse under both prompts exactly as the mechanism predicts, rejecting about half of impostors even under task description (FAR 50.9%) and four-fifths under zero-shot (FAR 20.2%). A model with identity evidence strong enough to overcome the similarity prior is not forced into the degenerate “same” response. Collapse is therefore a capability threshold, not a fixed property of the binary format: the same format that collapses four open-source models leaves the strongest one balanced. 6.2 Why Similarity Scoring Breaks Collapse The scoring prompt resolves the same underlying problem by changing what the model is asked to optimize. Under binary prompting, the model must commit to a categorical label against its own prior; the prior wins. Under scoring, the model places a continuous estimate on a calibrated scale, a task that requires reporting a degree of confidence rather than crossing a decision boundary. This framing lets the model’s uncertainty about impostor pairs surface as a lower score instead of being suppressed into the same “A” response it gives to mated pairs. The scoring prompt eliminates collapse in all four open-source models, but the resulting distributions show that scoring is necessary without being sufficient. It reveals whether discriminative capability exists; it does not confer it. The two models that lack it are InternVL3-8B and Qwen2.5-VL-7B (Fig. 1, rightmost panels). The two failures differ in kind. InternVL3-8B is inverted, scoring impostors above genuine pairs; we suspect its encoder keys on fine-grained ridge texture, which contrasts more strongly across two different subjects than between two renderings of one capture, so scoring faithfully reports this signal in the wrong di- rection. Qwen2.5-VL-7B is instead compressed: correctly ordered but confined to a narrow high-confidence band, the scoring-domain echo of the same similar- ity prior that drives its binary collapse. In neither case can scoring manufacture discrimination the representation does not encode. Why does scoring unlock the stronger models but not these? The most action- able explanation is that its calibrated anchors tell the model where to look (ridge flow, minutiae) and what to report (a value on a fixed scale) rather than forc- ing a binary commit, and only models with sufficient visual reasoning (Qwen3, Claude) can act on them. The practical implication is that a calibrated scor- ing prompt is a more effective probe of MLLM biometric capability than binary forced choice, but only when the architecture can exploit it. 12B. Pyakurel and M. G. S. Murshed 6.3 A Perfect Score Is a Diagnostic, Not a Capability Claim Qwen3-VL-8B attains AUC = 1.000 with EER = 0.0%. We do not read this as a capability result: the number is explained by the structure of the protocol rather than by verification ability, and the episode is the paper’s most useful finding for benchmark designers, because it shows how readily a SLAP protocol can manufacture a perfect score. The behavior underlying the number is revealing. Qwen3-VL-8B assigns ex- actly 100 to all 176 mated pairs, while its non-mated scores take only seven distinct values (0, 30, 45, 65, 85, 90, 95, mean 63.8) and never exceed 95. Per- fect separation is therefore not a finely graded judgment but a coarsely quantized output in which the single response 100 is reserved for the mated class; any mech- anism that saturates the mated class this way reproduces AUC = 1.000 whether or not it compares ridge structure. A model doing genuine forensic comparison would show some graded uncertainty across 176 subjects, as Claude Opus 4.8 does (nine distinct mated and 48 non-mated values on the same pairs). The resolution shortcut is the most economical explanation and the one we set out to test: mated pairs are cross-resolution (1000 vs. 500 PPI) while non-mated pairs are same-resolution (500 vs. 500), so a model that merely de- tects downsampling could separate the classes without comparing identity. We therefore ran the matched-resolution control of Section 4.1, rebuilding every non-mated pair as 1000 PPI vs. 500 PPI so both classes share the same structure and differ only in identity (FRGP 13: 88 mated, all 3,828 non-mated). The result is essentially unchanged: exactly 100 on every mated pair, no non-mated pair above 95, AUC = 1.000 with the non-mated mean moving only from 65.6 to 65.3. Making resolution non-diagnostic had no measurable effect, so we exclude the resolution shortcut. What the control cannot remove is near-duplicate detection: a mated pair is one capture rendered at two scales, so the two images share far stronger low-level correspondence than a deployed matcher sees between independent impressions, and rearranging resolutions cannot disturb this. SD302b cannot adjudicate it, because Device R holds one capture per subject and finger and the Device R and Device S pools are disjoint, so no mated pair can be formed from two independent impressions; settling the question needs a database with repeat SLAP captures. Memorization we set aside: had the model memorized identity labels the knowledge should transfer across prompts, yet its zero-shot FAR is 26.5% and it collapses under task description, and no other model (not even Claude at AUC = 0.953) reproduces the result. The honest summary is narrow: Qwen3-VL-8B separates SLAPBench’s pairs perfectly under scoring; the resolution shortcut has been tested and ruled out; near-duplicate detection remains and cannot be excluded within SD302b; and genuine identity discrimination, though consistent with the control, cannot be separated from it here, so no operational verification capability should be in- ferred. Near-perfect MLLM biometric results warrant a protocol audit before they warrant belief. SLAPBench: MLLMs for Four-Finger SLAP Verification13 6.4 The Left-Hand / Right-Hand Asymmetry A modest per-hand asymmetry appears under zero-shot prompting, but its di- rection is model-specific: Qwen3-VL-8B favours the left hand by 5.0 FAR points while Claude Opus 4.8 favours the right by 4.7, and the other three models are near-symmetric (FAR gaps ≤3.6 points). Since both FRGPs draw identical pair counts from the same 88 subjects, this reflects model-specific pretraining priors rather than any property of SLAP images; disentangling it would need a second dataset. 6.5 Limitations Three limitations bound what the present results establish, and we state them alongside the findings each one does and does not touch. Mated-pair construction. SD302b provides a single SLAP capture per subject and finger position, so a mated pair can only be formed across the two resolutions of that one capture (Section 3). Our matched-resolution control shows this asymmetry does not drive the results (Section 6.3); what the single-capture design leaves in place is that a mated pair is one exposure rendered twice, so near-duplicate detection cannot be separated from identity matching within this dataset, and settling it requires a database with repeat captures. This is why we decline to read Qwen3-VL-8B’s AUC = 1.000 as verification capability. It does not bear on the central findings: collapse is measured on non-mated pairs alone, so the collapse of the open-source models, Claude Opus 4.8’s resistance, and the removal of collapse by scoring are all unaffected. Model coverage. Our proprietary coverage is a single system. FPBench reports that Gemini 2.5 Pro leads open-source models by roughly 4 percentage points on single-finger tasks [4], and whether the collapse resistance we observe in Claude Opus 4.8 is a property of frontier-scale models generally or specific to Claude cannot be settled with one data point. Scope. The fairness analysis (Section 5.3) rests on 88 subjects with several small subgroups, so it is an initial probe rather than an audit; and SLAPBench compares MLLMs against one another, not against a deployed matcher such as VeriFinger [10], so it places models on a relative rather than an absolute scale. Both are left to future work. 6.6 Future Work Several directions follow. The most immediate is the matched-resolution con- trol of Section 6.3, rebuilding the non-mated pairs as 1000-vs-500 comparisons (in both orderings) so that resolution no longer signals class, alongside a mated set from a database with repeat impressions to remove the near-duplicate cue. Beyond that: broader proprietary evaluation (GPT-series, Gemini) to test whether Claude’s collapse resistance is general; domain-adaptive fine-tuning, which FPBench shows adds 7–39% on single-finger tasks [4]; larger-scale fair- ness on a balanced multi-database pool; algorithmic-baseline calibration 14B. Pyakurel and M. G. S. Murshed against a matcher such as VeriFinger; and benchmark extension to the seven further SLAPBench tasks (finger counting, laterality, localization, position, qual- ity, rotation, and segmentation-challenge identification). 7 Conclusion We introduced SLAPBench, the first benchmark for evaluating multimodal large language models on four-finger SLAP fingerprint verification, built on NIST SD302b with 7,832 pairs (176 mated, 7,656 non-mated). Task-description prompting collapses all four open-source models to near-100% FAR and Gemma- 3-12B collapses under zero-shot as well, while Claude Opus 4.8 resists collapse under both prompts and records the strongest binary result (FAR = 20.2%). Similarity scoring eliminates collapse across the open-source models and shows that architecture sets the ceiling, with discrimination ranging from functional (Claude Opus 4.8, Gemma-3-12B) to near-random or inverted (Qwen2.5-VL-7B, InternVL3-8B; full metrics in Table 1). Collapse is thus an artifact of the prompt format, whereas unlocking discriminative capability through scoring requires sufficient visual reasoning. Qwen3-VL-8B’s perfect separation (AUC = 1.000) we deliberately do not claim as capability: a matched-resolution control rules out the resolution shortcut, but SD302b’s single-capture design still admits near-duplicate detection, so whenever a dataset offers only one capture per subject the synthesized mated class can itself become the cue a model reads, and near-perfect results call for a protocol audit before belief. With the first SLAP-specific baseline established, domain-adaptive fine-tuning is the natural next step, consistent with the gains FPBench reports on single-finger tasks [4]. References 1. Anthropic: The Claude model family (2025), https://w.anthropic.com/ claude, claude Opus 4.8, accessed via the Anthropic API 2. Duan, H., Fang, X., Yang, J., Zhao, X., Qiao, Y., Li, M., Agarwal, A., Chen, Z., Chen, L., Liu, Y., Ma, Y., Sun, H., Zhang, Y., Lu, S., Wong, T.H., Wang, W., Zhou, P., Li, X., Fu, C., Cui, J., Chen, J., Song, E., Mao, S., Ding, S., Liang, T., Zhang, Z., Dong, X., Zang, Y., Zhang, P., Wang, J., Lin, D., Chen, K.: Vlmevalkit: An open-source toolkit for evaluating large multi-modality models (2025), https: //arxiv.org/abs/2407.11691 3. Engelsma, J.J., Cao, K., Jain, A.K.: Learning a fixed-length fingerprint represen- tation. IEEE Transactions on Pattern Analysis and Machine Intelligence 43(6), 1981–1997 (2021). https://doi.org/10.1109/TPAMI.2019.2956523 4. Gavas, E., Banerjee, S., Hegde, C., Memon, N.: Fpbench: A comprehensive bench- mark of multimodal large language models for fingerprint analysis (2026), https: //arxiv.org/abs/2512.18073 5. Gemma Team: Gemma 3 technical report (2025), https://huggingface.co/ google/gemma-3-12b-it, google DeepMind. Official model release and documen- tation. SLAPBench: MLLMs for Four-Finger SLAP Verification15 6. Maltoni, D., Maio, D., Jain, A.K., Feng, J.: Handbook of Fingerprint Recognition. Springer, Cham, 3rd edn. (2022). https://doi.org/10.1007/978-3-030-83624- 5, https://doi.org/10.1007/978-3-030-83624-5 7. Murshed, M.G.S., Bahmani, K., Schuckers, S., Hussain, F.: Deep age-invariant fingerprint segmentation system. IEEE Transactions on Biometrics, Behavior, and Identity Science 7(3), 313–330 (2025). https://doi.org/10.1109/TBIOM.2024. 3506926 8. Narayan, K., VS, V., Patel, V.M.: Facexbench: Evaluating multimodal llms on face understanding (2026), https://arxiv.org/abs/2501.10360 9. National Institute of Standards and Technology: NIST Special Database 302: Nail to nail fingerprint challenge dry run dataset. Tech. rep., National Institute of Standards and Technology (2018), https://w.nist.gov/itl/iad/btg/nist- special-database-302, accessed: 2026-05-24 10. Neurotechnology: VeriFinger fingerprint recognition SDK (2024), https://w. neurotechnology.com/verifinger.html 11. Qwen Team: Qwen2.5-vl (Jan 2025), https://qwenlm.github.io/blog/qwen2.5- vl/, official model release page for Qwen2.5-VL 12. Qwen Team: Qwen3-vl technical report (2025), https://huggingface.co/Qwen/ Qwen3-VL-8B-Instruct, alibaba Group. Official model release and documentation. 13. Shahreza, H.O., George, A., Marcel, S.: Evaluating multimodal large language models for heterogeneous face recognition (2026), https://arxiv.org/abs/2601. 15406 14. Shahreza, H.O., Marcel, S.: Benchmarking multimodal large language models for face recognition (2025), https://arxiv.org/abs/2510.14866 15. Tang, Y., Gao, F., Feng, J., Liu, Y.: FingerNet: An unified deep network for fin- gerprint minutiae extraction. In: IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS). p. 1–7 (2017). https://doi.org/10. 1109/BTAS.2017.8272679 16. Zhu, J., Wang, W., Chen, Z., Liu, Z., Ye, S., Gu, L., Tian, H., Duan, Y., Su, W., Shao, J., et al.: Internvl3: Exploring advanced training and test-time recipes for open-source multimodal models (2025), https://arxiv.org/abs/2504.10479 16B. Pyakurel and M. G. S. Murshed A Supporting Figures This appendix collects the supporting figures referenced in the main text, to- gether with the full protocol for the fairness analysis. It introduces no new claims; every result it illustrates is stated and quantified in the main text. Index Middle Ring Little Four-finger SLAP with segmentation ground truth Fig. S1: Four-finger SLAP capture with segmentation ground truth (NIST SD302b, Device R, 500 PPI; referenced in Section 3). The per-finger regions (index, middle, ring, little) come from the segmentation coordinates distributed with SD302b. A single frame holds four overlapping fingers of broadly similar morphology, so any two SLAP images look globally alike whether they are mated or not, which underlies the positive-bias collapse analyzed in Section 6. SLAPBench: MLLMs for Four-Finger SLAP Verification17 Subject 2368 · 500 PPISubject 2368 · 1000 PPI 050100 Similarity score (0–100) Qwen3-VL-8B 100 Claude Opus 4.8 100 Gemma-3-12B 75 InternVL3-8B 9 Qwen2.5-VL-7B 95 high = correct → Model confidence · same person Subject 2313 · 500 PPISubject 2374 · 500 PPI 050100 Similarity score (0–100) Qwen3-VL-8B 65 Claude Opus 4.8 50 Gemma-3-12B 35 InternVL3-8B 85 Qwen2.5-VL-7B 95 ← low = correct Model confidence · same person Genuine — same person Impostor — di f erent people Real SLAP pairs with per-model similarity scores Fig. S2: Real SLAP pairs with each model’s similarity score (0–100), refer- enced in Section 5.2. Top: a mated pair (subject 2368, 500 vs. 1000 PPI); every model but InternVL3-8B reports high confidence, while InternVL3 inverts and returns 9. Bot- tom: a non-mated pair (subjects 2313 and 2374); Qwen3-VL-8B, Claude, and Gemma assign lower confidence, whereas InternVL3-8B (85, inverted) and Qwen2.5-VL-7B (95, saturated) falsely accept it. The italic cue marks which direction is correct for each pair. 18B. Pyakurel and M. G. S. Murshed System prompt (all strategies). You are an expert fingerprint examiner. Zero-shot (ZS). Below are two SLAP fingerprint images. A SLAP image captures four fingers from one hand pressed simultaneously on a scanner. Do these two images belong to the same person? (A) Yes, same person (B) No, different people Reply with only the letter A or B. Task description (TD). A SLAP fingerprint image captures four fingers from one hand simultaneously. The same person’s fingers produce slightly different images each time they press the scanner (different pressure, slight movement), but the ridge patterns remain the same. Below are two SLAP fingerprint images. Do these two images belong to the same person? (A) Yes, same person (B) No, different people Reply with only the letter A or B. Similarity scoring (S). You are a forensic fingerprint examiner analyzing two SLAP fingerprint images. A SLAP image captures four fingers (index, middle, ring, little) pressed simultaneously on a scanner. Your task: Examine the ridge flow patterns, ridge endings, bifurcations, and the relative shape and spacing of each finger across both images. Then return a single integer between 0 and 100 representing your confidence that both images belong to the same person, where 0 = certain they are different people, 50 = completely uncertain, and 100 = certain they are the same person. A score of 65 means you are 65% confident the images are from the same person. Reply with the number only. Do not include any text, explanation, or label. Fig. S3: The three prompt templates, reproduced verbatim (referenced in Section 4.3). Every model receives the same system prompt and, per strategy, the same user prompt, with the two SLAP images attached to the user message. % denotes a literal percent sign. B Demographic Fairness Detail This section gives the full protocol and per-subgroup table for the fairness anal- ysis summarized in Section 5.3. We recompute similarity-scoring performance within demographic subgroups: a mated pair is assigned to a subgroup by its subject’s attribute, and a non-mated pair is counted within a subgroup only when both subjects share that attribute. The analysis is restricted to the three discriminating models (subgroup breakdowns of the two near-random models are uninformative) and to subgroups with sufficient support among the 88 clean subjects (gender; White and Black race; three age bands); Asian, “other,” and “no answer” race groups (≤ 6 subjects) are too small to evaluate reliably. SLAPBench: MLLMs for Four-Finger SLAP Verification19 Table S1: Per-subgroup similarity-scoring performance (AUC / EER%) for the three discriminating models. n g /n i are the mated and within-group non-mated pair counts. Small subgroups (Black, 18–30) are reported with caution. Qwen3-VL-8B is uniform at AUC = 1.000 across all groups, which must be read alongside the perfect-score caveat of Section 6.3. Subgroup n g n i Qwen3ClaudeGemma Male70 1190 1.000 / 0.0 0.945 / 13.2 0.810 / 15.6 Female106 2756 1.000 / 0.0 0.960 / 10.5 0.854 / 14.8 White122 3660 1.000 / 0.0 0.950 / 7.4 0.806 / 18.3 Black34 272 1.000 / 0.0 0.957 / 11.6 0.968 / 4.4 18–3026 156 1.000 / 0.0 0.967 / 6.1 0.815 / 19.2 31–4576 1406 1.000 / 0.0 0.944 / 13.8 0.826 / 15.8 46+74 1332 1.000 / 0.0 0.957 / 10.6 0.858 / 13.5 Claude Opus 4.8 varies by at most 1.5 AUC points across gender (male 0.945, female 0.960) and 0.7 across White/Black. Gemma-3-12B shows the widest spread, with a 4.4-point gender gap and an EER swing from 18.3% to 4.4% between White and Black; that Black subgroup rests on only 272 within-group non-mated pairs from 17 subjects, so neither its values nor any disparity from them should be over-read.