Paper deep dive

Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

Yuedong Tan, Lei Qi, Yu Liu, Di Wen, Ruiping Liu, Xiaoye Wang, Yufan Chen, Junwei Zheng, Chengzhi Wu, Chen Zhang, Zhihang Chen, Haiwen Sun, Zongwei Wu, Radu Timofte, Danda Pani Paudel, Kunyu Peng

Year: 2026Venue: arXiv preprintArea: cs.CVType: PreprintEmbeddings: 85

Intelligence

Status: not_run | Model: - | Prompt: - | Confidence: 0%

Entities (0)

No extracted entities yet.

Relation Signals (0)

No relation signals yet.

Cypher Suggestions (0)

No Cypher suggestions yet.

Abstract

Abstract:Embodied systems must make knowledge acquired during one encounter usable in another despite changes in viewpoint, motion, and illumination. Yet aggregate cross-video accuracy conflates failures of local perception with failures to preserve observation identity, establish correspondence, and compose evidence, obscuring whether local video understanding actually transfers. We introduce EgoGears, a complementary single- and multi-video benchmark designed to diagnose this transition. It contains 567 single-video and 1,487 multi-video questions derived from 126 human-collected egocentric recordings covering 39 outdoor routes. Repeated traversals across movement speeds and lighting conditions ground comparisons in shared physical environments; 531 questions require alignment across independent recordings. Single-video questions measure the local visual, spatial, and motion evidence available to a model, while multi-video questions test whether evidence remains bound to the correct observation and can be composed into consistent route relationships. We report 29 single-video and 31 multi-video MLLM configurations across six model families in the main leaderboard. Among the 20 configurations evaluated comparably on both splits, every model performs worse on multi-video questions, with a mean decrease of 22.5 percentage points, and the gap persists when answer format and scoring are held fixed. The gap is not explained simply by additional videos or recording boundaries. The central bottlenecks are observation--evidence binding and ordered route-state tracking. The code and benchmark are publicly available at this https URL.

PDF

Open source PDF →Open local PDF →

Trouble viewing inline? Open PDF directly →

Full Text

81,283 characters extracted from source content.

Expand or collapse full text

EgoGears DOES LOCAL VIDEO UNDERSTANDING TRANSFER ACROSS ENCOUNTERS?THE EGOGEARS BENCH- MARK Yuedong Tan 1,4∗ Lei Qi 2∗ Yu Liu 5 Di Wen 3 Ruiping Liu 3 Xiaoye Wang 1 Yufan Chen 3 Junwei Zheng 3 Chengzhi Wu 3 Chen Zhang 3 Zhihang Chen 3 Haiwen Sun 3 Zongwei Wu 4 Radu Timofte 4 Danda Pani Paudel 1 Kunyu Peng 3† 1 INSAIT, Sofia University “St. Kliment Ohridski” 2 Technical University of Munich 3 Karlsruhe Institute of Technology 4 University of W ̈ urzburg 5 Institute of Information Engineering ABSTRACT Embodied systems must make knowledge acquired during one encounter usable in another despite changes in viewpoint, motion, and illumination. Yet aggre- gate cross-video accuracy conflates failures of local perception with failures to preserve observation identity, establish correspondence, and compose evidence, obscuring whether local video understanding actually transfers. We introduce EgoGears, a complementary single- and multi-video benchmark designed to di- agnose this transition. It contains 567 single-video and 1,487 multi-video ques- tions derived from 126 human-collected egocentric recordings covering 39 out- door routes. Repeated traversals across movement speeds and lighting condi- tions ground comparisons in shared physical environments; 531 questions re- quire alignment across independent recordings. Single-video questions mea- sure the local visual, spatial, and motion evidence available to a model, while multi-video questions test whether evidence remains bound to the correct obser- vation and can be composed into consistent route relationships. We report 29 single-video and 31 multi-video MLLM configurations across six model fami- lies in the main leaderboard. Among the 20 configurations evaluated compara- bly on both splits, every model performs worse on multi-video questions, with a mean decrease of 22.5 percentage points, and the gap persists when answer format and scoring are held fixed. The gap is not explained simply by addi- tional videos or recording boundaries. The central bottlenecks are observation– evidence binding and ordered route-state tracking. EgoGears provides a diagnos- tic testbed for understanding when, why, and how local video understanding fails to transfer across encounters. The code and benchmark are publicly available at https://github.com/lei-qi-233/EgoGears 1INTRODUCTION Recent multimodal large language models (MLLMs) have made rapid progress in video understand- ing, including long-form question answering, temporal reasoning, and egocentric activity under- standing (Fan, 2019; Li et al., 2026b; Peng et al., 2026; Plizzari et al., 2025; Chen et al., 2026). For outdoor embodied AI, a consequential next step is to make knowledge acquired during one en- counter usable in another. An agent may revisit a junction from the opposite direction, encounter a familiar landmark under different illumination, or compare its current journey with a previously observed route. Successful interpretation requires connecting observations that differ in appearance while preserving distinctions between places, travel directions, and events. A model must deter- mine what remains the same, what has changed, and which experience supports each conclusion. Cross-video comparison thus probes a capability central to embodied intelligence: constructing a consistent understanding of the world from separate, partial encounters. ∗ Equal contribution. † Corresponding author: kunyu.peng@kit.edu 1 arXiv:2609.37938v1 [cs.CV] 29 Sep 2026 EgoGears Table 1: Comparison with representative egocentric and cross-video QA benchmarks. S: single- video QA; M: joint reasoning over multiple videos or clips. NR: a reliable total video duration was not established from the paper. BenchmarkVideo source#QA Video hours QA input Route understanding and acquisition design Route-structure QA Repeat-path protocol Multiple speed conditions Day/night counterparts EgoSchema (Mangalam et al., 2023) Ego4D> 5K > 250S— EgoTempo (Plizzari et al., 2025)Ego4D500 ∼4.6S— EgoCross (Li et al., 2026b)Five video datasets957NRS— EgoNight (Zhang et al., 2026)Real + synthetic3,658NRM—✓ EgoExoMem (Liu et al., 2026) Ego-Exo4D + LEMMA ∼2.6KNR Synchronized ego–exo — CrossVid (Li et al., 2026a)Six video datasets9,015 ∼318.4M— EgoGears (ours)Human outdoor routes2,05422.6S + M✓ Human-collected egocentric videos provide a grounded setting for investigating this capability. Our study uses recordings of people walking, jogging, and running along outdoor routes, with repeated traversals across movement speeds and lighting conditions. These recordings capture how bodily movement shapes visual evidence: turns change ego-relative directions, speed changes the tempo- ral spacing between landmarks, and return journeys reverse their order of appearance. Repeated observations of the same routes anchor these variations to a shared physical environment. This set- ting requires models to relate observations through environmental structure while accounting for the circumstances of each encounter. Its relevance extends to embodied systems that must interpret human route demonstrations, recognize previously visited places, or connect current observations with earlier experience. The distinctive contribution of our study lies in combining human egocentric motion, repeated outdoor traversals, and complementary single- and multi-video evaluation. Existing benchmarks have advanced local perception, temporal understanding, and reasoning across extended experi- ences (Fan, 2019; Li et al., 2026b; Plizzari et al., 2025; Chen et al., 2026). Our focus is the rela- tionship between these levels of competence: does understanding individual observations support consistent reasoning across observations? The single-video component assesses the local visual, spatial, and motion evidence available to a model. The multi-video component examines whether the model can retain observation identity, establish correspondence across separate recordings, and compose evidence into relationships among landmarks, directions, and route segments. Consider a runner returning at dusk along a route previously recorded in daylight. At an unfamiliar-looking junction, the runner asks: “Did I pass this junction earlier, and which landmark should appear next on the way back?” A wearable assistant would need to compare the current observation with the ear- lier recording, recognize the junction despite changes in illumination and viewing direction, identify the return phase, and infer the reversed landmark sequence. Recognizing objects in each video in- dependently would leave these relationships unresolved. Together, these evaluations support a more informative assessment of cross-video competence than aggregate accuracy alone. Cross-video er- rors may stem from local perception, evidence misattribution, failed correspondence, or reasoning over aligned observations. Evaluating these capabilities jointly helps the community identify where improvement is needed. We introduce EgoGears, a benchmark that examines whether models can preserve the identity and context of visual evidence when reasoning across outdoor experiences. It comprises 567 single- video questions and 1,487 multi-video comparison questions derived from 126 human-collected egocentric recordings covering 39 outdoor routes and 22.6 hours. Repeated traversals across move- ment speeds and lighting conditions anchor changes in appearance and motion to shared physical environments. The benchmark connects three evaluation targets: local understanding, evidence in- tegration, and cross-recording correspondence, all in high-motion walking and running footage. Single-video questions assess objects and attributes, ego-relative spatial relations, ego-motion, tra- jectories, and temporal events. Multi-video questions require models to associate evidence with the correct clip, integrate non-contiguous observations, recognize corresponding places and route phases, compare travel directions, identify shared paths, and localize route divergence. Of these, 531 questions require alignment across independent recordings. The question design makes the relationship between an observation and its context central to evalu- ation. Questions combine an observation target, a temporal or route-phase condition, and a relation to infer, with answers grounded in specified evidence windows. Distractors introduce targeted per- 2 EgoGears turbations to visually supported content, including directional reversals, temporal-order changes, route-phase mismatches, and incorrect attribution of landmarks or events. Resolving these alter- natives requires identifying not only which facts are present, but where, when, and to which ob- servation they belong. Variable-cardinality multi-select questions further require models to recover the complete supported answer set. Complementary input-structure and capability axes organize questions by how evidence is distributed and what reasoning it demands; five input-structure units span evidence within one recording through correspondence across recordings. Together with the single-video assessment, this design supports investigating whether difficulties arise in recovering local evidence or in preserving and composing it across observations. Deterministic option shuffling, metadata anonymization, text-only shortcut screening, video-grounded verification, and human re- view strengthen the connection between benchmark performance and visual evidence. We report 29 single-video and 31 multi-video MLLM configurations spanning six model families in the main leaderboard. Our evaluation reveals persistent difficulties with clip–evidence associa- tion and ordered route reasoning, with the strongest overall multi-video configuration reaching only 33.3% on multi-step turning over whole-video evidence (Table 6). Across the eight matched single- video comparisons in the main leaderboard, enabling explicit reasoning improves every configu- ration by a median of 7.8 percentage points, but the gains are substantially larger for ego-relative spatial relations than for trajectory-grounded questions (14.0 versus 3.7 points), suggesting that stronger evidence verification does not translate uniformly into better understanding of movement and route structure. Our contributions are threefold: • We formulate cross-video understanding for outdoor embodied AI around evidence bind- ing, correspondence, and spatiotemporal composition. Joint single- and multi-video evalu- ation examines whether local understanding supports consistent reasoning across encoun- ters. • We introduce EgoGears: 567 single-video and 1,487 multi-video questions from 126 human-collected egocentric recordings across 39 outdoor routes, including 531 questions requiring correspondence across independent recordings. Repeated traversals, relational distractors, and exact-set scoring probe evidence consistency across changes in movement speed and illumination. • We report 29 single-video and 31 multi-video configurations across six MLLM families, re- vealing bottlenecks in evidence binding and ordered route reasoning. Across eight matched single-video comparisons, reasoning improves every configuration (median gain: 7.8 per- centage points), with smaller gains for trajectory understanding than ego-relative spatial reasoning. 2RELATED WORK Egocentric Video QA Benchmarks. Egocentric video understanding has progressed from action understanding (EgoVQA (Fan, 2019) and EgoTaskQA (Jia et al., 2022)) to long-video temporal memory (EgoTempo (Plizzari et al., 2025)) and object-interaction topology (AMEGO (Goletto et al., 2025)), yet route-level spatial reasoning under highly dynamic outdoor motion remains underex- plored. Spatial QA benchmarks, including NuScenes-QA (Qian et al., 2024), SpatialBench (Xu et al., 2025b), and MMSI-Video-Bench (Lin et al., 2025), incorporate outdoor scenes or 3D geom- etry but primarily rely on vehicle trajectories, third-person views, or static scenes. EgoCross (Li et al., 2026b) covers extreme sports but remains limited to single clips. Regarding input scope, EgoThink (Cheng et al., 2024) uses single video sources, while Ego-Exo4D (Grauman et al., 2024) and EgoExoMem (Liu et al., 2026) support synchronized multi-view reasoning. EgoMonth (Chen et al., 2026) extends reasoning across videos and days but mainly targets routine activities. How- ever, they do not directly test whether knowledge acquired in one encounter remains spatially and temporally coherent when the same physical environment is revisited under different viewpoints, directions, speeds, or illumination. EgoGears targets this gap by pairing single-video understanding with cross-recording correspondence over repeated outdoor traversals. Multimodal Large Language Models. MLLMs increasingly rely on key-frame selection and to- ken compression to process long, highly dynamic videos (Shi et al., 2025a; Jiang et al., 2025; Peng et al., 2026; Wen et al., 2026). General-purpose open-source models, including InternVL (Zhu et al., 3 EgoGears EgoGears-Multi Video Observation Heterogeneous QA Generation 11,802 QA pairs gemini-3.1-pro-preview gemini-3.5-flash Evidence & Video clips prep. Video clip name and path anonymization 480p, H.264, remove audio Diverse clip durations Video Collection Same route, 2 lights, 3 speeds 1080p 30fps Egocentric outdoor out-and-back Automated Quality Gates Single Video QA 5–Stage Gate Cross Video QA 8–Stage Gate EgoGears-Single Video Processing and Segmentation 60 sec., 480p, H.264, remove audio Caption Generation gemini-3.1-pro-preview QA Generation from Caption: 6,770 pairs gemini-3.5-flash Segment Filtering & Question Classification 9 question categories Full Visual Verification gemini-3.1-pro-preview Correct, Wrong, Insufficient Human Review and Final Adjudication Human Review 10 annotators Full validation Multi: 1,526 QA pairs forreview Single: 698 QA pairs forreview Supported Ruled out Undecidable Post-Review Verification & Adjudication Adjudication gemini-3.1-pro-preview gemini-3.5-flash Blind guess Rewrite Remove Repair Prevent blind guessing Fix errors If not fixable Final Release Multi: 1,487 QA pairs 3,178 clips Single: 567 QA pairs 567 clips 39 routes 126 raw videos 22.6h duration Rekey Update answer key Figure 1: Overview of the EgoGears collection and annotation pipeline. Controlled outdoor route recordings feed separate candidate-generation paths for EgoGears-Single and EgoGears-Multi. Au- tomated gates screen structure, leakage, guessability, and visual support before human review. In- dependent post-review verification and adjudication then retain, revise, repair, or remove questions to produce the final paired benchmark. 2025), MiniCPM (Hu et al., 2024), and Qwen-Omni (Xu et al., 2025a), alongside egocentric mod- els such as EgoVLPv2 (Pramanick et al., 2023) and EgoGPT (Yang et al., 2025), have advanced dynamic visual representation. Qwen3-VL (Bai et al., 2025a) further supports ultra-long sequences through Interleaved-MRoPE and explicit text-based temporal alignment. Commercial Gemini mod- els, including Gemini 3.1 Pro (Google DeepMind, 2026a), provide strong general-purpose reasoning baselines and are included in our evaluation. Recent MLLMs nevertheless struggle with physical spatiotemporal and multi-video reasoning (Lin et al., 2025), and most open-source MLLMs lack comprehensive cross-video reasoning training. Frame sampling and token compression can discard spatial landmarks essential for continuous state tracking (Shi et al., 2025b;a), while outdoor lighting changes exacerbate hallucinations and reliance on language priors (Wu et al., 2025; Zhuang et al., 2026). Under degraded visibility, misalignment between these priors and visual evidence, or indis- criminate suppression of the priors, can further disrupt semantic consistency and state tracking. We therefore report 29 single-video and 31 multi-video configurations in the main leaderboard to assess highly dynamic state tracking, environmental robustness, and asynchronous cross-video reasoning. For configurations evaluated in comparable modes, multi-video accuracy is consistently lower than single-video accuracy, also when answer format and scoring are held fixed. The results motivate closer analysis of evidence binding and ordered route reasoning without attributing the observed difference to the number of videos alone. 3EGOGEARS DATASET Figure 1 summarizes how EgoGears is built. We record 126 egocentric videos over 39 outdoor routes at three movement speeds (slow walking, fast walking, and running) and two lighting conditions (day and night); coverage varies by route (Section 3.3). EgoGears-Single and EgoGears-Multi are generated along separate paths and screened by automated quality gates. The candidates then pass through human review and post-review adjudication, which yields 567 single-video and 1,487 multi- video QA pairs. We first describe the QA design principles shared by both subsets (Sec. 3.1). 4 EgoGears 3.1QA PAIRS DESIGN Design Objective and Task Scope. This study targets first-person outdoor high-dynamic video understanding, primarily focusing on walking, fast walking, and running scenarios. These videos inherently contain continuous camera displacement, viewpoint changes, motion-induced instability, and dynamic external entities. Under varying controlled conditions (e.g., changes in illumination and movement speed), the same route may exhibit different visual characteristics. Unlike traditional video QA that focuses on static scene summarization or isolated frame recognition, our central objec- tive is to assess whether models can form a local, continuous-temporal, and cross-clip understanding of first-person routes. Questions require models to connect visual entities with their temporal po- sition, spatial relation, route phase, and motion state. The model must determine not only what appears, but when it appears, its relative position to the walking path, and its order in the route structure, demonstrating a structured spatiotemporal representation of the dynamic environment. Principles of Question Construction. Every question must be traceable to defined video evidence windows. A question generally encodes three hierarchical levels of information: Observation Target , indicating specific entities such as buildings, vehicles, or pedestrians; Observation Condition , defin- ing contextual constraints like specific time intervals, points before or after a turn, or outbound versus return legs; and Inferred Relation, specifying the reasoning objective, such as presence, rel- ative direction, sequence, or cross-video correspondence. This structure ensures the task measures visually grounded spatiotemporal reasoning rather than text-based memorization. To achieve this, visual facts are transformed into discriminative relations to prevent models from relying on coarse scene-level categorization. For instance, rather than asking if an object exists, questions ask which objects appear after a right turn, or the sequence of passed landmarks. Spatial relations emphasize relative metrics (left/right, ahead/behind) based on the camera wearer’s trajectory, while dynamic entities are distinguished by their behavior (e.g., approaching, overtaking, crossing). Furthermore, questions scale in difficulty by utilizing single continuous clips, multiple non-contiguous windows, or complete route stages. This gradient tests the model’s ability to transition from local observation to long-temporal reasoning. Crucially, the provided evidence windows must jointly cover the asked relation; questions requiring unobservable context are excluded from deterministic evaluation. Option and Answer Design. EgoGears employs structured, letter-based closed-set options. For multiple-choice formats, a response is strictly evaluated based on the complete set of correct options. This design forces the model to perform both evidence-support and evidence-exclusion judgments simultaneously, ensuring it identifies all relevant visual evidence rather than stopping at one salient cue. Distractors are engineered as near-miss statements that apply controlled perturbations to entities genuinely present in the video, preventing models from guessing answers based on noun-matching or surface-level syntactic cues. Key perturbation strategies include spatial and directional rever- sals (e.g., swapping left/right or reversing turn directions), temporal and phase mismatches (e.g., reversing event order or incorrectly applying an outbound observation to a return leg), entity state confusion (e.g., confusing a parked object with a moving one, or altering the direction of motion), and subject-relation reassignment (e.g., pairing a legitimate landmark with the wrong building or action). All options are normalized for length, syntax, and information density. Ultimately, answer judgment is deeply grounded in visual evidence, explicitly distinguishing between a definitively in- correct statement and an indeterminate one. If a distractor incorrectly claims a spatial or temporal state, it is marked incorrect. However, if the video footage simply lacks the evidence to verify an option (e.g., a landmark is absent from a specific short clip but may exist in the broader unshown route), the option is not forced into the incorrect category, ensuring the evaluation remains strictly deterministic. The EgoGears QA design establishes a multi-granular evaluation framework centered on visual- evidence-driven first-person route understanding. By combining structured spatiotemporal relations, closed-set answer evaluations, and visually perturbed distractors, the design transcends basic video captioning. It robustly challenges models to decode the complex interplay of route trajectory, ob- server viewpoint, continuous time, and external dynamics. 3.2COLLECTION METHODOLOGY Human-collected route observations. We collect human egocentric recordings of outdoor routes across movement speeds and day/night illumination. Routes include distinctive landmarks and di- 5 EgoGears Figure 2: EgoGears statistics. (a) Route coverage: of the 39 routes, 29 have multiple recordings, 21 cover all three movement speeds, 12 have both day and night recordings that together cover all three speeds, and 9 are fully crossed, with one recording under each of the six speed× lighting conditions. (b) EgoGears-Single question types (N = 567). (c) Number of clips per EgoGears-Multi question (N = 1,487). (d) EgoGears-Multi question types; the seven most frequent of the 29 fine-grained types are shown individually, and the remaining 22 are grouped. verse turn structures while minimizing incidental pedestrian capture. Repeated and out-and-back traversals provide observations of shared physical structure under changes in viewpoint, travel di- rection, motion, and lighting. Condition coverage varies across routes, as reported in Section 3.3. Evidence-grounded question generation. MLLMs extract structured observations of landmarks, turns, route phases, spatial relations, and events to generate candidate questions. EgoGears- Single uses continuous 60-second clips, including shorter tail clips, to assess local understanding. EgoGears-Multi combines whole-recording or segment-level observations and, where required, in- dependent recordings to assess route-phase alignment, landmark correspondence, event attribution, and route divergence. Questions associate a visual target with an observation or route-phase con- dition and require inferring a spatial, temporal, or cross-observation relation. Relational distractors perturb direction, ordering, route phase, entity state, or evidence attribution. Preserving observation boundaries. Each question is linked to its source recordings and evidence windows. Non-contiguous excerpts and clips from different recordings remain separate inputs, pre- serving the observation boundaries needed for evidence binding. Evaluation clips use 480p H.264 video without audio, and anonymized identifiers conceal recording metadata. Verification and review. Text-only screening flags potentially guessable questions, while video- grounded verification evaluates options as supported, ruled out, or undecidable. Multi-clip and cross-video candidates additionally undergo checks for comparison requirements, evidence avail- ability, duplication, and metadata leakage; deterministic shuffling controls option-position and clip- order cues. Human reviewers assess question clarity and option validity. Multi-video reviewers additionally construct separate clip timelines and assess correspondence using stable physical struc- ture rather than transient appearance. Adjudication combines reviewer judgments with further vi- sual and text-only checks; repaired questions are rechecked, and unresolved cases are removed. The pipeline yields 567 single-video and 1,487 multi-video questions. Acquisition settings, model roles, screening procedures, and review coverage are detailed in Appendix C. 3.3DATASET COMPOSITION EgoGears evaluates local video understanding and cross-video reasoning using human-collected outdoor egocentric recordings spanning different movement speeds and lighting conditions. Figure 2 summarizes route coverage and question distributions. Source recordings and route coverage. The collection contains 126 recordings across 39 routes, totaling approximately 22.6 hours. It includes 88 daytime and 38 nighttime recordings, with 52 slow- walking, 32 fast-walking, and 42 running videos; 54 recordings follow out-and-back trajectories. Of the 39 routes, 29 have multiple recordings, 35 include daytime observations, and 16 include nighttime observations. Movement and lighting coverage varies by route: 21 routes cover all three movement categories, while 12 include both lighting conditions and collectively cover all movement categories. Among these, 9 contain all six movement–lighting combinations, enabling comparisons of each movement category under both day and night conditions. 6 EgoGears Clip preparation. Evaluation clips are standardized to 480p H.264 with audio removed. Unique identifiers link each question to its visual evidence: one clip file for EgoGears-Single and a folder of question-specific clips for EgoGears-Multi. EgoGears-Multi. This subset contains 1,487 verified QA pairs with supporting evidence and ex- planations. Five input structures distinguish how evidence is distributed. Whole-video questions and questions using multiple clips from the same recording account for 64.29% of the subset. The remaining 531 questions (35.71%) require correspondence across independent recordings through anonymous multi-clip inputs, explicit cross-video reasoning, or cross-recording comparisons. The subset covers 29 fine-grained question types, including landmark order, turn-pattern comparison, event-to-route-phase alignment, spatial consistency, route summarization, and landmark revisits. These questions test whether models associate evidence with the correct observation and compose it into consistent spatial and temporal relations. EgoGears-Single. This subset contains 567 verified QA pairs, each grounded in one continuous clip: 540 question inputs are 60 seconds long, and 27 are shorter tail clips. It assesses local un- derstanding without requiring cross-clip correspondence. Questions span three core types: visually grounded QA (45.86%), spatiotemporal reasoning (33.69%), and trajectory QA (20.46%). Nine fine-grained categories further characterize capabilities, including object and attribute recognition, ego-relative spatial reasoning, trajectory understanding, ego-motion recognition, scene understand- ing, and OCR. Answer format and shortcut controls. Both subsets vary the number of candidate options and correct answers. EgoGears-Multi provides 6 or 8 options, with 1–7 correct answers. EgoGears- Single provides 4–8 options and combines single-answer (57.32%) and multiple-answer (42.68%) questions; the latter contain 2–5 correct answers. Exact-set scoring requires selecting all and only the correct options. Metadata are anonymized to limit nonvisual shortcuts. Ten annotators cross- checked all questions (about 2,100 hours); Gemini API usage cost about USD 30,000. 4EXPERIMENTS Our experiments examine the transition from local video understanding to reliable comparison across encounters, focusing on evidence attribution, ordered route understanding, and the benefits and limitations of explicit reasoning. Experimental setup.We evaluate 29 single-video and 31 multi-video configurations across six MLLM families on EgoGears.We use deterministically shuffled options, temperature- zero decoding, and a common structured-answer instruction.The primary metric is fixed-denominator exact-set accuracy:invalid and unfinished outputs count as incorrect. Slow walkFast walkRunning 0 20 40 60 Accuracy (%) Single-video 52.6 55.7 47.8 42.6 48.9 40.5 Slow walkFast walkRunning 0 10 20 30 40 Accuracy (%) Multi-video 27.1 27.7 23.4 29.2 25.0 23.3 DayNight Figure 3: Mean exact-set accuracy on the 9 fully crossed routes (29 single-video and 31 multi- video configurations). Local accuracy leaves cross-video reliabil- ity unresolved. Tables 2 and 3 reveal sub- stantially different performance profiles across the two subsets. Qwen3.5-27B-Thinking and Gemma-4-31B-Thinking achieve nearly identi- cal single-video accuracy (68.6% and 68.4%), but their multi-video scores differ by 15.4 per- centage points (40.8% versus 56.2%). Both splits are drawn from the same recordings, and the gap is not an artifact of answer format or scoring: all 20 configurations evaluated on both splits remain lower on multi-video questions among single-choice questions (mean 14.6 points), among multi-select questions (20.4), and un- der partial credit (13.3; Appendix B.5). Local-video evaluation alone is therefore insufficient to assess reasoning across encounters. Recording identity alone does not determine difficulty. Evidence from independent recordings is not uniformly harder than evidence from one recording. Multi-caption questions draw all clips from one recording, yet 19 of the 31 configurations score higher on explicit cross-video questions; InternVL3.5-241B, for example, obtains 40.2% versus 12.2%. Because the units differ in answer format (random exact accuracy 12.6% versus 1.8%), we also compare chance-normalized accuracy 7 EgoGears Table 2: Single-video QA (N = 567). Exact-set accuracy (%). ModelMode All Obj. Sp.Tr.SC MS Qwen3.5 122B-A10BT68.672.277.245.868.968.2 D59.165.657.340.662.255.0 35B-A3BT66.568.467.851.067.764.9 D60.866.560.242.763.457.4 27BT68.668.975.453.169.567.4 D62.669.462.645.865.558.7 9BT58.662.758.543.859.757.0 D48.555.543.335.452.643.0 Qwen3-VL 235B-A22BT63.368.466.736.562.864.0 D52.964.138.039.660.642.6 30B-A3BT56.165.149.142.758.253.3 8BT52.660.348.535.452.652.5 D40.752.219.338.554.522.3 Qwen2.5-VL 72BD51.761.738.040.660.340.1 7BD22.425.411.720.835.15.4 Gemma 4-31BT68.474.270.247.969.566.9 D62.368.462.645.864.359.5 4-26B-A4BD49.061.235.137.555.140.9 3n-E4BD19.815.89.434.428.97.4 InternVL3.5 241B-A28BD45.753.126.951.058.828.1 38BD27.534.417.021.935.416.9 30B-A3BD27.327.317.534.439.411.2 20B-A4BD39.948.822.239.655.419.0 14BD36.336.824.039.651.116.5 8BD27.028.219.324.037.213.2 GLM 4.6VT51.157.448.532.351.450.8 D45.953.635.733.351.138.8 4.1V-9BT41.351.728.128.147.133.5 Kimi VL-A3B-2506T45.753.632.238.555.432.6 Table 3: Multi-video QA (N = 1,487). Exact- set accuracy (%). ModelMode AllW MC AN CV CR Gemini (API) 3.8-FlashAPI78.369.288.884.470.594.6 3.1-ProAPI66.560.175.066.371.274.4 2.5-ProAPI56.451.565.154.153.069.0 Qwen3.5 122B-A10BT37.842.042.835.215.932.6 D16.325.214.16.36.87.8 35B-A3BT37.941.441.834.124.232.6 D15.125.011.25.26.14.7 27BT40.840.846.743.022.740.3 D16.023.910.97.89.112.4 9BT21.327.618.112.215.921.7 D10.918.64.92.26.88.5 Qwen3-VL 235B-A22BT46.052.145.137.437.144.2 D28.638.216.114.440.227.1 30B-A3BT26.235.917.818.525.813.2 8BD16.927.33.97.425.85.4 Qwen2.5-VL 72BD26.435.611.813.341.725.6 7BD9.816.62.33.313.63.1 Gemma 4-31BT56.254.660.550.061.461.2 D33.240.525.024.132.634.9 4-26B-A4BD22.032.48.212.229.514.7 3n-E4BD9.013.52.34.814.45.4 InternVL3.5 241B-A28BD24.234.412.210.440.214.0 38BD18.126.16.98.530.311.6 30B-A3BD13.420.63.94.823.57.0 20B-A4BD13.923.83.34.817.44.7 14BD16.527.03.07.026.54.7 8BD10.415.84.65.615.22.3 GLM 4.6VT39.935.447.037.447.043.4 D36.935.438.831.553.034.1 4.1V-9BT13.413.39.29.629.515.5 Kimi VL-A3B-2506T19.528.712.27.827.37.0 Notes. Background colors identify model families; variants inherit the italicized family name above them. Bold indicates the best score in each column. T = Thinking; D = Direct; Obj. = objects/attributes; Sp. = ego-relative spatial relations; Tr. = trajectory; SC = single-choice; MS = multi-select. W = whole-video; MC = multi-caption multi-clip; AN = anonymous multi-clip; CV = cross-video; CR = cross-recording. Model references. Qwen3.5 (Qwen Team, 2026); Qwen3-VL (Bai et al., 2025a); Qwen2.5-VL (Bai et al., 2025b); Gemma-4 and Gemma- 3n (Gemma Team, 2026; 2025); InternVL3.5 (Wang et al., 2025); GLM-4.6V and GLM-4.1V (Z.ai, 2026; GLM-V Team, 2025); Kimi- VL (Kimi Team, 2025); Gemini-3.8-Flash, Gemini-3.1-Pro, and Gemini-2.5-Pro (Google DeepMind, 2026b;a; Gemini Team, 2025). κ (Appendix B.4). The ordering still depends on the model: InternVL3.5, Qwen2.5-VL, and the direct-answer Qwen3-VL models remain stronger on cross-video questions (e.g., κ = 31.6 versus 10.6 for InternVL3.5-241B), whereas Gemini and every Qwen3.5 configuration are stronger on multi-caption questions. Which input structure is harder is therefore model-specific rather than determined by whether clips come from different recordings. 8 EgoGears 0:100:390:43 B · 0:00B · 0:40D · 0:07D · 0:10 (a) EgoGears-Single ego-relative spatial relation Which objects are on the left at some point? (select 3) A white building (right) ✓ B graffiti container ✓ C wooden fence D parked van + SUV E container on the right ✓ F electric scooter Modeloffon Qwen3.5-122B, C, D ✗ B, C, F ✓ → Qwen3.5-27B, D, F ✗ B, C, F ✓ → Qwen3-VL-235BC, D, F ✗ B, C, F ✓ → (b) EgoGears-Multi cross-recording, opposite directions CLIP_B vs. CLIP_D: which are true? (select 3) A pipe order ✓ B sculpture: L in B, R in D ✓ C B leaves, D arrives D B arrives, D leaves E sculpture: R in B, L in D ✓ F benches: R in B, L in D G benches: L in B, R in D H same direction Modeloffon Gemma-4-31BA, B, F ✗ B, C, F ✓ → Qwen3-VL-235B, D, G ✗ A, B, C ✗ → Figure 4: Qualitative cases illustrating the benefits and limitations of explicit reasoning. (a) On single-video ego-relative spatial QA, three configurations fail without reasoning but recover the exact three-option answer when reasoning is enabled. (b) Cross-recording correspondence also requires matching the same place across opposite travel directions. Effect of speed and lighting. On the 9 routes recorded under all six speed× lighting conditions, every comparison holds the route and wearer fixed (Fig. 3; 95% CIs in brackets). Darkness mainly affects perception: night-time changes single-video accuracy by−8.0 p [−13.9,−1.3], with 28 of 29 models worse, but multi-video accuracy by only−0.3 p [−3.3, 2.5] (−1.7 p on the full bench- mark). As multi-video accuracy is already low, the smaller effect may partly reflect a floor. Running is the hardest condition: relative to fast walking it changes single-video accuracy by−8.1 p [−15.3, −0.4], and relative to slow walking it changes multi-video accuracy by−4.8 p [−8.4,−1.3]. Ordered route understanding is weak even within one observation. The strongest single-video trajectory score is only 53.1%, achieved by Qwen3.5-27B-Thinking, which reaches 75.4% on ego- relative spatial relations. Because 91 of the 96 trajectory questions are single-choice, this weakness cannot be attributed solely to exact multi-select evaluation. The same pattern recurs in multi-video evaluation (Table 6): turns and route shape form the weak- est capability group for both Gemini-3.8-Flash (64.0%) and Gemma-4-31B-Thinking (36.8%), and Gemini-3.8-Flash obtains only 33.3% on multi-step turning over whole-video evidence (n = 87). Such intersections are diagnostic only: several input–capability cells contain fewer than 20 ques- tions, and 10 are empty. Cross-video understanding thus depends on trajectory information that is already difficult to recover locally. Reasoning gains are selective across capabilities. Across the eight matched single-video com- parisons in Table 2, enabling reasoning improves every configuration, with a median gain of 7.8 percentage points. The median gain is much larger for ego-relative spatial relations (14.0 points) than for trajectory understanding (3.7 points). Similarly, Qwen3-VL-235B improves from 42.6% to 64.0% on multi-select questions but only from 60.6% to 62.8% on single-choice questions. Reason- ing thus appears to help verify candidate relations more than reconstruct ordered motion, although these comparisons also reflect the longer outputs of reasoning runs. We restrict this controlled com- parison to the single-video split. Qualitative case study. Figure 4 contrasts evidence verification with cross-observation reasoning. In panel (a), the three correct objects appear on the left at different times; every direct-answer con- figuration instead selects the parked vehicles on the right and omits one correct object, whereas with reasoning each model produces the exact set B, C, F. Panel (b) shows the same place traversed in opposite directions, so a model must establish correspondence, decide whether each camera ap- proaches or leaves the doors, and reverse the left–right relations of the sculpture and benches. Rea- 9 EgoGears soning corrects Gemma-4-31B from A, B, F to B, C, F, but Qwen3-VL-235B still selects A and omits F. Reasoning can verify individual propositions, but cross-encounter success also re- quires one consistent representation of place, direction, and route phase. 5CONCLUSION We introduced EgoGears, a benchmark of repeated outdoor egocentric traversals that complements local video understanding with reasoning across encounters. Current MLLMs perceive individual observations far better than they relate them: clip–evidence binding and ordered route understand- ing remain key bottlenecks, and explicit reasoning aids relation verification more than trajectory reconstruction. REFERENCES Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, et al. Qwen3-vl technical report. arXiv preprint arXiv:2511.21631, 2025a. Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, et al. Qwen2.5-vl technical report. arXiv preprint arXiv:2502.13923, 2025b. Weitao Chen, Hu Jiaxin, Xie Tianyidan, Yang Li, Yuyi Qian, Banghao Xu, Ziheng Tang, Shenyi Wang, Mingyue Yu, Duo Li, et al. Egomonth: A month-level egocentric video benchmark for long-term spatiotemporal memory. arXiv preprint arXiv:2608.13113, 2026. Sijie Cheng, Zhicheng Guo, Jingwen Wu, Kechen Fang, Peng Li, Huaping Liu, and Yang Liu. Ego- think: Evaluating first-person perspective thinking capability of vision-language models. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 14291– 14302, 2024. Chenyou Fan. Egovqa - an egocentric video question answering benchmark dataset. In 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), p. 4359–4366, 2019. doi: 10.1109/ICCVW.2019.00536. Gemini Team. Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities. arXiv preprint arXiv:2507.06261, 2025. Gemma Team. Gemma 3 technical report. arXiv preprint arXiv:2503.19786, 2025. Gemma Team. Gemma 4 technical report. arXiv preprint arXiv:2607.02770, 2026. GLM-V Team. GLM-4.5V and GLM-4.1V-Thinking: Towards versatile multimodal reasoning with scalable reinforcement learning. arXiv preprint arXiv:2507.01006, 2025. Gabriele Goletto, Tushar Nagarajan, Giuseppe Averta, and Dima Damen. Amego: Active memory from long egocentric videos. In Ale ˇ s Leonardis, Elisa Ricci, Stefan Roth, Olga Russakovsky, Torsten Sattler, and G ̈ ul Varol (eds.), Computer Vision – ECCV 2024, p. 92–110, Cham, 2025. Springer Nature Switzerland. ISBN 978-3-031-72624-8. Google DeepMind. Gemini 3.1 pro model card. https://deepmind.google/models/ model-cards/gemini-3-1-pro/, 2026a. Google DeepMind. Gemini 3.8 flash model card. https://deepmind.google/models/ model-cards/gemini-3-8-flash/, 2026b. Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, Triantafyllos Afouras, Kumar Ashutosh, Vijay Baiyya, Siddhant Bansal, Bikram Boote, et al. Ego-exo4d: Understanding skilled human activity from first-and third-person perspectives. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p. 19383–19400, 2024. 10 EgoGears Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, et al. Minicpm: Unveiling the potential of small language models with scalable training strategies. arXiv preprint arXiv:2404.06395, 2024. Baoxiong Jia, Ting Lei, Song-Chun Zhu, and Siyuan Huang. EgotaskQA: Understanding human tasks in egocentric videos. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2022. Jindong Jiang, Xiuyu Li, Zhijian Liu, Muyang Li, Guo Chen, Zhiqi Li, De-An Huang, Guilin Liu, Zhiding Yu, Kurt Keutzer, et al. Storm: Token-efficient long video understanding for multimodal llms. In 2025 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), p. 5889–5900. IEEE, 2025. Kimi Team. Kimi-vl technical report. arXiv preprint arXiv:2504.07491, 2025. Jingyao Li, Jingyun Wang, Molin Tan, Haochen Wang, Cilin Yan, Likun Shi, Jiayin Cai, Xiaolong Jiang, and Yao Hu. Crossvid: A comprehensive benchmark for evaluating cross-video reason- ing in multimodal large language models. In Proceedings of the AAAI Conference on Artificial Intelligence, 2026a. Yanjun Li, Yuqian Fu, Tianwen Qian, Qi’ao Xu, Silong Dai, Danda Pani Paudel, Luc Van Gool, and Xiaoling Wang. Egocross: Benchmarking multimodal large language models for cross-domain egocentric video question answering. In Proceedings of the AAAI Conference on Artificial Intel- ligence, 2026b. Jingli Lin, Runsen Xu, Shaohao Zhu, Sihan Yang, Peizhou Cao, Yunlong Ran, Miao Hu, Chenming Zhu, Yiman Xie, Yilin Long, Wenbo Hu, Dahua Lin, Tai Wang, and Jiangmiao Pang. Mmsi- video-bench: A holistic benchmark for video-based spatial intelligence, 2025. URL https: //arxiv.org/abs/2512.10863. Ruiping Liu, Junwei Zheng, Yufan Chen, Di Wen, Shaofang Quan, Chengzhi Wu, Jiaming Zhang, Kailun Yang, Kunyu Peng, and Rainer Stiefelhagen. Egoexomem: Cross-view memory reasoning over synchronized egocentric and exocentric videos. arXiv preprint arXiv:2605.18734, 2026. Karttikeya Mangalam, Raiymbek Akshulakov, and Jitendra Malik. Egoschema: A diagnostic bench- mark for very long-form video language understanding. Advances in Neural Information Process- ing Systems, 36:46212–46244, 2023. Kunyu Peng, Zhikun Zhou, Kailun Yang, Di Wen, Ruiping Liu, Yufan Chen, Junwei Zheng, Hao Shi, Yi Zhou, M Saquib Sarfraz, et al. Seeing together: Multi-robot cooperative egocentric spatial reasoning with multimodal large language models. arXiv preprint arXiv:2605.18431, 2026. Chiara Plizzari, Alessio Tonioni, Yongqin Xian, Achin Kulshrestha, and Federico Tombari. Omnia de egotempo: Benchmarking temporal understanding of multi-modal llms in egocentric videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), p. 24129–24138, June 2025. Shraman Pramanick, Yale Song, Sayan Nag, Kevin Qinghong Lin, Hardik Shah, Mike Zheng Shou, Rama Chellappa, and Pengchuan Zhang. Egovlpv2: Egocentric video-language pre-training with fusion in the backbone. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV), p. 5262–5274. IEEE, 2023. Tianwen Qian, Jingjing Chen, Linhai Zhuo, Yang Jiao, and Yu-Gang Jiang. Nuscenes-qa: A multi- modal visual question answering benchmark for autonomous driving scenario. In Proceedings of the AAAI conference on artificial intelligence, 2024. Qwen Team. Qwen3.5: Towards native multimodal agents. https://qwen.ai/blog?id= qwen3.5, 2026. Min Shi, Shihao Wang, Chieh-Yun Chen, Jitesh Jain, Kai Wang, Junjun Xiong, Guilin Liu, Zhiding Yu, and Humphrey Shi. Slow-fast architecture for video multi-modal large language models. arXiv preprint arXiv:2504.01328, 2025a. 11 EgoGears Yang Shi, Jiaheng Liu, Yushuo Guan, Zhenhua Wu, Yuanxing Zhang, Zihao Wang, Weihong Lin, Jingyun Hua, Zekun Wang, Xinlong Chen, et al. Mavors: Multi-granularity video representation for multimodal large language model. In Proceedings of the 33rd ACM International Conference on Multimedia, p. 10994–11003, 2025b. Weiyun Wang, Zhangwei Gao, Lixin Gu, Hengjun Pu, Long Cui, Xingguang Wei, Zhaoyang Liu, Linglin Jing, Shenglong Ye, Jie Shao, et al. Internvl3.5: Advancing open-source multimodal models in versatility, reasoning, and efficiency. arXiv preprint arXiv:2508.18265, 2025. Di Wen, Kailun Yang, Jimmy Weissert, Luc Maria Scherrer, Cedric Z ̈ ollner, Ruiping Liu, Yufan Chen, Jiale Wei, Junwei Zheng, and Kunyu Peng. Provia: Procedure state tracking for online mistake detection in egocentric videos. arXiv preprint arXiv:2609.20638, 2026. Zongyu Wu, Yuwei Niu, Hongcheng Gao, Minhua Lin, Zhiwei Zhang, Zhifang Zhang, Qi Shi, Yilong Wang, Sike Fu, Junjie Xu, et al. Lanp: Rethinking the impact of language priors in large vision-language models. arXiv preprint arXiv:2502.12359, 2025. Jin Xu, Zhifang Guo, Hangrui Hu, Yunfei Chu, Xiong Wang, Jinzheng He, Yuxuan Wang, Xian Shi, Ting He, Xinfa Zhu, et al. Qwen3-omni technical report. arXiv preprint arXiv:2509.17765, 2025a. Peiran Xu, Sudong Wang, Yao Zhu, Jianing Li, Gege Qi, and Yunjian Zhang.Spatial- bench: Benchmarking multimodal large language models for spatial cognition. arXiv preprint arXiv:2511.21471, 2025b. Jingkang Yang, Shuai Liu, Hongming Guo, Yuhao Dong, Xiamengwei Zhang, Sicheng Zhang, Pengyun Wang, Zitang Zhou, Binzhu Xie, Ziyue Wang, et al. Egolife: Towards egocentric life assistant. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), p. 28885–28900. IEEE, 2025. Z.ai. Glm-4.6v: Open source multimodal models with native tool use. https://z.ai/blog/ glm-4.6v, 2026. Deheng Zhang, Yuqian Fu, Runyi Yang, Yang Miao, Tianwen Qian, Xu Zheng, Guolei Sun, Ajad Chhatkuli, Xuanjing Huang, Yu-Gang Jiang, et al. Egonight: Towards egocentric vision un- derstanding at night with a challenging benchmark. In International Conference on Learning Representations, 2026. Jinguo Zhu, Weiyun Wang, Zhe Chen, Zhaoyang Liu, Shenglong Ye, Lixin Gu, Hao Tian, Yuchen Duan, Weijie Su, Jie Shao, et al. Internvl3: Exploring advanced training and test-time recipes for open-source multimodal models. arXiv preprint arXiv:2504.10479, 2025. Yingxuan Zhuang, Jingxiao Yang, Miao Pan, Cheng Tan, Yuxiang Cai, Siwei Tan, Chen Zhi, Xuhong Zhang, Jianwei Yin, and Jintao Chen. Mitigating manifold departure: Uncertainty- aware subspace rectification for trustworthy MLLM decoding.In Forty-third International Conference on Machine Learning, 2026. URL https://openreview.net/forum?id= LInDSHWGMK. 12 EgoGears APPENDIX ASOCIETAL IMPACT AND LIMITATIONS Societal impact. EgoGears evaluates whether multimodal models can relate egocentric observa- tions of outdoor routes recorded while walking and running, under changes in speed, viewpoint, and illumination. Reliable models of this kind could support wearable route assistants, assistive naviga- tion for people with visual impairments, place recognition for robots that learn from human route demonstrations, and the analysis of outdoor mobility. By separating local understanding from cross- video correspondence, the benchmark shows where current models fail, for example on ordered turns and on binding evidence to the correct clip, before such systems are deployed. The same capabilities raise risks. Recordings made in public spaces may contain bystanders, vehi- cles, and private property. Released clips are downscaled to 480p without audio, and anonymized identifiers conceal participants, routes, and recording conditions. Before release, faces and license plates will be blurred to reduce the identifiability of participants and incidental bystanders. Tasks that recognize the same place or route across recordings could, in principle, be used to infer where a person moves from videos they share. We therefore intend the benchmark for research on video un- derstanding and not for surveillance or re-identification. In addition, higher accuracy on EgoGears does not show that a model is safe for real-time use: a wrong answer about a turn, an obstacle, or a crossing could endanger a pedestrian or runner. Deployment would require human oversight, calibrated uncertainty, and validation in the target environment. Limitations. First, all 126 recordings come from a small number of participants and locations in one country, so they may not represent other regions, climates, terrains, body types, or recording devices. Second, the speed–lighting design is fully crossed on only 9 of the 39 routes, and night recordings cover 16 routes; the condition analysis in Figure 3 therefore rests on a small controlled subset and should be read as descriptive. Third, candidate questions were generated and partly verified with Gemini models, and Gemini also participated in adjudicating part of the multi-video set. Human review and the checks in Appendix C.6 reduce but do not eliminate residual label noise and possible model-specific bias. Fourth, results depend on the evaluation protocol: long reasoning outputs can be truncated, so some failures reflect incomplete outputs rather than a lack of understanding. Finally, the benchmark uses closed-set multiple-choice questions and offline clips; it does not evaluate open-ended answers or streaming, real-time interaction. Future work should extend the controlled design to more routes, participants, and regions, add conditions such as rain, snow, and crowded scenes, and evaluate models in open-ended and online settings. BIMPLEMENTATION DETAILS AND MODEL CONFIGURATIONS B.1MODELS AND CONFIGURATIONS We evaluate configurations from the Qwen2.5-VL, Qwen3-VL, Qwen3.5, InternVL3.5, Gemma, GLM, Kimi-VL, together with three Gemini API models on the multi-video split. A configura- tion denotes a checkpoint and an inference mode, so reasoning-enabled and direct-answer modes of the same checkpoint are evaluated separately. The single-video leaderboard reports 29 con- figurations (Table 2). The multi-video leaderboard reports 31 configurations (Table 3): 3 Gem- ini API models, 18 open-source base runs, and 10 open-source explicit-reasoning runs. For the four checkpoints released only as Thinking models (Qwen3-VL-235B-A22B-Thinking, Qwen3-VL- 30B-A3B-Thinking, GLM-4.1V-9B-Thinking, and Kimi-VL-A3B-Thinking-2506), we report only the explicit-reasoning run of each checkpoint. B.2VISUAL INPUT AND PROMPTING Models receive the evaluation clips of each question as images without audio. Non-contiguous clips and clips from different recordings remain separate rather than being concatenated into an artificial video. Each clip is introduced by an anonymized label. Option order is deterministically shuffled using the question identifier and mapped back before scor- ing. All models receive the same question, shuffled options, and required selection count. The 13 EgoGears prompt instructs the model to use visual evidence, select exactly the requested number of options, and return only a JSON object of the form "answer": [...]. Decoding is deterministic with temperature zero. The multi-video prompt differs only in introducing each independent clip with its label; the single-video prompt states that the frames are in chronological order. B.3INFERENCE AND ANSWER PARSING The default model context length is 65,536 tokens. InternVL3.5 uses its 40,960-token limit. All InternVL3.5 models except 20B-A4B use one visual tile per image, because default dynamic tiling would exceed this limit. Single-video open models are served through an OpenAI-compatible interface using vLLM 0.30.0, Transformers 5.17.0, and PyTorch 2.13.0 with CUDA 13.0. We explicitly set the reasoning switch for models that support both modes and use checkpoint defaults for fixed Instruct or Thinking mod- els. Model-specific reasoning parsers are used where required. In particular, Qwen models use the Qwen3 parser, Gemma-4 reasoning runs use the Gemma-4 parser, and Kimi’s custom reasoning delimiters are separated by the evaluation runner. The scorer removes the reasoning channel and accepts only the last post-reasoning JSON object containing an answer key. It provides no free-text fallback, and letters outside the displayed option range are invalid. Truncated, unparseable, missing, or incomplete predictions remain in the fixed benchmark denominator and are counted as incorrect. Each single-video run records dataset and prompt hashes so that incompatible configurations cannot be resumed accidentally. Multi-video runs use the same prompts, visual input, and option shuffling. The multi-video results indicate overall difficulty and differences between model groups, but differences of a few points among open-source configurations should not be read as capability rankings. B.4METRICS The primary metric is exact-set accuracy: a prediction is correct only if its selected option set exactly equals the reference set. We additionally report exact accuracy separately for single-choice and multi-select questions (Table 2) and a partial-credit score, the mean per-question Jaccard similarity |P ∩G|/|P ∪G| between the predicted set P and the reference set G, which penalizes both missing and extra options. To compare subsets with different answer formats, we use chance-normalized accuracy κ = a− c 1− c ,(1) where a is observed exact accuracy and c is the exact-set accuracy of uniform random selection given each question’s option and selection counts, averaged over the subset. On the 531 questions spanning independent recordings, the random baseline is 4.47%. Table 4 reports Jaccard and κ 531 for all configurations. Partial credit raises scores by a median of 9.2 points on single-video and 18.3 points on multi-video questions, but it barely changes the ranking of configurations (Spearman ρ ≥ 0.98 on both splits). Conclusions drawn from exact-set accuracy therefore do not depend on the strictness of the metric. B.5SINGLE- VERSUS MULTI-VIDEO COMPARISON Twenty configurations are evaluated in comparable modes on both splits. Both splits are drawn from the same pool of 126 recordings, but they differ in answer format: the share of multi-select questions and the option and selection counts vary. Table 5 therefore compares the splits with the answer format held fixed, by restricting both to single-choice or to multi-select questions, and with partial credit instead of exact-set scoring. Every configuration scores lower on multi-video questions under all four comparisons. Format and scoring account for part of the overall gap, which falls from a mean of 22.5 points to 14.6 points among single-choice questions and to 13.3 points under partial credit, but the gap remains positive for every configuration. 14 EgoGears Table 4: Exact-set versus partial-credit accuracy (%). Jaccard is the mean per-question |P ∩ G|/|P ∪ G| between the predicted set P and the reference set G; failed or missing answers score 0. κ 531 is chance-normalized exact accuracy on the 531 questions spanning independent recordings (random baseline 4.47%). Configurations and settings match Tables 2 and 3; – marks a configuration not evaluated on that split. Single-video (N = 567)Multi-video (N = 1,487) ModelModeExactJaccardExactJaccard κ 531 Gemini (API) 3.8-FlashAPI–78.383.182.7 3.1-ProAPI–66.576.568.1 2.5-ProAPI–56.468.655.4 Qwen3.5 122B-A10BT68.674.137.853.926.5 D59.166.416.338.42.4 35B-A3BT66.570.937.953.628.0 D60.868.115.137.30.8 27BT68.673.140.856.334.4 D62.669.716.038.55.0 9BT58.663.021.338.411.5 D48.557.710.930.40.4 Qwen3-VL 235B-A22BT63.369.846.061.536.1 D52.962.028.647.920.4 30B-A3BT56.164.126.244.815.2 8BT52.659.3– D40.752.316.935.67.3 Qwen2.5-VL 72BD51.762.026.445.719.8 7BD22.433.99.826.71.4 Gemma 4-31BT68.474.456.269.553.5 D62.369.633.252.525.5 4-26B-A4BD49.058.822.043.213.3 3n-E4BD19.831.09.025.83.0 InternVL3.5 241B-A28BD45.757.724.243.914.8 38BD27.540.518.138.510.7 30B-A3BD27.340.013.431.75.8 20B-A4BD39.950.413.931.93.6 14BD36.348.916.536.97.2 8BD27.039.910.428.52.8 GLM 4.6VT51.159.039.956.938.5 D45.955.736.954.934.6 4.1V-9BT41.351.313.435.412.1 Kimi VL-A3B-2506T45.757.419.541.38.3 B.6EVALUATION PROMPTS All evaluations use the two fixed templates below, unchanged between direct-answer and reasoning modes. They differ only in how the visual input is introduced. The wording is reproduced exactly; only line breaks are adjusted for layout. The visual input follows the text as images. In the multi- video setting, each clip’s frames are preceded by a text part --- CLIP X --- that carries the clip’s anonymized label. The placeholders are filled as listed below the templates. 15 EgoGears Table 5: Single- versus multi-video accuracy (%) for the 20 configurations evaluated in comparable modes on both splits. Both splits are drawn from the same recordings. SC and MS restrict each split to its single-choice or multi-select questions; Jaccard is the partial-credit score of Table 4. ∆ is the single-video minus multi-video score. All (exact)SC (exact)MS (exact)All (Jaccard) ModelModeSM∆SM∆SM∆SM∆ Qwen3.5-27BT68.6 40.8 27.8 69.5 45.2 24.3 67.4 38.7 28.7 73.1 56.3 16.8 Qwen3.5-122B-A10BT68.6 37.8 30.8 68.9 42.7 26.2 68.2 35.5 32.7 74.1 53.9 20.2 Qwen3.5-35B-A3BT66.5 37.9 28.6 67.7 46.1 21.6 64.9 34.1 30.8 70.9 53.6 17.3 Qwen3.5-9BT58.6 21.3 37.3 59.7 34.6 25.1 57.0 15.2 41.8 63.0 38.4 24.6 Gemma-4-31BT68.4 56.2 12.2 69.5 62.86.7 66.9 53.1 13.8 74.4 69.54.9 GLM-4.6VT51.1 39.9 11.2 51.4 46.94.5 50.8 36.6 14.2 59.0 56.92.1 Qwen3-VL-235B-A22BT63.3 46.0 17.3 62.8 56.36.5 64.0 41.2 22.8 69.8 61.58.3 Qwen3-VL-30B-A3BT56.1 26.2 29.9 58.2 48.2 10.0 53.3 15.9 37.4 64.1 44.8 19.3 GLM-4.1V-9BT41.3 13.4 27.9 47.1 24.8 22.3 33.58.2 25.3 51.3 35.4 15.9 Kimi-VL-A3B-2506T45.7 19.5 26.2 55.4 41.4 14.0 32.69.4 23.2 57.4 41.3 16.1 Qwen3-VL-235B-A22BD52.9 28.6 24.3 60.6 49.0 11.6 42.6 19.1 23.5 62.0 47.9 14.1 Qwen3-VL-8BD40.7 16.9 23.8 54.5 37.2 17.3 22.37.5 14.8 52.3 35.6 16.7 Qwen2.5-VL-72BD51.7 26.4 25.3 60.3 43.1 17.2 40.1 18.6 21.5 62.0 45.7 16.3 Qwen2.5-VL-7BD22.49.8 12.6 35.1 23.8 11.35.43.32.1 33.9 26.77.2 Gemma-4-26B-A4BD49.0 22.0 27.0 55.1 39.3 15.8 40.9 14.0 26.9 58.8 43.2 15.6 Gemma-3n-E4BD19.89.0 10.8 28.9 20.28.77.43.83.6 31.0 25.85.2 InternVL3.5-20B-A4BD39.9 13.9 26.0 55.4 32.3 23.1 19.05.4 13.6 50.4 31.9 18.5 InternVL3.5-241B-A28BD45.7 24.2 21.5 58.8 45.6 13.2 28.1 14.3 13.8 57.7 43.9 13.8 InternVL3.5-38BD27.5 18.19.4 35.4 35.00.4 16.9 10.26.7 40.5 38.52.0 InternVL3.5-14BD36.3 16.5 19.8 51.1 38.9 12.2 16.56.1 10.4 48.9 36.9 12.0 Mean48.7 26.2 22.5 55.3 40.7 14.6 39.9 19.5 20.4 57.7 44.4 13.3 Min. ∆9.40.42.12.0 Single-video prompt Answer this multiple-choice question about egocentric walking/running footage. The frames below are sampled in chronological order from the single video clip (at most 60 seconds long) associated with this question. Watch the video frames before deciding. Base your answer on visual evidence from this video. Do not answer from the wording of the options alone. QUESTION:question OPTIONS: options Select exactlyn optionplural. Return ONLY JSON:"answer": [example] Multi-video prompt Answer this multiple-choice question about egocentric walking/running footage. The frames below are sampled in order from the clip(s) the question refers to; each clip is introduced by its label. Watch before deciding. Do not answer from the wording of the options alone. QUESTION:question OPTIONS: options Select exactlyn optionplural. Return ONLY JSON:"answer": [example] PlaceholderFilled with questionThe question stem. optionsThe options after per-question shuffling, one per line as A. text. n,pluralThe required number of selections; s when n > 1, otherwise empty. exampleThe first n displayed option letters, e.g., "A", "B", "C". Because options are shuffled, copying the example does not favor the reference answer. 16 EgoGears B.7EVALUATION TAXONOMIES Multi-video questions have two complementary classification axes. The unit axis describes how ev- idence is organized: whole-video, multi-caption multi-clip, anonymous multi-clip, cross-video, and cross-recording. Whole-video and multi-caption questions draw clips from one recording, whereas anonymous, cross-video, and cross-recording questions require evidence from independent record- ings. The latter three units contain 531 questions in total. The capability axis merges 29 fine-grained question types into seven groups: landmark recognition and ordering, event and temporal reasoning, turns and route shape, global route and phase under- standing, spatial relations, cross-recording route matching, and environmental change. Each group contains at least 113 questions. We report the two axes separately because they are not independent: 10 of the 35 unit–capability intersections are empty, and several non-empty intersections contain fewer than 20 questions. Table 3 reports accuracy along the unit axis, and Table 6 along the capabil- ity axis. Single-video questions use nine semantic categories: object and attribute QA, ego-relative spatial relation, trajectory-grounded QA, ego-motion recognition, scene and place QA, text and OCR, tem- poral grounding, actor action and motion, and event sequencing. The main table emphasizes the first three categories because each contains at least 30 questions. The remaining categories are retained as high-variance diagnostics rather than used for fine-grained model ranking. CCOLLECTION AND QUALITY-CONTROL DETAILS C.1ACQUISITION AND EVIDENCE PREPARATION Videos were captured using smartphones at 1080p and 30 fps. Participants mounted the phone at chest level, with its plane perpendicular to the ground and the camera facing forward. Collection instructions specified continuous sessions of at least 10 minutes. Route selection prioritized recog- nizable landmarks, limited pedestrian presence, and varied geometry, including straight segments, left and right turns, and U-turns. The acquisition protocol targeted repeated traversals across movement and lighting conditions. Re- alized coverage is partial: 54 recordings are explicitly identified as out-and-back traversals, and 9 routes cover all six movement–lighting combinations. Evaluation clips are encoded as 480p H.264 video with audio removed. Evidence preparation follows each question’s temporal scope: continuous excerpts are extracted directly, while ques- tions about complete recordings may use multiple evidence windows from the same source. Non- contiguous windows and clips from independent recordings remain separate files. Anonymized clip labels and paths conceal original filenames, participant identities, route identifiers, movement and lighting metadata, and recording identities. Internal mappings retain the association between each question, its source recordings, and its evidence windows. C.2MODEL-ASSISTED CANDIDATE GENERATION We use gemini-3.1-pro-preview for video observation and visual verification. For EgoGears-Multi, gemini-3.5-flash generates question stems, options, proposed answers, question types, and evidence ranges from the structured observations. For EgoGears-Single, gemini-3.1-pro-preview generates both captions and candidate questions. Text-only screening uses gemini-3.5-flash throughout. For EgoGears-Multi, observation scope follows the question: complete recordings support global route questions, continuous excerpts support local temporal questions, and joint observations of independent recordings support cross-video comparisons. Segment-based generation uses clips at multiple temporal scales, including 60 and 180 seconds. Structured observations describe route phases, turns, landmarks, repeated places, dynamic events, environmental changes, and spatial rela- tions. This process produces approximately 11,802 candidate questions. For EgoGears-Single, recordings are divided into 60-second clips, retaining shorter tail clips. Each clip receives a visually grounded caption with structured fields for the environment, objects and 17 EgoGears Table 6: Multi-video QA by capability (N = 1,487). Exact-set accuracy (%) on the seven capa- bility groups, with question counts in the header. MST is the multi-step-turns question type over whole-video evidence (n = 87), a subset of Turn. Configurations and modes match Table 3. ModelMode Land. (337) Event (287) Turn (239) Route (239) Spatial (154) Match (118) Env. (113) MST (87) Random–7.34.96.810.42.46.66.615.5 Gemini (API) 3.8-FlashAPI79.877.764.082.085.785.679.633.3 3.1-ProAPI67.765.950.677.466.273.768.129.9 2.5-ProAPI53.755.139.771.160.461.061.916.1 Qwen3.5 122B-A10BT36.839.029.751.534.423.745.118.4 D17.220.25.931.86.56.816.84.6 35B-A3BT37.441.120.954.039.624.644.210.3 D16.019.55.028.55.83.419.56.9 27BT45.138.727.255.643.531.436.318.4 D21.114.63.829.79.16.820.43.4 9BT21.120.910.936.414.318.625.712.6 D13.48.02.923.43.97.614.23.4 Qwen3-VL 235B-A22BT49.651.928.959.439.638.145.124.1 D27.026.521.346.414.934.728.328.7 30B-A3BT25.825.413.842.322.721.231.014.9 8BD18.413.912.128.05.817.820.421.8 Qwen2.5-VL 72BD28.523.015.941.413.632.230.121.8 7BD8.67.35.023.05.89.38.011.5 Gemma 4-31BT56.455.136.871.157.161.960.227.6 D33.830.722.650.626.627.138.124.1 4-26B-A4BD24.621.613.432.610.421.227.417.2 3n-E4BD9.54.210.517.21.98.59.716.1 InternVL3.5 241B-A28BD29.720.615.937.210.426.323.923.0 38BD19.019.913.424.79.120.316.818.4 30B-A3BD14.511.87.923.06.516.111.514.9 20B-A4BD13.410.16.730.59.711.014.213.8 14BD16.014.310.930.57.115.319.517.2 8BD9.88.09.618.47.810.27.113.8 GLM 4.6VT37.735.531.851.539.051.738.923.0 D39.531.427.248.536.440.735.423.0 4.1V-9BT11.69.49.618.813.625.413.313.8 Kimi VL-A3B-2506T19.316.012.135.111.716.924.819.5 Land. = landmark recognition and ordering; Event = event and temporal reasoning; Turn = turns and route shape; Route = global route and phase understanding; Spatial = spatial relations; Match = cross-recording route matching; Env. = environmental change. Random is the exact- set accuracy of uniform random selection. Bold marks the best score in each column. attributes, spatial relations, camera trajectories, and events. Candidate questions are generated from these descriptions. C.3AUTOMATED SCREENING FOR EGOGEARS-MULTI Whole-recording and continuous-excerpt questions. These candidates pass a five-stage proce- dure: 1. Deterministic option shuffling. Option positions are randomized using a stable procedure. 2. Structural validation. Checks enforce consistency among the stem, options, answer la- bels, question type, and selection count, and reject duplicate options. 3. Leakage screening. Questions are screened for identifying metadata, internal annotation fields, caption-derived cues, and timestamps that reveal the answer. 18 EgoGears 4. Text-only screening. The text-only model answers each question three times without video. A question is flagged if at least two responses match the proposed answer, trig- gering rejection or rewriting. This is a heuristic screen for language or option-structure shortcuts. 5. Video-grounded verification. The video model checks the required footage against every option, identifying unsupported claims, directional errors, and inconsistencies between the question and its evidence. Multi-clip and cross-video questions. These candidates pass an eight-stage procedure: 1. Comparison requirement. The question must belong to an allowed task type, contain sufficient clips, and require reasoning across multiple evidence windows. 2. Option structure. Checks examine option and answer counts, option length, and informa- tion density for superficial answer cues. 3. Leakage screening. Identifying metadata, internal fields, and description-dependent word- ing such as according to the description are screened out. 4. Deterministic shuffling. Options and clip display order are randomized so that answer positions and alphabetic clip labels do not encode the intended relation. 5. Cross-batch deduplication. Checks identify exact and near-duplicate stems, repeated ev- idence patterns, and duplicate question signatures. 6. Text-only screening and rewriting. Candidates undergo the three-attempt text-only test. Flagged questions may be rewritten and retested; persistently guessable questions are re- moved. 7. Evidence availability. Required recordings and time ranges must be valid, extractable, and sufficient for review. 8. Answer-blind visual verification.The video model receives the question and evi- dence without captions or proposed answers and labels each option as supported, ruled out, or undecidable. Acceptance requires sufficient evidence and agreement between the supported-option set and the proposed answer. Shuffling precedes text-only screening, and inexpensive structural and textual checks precede video verification. Automated screening produces a human-review package of 1,526 questions. C.4VERIFICATION AND SAMPLING FOR EGOGEARS-SINGLE Pre-verification filtering. Candidate questions undergo the same three-attempt text-only screen- ing, with rewriting and retesting when necessary. The resulting pool contains 6,770 questions, av- eraging 4.8 questions per clip. Removing 318 questions associated with unsuitable clips, including truncated footage or insufficient visual evidence, leaves 6,452 candidates. Question taxonomy. Each question receives one primary label from nine categories: 1. Text and OCR: reading visible text, numbers, or signs. 2. Temporal Grounding: identifying when an event or object appears. 3. Event Sequencing: ordering events, landmarks, or actions. 4. Scene and Place QA: recognizing environmental and place properties. 5. Object and Attribute QA: identifying objects and their static attributes. 6. Ego-relative Spatial Relation: locating entities relative to the camera or route. 7. Trajectory-grounded QA: understanding overall paths, travel directions, and turn se- quences. 8. Ego-motion Recognition: recognizing local camera or wearer motion. 9. Actor Action and Motion: recognizing the actions of external entities. 19 EgoGears The classifier first uses question form to identify OCR, temporal-grounding, and sequencing ques- tions. Other categories use alignment between the proposed correct options and caption fields. Mo- tion questions are distinguished by whether they concern the overall route, local camera motion, or external actors. Spatial-versus-attribute ambiguity is further examined using the objects mentioned in distractors and captions; unresolved cases default to Object and Attribute QA. Exhaustive visual verification. The verifier receives the clip, question, options, and proposed an- swer; captions are withheld. It assigns option-level support labels and records evidence time ranges. A question is labeled answer correct when all proposed correct options are supported and dis- tractors are ruled out or undecidable. It is labeled answerwrong when a proposed correct option is contradicted or a distractor is supported, and insufficient when the evidence is inadequate. Verification of all 6,452 candidates yields 5,081 answer correct, 1,364 answerwrong, and 7 insufficient outcomes. Stratified selection. Only answercorrect candidates enter quota-based sampling, targeting approximately 700 questions across the nine categories. Larger categories are capped, while cate- gories below quota contribute all passing questions. Sampling uses a fixed random seed and a strict limit of 15 questions per source recording. Clip reuse is avoided where possible; this preference may be relaxed to fill quotas, while the recording-level cap remains fixed. The resulting 698 questions proceed to human review. C.5HUMAN REVIEW, ADJUDICATION, AND RELEASE Review protocol. Each subset’s review package is divided into ten batches assigned to ten an- notators. For EgoGears-Multi, proposed answers are withheld. Reviewers inspect every associ- ated clip, construct separate clip timelines, and label each option as supported, ruled out, or undecidable. They provide an answer, a clarity judgment, and notes on problematic options. Clip labels are not treated as chronological cues, and place correspondence is assessed using stable structures such as road geometry, building shapes, and fixed installations. EgoGears-Single review focuses on local visual facts, including objects, spatial relations, camera motion, event order, and environmental changes. Reviewers document the validity of questions and options against the footage. Post-review checks and repair. Following human review, the video model reassesses options without the proposed answer, and the text-only model repeats shortcut screening. Adjudication combines available human judgments, visual verification, text-only results, and proposed answers to retain, revise, repair, or remove questions. Repairs address answer errors, ambiguous wording, incomplete option sets, or insufficient evidence. Repaired questions undergo renewed visual verifi- cation and text-only screening. Release audit. Of the 1,526 EgoGears-Multi review items, 706 are confirmed, 504 pass repair, 277 receive answer changes through adjudication, and 39 are removed, yielding 1,487 released questions. For EgoGears-Single, 567 of the 698 reviewed candidates are retained: 562 have complete hu- man annotations, while 5 are retained through video-based verification without complete human annotations. The audit records 120 answer modifications, 3 question modifications, and 3 option modifications. These modifications correct errors in the model-generated candidates; each modified question was re-verified against the footage before release, so the rates describe the candidate pool rather than the released labels. C.6REPRODUCIBILITY AND VALIDITY CHECKS We independently rescore every per-question result of the 29 reported single-video configurations using the strict parser and recover the originally reported scores exactly. The dataset and prompt are locked by hashes in each run configuration. We also repeat Qwen3-VL-8B on a separate cluster: the direct-answer run obtains 40.9% versus 40.7% in the original environment, while the reasoning run 20 EgoGears obtains 51.0% versus 52.6%. The latter difference is explained mainly by a higher residual trunca- tion count (60 versus 38), again emphasizing that serving conditions interact with long reasoning outputs. Finally, we check whether Gemini’s participation in adjudicating 322 multi-video questions explains its lead. Within matched question units, this contributes an estimated 1.5 points to overall Gemini accuracy, far smaller than the 22.1-point gap between Gemini-3.8-Flash and the strongest open model. Table 7 reports all configurations on the 445 questions whose reference answers human reviewers confirmed (65 of them after option repair). On this subset, the Gemini models average 80.9%, compared with 34.0% across the 28 open-source configurations; Gemini-3.8-Flash leads the strongest open model by 20.5 points (22.1 on the full set), and the ranking of configurations is nearly unchanged (Spearman ρ = 0.99). Gemini’s lead is therefore unlikely to be explained by its role in adjudication. The Gemini models receive the same visual input, prompt, and option shuffling as the open-source models. Table 7: Multi-video exact accuracy on human-confirmed questions (%). All: the full set (N = 1,487, as in Table 3). Human: the 445 questions whose reference answers the reviewers confirmed (65 after option repair), with 95% bootstrap confidence intervals. ModelModeAllHuman95% CI Gemini (API) 3.8-FlashAPI78.390.6[87.6, 93.5] 3.1-ProAPI66.581.3[77.5, 84.9] 2.5-ProAPI56.470.8[66.5, 74.6] Qwen3.5 122B-A10BT37.849.0[44.3, 53.5] D16.324.5[20.4, 28.5] 35B-A3BT37.953.3[48.1, 58.0] D15.124.5[20.4, 28.8] 27BT40.851.2[46.5, 55.5] D16.022.0[18.2, 26.1] 9BT21.332.4[28.1, 36.9] D10.920.4[16.6, 24.3] Qwen3-VL 235B-A22BT46.061.3[57.1, 66.3] D28.640.9[36.6, 45.4] 30B-A3BT26.239.1[34.6, 43.6] 8BD16.925.2[21.3, 29.4] Qwen2.5-VL 72BD26.438.0[33.5, 42.2] 7BD9.813.9[10.8, 17.1] Gemma 4-31BT56.270.1[65.8, 74.2] D33.247.9[43.4, 52.4] 4-26B-A4BD22.031.2[27.0, 35.3] 3n-E4BD9.011.2[8.3, 14.2] InternVL3.5 241B-A28BD24.232.1[27.9, 36.6] 38BD18.124.9[20.9, 28.8] 30B-A3BD13.421.6[17.8, 25.4] 20B-A4BD13.923.8[20.0, 27.6] 14BD16.524.9[20.9, 28.8] 8BD10.415.1[11.7, 18.4] GLM 4.6VT39.954.2[49.9, 58.7] D36.951.5[46.7, 56.2] 4.1V-9BT13.418.4[15.1, 21.8] Kimi VL-A3B-2506T19.528.8[24.7, 33.0] Cross-recording comparison adds viewpoint reversal and correspondence uncertainty. In Fig- ure 5(a), the recordings depict the same intersection, but the correct answer requires reversing the travel-direction-dependent relation while preserving the building identity. Gemma-4-31B is cor- rected, whereas Qwen3-VL-235B remains inconsistent after reasoning. Panel (b) combines land- 21 EgoGears mark side with within-clip order; only the strongest displayed configuration produces the exact set. These examples show that recognizing shared visual content is insufficient: all selected propositions must be expressed in one consistent coordinate and temporal frame. Figure 6 presents a complementary whole-video failure. Determining whether the endpoint returns near the start requires linking distant observations and selecting the landmark that establishes the match. Qwen3-VL-235B succeeds in both modes, while Gemma-4-31B and Gemini-3.1-Pro select the same incorrect alternative. The stable model-specific outcomes suggest that additional reasoning is useful only after the start and end observations have been encoded as comparable place represen- tations. C.7ADDITIONAL COMPUTATION CAN RESCUE OR DESTABILIZE PREDICTIONS Figures 7–9 compare cases in which reasoning helps, has no effect, or damages an initially correct answer. Figure 7 is especially instructive because each panel contains both directions of change. In the spatial example, reasoning corrects Qwen3-VL-235B but causes GLM-4.6V to replace the cor- rect set with two unsupported objects; Qwen3.5-122B remains correct. In the trajectory example, Qwen3.5-27B and Gemma-4-31B are rescued, whereas GLM-4.6V changes from the correct end- point description to an incorrect dead-end interpretation. This pattern is inconsistent with a simple rule that more computation monotonically improves visual reasoning. The same instability appears in multi-video QA. In Figure 8(a), reasoning rescues Gemma-4-31B but leads GLM-4.6V away from an exact direct answer and does not resolve Qwen3-VL-235B. Panel (b) shows a second GLM regression alongside a stable correct Qwen prediction. Figure 9(a) again contrasts a successful GLM correction with an unresolved Qwen3-VL error. Its panel (b) is a limiting case: two models fail in both modes on an apparently simple “no turns” relation, while Qwen3.5-122B is correct in both. Here, reasoning cannot compensate for an incorrect segmentation of route events. Across these examples, explicit reasoning behaves primarily as an evidence-selection and consis- tency mechanism, not as a guaranteed source of new visual information. It helps when the required facts are present, but a direct answer binds them to the wrong option, side, or clip. It fails when motion evidence is missing, place correspondence is not established, or the trace introduces an unsupported reinterpretation. This explains why the aggregate gain can coexist with substantial per-instance regressions. 22 EgoGears Figure 5: Cross-recording side and order reasoning. The same physical structures must be aligned across observations before direction-dependent relations can be reversed and combined consistently. Figure 6: Whole-video start–end correspondence. The models must match distant route phases through a shared landmark; reasoning leaves both the correct and incorrect model predictions un- changed. Figure 7: Single-video cases where reasoning has opposite effects across models. Correct direct answers may be destabilized even when another model is rescued on the same question. 23 EgoGears Figure 8: Multi-video regressions and corrections under reasoning. The intervention can improve evidence binding for one model while inducing an inconsistent or wrong-cardinality answer in an- other. Figure 9: Reasoning rescue versus persistent failure in multi-video QA. Panel (a) contrasts success- ful and unsuccessful cross-clip evidence integration; panel (b) shows that added computation does not repair an incorrectly inferred turn sequence. 24

Instant research discovery