Paper deep dive
CADER: Confidence-Aware Dynamic Evidence Reasoning for Long-Video Understanding
Jinlong Yang, Wenhao Zhang, Kuanwei Lin, Sijie Cheng
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Long-video understanding increasingly relies on large vision-language models and tool-augmented reasoning, but most systems apply the same inference procedure to every example regardless of difficulty. This uniform strategy invokes unnecessary tool-assisted processing for easy questions and provides limited control when difficult questions require fine-grained temporal evidence. We propose CADER (Confidence-Aware Dynamic Evidence Reasoning), a training-free framework for adaptive and reliable long-video reasoning. CADER first performs global reasoning over uniformly sampled frames and estimates answer confidence with a logit-margin signal, allowing high-confidence examples to exit early. For uncertain examples, CADER activates a second-stage tool-augmented loop that combines temporal cropping, lightweight semantic verification, and Relevance-Guided Resampling to progressively localize question-relevant evidence. This design treats tool use as a sample-level decision: a single global pass handles easy cases, while additional reasoning is reserved for examples where uncertainty suggests that more evidence is needed. Experiments on multiple VideoQA benchmarks show that CADER improves long-video reasoning while bypassing Stage~2 for high-confidence samples. Moreover, when applied to a backbone trained only with tool-free chain-of-thought supervision, CADER achieves competitive performance against specialized tool-augmented frameworks, suggesting a practical inference-time route for adaptive long-video reasoning.
Tags
Links
- Source: https://arxiv.org/abs/2607.24582v1
- Canonical: https://arxiv.org/abs/2607.24582v1
Trouble viewing inline? Open PDF directly →
Full Text
58,899 characters extracted from source content.
Expand or collapse full text
CADER: Confidence-Aware Dynamic Evidence Reasoning for Long-Video Understanding Jinlong Yang1 , Wenhao Zhang2 , Kuanwei Lin2, Sijie Cheng3 Corresponding author. Abstract Long-video understanding increasingly relies on large vision-language models and tool-augmented reasoning, but most systems apply the same inference procedure to every example regardless of difficulty. This uniform strategy invokes unnecessary tool-assisted processing for easy questions and provides limited control when difficult questions require fine-grained temporal evidence. We propose CADER (Confidence-Aware Dynamic Evidence Reasoning), a training-free framework for adaptive and reliable long-video reasoning. CADER first performs global reasoning over uniformly sampled frames and estimates answer confidence with a logit-margin signal, allowing high-confidence examples to exit early. For uncertain examples, CADER activates a second-stage tool-augmented loop that combines temporal cropping, lightweight semantic verification, and Relevance-Guided Resampling to progressively localize question-relevant evidence. This design treats tool use as a sample-level decision: a single global pass handles easy cases, while additional reasoning is reserved for examples where uncertainty suggests that more evidence is needed. Experiments on multiple VideoQA benchmarks show that CADER improves long-video reasoning while bypassing Stage 2 for high-confidence samples. Moreover, when applied to a backbone trained only with tool-free chain-of-thought supervision, CADER achieves competitive performance against specialized tool-augmented frameworks, suggesting a practical inference-time route for adaptive long-video reasoning. Figure 1: Motivation of CADER. Instead of applying tool-assisted reasoning uniformly, the framework first uses confidence to decide whether a sample should enter the expensive tool pipeline. Introduction Long-video question answering is a central testbed for long-video understanding (LVU), requiring models to integrate sparse evidence across extended temporal contexts and ground natural-language queries in temporally distributed visual events. With the rapid progress of vision-language models (VLMs), recent approaches increasingly augment single-pass prediction with tool-based or agentic inference. By invoking tools and iteratively refining evidence, these systems decide where and how to attend within long videos, improving performance on complex queries (Wang et al. 2025b; Zhang et al. 2025b). However, such heavy-weight reasoning is not always necessary. A key limitation of existing tool-augmented long-video reasoning methods is that they typically apply a fixed inference pipeline to all samples, implicitly treating every question as if it requires fine-grained temporal search. This reflects a missing decision layer in current long-video systems: before deciding how to use a tool, the model should first decide whether the sample needs tool use at all. This issue is amplified by the mixed difficulty distribution of long-video benchmarks: many questions can be answered using global video semantics alone (Fu et al. 2025a; Zhou et al. 2025), while only a smaller subset requires localized evidence and iterative refinement. As a result, uniform tool invocation introduces redundant computation for easy samples and may even expose them to unnecessary localization errors. These observations motivate treating tool use as a confidence-conditioned, sample-level decision rather than a default procedure. Temporal localization via video cropping is effective for focusing on relevant segments and reducing visual redundancy (Yang et al. 2025b). Yet, existing methods often train specialized agentic models to decide when and how to use such tools (Pan et al. 2025b), which becomes costly as base VLMs evolve. Moreover, more computation does not necessarily improve difficult cases: grounding errors or irrelevant evidence can accumulate during iterative reasoning and destabilize predictions. To address these challenges, we propose CADER (Confidence-Aware Dynamic Evidence Reasoning), a training-free framework for long-video understanding. Instead of relying on retrained agentic policies, CADER introduces inference-time adaptive control to selectively allocate computation. In Stage 1, the model performs global reasoning over uniformly sampled frames and estimates prediction confidence via the logit margin, enabling early exit for high-confidence samples without tool invocation. For low-confidence cases, Stage 2 activates a tool-augmented reasoning pipeline that integrates temporal grounding, iterative video cropping, lightweight VLM-based semantic verification, and Relevance-Guided Resampling (RGR). RGR dynamically adjusts frame density by down-sampling verified low-relevance regions while preserving base-rate coverage of unexplored segments. Together, these components form a closed-loop refinement process that progressively identifies task-relevant temporal evidence while avoiding redundant tool use and error accumulation. Compared to prior tool-augmented or multi-stage frameworks, CADER combines confidence-driven adaptive routing with closed-loop semantic verification, enabling adaptive and stable long-video reasoning without tool-use training. A natural question is whether CADER can achieve “Thinking with Videos”-like performance without any specialized tool-augmented training. To investigate this, we evaluate CADER on Qwen3-VL-SFT, which is fine-tuned solely with tool-free chain-of-thought (CoT) data–the same type of supervision used in the tool-free component of LongVT (Yang et al. 2025b) to enhance the base model’s general reasoning ability, without any tool-use annotation. This controlled experiment demonstrates that our training-free framework can deliver strong long-video reasoning capability even when the backbone has not undergone specialized tool-augmented supervision. The main contributions of this paper are summarized as follows: • We propose CADER, a confidence-aware dynamic evidence reasoning framework that treats tool invocation as a sample-level decision, routing high-confidence examples to early exit while reserving expensive reasoning for uncertain cases. • We design a closed-loop evidence refinement stage that integrates temporal grounding, lightweight VLM verification, and Relevance-Guided Resampling (RGR), reducing irrelevant evidence and improving reasoning stability for low-confidence samples. • Extensive experiments on multiple VideoQA benchmarks show that confidence-conditioned routing consistently improves over the backbone, validates the contribution of each component, and achieves strong performance across diverse long-video scenarios. Related Work Long Video Understanding Long video understanding has advanced rapidly with multimodal large language models (MLLMs), enabling open-ended question answering, temporal reasoning, and semantic understanding over extended video inputs (Zhang et al. 2024; Jin et al. 2025b, a; Yang et al. 2025a). A central challenge is that long videos contain substantial temporal redundancy, while the evidence needed for a specific question is often sparse. Recent methods address this issue through memory mechanisms, curriculum or reinforcement learning, scene-level organization, tree-structured representations, and hierarchical frame selection (Wang et al. 2025d; Chen et al. 2025, 2026; Ben-Ami et al. 2026). Foundation models such as Qwen3-VL (Bai et al. 2025a) further improve timestamp modeling and temporal grounding. CADER builds on these advances from a system-level perspective: rather than processing every sample with the same long-video pipeline, it uses model confidence to decide when global reasoning is sufficient and when localized evidence search is needed. Adaptive Computation and Early-Exit Mechanisms Adaptive computation aims to dynamically allocate computational resources based on input complexity, enabling models to devote more computation to hard instances while reducing cost on easier ones (Graves 2016). In computer vision, this idea has been explored through techniques such as frame sparsification (Ghodrati et al. 2021), dynamic sampling (Wu et al. 2019), and resolution adaptation (Meng et al. 2020). Recent work further combines resolution scaling with depth-wise conditional execution, incorporating early-exit strategies for efficient video recognition (Wang et al. 2025a). These principles have also been extended to multimodal settings, such as early exiting for document understanding (Hamed et al. 2024), token-level pruning and merging for efficient MLLM inference (Zhong et al. 2025), and confidence-triggered CoT activation in video reasoning (Liu et al. 2026). However, these methods do not address whether to invoke a separate tool-assisted temporal search stage. In contrast, CADER introduces a system-level adaptive mechanism that performs stage-wise routing based on model confidence after a full forward pass, which is suitable for long-video reasoning where tool pipelines incur substantially higher cost. Figure 2: Overview of the CADER framework. Stage 1 performs global reasoning with confidence estimation and enables early exit for high-confidence samples. Stage 2 activates tool-assisted temporal search with lightweight VLM verification and relevance-guided resampling for low-confidence samples. Tool-Augmented and Agentic VLMs Tool-augmented reasoning has become an effective paradigm for complex multimodal tasks. In video understanding, agent-based frameworks (Fan et al. 2024; Yuan et al. 2025; Liu et al. 2025a; Yan et al. 2026) improve temporal reasoning through structured memory, multi-agent coordination, multi-tool interaction, and LLM-guided reasoning chains. Recent agentic condensation methods further reduce long-form videos into compact evidence representations (Yin et al. 2026), while reinforcement-learning methods train intrinsic tool-use capabilities (Yang et al. 2025b; Zhang et al. 2025b; Pan et al. 2025b). However, most of these methods optimize how tools are used after invocation has been assumed. They rarely ask whether a sample should enter the tool pipeline at all, and many still consume tool outputs without explicit relevance verification (Fan et al. 2025). CADER addresses these gaps by conditioning tool invocation on model confidence and validating candidate segments with a lightweight VLM verifier. Beyond this routing decision, CADER uses frame-density-encoded feedback: accumulated verifier scores are converted into a segment-wise fps map, allowing search history to shape subsequent proposals through the resampled visual input rather than textual context alone. Method Overview Long-video question answering demands a careful balance between reasoning accuracy and computation allocation: uniform full-video inference floods the model with temporally irrelevant content, while unconditional tool-assisted reasoning incurs substantial overhead regardless of sample difficulty. CADER addresses this tension through two stages, each targeting a distinct computational regime: Stage 1: Global Preliminary Reasoning. A strong VLM performs holistic reasoning over uniformly sampled frames and produces a candidate answer with a confidence score. High-confidence predictions exit immediately; uncertain samples proceed to Stage 2. This design allows additional tool-assisted computation to vary with sample difficulty instead of being applied uniformly. Stage 2: Tool-assisted Fine-grained Reasoning. A tool-based temporal search pipeline localizes the most relevant video segment through iterative cropping and lightweight VLM verification. To prevent redundant token expenditure on regions already verified as irrelevant, we further introduce Relevance-Guided Resampling (RGR), which dynamically adjusts frame density based on accumulated verifier scores. The complete pseudocode of CADER and RGR is provided in the supplementary material. Stage 1: Global Preliminary Reasoning Frame Sampling Strategy To provide broad temporal coverage while maintaining tractable token consumption, Stage 1 initially extracts frames at a fixed rate r1=1.0r_1=1.0 fps. Given a video V with duration D seconds, this yields N1=⌊D×r1⌋N_1= D× r_1 (1) frames. When N1N_1 exceeds the backbone’s internal visual-token budget, the sequence is uniformly subsampled over the full timeline. This preserves broad temporal coverage while respecting the model’s input constraint. Confidence Estimation via Logit Margin Given video V, question Q, and candidate options Oii=1N\O_i\_i=1^N, we employ a large-scale VLM (Qwen3-VL-8B-Instruct (Bai et al. 2025a)) to perform holistic reasoning over N1N_1 frames. The model produces logits zi\z_i\ for each candidate option, which we normalize via temperature-scaled softmax: Pi=exp(zi/T)∑j=1Nexp(zj/T),P_i= (z_i/T) _j=1^N (z_j/T), (2) where T=2.0T=2.0 is an empirically chosen value that softens the probability distribution without over-flattening it, improving the stability of margin-based confidence estimation across benchmarks with varying numbers of candidate options. We define the logit margin M as: M=Ptop1−Ptop2,M=P_top1-P_top2, (3) where Ptop1P_top1 and Ptop2P_top2 are the highest and second-highest probabilities, respectively. A large margin indicates that the model strongly favors one option over all others, which we interpret as high prediction confidence. If M≥τM≥τ (τ=0.97τ=0.97), the system directly outputs the top-1 prediction A1A_1 (early exit). Otherwise, the sample is routed to Stage 2. The reliability of M as a routing signal is examined in the adaptive routing analysis. In all reported experiments, the option logits used for answer selection also define the routing score, so confidence estimation requires no additional model call. This ties routing to the model’s own answer preference without a separately trained controller. Stage 1 inference disables chain-of-thought reasoning (enable_thinking=False) and produces a direct single-token prediction, minimizing latency while preserving logit scores for confidence estimation. Deliberate chain-of-thought reasoning is reserved for uncertain samples in Stage 2. Stage 2: Tool-assisted Fine-grained Reasoning Samples that fail the Stage 1 confidence check are routed to Stage 2, which performs targeted temporal search through four sequential components: temporal segment proposal, local evidence verification, reflection-based search with relevance-guided resampling, and final local reasoning. Temporal Segment Proposal The main VLM is prompted to identify a candidate time interval [ts,te][t_s,t_e] likely to contain the key visual evidence for answering Q. We further introduce a Breadth-Aware Fallback: if the proposed window exceeds 12001200 s or spans more than 20%20\% of the video, the question is treated as globally dependent and the system falls back to A1A_1. For valid proposals, crop_video extracts the segment, enforcing a minimum duration of 1010 s by symmetrically expanding shorter windows around their midpoint. Local Evidence Verification To validate whether the proposed segment contains the required visual evidence, we employ a lightweight VLM (Qwen3-VL-4B-Instruct (Bai et al. 2025a)) as a dedicated semantic verifier. We first apply Budget-Aware Dense Sampling to maximize information density within the model’s context window. For a cropped segment of duration Dcrop=te−tsD_crop=t_e-t_s, frames are sampled at: r2=clip(NbudgetDcrop,rmin,rmax),r_2=clip\! ( N_budgetD_crop,\;r_ ,\;r_ ), (4) where Nbudget=512N_budget=512, rmin=1.0r_ =1.0 fps, and rmax=8.0r_ =8.0 fps, ensuring short segments receive high temporal resolution while longer crops remain within the token budget. Given the densely sampled frames, the verifier answers a binary Yes/No question, and PyesP_yes is the token probability assigned to “Yes”. If Pyes≥δP_yes≥δ (δ=0.60δ=0.60), the segment is accepted and passed to final reasoning. Otherwise, a reflection step is triggered. The verifier scores are also accumulated across iterations to guide resampling in the next stage. Reflection-based Temporal Search When a segment is rejected, the system feeds all previously attempted ranges back to the main VLM, enabling spatio-temporal exclusion: the model proposes a new, non-overlapping interval informed by where evidence has not been found. After the initial proposal, the system performs at most K=2K=2 reflection rounds, yielding at most K+1=3K+1=3 crop-and-verify cycles. If no relevant segment is identified, it returns the cached Stage 1 prediction A1A_1 without an additional full-video reasoning pass. Relevance-Guided Resampling At each reflection iteration, uniform 1.01.0 fps sampling wastes context tokens on segments already verified as irrelevant. Relevance-Guided Resampling (RGR) instead adapts frame density according to accumulated verifier scores. This frame-density-encoded feedback carries search history implicitly through the resampled visual input. Specifically, after verifying interval [ts(k),te(k)][t_s^(k),t_e^(k)] at iteration k, we record a scored segment (k)=ts(k),te(k),f(k)S^(k)=\t_s^(k),t_e^(k),f^(k)\, where: f(k)=min(1.0,Pyes(k)+fmin),f^(k)= \! (1.0,\;P_yes^(k)+f_ ), (5) with fmin=0.4f_ =0.4 fps ensuring non-zero coverage even for highly irrelevant segments. Overlapping segments across iterations are merged into a non-overlapping per-segment fps map P by first collecting all unique temporal breakpoints: ℬ=sort(⋃kts(k),te(k)),B=sort\! ( _k\t_s^(k),t_e^(k)\ ), (6) and assigning to each sub-interval [bi,bi+1][b_i,b_i+1] the frame rate of the most recent scored segment covering it: f[bi,bi+1]=f(k∗),k∗=argmaxkk∣ts(k)≤bi∧te(k)≥bi+1. gatheredf_[b_i,b_i+1]=f^(k^*),\\ k^*= _k\, \k t_s^(k)≤ b_i t_e^(k)≥ b_i+1 \. gathered (7) Adjacent sub-intervals with identical frame rates are further merged to reduce fragmentation. The effective frame count for each sub-interval is: ni=⌊Δi×fi⌋,Δi=bi+1−bi,n_i= _i× f_i , _i=b_i+1-b_i, (8) and the total frame count for the reflection prompt is: Nreflect=∑[bi,bi+1]∈⌊Δi×fi⌋+⌊Dunexplored×r1⌋,N_reflect= _[b_i,b_i+1] _i× f_i \;+\; D_unexplored× r_1 , (9) where DunexploredD_unexplored is the total duration not yet covered by any scored segment. Explored regions are resampled at their adjusted rate fi≤r1f_i≤ r_1, while uncovered regions retain the base rate r1=1.0r_1=1.0 fps. This allocation reduces redundant context consumption by down-sampling verified low-relevance regions while keeping unexplored regions at the base rate. The RGR procedure is illustrated in Figure 3, with complete pseudocode provided in the supplementary material. Final Local Reasoning Once a relevant segment [ts∗,te∗][t_s^*,t_e^*] is accepted by the verifier, the main VLM performs final inference on its densely sampled frames (at rate r2r_2, up to 8.08.0 fps). Concentrating attention on a compact, high-fidelity clip mitigates evidence dilution and distraction from irrelevant frames. The final answer A is extracted via structured parsing with a single-letter fallback. Figure 3: Comparison between uniform sampling and RGR. Uniform sampling allocates equal frame density across the video, wasting tokens on already-explored irrelevant segments. RGR dynamically down-samples low-relevance explored regions while preserving base-rate coverage of unexplored areas, thereby encoding search history in the visual signal. Training-Free Scaling with Backbone Improvements While recent agentic MLLMs typically rely on tool-augmented SFT to achieve strong performance (Zhang et al. 2025b), CADER requires no such supervision and naturally benefits from improvements to the underlying backbone. To validate this, we construct a controlled backbone, Qwen3-VL-SFT, by fine-tuning Qwen3-VL-8B-Instruct for one epoch using LLaMA-Factory (Zheng et al. 2024) on a mixture of tool-free CoT data: LongVideo-Reason CoT (Chen et al. 2025), Video-R1 CoT (Feng et al. 2025), and image-based CoT instructions (Yang et al. 2025b), all of which are sourced from LongVT(Yang et al. 2025b). No tool-use annotations are included, ensuring that any performance gains reflect enhanced intrinsic reasoning ability alone. Evaluating CADER on top of this strengthened backbone under identical inference conditions, we demonstrate two key findings: (1) CADER achieves competitive long-video reasoning performance without any tool-augmented supervision; and (2) as backbone reasoning ability improves, CADER’s performance scales accordingly, confirming that our framework consistently amplifies backbone improvements without retraining any tool-use policies. Table 1: Comparison with state-of-the-art methods on long-video QA benchmarks. Bold denotes the best result among open-source models of comparable size. * denotes results reproduced by us. Method Video-MME MLVU LongVideoBench LVBench VideoEval-Pro (Long,w/o sub) (M-Avg, Val) (Validation) (Overall) (MCQ) Open-source Models Video-LLaVA (Lin et al. 2024) 36.2 47.3 39.1 - 27.7 LLaVA-OneVision (Li et al. 2024) 46.7 64.7 56.3 - - LLaVA-Video (Zhang et al. 2025c) 50.6 70.8 61.1 41.5 47.8 InternVL2.5 (Chen et al. 2024) 51.1 67.6 62.7 45.2 48.5 Flow4Agent (Liu et al. 2025b) 54.2 71.4 60.4 - - VideoLLaMA3 (Zhang et al. 2025a) 54.9 73.0 59.8 45.3 - TimeSearch-R (Pan et al. 2025a) 56.0 71.5 60.1 - - VideoChat-R1.5 (Yan et al. 2025) - 70.9 62.6 48.4 - LOVE-R1 (Fu et al. 2025b) - 67.4 60.1 48.2 - Video-Zoomer (Ding et al. 2026) 55.8 68.8 57.7 41.5 - TPO (LLaVA-Video) (Li et al. 2025) 55.4 71.1 60.3 - - LongVT (Yang et al. 2025b) - - - 41.3 - Qwen2.5-VL* (Bai et al. 2025b) 50.3 66.6 58.1 45.4 47.8 Qwen3-VL* (Bai et al. 2025a) 59.3 75.2 64.0 46.9 52.1 Training-free Methods DrVideo (Ma et al. 2024) 51.7 - - - - VideoAgent (Wang et al. 2024) 49.0 - - 29.3 - VideoTree (Wang et al. 2025d) 54.2 - - 28.8 - SeViCES (InternVL2.5) (Sheng et al. 2025) 55.2 72.1 61.7 46.7 - !10 CADER (Qwen3-VL) 60.1 75.9 65.7 50.1 54.0 !10 CADER (Qwen3-VL-SFT) 60.5 76.5 66.1 50.8 55.1 Experiments Our experiments are organized around the central claim that long-video reasoning should allocate computation according to sample difficulty. We first compare CADER with existing methods to evaluate overall accuracy, then ablate its major components to identify where the gains come from. We further quantify Stage 2 trigger rates and analyze the verifier and confidence signal, showing that sample-level tool invocation is selective and reliable. Experimental Setup Benchmarks. We evaluate our framework on five challenging long-video understanding benchmarks: Video-MME (Fu et al. 2025a) (long subset), MLVU (Zhou et al. 2025), LongVideoBench (Wu et al. 2024), VideoEval-Pro (Ma et al. 2025) (MCQ protocol), and LVBench (Wang et al. 2025c). These benchmarks span diverse video durations and question types, providing a comprehensive testbed for long-video QA evaluation. Implementation Details. Our framework uses Qwen3-VL-8B-Instruct (Bai et al. 2025a) as the primary model and Qwen3-VL-4B-Instruct (Bai et al. 2025a) as the lightweight verifier. Stage 1 samples frames at r1=1.0r_1=1.0 fps and follows the backbone’s internal visual-frame/token budget; overflow frames are uniformly subsampled to fit the model context. The confidence threshold is τ=0.97τ=0.97, the verifier threshold is δ=0.60δ=0.60, and the maximum reflection iterations are K=2K=2; these values are fixed across benchmarks. Stage 1 performs global reasoning with thinking disabled to avoid additional reasoning overhead. In contrast, Stage 2 enables chain-of-thought reasoning (enable_thinking=True) to support more deliberate temporal grounding and final answer generation. For localized reasoning, we use budget-aware sampling with Nbudget=512N_budget=512 frames and a sampling rate clipped to [1.0,8.0][1.0,8.0] fps. Each cropped segment is enforced to a minimum duration of 10 seconds. To study the effect of reasoning-oriented supervision, we additionally evaluate CADER on Qwen3-VL-SFT, described in the training-free scaling section. All experiments are conducted on 8× PPU-ZW810E GPUs with 96GB memory per device, and inference is run with bfloat16 precision to reduce memory footprint while preserving numerical stability. Main Results We compare CADER with state-of-the-art methods across five benchmarks. As shown in Table 1, CADER consistently improves over its Qwen3-VL-8B backbone, with larger gains on benchmarks requiring precise temporal localization. On shorter or more semantically diverse benchmarks such as Video-MME, Stage 2 is triggered less frequently and gains are accordingly smaller. With Qwen3-VL-SFT, introduced in the training-free scaling section, CADER achieves further gains and reaches performance competitive with specialized tool-augmented frameworks such as LongVT (Yang et al. 2025b), showing that reasoning-oriented supervision and inference-time adaptive computation are complementary. Ablation Study We conduct ablation experiments on VideoMME(long) and LVBench to analyze the contribution of each component in CADER. These two benchmarks are selected because they represent complementary evaluation regimes: VideoMME(long) covers a broad range of question types with a Stage 2 trigger rate of 59.9%59.9\%, while LVBench features a higher proportion of temporally localization-dependent questions and a higher Stage 2 trigger rate (78.6%78.6\%), making it more sensitive to the design choices in Stage 2. Results are reported in Table 2. Table 2: Ablation study on CADER. Each row disables one component while keeping the rest intact. ✓/× denote enabled/disabled; — denotes not applicable. Uniform Stage 2 disables early exit and routes every sample to Stage 2. Variant S2 Ver. Ref. RGR VMME LVB Full ✓ ✓ ✓ ✓ 60.1 50.1 w/o Stage 2 × — — — 59.3 46.9 Uniform S2 ✓ ✓ ✓ ✓ 59.0 49.8 w/o Verifier ✓ × ✓ ✓ 56.3 43.5 w/o Refl. (K=0K=0) ✓ ✓ × — 58.9 48.6 w/o RGR ✓ ✓ ✓ × 59.5 48.5 Removing Stage 2 leads to the largest performance drop on LVBench (−3.2-3.2 points), confirming that tool-assisted temporal reasoning is the primary source of improvement for hard samples. However, uniformly routing every sample to Stage 2 is also suboptimal, reducing accuracy from 60.160.1 to 59.059.0 on VideoMME(Long) and from 50.150.1 to 49.849.8 on LVBench. This shows that the gain is not obtained by simply adding more computation, but by selectively invoking Stage 2 when Stage 1 is uncertain. Disabling the verifier causes a larger drop despite Stage 2 remaining active, indicating that accepting every proposed segment without relevance checking can feed the main model irrelevant visual content. Together, these results confirm that each component serves a distinct role: Stage 2 provides temporal focus, the verifier ensures relevance, reflection recovers from grounding failures, and RGR improves resampling under a matched reflection budget. Additional depth-wise analysis of the reflection mechanism is provided in the supplementary material. Stage-2 Trigger Rate Analysis Beyond accuracy, we report Stage 2 trigger rates to quantify selective tool invocation relative to a uniform pipeline that applies Stage 2 to every sample. As shown in Table 3, CADER skips Stage 2 on 38.6%38.6\% of all evaluated samples, corresponding to 2,788 out of 7,227 examples. These examples require no cropping, verifier call, or reflection step. Trigger rates also vary by benchmark: MLVU exits at Stage 1 for more than half of its samples, while LVBench triggers Stage 2 more often, consistent with its stronger temporal localization demand. This adaptive behavior supports the central premise of CADER: computation should be allocated according to sample difficulty rather than applied uniformly across all videos. Together with the Uniform Stage 2 ablation, the trigger rates characterize both the coverage of tool invocation and the accuracy effect of applying temporal search selectively. Table 3: Stage 1 early-exit rate across benchmarks. The Stage 1 exit column reports the fraction of samples that avoid Stage 2 entirely. Benchmark Total S2 Trig. S1 Exit Acc. VideoMME-Long 900 59.9% 40.1% 60.1 LVBench 1549 78.6% 21.4% 50.1 MLVU 2160 45.4% 54.6% 75.9 LongVideoBench 1329 58.2% 41.8% 65.7 VideoEval-Pro 1289 72.0% 28.0% 54.0 Total 7227 61.4% 38.6% – High-Confidence Relevance Routing We examine whether high-confidence relevance routing on the initial Stage 2 proposal translates into downstream accuracy gains. As shown in Figure 4, initial candidate segments assigned high relevance scores by the verifier (Pyes≥0.9P_yes≥ 0.9) yield positive net gains over the Stage 1 baseline across all five benchmarks. This pattern indicates that highly scored initial candidate segments are likely to provide useful evidence for local reasoning, supporting verifier-guided relevance routing before local inference. Net gain counts incorrect Stage 1 answers corrected by local inference minus initially correct answers overturned. Positive values therefore measure the end-to-end utility of high-confidence relevance routing after local inference. The metric follows the complete path from the initial proposal through final local reasoning, testing whether verifier-ranked evidence remains useful when consumed by the main VLM. Figure 4: Net correct predictions gained by Stage 2 over the Stage 1 baseline for initial candidate segments assigned high relevance scores by the verifier (Pyes≥0.9P_yes≥ 0.9). Sample counts are shown on the x-axis. Adaptive Routing via Confidence Confidence calibration. We evaluate whether the logit margin M (Eq. (3)) serves as a reliable routing signal. Table 4 reports the sample distribution across margin intervals on all five benchmarks, and Figure 5 shows the corresponding Stage 1 accuracy trend. Table 4: Sample counts per logit-margin interval across benchmarks. Accuracy trends are shown in Figure 5. Margin interval VMME-L LVBench MLVU LVBch VEP ≥0.995≥ 0.995 263 224 921 417 262 [0.99,0.995)[0.99,0.995) 34 32 90 51 26 [0.97,0.99)[0.97,0.99) 64 75 169 89 73 [0.90,0.97)[0.90,0.97) 100 120 213 139 108 <0.90<0.90 439 1098 767 640 820 Figure 5: Stage-1 accuracy as a function of logit margin across multiple benchmarks. The monotonically increasing trend confirms that the margin reliably reflects prediction confidence and justifies threshold-based routing. Accuracy increases monotonically with larger margins across all benchmarks, indicating that M is a reliable confidence signal. This trend supports using the margin for threshold-based routing; we use τ=0.97τ=0.97 consistently across benchmarks. High-margin samples exit early, while lower-margin samples are routed to Stage 2. Minor fluctuations arise from small bins, but the overall ordering remains stable. Stage 2 improvement on low-confidence samples. Table 5 reports the gain of Stage 2 over the Stage 1 baseline restricted to low-confidence samples (M<τM<τ). Table 5: Accuracy improvement of Stage 2 over Stage 1 on low-confidence samples (M<τM<τ). Margin Benchmark Stage-1 Final [0.90, 0.97)[0.90,\;0.97) LongVideoBench 66.2 70.5 +4.3+4.3 LVBench 51.7 54.2 +2.5+2.5 VideoMME(Long) 55.0 56.0 +1.0+1.0 <0.90<0.90 LongVideoBench 44.4 47.0 +2.6+2.6 LVBench 37.0 41.0 +4.0+4.0 VideoMME(Long) 40.3 40.6 +0.2+0.2 Stage 2 improves accuracy across both margin ranges and all benchmarks, with larger gains on harder samples where Stage 1 is least reliable. The smaller but positive gain on VideoMME(Long) suggests that confidence routing limits Stage 2 invocation while identifying samples where evidence search is most likely to help. Conclusion CADER addresses uniform reasoning in VideoQA through confidence-aware routing, letting easy samples exit early while reserving tool use for uncertain cases. Its closed-loop design combines temporal grounding, RGR, and lightweight verification to reduce error accumulation. Results across five benchmarks support selective over uniform tool use. References S. Bai, Y. Cai, R. Chen, K. Chen, X. Chen, Z. Cheng, L. Deng, W. Ding, C. Gao, C. Ge, W. Ge, Z. Guo, Q. Huang, J. Huang, F. Huang, B. Hui, S. Jiang, Z. Li, M. Li, M. Li, K. Li, Z. Lin, J. Lin, X. Liu, J. Liu, C. Liu, Y. Liu, D. Liu, S. Liu, D. Lu, R. Luo, C. Lv, R. Men, L. Meng, X. Ren, X. Ren, S. Song, Y. Sun, J. Tang, J. Tu, J. Wan, P. Wang, P. Wang, Q. Wang, Y. Wang, T. Xie, Y. Xu, H. Xu, J. Xu, Z. Yang, M. Yang, J. Yang, A. Yang, B. Yu, F. Zhang, H. Zhang, X. Zhang, B. Zheng, H. Zhong, J. Zhou, F. Zhou, J. Zhou, Y. Zhu, and K. Zhu (2025a) Qwen3-vl technical report. arXiv preprint arXiv:2511.21631. Cited by: Base Model., Long Video Understanding, Confidence Estimation via Logit Margin, Local Evidence Verification, Table 1, Implementation Details.. S. Bai, K. Chen, X. Liu, J. Wang, W. Ge, S. Song, K. Dang, P. Wang, S. Wang, J. Tang, H. Zhong, Y. Zhu, M. Yang, Z. Li, J. Wan, P. Wang, W. Ding, Z. Fu, Y. Xu, J. Ye, X. Zhang, T. Xie, Z. Cheng, H. Zhang, Z. Yang, H. Xu, and J. Lin (2025b) Qwen2.5-vl technical report. arXiv preprint arXiv:2502.13923. Cited by: Table 1. D. Ben-Ami, G. Serussi, K. Cohen, and C. Baskin (2026) HiMu: hierarchical multimodal frame selection for long video question answering. External Links: 2603.18558, Link Cited by: Long Video Understanding. T. Chen, K. Zhang, Q. Wu, X. Chen, C. Chang, X. Sun, Y. Zhou, and R. Ji (2026) Scaling the long video understanding of multimodal large language models via visual memory mechanism. arXiv preprint arXiv:2603.29252. Cited by: Long Video Understanding. Y. Chen, W. Huang, B. Shi, Q. Hu, H. Ye, L. Zhu, Z. Liu, P. Molchanov, J. Kautz, X. Qi, et al. (2025) Scaling rl to long videos. arXiv preprint arXiv:2507.07966. Cited by: Long Video Understanding, Training-Free Scaling with Backbone Improvements. Z. Chen, W. Wang, Y. Cao, Y. Liu, Z. Gao, E. Cui, J. Zhu, S. Ye, H. Tian, Z. Liu, et al. (2024) Expanding performance boundaries of open-source multimodal models with model, data, and test-time scaling. arXiv preprint arXiv:2412.05271. Cited by: Table 1. Y. Ding, X. Lai, Y. Zhang, W. Li, R. Chu, and Y. Yang (2026) VideoZoomer: reinforcement-learned temporal focusing for long video reasoning. In The Fourteenth International Conference on Learning Representations, External Links: Link Cited by: Table 1. S. Fan, J. Cui, M. Guo, and S. Yang (2025) Tool-augmented spatiotemporal reasoning for streamlining video question answering task. arXiv preprint arXiv:2512.10359. Cited by: Tool-Augmented and Agentic VLMs. Y. Fan, X. Ma, R. Wu, Y. Du, J. Li, Z. Gao, and Q. Li (2024) Videoagent: a memory-augmented multimodal agent for video understanding. In European Conference on Computer Vision, p. 75–92. Cited by: Tool-Augmented and Agentic VLMs. K. Feng, K. Gong, B. Li, Z. Guo, Y. Wang, T. Peng, J. Wu, X. Zhang, B. Wang, and X. Yue (2025) Video-r1: reinforcing video reasoning in mllms. arXiv preprint arXiv:2503.21776. Cited by: Training-Free Scaling with Backbone Improvements. C. Fu, Y. Dai, Y. Luo, L. Li, S. Ren, R. Zhang, Z. Wang, C. Zhou, Y. Shen, M. Zhang, P. Chen, Y. Li, S. Lin, S. Zhao, K. Li, T. Xu, X. Zheng, E. Chen, C. Shan, R. He, and X. Sun (2025a) Video-mme: the first-ever comprehensive evaluation benchmark of multi-modal llms in video analysis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), p. 24108–24118. Cited by: Introduction, Benchmarks.. S. Fu, Q. Yang, Y. Li, X. Wei, X. Xie, and W. Zheng (2025b) LOVE-r1: advancing long video understanding with an adaptive zoom-in mechanism via multi-step reasoning. arXiv preprint arXiv:2509.24786. Cited by: Table 1. A. Ghodrati, B. E. Bejnordi, and A. Habibian (2021) Frameexit: conditional early exiting for efficient video recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 15608–15618. Cited by: Adaptive Computation and Early-Exit Mechanisms. A. Graves (2016) Adaptive computation time for recurrent neural networks. arXiv preprint arXiv:1603.08983. External Links: Link Cited by: Adaptive Computation and Early-Exit Mechanisms. O. Hamed, S. Bakkali, M. Blaschko, S. Moens, and J. Van Landeghem (2024) Multimodal adaptive inference for document image classification with anytime early exiting. In International Conference on Document Analysis and Recognition, p. 270–286. Cited by: Adaptive Computation and Early-Exit Mechanisms. H. Jin, K. Lin, W. Zhang, Y. Jin, and G. Li (2025a) VideoCuRL: video curriculum reinforcement learning with orthogonal difficulty decomposition. arXiv preprint arXiv:2601.00887. Cited by: Long Video Understanding. H. Jin, Q. Wang, W. Zhang, Y. Liu, and S. Cheng (2025b) VideoMem: enhancing ultra-long video understanding via adaptive memory management. arXiv preprint arXiv:2512.04540. Cited by: Long Video Understanding. B. Li, Y. Zhang, D. Guo, R. Zhang, F. Li, H. Zhang, K. Zhang, P. Zhang, Y. Li, Z. Liu, et al. (2024) Llava-onevision: easy visual task transfer. arXiv preprint arXiv:2408.03326. Cited by: Table 1. R. Li, X. Wang, Y. Zhang, O. Zohar, Z. Wang, and S. Yeung-Levy (2025) Temporal preference optimization for long-form video understanding. arXiv preprint arXiv:2501.13919. Cited by: Table 1. B. Lin, Y. Ye, B. Zhu, J. Cui, M. Ning, P. Jin, and L. Yuan (2024) Video-llava: learning united visual representation by alignment before projection. In Proceedings of the 2024 conference on empirical methods in natural language processing, p. 5971–5984. Cited by: Table 1. R. Liu, Z. Liu, J. Tang, Y. Ma, R. Pi, J. Zhang, and Q. Chen (2025a) LongVideoAgent: multi-agent reasoning with long videos. External Links: 2512.20618, Link Cited by: Tool-Augmented and Agentic VLMs. R. Liu, S. Sun, H. Tang, W. Gao, and G. Li (2025b) Flow4agent: long-form video understanding via motion prior from optical flow. In Proceedings of the IEEE/CVF International Conference on Computer Vision, p. 23817–23827. Cited by: Table 1. S. Liu, M. Zhuge, C. Zhao, J. Chen, L. Wu, Z. Liu, C. Zhu, Z. Cai, C. Zhou, H. Liu, E. Chang, S. Suri, H. Xu, Q. Qian, W. Wen, B. Varadarajan, Z. Liu, H. Xu, F. Bordes, R. Krishnamoorthi, B. Ghanem, V. Chandra, and Y. Xiong (2026) VideoAuto-r1: video auto reasoning via thinking once, answering twice. arXiv preprint arXiv:2601.05175. Cited by: Adaptive Computation and Early-Exit Mechanisms. W. Ma, W. Ren, Y. Jia, Z. Li, P. Nie, G. Zhang, and W. Chen (2025) Videoeval-pro: robust and realistic long video understanding evaluation. arXiv preprint arXiv:2505.14640. Cited by: Benchmarks.. Z. Ma, C. Gou, H. Shi, B. Sun, S. Li, H. Rezatofighi, and J. Cai (2024) DrVideo: document retrieval based long video understanding. External Links: 2406.12846, Link Cited by: Table 1. Y. Meng, C. Lin, R. Panda, P. Sattigeri, L. Karlinsky, A. Oliva, K. Saenko, and R. Feris (2020) Ar-net: adaptive frame resolution for efficient action recognition. In European conference on computer vision, p. 86–104. Cited by: Adaptive Computation and Early-Exit Mechanisms. J. Pan, Q. Zhang, R. Zhang, M. Lu, X. Wan, Y. Zhang, C. Liu, and Q. She (2025a) TimeSearch-r: adaptive temporal search for long-form video understanding via self-verification reinforcement learning. arXiv preprint arXiv:2511.05489. Cited by: Table 1. J. Pan, R. Zhang, X. Wan, Y. Zhang, M. Lu, and Q. She (2025b) Timesearch: hierarchical video search with spotlight and reflection for human-like long video understanding. arXiv preprint arXiv:2504.01407. Cited by: Introduction, Tool-Augmented and Agentic VLMs. Y. Sheng, Y. Hao, C. Li, S. Wang, and X. He (2025) SeViCES: unifying semantic-visual evidence consensus for long video understanding. arXiv preprint arXiv:2510.20622. Cited by: Table 1. Q. Wang, C. Yu, S. Chen, W. Fang, and N. Xiong (2025a) Joint adaptive resolution selection and conditional early exiting for efficient video recognition on edge devices. Big Data Mining and Analytics 8 (3), p. 661–677. Cited by: Adaptive Computation and Early-Exit Mechanisms. S. Wang, J. Jin, X. Wang, L. Song, R. Fu, H. Wang, Z. Ge, Y. Lu, and X. Cheng (2025b) Video-thinker: sparking" thinking with videos" via reinforcement learning. arXiv preprint arXiv:2510.23473. Cited by: Introduction. W. Wang, Z. He, W. Hong, Y. Cheng, X. Zhang, J. Qi, M. Ding, X. Gu, S. Huang, B. Xu, et al. (2025c) Lvbench: an extreme long video understanding benchmark. In Proceedings of the IEEE/CVF International Conference on Computer Vision, p. 22958–22967. Cited by: Benchmarks.. X. Wang, Y. Zhang, O. Zohar, and S. Yeung-Levy (2024) VideoAgent: long-form video understanding with large language model as agent. External Links: 2403.10517, Link Cited by: Table 1. Z. Wang, S. Yu, E. Stengel-Eskin, J. Yoon, F. Cheng, G. Bertasius, and M. Bansal (2025d) VideoTree: adaptive tree-based video representation for llm reasoning on long videos. In Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR), p. 3272–3283. Cited by: Long Video Understanding, Table 1. H. Wu, D. Li, B. Chen, and J. Li (2024) LongVideoBench: a benchmark for long-context interleaved video-language understanding. External Links: 2407.15754, Link Cited by: Benchmarks.. Z. Wu, C. Xiong, C. Ma, R. Socher, and L. S. Davis (2019) Adaframe: adaptive frame selection for fast video recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 1278–1287. Cited by: Adaptive Computation and Early-Exit Mechanisms. H. Yan, H. Zhou, P. Xu, X. Feng, and M. Liu (2026) Symphony: a cognitively-inspired multi-agent system for long-video understanding. External Links: 2603.17307, Link Cited by: Tool-Augmented and Agentic VLMs. Z. Yan, X. Li, Y. He, Z. Yue, X. Zeng, Y. Wang, Y. Qiao, L. Wang, and Y. Wang (2025) VideoChat-r1.5: visual test-time scaling to reinforce multimodal reasoning by iterative perception. arXiv preprint arXiv:2509.21100. Cited by: Table 1. X. Yang, W. Zhang, H. Jin, L. Liu, H. Xu, Y. Nie, F. Yu, and F. Ma (2025a) Enhancing long video question answering with scene-localized frame grouping. arXiv preprint arXiv:2508.03009. Cited by: Long Video Understanding. Z. Yang, S. Wang, K. Zhang, K. Wu, S. Leng, Y. Zhang, B. Li, C. Qin, S. Lu, X. Li, and L. Bing (2025b) LongVT: incentivizing "thinking with long videos" via native tool calling. arXiv preprint arXiv:2511.20785. Cited by: Training Data., Introduction, Introduction, Tool-Augmented and Agentic VLMs, Training-Free Scaling with Backbone Improvements, Table 1, Main Results. Y. Yin, Y. Xing, Q. Meng, M. Chen, Y. Yang, and Z. Yu (2026) Progressive video condensation with mllm agent for long-form video understanding. External Links: 2604.02891, Link Cited by: Tool-Augmented and Agentic VLMs. H. Yuan, Z. Liu, J. Zhou, H. Qian, Y. Shu, N. Sebe, J. Wen, and Z. Dou (2025) VideoExplorer: think with videos for agentic long-video understanding. External Links: 2506.10821, Link Cited by: Tool-Augmented and Agentic VLMs. B. Zhang, K. Li, Z. Cheng, Z. Hu, Y. Yuan, G. Chen, S. Leng, Y. Jiang, H. Zhang, X. Li, P. Jin, W. Zhang, F. Wang, L. Bing, and D. Zhao (2025a) VideoLLaMA 3: frontier multimodal foundation models for image and video understanding. arXiv preprint arXiv:2501.13106. External Links: Link Cited by: Table 1. H. Zhang, X. Gu, J. Li, C. Ma, S. Bai, C. Zhang, B. Zhang, Z. Zhou, D. He, and Y. Tang (2025b) Thinking with videos: multimodal tool-augmented reinforcement learning for long video reasoning. arXiv preprint arXiv:2508.04416. Cited by: Introduction, Tool-Augmented and Agentic VLMs, Training-Free Scaling with Backbone Improvements. J. Zhang, J. Huang, S. Jin, and S. Lu (2024) Vision-language models for vision tasks: a survey. IEEE transactions on pattern analysis and machine intelligence 46 (8), p. 5625–5644. Cited by: Long Video Understanding. Y. Zhang, J. Wu, W. Li, B. Li, Z. Ma, Z. Liu, and C. Li (2025c) LLaVA-video: video instruction tuning with synthetic data. External Links: 2410.02713, Link Cited by: Table 1. Y. Zheng, R. Zhang, J. Zhang, Y. Ye, and Z. Luo (2024) Llamafactory: unified efficient fine-tuning of 100+ language models. In Proceedings of the 62nd annual meeting of the association for computational linguistics (volume 3: system demonstrations), p. 400–410. Cited by: Base Model., Training-Free Scaling with Backbone Improvements. Y. Zhong, Z. Liu, Y. Li, and L. Wang (2025) Aim: adaptive inference of multi-modal llms via token merging and pruning. In Proceedings of the IEEE/CVF International Conference on Computer Vision, p. 20180–20192. Cited by: Adaptive Computation and Early-Exit Mechanisms. J. Zhou, Y. Shu, B. Zhao, B. Wu, Z. Liang, S. Xiao, M. Qin, X. Yang, Y. Xiong, B. Zhang, T. Huang, and Z. Liu (2025) MLVU: benchmarking multi-task long video understanding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), p. 13691–13701. Cited by: Introduction, Benchmarks.. Supplementary Material A Training Details of Qwen3-VL-SFT Base Model. We fine-tune Qwen3-VL-8B-Instruct (Bai et al. 2025a) as the backbone using the LLaMA-Factory (Zheng et al. 2024) framework for one epoch. Training Data. Following LongVT (Yang et al. 2025b), we construct our SFT training mixture from the tool-free portion of its publicly released SFT data. Specifically, we retain only samples without external tool calls and use three major chain-of-thought sources: LongVideo-Reason CoT, Video-R1 CoT, and image-based CoT instruction data. In our final training split, this yields approximately 228.8K samples in total, including 5,238 samples from LongVideo-Reason CoT, 165,575 samples from Video-R1 CoT, and 58,022 samples from image-based CoT data. This construction follows the data recipe of LongVT while excluding tool-augmented trajectories, allowing us to isolate the effect of reasoning-oriented supervision without introducing explicit tool-use annotation. Hyperparameters. Key training hyperparameters are listed in Table 6. Table 6: Training hyperparameters for Qwen3-VL-SFT. Hyperparameter Value Base model Qwen3-VL-8B-Instruct Fine-tuning type Full-parameter SFT Training epochs 1 Learning rate 1.0×10−51.0× 10^-5 Effective batch size 16 Max sequence length 10240 tokens Warmup ratio 0.1 LR scheduler cosine Precision bfloat16 Hardware 8× PPU-ZW810E (96GB) Data Preprocessing. Video frames are uniformly sampled at 1.0 fps before tokenization. The maximum video length is set to 4096 frames. Inputs exceeding the maximum context length are truncated. We use a maximum visual resolution of 262,144 pixels for images and 65,536 pixels for video frames. B Case Study We present two representative cases in Figure 6 to illustrate the adaptive routing behavior of CADER across different difficulty levels. Figure 6: Case study of CADER on two representative samples. (a) Easy case: Stage 1 exits early with high confidence (M=0.999≥τ=0.97M=0.999≥τ=0.97), correctly answering without invoking Stage 2. (b) Hard case: Stage 1 produces an incorrect low-confidence prediction (M=0.056M=0.056). Stage 2 first proposes [2100s,2130s][2100s,2130s] (Pyes=0.378P_yes=0.378), then refines it to [2300s,2330s][2300s,2330s], which is accepted (Pyes=0.679P_yes=0.679), leading to the correct answer. (a) Easy Case: Stage 1 Early Exit. Stage 1 samples sparse frames and produces a highly confident prediction with M=0.999M=0.999, exceeding the threshold τ=0.97τ=0.97. The model directly answers the question based on global semantic understanding without invoking Stage 2. This case demonstrates that CADER can handle simple queries via early exit without invoking Stage 2. (b) Hard Case: Stage 2 with Iterative Refinement. Stage 1 yields a low-confidence prediction (M=0.056<τM=0.056<τ), resulting in an incorrect answer. CADER then activates Stage 2 for tool-augmented reasoning. An initial temporal proposal [2100s,2130s][2100s,2130s] is generated but rejected by the verifier (Pyes=0.378P_yes=0.378). After one round of reflection, a refined proposal [2300s,2330s][2300s,2330s] is produced and accepted with higher confidence (Pyes=0.679P_yes=0.679). Dense reasoning over this segment successfully recovers the correct answer. Discussion. These cases highlight the key advantage of CADER: it routes samples according to prediction confidence. Easy samples exit after Stage 1, while more challenging ones benefit from iterative grounding and verification, leading to improved accuracy. C Prompt Templates We provide the complete prompt templates used in each stage of CADER. Placeholders in curly braces (e.g., question) are filled with the corresponding inputs at inference time. C.1 Stage 1: Global Reasoning Stage 1 — System Prompt You are a video question answering assistant. Watch the video carefully and answer the multiple-choice question. Output ONLY a single capital letter corresponding to your answer. No explanation. No punctuation. Nothing else. Stage 1 — User Prompt Question: question Options: options Answer: Chain-of-thought is disabled (enable_thinking=False) to minimize latency. The logit probability of each option token is extracted to compute the margin M=Ptop1−Ptop2M=P_top1-P_top2. C.2 Stage 2: Temporal Segment Proposal Temporal Grounding — System Prompt You are a video temporal grounding assistant. Your task is to identify the time window in the video that contains the key visual evidence to answer the given multiple-choice question. Output ONLY a single window in JSON format. Do NOT include explanations or multiple windows. Temporal Grounding — User Prompt (First Proposal) Question: question Options: options The video is duration seconds long. Identify the time window containing the visual evidence that distinguishes between the options above. The window must be at least min_crop seconds wide. After thinking, output your answer in this format: "relevant_windows": [["<start_seconds>", "<end_seconds>"]] Temporal Grounding — User Prompt (Reflection) The following time windows have already been tried and failed: tried_ranges Please identify a different time window that is less likely to overlap with the above. Pick ONLY ONE single time window. The video is duration seconds long. The window must be at least min_crops wide. Question: question Options: options After thinking, output your answer in this format: "relevant_windows": [["<start_seconds>", "<end_seconds>"]] The reflection prompt (orange box) replaces the first-proposal prompt when previously attempted intervals exist, enabling spatio-temporal exclusion. Chain-of-thought is enabled (enable_thinking=True). C.3 Verifier Prompt The verifier (Qwen3-VL-4B-Instruct) receives the cropped video segment and the following prompt. PyesP_yes is extracted from the token probability of Yes. Verifier — System Prompt You are a video question answering assistant. Watch the video carefully and answer the multiple-choice question. Verifier — User Prompt Does this video clip contain relevant visual evidence for answering the question below? Question: question Options: options Answer Yes or No only. C.4 Stage 2: Final Reasoning Final Reasoning — System Prompt You are a video question answering assistant. Watch the video carefully and answer the multiple-choice question. Final Reasoning — User Prompt This is the most relevant segment of the video (start_ts ∼ end_ts). Watch it carefully and answer the question. Question: question Options: options After thinking, output your answer in this format: <answer>X</answer> Where X is a single capital letter: valid_letters. Chain-of-thought is enabled (enable_thinking=True) for deliberate reasoning over the localized clip. The answer is extracted via structured parsing of the <answer> tag, with a single-letter fallback. D Reflection Depth Analysis To understand the contribution of the iterative reflection mechanism, we analyze LVBench samples that enter Stage 2 and execute at least one crop-and-verify cycle, stratified by iteration depth. For each such sample, the depth d∈1,2,3d∈\1,2,3\ denotes how many crop-and-verify cycles were executed before the verifier either accepted a segment (Pyes≥δP_yes≥δ) or exhausted the two-reflection budget (K=2K=2), which permits at most three crop-and-verify cycles. Results are shown in Table 7. Table 7: Stage 2 accuracy vs. Stage 1 baseline on LVBench. Depth Samples Stage-1 Base Final Acc 1 (0 reflections) 327 41.59% 50.15% +8.6+8.6 2 (1 reflection) 111 35.14% 51.35% +16.2+16.2 3 (2 reflections) 757 37.38% 37.91% +0.5+0.5 Depth 1 and depth 2 samples obtain substantial improvements over their Stage 1 baselines, with gains of +8.6+8.6 and +16.2+16.2 points, respectively. The stronger gain at depth 2 shows that one reflection step can recover from initial temporal grounding failures and redirect the search toward more relevant evidence. At depth 3, the aggregate gain is smaller because most samples reach the maximum search depth, exhaust the reflection budget, and conservatively fall back to the Stage 1 prediction. Accordingly, the aggregate gain at this depth is limited. This result indicates diminishing returns at the maximum reflection depth. In the w/o Reflection variant (K=0K=0), samples that require later reflection steps are not refined further and therefore fall back to their Stage 1 predictions. The resulting accuracy is reported in the main paper; the per-depth statistics above explain the observed drops to 48.6%48.6\% on LVBench and 58.9%58.9\% on VideoMME (Long). E Pseudocode We provide the complete pseudocode of CADER and Relevance-Guided Resampling (RGR) for reproducibility. Algorithm 1 Dual-Stage Adaptive Evidence Reasoning (CADER) 1:Video V, Question Q, Options Oi\O_i\ 2:Answer A 3: 4:Stage 1: Global Preliminary Reasoning 5:F1←ConstantRateSample(V,r1=1.0fps)F_1 (V,\;r_1=1.0\,fps) 6:zi←MainVLM(F1,Q)\z_i\ (F_1,Q) 7:Pi←Softmax(zi/T)P_i (z_i/T), T=2.0T=2.0 8:M←Ptop1−Ptop2M← P_top1-P_top2 9:A1←argmaxiPiA_1← _iP_i 10:if M≥τM≥τ then ⊳ τ=0.97τ=0.97; early exit 11: return A1A_1 12:end if 13: 14:Stage 2: Tool-assisted Fine-grained Reasoning 15:←∅S← ; tried←∅tried← ; Fcur←F1F_cur← F_1; iter←0iter← 0 16:while iter≤Kiter≤ K do ⊳ K=2K=2 reflection rounds; at most K+1K+1 attempts 17: [ts,te]←ProposeInterval(Fcur,Q,tried)[t_s,t_e] (F_cur,Q,tried) ⊳ use F1F_1 at iter=0=0, FreflectF_reflect thereafter 18: if IsTooBroad(ts,te,V)IsTooBroad(t_s,t_e,V) then 19: return A1A_1 ⊳ return cached Stage 1 prediction 20: end if 21: C←crop_video(V,ts,te)C← crop\_video(V,t_s,t_e) 22: r2←clip(512/(te−ts), 1.0, 8.0)r_2 (512\,/\,(t_e-t_s),\;1.0,\;8.0) 23: F2←Sample(C,r2)F_2 (C,r_2) 24: Pyes←SmallVLMverifier(F2,Q)P_yes _verifier(F_2,Q) 25: f(iter)←min(1.0,Pyes+fmin)f^(iter)← (1.0,\;P_yes+f_ ) 26: ←∪(ts,te,f(iter))S ∪\(t_s,t_e,f^(iter))\ 27: if Pyes≥δP_yes≥δ then ⊳ δ=0.60δ=0.60; segment accepted 28: A←MainVLM(F2,Q)A (F_2,Q) 29: return A 30: end if 31: tried←tried∪[ts,te]tried ∪\[t_s,t_e]\ 32: if iter=Kiter=K then 33: break ⊳ reflection budget exhausted 34: end if 35: ←RGR-Fuse()P -Fuse(S) ⊳ build per-segment fps map 36: Freflect←RGR-Sample(V,,r1=1.0)F_reflect -Sample(V,P,r_1=1.0) 37: Fcur←FreflectF_cur← F_reflect ⊳ update context for next proposal 38: iter←iter+1iter +1 39:end while 40:return A1A_1 ⊳ return cached Stage 1 prediction; no extra VLM call Algorithm 2 Relevance-Guided Resampling (RGR) 1:Scored segments =(ts(k),te(k),f(k))S=\(t_s^(k),t_e^(k),f^(k))\, video V with duration D, base fps r1r_1 2:Resampled frame sequence FreflectF_reflect 3:// Step 1: Collect breakpoints and build non-overlapping map 4:ℬ←sort(⋃kts(k),te(k))B \! ( _k\t_s^(k),\,t_e^(k)\ ) 5:←∅P← 6:for i=0i=0 to |ℬ|−2|B|-2 do 7: bs←ℬ[i]b_s [i]; be←ℬ[i+1]b_e [i+1] 8: k∗←argmaxkk∣ts(k)≤bs∧te(k)≥bek^*← _k\k t_s^(k)≤ b_s t_e^(k)≥ b_e\ 9: f[bs,be]←f(k∗)f_[b_s,b_e]← f^(k^*) 10: ←∪(bs,be,f[bs,be])P ∪\(b_s,\,b_e,\,f_[b_s,b_e])\ 11:end for 12:Merge adjacent entries in P with equal fps 13:// Step 2: Resample explored regions at reduced rates 14:Freflect←[]F_reflect←[\ ] 15:for (bs,be,fi)∈(b_s,b_e,f_i) do 16: ni←⌊(be−bs)×fi⌋n_i← (b_e-b_s)× f_i 17: Freflect.append(Sample(V[bs:be],ni))F_reflect.append\! (Sample(V[b_s:b_e],\,n_i) ) 18:end for 19:// Step 3: Resample unexplored regions at base rate 20:←[0,D]∖⋃(bs,be,⋅)∈[bs,be]U←[0,D] _(b_s,b_e,·) [b_s,b_e] 21:for [us,ue]∈[u_s,u_e] do 22: Freflect.append(Sample(V[us:ue],r1))F_reflect.append\! (Sample(V[u_s:u_e],\,r_1) ) 23:end for 24:Sort FreflectF_reflect by timestamp 25:return FreflectF_reflect