Paper deep dive
Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluation
Yifei Xue, Yuanchen Fei, Hao Zhang, Chenzhi Nie, Tie ji, Yizhen Lao
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Recently, AI-driven video generation has attracted considerable attention. This surge increases the demand for reliable video quality assessment (VQA) metrics to evaluate AI-generated content (AIGC) videos and guide model optimization. Existing studies assess video quality through visual harmony, video-text consistency, and domain-specific alignment, yet lack quantitative metrics for measuring fidelity to physical laws. To address this limitation, we present a novel benchmark that evaluates the quality of AIGC videos based on their compliance with physical principles by quantitatively measuring geometric consistency across frames extracted from generated sequences. This serves as a proxy for estimating the extent to which generated videos conform to real-world physical rules. Specifically, GeoCon-Bench captures global motion through translation estimation, fits homography or fundamental matrix models using background correspondences, and reports complementary metrics, including inlier ratio and geometric error. We also release a dataset containing 20 scenes across six motion categories. Experiments on state-of-the-art AIGC models demonstrate the reliability of GeoCon-Bench as a video quality assessment metric.
Tags
Links
- Source: https://arxiv.org/abs/2608.09594v1
- Canonical: https://arxiv.org/abs/2608.09594v1
Trouble viewing inline? Open PDF directly â
Full Text
115,572 characters extracted from source content.
Expand or collapse full text
Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluation Yifei Xue Hunan UniversityChina , Yuanchen Fei Hunan UniversityChina , Hao Zhang Hunan UniversityChina , Chenzhi Nie Hunan UniversityChina , Tie Ji Hunan UniversityChina and Yizhen Lao Hunan UniversityChina (5 June 2009) Abstract. Recently, AI-driven video generation has attracted considerable attention. This surge increases demand for reliable video quality assessment (VQA) metrics to assess AI-generated content (AIGC) videos and guide model optimization. Existing work examines VQA via visual harmony, videoâtext consistency, and domain-specific alignment, yet lacks quantitative metrics for fidelity to physical laws. To address this limitation, we present a novel benchmark that evaluates the quality of AIGC videos through their compliance with physical principles, achieved by quantitatively measuring the geometrical consistency across frames extracted from the generated sequences, thus as a proxy to gauge the extent to which the generated videos conform to real-world physics rules. Specifically, GeoCon-Bench gates global motion via translation estimates, fits a homography or fundamental matrix to background correspondences, and reports complementary metrics (inlier ratio, geometric error). We also release a dataset of 20 scenes across six motion categories. Experiments on state-of-the-art AIGC models demonstrate GeoCon-Benchâs reliability as a video quality metric. T2V, AIGC, multi-view geometry, 3D reconstruction â copyright: acmlicensedâ journalyear: 2018â doi: X.Xâ conference: Make sure to enter the correct conference title from your rights confirmation email; June 03â05, 2018; Woodstock, NYâ isbn: 978-1-4503-X-X/2018/06â ccs: Do Not Use This Code Generate the Correct Terms for Your Paperâ ccs: Do Not Use This Code Generate the Correct Terms for Your Paperâ ccs: Do Not Use This Code Generate the Correct Terms for Your Paperâ ccs: Do Not Use This Code Generate the Correct Terms for Your Paper Figure 1. To quantify how well AIGC-generated videos preserve physical-world geometry, we introduce GeoCon-Bench, a model-agnostic evaluation framework grounded in multiview geometry and optical-flow analysis. The figure shows (top) a generated camera sweep; (right) representative failure modes; and (bottom) the theoretical cornerstones we use. GeoCon-Bench scores clips via homography/fundamental-matrix metrics for rigid backgrounds and flow-based tests for dynamic regions, enabling reproducible auditing of geometric consistency. 1. Introduction Generative video offers a tantalizing pathway to lower the cost and latency of 3D asset creation (Mildenhall et al., 2021; Kerbl et al., 2023). Rather than capturing calibrated footage and running bespoke reconstruction pipelines, practitioners could in principle feed an idealized video to a reconstruction system and obtain geometry ready for downstream use. Yet this promise is ultimately gated by photogrammetry and multi-view geometry (Hartley and Zisserman, 2004): usable parallax, consistency with either homography or epipolar structure, and coherent occlusion handling are prerequisites, not niceties. When those prerequisites fail, error cascades are immediate and practicalâpoint clouds fragment or rubber-sheet, camera poses drift, novel views shear, and AR overlays refuse to lockâeven though the sequence may still look plausible to the eye (Jang et al., 2025; Kamali et al., 2025). Recent progress in diffusion/transformer generators (Bar-Tal et al., 2024; Kondratyuk et al., 2023; Vaswani et al., 2017; Dosovitskiy et al., 2020; Ho et al., 2020) increases perceptual quality but does not guarantee photogrammetric validity (Heusel et al., 2017; Unterthiner et al., 2018; Zhang et al., 2018; Peebles and Xie, 2023; Chu et al., 2020). Accordingly, the value proposition of video-to-3D is determined not by aesthetics or prompt adherence, but by geometric reliability (Schonberger and Frahm, 2016). Perceptual plausibility â photogrammetric correctness (Wang et al., 2004; Huang et al., 2024a, b). Contemporary systems can score well on perceptual or distributional metrics while systematically violating multi-view constraints. Typical failure modes that matter for reconstruction include: (i) background slide where planar regions move inconsistently with the camera; (i) rubber-sheet warps that break the assumption of a single rigid background model; and (i) inconsistent scaleâdepth relations across time that a bundle adjuster cannot reconcile. These violations have been documented both qualitatively and quantitatively in generative pipelines (Sarkar et al., 2024), and they are fatal for multi-view reconstruction, pose estimation, and novel-view synthesis (NVS). Mainstream evaluation emphasizes pixel fidelity, learned perceptual similarity, distributional distances, semantics, or composite leaderboards (Huang et al., 2024a, b; Fan et al., 2023; Liu et al., 2024b, a; Zhang et al., 2025; Qu et al., 2024; Duan et al., 2025). While valuable for breadth, such axes are insensitive to multi-view geometric validity, especially in real-data settings where ground truth (GT) is unavailable. In practical platform comparisons, GT is usually absent: real camera trajectories and scene geometry are proprietary or intractable to share; generated videos often have no physical camera at all; and synthetic GT, while useful scientifically, can misalign with deployment distributions and sensors, confounding cross-platform conclusions. Therefore, the community lacks a GT-free, photogrammetry-aligned, auditable protocol that can be reproduced across generators and data regimes. Hence, we derive four design requirements for a practical geometry-consistency protocol: R1 Regime awareness: background modeling must switch between homography and fundamental descriptions based on translation evidence; R2 Backgroundâdynamic disentanglement: rigid backgrounds and moving/non-rigid regions obey different assumptions and must be scored against different objectives; R3 GT-free feasibility: every stage must operate without GT, so that results are reproducible across platforms and datasets; R4 Auditability and comparability: decisions and scores must be traceable (with gate rationales, inlier diagnostics, and threshold sensitivity) so platform-level comparisons are defensible. We propose a unified, GT-free protocol that (i) extracts translation evidence from pose logs to gate the background model, (i) fits the model with calibrated dual thresholds tailored to each residual family, (i) scores dynamic regions separately via an optical-flow-guided measure, and (iv) logs diagnostics for auditability. Concretely, a gate variable ÎłtâH,F _t\!â\!\H,F\ selects a homography when translation is negligible and a fundamental model otherwise. For background matches, we compute IRH,GEHIR_H,GE_H under a homography residual with threshold ÏH _H and IRF,GEFIR_F,GE_F under an epipolar/Sampson residual with threshold ÏF _F, explicitly allowing ÏHâ ÏF _H\!â \! _F because the two residual families have different statistical scales. We accompany indicators with thresholdâscore sensitivity scans and percentile alignment to ensure cross-platform interpretability. Dynamic/non-rigid pixels are evaluated with a flow-guided measure (e.g., AdaDFRC-W2): forcing them into H/F would pollute inlier sets, destabilize robust fitting, and render IR/GE less diagnostic of background validity. The protocol logs gate rationales, inlier maps, thresholdâscore curves, and pose-log vs. fit sanity checks to support reproducible, inspector-friendly audits. To our knowledge, this is the first GT-free, regime-aware, photogrammetry-aligned evaluation protocol for AIGC videos that is auditable across platforms. To summarize, our contributions are threefold: âą We introduce the first GT-free, regime-aware, and photogrammetry-aligned evaluation framework GeoCon-Bench for AIGC videos that supports auditable, cross-platform assessments. âą We design a translation-gated framework that adaptively selects between homography and fundamental modeling, proposes calibrated dual-threshold indicators for background consistency, and introduces AdaDFRC-W2, a Wasserstein-2 regional flow-consistency metric for robust evaluation of dynamic content. âą We release auditing assets including lightweight logs, coverage statistics, score curves, and a dedicated benchmark dataset that spans diverse scenes and motion regimes, enabling reproducible and inspector-friendly audits. GeoCon-Bench will be publicly available after acceptance. 2. Related Works Mainstream evaluation familiesâpixel fidelity (PSNR/SSIM) (Wang et al., 2004), learned perceptual similarity (LPIPS) (Zhang et al., 2018), distributional distances (FID/FVD) (Unterthiner et al., 2019), semantic/prompt alignment (CLIP) (Hessel et al., 2021; Radford et al., 2021), and composite leaderboardsâprovide breadth but are largely insensitive to multi-view geometric validity, particularly under GT-free conditions (Huang et al., 2024a, b). Their objectives emphasize local textures, global feature statistics, or textâimage agreement, not whether homography/epipolar relations hold across viewpoints. As diffusion/transformer generators improve perceptual quality (Peebles and Xie, 2023; Chu et al., 2020; Wang et al., 2025; Ma et al., 2024), such blind spots become consequential: videos may look convincing yet remain unusable for 3D reconstruction, degrading pose estimation, bundle adjustment, and novel-view synthesis. Recent multi-objective video benchmarks broaden axes (aesthetics, prompt adherence, temporal smoothness), but typically do not enforce photogrammetric constraints on real data without ground truth (Huang et al., 2024a, b; Jiang et al., 2024). Our work complements this breadth with explicit, photogrammetry-aligned checks that are feasible and auditable in GT-free settings. Photogrammetry and multi-view geometry formalize how scene structure and camera motion are recovered from image correspondences; practical pipelines rely on correspondence quality (inlier ratios), geometric residuals (reprojection or epipolar/Sampson) (Hartley and Zisserman, 2004; Fathy et al., 2011), robust model fitting, and bundle adjustment (Fischler and Bolles, 1981; Torr and Zisserman, 2000; Chum and Matas, 2005; Chum et al., 2003; Lebeda et al., 2012). However, thresholds inside these systems are typically tuned for optimization stability on particular datasets rather than for cross-platform comparability and auditability. Crucially, the appropriate background model depends on camera motion: negligible translation (NistĂ©r, 2004) supports a homography on planar/parallax-free backgrounds, whereas observable translation calls for epipolar geometry on backgrounds with depth variation. Modern monocular multi-view methods (e.g., DUSt3R) expose pose logs that can be repurposed as translation evidence to inform such regime choices (Wang et al., 2024). We build on these signals but reframe them as comparable indicators by (i) tying regime selection to translation evidence and (i) calibrating dual thresholds (ÏH,ÏF)( _H, _F) for model-appropriate residual families with sensitivity analyses, so reported IR/GE are interpretable across generators and datasets. Moving or deforming content violates rigid-background assumptions; if dynamic pixels are forced into homography/fundamental fitting, they pollute inlier sets, destabilize robust estimation, and reduce the diagnostic power of IR/GE for the background. Optical flow and occlusion reasoning directly probe motion plausibility, deformation continuity, and disocclusion behavior (Teed and Deng, 2020; Sun et al., 2018; Xu et al., 2022), properties that matter for structure-from-motion (ĂzyeĆil et al., 2017) and view synthesis. In the generative setting, dynamics can be perceptually plausible while geometrically inconsistent across frames (e.g., flow fields that ignore parallax or violate occlusion ordering) (Sarkar et al., 2024). We therefore separate background rigidity from dynamic coherence: H/F-based indicators summarize whether a single rigid model explains the background, while a flow-guided score targets non-rigid and occlusion dynamics. This separation is methodological rather than cosmetic, preserving interpretability and avoiding mixed-objective confounds. GT-free or weakly supervised evaluations are standard in perceptual quality assessment, but GT-free geometry-aware protocols remain scarce for platform-level comparisons. Two challenges recur: defensibility of decisions (e.g., why a particular regime/threshold) and traceability of results (e.g., whether scores are stable across thresholds/unseen scenes). In practice, GT is usually unavailable because real camera trajectories and scene geometry are proprietary, intractable to share, or nonexistent for generated videos. Synthetic GT, while scientifically useful, often misaligns with deployment distributions and sensor data. We address these challenges by (i) grounding regime selection in pose-log translation evidence with sanity checks against fitted geometry, (i) releasing thresholdâscore sensitivity scans and percentile-aligned summaries to ensure comparability, and (i) logging inlier coverage and robust clip-level aggregation to make audits reproducible across systems. Recent studies document how generative pipelines can violate physical/geometric constraints despite high perceptual scores (Sarkar et al., 2024), while multi-objective benchmarks emphasize user-perceived axes over explicit multi-view validity (Huang et al., 2024a, b). We bridge these trajectories: retaining GT-free feasibility and breadth, but injecting photogrammetry-aligned checks that are auditable and reproducible. This reframes evaluation around practitioner questions: Will this video support reconstruction? If not, where does geometry fail, and are failures systematic across content and generators? Prior work provides broad perceptual/semantic coverage and mature geometric estimators, but stops short of an integrated, GT-free standard that enforces multi-view validity while preserving auditability. We next formalize the latent construct and observable indicators in a concept layer, then instantiate the protocol and diagnostics in §4. 3. Concept 3.1. Construct, scope, and contextual factors We treat geometry consistency as a latent construct with two facets: background rigidity and dynamic-region coherence. Perceived salience of a specific residual depends on contextual factors, including scene depth span, planarity, edge density, motion spectrum, and occlusion complexity (Teed and Deng, 2020; Sun et al., 2018; Xu et al., 2022). Consequently, indicators must be interpretable under diverse conditions and aggregated robustly over time. The construct is operationalized without ground truth (GT-free) (Huang et al., 2024a, b) by checking self-consistency with photogrammetric constraints and by leveraging pose logs (Wang et al., 2024) as auxiliary evidence. 3.2. Regime-aware prior Let It,It+1I_t,I_t+1 be consecutive frames with background matches (i,i)i=1Nb\(x_i,y_i)\_i=1^N_b and a background mask âłbM_b. From pose logs (e.g., DUSt3R) we obtain a translation proxy Ït _t (Wang et al., 2024) and define a gate (1) ÎłtâH,F,Îłt=Hif âÏt<Ïgate,Fotherwise. _tâ\H,F\, _t= casesH&if _t< _gate,\\[2.0pt] F&otherwise. cases When Îłt=H _t=H we fit a homography matrix tH_t to background correspondences; when Îłt=F _t=F we fit a fundamental matrix (Hartley and Zisserman, 2004) tF_t. This prior encodes standard photogrammetric practice: homographies capture planar or parallax-free backgrounds under negligible translation, whereas epipolar geometry governs backgrounds with depth variation under translation. 3.3. Dual-threshold indicators for background rigidity For a candidate model gtât,tg_tâ\H_t,F_t\, let ei(g)e_i^(g) denote a model-appropriate residual. In our research, we utilize symmetric transfer error for tH_t, and Sampson/epipolar approximation for tF_t. Because these residual families have different statistical scales and tails, we calibrate dual thresholds (ÏH,ÏF)( _H, _F) rather than forcing a single cutoff. Define the inlier set (2) Ï(g)=iââłb|ei(g)â€Ï,S^(g)_Ï= \\,i _b\; |\;e_i^(g)â€Ï\, \, and report two indicators (Chum and Matas, 2005; Torr and Zisserman, 2000): (3) IRH=|ÏH()|Nb,GEH=medianâĄei():iâÏH();IRF=|ÏF()|Nb,GEF=medianâĄei():iâÏF().IR_H= |S^(H)_ _H|N_b, _H=median\\,e_i^(H):i ^(H)_ _H\,\; _F= |S^(F)_ _F|N_b, _F=median\\,e_i^(F):i ^(F)_ _F\,\. IR answers whether a single rigid model explains the background at step t; GE answers how tightly the consistent matches align when it does. To ensure cross-platform interpretability, we accompany each report with thresholdâscore sensitivity scans over a grid of (ÏH,ÏF)( _H, _F) and with percentile-aligned summaries, mitigating absolute-scale differences across residual families and datasets. See §6.2 for thresholdâscore sensitivity scans, stability bands, and coverage definitions. 3.4. Why dynamics require a separate metric Dynamic or non-rigid pixels on a moving object always violate the rigid-scene assumptions. Thatâs why including them in H/F fitting (i) corrupts inlier sets, (i) destabilizes robust estimation, and (i) degrades the diagnostic value of IR/GE for the background. Conversely, judging dynamics by background residuals rewards trivial solutions (e.g., shrinking inlier sets) and unfairly penalizes scenes with legitimate motion. We therefore adopt a flow-guided dynamic score to capture motion plausibility, deformation continuity, and occlusion ordering: (4) Dynt=RobAggâĄ(wiââ^iâiâ2;iââłd),Dyn_t\;=\;RobAgg (w_i\, \| u_i-u_i \|_2\;;\;i _d ), where âłdM_d is the dynamic-region mask, iu_i is measured optical flow, ^i u_i is expected motion under consistency priors, wiw_i down-weights unreliable/occluded pixels, and RobAggRobAgg denotes a robust aggregator. We instantiate this metric with an adaptive Wasserstein-2 (Dukler et al., 2019) regional formulation (AdaDFRC-W2) in §4, which aggregates local motion-pattern discrepancies with occlusion-aware weighting. This score is complementary to background indicators: H/F-based IR/GE certify rigid-scene adequacy, while DynDyn certifies that moving/occluding content evolves plausibly. 3.5. Intended use, GT-free positioning, and boundaries Our protocol is an engineering QA baseline for model comparison, regression testing, and content-side risk triage under GT-free conditions. It complements human-subject studies rather than replacing them by enforcing photogrammetric validity without GT (Li et al., 2025; Murai et al., 2025). It provides a reproducible floor upon which subjective evaluation can build. Beyond the practical unavailability of GT in platform settings, GT-free protocols allow cross-platform comparisons on real data without disclosing proprietary trajectories or geometry and avoid mismatches introduced by synthetic GT. By aligning to photogrammetric self-consistency and releasing audit artifacts, we retain a hard, reproducible constraint that generalizes across devices, content, and generators. Typical uses include (i) cross-generator comparisons with regime-stratified breakdowns; (i) pipeline regression tests where gate agreement and sensitivity curves act as sentinels; and (i) dataset curation by filtering clips with unstable regimes or insufficient background support. Known limitations include specularities, rolling-shutter distortions, extreme motions with low-SNR correspondences, and non-pinhole optics. 4. Methodology Our methodology is designed to quantitatively answer a fundamental question: whether a generated video adheres to the geometric principles of a rigid 3D world observed by a moving camera. The framework operates without ground truth and is built on a core principle we term mask-first, regime-aware geometry. This principle dictates that we must first isolate independently moving objects from the static background (mask-first), and then apply the geometrically appropriate motion model to the background based on the nature of the cameraâs movement (regime-aware). 4.1. Overall Framework Given a generated video sequence Itt=0T\I_t\_t=0^T, our evaluation proceeds in three main stages, as illustrated in Fig. 2: (1) Global Motion Regime Gating: We first determine the dominant camera motion of the input video stream. Specifically, we distinguish between motion that is purely rotational (or static) and motion that includes a translational component. This decision is critical as it dictates which geometric model is appropriate for the background. (2) Foreground/Background Separation: We segment any objects that are moving independently of the cameraâs ego-motion. This creates a clean background mask, ensuring that our analysis of the static sceneâs rigidity is not contaminated by foreground motion. (3) Consistency Evaluation: We apply distinct, specialized metrics to the separated background and foreground regions. The background is evaluated for rigid-body consistency using classical geometric models, while each moving foreground object is evaluated for its internal geometric integrity. Figure 2. Our evaluation workflow. A pose estimator (DUSt3R) determines the camera motion regime to select between a Fundamental Matrix (F) or Homography (H) model. A segmentation model (SAM-2) (Ravi et al., 2024) isolates moving objects. Background consistency is then evaluated on the static regions only, while foreground objects are scored for internal rigidity using AdaDFRC-W2. 4.2. Pose estimation and translation-aware gating In photogrammetry, negligible translation justifies a single-plane/parallax-free background (homography), whereas observable translation requires epipolar geometry (fundamental). We therefore route by a translation-evidence proxy sts_t from pose logs, with a hysteresis band [ÏÏâΔ,ÏÏ+Δ][ _Ï- ,\ _Ï+ ] to avoid flipâflop: Îłt=H _t\!=\!H if st<ÏÏâΔs_t< _Ï- , Îłt=F _t\!=\!F if st>ÏÏ+Δs_t> _Ï+ , and otherwise we keep Îłtâ1 _t-1. To select the correct geometric model for the background, we must first characterize the cameraâs ego-motion. We estimate the relative camera pose (t,t)âSâEâ(3)(R_t,t_t)â SE(3) between frames. Let It,It+1I_t,I_t+1 be adjacent frames. From deep matches âłt,t+1=(xi,xiâČ)i=1NM_t,t+1=\(x_i,x _i)\_i=1^N (pixel coordinates in homogeneous form), we estimate the relative pose (,)âSEâ(3)(R,t)\!â\!SE(3) using DUSt3R or a PnP solver on the same correspondences (Wang et al., 2024). Under DUSt3Râs convention, the scene is normalized to unit scale along principal axes. We declare the pair non-translation-dominant (behaves like pure rotation) when (5) âââmaxâĄ|tx|,|ty|,|tz|â€Ït,Ït=0.04,\|t\|_â\; \; \|t_x|,|t_y|,|t_z|\\;â€\; _t, _t=0.04, and translation-dominant otherwise. The choice of Ït _t follows a first-order pinhole analysis: for a 3D point =(X,Y,Z)TP=(X,Y,Z)^T the translation-induced image displacement satisfies (6) âÎŽâââČfZââââ,\| \|\; \; fZ\,\|t_ \|, with focal length f (in pixels) and translation component ât_ orthogonal to the view. Requiring âÎŽâââ€ÏH\| \|\!â€\! _H (the inlier tolerance of homography fitting, typically âŒ1 \!1 px at our working resolution) yields ââââ€(ÏH/f)âZ\|t_ \|\!â€\!( _H/f)\,Z. With median Zâ1Z\!â\!1 in DUSt3R units and calibrated f, the practical bound âââ€0.04\|t\|_â\!â€\!0.04 keeps âÎŽââ\| \| at the noise floor, so a single homography provides an adequate approximation. To stabilize decisions near the boundary, we adopt a narrow hysteresis in implementation (â€0.03†0.03: homography branch; â„0.05â„ 0.05: fundamental branch); in the gray zone, both models are evaluated, and the one with higher support is selected downstream. Section §6.2 empirically calibrates this gate by a threshold sweep. 4.3. Foreground/Background Separation A core tenet of our method is that the geometric model for camera ego-motion applies only to the static parts of the scene. Therefore, we must first identify and mask out any independently moving objects. Using a video object segmentation model, we generate a set of masks Mtk\M_t^k\ for each moving object k at frame t. The static background mask BtB_t is then defined as the complement of the union of all foreground masks: Bt=1ââkMtkB_t=1- _kM_t^k. All subsequent analysis of the backgroundâs geometric consistency is performed exclusively on feature correspondences found within the regions defined by BtB_t. This âmask-firstâ approach is crucial as it prevents moving objects from corrupting the estimation of the global camera motion model, which would otherwise lead to incorrect evaluations of background stability. 4.4. Background Consistency: IR and GE We assess the behavior of the static background as a single rigid body across consecutive frames by fitting a global geometric model. Specifically, we utilize either a homography H for the planar/rotation regime or a fundamental matrix F for the translation/parallax regime. The analysis is conducted on background-only correspondences, employing a robust estimator. Models are estimated in normalized coordinates for numerical stability and denormalized to pixels for residual evaluation. All residuals are computed on the content mask (letterboxed padding ignored). Unless otherwise specified, frames are 1024Ă7201024Ă720 with letterboxing. Inlier Ratio (IR) is the fraction of background correspondences whose geometric residual falls below the inlier test used by the robust estimator. A high IR indicates that a single rigid transformation explains the majority of the background motion, as expected for static scenes (cf. Fig. 3). Geometric Error (GE) summarizes the accuracy of alignment among the inliers only, reported as the median residual. Thus IR answers âdoes a single global model hold?â, while GE answers âhow tightly do the consistent matches align?â. In our implementation, the same inlier test used during robust estimation is reused to define the inlier set for reporting. Figure 3. Each panel shows two adjacent frames with matched feature correspondences. Left: high IRâmost matches are inliers, indicating a rigid background. Right: low IRâmany outliers, revealing background inconsistency. Homography and epipolar residuals differ in scale and tail behavior; we therefore calibrate dual thresholds (ÏH,ÏF)( _H, _F) rather than forcing a single cutoff. To make platform-level rankings defensible, we accompany per-clip IR/GE with (i) thresholdâscore sensitivity scans over (ÏH,ÏF)( _H, _F) and (i) percentile-aligned summaries (e.g., reporting GEHGE_H at matched IRHIR_H percentiles), which mitigate absolute-scale differences across datasets and generators. Homography case (non-translation regime). In the non-translation regime, we model background motion with a homography tH_t. The error for each correspondence pair (1,2)(x_1,x_2) is evaluated using the symmetric transfer error, which averages the forward and backward projection errors in the pixel domain: (7) ^2=Ïâ(tâ1),^1=Ïâ(tâ1â2),rHsym=12ââ2â^2â2+12ââ1â^1â2, x_2=Ï(H_t\,x_1), x_1=Ï(H_t^-1\,x_2), r_H^sym= 12 \|x_2- x_2 \|_2+ 12 \|x_1- x_1 \|_2, where Ïâ([a,b,c]â€)=[a/c,b/c]â€Ï([a,b,c] )=[a/c,\,b/c] converts from homogeneous to Cartesian coordinates. Using this error metric, the two key consistency scores can be derived. We robustly estimate tH_t (e.g., via PROSAC sampling) by finding the largest set of correspondences that satisfy the inlier condition (8) rHsymâ€ÏH,with âÏH=2.0,px.r_H^sym†_H, _H=2.0,px. The IR is the fraction of correspondences classified as inliers, and the GE is the median symmetric transfer error among these inliers. Fundamental case (translation/parallax regime). The estimation of the fundamental matrix tF_t is highly sensitive to the scale and origin of pixel coordinates. To ensure numerical stability, we follow the standard practice of coordinate normalization. For a given set of N points i=[ui,vi,1]â€\x_i=[u_i,v_i,1] \, we first compute their centroid =[uÂŻ,vÂŻ]â€c=[ u, v] and a scaling factor s=2/dÂŻs= 2/ d, where dÂŻ=1Nââiâ[uiâuÂŻ,viâvÂŻ]â€â2 d= 1N _i\|[u_i- u,v_i- v] \|_2 is the average distance from the centroid. The normalization matrix T is then constructed as: (9) =[s0âsâuÂŻ0sâsâvÂŻ001].T= bmatrixs&0&-s u\\ 0&s&-s v\\ 0&0&1 bmatrix. We compute 1T_1 and 2T_2 for the point sets in each image respectively, yielding normalized coordinates ^1=1â1 x_1=T_1x_1 and ^2=2â2 x_2=T_2x_2. In this normalized space, we fit ^t F_t using a robust estimator (again, PROSAC can be used) exclusively in this normalized space. It finds an optimal normalized fundamental matrix ^t F_t by classifying a correspondence as an inlier if its Sampson distance, computed on normalized data, is below the unitless threshold ÏF=0.1 _F=0.1. The Inlier Ratio (IR) is the fraction of correspondences in this final inlier set (Hartley and Zisserman, 2004; Fathy et al., 2011). Once the inlier set is identified, ^t F_t is transformed back to the original pixel domain via denormalization: (10) t=2â€â^tâ1.F_t=T_2 F_tT_1. Finally, the Geometric Error (GE) is defined as the median of the Sampson distances computed for all inlier pairs. This computation uses their original pixel coordinates (1,2)(x_1,x_2) and the denormalized matrix tF_t: (11) GE=median(1,2)âInliersâ|2â€âtâ1|()12+()22+()12+()22,GE= (x_1,x_2) median \ |x_2^\! F_tx_1| (a)_1^2+(a)_2^2+(b)_1^2+(b)_2^2 \, where =tâ1a=F_tx_1 and =tâ€â2b=F_t^\! x_2. This two-stage process ensures that the inlier selection is robust and independent of image resolution, while the final reported GE remains interpretable in the context of pixel-level deviations. For H we use symmetric transfer error in pixels with threshold ÏH _H; for F we use the normalized Sampson error with threshold ÏF _F (unitless). The dual-threshold design reflects fundamentally different residual scales and avoids ill-posed single-threshold comparisons. IRIR is the fraction of correspondences within the relevant threshold; GEGE is the median residual over inliers. Both metrics use the same per-family threshold to avoid moving standards. For brevity, in (12) we write a generic cutoff ÎŽ which denotes ÏH _H when Îłt=H _t=H and ÏF _F when Îłt=F _t=F. Let tbgC^bg_t be the background correspondences for pair (It,It+1)(I_t,I_t+1). We dispatch to F (translation) or H (non-translation) using a translation surrogate Ï~t Ï_t with threshold ÏÏ _Ï (§4.2). Denote the residual of a match by rir_i (either rHsymr_H^sym or rFr_F). With a single global inlier threshold ÎŽ (pixels), the inlier set and the per-pair metrics are (12) ât=iâtbgâŁriâ€ÎŽ,IRBGâ(t)=|ât||tbg|,GEBGâ(t)=medianâĄriâŁiâât.I_t=\\,i ^bg_t r_iâ€ÎŽ\,\, _BG(t)= |I_t||C^bg_t|, _BG(t)=median\\,r_i i _t\,\. Pairs with too few inliers (e.g., |ât|<30|I_t|<30 due to extreme blur/low texture) are marked invalid and excluded from aggregation. For a clip, we summarize background consistency by robust medians over valid pairs: (13) IRBGclip=mediantâĄ(IRBGâ(t)),GEBGclip=mediantâĄ(GEBGâ(t)).IR_BG^clip=median_t (IR_BG(t) ), _BG^clip=median_t (GE_BG(t) ). Scene-balanced medians and 95% bootstrap CIs are reported across seeds within each category. Within each category (Câ1C1âCâ6C6), we aggregate per-seed clip scores by a scene-balanced median, i.e., each seed (scene) contributes one score with equal weight: m~Câk=mediansâĄ(ms) m_Ck=median_s(m_s). To quantify uncertainty around the median, we report 95% nonparametric bootstrap confidence intervals by resampling seeds with replacement (B=10,000B=10,000 replicates) and taking the 2.5/97.5 percentiles of the bootstrap distribution of m~Câk m_Ck. This avoids distributional assumptions and prevents categories or seeds with more regenerations from dominating the estimate. We use a family-specific inlier gate during robust fitting. Specifically, we use symmetric transfer error with ÏH=2 _H=2 px for a homography situation, and normalized Sampson with ÏF=0.1 _F=0.1 at the fundamental case. At report time, we apply a pixel-domain gate on GE fixed at ÎŽ=3.5ÎŽ=3.5 px. A geometrically consistent background exhibits high IRBGIR_BG and low GEBGGE_BG. Drops in IR indicate that a single global model cannot explain the pair (global inconsistency), while increases in GE at stable IR indicate imprecise alignment among otherwise consistent matches. 4.5. Foreground Consistency: AdaDFRC-W2 Dynamic/non-rigid pixels violate rigid-background assumptions. Including them in H/F fitting (i) pollutes inlier sets, (i) destabilizes robust estimation, and (i) degrades the diagnostic value of IR/GE for the background. Conversely, judging dynamics by background residuals rewards trivial solutions (shrinking inlier sets) and unfairly penalizes legitimate motion. A flow-guided score such as AdaDFRC-W2 directly targets motion plausibility, deformation continuity, and occlusion ordering, complementing IR/GE rather than conflating objectives. To assess the geometric integrity of an individual moving object, which standard metrics fail to capture, we introduce the Adaptive Dense Flow Regional Consistency (AdaDFRC-W2) metric. This metric quantifies how well the internal motion of an object adheres to a rigid or near-rigid transformation, a key property of real-world objects. Theoretical Foundation The core principle of AdaDFRC-W2 is derived from the observation that the motion of a rigid object, when projected onto a 2D image plane under perspective projection, can be locally approximated by a 2D affine transformation. This approximation holds particularly well for objects that are relatively small in the field of view or distant from the camera. Consequently, for a geometrically consistent, rigid moving object, we expect its internal motion fieldâas captured by dense optical flowâto be highly structured and conform well to a single, dominant affine motion model. Any significant deviation from this model indicates non-rigid deformation, which in the context of AIGC, often manifests as generative artifacts like shearing, tearing, or texture âboiling.â AdaDFRC-W2 is designed to measure the magnitude of this deviation precisely. Derivation and Methodology For each independently moving object k, identified by its mask MtkM_t^k at time t, we compute its AdaDFRC-W2 score through a systematic, multi-step process detailed below. This process is designed to be robust and invariant to the objectâs on-screen size and position. (1) Adaptive Grid Normalization: To standardize the analysis regardless of the objectâs scale, we first define a bounding box around the mask MtkM_t^k. This bounding box is then partitioned into a uniform NĂNĂ N grid of cells. This adaptive grid ensures that our analysis has a consistent spatial resolution relative to the object itself. (2) Robust Local Motion Summarization: We compute a dense optical flow field from frame ItI_t to It+1I_t+1 within the objectâs bounding box. For each grid cell (i,j)(i,j), we identify all the object pixels (as defined by MtkM_t^k) that fall within it. A single, robust motion vector i,jââ2v_i,j ^2 is then computed for this cell by taking the median of the flow vectors of all its constituent pixels. The median is chosen for its robustness to outliers, effectively filtering out minor noise in the flow estimation. If a cell contains no object pixels, it is excluded from further analysis. (3) Optimal Affine Model Fitting via Weighted Least-Squares: The central step is to find the single affine transformation that best describes the collection of local motion vectors i,j\v_i,j\. An affine transformation models the motion of a point p as âČ=+p =Ap+b, where A is a 2Ă22Ă 2 matrix representing rotation, scaling, and shear, and b is a 2Ă12Ă 1 translation vector. The motion vector is thus predicted as predâ()=âČâ=(â)â+v_pred(p)=p -p=(A-I)p+b. We formulate this as a weighted least-squares problem. We seek the optimal affine parameters (â,â)(A^*,b^*) that minimize the sum of squared differences between the predicted motion and the observed local motion vectors i,j\v_i,j\. To give more importance to denser parts of the object, each cell (i,j)(i,j) is assigned a weight wi,jw_i,j equal to the number of object pixels it contains. The optimization problem is thus: (14) (â,â)=argâĄmin,ââi,jwi,jââ(i,j+)âi,jâ22(A^*,b^*)= _A,b _i,jw_i,j\|\,(Ap_i,j+b)-v_i,j\,\|_2^2 where i,jp_i,j is the geometric centroid of the grid cell (i,j)(i,j). This is a standard linear least-squares problem that can be solved efficiently in closed form. (4) Score Calculation as Weighted Mean Squared Error (WMSE): The AdaDFRC-W2 score for the object k at time t, denoted t(k)D_t^(k), is defined as the weighted mean squared error (WMSE) of this optimal fit. This value represents the residual, non-affine component of the motion fieldâthe part that cannot be explained by a single rigid transformation. (15) t(k)=âi,jwi,jââ(ââi,j+â)âi,jâ22âi,jwi,jD_t^(k)= _i,jw_i,j\|\,(A^*p_i,j+b^*)-v_i,j\,\|_2^2 _i,jw_i,j A low t(k)D_t^(k) score signifies high internal consistency, indicating that the objectâs motion is well-described by a single affine model, which is characteristic of a rigid body. Conversely, a high score points to significant non-rigid deformation or other structural inconsistencies symptomatic of generative artifacts. The final consistency score for an object instance, (k)S^(k), is computed by averaging t(k)D_t^(k) over its entire visible trajectory. 5. GeoCon-Bench Dataset: A Sophisticated Collection for Geometric Consistency To transition geometric consistency from a qualitative afterthought to a first-class, quantitative evaluation target, we construct GeoCon-Bench, a standard, reusable, and expandable benchmark explicitly tailored to the challenges of geometry consistency among various prompt situations in AIGC videos. It is the first benchmark of its kind to systematically factorize geometric stressors, providing a controlled environment to probe model capabilities beyond semantic and aesthetic appeal. The dataset is designed to (i) rigorously test whether a single rigid motion model can explain frame-to-frame changes, (i) isolate independently moving objects for granular, per-object consistency analysis, and (i) directly align with and validate our translation-aware gating mechanism. 5.1. Design Principles Our benchmark is built on five core principles to ensure fairness, rigor, and utility: âą Geometry-first, not aesthetics: Prompts and scenes are constructed to emphasize camera motion, scene structure, and object rigidity over complex textures or artistic styles. This prevents models from hiding geometric flaws behind stylistic appeal and focuses the evaluation on structural integrity. âą Orthogonal stressors: Scenarios are carefully factored along controllable geometric axes (e.g., planarity of the background, presence of parallax, number of independent motion fields). This allows for targeted analysis of specific model weaknesses, such as a failure to model epipolar geometry while succeeding at projective transforms. âą Model-agnostic generation: To ensure a fair comparison, identical prompts and random seeds are used across all tested models (Sora (Liu et al., 2024c), Runway, Wan (Wan et al., 2025)). Technical parameters such as resolution, frames per second (fps), and clip duration are also held constant. âą Reproducibility: Every generated sequence is accompanied by a detailed metadata record (prompt, seed, model version, resolution, fps, duration) and the scripts used for generation. This commitment to transparency allows for full verification and extension of our results. âą Replaceable components: The tools used in our evaluation pipeline (segmentation, feature matching, optical flow) are treated as default choices, not fixed requirements. The benchmark is structured to allow for drop-in alternatives (e.g., swapping RAFT for a future optical flow model), ensuring its long-term relevance as underlying technologies evolve. 5.2. Scenario Taxonomy The dataset is partitioned into six distinct scenarios. We first include the Static Scene as a negative-control baseline. Its purpose is not to test complex 3D understanding but to evaluate temporal stability and the fidelity of executing a zero-motion command. It reveals texture flicker, unintended camera drift, and minor object instability. For a perfect static video, camera motion should be zero and appearance-consistency between frames should approach zero; any deviation directly quantifies inherent instability. Failing this simplest case indicates that errors in more complex scenarios likely stem from a lack of temporal coherence rather than motion understanding. 1) Static Scene (Temporal Stability Baseline): see above. 2) Pure Camera Rotation (Homography-dominant): A static 3D scene where the camera rotates around its optical center. This is a foundational test of projective consistency. Expected Behavior: The motion should be classified as non-translation-dominant. A single homography (H) should explain nearly all background feature matches, resulting in an Inlier Ratio (IR) approaching 100% and a very low Geometric Error (GE). 3) Pure Camera Translation (Epipolar-dominant): A static scene with significant depth variations (e.g., near and far objects) where the camera translates laterally or forward. This is a critical test of a modelâs ability to synthesize motion parallax. Expected Behavior: The motion must be classified as translation-dominant. A single fundamental matrix (F) should model the epipolar geometry, yielding a high IR and low GE. Failure often manifests as scene âbreathingâ or warping, where distant objects do not remain stable relative to near ones. 4) Static Background + Single Moving Object: A static camera observes a scene where a single foreground object moves independently. This scenario tests the modelâs ability to disentangle different motion fields. Expected Behavior: The background should remain perfectly rigid, passing the H/FH/F test with high scores. The foreground object is evaluated for internal rigidity using AdaDFRC-W2 (Eq. (15)); a low score indicates a rigid object, while a high score reveals non-rigid deformations like stretching or shearing. 5) Complex Camera Motion (Rotation+Translation): Realistic, combined camera movements such as a dolly-zoom or arc shot. This probes the modelâs ability to maintain a coherent 3D representation under more challenging, free-form motion. Expected Behavior: The motion should be classified as translation-dominant. The evaluation checks if a single fundamental matrix (F) can still robustly model the background motion, despite its complexity, and if foreground objects (if any) can be stably decomposed and tracked. 6) Geometric Stress Tests: Adversarial but physically-plausible setups designed to push models to their limits. This includes scenes with thin, detailed structures (prone to disappearing), reflective or transparent surfaces (challenging for feature matching), and occlusions. Expected Behavior: We anticipate a significant drop in performance across all metrics. These scenarios are diagnostic, designed to reveal failure modes like structural âbreathing,â object wobble, or non-rigid drift that might not be apparent in simpler scenes. 5.3. Prompt Templates and Lexicon To ensure precise control over the generated geometry and minimize semantic ambiguity, we adopt a structured, modular prompt system. This forces the models to contend with the geometric request directly, rather than relying on semantic shortcuts. Each prompt uses four slots: Motion Command + Scene Composition + Object Specification + Qualitative Style. A comprehensive prompt lexicon, detailing the allowed vocabulary for each slot, is provided in an appendix (cf. Appendix A) to standardize wording. Examples (abbrev.). âą Pure Rotation: âSingle static shot. The camera rotates in place around the building facade. No translation. Background absolutely fixed.â âą Pure Translation: âSingle static shot. Camera dollies right past trees and a building, revealing parallax (near vs far).â âą Static BG + Object: âStatic camera. A red car drives a circular path in front of a fixed building. Background must stay rigid.â 5.4. Generation Protocol and Dataset Statistics All clips in GeoCon-Bench are generated under a strict protocol. In addition to the released seed-image scenes, we include standardized videos from three representative AIGC models, including Sora (commercial), Runway (industry-leading), and Wan (open-source). Each clip is generated at a fixed resolution and 24 fps, with a duration of 5 seconds (120 frames). For each of the 20 unique prompts, we generate 3 clips per model using different seeds. We advocate for scene-balanced reporting, where metrics are first averaged within each scenario before being averaged across scenarios. This prevents a modelâs high performance on an easy category from masking its failures on more challenging ones. 5.5. Metadata and Release Format To maximize the benchmarkâs utility and promote reproducible science, each clip is accompanied by a JSON metadata file containing: prompt, model, model_version, seed, resolution, fps, duration, clip_id, masks_path. We will publicly release (i) all prompts, (i) all generated videos, (i) all extracted foreground masks, (iv) evaluation configurations, and (v) scripts to reproduce all tables and figures in this paper. 5.6. Grounded Validation To anchor our metrics and calibrate key thresholds, the benchmark includes a small subset of âgroundedâ scenarios where the intended geometry is unambiguous. These include textured planar surfaces for rotation checks (which should yield a perfect homography with IR=100%) and scenes with clearly separated near/far layers for translation checks. These anchors provide a sanity check for the entire evaluation pipeline and are used to calibrate the gating threshold ÏÏ _Ï by observing the IR saturation across these known scenarios. 6. Experimental Validation We conducted a comprehensive set of experiments to validate our proposed framework and evaluate the geometric consistency of state-of-the-art video generation models using a custom benchmark, GeoCon-Bench. The goal is not merely to rank models but to establish a standardized, interpretable procedure for judging geometric fidelity. We investigate: RQ1 (Gate validity): Does translation-evidence gating agree with photogrammetric fits across scenes and platforms? RQ2 (Background rigidity): Are IRH/FIR_H/F and GEH/FGE_H/F stable under dual-threshold scanning and informative for cross-platform comparison? RQ3 (Dynamic coherence): Does the flow-guided dynamic score (AdaDFRC-W2) capture complementary failures that background indicators cannot? RQ4 (Comparability & auditing): Do percentile-aligned summaries and audit cards yield stable platform rankings and reproducible diagnostics? 6.1. Implementation Details This section details the specific choices of algorithms and parameters used to implement our framework, clearly separating the practical implementation (cf. pseudocode Algorithm 1) from the theoretical methodology of Section 4. The abstract components of our framework were realized with the following state-of-the-art models: âą Pose Estimation: We used the official implementation of DUSt3R for pairwise relative pose estimation. Its ability to handle uncalibrated images makes it robust for AIGC evaluation. âą Video Segmentation: Foreground object masks were generated using SAM-2, leveraging its streaming architecture for efficient video processing. âą Optical Flow: Dense flow fields for the AdaDFRC-W2 metric were computed with Recurrent All-Pairs Field Transforms (RAFT-small), chosen for its balance of accuracy and efficiency. Input : Seed I0I_0; generated frames I1:TI_1:T; scales S=1/4,1/2,1S=\1/4,1/2,1\; DUSt3R translation gate Ït _t (default 0.040.04); fixed background gates ÏH=2 _H=2 px, ÏF=0.1 _F=0.1. Output : IRBG,GEBGIR_BG,GE_BG; per-object (O)S^(O); detected category. A. DUSt3R translation decision (firstâlast) estimate pose =(,)T=(R,t) between (I0,IT)(I_0,I_T); if pose available then set tâââât_â\!â\!\|t\|_â, translation_flagâ(tâ>Ït)â(t_â> _t) else translation_flagâ (present-only policy) B. SAM-2 segmentation (mask-first) run SAM-2 âMtkâ\M_t^k\; define content mask (remove letterbox) and background Bt=content(It)ââȘkMtkB_t=content(I_t) _kM_t^k; build background-only correspondences t,sbgC^bg_t,s on Btâ©Bt+1B_tâ© B_t+1 for all t and sâSsâ S. C. Background geometry on masks-outside for t=0t=0 to Tâ1T-1 do for sâSsâ S do if translation_flag then fit t,sF_t,s on t,sbgC^bg_t,s (robust, gate ÏF _F); compute IRF and median Sampson residual GEF (pixels); else fit t,sH_t,s on t,sbgC^bg_t,s (robust, gate ÏH _H); compute IRH and median symmetric reprojection GEH (pixels); aggregate over time/scales by robust medians to obtain IRBG,GEBGIR_BG,GE_BG; (optional) also record best-of(H/F) per pair for analysis, without affecting the main scores. D. Movers: AdaDFRC-W2 for each object O and sâSsâ S do estimate dense flow and occlusion inside O; grid the bbox, take per-cell median flow vi,jv_i,j; fit affine (,)(A,b) and compute weighted MSE per frame t(O)D_t^(O); average over the track â(O) ^(O). E. Post-hoc categorization combine translation_flag with (IRBG,GEBG)(IR_BG,GE_BG) under fixed report gates (IRâ„0.97â„ 0.97, GEâ€3.5†3.5 px) to assign one of Static, Rotation-dominant, Translation-dominant, StaticCam+MovingObjs, Complex, Stress. return IRBG,GEBG,(O)IR_BG,GE_BG,\S^(O)\. Algorithm 1 Mask-first, translation-aware evaluation. Residuals are evaluated in pixels on the content mask; the background model (H or F) is chosen once from the DUSt3R decision on (I0,IT)(I_0,I_T). 6.2. DUSt3R Translation-Gate Calibration Given the DUSt3R relative pose between the first/last frames, we declare a pair translation-dominant (F) if ââ>Ït\|t\|_â> _t and rotation/planar-like (H) otherwise, where tââââ=maxâĄ(|tx|,|ty|,|tz|)t_â\! \!\|t\|_â\!=\! (|t_x|,|t_y|,|t_z|). Throughout the paper, background inlier gates are kept fixed to empirically chosen constants and are not ablated: ÏH=2 _H=2 px (homography reprojection) and ÏF=0.1 _F=0.1 (Sampson residual); when background consistency is required we use IRâ„0.97IR\!â„\!0.97 and GEâ€3.5GE\!â€\!3.5 px on the content mask (pixels, after denormalization). For the calibration of Ït _t we use present-only pairs (i.e., DUSt3R poses available; âfailâ pairs have undefined tât_â), across all three platforms and all six prompt families. The sampling unit is a (seed, platform, family) triplet, yielding N=300N=300 observations with valid tât_â (146 F-expected: C3/C5/C6; 154 H-expected: C1/C2/C4). This analysis is purely geometric and independent of semantic scores. Fig. 4(a) shows smoothed densities of tât_â for H-expected (C1/2/4) and F-expected (C3/5/6) families. Densities are reported as equal-width histograms over the central 99% range with a mild Gaussian smoothing (for visualization only; no decision is made on smoothed values). A clear valley emerges around tââ0.04t_â\!â\!0.04, indicating a natural separation between the two regimes; choosing Ït _t in that valley minimizes overlap of the class-conditional distributions. (a) tât_â density for H-expected (C1/2/4) vs. F-expected (C3/5/6). A valley appears near tââ0.04t_â\!â\!0.04, indicating a natural split for Ït _t. (b) Empirical calibration Pâ(FâŁtâ)P(F t_â) with Wilson 95% CIs (equal-count bins; â 25 samples/bin). The 0.5 crossing occurs within [0.04,0.07][0.04,0.07]; Ït=0.04 _t=0.04 lies inside this transition band. Figure 4. Translation-gate calibration for pose estimation. To quantify the separation without assuming parametric forms, we estimate the empirical calibration curve Pâ(FâŁtâ)P(F t_â) using equal-count binning and Wilson 95% confidence intervals (CIs): for each bin b with mbm_b samples and p^b p_b the observed F fraction, we report (16) [p^b+z22âmb1+z2mb±z1+z2mbâp^bâ(1âp^b)mb+z24âmb2],z=1.96. [ p_b+ z^22m_b1+ z^2m_b± z1+ z^2m_b p_b(1- p_b)m_b+ z^24m_b^2 ], z=1.96. Fig. 4(b) exhibits a smooth transition from H-like to F-like regimes. With K=12K=12 equal-count bins (about 25 samples per bin), the 0.5 crossing lies in the interval tââ[0.04, 0.07]t_â\!â\![0.04,\,0.07]; notably, the bin centered at tââ0.043t_â\!â\!0.043 has p^=0.40 p=0.40 with a Wilson CI that contains 0.5, while the next bin centered at â0.073â\!0.073 has p^=0.52 p=0.52 (CI also overlapping 0.5). Hence, Ït=0.04 _t=0.04 lies inside the statistically identified transition band, on the conservative side of the equiprobable boundary. We therefore adopt Ït=0.04 _t=0.04 as the default translation gate: (i) it falls in the density valley separating the H/F families, thereby reducing class overlap; and (i) it lies within the empirical calibration band where Pâ(FâŁtâ)â0.5P(F t_â)\!â\!0.5, providing a principled knee-point that balances recall on F-expected cases (C3/5/6) against false positives on H-expected ones (C1/2/4). Complementary analyses in the Appendix B show that Ïtâ[0.04,0.06] _t\!â\![0.04,0.06] forms a broad performance plateau, and that Ït=0.04 _t=0.04 is either at or statistically indistinguishable from the maxima while being slightly more conservative on spurious F. 6.3. GeoCon Benchmark We evaluate whether camera translation is dominant (âFâ) or not (âHâ) across three video-generation platforms (Runway, Sora, Wan) and six prompt categories. For each clip, we feed the first and last frames to DUSt3R and extract the 4Ă44Ă4 relative pose; we compute Eq. 5 from the translation column and declare translation-dominant (âFâ) iff âtââ>Ï\|t\|_â>Ï with Ï=0.04Ï=0.04; otherwise we label âHâ. Unless otherwise stated, all descriptive statistics below are computed over the available clipâpairs (i.e., no imputation), while some visualizations additionally show a conservative variant that treats missing pairs as F. For reporting raw coverage, we count a pair as âpresentâ only if DUSt3R returns a valid pose. Thus, the Sora split exhibits fewer âpresentâ pairs not because videos were absent, but because DUSt3R could not reconstruct a larger fraction of first/last-frame pairs. In all downstream analyses that depend on semantic consistency, these non-reconstructed pairs are treated as F by construction. Unless stated, statistics are computed over present-only pairs (DUSt3R pose available). For robustness audits, we also report a conservative variant that treats missing pairs as F, reflecting that large endpoint displacement often prevents pose recovery. We evaluate three platforms (Runway, Sora, Wan) over six categories and multiple seeds. DUSt3R returns valid poses for 108108 pairs on Runway, 9292 on Sora, and 100100 on Wan. The number of distinct seeds with at least one valid pair is 2020 (Runway), 1919 (Sora), and 2020 (Wan), so the maximum possible pairs per platform are 120/114/120120/114/120, leaving 12/22/2012/22/20 missing (failure) pairs, respectively. Per-category coverage (present pairs divided by #seeds) is: Runway 100, 85, 95, 85, 95, 80%\100,\,85,\,95,\,85,\,95,\,80\\% for C1âC6; Sora 84.2, 84.2, 78.9, 78.9, 78.9, 78.9%\84.2,\,84.2,\,78.9,\,78.9,\,78.9,\,78.9\\%; Wan 90, 80, 80, 95, 85, 70%\90,\,80,\,80,\,95,\,85,\,70\\%. On present pairs, the distributions are: Runway (count 108108): mean 0.0930.093, median 0.0420.042, max 0.5800.580; Sora (count 9292): mean 0.1290.129, median 0.0500.050, max 0.6910.691; Wan (count 100100): mean 0.1250.125, median 0.0760.076, max 0.5480.548. Overall, 21/300=7.0%21/300=7.0\% of decisions lie within ±0.01± 0.01 of the threshold Ï=0.04Ï=0.04 (Runway 8.3%8.3\%, Sora 5.4%5.4\%, Wan 7.0%7.0\%), indicating a non-negligible band of near-threshold cases. DUSt3R failures indicate excessive translation and are treated as translation-present; such pairs are excluded from present-only aggregation but counted in all-pairs coverage. As expected, semantics intended to contain translation (C3, C5, C6) yield higher F-rates, while C1/C2/C4 lean toward H. Per-platform F-rates (fraction of F among present pairs) are: âą Runway: C1 30.0%30.0\%, C2 58.8%58.8\%, C3 84.2%84.2\%, C4 11.8%11.8\%, C5 68.4%68.4\%, C6 56.2%56.2\%; overall 51.9%51.9\%. âą Sora: C1 25.0%25.0\%, C2 50.0%50.0\%, C3 46.7%46.7\%, C4 46.7%46.7\%, C5 66.7%66.7\%, C6 80.0%80.0\%; overall 52.2%52.2\%. âą Wan: C1 33.3%33.3\%, C2 62.5%62.5\%, C3 87.5%87.5\%, C4 26.3%26.3\%, C5 94.1%94.1\%, C6 64.3%64.3\%; overall 60.0%60.0\%. Notably, Soraâs C3 is closer to the decision boundary (only 46.7%46.7\% F), whereas Wan is extremely translation-heavy on C5 (94.1%94.1\% F). By design, categories C1 (Static), C2 (Rotation-dominant), and C4 (Static camera + moving object) are expected to be H-majority (translation-free at the first/last endpoints), whereas C3/C5/C6 are expected to be F-majority. Empirically, we observe C1 and C4 behave as expected (H-majority). F-rates for C1 are 30.0%30.0\%/ 25.0%25.0\%/ 33.3%33.3\% (Runway/Sora/Wan); for C4 they are 11.8%11.8\%/ 46.7%46.7\%/ 26.3%26.3\%. Thus, C1 is consistently H-majority; C4 is H-majority on Runway/Wan and borderline on Sora. C2 deviates from expectation. Despite the rotation-only intent, C2 shows elevated F: 58.8%58.8\%/ 50.0%50.0\%/ 62.5%62.5\% (Runway/Sora/Wan), i.e., not H-majority on Runway/Wan and exactly balanced on Sora. This suggests either residual translation between endpoints, moving content that induces effective parallax, or reconstruction biases on low-parallax/rotation-heavy pairs. C3 and C5 are strongly F-majority, as intended: C3 has 84.2%84.2\%/ 46.7%46.7\%/ 87.5%87.5\% F; C5 has 68.4%68.4\%/ 66.7%66.7\%/ 94.1%94.1\% F (Runway/Sora/Wan). C6 (stress) is also F-leaning: 56.2%56.2\%/ 80.0%80.0\%/ 64.3%64.3\% F. Using the expected rule (C1/C2/C4 â H; C3/C5/C6 â F), an anomaly occurs when the DUSt3R gate disagrees with the expectation. Present-only anomaly rates are: âą Runway: C1 30.0%30.0\%, C2 58.8%58.8\%, C3 15.8%15.8\%, C4 11.8%11.8\%, C5 31.6%31.6\%, C6 43.8%43.8\%; overall 31.5%31.5\%. âą Sora: C1 25.0%25.0\%, C2 50.0%50.0\%, C3 53.3%53.3\%, C4 46.7%46.7\%, C5 33.3%33.3\%, C6 20.0%20.0\%; overall 38.0%38.0\%. âą Wan: C1 33.3%33.3\%, C2 62.5%62.5\%, C3 12.5%12.5\%, C4 26.3%26.3\%, C5 5.9%5.9\%, C6 35.7%35.7\%; overall 29.0%29.0\%. Thus, C2 is systematically difficult (anomaly â„50%â„ 50\% on Runway/Wan), while C1/C4 largely conform to expectations (lower anomalies, aside from Soraâs borderline C4). When reconstruction failures are set to F prior to the check (our default protocol), overall anomaly rates become 33.3%33.3\% (Runway), 39.5%39.5\% (Sora), and 30.0%30.0\% (Wan). By category: Runway 30.0, 65.0, 15.0, 25.0, 30.0, 35.0%\30.0,\,65.0,\,15.0,\,25.0,\,30.0,\,35.0\\%; Sora 36.8, 57.9, 42.1, 57.9, 26.3, 15.8%\36.8,\,57.9,\,42.1,\,57.9,\,26.3,\,15.8\\%; Wan 40.0, 70.0, 10.0, 30.0, 5.0, 25.0%\40.0,\,70.0,\,10.0,\,30.0,\,5.0,\,25.0\\% (C1âC6). These increases concentrate in H-expected categories (C1/C2/C4), reflecting that failures are interpreted as large-displacement F. Fig. 5 merges cross-platform alignment and semantic consistency into a single panel. Each cell is color-coded by the DUSt3R-derived â„tâ„â t _â and overlaid with the H/F gate; orange borders denote anomalies under the expected rule (C1/C2/C4 â H; C3/C5/C6 â F), while gray borders indicate agreement. Rows list seeds in the fixed order 11â2020; columns enumerate category (C1âC6) Ă platform (R/S/W for Runway/Sora/Wan). Missing pairs follow our default convention (treated as F and colored with the global maximum â„tâ„â t _â to preserve a common scale). Under this convention, 46.7%46.7\% of seedâcategory triplets are unanimous across platforms; of those, 76.8%76.8\% are all-F, reflecting translation-dominant or failure-inferred cases. The combined view highlights three trends: (i) C3 and C5 align with translation dominance across platforms; (i) C1 and C4 are mostly H with scattered mismatches; (i) C2 departs from its H expectation, showing noticeable F decisions and borderline behavior near the threshold. Figure 5. Combined cross-platform alignment and semantic consistency. Color encodes â„tâ„â t _â from the DUSt3R firstâlast pose; overlaid labels show the H/F decision. Orange borders mark anomalies under the expected rule (C1/C2/C4 â H; C3/C5/C6 â F), gray borders indicate matches. Missing pairs are treated as F and colored with the global maximum to keep a common scale. Rows follow the seed order 11â2020; columns are category (C1âC6) Ă platform (R/S/W). 6.4. Sanity checks and gateâsupport agreement For each clip, we read the DUSt3R firstâlast pose =[1]T= bmatrixR&t\\ 0&1 bmatrix, compute tâ=maxâĄ(|tx|,|ty|,|tz|)t_â= (|t_x|,|t_y|,|t_z|), and apply a hysteresis gate: tââ€0.03ât_â†0.03 , tââ„0.05ât_ââ„ 0.05 , and 0.03<tâ<0.050.03<t_â<0.05 is a tolerance band (âUâ). Unless stated, Sankey plots drop U to avoid three-way clutter, whereas diagnostics report it explicitly. Across all available tuples (platform Ă seed Ă prompt) we obtain =156F=156 (52%), =123H=123 (41%), and =21U=21 (7%). Fig. 6(a) shows the global histogram of tât_â with the two thresholds overlaid. The tolerance band [0.03,0.05][0.03,0.05] is sparsely occupied, supporting the defensibility of the gate. We also visualize the full distributions with a violin plot in Fig. 6(b). C1 (static scene) and C4 (static camera + moving objects) concentrate below 0.030.03 (H regime), C3 (translation-dominant) and C5 (complex camera motion) shift mass above 0.050.05 (F regime), while C2 (rotation-dominant) spans both sides, indicating that even small translations or scale drift can flip the decision. C6 (geometric stress tests) is intentionally unconstrained and shows an F-skewed but mixed distribution: 28/45\,28/45 F, 14/45\,14/45 H, 3/45\,3/45 U(62.2%62.2\% F, 31.1%31.1\% H, 6.7%6.7\% U), consistent with stress conditions that elicit both regimes. We define gate margins as mH=0.03âtâm_H=0.03-t_â for H-gated tuples and mF=tââ0.05m_F=t_â-0.05 for F-gated tuples. Fig. 6(c) shows the margin histograms for H and F, respectively: both concentrate away from zero, indicating decisions are not brittle. Fig. 6(d) expose platform effects(left: mHm_H, right: mFm_F). Margins remain comfortably positive overall, but distributions differ across platforms, reflecting platform-specific motion priors under identical prompts. On (seed, prompt) tuples where at least two platforms are non-U, 55/103 are unanimous (consensus) and 48/103 are split (F vs. H), yielding a 53.4% consensus rate. These differences are visible directly in the platform-conditioned margin violins in Fig. 6(d). For H-gated tuples, the distributions of mH=0.03âtâm_H=0.03-t_â differ by platform, and for F-gated tuples, the distributions of mF=tââ0.05m_F=t_â-0.05 likewise separate across platforms. Margins remain largely positive, indicating decisions are not brittle, yet their platform-specific shifts corroborate the presence of distinct motion/rendering biases under identical prompts. (a) tât_â histogram. (b) tât_â distribution by prompt (C1âC6). Violins show the full distribution with medians. (c) Gate margins (H/F panels). (d) Gate margins by platform. Left: mH=0.03âtâm_H=0.03-t_â for H-gated tuples; Right: mF=tââ0.05m_F=t_â-0.05 for F-gated tuples. Figure 6. Gateâsupport diagnostics with the hysteresis rule (tââ€0.03ât_â†0.03 , tââ„0.05ât_ââ„ 0.05 ). (a) tât_â histogram with thresholds, showing low occupancy of the tolerance band. (b) Prompt-wise tât_â distributions (C1âC6; violins with medians): C1/C4 concentrate below 0.03, C3/C5 shift above 0.05, and C2 spans both regimes. (c) Gate margins mH=0.03âtâm_H=0.03-t_â and mF=tââ0.05m_F=t_â-0.05 (two panels) are largely positive, indicating stable decisions away from thresholds. (d) Platform-conditioned margin violins (left: mHm_H, right: mFm_F) reveal cross-platform differences while remaining comfortably above zero. 6.5. Background rigidity: distributional behavior, cross-model gaps, and effect sizes We evaluate background rigidity using two complementary scalars computed per tuple: IRIR (image-space rigidity consistency; larger is better) and GEGE (background geometry error; smaller is better). We report both the H family (thresholded at ÏH=2 _H=2px) and the F family (gate near ÏFâ0.10 _Fâ 0.10), and we summarize per-prompt distributions (C1âC6) for each platform (Runway, Sora, Wan). Distributions are visualized with ridgelines (per prompt) and cross-family gaps are quantified with GardnerâAltman style effect-size panels (median differences with bootstrap 95% CIs). Fig. 7 shows that IR concentrates in a high-rigidity regime with visibly broader right tails under the stress prompts C4 (static camera + moving objects) and C6 (geometric stress tests) across all three platforms. The corresponding GE ridgelines in Fig. 8 reveal rightward shifts (i.e., larger errors) for H relative to F, and again heavier upper tails in C4/C6. Together, the ridgelines indicate (i) background remains mostly rigid, but (i) stress prompts inject a non-negligible fraction of difficult cases whose mass accumulates in the upper tails (higher GEGE / slightly lower effective IRIR). To make platform-wise comparisons commensurate, we use median differences with bootstrap uncertainty. Fig. 9 reports Medianâ(GEH)âMedianâ(GEF)Median(GE_H)-Median(GE_F): the effect is consistently positive on all platforms, meaning F has lower background geometry error than H. The magnitude is small on Runway (on the order of a few 10â210^-2), medium on Sora (peaking in C5/C6), and largest on Wan (systematically the highest across C1âC6). This ranking matches the qualitative right-shift in the GE ridgelines for C4/C6 on Wan. Fig. 10 reports Medianâ(IRH)âMedianâ(IRF)Median(IR_H)-Median(IR_F): the effect is consistently negative (i.e., F yields slightly higher rigidity) with the strongest gaps on Sora/Wan and milder gaps on Runway. Across platforms, the signs are stable, the CIs are tight, and the ordering by prompt mirrors the stress semantics: C4 and C6 show the most significant gaps, while C1âC3/C5 remain smaller and often overlap. The F family, which enforces epipolar-consistent background structure, systematically reduces GEGE and increases IRIR (higher rigidity), with effects most pronounced under stress prompts (C4/C6)âsee the rightward density mass in Fig. 8 and the positive GE gaps in Fig. 9, together with the negative IR gaps in Fig. 10. Wan exhibits the largest GE gaps (H worse than F) across nearly all prompts; Sora shows medium gaps concentrated in C5/C6; Runway shows the smallest gaps. The same ranking is echoed in IR, supporting a consistent story across both metrics. (3) Stress prompts magnify tails rather than medians. Ridgelines show that medians stay near the high-rigidity regime, while the upper tail mass expands in C4/C6 (Fig. 7, Fig. 8). Consequently, the effect-size panels capture meaningful, prompt-aligned differences even when central tendency moves only slightly. The GardnerâAltman representation in Fig. 9â10 (half-violin density + CI + point estimate) provides (i) robust ranking immune to outliers from stress cases; (i) cross-platform comparability via a common horizontal scale; and (i) visually verifiable uncertainty. These properties are crucial because stress prompts primarily affect the tails, which can mislead mean-based summaries but are faithfully captured by medians and their sampling distribution. Across three datasets and six prompts, the evidence is consistent and convergent: the F family dominates the H family for background rigidity, reducing GEGE and improving IRIR, with the largest wins under C4/C6 and the strongest overall gaps on Wan, followed by Sora, then Runway. This agrees with the qualitative mass shifts in the ridgelines and the quantitative, uncertainty-aware effect sizes. (a) Runway. (b) Sora. (c) Wan. Figure 7. IR distribution ridgelines per prompt (C1âC6). Each panel overlays H (solid, filled) vs. F (dashed) for a given platform. Stress prompts C4/C6 widen the upper tails across all platforms. (a) Runway. (b) Sora. (c) Wan. Figure 8. GE distribution ridgelines per prompt (C1âC6). H shows right-shifted densities relative to F, with the largest gaps on Wan and pronounced tail mass in C4/C6. Figure 9. Prompt-wise effect size with 95% CI â GE. Median difference Medianâ(GEH)âMedianâ(GEF)Median(GE_H)-Median(GE_F) per prompt and platform. Effects are positive across the board (F<<H), smallest on Runway, medium on Sora, largest on Wan, and amplified for C4/C6. Figure 10. Prompt-wise effect size with 95% CI â IR. Median difference Medianâ(IRH)âMedianâ(IRF)Median(IR_H)-Median(IR_F) per prompt and platform. Effects are negative (F>>H) with the strongest gaps on Sora/Wan and the mildest on Runway; the ordering by prompt mirrors C4/C6 stress. 6.6. Dynamic coherence: flow-guided plausibility and occlusion ordering We assess dynamic plausibility with the per-frame AdaDFRC-W2 score, designed to increase when occlusion ordering or flow consistency becomes implausible. For each object track within a clip we summarize its temporal severity by the robust upper-tail statistic (17) AdaPninety=quantile0.9â(AdaDFRCâ-âW2tt=1T),AdaPninety\;\;=\;\;quantile_0.9 (\AdaDFRC-W2_t\_t=1^T ), which captures the magnitude of the worst 10%10\% frames while being insensitive to isolated spikes. We rely on four complementary views. (i) Beeswarm panels group every object by prompt (C1âC6) and model, and overlay the per-prompt, per-model P80 thresholds (dashed ticks) and median markers (short bars), see Figs. 11(a)â11(c). (i) Empirical Cumulative Distribution Function (ECDF) panels show full distributions with the same P80 thresholds, exposing tail heaviness (right-shifts). (i) Anomaly-rate bars report the fraction of objects above the per-prompt P80; these rates are primarily descriptive (they are near 20%20\% by construction and not used for cross-prompt ranking). (iv) Top-N sparkline sheets plot the per-frame trajectories for the hardest objects in each model with summary statistics (P50/P90/n), revealing whether failures are bursty or persistent (Figs. 12(a)â12(c)). Dynamic coherence is only defined when detectable objects exist. Across our data, the object counts per model are comparable, providing sufficient support for model- and prompt-conditioned analyses. Prompts C4 (static camera + moving objects) and C6 (geometric stress tests) contain the richest dynamic evidence, consistent with our protocol design. We report consistent, model-agnostic evidence that dynamic coherence is most fragile under prompts C4 (static camera + moving objects) and C6 (geometric stress tests). Across all three models, the beeswarm panels reveal visibly taller stacks for C4/C6 while the medians remain comparatively stable, and the ECDFs shift to the right with fatter upper tails. This pattern indicates that failures concentrate in the worst part of the distribution rather than uniformly raising central tendencyâexactly the behavior one would expect when motion- or geometry-induced occlusion ordering becomes implausible. Although all models exhibit heavier tails for C4/C6, the magnitude of the extremes differs across models. The largest AdaPninetyAdaPninety objectsâand thus the most severe dynamic inconsistenciesâare most pronounced on Runway and Sora, with Wan displaying comparatively lower maxima. This cross-model ordering is independently corroborated by the Top-N sparkline sheets: the largest-amplitude trajectories cluster in (Runway, C6) and (Sora, C6/C4), whereas Wanâs top traces remain lower in amplitude, albeit still clearly abnormal. The temporal shapes of these failures are mechanistically distinct. The Top-N trajectories expose (i) brief burst spikes aligned with object enter/exit events or edge flicker; (i) quasi-periodic riseâfall patterns consistent with recurrent depth/flow flips; and (i) long segments of persistent elevation indicative of sustained layer mis-ordering or non-rigid flow leakage. Notably, these dynamic signatures often arise without commensurate increases in background photogrammetric residuals, underscoring that they are genuinely dynamic (flow/ordering) failures rather than artifacts of the static fit. We also clarify how prevalence is interpreted in our diagnostics. Because thresholds are defined per prompt and per model at the P80 level, the within-prompt anomaly fractions are expected to be near 20%20\% by construction and are therefore not used to rank prompts. Instead, our conclusions rest on severity (how far the upper tail extends) and tail shape (ECDF right-shift), which together yield a clear and stable ordering in upper-tail mass: C4 >> C6 >> (C1, C2, C3, C5). Joint checks with gateâsupport agreement (Sec. 6.4) further show a non-trivial subset of clips in which dynamic anomalies coexist with strong background fits (âdynamic-anomaly & background-goodâ), amounting to roughly a tenth of cases. This complementarity motivates including an explicit, object-aware dynamic score such as AdaDFRC-W2 alongside background rigidity fits in any holistic geo-consistency audit. Two robustness choices make the conclusions stable: (i) summarizing per-object with AdaPninetyAdaPninety instead of maxima prevents overreaction to isolated spikes, yet keeps genuine tail mass visible; (i) auditing with model- and prompt-specific P80 thresholds prevents cross-model scale confounding while preserving comparability of shapes and extremes. Empirically, Top-N membership is stable under small changes in N (8â12) and under ±2± 2 percentile changes in the per-prompt thresholds. Dynamic coherence is the dominant failure axis under motion- and geometry-stress prompts. It manifests as heavy-tailed AdaPninetyAdaPninety distributions with clear bursty or persistent temporal signatures, and it is not predictable from background photogrammetric residuals alone. Therefore, any holistic geo-consistency audit must include an object-aware, flow-guided dynamic term like AdaDFRC-W2 in addition to background rigidity fits. (a) (b) (c) Figure 11. Foreground rigidity via AdaDFRC-W2 across prompt families and platforms. Each row shows one platformâ(a) Runway, (b) Sora, (c) Wan. Left: perâobject AdaDFRC-W2 scores grouped by prompt family (C1âC6; lower is better). Each marker corresponds to one tracked object; points are horizontally jittered for visibility. Grey horizontal guidelines indicate the platformâs R80 robustness threshold, used to summarize the heavy-tail portion of the distribution. Right: Rate bars report, per family, the fraction of objects whose score exceeds R80 (higher bars imply more non-rigid/unstable motion). The ECDF inset shows the empirical cumulative distribution of AdaDFRC-W2 for that platform, with the vertical dashed line marking R80. (a) Runway (b) Sora (c) Wan Figure 12. Top-N hardest objects per model. Each sparkline shows per-frame AdaDFRC-W2 for one object; the page-level x/y labels indicate frame index (temporal order) and AdaDFRC-W2, respectively. Dashed lines mark the model-wise median of per-prompt P80. Right-side annotations report P50, P90, and the number of frames (n). 6.7. Quantitative Results We present the scene-balanced average scores for each generative model across all categories of GeoCon-Bench in Table 1. Higher IR is better, while lower GE and AdaDFRC-W2 are better. We report scene-balanced averages over all seeds and categories of GeoCon-Bench. For each seedâcategory pair we first average frame-wise scores within a clip and then average equally across scenes. Background scores use H/F-based metrics (IR and GE) on the static layer, while foreground scores report AdaDFRC-W2 on moving objects. Higher IR is better; lower GE and AdaDFRC-W2 are better. Table 1. Scene-balanced average results on GeoCon-Bench Background Foreground Model IR (%) â GE (norm) â AdaDFRC-W2 â Runway 97.0 0.274 18.54 Sora 96.6 0.398 21.79 Wan 96.2 0.394 12.76 Background geometry is consistently strong across models (IR â 96â97%), with sub-pixel GE magnitudes on average. Foreground coherence (AdaDFRC-W2) varies more: Wan attains the lowest deformation on average (12.76), Runway is moderate (18.54), and Sora is the highest (21.79). A category-wise breakdown reveals model-specific weaknesses: Runway exhibits elevated foreground deformation in C4 (Static camera + moving object, 31.69) and C6 (Stress, 23.91); Sora peaks in C6 (36.84) and is also high in C3/C4 (22.83/22.36); Wan is most challenged in C2 (Rotation-dominant, 24.42) and C4 (18.94), while remaining low in C1/C5 (2.30/4.86). These patterns are consistent with the combined alignment/consistency map in Fig. 5, where translation-dominant or failure-inferred cells tend to coincide with larger foreground deformation. Across scenes, the 95% confidence intervals (CI) for background IR are Runway [96.35, 97.55][96.35,\,97.55], Sora [95.91, 97.29][95.91,\,97.29], Wan [95.41, 97.06][95.41,\,97.06] (in %); for GE (px): Runway [1.90Ă10â4, 2.48Ă10â4][1.90\!Ă\!10^-4,\,2.48\!Ă\!10^-4], Sora [2.70Ă10â4, 3.65Ă10â4][2.70\!Ă\!10^-4,\,3.65\!Ă\!10^-4], Wan [2.78Ă10â4, 3.52Ă10â4][2.78\!Ă\!10^-4,\,3.52\!Ă\!10^-4]; for AdaDFRC-W2: Runway [12.32, 24.76][12.32,\,24.76] (63 scenes), Sora [12.74, 30.84][12.74,\,30.84] (64), Wan [6.57, 18.95][6.57,\,18.95] (66). The results indicate clear differences in the geometric consistency of the evaluated models. A more detailed breakdown by scenario reveals specific strengths and weaknesses. For instance, most models perform well on pure rotation scenarios, achieving high IR with the homography model, but struggle with pure translation, where maintaining epipolar constraints for parallax is more challenging. The AdaDFRC-W2 scores are particularly revealing in categories with moving objects, quantifying the degree of unnatural deformation. 6.8. Analysis: Decoupling Geometric and Semantic Quality We investigate whether semantic alignment, measured by CLIP, predicts geometric coherence of the generated videos. For each scene (seedâcategory) and platform, we robustly fit a single background motion model on background-only correspondences, using either a homography H (planar/rotation regime) or a fundamental matrix F (translation/parallax regime). Models are estimated in normalized coordinates for numerical stability, and residuals are denormalized to pixels before scoring on the content mask (letterboxing excluded). Under either family gâ,gâ\H,F\ we report two model-agnostic indicators: Inlier Ratio (IR)âthe fraction of correspondences passing the family-specific inlier testâand Geometric Error (GE)âthe median pixel residual among those inliers. Hence IR answers whether a single global model sufficiently explains the background motion, while GE quantifies how tightly the consistent matches align, both defined for either H or F. We analyze the coupling of CLIP with geometry from: (i) an auto-selected view, where each scene adopts the better-fitting family, IRbest=maxâĄ(IRH,IRF)IR_best= (IR_H,IR_F) and GEbest=minâĄ(GEH,GEF)GE_best= (GE_H,GE_F); and (i) a per-family view that keeps H and F separate to avoid bias toward either residual family. Fig. 13-(a,b) plot overall CLIP against IRbestIR_best (higher is better) and GEbestGE_best in pixels (lower is better), respectively, pooling Sora, Runway, and Wan. Across platforms, the scatter shows no strong monotonic trend; the decile medians overlaid in each panel remain flat or erratic. Practically, we observe numerous clips with high CLIP but low IRbestIR_best or elevated GEbestGE_best (px), as well as the converse. This directly illustrates that semantic fidelity is not a reliable proxy for geometric consistency. Fig. 13-(c) reports reliability by CLIP deciles: for each CLIP bin we plot the proportion of scenes meeting a pixel-domain geometry criterion, with 95% Wilson confidence bands. We consider two thresholds: (1) IRbestâ„0.97IR_best\!â„ 0.97; and (2) IRbestâ„0.97IR_best\!â„ 0.97 and GEbestâ€3.5GE_best\!†3.5 px. If CLIP were predictive of geometry, the curves should increase monotonically with CLIP. Instead, both curves remain flat or mildly non-monotonic, indicating that higher CLIP bins do not consistently translate into better geometry. Fig. 13-(c) reports reliability by CLIP deciles: for each CLIP bin we plot the proportion of scenes meeting a pixel-domain geometry criterion, with 95% Wilson confidence bands. Fig. 13-(d) overlays the same decile analysis for the two residual families (solid: IR-only; dashed: IR+GE). The shapes of the H and F curves are similar and remain weakly dependent on CLIP. Thus the decoupling phenomenon is not an artifact of favoring one family: whether a scene is better explained by a homography or a fundamental matrix, CLIP still fails to predict geometric coherence. The findings, which are consistent across various platforms and resilient to the selection of residual family, indicate a significant decoupling between semantic and geometric quality. Therefore, evaluating video generators as âworld simulatorsâ requires reporting geometry-oriented metrics (IR/GE in the pixel domain) in addition to semantic scores. In our supplementary material, we provide counterexample lists (high-CLIP with poor geometry and vice versa) and per-family rank correlations, further corroborating this conclusion. (a) CLIP vs. IRbestIR_best (auto-selected; higher is better). Decile medians are overlaid. (b) CLIP vs. GEbestGE_best in pixels (auto-selected; lower is better). Decile medians are overlaid. (c) Reliability by CLIP deciles (auto-selected). Criteria: IRbestâ„0.97IR_best\!â„ 0.97 (solid) and IRbestâ„0.97IR_best\!â„ 0.97 & GEbestâ€3.5GE_best\! 3.5 px (dashed), with 95% Wilson bands. (d) Per-family reliability overlays (H/F). Solid: IR-only; dashed: IR+GE with ÎŽ=3.5ÎŽ=3.5 px. Curves remain flat or weakly non-monotonic with CLIP. Figure 13. Semantic vs. geometric decoupling. All residuals are evaluated in the pixel domain on the content mask (letterboxing excluded). Points aggregate Sora, Runway, and Wan over all seedâcategory scenes. Across three generators and all six categories, CLIP is a poor predictor of geometry: both scatter views (CLIP vs. IRbest_best, CLIP vs. GEbest_best in pixels) and reliability-by-CLIP deciles remain flat or mildly non-monotonic. All residuals are evaluated in the pixel domain on the content mask (letterboxing excluded) with a single gate fixed at ÎŽ=3.5ÎŽ=3.5 px and a stringent rigidity criterion IRbestâ„0.97IR_best\!â„ 0.97. Per-family overlays (H/F) behave similarly, ruling out residual-family bias; higher CLIP does not reliably imply better geometry. 6.9. Perceptual Evaluation Fig. 14 assembles row-wise exemplars. The leftmost cell of each row shows the seed image for context; the three cells to its right visualize the background geometry obtained from adjacent-frame matches on the content mask (letterboxing ignored) for three platforms. For each cell, we report the Inlier Ratio (IR) and the Geometric Error (GE, median residual in pixels after de-normalization). Two visual regularities are consistent across rows. Scenes that are visually rigid to a humanâe.g., static rooms or static landscapes viewed with small camera motionâsystematically present high IR (most background correspondences agree with one global model) and low GE (aligned inliers are tight). The reconstructed point clouds look compact with clean planes and straight edges; tiny reprojection jitter is perceptually negligible. When humans perceive background instabilityâe.g., subtle âbreathingâ of buildings, bending railings, or tearing near depth discontinuitiesâthe geometry mirrors that: IR drops (more outliers against a single model) and/or GE rises (inlier alignment loosens). In rows where DUSt3R fails to return a pose for the firstâlast pair (because the displacement is too large or the texture is degenerate), the reconstruction is sparse or absent. By our evaluation policy, those cases are labeled F, and they correlate with visible large parallax or scene changes. Overall, the qualitative impressions match the quantitative trend: visually cleaner reconstructions coincide with IâRâ„0.97IRâ„ 0.97 and GâEâ€3.5GE†3.5, whereas visually degraded ones violate one or both. Fig. 15 presents object-centric optical-flow slices used by our foreground metric. Horizontally, we sample representative seeds; vertically, we juxtapose platforms. For each object mask and frame pair, hue encodes the direction of the per-cell median flow (magnitude is normalized for visualization only). When an object undergoes near-rigid motion (e.g., a pedestrian translating without limb swing emphasis, or a car with minimal rolling artifacts), the flow direction is coherent within the mask and stable over time. Our AdaDFRC-W2âcomputed by fitting an affine flow on the object support and measuring a Wasserstein-2 transport cost from that rigid prediction to the observed per-cell medians with adaptive reliability weightsâstays low. Non-rigid behavior (articulated limbs, fluttering texture, rolling shutterâlike distortions) and occlusion events create sharp direction changes within the mask. The hue then varies within a single frame or flips between frames; these spatio-temporal inconsistencies raise the transport needed from the rigid hypothesis to the observed distribution, yielding a higher AdaDFRC-W2. Cross-platform differences in these hue patterns align with our quantitative ranking of foreground consistency. Figure 14. Background geometry in practice. For each row, the left cell shows the seed image; the three cells on the right visualize background reconstructions and report IR/GE per platform. Missing or extremely sparse reconstructions are treated as F under our DUSt3R gate and also exhibit poor visual stability. Figure 15. Foreground motion slices used by AdaDFRC-W2. Columns pick representative seeds; rows juxtapose platforms. Within each object mask and time step, color encodes the direction of the per-cell median optical flow. Directional coherence across the mask indicates near-rigid motion and leads to low AdaDFRC-W2; intra-mask direction changes or flips expose non-rigid/unstable dynamics and increase AdaDFRC-W2. The two visual panels ground our metrics in human perception: high IR/low GE tracks âbackground feels rigid,â while low/high signals âbackground looks wrongâ; low AdaDFRC-W2 matches âobject moves as a solid,â while high values expose non-rigid or unstable motion. These qualitative correspondences validate that our thresholds produce behavior that is not merely numerical but perceptually meaningful. 7. Discussion 7.1. What GeoCon-Bench Measuresâand What It Does Not GeoCon-Bench operationalizes geometric consistency in AIGC video along two complementary, model-agnostic axes. For the background, we test whether a single global transformation explains adjacent-frame motion: either a homography (H) or a fundamental matrix (F), with the model routed by a DUSt3R translation gate on the first/last frames. For both models, we report (i) the inlier ratio (IR), defined as the fraction of background correspondences that fit the chosen model under a family-specific inlier gate, and (i) the geometric error (GE), defined as the median residual among those inliers. Inliers are defined with family-specific gates, while all GEs are evaluated and reported in the pixel domain after denormalization on the content mask. At the clip level, a background is called geometrically consistent when IRâ„0.97â„0.97 and GEâ€3.5â€3.5 px. For the foreground, AdaDFRC-W2 regresses the best affine motion inside each object mask and summarizes non-rigid residuals, exposing elastic artifacts and layer slippage that a rigid-background test cannot see. This decomposition yields interpretable diagnostics: low IR or high GE indicates cameraâscene inconsistency (violations of projective/epipolar geometry), whereas high AdaDFRC-W2 flags dynamic incoherence of movers. Crucially, GeoCon-Bench does not measure semantic fidelity; it is designed to complement, not replace, semantic metrics. The dissociation we observe between semantics and geometry underscores why a dedicated geometric axis is necessary. 7.2. Cross-Platform Trends and Where Models Diverge Because prompts are categorized into six families (C1âC6), the benchmark supports per-regime comparisons rather than a single pooled score. Three regularities emerge. First, families intended to be H-majorityâC1 (static), C2 (rotation-dominant), and C4 (static camera + moving objects)âconcentrate mass at high IR and low GE under the homography model; when discrepancies arise, they typically reflect (i) small end-to-end translational drift that pushes a minority of seeds into the F branch, or (i) segmentation leakage admitting moving edges into the background set, both surfaced as mild but systematic penalties. Second, families expected to be F-majorityâC3 (translation-dominant), C5 (complex camera motion), and C6 (geometric stress)âexhibit broader dispersion and a higher rate of F decisions; platforms diverge most in how parallax is realized (amount of depth-induced motion, stabilization priors), which manifests as different balances of IR versus GE. Third, failure handling matters: present-only results isolate pure geometry where DUSt3R succeeds, whereas a conservative failâ view additionally counts first/last configurations whose displacement prevents pose recoveryâan informative signal under stress conditions. At the seed-aligned level (same seed across platforms), two divergence types are actionable. One is routing disagreement: the same seedâfamily pair routes to H on one platform but to F on another, indicating distinct camera priors or depth realism; such cases dominate off-diagonal cells in cross-platform alignment maps and co-occur with GE shifts. The other is agreement with different margins: all platforms agree on H (or F), yet one sits closer to the IR/GE boundaryâthese ânear-failâ seeds are highly sensitive to training or decoding changes and thus serve as high-yield regression tests. Finally, the anomaly distribution separates families where dispersion is intrinsic (C6) from those where instability is a warning sign (C2, C4). Together, these trends motivate reporting per-family, seed-aligned summaries in addition to pooled scores: they are diagnostic, reproducible, and immediately actionable for model development. 7.3. SemanticâGeometric Dissociation and Why It Matters High semantic alignment (e.g., CLIP) does not guarantee geometric correctness. We substantiate this with two independent lenses. (i) Thresholded reliability. Under a fixed, pixel-domain reporting gate (IRâ„0.97â„0.97, GEâ€3.5â€3.5 px), a substantial fraction of clips that score highly on CLIP fail the background rigidity check or exhibit elevated AdaDFRC-W2. This persists whether the background model is auto-selected by DUSt3R or forced per-family (H for C1/2/4, F for C3/5/6), indicating that the dissociation is not a routing artifact (see Fig. 13). (i) Distributional stability. Across CLIP deciles, both the pass rate for background consistency and the distribution of foreground residuals change weakly, if at all, despite large semantic swingsâagain pointing to orthogonality. Mechanistically, textâvision alignment systems reward object/texture plausibility and global style, whereas our geometry axis constrains cameraâscene relations and rigidity. Video generators inherit stabilization or motion-style priors that visually improve coherence yet can suppress or misshape parallax, and they often synthesize movers with elastic shortcuts that evade semantic penalties but are penalized by AdaDFRC-W2. The implication is practical: leaderboards and ablations should report semantics and geometry as two orthogonal axes. GeoCon-Bench provides a drop-in geometric axisâbackground IR/GE in the pixel domain, plus object-level AdaDFRC-W2âso that model builders can diagnose failure modes that semantic metrics systematically miss. Releasing per-clip pose logs, masks, and fixed gates is essential for reproducibility and actionable debugging. 7.4. Limitations and Future Work Our study is deliberately scoped to geometric behaviors that are most consequential for perception-centric use. We evaluate static or near-rigid backgrounds with a single global model and summarize foreground motion with an affine proxy and distributional residuals, routed by DUSt3R into either planar/rotation or translation/parallax regimes. This design prioritizes interpretability and reproducibility, and within that operating regime, our metrics exhibit stable behavior and align with human judgments. Several methodological boundaries remain. First, the routing currently relies on a two-frame statistic; clip length, baseline, or near-degenerate configurations can bias this decision. Second, residuals are computed in the pixel domain and are mildly sensitive to sensor- or codec-induced artifacts such as rolling shutter and heavy compression. Third, backgroundâforeground separation inherits any errors in segmentation, so boundary perturbations may affect marginal cases even when coverage is reported and failure cases are handled consistently. Finally, our prompt families emphasize common scene regimes rather than exhaustive coverage. These caveats point to concrete extensions: multi-window or temporally smoothed routing that is invariant to clip length; degeneracy-aware estimation with explicit parallax and conditioning checks; residual models that account for sensor-domain effects; uncertainty- and occlusion-aware masks with consistency checks between pose and segmentation; and layered or depth-harmonized background models that retain the current interpretability while broadening applicability. Expanding the dataset with calibrated trajectories and controlled synthetic scenes will further enable stress testing and fine-grained calibration, moving the framework toward a more comprehensive standard for assessing generative video as a geometric process. Acknowledgements.To Robert, for the bagels and explaining CMYK and color spaces. References O. Bar-Tal, H. Chefer, O. Tov, C. Herrmann, R. Paiss, S. Zada, A. Ephrat, J. Hur, G. Liu, A. Raj, et al. (2024) Lumiere: a space-time diffusion model for video generation. In SIGGRAPH Asia 2024 Conference Papers, p. 1â11. Cited by: §1. M. Chu, Y. Xie, J. Mayer, L. Leal-TaixĂ©, and N. Thuerey (2020) Learning temporal coherence via self-supervision for gan-based video generation. ACM Trans. Graph. 39 (4). External Links: ISSN 0730-0301, Link, Document Cited by: §1, §2. O. Chum, J. Matas, and J. Kittler (2003) Locally optimized ransac. In Joint pattern recognition symposium, p. 236â243. Cited by: §2. O. Chum and J. Matas (2005) Matching with prosac-progressive sample consensus. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPRâ05), Vol. 1, p. 220â226. Cited by: §2, §3.3. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, et al. (2020) An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929. Cited by: §1. H. Duan, H. Yu, S. Chen, L. Fei-Fei, and J. Wu (2025) Worldscore: a unified evaluation benchmark for world generation. arXiv preprint arXiv:2504.00983. Cited by: §1. Y. Dukler, W. Li, A. Lin, and G. Montufar (2019) Wasserstein of Wasserstein loss for learning generative models. In Proceedings of the 36th International Conference on Machine Learning, K. Chaudhuri and R. Salakhutdinov (Eds.), Proceedings of Machine Learning Research, Vol. 97, p. 1716â1725. External Links: Link Cited by: §3.4. F. Fan, C. Luo, W. Gao, and J. Zhan (2023) Aigcbench: comprehensive evaluation of image-to-video content generated by ai. BenchCouncil Transactions on Benchmarks, Standards and Evaluations 3 (4), p. 100152. Cited by: §1. M. E. Fathy, A. S. Hussein, and M. F. Tolba (2011) Fundamental matrix estimation: a study of error criteria. Pattern Recognition Letters 32 (2), p. 383â391. Cited by: §2, §4.4. M. A. Fischler and R. C. Bolles (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24 (6), p. 381â395. Cited by: §2. R. Hartley and A. Zisserman (2004) Multiple view geometry in computer vision. Cambridge University Press. Cited by: §1, §2, §3.2, §4.4. J. Hessel, A. Holtzman, M. Forbes, R. L. Bras, and Y. Choi (2021) Clipscore: a reference-free evaluation metric for image captioning. arXiv preprint arXiv:2104.08718. Cited by: §2. M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter (2017) Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30. Cited by: §1. J. Ho, A. Jain, and P. Abbeel (2020) Denoising diffusion probabilistic models. Advances in neural information processing systems 33, p. 6840â6851. Cited by: §1. Z. Huang, Y. He, J. Yu, F. Zhang, C. Si, Y. Jiang, Y. Zhang, T. Wu, Q. Jin, N. Chanpaisit, et al. (2024a) Vbench: comprehensive benchmark suite for video generative models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 21807â21818. Cited by: §1, §1, §2, §2, §3.1. Z. Huang, F. Zhang, X. Xu, Y. He, J. Yu, Z. Dong, Q. Ma, N. Chanpaisit, C. Si, Y. Jiang, et al. (2024b) Vbench++: comprehensive and versatile benchmark suite for video generative models. arXiv preprint arXiv:2411.13503. Cited by: §1, §1, §2, §2, §3.1. E. Jang, H. M. Lee, S. Lee, Y. Jung, and S. S. Sundar (2025) Too good to be false: how photorealism promotes susceptibility to misinformation. In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, CHI EA â25, New York, NY, USA. External Links: ISBN 9798400713958, Link, Document Cited by: §1. D. Jiang, M. Ku, T. Li, Y. Ni, S. Sun, R. Fan, and W. Chen (2024) Genai arena: an open evaluation platform for generative models. Advances in Neural Information Processing Systems 37, p. 79889â79908. Cited by: §2. N. Kamali, K. Nakamura, A. Kumar, A. Chatzimparmpas, J. Hullman, and M. Groh (2025) Characterizing photorealism and artifacts in diffusion model-generated images. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, p. 1â26. Cited by: §1. B. Kerbl, G. Kopanas, T. LeimkĂŒhler, and G. Drettakis (2023) 3D gaussian splatting for real-time radiance field rendering.. ACM Trans. Graph. 42 (4), p. 139â1. Cited by: §1. D. Kondratyuk, L. Yu, X. Gu, J. Lezama, J. Huang, G. Schindler, R. Hornung, V. Birodkar, J. Yan, M. Chiu, et al. (2023) Videopoet: a large language model for zero-shot video generation. arXiv preprint arXiv:2312.14125. Cited by: §1. K. Lebeda, J. Matas, and O. Chum (2012) Fixing the locally optimized ransacâfull experimental evaluation. In British machine vision conference, Vol. 2. Cited by: §2. Y. Li, Y. Wu, Y. Ming, Y. Zhang, and Z. Cheng (2025) GeoAT: geometry-aware attention feature matching network. IEEE Access. Cited by: §3.5. X. Liu, X. Xiang, Z. Li, Y. Wang, Z. Li, Z. Liu, W. Zhang, W. Ye, and J. Zhang (2024a) A survey of ai-generated video evaluation. arXiv preprint arXiv:2410.19884. Cited by: §1. Y. Liu, X. Cun, X. Liu, X. Wang, Y. Zhang, H. Chen, Y. Liu, T. Zeng, R. Chan, and Y. Shan (2024b) Evalcrafter: benchmarking and evaluating large video generation models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 22139â22149. Cited by: §1. Y. Liu, K. Zhang, Y. Li, Z. Yan, C. Gao, R. Chen, Z. Yuan, Y. Huang, H. Sun, J. Gao, et al. (2024c) Sora: a review on background, technology, limitations, and opportunities of large vision models. arXiv preprint arXiv:2402.17177. Cited by: 3rd item. X. Ma, Y. Wang, G. Jia, X. Chen, Z. Liu, Y. Li, C. Chen, and Y. Qiao (2024) Latte: latent diffusion transformer for video generation. arXiv preprint arXiv:2401.03048. Cited by: §2. B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng (2021) Nerf: representing scenes as neural radiance fields for view synthesis. Communications of the ACM 65 (1), p. 99â106. Cited by: §1. R. Murai, E. Dexheimer, and A. J. Davison (2025) MASt3R-slam: real-time dense slam with 3d reconstruction priors. In Proceedings of the Computer Vision and Pattern Recognition Conference, p. 16695â16705. Cited by: §3.5. D. NistĂ©r (2004) An efficient solution to the five-point relative pose problem. IEEE transactions on pattern analysis and machine intelligence 26 (6), p. 756â770. Cited by: §2. O. ĂzyeĆil, V. Voroninski, R. Basri, and A. Singer (2017) A survey of structure from motion*.. Acta Numerica 26, p. 305â364. Cited by: §2. W. Peebles and S. Xie (2023) Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF international conference on computer vision, p. 4195â4205. Cited by: §1, §2. B. Qu, X. Liang, S. Sun, and W. Gao (2024) Exploring aigc video quality: a focus on visual harmony video-text consistency and domain distribution gap. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 6652â6660. Cited by: §1. A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, et al. (2021) Learning transferable visual models from natural language supervision. In International conference on machine learning, p. 8748â8763. Cited by: §2. N. Ravi, V. Gabeur, Y. Hu, R. Hu, C. Ryali, T. Ma, H. Khedr, R. RĂ€dle, C. Rolland, L. Gustafson, E. Mintun, J. Pan, K. V. Alwala, N. Carion, C. Wu, R. Girshick, P. DollĂĄr, and C. Feichtenhofer (2024) SAM 2: segment anything in images and videos. arXiv preprint arXiv:2408.00714. External Links: Link Cited by: Figure 2, Figure 2. A. Sarkar, H. Mai, A. Mahapatra, S. Lazebnik, D. A. Forsyth, and A. Bhattad (2024) Shadows donât lie and lines canât bend! generative models donât know projective geometry⊠for now. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 28140â28149. Cited by: §1, §2, §2. J. L. Schonberger and J. Frahm (2016) Structure-from-motion revisited. In Proceedings of the IEEE conference on computer vision and pattern recognition, p. 4104â4113. Cited by: §1. D. Sun, X. Yang, M. Liu, and J. Kautz (2018) Pwc-net: cnns for optical flow using pyramid, warping, and cost volume. In Proceedings of the IEEE conference on computer vision and pattern recognition, p. 8934â8943. Cited by: §2, §3.1. Z. Teed and J. Deng (2020) Raft: recurrent all-pairs field transforms for optical flow. In European conference on computer vision, p. 402â419. Cited by: §2, §3.1. P. H. Torr and A. Zisserman (2000) MLESAC: a new robust estimator with application to estimating image geometry. Computer vision and image understanding 78 (1), p. 138â156. Cited by: §2, §3.3. T. Unterthiner, S. Van Steenkiste, K. Kurach, R. Marinier, M. Michalski, and S. Gelly (2018) Towards accurate generative models of video: a new metric & challenges. arXiv preprint arXiv:1812.01717. Cited by: §1. T. Unterthiner, S. Van Steenkiste, K. Kurach, R. Marinier, M. Michalski, and S. Gelly (2019) FVD: a new metric for video generation. Cited by: §2. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ć. Kaiser, and I. Polosukhin (2017) Attention is all you need. Advances in neural information processing systems 30. Cited by: §1. T. Wan, A. Wang, B. Ai, B. Wen, C. Mao, C. Xie, D. Chen, F. Yu, H. Zhao, J. Yang, J. Zeng, J. Wang, J. Zhang, J. Zhou, J. Wang, J. Chen, K. Zhu, K. Zhao, K. Yan, L. Huang, M. Feng, N. Zhang, P. Li, P. Wu, R. Chu, R. Feng, S. Zhang, S. Sun, T. Fang, T. Wang, T. Gui, T. Weng, T. Shen, W. Lin, W. Wang, W. Wang, W. Zhou, W. Wang, W. Shen, W. Yu, X. Shi, X. Huang, X. Xu, Y. Kou, Y. Lv, Y. Li, Y. Liu, Y. Wang, Y. Zhang, Y. Huang, Y. Li, Y. Wu, Y. Liu, Y. Pan, Y. Zheng, Y. Hong, Y. Shi, Y. Feng, Z. Jiang, Z. Han, Z. Wu, and Z. Liu (2025) Wan: open and advanced large-scale video generative models. arXiv preprint arXiv:2503.20314. Cited by: 3rd item. S. Wang, V. Leroy, Y. Cabon, B. Chidlovskii, and J. Revaud (2024) Dust3r: geometric 3d vision made easy. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 20697â20709. Cited by: §2, §3.1, §3.2, §4.2. Y. Wang, X. Chen, X. Ma, S. Zhou, Z. Huang, Y. Wang, C. Yang, Y. He, J. Yu, P. Yang, et al. (2025) Lavie: high-quality video generation with cascaded latent diffusion models. International Journal of Computer Vision 133 (5), p. 3059â3078. Cited by: §2. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli (2004) Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing 13 (4), p. 600â612. Cited by: §1, §2. H. Xu, J. Zhang, J. Cai, H. Rezatofighi, and D. Tao (2022) Gmflow: learning optical flow via global matching. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p. 8121â8130. Cited by: §2, §3.1. R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang (2018) The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition, p. 586â595. Cited by: §1, §2. Z. Zhang, Z. Jia, H. Wu, C. Li, Z. Chen, Y. Zhou, W. Sun, X. Liu, X. Min, W. Lin, et al. (2025) Q-bench-video: benchmark the video quality understanding of lmms. In Proceedings of the Computer Vision and Pattern Recognition Conference, p. 3229â3239. Cited by: §1. Appendix A Prompt Component Lexicon This appendix provides an expanded vocabulary for the prompt components defined in our framework. Table 2. Expanded Prompt Component Lexicon Component Category Vocabulary Examples Motion Command Foundational âThis is a single continuous shotâ, âThe camera is locked downâ Camera Rotation âpans leftâ, âtilts upâ, ârolls clockwiseâ, âorbits aroundâ Camera Translation âdollies inâ, âtrucks leftâ, âcranes upâ, âmoves in a straight lineâ Figurative & Phenomenological âas if on a cinematic dolly trackâ; âcreating true motion parallaxâ; âas if mounted on a heavy concrete pillarâ; âshadows stretch realisticallyâ; âreflections move accurately across the surfaceâ Qualitative Style Realism/Fidelity âhyper-realisticâ, âphotorealisticâ, â8K resolutionâ, âsharp focusâ, âdeep depth of fieldâ, âshot on IMAX filmâ, âdocumentary styleâ Lighting âcinematic lightingâ, âgolden hourâ, âdramatic lightingâ, âstudio lightingâ, âneon glowâ, âvolumetric lightingâ Artistic Medium âin the style of a vintage filmâ, âblack and white film noirâ, âimpressionist paintingâ, âstop-motion animationâ Scene Composition Environment âa bustling city streetâ, âa serene forest pathâ, âa minimalist interiorâ, âa futuristic laboratoryâ, âa Victorian-era roomâ Geometric Structure âa long corridor with repeating archesâ, âa skyscraper with a grid of windowsâ, âa spiral staircaseâ, âa checkerboard floorâ Object Specification Material/Texture âreflective chromeâ, âmatte black finishâ, ârough stone textureâ, âsmooth glassâ Object State âa pristine new carâ, âa rusted, abandoned vehicleâ, âa blooming flowerâ Appendix B Additional Evidence for DUSt3R Translation-Gate Calibration We reassess the DUSt3R translation gate using only pairs with available poses (present-only), across all platforms and prompt families. This analysis is geometric and independent of semantic scores; background inlier gates remain fixed throughout the paper (ÏH=2 _H=2 px, ÏF=0.1 _F=0.1, with IRâ„0.97IR\!â„\!0.97 and GEâ€3.5GE\!â€\!3.5 px when background consistency is evaluated elsewhere). We quantify the operating trade-off between recall on F-expected scenes (C3/5/6) and spurious F on H-expected ones (C1/2/4) via the net benefit (18) NBâ(Ït)=TPâcâ FPN,NB( _t)= TP-c·FPN, for false-positive cost ratios câ0.5,1,2c\!â\!\0.5,1,2\. Fig. 16 shows that Ït=0.04 _t=0.04 sits close to the maxima simultaneously for all c and is thus robust to reasonable changes in cost. Figure 16. Decision-curve analysis (present-only): net benefit (TPâcâ FP)/N(TP-c·FP)/N across câ0.5,1,2c\!â\!\0.5,1,2\. The choice Ït=0.04 _t=0.04 lies near the maxima and remains robust to c. We perform B=400B=400 bootstrap resamples over the observation set (sampling units are (seed, platform, family)), compute balanced accuracy for each Ïtâ0.02,0.03,0.04,0.06,0.08 _t\!â\!\0.02,0.03,0.04,0.06,0.08\, and record both the mean± 95% CI and the best threshold per resample. Fig. 17 (left) reveals a broad performance plateau over [0.04,0.06][0.04,0.06] where confidence bands strongly overlap; the histogram (right) concentrates the best-threshold selections in the same interval, with a visible mode at 0.040.04â0.060.06. Hence Ït=0.04 _t=0.04 is either at or statistically indistinguishable from the maxima while being slightly more conservative on false positives. (a) Balanced accuracy vs. Ït _t (bootstrap mean ± 95% CI, B=400B=400). A broad plateau spans [0.04,0.06][0.04,0.06]. (b) Distribution of argâĄmax Ït _t over bootstraps; modes concentrate at 0.040.04â0.060.06. Figure 17.