Paper deep dive
ExPhy: A Benchmark for Explicit Physical Property Learning in Multi-Object Trajectory Forecasting
Rui Wang, Yeteng Wu, Xianlin Zhang, Mengshi Qi
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 92%
Last extracted: 8/26/2026, 3:45:16 AM
Summary
The paper introduces ExPhy, a benchmark for multi-object trajectory forecasting that explicitly evaluates physical property learning (mass, friction, restitution) alongside trajectory prediction. It includes 24,000 simulated scenes with in-distribution and out-of-distribution splits. The authors propose PhyODE, a physics-guided model that estimates these properties from observed trajectories to improve long-horizon forecasting accuracy, demonstrating that trajectory accuracy does not always correlate with physical property recovery.
Entities (10)
Relation Signals (9)
ExPhy → contains → 24,000 simulated physical scenes
confidence 95% · ExPhy, a multi-object trajectory forecasting benchmark containing 24,000 simulated physical scenes
ExPhy → evaluates → mass
confidence 95% · explicit object-level labels for mass, friction, and restitution
ExPhy → evaluates → friction
confidence 95% · explicit object-level labels for mass, friction, and restitution
ExPhy → evaluates → restitution
confidence 95% · explicit object-level labels for mass, friction, and restitution
PhyODE → isinstantiatedfor → ExPhy
confidence 95% · To instantiate the ExPhy evaluation, we develop PhyODE
ExPhy → hassplit → OOD-Initial
confidence 90% · two out-of-distribution (OOD) splits over physical parameters (OOD-Parameter) and initial states (OOD-Initial)
PhyODE → reduces → ADE
confidence 90% · PhyODE reduces ADE and FDE by 33.1%
PhyODE → reduces → FDE
confidence 90% · PhyODE reduces ADE and FDE by 33.1% and 31.0%
PhyODE → uses →
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Understanding object dynamics requires not only predicting future trajectories but also examining whether a model captures the physical properties that govern motion. However, existing benchmarks rarely expose object-level physical properties as explicit evaluation targets alongside trajectory forecasting. To address this gap, we introduce \emph{ExPhy}, a multi-object trajectory forecasting benchmark containing 24,000 simulated physical scenes with explicit object-level labels for mass, friction, and restitution. ExPhy provides observed and future trajectories together with an in-distribution (ID) split and two out-of-distribution (OOD) splits over physical parameters (OOD-Parameter) and initial states (OOD-Initial) for jointly evaluating trajectory forecasting and physical property estimation. We further instantiate \textsc{PhyODE}, a physics-guided model with an explicit property interface that estimates physical properties from observed trajectories and uses them for differentiable future rollout. On the long-horizon OOD-Initial setting, \textsc{PhyODE} reduces ADE and FDE by 33.1\% and 31.0\%, respectively, compared with the strongest baseline. Zero-shot evaluation on ComPhy further assesses cross-benchmark transfer. Property-level analyses reveal that accurate trajectory forecasting does not necessarily imply accurate recovery of the underlying physical properties. Code and data are available at this https URL.
Tags
Links
- Source: https://arxiv.org/abs/2608.20009v2
- Canonical: https://arxiv.org/abs/2608.20009v2
Trouble viewing inline? Open PDF directly →
Full Text
47,556 characters extracted from source content.
Expand or collapse full text
ExPhy: A Benchmark for Explicit Physical Property Learning in Multi-Object Trajectory Forecasting Rui Wang Yeteng Wu Xianlin Zhang Mengshi Qi Abstract Understanding object dynamics requires not only predicting future trajectories but also examining whether a model captures the physical properties that govern motion. However, existing benchmarks rarely expose object-level physical properties as explicit evaluation targets alongside trajectory forecasting. To address this gap, we introduce ExPhy, a multi-object trajectory forecasting benchmark containing 24,000 simulated physical scenes with explicit object-level labels for mass, friction, and restitution. ExPhy provides observed and future trajectories together with an in-distribution (ID) split and two out-of-distribution (OOD) splits over physical parameters (OOD-Parameter) and initial states (OOD-Initial) for jointly evaluating trajectory forecasting and physical property estimation. We further instantiate PhyODE, a physics-guided model with an explicit property interface that estimates physical properties from observed trajectories and uses them for differentiable future rollout. On the long-horizon OOD-Initial setting, PhyODE reduces ADE and FDE by 33.1% and 31.0%, respectively, compared with the strongest baseline. Zero-shot evaluation on ComPhy further assesses cross-benchmark transfer. Property-level analyses reveal that accurate trajectory forecasting does not necessarily imply accurate recovery of the underlying physical properties. Code and data are available at https://github.com/Zest86/ExPhy. 1State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications 2School of Digital Media & Design Art, Beijing University of Posts and Telecommunications Beijing, China wr@bupt.edu.cn, wuyeteng@bupt.edu.cn, zxlin@bupt.edu.cn, qms@bupt.edu.cn Introduction Understanding object dynamics is a central problem in physical reasoning, as predicting future motion from observed trajectories requires accounting for the physical properties that shape how objects move and interact (Battaglia et al. 2016; Watters et al. 2017). Humans exhibit intuitive physical reasoning from early development, such as anticipating motion, collision outcomes, and material responses (Davis 2008; Spelke and Kinzler 2007; Wu 2024; Qi et al. 2026b; Qi et al. 2026a). In dynamic multi-object interactions, properties such as mass, friction, and restitution govern inertial response, tangential contact behavior, and collision rebound, respectively. Existing evaluations of object-centric physical dynamics commonly focus on future outcomes or predicted trajectories, while estimation of the underlying object-level properties is often assessed separately or not at all. This distinction matters because low trajectory error does not necessarily imply accurate physical property estimation. It therefore motivates evaluating trajectory forecasting alongside explicit object-level property learning. Figure 1: Comparison between existing benchmarks and the proposed ExPhy benchmark. (a) Existing benchmarks primarily supervise future outcomes, while object-level physical properties are often represented implicitly or indirectly and are unavailable as dedicated evaluation targets. (b) ExPhy provides explicit continuous-valued labels for mass, friction, and restitution, enabling joint evaluation of trajectory forecasting and physical property estimation. Table 1: Comparison of representative physical reasoning benchmarks. ∘ denotes property-dependent evaluation without direct property targets. Obj. denotes direct object-level property evaluation; Cont. denotes continuous parameter regression; Traj. denotes trajectory-level forecasting; and OOD denotes a controlled distribution-shift protocol. Dataset Phys. Prop. Eval. Traj. Eval. OOD Eval. Obj-level Cont. CLEVRER [ICLR20] × × × × Super-CLEVR [CVPR23] × × × ✓ Physion++ [NeurIPS23] ∘ × × × ComPhy [TPAMI25] ✓ × × × PhysBench [ICLR25] ✓ × × × PhysInOne [CVPR26] ✓ ✓ × × ExPhy (Ours) ✓ ✓ ✓ ✓ Despite recent progress in physical reasoning and dynamics prediction, existing benchmarks still largely emphasize future-outcome prediction or task-specific reasoning, including future-state prediction, physical question answering, and event plausibility judgment (Yi et al. 2020; Wang et al. 2023; Bear et al. 2021; Chen et al. 2025; Qi et al. 2025a; Wang et al. 2026). As illustrated in Fig. 1 and summarized in Table 1, object-level physical factors are often represented implicitly or indirectly, rather than exposed as dedicated object-level evaluation targets. To address this gap, we introduce ExPhy, a benchmark for joint trajectory and physical-property evaluation in multi-object trajectory forecasting. ExPhy comprises 24k simulated dynamic scenes with observed and future trajectories and explicit object-level labels for mass, friction, and restitution. Together with dedicated in-distribution (ID) and out-of-distribution (OOD) splits, it enables unified evaluation of trajectory forecasting, physical property estimation, and generalization under controlled distribution shifts. With ExPhy, we distinguish two complementary questions: whether a model forecasts future trajectories accurately and whether its estimated physical properties agree with the underlying simulator parameters. Existing trajectory forecasting models typically learn future states directly from observed trajectories through graph interactions, Transformers, or latent dynamics models (Li et al. 2020; Han et al. 2022; Huang et al. 2022; Liu et al. 2023; Wen et al. 2022; Fang et al. 2025; Fu et al. 2025; Qi et al. 2025b). Although effective under ADE/FDE, their internal variables need not correspond to physically meaningful properties. To instantiate the ExPhy evaluation, we develop PhyODE, a physics-guided hybrid model that estimates object-level physical properties from observed trajectories and uses them for differentiable future rollout. Property labels are used as training supervision but are never provided as inference inputs. We evaluate PhyODE under ID and OOD settings, conduct zero-shot transfer to ComPhy, and analyze object-level property estimation. Together, these experiments expose the distinction between accurate trajectory forecasting and accurate physical property estimation. The main contributions are summarized as follows: (1) We introduce ExPhy, a benchmark comprising 24k multi-object scenes with explicit object-level labels for mass, friction, and restitution, together with ID, OOD-Parameter, and OOD-Initial evaluation protocols. (2) We develop PhyODE, a physics-guided hybrid model with an explicit property interface that estimates object-level physical properties from observed trajectories and uses them for differentiable future rollout. (3) Extensive experiments demonstrate competitive ID/OOD and cross-benchmark forecasting, and reveal that trajectory accuracy and physical property accuracy are related but distinct evaluation dimensions. Related Work Physical Reasoning Benchmarks. Existing benchmarks evaluate complementary aspects of physical understanding. CLEVRER (Yi et al. 2020) focuses on causal and future-event reasoning, while Super-CLEVR (Li et al. 2023b) introduces controlled domain shifts for compositional visual reasoning. Physion and Physion++ (Bear et al. 2021; Tung et al. 2023) primarily evaluate future-contact or outcome prediction, which require inferring latent mechanical properties. ComPhy (Chen et al. 2025) directly evaluates object-level mass and charge through categorical targets, whereas PhysBench (Chow et al. 2025) assesses broader physical properties through multiple-choice questions. PhysInOne (Zhou et al. 2026b) further supports continuous parameter estimation and physics-based resimulation. Overall, prior benchmarks address property reasoning, future prediction, and distribution shifts, but largely through separate protocols. ExPhy instead unifies direct continuous object-level property evaluation, future trajectory forecasting, and controlled extrapolation over physical parameters and initial states. Trajectory and Dynamics Forecasting. Trajectory forecasting methods predict future motion using recurrent networks (Alahi et al. 2016; Qi et al. 2020), Transformers (Zhang et al. 2024; Zhou et al. 2025), interaction models, or generative frameworks (Fu et al. 2025; Fang et al. 2025). Despite strong ADE/FDE performance, their representations need not correspond to physically meaningful object properties. Physics-informed methods introduce analytical dynamics, differentiable simulators, or structural constraints (Tang et al. 2023; Le Cleac’h et al. 2023; Xu et al. 2024; Wang et al. 2025), while Neural ODE approaches (Huang et al. 2020; Wen et al. 2022; Luo et al. 2023; Yuan et al. 2024) model continuous-time evolution. However, these models often use entangled latent states without direct supervision or evaluation of named physical properties. Physical Property Learning. Related studies infer hidden physical properties from visual observations or interactions. Latent dynamics approaches (Battaglia et al. 2016; Watters et al. 2017; Zhu et al. 2024) encode physical information without requiring interpretable variables. Direct estimators predict quantities such as mass, material, or interaction parameters, but may rely on appearance cues (Wu et al. 2015; Standley et al. 2017), semantic priors (Zhai et al. 2024), multi-view observations (Li et al. 2023a), or foundation models (Zhan et al. 2026). Property estimation is also commonly evaluated separately from future trajectory forecasting. PhyODE instead estimates mass, friction, and restitution from observed trajectories and integrates them into differentiable rollout, enabling trajectory and property evaluation within a single model. ExPhy benchmark We introduce ExPhy, a benchmark for jointly evaluating multi-object trajectory forecasting and explicit physical property estimation. ExPhy provides observed and future trajectories together with object-level mass, friction, and restitution annotations, as well as controlled distribution shifts over physical parameters and initial states. Problem Formulation. Each ExPhy instance contains the observed trajectories of N interacting objects. For each object i∈1,…,Ni∈\1,…,N\, let it=[xit,yit,zit]⊤∈ℝ3x_i^t=[x_i^t,y_i^t,z_i^t] ^3 denote its 3D position at time step t, and let i,obs=(i1,…,iTobs)X_i,obs=(x_i^1,…,x_i^T_obs) denote its observed trajectory. We collect all object trajectories as obs=(1,obs,…,N,obs)∈ℝN×Tobs×3X_obs=(X_1,obs,…,X_N,obs) ^N× T_obs× 3. Given obsX_obs, the primary task is to predict the future trajectories ^pred∈ℝN×Tpred×3 X_pred ^N× T_pred× 3 over the following TpredT_pred steps. ExPhy additionally provides an explicit property vector i=[mi,μi,ei]⊤p_i=[m_i, _i,e_i] for each object, corresponding to mass, friction, and restitution. These labels are not provided as inference inputs, but support property-supervised training and property-level evaluation. Figure 2: Overview of the ExPhy benchmark. (a) Benchmark construction and annotation pipeline. (b) ID, OOD-Parameter, and OOD-Initial evaluation protocols. Blue and red denote ID and OOD variables, respectively; the blue dashed box and red-shaded outer region mark their location ranges, while arrows depict initial velocities. Dataset Construction ExPhy is constructed using the PyBullet physics engine (Coumans and Bai 2016) to generate controllable multi-object rigid-body interactions. Each scene contains 3–8 objects with diverse geometric shapes, including cubes, cylinders, and spheres. Their initial states and physical properties are sampled from predefined distributions to produce diverse motion patterns and collision events. ExPhy contains 24k dynamic scenes. ExPhy-A comprises 20k scenes, split into 16k/2k/2k training, validation, and test sets, while ExPhy-B and ExPhy-C each contain 2k held-out OOD test scenes. Object trajectories and object-level mass, friction, and restitution labels are recorded directly from the simulator. Figure 2 illustrates the construction and evaluation protocols, and Table 2 summarizes the sampling ranges. Table 2: Sampling ranges and supports for the ExPhy splits. For friction and restitution, one of the two listed intervals is selected uniformly at random before sampling within it. ExPhy-B shifts the physical-property distributions, whereas ExPhy-C shifts the initial-state distributions. “Same” denotes the corresponding ExPhy-A setting. Variable ExPhy-A ExPhy-B ExPhy-C Physical properties Mass m [0.1,10][0.1,10] [10.01,15][10.01,15] Same Friction μ [0.35,0.60][0.35,0.60] [0.25,0.34][0.25,0.34] Same [0.70,0.95][0.70,0.95] [0.96,1.00][0.96,1.00] Restitution e [0.15,0.40][0.15,0.40] [0.05,0.14][0.05,0.14] Same [0.55,0.85][0.55,0.85] [0.86,0.95][0.86,0.95] Initial state Location i,xy1x_i,xy^1 [−7,7]2[-7,7]^2 Same [−10,10]2∖[−7,7]2[-10,10]^2 [-7,7]^2 Velocity i,xy1v^1_i,xy [−3,3]2[-3,3]^2 Same ([−5,−3]∪[3,5])2 ([-5,-3]∪[3,5] )^2 Figure 3: Overview of PhyODE. The physical property estimator ℱψF_ψ combines raw motion, invariant trajectory, and pairwise relation features to estimate object-level mass, friction, and restitution. Conditioned on these properties, the differentiable trajectory solver ϕG_φ combines frictional dissipation and discrete collision updates with a residual Neural ODE, and uses RK4 integration to forecast future trajectories. Explicit Physical Property Labels For each object i, ExPhy provides an explicit physical property vector i=[mi,μi,ei]⊤p_i=[m_i, _i,e_i] , comprising mass, friction, and restitution. These labels correspond to the simulator mass, lateral friction coefficient, and restitution parameters, which affect inertial response, tangential contact behavior, and collision rebound, respectively. The property labels are recorded directly from the simulation configuration and remain constant for each object throughout a scene. Because these properties are not directly observable from a single 3D position, their estimation relies on temporal motion and inter-object interaction cues. The explicit annotations support supervised property learning and direct object-level property evaluation. The sampling ranges across ExPhy-A/B/C are summarized in Table 2. Evaluation Protocols To evaluate generalization beyond the training distribution, ExPhy provides three complementary splits. ExPhy-A (In-Distribution) follows the same physical-property and spatial distributions across training, validation, and test sets, and measures standard interpolation performance. ExPhy-B (OOD-Parameter) evaluates extrapolation to unseen physical properties by sampling mass, friction, and restitution outside the training ranges while retaining the same spatial distribution. ExPhy-C (OOD-Initial) evaluates extrapolation to unseen initial states by shifting both the initial-location and initial-velocity distributions while preserving the ExPhy-A physical-property ranges. All models are trained on ExPhy-A and directly evaluated on ExPhy-B/C without fine-tuning. We further define three observation-prediction horizons: Short (1010–1010), Mid (2020–4040), and Long (3030–6060), covering increasingly challenging forecasting durations. Methodology Overview As shown in Figure 3, PhyODE is a physics-guided hybrid model that couples an explicit property estimator with a differentiable trajectory solver. Given obsX_obs, ℱψF_ψ estimates object-level mass, friction, and restitution, which condition ϕG_φ to combine physics-based dynamics with a residual Neural ODE and produce ^pred X_pred. The model is trained end-to-end with trajectory and property supervision, while inference uses only the observed trajectories without ground-truth property labels. Explicit Physical Property Estimator ℱψF_ψ Given the observed scene trajectories obs=i,obsi=1N∈ℝN×Tobs×3X_obs=\X_i,obs\_i=1^N ^N× T_obs× 3, the estimator extracts complementary cues through three encoding branches. The raw motion encoder captures coordinate-level temporal evolution from positions and their first- and second-order differences: iraw=fraw([i,obs;Δi,obs;Δ2i,obs]),h^raw_i=f_raw ( [X_i,obs; _i,obs; ^2X_i,obs ] ), (1) where Δi,obs _i,obs and Δ2i,obs ^2X_i,obs represent the finite-difference velocities and accelerations, respectively. Complementarily, the invariant descriptor encoder summarizes trajectory geometry independently of absolute coordinates: iinv=finv(Φinv(i,obs)),h^inv_i=f_inv ( _inv(X_i,obs) ), (2) where Φinv _inv concatenates relative temporal changes and motion-magnitude statistics, with the complete descriptor definition provided in the supplementary material. The pairwise relation encoder captures interaction-dependent physical cues. For each object pair (i,j)(i,j), relation features are constructed from relative positions, relative velocities, and pairwise distances, and then aggregated using learned attention weights: ij=Φpair(i,obs,j,obs),ipair=∑j≠iαijfpair(ij).r_ij= _pair (X_i,obs,X_j,obs ), ^pair_i= _j≠ i _ijf_pair(r_ij). (3) This aggregation is permutation equivariant with respect to object ordering and allows the estimator to identify physical cues revealed through inter-object interactions. The three branch representations are fused into an object-level latent feature: i=ffusion([iraw;iinv;ipair]).h_i=f_fusion ( [h^raw_i;h^inv_i;h^pair_i ] ). (4) The fused feature is decoded by three property-specific regression heads to produce ^i=[m^i,μ^i,e^i]⊤=ℱψ(obs)i p_i=[ m_i, μ_i, e_i] =F_ψ(X_obs)_i. We use a Softplus output for positive mass prediction and sigmoid outputs to constrain friction and restitution to [0,1][0,1]. Physics-Based Hybrid Trajectory Solver ϕG_φ Hybrid dynamics formulation. Given the estimated object-level physical properties ^i=[m^i,μ^i,e^i]⊤ p_i=[ m_i, μ_i, e_i] , the trajectory solver rolls out future object states in continuous time. We use i(t)x_i(t) to denote the continuous-time counterpart of the discretely observed coordinates itx_i^t. For each object i, we define an eight-dimensional state i(t)=[i(t),i(t),θi(t),ωi(t)]z_i(t)=[x_i(t),v_i(t), _i(t), _i(t)], where i(t)=[xi(t),yi(t),zi(t)]x_i(t)=[x_i(t),y_i(t),z_i(t)] contains the 3D coordinates, i(t)=[vi,x(t),vi,y(t),vi,z(t)]v_i(t)=[v_i,x(t),v_i,y(t),v_i,z(t)] denotes the corresponding velocity, and θi(t) _i(t) and ωi(t) _i(t) represent scalar planar orientation and angular velocity, respectively. Let (t)=[1(t),…,N(t)]Z(t)=[z_1(t),…,z_N(t)] and ^=[^1,…,^N] P=[ p_1,…, p_N]. The hybrid dynamics combine a property-conditioned physics branch with a learnable residual vector field: d(t)dt=fDPE((t),^)+λresfϕres((t),t). dZ(t)dt=f_DPE (Z(t), P )+ _resf_φ^res (Z(t),t ). (5) Here, fDPEf_DPE models the continuous dynamics under kinetic friction, while fϕresf_φ^res provides learned corrections to the translational and angular derivatives. The DPE additionally handles collision detection and impulse-based state updates during rollout. Physics-based dynamics and numerical rollout. During each collision-free interval, the continuous component of the DPE advances the translational and angular states according to di(t)dt dx_i(t)dt =i(t), =v_i(t), di(t)dt dv_i(t)dt =−μ^igi,∥(t)∥i,∥(t)∥2+ϵ, =- μ_ig v_i, (t)\|v_i, (t)\|_2+ε, (6) dθi(t)dt d _i(t)dt =ωi(t), = _i(t), dωi(t)dt d _i(t)dt =0, =0, where g is the gravitational acceleration, i,∥(t)v_i, (t) is the velocity tangent to the supporting surface, and ϵε ensures numerical stability. This defines the continuous DPE step, followed by impulse-based collision updates to the linear and angular velocities. After continuous integration, the DPE applies an impulse-based update to each detected collision. Superscripts −- and ++ denote the states immediately before and after the impulse update, respectively. For an approaching pair (i,j)(i,j), let ijn_ij and ijt_ij denote the contact normal and tangent, and define the corresponding relative velocities as vijn=(i−j−)⊤ijv_ij^n=(v_i^--v_j^-) n_ij and vijt=(i−j−)⊤ijv_ij^t=(v_i^--v_j^-) t_ij. The normal and tangential impulse components are Jijn=−(1+e^ij)vijn/(m^i−1+m^j−1)J_ij^n=-(1+ e_ij)v_ij^n/( m_i^-1+ m_j^-1) and Jijt=−μ^ij|Jijn|sign(vijt)J_ij^t=- μ_ij|J_ij^n|sign(v_ij^t), respectively. Defining the total impulse as ij=Jijnij+JijtijJ_ij=J_ij^nn_ij+J_ij^tt_ij, the linear and angular velocities are updated by i+ _i^+ =i−+m^i−1ij, =v_i^-+ m_i^-1J_ij, j+ _j^+ =j−m^j−1ij, =v_j^-- m_j^-1J_ij, (7) ωi+ _i^+ =ωi−+JijtriIi, = _i^-+ J_ij^tr_iI_i, ωj+ _j^+ =ωj−JijtrjIj. = _j^-- J_ij^tr_jI_j. Here, the DPE uses the symmetric pairwise coefficients e^ij=(e^i+e^j)/2 e_ij=( e_i+ e_j)/2 and μ^ij=(μ^i+μ^j)/2 μ_ij=( μ_i+ μ_j)/2. The effective planar object scale rir_i is obtained from the observed state and defines the corresponding effective moment of inertia Ii=12m^iri2I_i= 12 m_ir_i^2. The instantaneous impulse update changes the linear and angular velocities while leaving ix_i and θi _i unchanged. Let k=(t0+kΔt)Z_k=Z(t_0+k t) denote the rollout state at the k-th prediction step. At each step, the DPE computes the property-conditioned friction and collision responses from the current state. These physics-based dynamics are combined with the residual vector field and integrated using RK4: k+1=RK4(k,fDPE+λresfϕres,Δt).Z_k+1=RK4 (Z_k,f_DPE+ _resf_φ^res, t ). (8) After TpredT_pred steps, the predicted trajectories are ^pred=[Π(1),…,Π(Tpred)]∈ℝN×Tpred×3, X_pred= [ _x(Z_1),…, _x(Z_T_pred) ] ^N× T_pred× 3, (9) where Π(k)∈ℝN×3 _x(Z_k) ^N× 3 extracts the 3D coordinates of all objects at prediction step k. Training Objective PhyODE is trained end-to-end using both trajectory supervision and physical-property supervision. The trajectory loss is defined over all objects and future time steps: ℒtraj=1NTpred∑i=1N∑t=1Tpred‖^it−it‖22,L_traj= 1NT_pred _i=1^N _t=1^T_pred \| x_i^t-x_i^t \|_2^2, (10) where N denotes the number of objects in the scene. For physical-property supervision, prediction errors are normalized using fixed property-specific scales rpr_p, shared across training and evaluation. The property loss is then given by ℒprop=13N∑i=1N∑p∈m,μ,eSmoothL1(p^i−pirp).L_prop= 13N _i=1^N _p∈\m,μ,e\SmoothL1 ( p_i-p_ir_p ). (11) The overall training objective is ℒtotal=ℒtraj+λpropℒprop,L_total=L_traj+ _propL_prop, (12) where λprop _prop balances trajectory forecasting and physical property estimation. Table 3: Quantitative comparison of trajectory forecasting error (ADE/FDE ↓ ) on ExPhy-A, ExPhy-B and ExPhy-C. Lower is better. The prediction horizons are explicitly defined based on observation-prediction steps (TobsT_obs-TpredT_pred): Short (10-10), Mid (20-40), and Long (30-60). † indicates trajectory-only adaptations of physical reasoning baselines, where visual/perceptual frontends are replaced with trajectory encoders while preserving their original reasoning mechanisms. The baselines are grouped according to their primary inductive biases. Bold and underlined indicate the best and second-best results, respectively. Methods ExPhy-A (In-Distribution) ExPhy-B (OOD-Parameter) ExPhy-C (OOD-Initial) Short Mid Long Short Mid Long Short Mid Long Physical reasoning baselines VRDP† [NeurIPS21] 0.04/0.08 0.28/0.58 0.41/0.83 0.04/0.08 0.29/0.61 0.45/0.92 0.12/0.23 0.93/1.93 2.13/4.23 PHYCINE† [CVPR23] 0.04/0.08 0.34/0.66 0.46/0.90 0.04/0.08 0.36/0.70 0.51/1.01 0.12/0.21 1.12/2.15 1.95/3.86 PCR† [TPAMI25] 0.05/0.10 0.28/0.57 0.48/0.94 0.05/0.10 0.28/0.58 0.52/1.04 0.14/0.28 0.67/1.47 1.58/3.27 Geometric dynamics baselines PAINET [ICLR26] 0.05/0.10 0.27/0.57 0.40/0.81 0.06/0.11 0.29/0.60 0.43/0.90 1.32/1.33 2.16/3.65 2.46/5.14 GSE-Flow [ICML26] 0.13/0.24 0.28/0.59 0.52/0.99 0.12/0.24 0.29/0.64 0.53/1.07 0.47/0.89 1.17/2.07 2.66/4.60 General-purpose trajectory forecasting baselines MoFlow [CVPR25] 0.07/0.11 0.27/0.53 0.40/0.76 0.07/0.11 0.28/0.56 0.41/0.81 0.44/0.58 1.04/1.97 1.85/3.47 Neuralized MRF [ICLR25] 0.09/0.18 0.68/1.33 0.90/1.73 0.10/0.20 0.73/1.47 1.07/2.02 0.51/1.01 2.61/5.40 4.07/7.98 PRF [CVPR26] 0.04/0.09 0.29/0.60 0.42/0.85 0.05/0.10 0.30/0.63 0.49/1.02 0.12/0.25 0.91/1.98 1.45/2.90 Physics-guided dynamics PhyODE 0.03/0.07 0.26/0.51 0.36/0.75 0.04/0.07 0.25/0.51 0.40/0.85 0.07/0.13 0.48/1.08 0.97/2.00 Experiments Settings Datasets. We evaluate all methods on the three ExPhy splits. ExPhy-A contains 20k in-distribution scenes, divided into 16k/2k/2k training, validation, and test sets. ExPhy-B and ExPhy-C each contain 2k held-out test scenes. ExPhy-B (OOD-Parameter) shifts the object-level physical-property distributions, whereas ExPhy-C (OOD-Initial) shifts both initial locations and velocities. All models are trained on the ExPhy-A training set, with checkpoints selected on its validation set, evaluated on the ExPhy-A test set and ExPhy-B/C without fine-tuning. We additionally evaluate cross-benchmark transfer on ComPhy (Chen et al. 2025), an independently constructed video reasoning benchmark centered on hidden mass and charge. We repurpose its object trajectories for forecasting and evaluate the ExPhy-trained models without fine-tuning. Compared Methods. We compare PhyODE with representative baselines for trajectory forecasting and physical property estimation. For trajectory forecasting, physical reasoning baselines include VRDP (Ding et al. 2021), PHYCINE (Tang et al. 2023), and PCR (Chen et al. 2025), whose visual frontends are replaced with trajectory encoders. Geometric dynamics baselines include PAINET (Yang et al. 2026) and GSE-Flow (Wu et al. 2026), while general-purpose forecasting baselines include MoFlow (Fu et al. 2025), Neuralized MRF (Fang et al. 2025), and PRF (Zhou et al. 2026a). All methods use the same observed trajectories and prediction horizons. For property estimation, Mean and Uniform Random are input-free baselines. Mean uses the empirical ExPhy-A training means, while Uniform Random independently samples mass from U[0.1,10]U[0.1,10] and friction and restitution from U[0,1]U[0,1] for each test object. Temporal MLP, Transformer, and Object-GNN are supervised property predictors trained on ExPhy-A labels. Ground-truth properties are never provided at inference. Metrics. We evaluate trajectory forecasting using Average Displacement Error (ADE) and Final Displacement Error (FDE), which measure the average prediction error over all future steps and the error at the final step, respectively. Physical property estimation is evaluated using normalized mean absolute error (NMAE) for mass, friction, and restitution. We divide the corresponding MAEs by the fixed scales (rm,rμ,re)=(9.9,1,1)(r_m,r_μ,r_e)=(9.9,1,1), where rmr_m is the ExPhy-A mass span and rμ,rer_μ,r_e are the spans of the admissible coefficient domains [0,1][0,1]. The same scales are used for all splits, and the average NMAE is the unweighted mean across the three properties. Lower is better for all metrics. Table 4: Zero-shot transfer results on ComPhy. All models are trained on ExPhy-A and directly evaluated on ComPhy without fine-tuning. We report ADE/FDE (↓ ). † indicates trajectory-only adaptations of physical reasoning baselines. Best and second-best results are shown in bold and underlined, respectively. Methods ComPhy [TPAMI25] Short Mid Long Physical reasoning baselines VRDP† [NeurIPS21] 0.13/0.23 0.51/0.92 0.79/1.32 PHYCINE† [CVPR23] 0.13/0.24 0.56/0.99 0.84/1.41 PCR† [TPAMI25] 0.19/0.34 0.77/1.41 1.15/2.00 Geometric dynamics baselines PAINET [ICLR26] 0.27/0.36 1.70/3.52 1.56/2.78 GSE-Flow [ICML26] 0.21/0.32 0.82/1.18 1.42/1.95 General-purpose trajectory forecasting baselines MoFlow [CVPR25] 0.24/0.37 0.89/1.50 1.20/1.93 Neuralized MRF [ICLR25] 0.13/0.20 0.56/0.93 0.63/1.00 PRF [CVPR26] 0.24/0.44 1.48/2.70 3.09/5.52 Physics-guided dynamics PhyODE 0.12/0.20 0.37/0.65 0.51/0.82 Implementation Details. All models are implemented in PyTorch and trained and evaluated on a single NVIDIA RTX 3090 GPU. Unless otherwise specified, baseline models follow their original implementations and are trained under the same observation-prediction horizons. We train PhyODE with AdamW using a learning rate of 1×10−41× 10^-4, weight decay of 1×10−51× 10^-5, batch size 64, and 50 epochs. Table 5: Object-level property estimation under the Long setting (Tobs=30T_obs=30). Entries report NMAE on ExPhy-A/ExPhy-B (ID/OOD-Parameter). All learned models are trained on ExPhy-A and evaluated zero-shot on ExPhy-B. “Prop. only”, “Traj. only”, and “Full” use ℒpropL_prop, ℒtrajL_traj, and their joint objective, respectively. Lower is better; bold denotes the best results, including ties. Method Mass ↓ Fric. ↓ Rest. ↓ Avg. ↓ A/B A/B A/B A/B Non-learned baselines Mean 0.25/0.77 0.17/0.34 0.22/0.41 0.21/0.51 Random 0.33/0.75 0.31/0.39 0.30/0.41 0.31/0.52 Supervised property predictors Temporal MLP 0.24/0.77 0.13/0.28 0.17/0.33 0.18/0.46 Transformer 0.25/0.77 0.11/0.24 0.14/0.27 0.17/0.43 Object-GNN 0.22/0.79 0.09/0.21 0.13/0.27 0.15/0.42 PhyODE variants PhyODE (Prop. only) 0.22/0.78 0.09/0.21 0.13/0.27 0.15/0.42 PhyODE (Traj. only) 0.30/0.99 0.63/0.63 0.26/0.41 0.40/0.68 PhyODE (Full) 0.25/0.75 0.17/0.34 0.22/0.40 0.21/0.50 Quantitative Results Trajectory forecasting. Table 3 reports ADE/FDE on ExPhy-A/B/C across three horizons. PhyODE achieves competitive ID and OOD performance, including the best Long-horizon result of 0.36/0.75 on ExPhy-A and the best ADE on ExPhy-B. Its advantage is most pronounced on ExPhy-C, reducing Long-horizon ADE/FDE from the second-best 1.45/2.90 to 0.97/2.00. Since ExPhy-C shifts both initial locations and velocities while preserving the property ranges, the pronounced gains suggest that the structured dynamics design of PhyODE is effective for long-horizon extrapolation to unseen initial states. Cross-benchmark transfer. Table 4 reports zero-shot forecasting results on ComPhy, where all models are trained only on ExPhy-A and evaluated without fine-tuning. PhyODE achieves the best performance across all horizons, with ADE/FDE of 0.12/0.20, 0.37/0.65, and 0.51/0.82 from Short to Long. Its gains over Neuralized MRF become more pronounced at the Mid and Long horizons. These results provide external validation that dynamics learned from ExPhy remain useful beyond its native scene distribution, while the sustained Mid- and Long-horizon advantages suggest that the structured dynamics design remains effective under cross-benchmark transfer. Physical property estimation. On ExPhy-A, dedicated property predictors outperform the non-learned baselines, with Object-GNN and PhyODE (Prop. only) achieving the best average NMAE of 0.15. On ExPhy-B, errors increase across all methods, especially for mass, while friction and restitution generalize more reliably; the same two models remain the strongest overall with an average NMAE of 0.42. Among the PhyODE variants, property-only supervision achieves 0.15/0.42 on ExPhy-A/B, trajectory-only supervision degrades to 0.40/0.68, and joint training improves the results to 0.21/0.50 but remains less accurate than direct property supervision. Together with the forecasting results, these findings show that low trajectory error does not necessarily imply accurate physical property estimation. Figure 4: Visualization of long-horizon trajectory forecasting on ExPhy-A, ExPhy-B, and ExPhy-C. Rows show representative methods from different model families, and columns correspond to ID/OOD splits. Red, blue, and green dots denote predicted, observed, and ground-truth trajectories, respectively. Figure 5: Qualitative property interventions under the Long setting. Red, blue, and green denote predicted, observed, and ground-truth trajectories, respectively. Qualitative Results Figure 4 compares long-horizon forecasts on ExPhy-A/B/C, while Figure 5 qualitatively examines inference-time property interventions. PhyODE produces stable predictions under both ID and OOD settings. Compared with the original rollout, fixed perturbations of ±30%± 30\% of each property range and random property replacement produce visible trajectory changes, providing qualitative evidence that the estimated properties actively influence trajectory rollout. Table 6: Component ablation of PhyODE under the Long horizon setting (TobsT_obs-Tpred=30T_pred=30-6060). We report trajectory forecasting errors as ADE/FDE (↓ ) on both ID and OOD splits. Best results are shown in bold. Variant ExPhy-A ExPhy-B ExPhy-C ADE/FDE ↓ ADE/FDE ↓ ADE/FDE ↓ w/o explicit physics 0.42/0.86 0.48/0.99 1.80/3.41 w/o Neural ODE 0.38/0.79 0.41/0.86 1.12/2.30 PhyODE 0.36/0.75 0.40/0.85 0.97/2.00 Ablation Study Table 6 evaluates the main rollout components of PhyODE. Removing explicit physics causes the largest degradation, especially on ExPhy-C, indicating the importance of property-conditioned physical rollout under OOD initial states. Removing the Neural ODE component also degrades long-horizon forecasting, suggesting that the learnable residual dynamics complement the structured physical module. Conclusion In this paper, we presented ExPhy, a benchmark for joint trajectory and physical-property evaluation in multi-object trajectory forecasting. ExPhy contains 24,000 dynamic scenes with trajectories, object-level mass, friction, restitution annotations, and controlled ID/OOD protocols. We also introduced PhyODE, a physics-guided hybrid model that explicitly estimates these properties and uses them for differentiable rollout. Experiments on ExPhy and zero-shot transfer to ComPhy show that low trajectory error does not necessarily imply accurate physical property estimation. References Alahi et al. (2016) A. Alahi, K. Goel, V. Ramanathan, A. Robicquet, L. Fei-Fei, and S. Savarese Social LSTM: human trajectory prediction in crowded spaces. In CVPR, Cited by: Trajectory and Dynamics Forecasting.. Battaglia et al. (2016) P. Battaglia, R. Pascanu, M. Lai, D. J. Rezende, et al. Interaction networks for learning about objects, relations and physics. In NeurIPS, Cited by: Introduction, Physical Property Learning.. Bear et al. (2021) D. M. Bear, E. Wang, D. Mrowca, F. J. Binder, H. F. Tung, R. Pramod, C. Holdaway, S. Tao, K. Smith, F. Sun, et al. Physion: evaluating physical prediction from vision in humans and machines. In NeurIPS, Cited by: Introduction, Physical Reasoning Benchmarks.. Chen et al. (2025) Z. Chen, S. Dong, K. Yi, Y. Li, M. Ding, A. Torralba, J. B. Tenenbaum, and C. Gan Compositional physical reasoning of objects and events from videos. IEEE Transactions on Pattern Analysis and Machine Intelligence 47 (9), p. 7689–7703. Cited by: Introduction, Physical Reasoning Benchmarks., Datasets., Compared Methods.. Chow et al. (2025) W. Chow, J. Mao, B. Li, D. Seita, V. Guizilini, and Y. Wang PhysBench: benchmarking and enhancing vision language models for physical world understanding. In ICLR, Cited by: Physical Reasoning Benchmarks.. Coumans and Bai (2016) E. Coumans and Y. Bai Pybullet, a python module for physics simulation for games, robotics and machine learning. Cited by: Dataset Construction. Davis (2008) E. Davis Physical reasoning. Foundations of Artificial Intelligence 3, p. 597–620. Cited by: Introduction. Ding et al. (2021) M. Ding, Z. Chen, T. Du, and P. Luo Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language. In NeurIPS, Cited by: Compared Methods.. Fang et al. (2025) Z. Fang, D. Hsu, and G. H. Lee Neuralized markov random field for interaction-aware stochastic human trajectory prediction. In ICLR, Cited by: Introduction, Trajectory and Dynamics Forecasting., Compared Methods.. Fu et al. (2025) Y. Fu, Q. Yan, L. Wang, K. Li, and R. Liao MoFlow: one-step flow matching for human trajectory forecasting via implicit maximum likelihood estimation based distillation. In CVPR, Cited by: Introduction, Trajectory and Dynamics Forecasting., Compared Methods.. Han et al. (2022) J. Han, W. Huang, H. Ma, J. Li, J. Tenenbaum, and C. Gan Learning physical dynamics with subequivariant graph neural networks. In NeurIPS, Cited by: Introduction. Huang et al. (2022) W. Huang, J. Han, Y. Rong, T. Xu, F. Sun, and J. Huang Equivariant graph mechanics networks with constraints. In ICLR, Cited by: Introduction. Huang et al. (2020) Z. Huang, Y. Sun, and W. Wang Learning continuous system dynamics from irregularly-sampled partial observations. In NeurIPS, Cited by: Trajectory and Dynamics Forecasting.. Le Cleac’h et al. (2023) S. Le Cleac’h, H. Yu, M. Guo, T. Howell, R. Gao, J. Wu, Z. Manchester, and M. Schwager Differentiable physics simulation of dynamics-augmented neural objects. IEEE Robotics and Automation Letters 8 (5), p. 2780–2787. Cited by: Trajectory and Dynamics Forecasting.. Li et al. (2023a) X. Li, Y. Qiao, P. Y. Chen, K. M. Jatavallabhula, M. Lin, C. Jiang, and C. Gan PAC-NeRF: physics augmented continuum neural radiance fields for geometry-agnostic system identification. In ICLR, Cited by: Physical Property Learning.. Li et al. (2020) Y. Li, T. Lin, K. Yi, D. Bear, D. Yamins, J. Wu, J. Tenenbaum, and A. Torralba Visual grounding of learned physical models. In ICML, Cited by: Introduction. Li et al. (2023b) Z. Li, X. Wang, E. Stengel-Eskin, A. Kortylewski, W. Ma, B. Van Durme, and A. L. Yuille Super-CLEVR: a virtual benchmark to diagnose domain robustness in visual reasoning. In CVPR, Cited by: Physical Reasoning Benchmarks.. Liu et al. (2023) Y. Liu, J. Cheng, H. Zhao, T. Xu, P. Zhao, F. Tsung, J. Li, and Y. Rong SEGNO: generalizing equivariant graph neural networks with physical inductive biases. In ICLR, Cited by: Introduction. Luo et al. (2023) X. Luo, J. Yuan, Z. Huang, H. Jiang, Y. Qin, W. Ju, M. Zhang, and Y. Sun HOPE: high-order graph ode for modeling interacting dynamics. In ICML, Cited by: Trajectory and Dynamics Forecasting.. Qi et al. (2026a) M. Qi, H. Ji, W. Yun, X. Zhang, and H. Ma Chain-of-evidence multimodal reasoning for few-shot temporal action localization. IEEE Transactions on Image Processing. Cited by: Introduction. Qi et al. (2025a) M. Qi, C. Lv, and H. Ma Robust disentangled counterfactual learning for physical audiovisual commonsense reasoning. IEEE Transactions on Pattern Analysis and Machine Intelligence. Cited by: Introduction. Qi et al. (2020) M. Qi, J. Qin, Y. Wu, and Y. Yang Imitative non-autoregressive modeling for trajectory forecasting and imputation. In CVPR, Cited by: Trajectory and Dynamics Forecasting.. Qi et al. (2026b) M. Qi, Y. Wu, W. Yun, X. Zhang, and H. Ma Explainable action form assessment by exploiting multimodal chain-of-thoughts reasoning. IEEE Transactions on Image Processing. Cited by: Introduction. Qi et al. (2025b) M. Qi, H. Ye, J. Peng, and H. Ma Action quality assessment via hierarchical pose-guided multi-stage contrastive regression. IEEE Transactions on Image Processing. Cited by: Introduction. Spelke and Kinzler (2007) E. S. Spelke and K. D. Kinzler Core knowledge. Am. Psychol. 10 (1), p. 89–96. Cited by: Introduction. Standley et al. (2017) T. Standley, O. Sener, D. Chen, and S. Savarese Image2mass: estimating the mass of an object from its image. In CoRL, Cited by: Physical Property Learning.. Tang et al. (2023) Q. Tang, X. Zhu, Z. Lei, and Z. Zhang Intrinsic Physical Concepts Discovery With Object-Centric Predictive Models. In CVPR, Cited by: Trajectory and Dynamics Forecasting., Compared Methods.. Tung et al. (2023) H. Tung, M. Ding, Z. Chen, D. M. Bear, C. Gan, J. B. Tenenbaum, D. L. K. Yamins, J. Fan, and K. A. Smith Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties. In NeurIPS, Cited by: Physical Reasoning Benchmarks.. Wang et al. (2025) R. Wang, M. Qi, Y. Shao, A. Zhou, and H. Ma PITN: physics-informed temporal networks for cuffless blood pressure estimation. IEEE Transactions on Mobile Computing. Cited by: Trajectory and Dynamics Forecasting.. Wang et al. (2026) R. Wang, Y. Wu, X. Zhang, and M. Qi VTO: visual tool orchestration for video anomaly detection. In ACM M, External Links: Document Cited by: Introduction. Wang et al. (2023) X. Wang, W. Ma, Z. Li, A. Kortylewski, and A. Yuille 3D-Aware Visual Question Answering about Parts, Poses and Occlusions. In NeurIPS, Cited by: Introduction. Watters et al. (2017) N. Watters, D. Zoran, T. Weber, P. Battaglia, R. Pascanu, and A. Tacchetti Visual interaction networks: learning a physics simulator from video. In NeurIPS, Cited by: Introduction, Physical Property Learning.. Wen et al. (2022) S. Wen, H. Wang, and D. Metaxas Social ODE: multi-agent trajectory forecasting with neural ordinary differential equations. In ECCV, Cited by: Introduction, Trajectory and Dynamics Forecasting.. Wu et al. (2015) J. Wu, I. Yildirim, J. J. Lim, B. Freeman, and J. Tenenbaum Galileo: perceiving physical object properties by integrating a physics engine with deep learning. In NeurIPS, Cited by: Physical Property Learning.. Wu (2024) J. Wu Physical scene understanding. AI Magazine 45 (1), p. 156–164. Cited by: Introduction. Wu et al. (2026) J. Wu, Y. Liu, R. Yu, and J. Sun Flow for future: geometric se (3)-equivariant flow matching for 3d trajectory prediction. In ICML, Cited by: Compared Methods.. Xu et al. (2024) H. Xu, T. Chen, and F. Xu Learning physical dynamics for object-centric visual prediction. arXiv preprint arXiv:2403.10079. Cited by: Trajectory and Dynamics Forecasting.. Yang et al. (2026) K. Yang, Y. Huang, J. Tao, W. Wang, and Q. Wu PAINET: a principled efficient transformer for 3d dynamics modeling. In ICLR, Cited by: Compared Methods.. Yi et al. (2020) K. Yi, C. Gan, Y. Li, P. Kohli, J. Wu, A. Torralba, and J. B. Tenenbaum CLEVRER: CoLlision Events for Video REpresentation and Reasoning. In ICLR, Cited by: Introduction, Physical Reasoning Benchmarks.. Yuan et al. (2024) J. Yuan, G. Sun, Z. Xiao, H. Zhou, X. Luo, J. Luo, Y. Zhao, W. Ju, and M. Zhang EGODE: an event-attended graph ode framework for modeling rigid dynamics. In NeurIPS, Cited by: Trajectory and Dynamics Forecasting.. Zhai et al. (2024) A. J. Zhai, Y. Shen, E. Y. Chen, G. X. Wang, X. Wang, S. Wang, K. Guan, and S. Wang Physical property understanding from language-embedded feature fields. In CVPR, Cited by: Physical Property Learning.. Zhan et al. (2026) G. Zhan, X. Ma, W. Xie, and A. Zisserman Inferring dynamic physical properties from video foundation models. In CVPR Workshops, Cited by: Physical Property Learning.. Zhang et al. (2024) Z. Zhang, Z. Ding, and R. Tian Decouple ego-view motions for predicting pedestrian trajectory and intention. IEEE Transactions on Image Processing 33 (), p. 4716–4727. Cited by: Trajectory and Dynamics Forecasting.. Zhou et al. (2026a) H. Zhou, L. Qi, X. Li, J. Zhang, Y. Liu, X. Yang, M. Fan, and F. Luo Recover to predict: progressive retrospective learning for variable-length trajectory prediction. In CVPR, Cited by: Compared Methods.. Zhou et al. (2025) J. Zhou, Y. Dong, and B. Du Siam titp: incorporating temporal information and trajectory prediction siamese network for satellite video object tracking. IEEE Transactions on Image Processing 34 (), p. 4120–4133. Cited by: Trajectory and Dynamics Forecasting.. Zhou et al. (2026b) S. Zhou, H. Wang, H. Cheng, J. Li, D. Wang, J. Jiang, Y. Jin, J. Huang, S. Mao, S. Liu, Y. Yang, H. Song, S. Wei, Z. Zhang, P. Huang, S. Liu, Z. Hao, H. Li, Y. Li, W. Zhou, Z. Zhao, Z. He, H. Wen, S. Huang, P. Yun, B. Cheng, P. K. Fu, W. K. Lai, J. Chen, K. Wang, Z. Sun, Z. Li, H. Hu, D. Zhang, C. H. Yuen, B. Wang, Z. Wang, C. Zou, and B. Yang PhysInOne: visual physics learning and reasoning in one suite. In CVPR, Cited by: Physical Reasoning Benchmarks.. Zhu et al. (2024) X. Zhu, H. Deng, H. Yuan, Y. Wang, and X. Yang Latent intuitive physics: learning to transfer hidden physics from a 3d video. In ICLR, Cited by: Physical Property Learning..