Paper deep dive
HSTGFormer: Hyper Spatial-Temporal Graph Transformer for 3D Human Pose Estimation
Ruochen Li, Shuang Chen, Wenke E, Farshad Arvin, Amir Atapour-Abarghouei
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Transformer-based methods have achieved strong performance in monocular 3D human pose estimation, but most existing approaches organise spatial and temporal reasoning as separate stages, which may weaken unified spatial-temporal interdependencies inherent in human motion and compress frame-level structural information before temporal modelling. In this paper, we propose HSTGFormer, a graph-enhanced Transformer framework that reformulates spatial-temporal reasoning as localised coupled graph aggregation over joint-time nodes. Specifically, HSTGFormer introduces a Hyper Spatial-Temporal Graph (HSTG), which decomposes global spatial-temporal reasoning into local spatial-temporal receptive fields around individual joint-time nodes by extending per-frame skeleton graphs into temporal neighbourhoods, thereby enabling structure-aware coupled reasoning while preserving local structural motion information. It further incorporates an Adaptive Dual-Scale Temporal Graph (ADSTG) to capture joint-specific temporal dependencies over complementary short- and long-range windows. A lightweight node-wise fusion module further adaptively integrates the two graph representations for each joint-time node. Experiments on Human3.6M and MPI-INF-3DHP show that HSTGFormer achieves strong accuracy with high computational efficiency.
Tags
Links
- Source: https://arxiv.org/abs/2608.12187v1
- Canonical: https://arxiv.org/abs/2608.12187v1
Trouble viewing inline? Open PDF directly →
Full Text
57,532 characters extracted from source content.
Expand or collapse full text
HSTGFormer HSTGFormer: Hyper Spatial-Temporal Graph Transformer for 3D Human Pose Estimation Ruochen Li Shuang Chen Wenke E Farshad Arvin Amir Atapour-Abarghouei Abstract Transformer-based methods have achieved strong performance in monocular 3D human pose estimation, but most existing approaches organise spatial and temporal reasoning as separate stages, which may weaken unified spatial-temporal interdependencies inherent in human motion and compress frame-level structural information before temporal modelling. In this paper, we propose HSTGFormer, a graph-enhanced Transformer framework that reformulates spatial-temporal reasoning as localised coupled graph aggregation over joint-time nodes. Specifically, HSTGFormer introduces a Hyper Spatial-Temporal Graph (HSTG), which decomposes global spatial-temporal reasoning into local spatial-temporal receptive fields around individual joint-time nodes by extending per-frame skeleton graphs into temporal neighbourhoods, thereby enabling structure-aware coupled reasoning while preserving local structural motion information. It further incorporates an Adaptive Dual-Scale Temporal Graph (ADSTG) to capture joint-specific temporal dependencies over complementary short- and long-range windows. A lightweight node-wise fusion module further adaptively integrates the two graph representations for each joint-time node. Experiments on Human3.6M and MPI-INF-3DHP show that HSTGFormer achieves strong accuracy with high computational efficiency. †email: ruochen.li@durham.ac.uk†email: shuang.chen@durham.ac.uk†email: wenke.e@durham.ac.uk†email: farshad.arvin@durham.ac.uk†email: amir.atapour-abarghouei@durham.ac.uk†affiliation: Department of Computer Science Durham University Durham, UK 1 Introduction 3D human pose estimation (HPE) aims to recover accurate human joint coordinates from input monocular 2D images, which is a crucial task in computer vision with broad research significance and related applications such as motion prediction [Yang et al.(2022)Yang, Ma, Zuo, Wang, Gong, and Cheng, Cui et al.(2023)Cui, Sun, Lu, Li, Li, Yi, and Wang], human-computer interaction [Rossol et al.(2015)Rossol, Cheng, and Basu, Huo et al.(2023)Huo, Gao, Qi, and Ju, Qiao et al.(2025)Qiao, Li, Li, Kubotani, Morishima, and Shum, Qiao et al.(2024)Qiao, Li, Li, and Shum], sports analysis [Suzuki et al.(2025)Suzuki, Tanaka, Yeung, and Fujii, Ingwersen et al.(2023)Ingwersen, Mikkelstrup, Jensen, Hannemose, and Dahl], and virtual reality [Hagbi et al.(2010)Hagbi, Bergig, El-Sana, and Billinghurst]. Unlike single-frame pose estimation [Li et al.(2022b)Li, Liu, Tang, Wang, and Van Gool, Zhao et al.(2023)Zhao, Zheng, Liu, Wang, and Chen, Yu et al.(2023)Yu, Zhang, Liu, Zhong, Liu, and Chen], video-based methods exploit both the anatomical structure of the human body and the temporal dynamics of motion. Skeleton provides strong kinematic constraints among connected joints, while consecutive frames contain motion cues that help resolve depth ambiguity, occlusion, and noisy detections. Therefore, effective 3D HPE requires comprehensive modelling of the spatial-temporal correlations of human motions. Early methods for 3D human pose estimation typically operated on individual frames and adopted CNN-based architectures to either directly regress 3D joint coordinates from images [Li and Chan(2014)] or to lift 2D keypoint detections to 3D poses using fully connected networks [Martinez et al.(2017)Martinez, Hossain, Romero, and Little]. These methods generally lack effective and explicit spatial-temporal dependency modelling, relying primarily on per-frame predictions with limited structural priors. Inspired by the representation learning capability of Transformers [Vaswani et al.(2017)Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, and Polosukhin, Devlin et al.(2019)Devlin, Chang, Lee, and Toutanova] in natural language processing, many video-based 3D HPE methods have adopted attention mechanisms to model spatial-temporal dependencies [Zhu et al.(2023)Zhu, Ma, Liu, Liu, Wu, and Wang, Zheng et al.(2021)Zheng, Zhu, Mendieta, Yang, Chen, and Ding, Tang et al.(2023)Tang, Qiu, Hao, Hong, and Yao, Peng et al.(2024)Peng, Zhou, and Mok, Mehraban et al.(2024)Mehraban, Adeli, and Taati, Liu et al.(2025)Liu, Liu, Liu, and Li, Zhang et al.(2022)Zhang, Tu, Yang, Chen, and Yuan]. To model spatial-temporal correlations, these methods employ spatial attention to capture interactions among joints within each frame, while using temporal attention to model motion dependencies across consecutive frames. Despite their strong performance, Transformer-based methods often lack explicit skeletal priors and require stacked attention layers to capture complex spatial-temporal correlations, resulting in high computational cost for long video sequences. To address these limitations, recent works [Peng et al.(2024)Peng, Zhou, and Mok, Mehraban et al.(2024)Mehraban, Adeli, and Taati, Li et al.(2026b)Li, Chen, Arvin, Atapour-Abarghouei, et al.] incorporate graphs (Fig. 1(a)) into Transformer-based frameworks to introduce explicit skeletal priors and improve spatial-temporal representation learning. By modelling human joints as graph nodes, graph-based methods provide stronger structural inductive bias and enable efficient representation learning. Figure 1: Illustration of the proposed Hyper Spatial-Temporal Graph (HSTG). (a) 2D joints are represented as graph nodes over time. (b) Existing methods decouple spatial and temporal reasoning through intra-frame skeletal aggregation followed by same-joint temporal modelling. (c) HSTG defines a localised coupled spatial-temporal receptive field around each ego node, efficiently aggregating from anatomically related joints within nearby frames. Despite recent progress, existing methods still face several limitations in spatial-temporal modelling. First, most existing methods organise spatial and temporal reasoning as two separate propagation stages, where spatial features are first extracted within each frame and subsequently passed to temporal modules for motion modelling (Fig. 1(b)). This separate process compresses frame-level structural information before temporal reasoning, limiting the ability to capture continuous spatial-temporal interdependencies [Yi et al.(2023)Yi, Zhang, Fan, He, Hu, Wang, An, Cao, and Niu, Li et al.(2025b)Li, Qiao, Katsigiannis, Zhu, and Shum, Marisca et al.(2025)Marisca, Bamberger, Alippi, and Bronstein, Li et al.(2026c)Li, Zhu, Qiao, and Shum, Li et al.(2025a)Li, Katsigiannis, Kim, and Shum]. For example, during walking, the knee and foot not only exhibit strong intra-frame anatomical coupling, but also maintain correlated local motion patterns across adjacent timesteps. However, sequential spatial-then-temporal propagation may weaken such localised spatial-temporal dependencies before coupled reasoning is established. Second, temporal modelling is often conducted over either long-range sequences or predefined receptive fields. Although recent works explore multi-scale temporal modelling [Liu et al.(2025)Liu, Liu, Liu, and Li], they still rely on fixed temporal scales, which may be insufficient for modelling joint dynamics across different motion patterns (e.g., fast-moving extremities vs. relatively stable torso joints). In this paper, we propose HSTGFormer, a graph-based Transformer framework for efficient 3D human pose estimation. It introduces a graph-enhanced spatial-temporal reasoning paradigm based on two complementary graph structures: Hyper Spatial-Temporal Graph (HSTG) and Adaptive Dual-Scale Temporal Graph (ADSTG). As shown in Fig. 1(c), HSTG moves beyond decoupled per-frame spatial and per-joint temporal receptive fields by extending skeleton graphs into localised temporal neighbourhoods, yielding a local coupled spatial-temporal receptive field for each joint-time node. This formulation preserves localized spatial-temporal interdependencies within each joint-time neighbourhood, alleviating early information compression [Marisca et al.(2025)Marisca, Bamberger, Alippi, and Bronstein] of frame-level skeletal features before temporal modelling. Through efficient graph-based aggregation, HSTG preserves anatomical priors and captures local spatial-temporal context without constructing a dense spatial-temporal graph. For temporal modelling, ADSTG constructs dynamic graphs over short- and long-range temporal windows. This allows each joint to adaptively aggregate motion dependencies from different temporal contexts, enabling flexible temporal reasoning for diverse joint motion patterns. Finally, a context-aware fusion mechanism assigns node-wise weights to HSTG and ADSTG, allowing each node to integrate complementary spatial-temporal contexts. Experiments on Human3.6M [Ionescu et al.(2013)Ionescu, Papava, Olaru, and Sminchisescu] and MPI-INF-3DHP [Mehta et al.(2017)Mehta, Rhodin, Casas, Fua, Sotnychenko, Xu, and Theobalt] show that HSTGFormer achieves strong accuracy with high computational efficiency. Our contributions are: • We propose HSTGFormer, a graph-based Transformer framework for efficient 3D human pose estimation, which reformulates spatial-temporal modelling from a graph perspective to better capture motion continuity and structural dependencies. • We introduce a Hyper Spatial-Temporal Graph (HSTG) structure (Sec. 3.2) that extends per-frame skeleton graphs to localised temporal neighbourhoods, enabling structure-aware modelling of local motion continuity while preserving human skeletal priors. • We design an Adaptive Dual-Scale Temporal Graph (ADSTG) module (Sec. 3.3) to construct and fuse dynamic temporal graphs over complementary temporal ranges, allowing joint-specific and adaptive temporal dependency modelling. 2 Related Work 2.1 Transformer for 3D Human Pose Estimation With the success of Transformers [Vaswani et al.(2017)Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, and Polosukhin] in natural language processing [Devlin et al.(2019)Devlin, Chang, Lee, and Toutanova] and computer vision [Dosovitskiy et al.(2020)Dosovitskiy, Beyer, Kolesnikov, Weissenborn, Zhai, Unterthiner, Dehghani, Minderer, Heigold, Gelly, et al., Li et al.(2026a)Li, Chang, Hu, Li, Atapour-Abarghouei, and Shum], recent works have increasingly adopted Transformer-based architectures for 3D human pose estimation. PoseFormer [Zheng et al.(2021)Zheng, Zhu, Mendieta, Yang, Chen, and Ding] introduces one of the first pure Transformer frameworks for 3D pose lifting, where spatial and temporal Transformers are stacked to jointly model spatial relationships within each frame and long-range dependencies across frames. MixSTE [Zhang et al.(2022)Zhang, Tu, Yang, Chen, and Yuan] proposes a mixed spatial-temporal encoder with an alternating seq2seq design that more effectively captures temporal dynamics of different body joints over long sequences. MotionBERT [Zhu et al.(2023)Zhu, Ma, Liu, Liu, Wu, and Wang] employs large-scale pre-training to learn general motion representations from massive pose data and adapts them to downstream 3D pose estimation tasks. STCFormer [Tang et al.(2023)Tang, Qiu, Hao, Hong, and Yao] introduces a two-pathway design for spatial-temporal modelling, enabling more expressive modeling of complex motion patterns in monocular videos. TCPFormer [Liu et al.(2025)Liu, Liu, Liu, and Li] further refines temporal context aggregation by tailoring Transformer blocks to better capture multi-scale temporal cues and mitigate motion ambiguity, leading to consistent performance gains on standard 3D pose benchmarks. However, most Transformer-based methods do not explicitly exploit human skeletal priors, often requiring deeper architectures to model complex spatial-temporal dependencies, which increases computational cost. 2.2 Graph-transformer for 3D Human Pose Estimation Due to the strong capability for modelling topological structures, graph-based methods have been widely adopted for spatial-temporal modelling in 3D human pose estimation. PoseGTAC [Zhu et al.(2021)Zhu, Xu, Shen, Ji, Gao, and Shen] combines graph atrous convolution for multi-scale neighbour aggregation with graph Transformer layers to capture long-range spatial-temporal dependencies. MotionAGFormer [Mehraban et al.(2024)Mehraban, Adeli, and Taati] integrates attention and GCN [Kipf and Welling(2017), Li et al.(2022a)Li, Katsigiannis, and Shum] branches to capture global joint relationships and local skeletal dependencies. DiffPose [Gong et al.(2023)Gong, Foo, Fan, Ke, Rahmani, and Liu] further introduces a diffusion-based framework with GCN to better encode spatial dependencies on the human skeleton and generate more reliable multi-hypothesis 3D poses under occlusion. GLA-GCN [Yu et al.(2023)Yu, Zhang, Liu, Zhong, Liu, and Chen] explores adaptive graph convolution to capture global pose representations. By adopting a strided temporal design, it reduces the effective temporal modelling range and achieves competitive performance compared with Transformer-based methods, while requiring lower memory consumption. KTPFormer [Peng et al.(2024)Peng, Zhou, and Mok] introduces kinematic and trajectory priors into spatial and temporal attention to better encode anatomical and motion constraints. However, most existing graph-transformer methods still perform spatial modelling within individual frames, limiting their ability to explicitly capture continuous spatial-temporal interdependencies during human motion. 3 Method 3.1 Problem Formulation and Overview Given an input 2D pose sequence =tt=1T∈ℝT×J×CinX=\x_t\_t=1^T ^T× J× C_in, where T is the number of frames and J is the number of body joints, each joint is represented by its 2D coordinates and confidence score. The objective is to recover the corresponding 3D pose sequence =tt=1T∈ℝT×J×CoutY=\y_t\_t=1^T ^T× J× C_out, where CinC_in and CoutC_out denote the input and output joint dimensions, respectively. Following recent Transformer-based 3D pose estimation methods [Liu et al.(2025)Liu, Liu, Liu, and Li, Mehraban et al.(2024)Mehraban, Adeli, and Taati], we first map the input sequence into a high-dimensional latent space through a linear embedding layer, producing h∈ℝT×J×DX_h ^T× J× D, where D is the hidden feature dimension. To retain joint identity information, a learnable joint-level positional encoding posP_pos is added to the embedded features. The resulting representation is then processed by a spatial-temporal Transformer encoder st=Φ(h+pos)X_st= (X_h+P_pos ), where Φ(⋅) (·) denotes the backbone encoder used to capture global spatial-temporal dependencies before graph-based reasoning. As illustrated in Fig. 2, building on the embedded pose representation hX_h, HSTGFormer performs graph-enhanced spatial-temporal reasoning through two complementary branches. The first branch, Hyper Spatial-Temporal Graph (HSTG), extends the per-frame skeleton graph to localised temporal neighbourhoods, forming a coupled spatial-temporal receptive field for each joint-time node. Through mask-constrained and factorised graph attention, HSTG captures local structural motion context while preserving anatomical connectivity priors. The second branch, Adaptive Dual-Scale Temporal Graph (ADSTG), constructs dynamic graphs over short- and long-range temporal windows, allowing each joint to adaptively aggregate motion cues from complementary temporal ranges. A context-aware node-wise fusion module then predicts adaptive weights for the two branches, enabling each joint-time node to integrate local spatial-temporal context and temporal motion dynamics. The fused graph representation is finally combined with the backbone features and fed into the regression head to estimate the 3D pose sequence. 3.2 Hyper Spatial-Temporal Graph (HSTG) Reasoning Human motion is governed by anatomical constraints and local temporal continuity, but conventional spatial-then-temporal methods model them separately: first within each frame, then along each joint trajectory. Such designs may overlook localised spatial-temporal interdependencies, where neighbouring joints exhibit correlated motion over adjacent timesteps. To address this, we introduce the Hyper Spatial-Temporal Graph (HSTG), which extends the skeleton graph from individual frames to local temporal neighbourhoods and performs structure-aware graph reasoning over joint-time nodes. Figure 2: Framework overview. HSTGFormer consists of two graph-based modules: (a) the Hyper Spatial-Temporal Graph (HSTG), which constructs localised coupled spatial-temporal receptive fields across nearby frames, and (b) the Adaptive Dual-Scale Temporal Graph (ADSTG), which models adaptive short- and long-range temporal dependencies. A node-wise fusion module then adaptively integrates graph contexts for final 3D pose estimation. Graph Construction. Given the embedded pose representation h∈ℝT×J×DX_h ^T× J× D, we construct a Hyper Spatial-Temporal Graph hyper=(,ℰhyper)G_hyper=(V,E_hyper), where each node vt,j∈v_t,j represents joint j at timestep t, and ||=TJ|V|=TJ. From the perspective of each ego node vt,jv_t,j, HSTG defines a local spatial-temporal neighbourhood by jointly considering anatomical connectivity and temporal proximity. Specifically, let spa∈0,1J×JA_spa∈\0,1\^J× J denote the skeleton adjacency matrix with self-loops, and let tem∈0,1T×TA_tem∈\0,1\^T× T denote a temporal band adjacency: [tem]t,t′=1,|t−t′|≤w,0,otherwise,[A_tem]_t,t = cases1,&|t-t |≤ w,\\ 0,&otherwise, cases (1) where w is the temporal window radius. The resulting spatial-temporal support can be represented in a Kronecker-factorised form: hyper≈tem⊗spa,A_hyper _tem _spa, (2) where ⊗ denotes the Kronecker product. Here, hyperA_hyper denotes the induced local spatial-temporal support rather than an explicitly materialised dense adjacency matrix. This factorised formulation allows HSTG to perform graph attention through spatial and temporal graph operations while preserving a localised coupled spatial-temporal receptive field. Factorised Graph Attention. The support hyperA_hyper specifies the valid local spatial-temporal neighbourhood of each joint-time node. However, explicitly performing attention over hyperA_hyper would require constructing a (TJ)×(TJ)(TJ)×(TJ) attention map, which is computationally expensive for long pose sequences. Instead, we exploit the Kronecker structure of hyperA_hyper and implement HSTG reasoning through two factorised masked graph attention [Veličković et al.(2017)Veličković, Cucurull, Casanova, Romero, Lio, and Bengio] operations: skeleton-constrained spatial attention followed by local temporal attention. Given a set of node features ∈ℝN×DF ^N× D and a binary adjacency matrix ∈0,1N×NA∈\0,1\^N× N, we define a generic masked graph attention operator [Veličković et al.(2017)Veličković, Cucurull, Casanova, Romero, Lio, and Bengio, Vaswani et al.(2017)Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, and Polosukhin] as GraphAttn(,)i=∑j∈(i)αijjv,αij=exp((iq)(jk)⊤/D)∑k∈(i)exp((iq)(kk)⊤/D), gatheredGraphAttn(F,A)_i= _j (i) _ijF_jW_v,\\ _ij= ((F_iW_q)(F_jW_k) / D ) _k (i) ((F_iW_q)(F_kW_k) / D ), gathered (3) where (i)=j∣ij=1N(i)=\j _ij=1\ denotes the masked neighbourhood of node i, and qW_q, kW_k, and vW_v are learnable projection matrices. Using this operator, we first normalise [Ba et al.(2016)Ba, Kiros, and Hinton] the embedded feature as ¯h=LN(h). X_h=LN(X_h). For each timestep t, we apply skeleton-constrained graph attention over the joint dimension: t=GraphAttnspa(¯ht,spa),Z_t=GraphAttn_spa ( X^t_h,A_spa ), (4) where ¯ht∈ℝJ×D X^t_h ^J× D denotes the joint features at timestep t. Then, for each joint j, temporal graph attention is applied over its local temporal neighbourhood: j=GraphAttntem(j,tem),H^j=GraphAttn_tem (Z^j,A_tem ), (5) where j∈ℝT×DZ^j ^T× D denotes the temporal sequence of the spatially enriched features for joint j. Finally, we apply residual refinement to obtain the HSTG output: hyper=h+σ(LN(+¯hu)),X_hyper=X_h+σ (LN (H+ X_hW_u ) ), (6) where σ(⋅)σ(·) denotes the ReLU activation. HSTG defines local joint-time receptive fields instead of sequentially separating spatial and temporal modelling. Its factorised attention preserves the localised Cartesian support between skeleton and temporal neighbours, enabling efficient spatial-temporal graph reasoning without constructing a dense attention graph. 3.3 Adaptive Dual-Scale Temporal Graph (ADSTG) Reasoning Although HSTG captures localised coupled spatial-temporal context, human motion also involves temporal dependencies at different ranges. For example, fast-moving joints require short-range cues for fine-grained motion changes, while more stable joints may benefit from longer-range context. In this paper, we propose an Adaptive Dual-Scale Temporal Graph (ADSTG), which constructs dynamic temporal graphs over complementary short- and long-range windows and fuses them in a joint-aware manner. Dynamic Temporal Graph Construction. Given the embedded pose representation h∈ℝT×J×DX_h ^T× J× D, ADSTG constructs dynamic temporal graphs along the temporal dimension. Unlike HSTG, which defines a localised coupled spatial-temporal receptive field, ADSTG focuses on selecting informative temporal neighbours for each joint-time node (t,j)(t,j) from complementary temporal ranges. Specifically, we define two centred temporal windows: m(t)=t′∣|t−t′|≤rm,m∈short,long,N_m(t)=\t |t-t |≤ r_m\, m∈\short,long\, (7) where rmr_m denotes the temporal radius of branch m. Within each window, ADSTG computes dot-product similarities between node (t,j)(t,j) and its temporal candidates (t′,j)(t ,j), and retains the top-kmk_m most similar candidates to form a sparse dynamic temporal adjacency: [m]t,t′=1,t′∈TopKkm(m(t)),0,otherwise,[A_m]_t,t = cases1,&t _k_m\! (N_m(t) ),\\ 0,&otherwise, cases (8) where shortA_short and longA_long denote the short- and long-range dynamic temporal adjacencies, respectively. This construction allows each joint-time node to adaptively select relevant temporal neighbours within local and extended temporal contexts. Dual-Scale Temporal Propagation. Given a dynamic temporal adjacency A, we define a normalised temporal graph GCN [Kipf and Welling(2017)] as TempGCN(h,)=~hv,~=−12(+)−12, gatheredTempGCN(X_h,A)= AX_hW_v,\\ A=D^- 12(A+I)D^- 12, gathered (9) where self-loops are added before symmetric normalisation, D is the degree matrix, and vW_v is a learnable projection matrix. ADSTG applies the same temporal GCN to the short- and long-range dynamic temporal adjacencies: short=TempGCN(h,short),long=TempGCN(h,long).Z_short=TempGCN(X_h,A_short), _long=TempGCN(X_h,A_long). (10) This produces two complementary temporal representations, corresponding to local motion details and extended temporal context. To combine the two temporal scales, we use a lightweight topology-aware gate based on the skeleton degree. Given spaA_spa, we compute the joint degree vector ∈ℝJd ^J and generate joint-wise scale weights G. The output of ADSTG is obtained by weighted fusion of the short- and long-range temporal representations: ada=∑m∈short,longm⊙m.X_ada= _m∈\short,long\G_m _m. (11) ADSTG complements HSTG by focusing on adaptive temporal dependency modelling. Instead of relying on a single fixed temporal neighbourhood, ADSTG constructs content-adaptive temporal graphs within short- and long-range windows, allowing each joint to select informative temporal neighbours according to its motion pattern. The joint-adaptive fusion further balances local and extended temporal contexts, providing flexible temporal reasoning for heterogeneous human motion dynamics. 3.4 Adaptive Node-wise Fusion After obtaining the HSTG feature hyperX_hyper and the ADSTG feature adaX_ada, we use two lightweight branch-specific Multilayer Perceptrons (MLP) for feature enhancement: ^hyper=MLPhyper(hyper),^ada=MLPada(ada). X_hyper=MLP_hyper(X_hyper), X_ada=MLP_ada(X_ada). (12) To adaptively combine the two graph representations, we introduce a context-aware fusion module that predicts node-wise weights for each joint-time node (t,j)(t,j). Here, spaC_spa is obtained by averaging hX_h over joints to provide frame-level context, while temC_tem is obtained by averaging over time to provide joint-level context. After broadcasting them to each joint-time node, we concatenate the token feature with spaC_spa and temC_tem, and feed the result into a lightweight MLP followed by softmax: ωhyper,ωada=Softmax(MLP[h,spa,tem]). _hyper, _ada=Softmax (MLP [X_h,C_spa,C_tem ] ). (13) The final graph representation is then computed as fuse=ωhyper⊙^hyper+ωada⊙^ada.X_fuse= _hyper X_hyper+ _ada X_ada. (14) This adaptive fusion allows each joint-time node to balance local coupled spatial-temporal reasoning from HSTG and adaptive temporal dependency modelling from ADSTG. The fused representation is then combined with the backbone Transformer encoder features [Liu et al.(2025)Liu, Liu, Liu, and Li, Mehraban et al.(2024)Mehraban, Adeli, and Taati], enabling the model to retain global spatial-temporal context while incorporating graph-enhanced motion representations. After L stacked HSTGFormer blocks, an MLP-based regression head maps the learned joint-time features to the final 3D pose sequence. 3.5 Overall Learning Objectives We optimise HSTGFormer end-to-end using a composite training objective following the commonly used protocol in recent 3D HPE methods [Liu et al.(2025)Liu, Liu, Liu, and Li]. The overall loss is defined as: ℒ=ℒmpjpe+λsℒnmpjpe+λvℒvel+λdℒdiff+λlbℒlb,L=L_mpjpe+ _sL_nmpjpe+ _vL_vel+ _dL_diff+ _lbL_lb, (15) where ℒmpjpeL_mpjpe and ℒnmpjpeL_nmpjpe measure the pose reconstruction error using MPJPE and normalised MPJPE, respectively. ℒvelL_vel supervises motion consistency through velocity differences, while ℒdiffL_diff regularises consecutive-frame variations to encourage temporally smooth predictions [Liu et al.(2025)Liu, Liu, Liu, and Li]. We set λs=0.5 _s=0.5, λv=20 _v=20, λd=0.5 _d=0.5 in all experiments. Since our fusion module assigns node-wise weights to different graph pathways, we further apply a lightweight load-balancing regularisation to avoid one pathway dominating the fusion process: ℒlb=∑r=1K(1|Ω|∑i∈Ωωri−1K)2,L_lb= _r=1^K ( 1| | _i∈ _r^i- 1K )^2, (16) where K denotes the number of graph pathways, Ω is the set of all joint-time nodes in a mini-batch, and ωri _r^i is the fusion weight assigned to pathway r for node i. 4 Experiments 4.1 Experimental Setup 4.1.1 Datasets We evaluate the proposed HSTGFormer on two standard benchmarks for monocular 3D human pose estimation: Human3.6M [Ionescu et al.(2013)Ionescu, Papava, Olaru, and Sminchisescu] and MPI-INF-3DHP [Mehta et al.(2017)Mehta, Rhodin, Casas, Fua, Sotnychenko, Xu, and Theobalt]. These two datasets provide complementary evaluation settings, with Human3.6M mainly focusing on controlled indoor scenarios and MPI-INF-3DHP covering more diverse indoor and outdoor environments. Human3.6M is a widely used 3D human pose estimation benchmark with 3.6M annotated frames from 11 subjects performing 15 actions in indoor settings. Following [Liu et al.(2025)Liu, Liu, Liu, and Li, Li et al.(2026b)Li, Chen, Arvin, Atapour-Abarghouei, et al., Mehraban et al.(2024)Mehraban, Adeli, and Taati], we train on S1, S5, S6, S7, and S8, and evaluate on S9 and S11. We report Mean Per-Joint Position Error (MPJPE) and Procrustes-aligned MPJPE (P-MPJPE) as evaluation metrics. MPI-INF-3DHP is a more challenging benchmark containing diverse indoor and outdoor motions with larger variations in viewpoints, poses, and environmental conditions, making it suitable for evaluating the generalisation ability. Following [Liu et al.(2025)Liu, Liu, Liu, and Li, Li et al.(2026b)Li, Chen, Arvin, Atapour-Abarghouei, et al., Mehraban et al.(2024)Mehraban, Adeli, and Taati], we report MPJPE, Percentage of Correct Keypoints (PCK), and Area Under the Curve (AUC). 4.1.2 Implementation Details Our framework is implemented in PyTorch and trained end-to-end using AdamW with a weight decay of 0.010.01. The feature dimension is set to 128128. Human3.6M: We train for 8080 epochs with batch size 66 and sequence length 243243. The initial learning rate is 5×10−45× 10^-4 with an exponential decay factor of 0.990.99. The short/long ADSTG windows are set to 27/8127/81 frames. Following [Mehraban et al.(2024)Mehraban, Adeli, and Taati, Liu et al.(2025)Liu, Liu, Liu, and Li], we evaluate with both ground-truth 2D keypoints and Stacked Hourglass detections [Newell et al.(2016)Newell, Yang, and Deng]. MPI-INF-3DHP: We train for 9090 epochs with batch size 66 and sequence length 8181. The initial learning rate and decay follow Human3.6M. The short/long ADSTG windows are set to 9/279/27 frames. Following [Mehraban et al.(2024)Mehraban, Adeli, and Taati, Liu et al.(2025)Liu, Liu, Liu, and Li], we use ground-truth 2D inputs for evaluation. 4.2 Quantitative Comparisons with State-of-the-Art Methods In this section, we quantitatively compare the proposed HSTGFormer with recent state-of-the-art methods on Human3.6M and MPI-INF-3DHP. The comparisons include a broad range of Transformer-based and graph-enhanced pose estimation approaches. Notably, MotionAGFormer [Mehraban et al.(2024)Mehraban, Adeli, and Taati] and TCPFormer [Liu et al.(2025)Liu, Liu, Liu, and Li] use the same backbone encoder as our method, enabling a fair comparison of the proposed graph reasoning modules. Method Venue CE T Parameter MACs MACs/frames↓ MPJPE↓ P-MPJPE↓ MHFormer [Li et al.(2022b)Li, Liu, Tang, Wang, and Van Gool] CVPR’22 ✓ 351 30.9M 7.1G 7096M 43.0 34.4 MixSTE [Zhang et al.(2022)Zhang, Tu, Yang, Chen, and Yuan] CVPR’22 ✗ 243 33.6M 139.0G 572M 40.9 32.6 P-STMO [Shan et al.(2022)Shan, Liu, Zhang, Wang, Ma, and Gao] ECCV’22 ✓ 243 6.2M 0.7G 740M 42.8 34.4 PoseFormerV2 [Zhao et al.(2023)Zhao, Zheng, Liu, Wang, and Chen] CVPR’23 ✓ 243 14.3M 0.5G 528M 45.2 35.6 GLA-GCN [Yu et al.(2023)Yu, Zhang, Liu, Zhong, Liu, and Chen] ICCV’23 ✓ 243 1.3M 1.5G 1556M 44.4 34.8 MotionBERT [Zhu et al.(2023)Zhu, Ma, Liu, Liu, Wu, and Wang] ICCV’23 ✗ 243 42.3M 174.8G 719M 39.2 32.9 MotionAGFormer-L [Mehraban et al.(2024)Mehraban, Adeli, and Taati] WACV’24 ✗ 243 19.0M 78.3G 322M 38.4 32.5 PoseRetNet [Zheng et al.(2024)Zheng, Lu, Lv, Zhang, Guo, and Wu] ECCV’24 ✗ 243 25.2M 104.5G 430M 40.4 32.5 KTPFormer [Peng et al.(2024)Peng, Zhou, and Mok] CVPR’24 ✗ 243 33.7M 69.5G 286M 40.1 31.9 H2OT++MotionAGFormer [Li et al.(2025c)Li, Liu, Liu, Wang, Lu, and Sebe] TPAMI’25 ✗ 243 11.7M 38.9G - 38.5 - TCPFormer [Liu et al.(2025)Liu, Liu, Liu, and Li] AAAI’25 ✗ 243 35.1M 109.2G 449M 37.9 31.7 Ours – ✗ 243 14.2M 58.5G 240M 37.9 31.5 Table 1: Results on Human3.6M in millimeters under MPJPE and P-MPJPE. CE indicates centre-frame prediction. T is the number of input frames. MACs/frame represents the number of multiply-accumulate operations per output frame, where a lower value indicates higher computational efficiency. Bold/underline indicates the best/second-best result. Blue rows indicate methods sharing the same backbone encoder. Indoor Monocular Human3.6M Dataset. As shown in Table 1, our method achieves highly competitive performance on Human3.6M, obtaining the best P-MPJPE of 31.531.5 m and matching the best MPJPE of 37.937.9 m among all compared methods. Compared with KTPFormer, our model reduces MPJPE from 40.140.1 m to 37.937.9 m and P-MPJPE from 31.931.9 m to 31.531.5 m, corresponding to relative improvements of 5.5%5.5\% and 1.3%1.3\%, respectively. Compared with MotionAGFormer-L, which shares the same backbone encoder, our method improves MPJPE from 38.438.4 m to 37.937.9 m and P-MPJPE from 32.532.5 m to 31.531.5 m. These results show that HSTGFormer improves pose estimation mainly through more effective graph-enhanced spatial-temporal reasoning, rather than simply increasing model capacity. Efficiency Comparison. Beyond accuracy, our method achieves a favourable accuracy-efficiency trade-off. Compared with TCPFormer, which uses the same backbone encoder, our method obtains comparable MPJPE and better P-MPJPE with 59.5%59.5\% fewer parameters and 46.5%46.5\% lower MACs/frame. It also reduces parameters and MACs/frame by 25.3%25.3\% and 25.5%25.5\% compared with MotionAGFormer-L. In-the-wild MPI-INF-3DHP Datasets. Table 2 reports the quantitative results on MPI-INF-3DHP, which contains more diverse scenes and larger motion variations than Human3.6M. Our method achieves the best overall performance. Compared with TCPFormer, which shares the same backbone encoder, our method improves AUC from 87.787.7 to 89.389.3 and reduces MPJPE from 15.015.0 m to 14.014.0 m (-6.7%). Compared with MotionAGFormer-L, our method improves AUC by 4.04.0 points and reduces MPJPE by 13.6%13.6\%. These gains on the more challenging MPI-INF-3DHP benchmark indicate that the proposed HSTG and ADSTG modules improve robustness to diverse motion patterns and scene variations. Method Venue CE T PCK↑ AUC↑ MPJPE↓ MHFormer [Li et al.(2022b)Li, Liu, Tang, Wang, and Van Gool] CVPR’22 ✓ 9 93.8 63.3 58.0 MixSTE [Zhang et al.(2022)Zhang, Tu, Yang, Chen, and Yuan] CVPR’22 ✗ 27 94.4 66.5 54.9 P-STMO [Shan et al.(2022)Shan, Liu, Zhang, Wang, Ma, and Gao] ECCV’22 ✓ 81 97.9 75.8 32.2 PoseFormerV2 [Zhao et al.(2023)Zhao, Zheng, Liu, Wang, and Chen] CVPR’23 ✓ 81 97.9 78.8 27.8 GLA-GCN [Yu et al.(2023)Yu, Zhang, Liu, Zhong, Liu, and Chen] ICCV’23 ✓ 81 98.5 79.1 27.7 MotionBERT [Zhu et al.(2023)Zhu, Ma, Liu, Liu, Wu, and Wang] ICCV’23 ✗ - - - - MotionAGFormer-L [Mehraban et al.(2024)Mehraban, Adeli, and Taati] WACV’24 ✗ 81 98.2 85.3 16.2 PoseRetNet [Zheng et al.(2024)Zheng, Lu, Lv, Zhang, Guo, and Wu] ECCV’24 ✗ 81 99.1 84.4 22.2 KTPFormer [Peng et al.(2024)Peng, Zhou, and Mok] CVPR’24 ✗ 81 98.9 85.9 16.7 H2OT+MotionAGFormer [Li et al.(2025c)Li, Liu, Liu, Wang, Lu, and Sebe] TPAMI’25 ✗ 81 99.1 85.2 18.0 TCPFormer [Liu et al.(2025)Liu, Liu, Liu, and Li] AAAI’25 ✗ 81 99.0 87.7 15.0 Ours – ✗ 81 99.1 89.3 14.0 Table 2: Results on MPI-INF-3DHP. CE indicates centre-frame prediction. T denotes the number of input frames. Bold/underline indicates the best/second-best result. Blue rows indicate methods sharing the same backbone encoder. 4.3 Ablation Studies and Analysis 4.3.1 Main Component Ablation Studies Variant MPJPE↓ P-MPJPE↓ (1) Baseline (w/o HSTG & ADSTG) 41.1 36.0 (2) w/o HSTG 39.2 32.9 (3) w/o ADSTG 38.8 32.5 (4) w/o Node-wise Adaptive Fusion (fixed 0.5/0.50.5/0.5 weights) 38.3 32.6 (5) w/o load-balance loss (ℒlbL_lb) 38.8 33.0 HSTGFormer (Ours) 37.9 31.5 Table 3: Main component ablation on Human3.6M. We evaluate the contribution of the proposed HSTG, ADSTG, adaptive fusion strategy, and load-balance loss. Results are reported in MPJPE and P-MPJPE (m). Bold/underline indicates the best/second-best result. Table 3 presents the main ablation study on Human3.6M. We evaluate the contribution of the two proposed graph reasoning modules, HSTG and ADSTG, as well as the adaptive node-wise fusion strategy. Variants (1)-(3) mainly examine the effectiveness of the graph reasoning design. Compared with the baseline without HSTG and ADSTG, adding either component brings clear improvements, reducing MPJPE from 41.141.1 m to 39.239.2 m and 38.838.8 m, respectively. This shows that both local coupled spatial-temporal reasoning and adaptive temporal graph modelling contribute to better pose estimation. Variants (4)-(5) further analyse the fusion mechanism. Replacing node-wise adaptive fusion with fixed 0.5/0.50.5/0.5 weights degrades MPJPE from 37.937.9 m to 38.338.3 m, indicating that different joint-time nodes benefit from different graph contexts. Removing the load-balance loss also weakens the performance, suggesting that balanced utilization of the two branches helps stabilize adaptive fusion. Overall, the full HSTGFormer achieves the best MPJPE and P-MPJPE, showing that HSTG and ADSTG provide complementary spatial-temporal representations, while the proposed node-wise fusion further improves adaptive spatial-temporal reasoning. Component Variant MPJPE↓ P-MPJPE↓ HSTG (1) w/ Factorised MLP 39.7 33.0 (2) w/ Factorised GCN 38.1 32.1 Ours 37.9 31.5 ADSTG (1) w/ Fixed Dual-Scale Temporal Convolution 39.1 32.7 (2) w/ Fixed Temporal Attention 38.7 32.6 Ours 37.9 31.5 Table 4: Ablation studies on HSTG and ADSTG design choices. Results are reported in MPJPE and P-MPJPE (m). Bold/underline indicate the best/second-best results. Method Venue T Dir. Disc. Eat Greet Phone Photo Pose Pur. Sit SitD. Smoke Wait WalkD. Walk WalkT. MHFormer [Li et al.(2022b)Li, Liu, Tang, Wang, and Van Gool] CVPR’22 351 31.5 34.9 32.8 33.6 35.3 39.6 32.0 32.2 43.5 48.7 36.4 32.6 34.3 23.9 25.1 MixSTE [Zhang et al.(2022)Zhang, Tu, Yang, Chen, and Yuan] CVPR’22 243 32.0 34.2 31.7 33.7 34.4 39.2 32.0 31.8 42.9 46.9 35.5 32.0 34.4 23.6 25.2 P-STMO [Shan et al.(2022)Shan, Liu, Zhang, Wang, Ma, and Gao] ECCV’22 243 31.3 35.2 32.9 33.9 35.4 39.3 32.5 31.5 44.6 48.2 36.3 32.9 34.4 23.8 23.9 GLA-GCN [Yu et al.(2023)Yu, Zhang, Liu, Zhong, Liu, and Chen] ICCV’23 243 32.4 35.3 32.6 34.2 35.0 42.1 32.1 31.9 45.5 49.5 36.1 32.4 35.6 23.5 24.7 MotionAGFormer-L [Mehraban et al.(2024)Mehraban, Adeli, and Taati] WACV’24 243 31.0 32.6 31.1 28.0 34.0 38.8 31.5 30.1 41.4 45.5 34.9 30.8 31.3 22.8 23.2 KTPFormer [Peng et al.(2024)Peng, Zhou, and Mok] CVPR’24 243 30.1 32.3 29.6 30.8 32.3 37.3 30.0 30.2 41.0 45.3 33.6 29.9 31.4 21.5 22.6 PoseRetNet [Zheng et al.(2024)Zheng, Lu, Lv, Zhang, Guo, and Wu] ECCV’24 243 30.8 33.1 31.3 31.8 33.4 37.7 30.1 30.5 43.4 45.5 34.3 30.3 31.5 21.4 22.7 TCPFormer [Liu et al.(2025)Liu, Liu, Liu, and Li] AAAI’25 243 30.1 31.6 31.4 27.3 33.5 37.6 29.4 29.6 41.1 45.9 34.4 29.6 30.6 21.7 22.3 Ours - 243 29.9 31.9 29.6 27.7 33.3 37.6 29.5 29.3 39.6 45.3 34.8 30.0 30.2 22.3 22.1 Table 5: Results on Human3.6M under P-MPJPE for 15 actions. Bold/underline indicates the best/second-best result. Blue rows indicate methods sharing the same backbone encoder. 4.3.2 Graph Design Analysis Table 4 explores the design choices of HSTG and ADSTG by replacing them with alternative architectures. For HSTG, factorised MLPs lead to a clear performance drop, with our design reducing MPJPE by 4.5%4.5\% and P-MPJPE by 4.2%4.2\%, indicating that point-wise transformations are insufficient for modelling structured joint dependencies and coupled spatial-temporal interactions. Factorised GCNs perform better than MLPs but still underperform our design, suggesting that adaptive graph attention enables more flexible spatial-temporal aggregation. For ADSTG, replacing adaptive temporal graph modelling with fixed dual-scale temporal convolutions or fixed temporal attention also degrades performance. This shows that content-adaptive temporal neighbourhoods are more effective than predefined temporal kernels. 4.3.3 Per-action Quantitative Analysis To better understand the action-wise behaviour of HSTGFormer, we analyse the per-action performance on Human3.6M in Table 5. Our method achieves the best results on several representative actions, including Direction, Eating, Purchases, Sitting, Sitting Down, Walking Dog, and Walking Together, while remaining competitive on Discussion, Phone, Photo, and Pose. The gains are particularly clear on complex or motion-intensive actions, suggesting that HSTGFormer effectively captures continuous spatial-temporal dependencies. 4.4 Qualitative Analysis 4.4.1 Pose Estimation Visualisation Figure 3: Qualitative comparison against TCPFormer [Liu et al.(2025)Liu, Liu, Liu, and Li] and MotionAGFormer [Mehraban et al.(2024)Mehraban, Adeli, and Taati] on in-the-wild videos. Orange arrows highlight challenging pose regions. Figure 4: Qualitative comparison against TCPFormer [Liu et al.(2025)Liu, Liu, Liu, and Li] on the Human3.6M dataset. Orange arrows highlight challenging pose regions. Figures 3 and 4 present qualitative comparisons on both in-the-wild videos and the Human3.6M dataset. Compared with MotionAGFormer and TCPFormer, our method produces more structurally consistent and anatomically plausible 3D poses under challenging body articulations and self-occlusions. In particular, our predictions better preserve local joint geometry and long-range body coordination in difficult regions such as arms, shoulders, and torso bending poses. These qualitative results further demonstrate the effectiveness of the proposed HSTG and ADSTG modules for robust spatial-temporal pose reasoning. Figure 5: (a) Visualisation of learned spatial-temporal correlations in HSTG. Highlighted regions indicate that the query node attends to anatomically related joints across nearby timesteps. (b) Visualisation of adaptive fusion weights across different layers and actions. Figure 6: Zero-shot qualitative visualisations on humanoid robots and bees using the Human3.6M-trained checkpoint. 4.4.2 Correlation Weights Analysis for HSTG Figure 5 (a) visualizes the learned spatial-temporal correlation weights in HSTG. For each query joint-time node, we show its correlation responses to anatomically related joints within a local temporal neighbourhood. The highlighted regions indicate that the most relevant information does not always come from the same frame. Instead, the query node can attend to related joints across nearby timesteps, such as the knee receiving strong responses from neighbouring hip/foot joints at adjacent frames. This observation supports our motivation that local pose dynamics are inherently coupled in both spatial and temporal dimensions. By extending the skeleton graph into localised temporal neighbourhoods, HSTG can capture such cross-frame structural dependencies while still preserving anatomical constraints. 4.4.3 Adaptive Fusion Weights Analysis Figure 5 (b) shows the adaptive fusion weights assigned to HSTG and ADSTG across different layers and actions. The weights are not fixed, but vary with both network depth and motion context. For SittingDown, the model assigns relatively higher HSTG weights in deeper layers, suggesting that local coupled spatial-temporal reasoning becomes more important for complex body articulation. In contrast, for Photo, the ADSTG weight increases in deeper layers, indicating a stronger reliance on adaptive temporal dependency modelling. 4.4.4 Broader Impact Discussion Figure 6 shows qualitative zero-shot visualisations beyond human pose estimation using the Human3.6M-trained checkpoint without additional fine-tuning. Although the proposed framework is trained only on human pose data, it can produce visually coherent 3D structures for articulated humanoid robots and bees. These preliminary examples are not intended as quantitative validation, but rather illustrate the potential of graph-enhanced spatial-temporal reasoning for broader articulated structure modelling. 5 Conclusion In this paper, we propose HSTGFormer, a graph-enhanced Transformer framework for efficient monocular 3D human pose estimation. Unlike conventional spatial-then-temporal modelling strategies, the proposed framework reformulates spatial-temporal reasoning from a graph perspective through two complementary modules: the Hyper Spatial-Temporal Graph (HSTG) and the Adaptive Dual-Scale Temporal Graph (ADSTG). HSTG extends conventional skeleton graphs into localised temporal neighbourhoods to enable efficient coupled spatial-temporal reasoning, while ADSTG performs adaptive temporal dependency modelling over complementary temporal ranges. In addition, a lightweight node-wise fusion mechanism dynamically integrates the two graph representations according to different motion contexts. Extensive experiments on Human3.6M and MPI-INF-3DHP demonstrate that HSTGFormer achieves strong accuracy while maintaining high computational efficiency and low memory cost. Further ablation studies and qualitative analyses verify the effectiveness of the proposed graph reasoning design. Preliminary zero-shot results on humanoid robots and bees also suggest its potential applicability beyond human pose estimation. Acknowledgements This work was supported by EU H2020-FET RoboRoyale project (964492). References [Ba et al.(2016)Ba, Kiros, and Hinton] Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton. Layer normalization. arXiv, 2016. [Cui et al.(2023)Cui, Sun, Lu, Li, Li, Yi, and Wang] Qiongjie Cui, Huaijiang Sun, Jianfeng Lu, Weiqing Li, Bin Li, Hongwei Yi, and Haofan Wang. Test-time personalizable forecasting of 3d human poses. In ICCV, pages 274–283, 2023. [Devlin et al.(2019)Devlin, Chang, Lee, and Toutanova] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. In NAACL-HLT, pages 4171–4186, 2019. [Dosovitskiy et al.(2020)Dosovitskiy, Beyer, Kolesnikov, Weissenborn, Zhai, Unterthiner, Dehghani, Minderer, Heigold, Gelly, et al.] Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv, 2020. [Gong et al.(2023)Gong, Foo, Fan, Ke, Rahmani, and Liu] Jia Gong, Lin Geng Foo, Zhipeng Fan, Qiuhong Ke, Hossein Rahmani, and Jun Liu. Diffpose: Toward more reliable 3d pose estimation. In CVPR, pages 13041–13051, 2023. [Hagbi et al.(2010)Hagbi, Bergig, El-Sana, and Billinghurst] Nate Hagbi, Oriel Bergig, Jihad El-Sana, and Mark Billinghurst. Shape recognition and pose estimation for mobile augmented reality. TVCG, 17(10):1369–1379, 2010. [Huo et al.(2023)Huo, Gao, Qi, and Ju] Rongtian Huo, Qing Gao, Jing Qi, and Zhaojie Ju. 3d human pose estimation in video for human-computer/robot interaction. In ICIRA, pages 176–187, 2023. [Ingwersen et al.(2023)Ingwersen, Mikkelstrup, Jensen, Hannemose, and Dahl] Christian Keilstrup Ingwersen, Christian Møller Mikkelstrup, Janus Nørtoft Jensen, Morten Rieger Hannemose, and Anders Bjorholm Dahl. Sportspose-a dynamic 3d sports pose dataset. In CVPR, pages 5219–5228, 2023. [Ionescu et al.(2013)Ionescu, Papava, Olaru, and Sminchisescu] Catalin Ionescu, Dragos Papava, Vlad Olaru, and Cristian Sminchisescu. Human3.6M: Large scale datasets and predictive methods for 3D human sensing in natural environments. TPAMI, 36(7):1325–1339, 2013. [Kipf and Welling(2017)] Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In ICLR, 2017. [Li et al.(2022a)Li, Katsigiannis, and Shum] Ruochen Li, Stamos Katsigiannis, and Hubert PH Shum. Multiclass-sgcn: Sparse graph-based trajectory prediction with agent class embedding. In ICIP, pages 2346–2350, 2022a. [Li et al.(2025a)Li, Katsigiannis, Kim, and Shum] Ruochen Li, Stamos Katsigiannis, Tae-Kyun Kim, and Hubert PH Shum. Bp-sgcn: Behavioral pseudo-label informed sparse graph convolution network for pedestrian and heterogeneous trajectory prediction. TNNLS, 2025a. [Li et al.(2025b)Li, Qiao, Katsigiannis, Zhu, and Shum] Ruochen Li, Tanqiu Qiao, Stamos Katsigiannis, Zhanxing Zhu, and Hubert PH Shum. Unified spatial-temporal edge-enhanced graph networks for pedestrian trajectory prediction. TCSVT, 2025b. [Li et al.(2026a)Li, Chang, Hu, Li, Atapour-Abarghouei, and Shum] Ruochen Li, Ziyi Chang, Junyan Hu, Jiannan Li, Amir Atapour-Abarghouei, and Hubert PH Shum. Art: Adaptive relational transformer for pedestrian trajectory prediction with temporal-aware relations. In ICHMS, pages 251–256, 2026a. [Li et al.(2026b)Li, Chen, Arvin, Atapour-Abarghouei, et al.] Ruochen Li, Shuang Chen, Farshad Arvin, Amir Atapour-Abarghouei, et al. Motion-adaptive multi-scale temporal modelling with skeleton-constrained spatial graphs for efficient 3d human pose estimation. IJCNN, 2026b. [Li et al.(2026c)Li, Zhu, Qiao, and Shum] Ruochen Li, Zhanxing Zhu, Tanqiu Qiao, and Hubert PH Shum. Vite: Virtual graph trajectory expert router for pedestrian trajectory prediction. In AAAI, volume 40, pages 17535–17543, 2026c. [Li and Chan(2014)] Sijin Li and Antoni B Chan. 3d human pose estimation from monocular images with deep convolutional neural network. In ACCV, pages 332–347, 2014. [Li et al.(2022b)Li, Liu, Tang, Wang, and Van Gool] Wenhao Li, Hong Liu, Hao Tang, Pichao Wang, and Luc Van Gool. Mhformer: Multi-hypothesis transformer for 3d human pose estimation. In CVPR, pages 13147–13156, 2022b. [Li et al.(2025c)Li, Liu, Liu, Wang, Lu, and Sebe] Wenhao Li, Mengyuan Liu, Hong Liu, Pichao Wang, Shijian Lu, and Nicu Sebe. H2ot: Hierarchical hourglass tokenizer for efficient video pose transformers. TPAMI, 2025c. [Liu et al.(2025)Liu, Liu, Liu, and Li] Jiajie Liu, Mengyuan Liu, Hong Liu, and Wenhao Li. Tcpformer: Learning temporal correlation with implicit pose proxy for 3d human pose estimation. In AAAI, volume 39, pages 5478–5486, 2025. [Marisca et al.(2025)Marisca, Bamberger, Alippi, and Bronstein] Ivan Marisca, Jacob Bamberger, Cesare Alippi, and Michael M Bronstein. Over-squashing in spatiotemporal graph neural networks. In NeurIPS, 2025. [Martinez et al.(2017)Martinez, Hossain, Romero, and Little] Julieta Martinez, Rayat Hossain, Javier Romero, and James J Little. A simple yet effective baseline for 3d human pose estimation. In ICCV, pages 2640–2649, 2017. [Mehraban et al.(2024)Mehraban, Adeli, and Taati] Soroush Mehraban, Vida Adeli, and Babak Taati. Motionagformer: Enhancing 3d human pose estimation with a transformer-gcnformer network. In WACV, pages 6920–6930, 2024. [Mehta et al.(2017)Mehta, Rhodin, Casas, Fua, Sotnychenko, Xu, and Theobalt] Dushyant Mehta, Helge Rhodin, Dan Casas, Pascal Fua, Oleksandr Sotnychenko, Weipeng Xu, and Christian Theobalt. Monocular 3D human pose estimation in the wild using improved CNN supervision. In 3DV, pages 506–516, 2017. [Newell et al.(2016)Newell, Yang, and Deng] Alejandro Newell, Kaiyu Yang, and Jia Deng. Stacked hourglass networks for human pose estimation. In ECCV, pages 483–499, 2016. [Peng et al.(2024)Peng, Zhou, and Mok] Jihua Peng, Yanghong Zhou, and PY Mok. Ktpformer: Kinematics and trajectory prior knowledge-enhanced transformer for 3d human pose estimation. In CVPR, pages 1123–1132, 2024. [Qiao et al.(2024)Qiao, Li, Li, and Shum] Tanqiu Qiao, Ruochen Li, Frederick WB Li, and Hubert PH Shum. From category to scenery: An end-to-end framework for multi-person human-object interaction recognition in videos. In ICPR, pages 262–277, 2024. [Qiao et al.(2025)Qiao, Li, Li, Kubotani, Morishima, and Shum] Tanqiu Qiao, Ruochen Li, Frederick WB Li, Yoshiki Kubotani, Shigeo Morishima, and Hubert PH Shum. Geometric visual fusion graph neural networks for multi-person human-object interaction recognition in videos. ESWA, 2025. [Rossol et al.(2015)Rossol, Cheng, and Basu] Nathaniel Rossol, Irene Cheng, and Anup Basu. A multisensor technique for gesture recognition through intelligent skeletal pose analysis. Trans. Hum.-Mach. Syst., 46(3):350–359, 2015. [Shan et al.(2022)Shan, Liu, Zhang, Wang, Ma, and Gao] Wenkang Shan, Zhenhua Liu, Xinfeng Zhang, Shanshe Wang, Siwei Ma, and Wen Gao. P-stmo: Pre-trained spatial temporal many-to-one model for 3d human pose estimation. In ECCV, pages 461–478, 2022. [Suzuki et al.(2025)Suzuki, Tanaka, Yeung, and Fujii] Tomohiro Suzuki, Ryota Tanaka, Calvin Yeung, and Keisuke Fujii. Athleticspose: Authentic sports motion dataset on athletic field and evaluation of monocular 3d pose estimation ability, 2025. [Tang et al.(2023)Tang, Qiu, Hao, Hong, and Yao] Zhenhua Tang, Zhaofan Qiu, Yanbin Hao, Richang Hong, and Ting Yao. 3d human pose estimation with spatio-temporal criss-cross attention. In CVPR, pages 4790–4799, 2023. [Vaswani et al.(2017)Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, and Polosukhin] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. NeurIPS, 30, 2017. [Veličković et al.(2017)Veličković, Cucurull, Casanova, Romero, Lio, and Bengio] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. Graph attention networks. arXiv, 2017. [Yang et al.(2022)Yang, Ma, Zuo, Wang, Gong, and Cheng] Ji Yang, Youdong Ma, Xinxin Zuo, Sen Wang, Minglun Gong, and Li Cheng. 3d pose estimation and future motion prediction from 2d images. PR, 124:108439, 2022. [Yi et al.(2023)Yi, Zhang, Fan, He, Hu, Wang, An, Cao, and Niu] Kun Yi, Qi Zhang, Wei Fan, Hui He, Liang Hu, Pengyang Wang, Ning An, Longbing Cao, and Zhendong Niu. FourierGNN: Rethinking multivariate time series forecasting from a pure graph perspective. In NeurIPS, 2023. [Yu et al.(2023)Yu, Zhang, Liu, Zhong, Liu, and Chen] Bruce XB Yu, Zhi Zhang, Yongxu Liu, Sheng-hua Zhong, Yan Liu, and Chang Wen Chen. Gla-gcn: Global-local adaptive graph convolutional network for 3d human pose estimation from monocular video. In ICCV, pages 8818–8829, 2023. [Zhang et al.(2022)Zhang, Tu, Yang, Chen, and Yuan] Jinlu Zhang, Zhigang Tu, Jianyu Yang, Yujin Chen, and Junsong Yuan. Mixste: Seq2seq mixed spatio-temporal encoder for 3d human pose estimation in video. In CVPR, pages 13222–13232, 2022. [Zhao et al.(2023)Zhao, Zheng, Liu, Wang, and Chen] Qitao Zhao, Ce Zheng, Mengyuan Liu, Pichao Wang, and Chen Chen. Poseformerv2: Exploring frequency domain for efficient and robust 3d human pose estimation. In CVPR, pages 8877–8886, 2023. [Zheng et al.(2021)Zheng, Zhu, Mendieta, Yang, Chen, and Ding] Ce Zheng, Sijie Zhu, Matias Mendieta, Taojiannan Yang, Chen Chen, and Zhengming Ding. 3d human pose estimation with spatial and temporal transformers. In ICCV, pages 11656–11665, 2021. [Zheng et al.(2024)Zheng, Lu, Lv, Zhang, Guo, and Wu] Kaili Zheng, Feixiang Lu, Yihao Lv, Liangjun Zhang, Chenyi Guo, and Ji Wu. 3d human pose estimation via non-causal retentive networks. In ECCV, pages 111–128, 2024. [Zhu et al.(2023)Zhu, Ma, Liu, Liu, Wu, and Wang] Wentao Zhu, Xiaoxuan Ma, Zhaoyang Liu, Libin Liu, Wayne Wu, and Yizhou Wang. Motionbert: A unified perspective on learning human motion representations. In ICCV, pages 15085–15099, 2023. [Zhu et al.(2021)Zhu, Xu, Shen, Ji, Gao, and Shen] Yiran Zhu, Xing Xu, Fumin Shen, Yanli Ji, Lianli Gao, and Heng Tao Shen. Posegtac: Graph transformer encoder-decoder with atrous convolution for 3d human pose estimation. In IJCAI, pages 1359–1365, 2021.