Paper deep dive
UAV Video Deblurring via Motion-Aware Diffusion: A Path to Robust Target Detection
Zhiqiang Hu, Shouren Huang, Masatoshi Ishikawa
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 93%
Last extracted: 8/18/2026, 5:58:13 AM
Summary
This paper proposes a motion-aware diffusion framework for UAV video deblurring to enhance target detection. The method introduces an Adaptive Latent Scale Selector (ALSS) that adjusts latent resolution based on optical flow motion intensity to balance efficiency and detail preservation. It also employs a Multi-Frame Alignment and Learnable Gating (MALG) module to ensure temporal consistency by warping and gating preceding frames. Experiments on real UAV benchmarks demonstrate superior deblurring performance and improved target detection accuracy compared to existing methods.
Entities (9)
Relation Signals (6)
Proposed Method → enhances → Target Detection
confidence 96% · our method not only yields superior deblurring performance but also significantly boosts target detection accuracy
Adaptive Latent Scale Selector → uses → Optical Flow
confidence 95% · ALSS dynamically adjusts the latent feature scale based on the intensity of motion detected from the optical flow
Multi-Frame Alignment and Learnable Gating → improves → Temporal Consistency
confidence 93% · To ensure temporal consistency, we introduce a Multi-Frame Alignment and Learnable Gating module
Multi-Frame Cross-Attention → partof → Multi-Frame Alignment and Learnable Gating
confidence 92% · aggregating multiple frames by Multi-Frame Cross-Attention... within the Multi-Frame Alignment and Learnable Gating module
RAFT → usedby → Adaptive Latent Scale Selector
confidence 90% · We use RAFT [24] to compute optical flow... for the Adaptive Latent Scale Selector
Stable Diffusion → providesarchitecturefor → Auto-encoder
confidence 88% · We adopt the auto-encoder architecture from Stable Diffusion [21]
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Unmanned Aerial Vehicles (UAVs) play a crucial role in various scenarios ranging from disaster response to traffic surveillance. However, aerial video footage often suffers from severe motion blur due to rapid flight maneuvers, vibrations, and camera panning, which can significantly degrade downstream tasks such as target detection. Our goal is to explore a computationally-efficient and effective video deblurring approach to enhance UAV target detection performance. To reduce computational cost, we first propose an Adaptive Latent Scale Selector that dynamically adjusts the latent space resolution according to the intensity of UAV motion, thus balancing detail preservation with inference efficiency. To ensure temporal consistency, we introduce a Multi-Frame Alignment and Learnable Gating module to warp and gate the preceding frames, allowing the model to fuse only relevant temporal information and suppress misaligned or uninformative features. Our method can effectively recover sharp details from the UAV video stream. Extensive experiments on real UAV benchmarks demonstrate that our method not only yields superior deblurring performance but also significantly boosts target detection accuracy, making it highly applicable to robust aerial vision tasks.
Tags
Links
- Source: https://arxiv.org/abs/2608.15259v1
- Canonical: https://arxiv.org/abs/2608.15259v1
Trouble viewing inline? Open PDF directly →
Full Text
44,795 characters extracted from source content.
Expand or collapse full text
UAV Video Deblurring via Motion-Aware Diffusion: A Path to Robust Target Detection Zhiqiang HU Shouren HUANG Masatoshi ISHIKAWA Thanks: Thanks: The authors are with the Research Institute for Science & Technology, Tokyo University of Science zhiqiang.hu, huang, ishikawa@ishikawa-vision.org Abstract Unmanned Aerial Vehicles (UAVs) play a crucial role in various scenarios ranging from disaster response to traffic surveillance. However, aerial video footage often suffers from severe motion blur due to rapid flight maneuvers, vibrations, and camera panning, which can significantly degrade downstream tasks such as target detection. Our goal is to explore a computationally-efficient and effective video deblurring approach to enhance UAV target detection performance. To reduce computational cost, we first propose an Adaptive Latent Scale Selector that dynamically adjusts the latent space resolution according to the intensity of UAV motion, thus balancing detail preservation with inference efficiency. To ensure temporal consistency, we introduce a Multi-Frame Alignment and Learnable Gating module to warp and gate the preceding frames, allowing the model to fuse only relevant temporal information and suppress misaligned or uninformative features. Our method can effectively recover sharp details from the UAV video stream. Extensive experiments on real UAV benchmarks demonstrate that our method not only yields superior deblurring performance but also significantly boosts target detection accuracy, making it highly applicable to robust aerial vision tasks. Code will be publicly available here. I Introduction Unmanned Aerial Vehicles (UAVs) have become indispensable in various mission-critical fields, such as disaster surveillance, urban monitoring, and environmental inspection. In these applications, target detection (e.g., identifying pedestrians, vehicles, or infrastructure anomalies) is vital for effective decision-making and timely interventions. However, UAV-captured videos often suffer from severe motion blur due to rapid flight maneuvers, vibrations, and dynamic environmental factors. Such motion blur not only degrades the visual quality but also poses a serious challenge to downstream detection algorithms, which rely on clear spatial details to localize and classify objects accurately. Consequently, computationally efficient and effective video deblurring methods are highly valuable for enhancing UAV target detection applications as illustrated in Figure 1. Fig. 1: Impact of Video Deblurring on UAV-Based Object Detection. The left section shows a UAV capturing a blurry scene. The middle section represents the deblurring process, restoring sharp frames. The right section compares object detection results on both blurry and restored frames, demonstrating improved object detection performance with deblurring. Traditional video deblurring techniques often prove inadequate in dynamic scenarios because they struggle to adapt to unpredictable environments and rapid UAV motion [27]. In particular, they often find it challenging to optimize complex temporal models and generalize to the diverse types of motion blur encountered in real-world UAV scenarios. To address these challenges, deep learning-based methods have emerged as a more powerful alternative. Approaches such as EDVR [25] utilize advanced techniques like deformable convolution and gradual refinement schemes to tackle issues related to temporal alignment and motion compensation. Despite their success, these methods predominantly focus on the spatial domain and tend to overlook the potential of temporal information [9]. This oversight can limit their effectiveness, particularly in scenarios involving complex and unpredictable motion blur like UAV target detection and tracking. Recently, Diffusion Models (DMs) have demonstrated remarkable performance in image synthesis [5] and restoration tasks [10, 3]. DMs generate high-fidelity images through a stochastic iterative denoising process, starting from pure Gaussian noise [5]. Compared to other generative models like Generative Adversarial Networks (GANs), DMs offer a more accurate target distribution without the common issues of optimization instability or mode collapse [5]. However, DMs often face criticism for their high computational costs, as the iterative denoising steps become prohibitively expensive when dealing with high-resolution inputs [7]. This limitation is especially problematic for UAV-based applications, where real-time or near real-time processing is crucial for timely decision-making in dynamic environments. Moreover, maintaining temporal coherence across consecutive frames remains challenging for DMs; they may produce outputs with inconsistent motion flow, manifesting as jitter or ghosting effects. In UAV scenarios involving rapid camera movements and frequent viewpoint changes, these artifacts severely compromise the reliability of subsequent tasks such as target detection or situational awareness. To tackle these challenges, our work introduces a novel video deblurring framework aiming for UAV target detection tasks. Firstly, to reduce computational complexity, we propose an Adaptive Latent Scale Selector module that dynamically adjusts the latent feature scale based on the intensity of motion detected from the optical flow in the blurry video frames, see Figure 2 for detailed information. This method allows our model to preserve fine details in regions of rapid motion while optimizing computational resources in more stable areas, thereby accelerating the inference process. Secondly, to ensure temporal consistency across video frames, our method explicitly aligns preceding frames to the current view and employs a learnable gating mechanism to filter out misaligned or degraded cues. This approach recovers consistent temporal details and mitigates artifacts such as ghosting and jitter, ultimately enhancing video clarity and directly boosting target detection performance. Overall, the key contributions of our proposed method are: Adaptive Latent Scale Selector (ALSS): A motion-aware mechanism that dynamically adjusts the latent-space resolution based on motion intensity estimated from optical flow. ALSS strikes an effective balance between computational efficiency and detail preservation, please refer to Figure 2 for the concept of our method. Multi-Frame Alignment with Learnable Gating (MALG): UAV video is prone to rapid viewpoint changes and dynamic backgrounds, making simple frame fusion insufficient. By adaptively filtering out degraded cues and aggregating multiple frames by Multi-Frame Cross-Attention, our method can recover temporally consistent details and mitigate artifacts. Improved Detection Outcomes: By effectively reducing severe blur while maintaining motion continuity, our approach substantially enhances detection performance on UAV video benchmarks. The recovered spatio-temporal fidelity not only produces sharper visual outputs but also translates into higher target detection accuracy. I Related Works I-A UAV Object Detection Recent advancements in UAV object detection have garnered significant attention due to their immense practical value and broad range of applications. ViT-YOLO [30] introduces a Transformer-based approach for UAV object detection, effectively capturing global contextual information. However, its substantial computational cost poses significant challenges for real-time deployment on UAV platforms. To address this, Drone-YOLO [29] optimizes feature extraction by integrating shallow features more effectively, thereby improving small object detection and inference speed. Similarly, YOLOv8-s [15] enhances parameter efficiency by incorporating Bi-FPN and Ghost blocks, reducing computational overhead without compromising accuracy. Furthermore, EFPN [4] introduces a Feature Texture Transfer (FTT) module to refine shallow feature mapping, further boosting detection precision. Real-Time DEtection TRansformer (RT-DETR) [31] has emerged as a powerful end-to-end object detector, bridging the gap between efficiency and accuracy in real-time detection tasks. Despite these advancements, none of these methods explicitly address the impact of motion blur on object detection performance, which is particularly critical in UAV applications where rapid camera movement and environmental conditions can introduce significant blurring artifacts. Our work, by contrast, focuses on explicitly reducing blur to enhance detection, bridging this overlooked gap. I-B Video Deblurring Video deblurring has been advanced significantly with deep learning, several approaches leveraged spatial and temporal coherence to improve performance over single-image techniques [9]. Early works by Su et al. [23] focused on aligning and aggregating information across frames to enhance deblurring. More recently, transformer-based architectures have emerged as a robust solution for video deblurring, image enhancement [8] capable of modeling long-range dependencies. Liang et al. [17] introduced a recurrent video restoration transformer with guided deformable attention, effectively leveraging both spatial and temporal information. Lin et al. [18] proposed a flow-guided sparse transformer that uses optical flows to guide the attention module, enhancing the model’s ability to manage diverse motion blur conditions. However, these methods often struggle to fully adapt to varying motion intensities across different regions of a video frame, limiting their real-world effectiveness. Our approach addresses this by adapting the processing scale based on motion intensity, preserving fine details in rapid-motion frames while conserving resources in stable frames. Fig. 2: Inference Process with Adaptive Latent Feature Sizes: For frames with smooth motion (top), the Optical Flow Estimator calculates a lower motion intensity, leading the Adaptive Latent Scale Selector to choose a smaller latent feature size for encoding, which results in a shorter inference time; conversely, for frames with intense motion, a larger latent feature size is selected, leading to a longer inference time. Fig. 3: Overview of Our Motion-Aware Dynamic Latent Diffusion Framework (a) for UAV Video Deblurring. First, each blurry frame is encoded at multiple scales. Then, an Adaptive Latent Scale Selector (Sec. I-C) dynamically determines the appropriate latent feature size based on the estimated motion intensity from optical flow, balancing fine detail preservation and computational efficiency. Next, our Multi-Frame Alignment and Learnable Gating (b) and Latent Fusion with MFCA (c) (Sec. I-E) warps preceding frames and filters out misaligned or uninformative regions, ensuring robust temporal fusion. Finally, we perform diffusion-based denoising (Sec. I-E) conditioned on these fused latent and decode them back to the spatial domain to obtain deblurred frames. I-C Diffusion Models for Low-Level Vision Diffusion models (DMs) have emerged as a powerful tool in image restoration tasks, including super-resolution [14], inpainting [19], and deblurring [26], due to their capability to generate high-fidelity images through an iterative denoising process [5, 22]. These models refine noisy inputs by reversing a diffusion process, which has been highly effective in various low-level vision tasks, as demonstrated by models like DDRM [10]. However, the application of DMs to high-resolution and video restoration tasks is hindered by their significant computational cost and the challenge of maintaining temporal consistency across frames. Our approach tackles these challenges by preserving temporal coherence, reducing artifacts, and maintaining high-quality deblurring across frames. I Method I-A Method Overview In UAV-based scenarios, formally, we have a blurry video sequence ℐblur=1blur,2blur,…,NblurI^blur=\I^blur_1,I^blur_2,…,I^blur_N\, where each frame iblur∈ℝH×W×CI^blur_i ^H× W× C, H, W, and C denote the height, width, and number of color channels of the image, respectively. Our goal is to produce a deblurred sequence ℐclear=1clear,2clear,…,NclearI^clear=\I^clear_1,I^clear_2,…,I^clear_N\, which preserves spatial details and maintains temporal consistency for downstream UAV applications. I-B Adaptive Latent Scale Selector I-B1 Latent Extraction We encode each frame iI_i at scale s via (s,t)i=ℰs(i)z^i_(s,t)=E_s(I_i), where s∈1,…,Ss∈\1,…,S\ is the chosen latent scale and i∈1,…,Ni∈\1,…,N\ indicates frame index and t is the diffusion step. Here, ℰsE_s is the encoder that produces a latent representation at resolution scale s. We adopt the auto-encoder architecture from Stable Diffusion [21] to obtain multi-level latent features. I-B2 Adaptive Latent Scale Selector To handle varying motion intensities across UAV video frames, we adaptively choose the most suitable latent resolution scale for each frame based on optical flow. Specifically, we estimate the forward optical flow i−1→i∈ℝH×W×Dff_i-1→ i ^H× W× D_f where i−1→if_i-1→ i represents the flow vectors from frame (i−1)(i-1) to frame i, and DfD_f is the dimensionality of the flow field. We use RAFT [24] to compute i−1→if_i-1→ i between two consecutive blurry UAV frames i−1blurI^blur_i-1 and iblurI^blur_i. Motion Intensity Estimation. We define the motion intensity ‖Flow(i−1blur,iblur)‖\|Flow(I^blur_i-1,I^blur_i)\| as the magnitude of the optical flow vector: ‖Flow(i−1blur,iblur)‖=(Δx)2+(Δy)2,\|Flow(I^blur_i-1,I^blur_i)\|= ( x)^2+( y)^2, (1) where (Δx,Δy)( x, y) are the horizontal and vertical flow components from i−1→if_i-1→ i, respectively. Scale Selection. Rather than relying on a fixed threshold, we map this motion intensity to a suitable latent scale sis_i by linearly interpolating within a predefined set of scales 1,…,S\1,…,S\. Specifically, si=round(‖Flow(i−1blur,iblur)‖MaxFlowadaptive(i)×(S−1))+1,s_i=round ( \|Flow(I^blur_i-1,I^blur_i)\|MaxFlow_adaptive(i)×(S-1) )+1, (2) where round(⋅)round(·) denotes rounding to the nearest integer. A larger flow magnitude indicates stronger motion and thus selects a larger scale s. We define MaxFlowadaptive(i)MaxFlow_adaptive(i) as follows: MaxFlowadaptive(i) _adaptive(i) =α⋅‖Flow(i−1blur,iblur)‖max =α· \|Flow (I^blur_i-1,I^blur_i ) \|_max (3) +(1−α)MaxFlowadaptive(i−1). +(1-α)\,MaxFlow_adaptive(i-1). where α is a smoothing factor (0<α<1)(0<α<1) that balances current and previous flow magnitudes, and MaxFlowadaptive(i−1)MaxFlow_adaptive(i-1) is the adaptive reference from the previous frame. The α is set to be 0.8 in our experiments. The selected scale sis_i thus adapts in real-time according to the UAV’s motion intensity, preserving fine details when movement is large while avoiding unnecessary high-resolution encodings during smooth flight segments. I-C Latent Diffusion with Motion-Aware Conditioning I-C1 Multi-Frame Alignment with Learnable Gating In high-dynamic UAV scenarios, significant motion variations and complex environmental factors often lead to severe misalignment and occlusion across frames. To maintain consistency in the current blurred frame while leveraging clear region information from preceding frames, we propose a multiple-frame aggregation module. However, naively aggregating multiple frames without explicit handling of such discrepancies can result in substantial artifacts and temporal inconsistencies. To mitigate these challenges, we first spatially align each preceding frame to the current frame using optical flow-based warping. Additionally, we introduce a learnable spatial gating mechanism that adaptively suppresses unreliable regions while preserving informative, well-aligned features. This per-pixel gating strategy ensures that only temporally coherent and structurally consistent regions contribute to the final reconstruction, thereby enhancing robustness against motion-induced distortions and occlusions. We take the previous M latent (s,t)i−m∣m=1,…,M\z^\,i-m_(s,t) m=1,…,M\. If any latent is at a different scale s′≠s ≠ s, we first resize it to the target scale s. Then, using the optical flow f(i−m)→if_(i-m)→ i, we warp the latent: ^(s,t)i−m=(Resize((s′,t)i−m),f(i−m)→i). z_(s,t)^\,i-m=W\! (Resize(z^\,i-m_(s ,t)),\,f_(i-m)→ i ). (4) A three-layer convolutional network (with kernel sizes 7×77× 7, 5×55× 5, and 3×33× 3) is used as the warping operator W. Next, a learnable mask Γmi∈ℝH×W _m^i ^H× W is applied to obtain the gated latent: ~(s,t)i−m(u,v)=σ(Γmi(u,v))⊙^(s,t)i−m(u,v), z_(s,t)^\,i-m(u,v)=σ ( _m^i(u,v) )\, \, z_(s,t)^\,i-m(u,v), (5) where σ(⋅)σ(·) is the sigmoid function and ⊙ denotes element-wise multiplication. We use a lightweight gating network to predict Γmi _m^i. We then stack these gated latent for following Multi-Frame Cross-Attention calculation: ~i=[~(s,t)i−1,~(s,t)i−2,…,~(s,t)i−M]. F_i= [ z_(s,t)^\,i-1,\, z_(s,t)^\,i-2,…, z_(s,t)^\,i-M ]. (6) I-C2 Latent Fusion with Multi-Frame Cross-Attention (MFCA) We fuse information from past frames via Multi-Frame Cross-Attention (MFCA) see Figure 3(c). Specifically, we define =WQFlatten((s,t)i)Q=W^Q\,Flatten (z^\,i_(s,t) ), =WKFlatten(~i)K=W^K\,Flatten ( F_i ), =WVFlatten(~i)V=W^V\,Flatten ( F_i ), where WQ,WK,WVW^Q,W^K,W^V map each flattened input into a common d-dimensional space. The MFCA operation is then computed as MFCA(,,)=softmax(⊤d),MFCA(Q,\,K,\,V)=softmax ( QK d )\,V, and we reshape the output back to a 2D grid to obtain the refined latent mfcaiz^\,i_mfca. I-C3 Scale-Conditioned Reverse Denoising To enable the denoising network (UNet) to explicitly handle different spatial scales, we introduce a scale embedding ese_s. Specifically, we learn a small mapping Φscale(s) _scale(s) that converts the discrete scale index s into a feature vector ese_s. This embedding is injected into the UNet via conditional normalization layers; for instance, at an intermediate layer with feature map F, the scale-conditioned feature is computed as F′=γ(es)⊙F+β(es),F =γ(e_s) F+β(e_s), (7) where γ(es)γ(e_s) and β(es)β(e_s) are generated by small networks conditioned on ese_s. Furthermore, in addition to the scale embedding, we also inject the refined latent as a conditional signal. Similar to scale conditioning, we feed the mfcaiz^\,i_mfca into a small MLP denoted as Φprior(z) _prior(z) to produce adaptive parameters γc _c and βc _c. Then, at another intermediate layer (or the same layer), the feature map can be updated by F′=γc(mfcai)⊙F′+βc(mfcai),F = _c(z^\,i_mfca) F + _c(z^\,i_mfca), (8) where F′F is the feature already modulated by ese_s. This helps preserve structural information from the original input, providing an additional prior for better deblurring. Finally, this refined latent is fed into our UNet-like denoiser along with the diffusion timestep t, the scale embedding ese_s, and optionally the clean latent (s,0)z_(s,0). Formally, the denoiser is defined as: ϵθ(mfcai,t,es,(s,0))=UNet(mfcai,t,es,(s,0)), _θ (z^\,i_mfca,\,t,\,e_s,\,z_(s,0) )=UNet\! (z^\,i_mfca,\,t,\,e_s,\,z_(s,0) ), (9) where the UNet incorporates both the scale information and the refined latent via conditional normalization. With the predicted noise, we perform the standard reverse diffusion update (as in DDPM [6]): (s,t−1)i=1αt[(s,t)i−1−αt1−α¯tϵθ(mfcai,t,es,(s,0))]+σtη, splitz^\,i_(s,t-1)&= 1 _t [z^\,i_(s,t)- 1- _t 1- α_t\, _θ (z^\,i_mfca,\,t,\,e_s,\,z_(s,0) ) ]\\ & + _t\,η, split (10) where η∼(0,I)η (0,I), α¯t=∏τ=1tατ α_t= _τ=1^t _τ, and T is the total number of reverse diffusion steps. After iterating down to t=0t=0, we obtain the deblurred latent (s,0)iz^\,i_(s,0) then decode it via D to yield the deblurred frame IiclearI_i^clear. I-D Training Strategy Phase 1: Pre-training Encoder and Decoder. We first train an auto-encoder (ℰ,)(E,D) on ground-truth data by minimizing ℒrec=‖(ℰ(Iclear))−Iclear‖22,L_rec= \|D (E(I^clear) )-I^clear \|_2^2, ensuring that the reconstructed output closely matches the ground-truth frame. This phase yields a high-quality VAE capable of encoding images into latent (s,0)z_(s,0) and decoding them back. Phase 2: Multi-Scale Diffusion Denoising Model Training. To handle varying latent resolutions, we adopt a multi-scale training scheme. Specifically, we randomly sample a scale s from the discrete set 1,…,S\1,…,S\, then encode the blurry input frame IiblurI_i^blur using ℰsE_s to obtain (s,0)i=ℰs(Iiblur).z_(s,0)^i=E_s (I_i^blur ). We perform forward diffusion over T steps to corrupt (s,0)iz_(s,0)^i into (s,t)iz_(s,t)^i by adding noise. During training, we compute the fused latent (s,t)i→mfcaiz_(s,t)^i\!→\!z_mfca^i (via Multi-Frame Cross-Attention, see Sec. I-C1) and inject both the scale embedding ese_s and the refined latent (optionally combined with the clean latent (s,0)iz_(s,0)^i) into the denoiser ϵθ _θ. The objective is to predict the added noise: ℒdenoise=s∼p(s),t,ϵ‖ϵ−ϵθ(mfcai,t,es,(s,0)i)‖22,L_denoise=E_s p(s),\,t,\,ε \|ε- _θ (z_mfca^i,\,t,\,e_s,z_(s,0)^i ) \|_2^2, where p(s)p(s) is typically uniform (or can be biased to favor certain scales). This multi-scale training strategy enables the diffusion UNet ϵθ(⋅) _θ(·) to handle diverse resolutions and leverage multi-frame temporal cues. Phase 3: Joint Fine-Tuning. After obtaining a preliminary denoising model, we fine-tune all modules, including the set of encoders ℰs\E_s\ for each scale, the decoder D, and the diffusion UNet UθU_θ under a combined objective:ℒtotal=λ1ℒrec+λ2ℒdenoise,L_total= _1\,L_rec+ _2\,L_denoise,where λ1 _1 and λ2 _2 are weights balancing VAE reconstruction fidelity and noise-prediction accuracy, respectively. We set λ1=0.6 _1=0.6 and λ2=0.4 _2=0.4 throughout our experiments. This joint fine-tuning ensures that the latent space (VAE) and the scale-conditioned diffusion model are well-aligned, leading to robust UAV video deblurring across different motion intensities and resolutions. Fig. 4: Visual Comparisons Between our Method and SOTA Methods on GoPro [20] Dataset. Fig. 5: Visual Comparisons Between Our Method and SOTA Methods on DVD [23] Dataset. Fig. 6: Temporal Consistency Comparison on DVD [23] dataset. We analyze the temporal profile along a fixed row in consecutive frames to assess temporal consistency. The temporal profiles generated by existing methods, including VRT [16], RVRT [17], and Shift-Net+ [12], reveal noticeable distortions and discontinuities, indicating flickering artifacts across frames. In contrast, Ours maintains a smooth and coherent profile over time, showcasing improved temporal consistency. TABLE I: Quantitative comparisons on the GoPro and DVD datasets. The best results are highlighted in bold. Method GoPro DVD PSNR SSIM PSNR SSIM STFAN [32] 28.69 0.8610 31.24 0.9340 STDA [28] 32.62 0.9375 33.05 0.9374 NAFNet [2] 33.69 0.9670 - - ARVo [13] - - 32.80 0.9352 VRT [16] 34.81 0.9724 34.27 0.9651 RVRT [17] 34.92 0.9738 34.30 0.9655 Shift-Net+ [12] 35.88 0.9790 34.69 0.9690 Ours 36.12 0.9799 35.18 0.9778 Fig. 7: Object Detection Performance on the VisDrone-VID2019 Dataset [33]. From left to right: (1) Detection results on blurred input frames using RTDETR [31], (2) RVRT [17] deblurred frames + RTDETR detection [31], (3) Our method deblurred frames + RTDETR detection, and (4) Detection results on original clear frames using RTDETR [31]. Our approach (Ours + RTDETR [31]) achieves the best detection performance, effectively recovering motion-degraded objects while preserving fine details. The zoomed-in patches further highlight that our deblurring algorithm restores sharper textures and more accurate object structures compared to RVRT [17]. IV Experiments IV-A Datasets GoPro Dataset: The GoPro dataset [20] contains 3,214 pairs of blurry and sharp images with a resolution of 1280 × 720, split into 2,103 training pairs and 1,111 testing pairs. It is a standard benchmark for video deblurring, capturing real-world dynamic scenes with significant motion blur. DVD Dataset: The DVD dataset [23] includes 71 videos, yielding 6,708 blurry-sharp frame pairs, with 5,708 pairs for training and 1,000 pairs for testing. It covers a wide range of motion patterns and blur levels, providing a comprehensive evaluation environment for deblurring algorithms. VisDrone-VID2019 Dataset: We also conduct experiments on the VisDrone-VID2019 [33] benchmark, which comprises 79 real-world UAV video sequences, totaling 33,366 frames. These videos are captured under diverse weather and illumination settings across multiple urban locations, ensuring a broad range of motion patterns and scene complexity. To simulate motion blur for our method’s evaluation, we apply the approach of [1] to generate artificially blurred frames from the original VisDrone-VID2019 videos. This procedure enables us to assess how effectively our deblurring framework can restore image clarity in high-speed UAV footage and subsequently improve object detection. For quantitative assessment, we follow the protocol of the MS COCO-style metrics—namely AP, AP50, AP75, AR1, AR10, AR100, and AR500 where AP (averaged over IoU thresholds from 0.5 to 0.95) serves as the primary ranking metric. IV-B Implementation Details Training Details: The network is implemented in PyTorch and trained on 8 NVIDIA A100 GPUs with a batch size of 8. The initial learning rate is set to 4×10−44× 10^-4. We use the Adam optimizer [11] with β1=0.9 _1=0.9 and β2=0.999 _2=0.999. The flow estimator in our method utilizes pre-trained weights from RAFT [24] and remains fixed during training. During training, input images are randomly cropped to 256×256256× 256 patches with random flipping and rotation augmentations. Fig. 8: Precision-recall Curves on the VisDrone-VID2019 [33] Dataset. The proposed method (F: Ours + RTDETR [31]) achieves the best precision-recall performance, consistently outperforming previous methods including STFAN [32], VRT [16], RVRT [17], and Shift-Net [12]. This demonstrates its superior capability in handling degraded UAV imagery and improving object detection accuracy. TABLE I: Comparison results (AP, AR %) on the VisDrone-VID2019 [33] dataset. All entries use the same RTDETR [31] detection framework. We report AP, AP50, AP75, and AR under different candidate limits (1, 10, 100, 500). Method AP AP50 AP75 AR1 AR10 AR100 AR500 (A) Blur Video + RTDETR [31] 21.53 45.22 16.34 10.45 28.74 42.66 44.12 (B) STFAN [32] + RTDETR [31] 29.22 58.00 25.34 14.30 35.58 50.75 53.67 (C) VRT [16] + RTDETR [31] 31.50 60.20 27.80 15.20 37.44 52.20 55.10 (D) RVRT [17] + RTDETR [31] 32.60 62.80 28.60 16.10 38.05 53.60 56.00 (E) Shift-Net+ [12] + RTDETR [31] 33.80 63.20 29.25 16.60 38.90 54.40 57.50 (F) Ours + RTDETR [31] 35.12 64.70 30.80 17.75 40.10 55.90 59.20 IV-C Main Results IV-C1 Quantitative Evaluation GoPro Dataset: As reported in Table I, our proposed method achieves a PSNR/SSIM of 36.12 dB and 0.9799, outperforming existing state-of-the-art approaches such as Shift-Net+ [12] and RVRT [17]. Notably, our framework surpasses these competitors by a clear margin (e.g., a relative PSNR gain of over 0.2 dB compared to Shift-Net+), indicating its superior capacity for recovering details under diverse motion blur patterns. Visual comparisons in Figure 4 further highlight the sharper textures and reduced artifact levels of our outputs. DVD Dataset: As shown in Table I, our approach also maintains a clear advantage over prior works on the DVD dataset, achieving 35.18 dB in PSNR and 0.9778 in SSIM. Compared to alternative methods, our framework consistently restores finer structural details and suppresses temporal artifacts even in challenging cases with large camera motion and dynamic objects. TABLE I: Ablation Study on the GoPro Dataset (PSNR/SSIM) and the VisDrone-VID2019 Dataset. ALSS = Adaptive Latent Scale Selector, MAlign = Multi-Frame Alignment, Gating = Learnable Gating. The best results are in bold. Method ALSS MAlign Gating GoPro VisDrone-VID2019 PSNR SSIM AP AP50 AP75 AR1 AR10 AR100 AR500 (1) Baseline – – – 34.20 0.9680 31.00 60.30 27.00 15.20 36.10 51.20 53.50 (2) + ALSS ✓ – – 34.80 0.9710 31.90 61.20 28.00 15.80 37.00 52.10 54.60 (3) + MAlign – ✓ – 35.00 0.9730 32.50 62.10 28.90 16.00 38.00 53.80 55.90 (4) + Gating – – ✓ 35.10 0.9745 33.00 62.70 29.10 16.20 38.40 54.10 56.10 (5) + MAlign + Gating – ✓ ✓ 35.50 0.9770 34.00 63.50 29.70 16.50 39.00 55.20 57.30 (6) Ours (ALSS + MAlign + Gating) ✓ ✓ ✓ 36.12 0.9799 35.12 64.70 30.80 17.75 40.10 55.90 59.20 IV-C2 Qualitative Results Figures 4 and 5 show a visual comparison of our method against recent approaches on the GoPro and DVD datasets, respectively. It is evident that our restorations exhibit sharper boundaries, fewer artifacts, and more perceptually faithful textures. In particular, our Multi-Frame Alignment and Learnable Gating (MALG) module excels at integrating spatial and temporal cues to suppress ghosting and jitter, which are especially problematic in dynamic scenes with complex motion. For instance, rapidly moving objects or camera-induced vibrations often cause severe blur that competing methods struggle to remove cleanly. IV-D Experimental Result on UAV Object Detection Dataset We use the VisDrone-VID 2019 dataset to compare various deblurring pipelines under a consistent detection framework (RTDETR [31]). Method (A) feeds the original blurry videos directly into RTDETR, while (B) to (F) first apply different deblurring algorithms and then use the resulting restored frames as input to RTDETR. All methods adopt the same inference settings from RTDETR (batch size, learning rate, etc.) for a fair comparison. We measure detection performance using standard AP and AR metrics at IoU thresholds of 0.50/0.75, as well as recall under varying candidate limits. IV-E Results and Discussion Table I summarizes the detection performance. We observe that running RTDETR on blurry videos (Method A) yields limited accuracy (AP = 21.53%). In contrast, incorporating a deblurring stage (Methods B to F) consistently boosts AP and AR scores. Specifically, STFAN (B) improves AP to 29.22%, underscoring the benefit of a video-focused approach. VRT (C) and RVRT (D) further refine temporal alignment, leading to better results. Shift-Net+ (E) attains 33.80% AP, highlighting its effectiveness in handling complex blurs. Refer to Figure 8 for the detailed comparison curves and Figure 7 for qualitative comparison of object detection performance. Notably, our proposed method (F) outperforms all baselines, achieving 35.12% AP and 64.70% AP50. We attribute this improvement to (i) robust multi-frame alignment, (i) our learnable gating strategy filtering misaligned features. These findings confirm the crucial role of deblurring in enhancing UAV object detection performance under challenging motion conditions. TABLE IV: Combined Ablation Study on Latent Scale and Cached Latent Frames on VisDrone-VID2019. Best results in each block are in bold. Experiment PSNR SSIM AP Time (ms) Latent Scale Ablation Fixed size 16×1616× 16 33.50 0.9590 30.10 20 Fixed size 32×3232× 32 34.00 0.9660 31.50 30 Fixed size 64×6464× 64 34.50 0.9700 32.40 45 + Adaptive Scale (ALSS) 34.20 0.9671 32.80 35 Cached Latent Frames Ablation M=1M=1 34.50 0.9710 31.00 30 M=2M=2 34.90 0.9740 32.90 33 M=4M=4 35.10 0.9750 34.40 36 M=8M=8 35.20 0.9760 35.12 40 M=16M=16 35.10 0.9755 34.80 48 IV-F Ablation Study To evaluate the impact of each major component in our model, we conducted an ablation study by analyzing the effects of including Adaptive Latent Scale Selector and cached latent frame count for MFCA. The study examines how each setting individually contributes to the overall performance of the model. The results are summarized in Table IV. IV-F1 Impact of Adaptive Latent Scale Selector (Latent Scale Ablation) As shown in the top rows of Table IV, using a larger fixed latent size (e.g., 64×6464× 64) generally improves PSNR and AP but also increases inference time. By contrast, the Adaptive Latent Scale Selector (ALSS) dynamically balances detail preservation and speed: it achieves 34.20 dB PSNR and 32.80% AP in 35 ms—close to the quality of the larger 64×6464× 64 fixed size yet noticeably faster. This suggests that ALSS provides an optimal trade-off for UAV scenarios with highly variable motion intensities, effectively reducing unnecessary computation on smoother frames while preserving fine details in challenging frames. IV-F2 Impact of Cached Latent Frames (Multi-Frame Ablation) In the bottom rows of Table IV, we compare different numbers M of cached past latent. Increasing M from 1 to 8 steadily boosts PSNR, SSIM, and detection AP, indicating that a richer temporal context leads to better deblurring and object detection. At M=8M=8, we reach the highest AP (35.12%), although inference time rises to 40 ms. Beyond M=8M=8, gains begin to diminish (with a slight drop in AP at M=16M=16) while the time cost increases further. Consequently, M=8M=8 offers the most favorable balance between accuracy and efficiency, making it well-suited for real-time UAV deblurring. IV-F3 Ablation on Each Module We systematically ablate our proposed modules on both the GoPro and VisDrone-VID2019 datasets, as summarized in Table I. (1) Adaptive Latent Scale Selector (ALSS): Dynamically choosing the latent resolution based on optical flow substantially boosts both PSNR/SSIM and detection metrics. (2) Multi-Frame Alignment (MAlign): Warping preceding latents to the current frame markedly reduces temporal artifacts and enhances deblurring quality. (3) Learnable Gating (Gating): Per-pixel gating effectively suppresses occlusions and misaligned regions, further improving robustness and overall performance. When all modules are combined (Row (6)), our method attains the best results across datasets, confirming that these modules complement each other in tackling severe motion blur and improving UAV-based detection. V Summary In this paper, we introduced a novel UAV video deblurring framework based on a motion-aware diffusion model designed to boost target detection performance for UAV. Extensive experiments on the VisDrone-VID 2019 dataset confirm that our approach significantly enhances detection accuracy. Furthermore, evaluations on the GoPro and DVD datasets demonstrate that our method consistently outperforms state-of-the-art deblurring techniques, validating its robustness for real-time applications in dynamic environments. References [1] T. Brooks and J. T. Barron (2019) Learning to synthesize motion blur. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 6840–6848. Cited by: §IV-A. [2] L. Chen, X. Chu, X. Zhang, and J. Sun (2022) Simple baselines for image restoration. In European conference on computer vision, p. 17–33. Cited by: TABLE I. [3] Z. Chen, Y. Zhang, D. Liu, J. Gu, L. Kong, X. Yuan, et al. (2024) Hierarchical integration diffusion model for realistic image deblurring. Advances in neural information processing systems 36. Cited by: §I. [4] C. Deng, M. Wang, L. Liu, Y. Liu, and Y. Jiang (2021) Extended feature pyramid network for small object detection. IEEE Transactions on Multimedia 24, p. 1968–1979. Cited by: §I-A. [5] P. Dhariwal and A. Nichol (2021) Diffusion models beat gans on image synthesis. Advances in neural information processing systems 34, p. 8780–8794. Cited by: §I, §I-C. [6] J. Ho, A. Jain, and P. Abbeel (2020) Denoising diffusion probabilistic models. Advances in neural information processing systems 33, p. 6840–6851. Cited by: §I-C3. [7] E. Hoogeboom, J. Heek, and T. Salimans (2023) Simple diffusion: end-to-end diffusion for high resolution images. In International Conference on Machine Learning, p. 13213–13232. Cited by: §I. [8] Z. Hu, T. Yu, S. Huang, and M. Ishikawa (2024) Dynamic spectraformer for ultra-high-definition underwater image enhancement. In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), p. 8634–8641. Cited by: §I-B. [9] Z. Hu and T. Yu (2022) Learning to predict decomposed dynamic filters for single image motion deblurring. In Proceedings of the Asian conference on computer vision, p. 4225–4242. Cited by: §I, §I-B. [10] B. Kawar, M. Elad, S. Ermon, and J. Song (2022) Denoising diffusion restoration models. Advances in Neural Information Processing Systems 35, p. 23593–23606. Cited by: §I, §I-C. [11] D. P. Kingma and J. Ba (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980. Cited by: §IV-B. [12] D. Li, X. Shi, Y. Zhang, K. C. Cheung, S. See, X. Wang, H. Qin, and H. Li (2023) A simple baseline for video restoration with grouped spatial-temporal shift. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 9822–9832. Cited by: Fig. 6, TABLE I, Fig. 8, §IV-C1, TABLE I. [13] D. Li, C. Xu, K. Zhang, X. Yu, Y. Zhong, W. Ren, H. Suominen, and H. Li (2021) Arvo: learning all-range volumetric correspondence for video deblurring. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 7721–7731. Cited by: TABLE I. [14] H. Li, Y. Yang, M. Chang, S. Chen, H. Feng, Z. Xu, Q. Li, and Y. Chen (2022) Srdiff: single image super-resolution with diffusion probabilistic models. Neurocomputing 479, p. 47–59. Cited by: §I-C. [15] Y. Li, Q. Fan, H. Huang, Z. Han, and Q. Gu (2023) A modified yolov8 detection network for uav aerial image recognition. Drones 7 (5), p. 304. Cited by: §I-A. [16] J. Liang, J. Cao, Y. Fan, K. Zhang, R. Ranjan, Y. Li, R. Timofte, and L. Van Gool (2024) Vrt: a video restoration transformer. IEEE Transactions on Image Processing. Cited by: Fig. 6, TABLE I, Fig. 8, TABLE I. [17] J. Liang, Y. Fan, X. Xiang, R. Ranjan, E. Ilg, S. Green, J. Cao, K. Zhang, R. Timofte, and L. V. Gool (2022) Recurrent video restoration transformer with guided deformable attention. Advances in Neural Information Processing Systems 35, p. 378–393. Cited by: §I-B, Fig. 6, Fig. 7, TABLE I, Fig. 8, §IV-C1, TABLE I. [18] J. Lin, Y. Cai, X. Hu, H. Wang, Y. Yan, X. Zou, H. Ding, Y. Zhang, R. Timofte, and L. Van Gool (2022) Flow-guided sparse transformer for video deblurring. arXiv preprint arXiv:2201.01893. Cited by: §I-B. [19] A. Lugmayr, M. Danelljan, A. Romero, F. Yu, R. Timofte, and L. Van Gool (2022) Repaint: inpainting using denoising diffusion probabilistic models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p. 11461–11471. Cited by: §I-C. [20] S. Nah, T. H. Kim, and K. M. Lee (2017) Deep multi-scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, p. 3883–3891. Cited by: Fig. 4, Fig. 4, §IV-A. [21] R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer (2022) High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 10684–10695. Cited by: §I-B1. [22] Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, and B. Poole (2021) Score-based generative modeling through stochastic differential equations. In 9th International Conference on Learning Representations (ICLR), Cited by: §I-C. [23] S. Su, M. Delbracio, J. Wang, G. Sapiro, W. Heidrich, and O. Wang (2017) Deep video deblurring for hand-held cameras. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 1279–1288. Cited by: §I-B, Fig. 5, Fig. 5, Fig. 6, Fig. 6, §IV-A. [24] Z. Teed and J. Deng (2020) Raft: recurrent all-pairs field transforms for optical flow. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16, p. 402–419. Cited by: §I-B2, §IV-B. [25] X. Wang, K. C. Chan, K. Yu, C. Dong, and C. Change Loy (2019) Edvr: video restoration with enhanced deformable convolutional networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, p. 0–0. Cited by: §I. [26] J. Whang, M. Delbracio, H. Talebi, C. Saharia, A. G. Dimakis, and P. Milanfar (2022) Deblurring via stochastic refinement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p. 16293–16303. Cited by: §I-C. [27] L. Xu and J. Jia (2010) Two-phase kernel estimation for robust motion deblurring. In Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part I 11, p. 157–170. Cited by: §I. [28] H. Zhang, H. Xie, and H. Yao (2022) Spatio-temporal deformable attention network for video deblurring. In European Conference on Computer Vision, p. 581–596. Cited by: TABLE I. [29] Z. Zhang (2023) Drone-yolo: an efficient neural network method for target detection in drone images. Drones 7 (8), p. 526. Cited by: §I-A. [30] Z. Zhang, X. Lu, G. Cao, Y. Yang, L. Jiao, and F. Liu (2021) ViT-yolo: transformer-based yolo for object detection. In Proceedings of the IEEE/CVF international conference on computer vision, p. 2799–2808. Cited by: §I-A. [31] Y. Zhao, W. Lv, S. Xu, J. Wei, G. Wang, Q. Dang, Y. Liu, and J. Chen (2024) Detrs beat yolos on real-time object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p. 16965–16974. Cited by: §I-A, Fig. 7, Fig. 7, Fig. 7, Fig. 8, Fig. 8, §IV-D, TABLE I, TABLE I, TABLE I, TABLE I, TABLE I, TABLE I, TABLE I. [32] S. Zhou, J. Zhang, J. Pan, H. Xie, W. Zuo, and J. Ren (2019) Spatio-temporal filter adaptive network for video deblurring. In Proceedings of the IEEE/CVF international conference on computer vision, p. 2482–2491. Cited by: TABLE I, Fig. 8, TABLE I. [33] P. Zhu, L. Wen, D. Du, X. Bian, H. Fan, Q. Hu, and H. Ling (2021) Detection and tracking meet drones challenge. IEEE Transactions on Pattern Analysis and Machine Intelligence 44 (11), p. 7380–7399. Cited by: Fig. 7, Fig. 7, Fig. 8, Fig. 8, §IV-A, TABLE I, TABLE I.