Paper deep dive
Infant Care Video Dataset for Classification of Interventions Using Transformers
Igor Bogdanov, James Green
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 92%
Last extracted: 8/26/2026, 4:45:54 AM
Summary
This paper introduces the Infant Care Video Dataset (ICVD), a collection of 4,144 videos simulating 12 neonatal intensive care unit (NICU) interventions using manikins to ensure privacy. The authors establish baseline performance using video transformer architectures, specifically TimeSformer (93.97% accuracy) and MotionFormer (93.17% accuracy), demonstrating that temporal modeling is critical for accurate intervention classification compared to framewise approaches.
Entities (6)
Relation Signals (5)
TimeSformer â achievedaccuracy â 93.97%
confidence 95% ¡ TimeSformer... achieved 93.97%... top-1 accuracy
MotionFormer â achievedaccuracy â 93.17%
confidence 95% ¡ MotionFormer... achieved 93.17%... top-1 accuracy
Infant Care Video Dataset â contains â 12 simulated intervention classes
confidence 95% ¡ a collection of 4,144 videos spanning 12 simulated intervention classes
TimeSformer â outperforms â framewise approach
confidence 92% ¡ demonstrates a 70.80% performance gap... validating the need for temporal modeling
Infant Care Video Dataset â usedfor â automated documentation systems
confidence 90% ¡ designed for developing automated documentation systems
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Healthcare documentation in the neonatal intensive care unit (NICU) presents significant challenges, with nurses spending approximately 25\% of their time on record-keeping, while up to 60\% of interventions remain undocumented. Motivated by the need to detect interventions from video automatically, we present the Infant Care Video Dataset (ICVD), a collection of 4,144 videos spanning 12 simulated intervention classes designed for developing automated documentation systems. Our manikin-based approach systematically varies conditions, such as camera angle and clinician skin tone, while ensuring privacy compliance. Using video transformer architectures (TimeSformer and MotionFormer), we establish strong baseline performance (93.97\% and 93.17\% top-1 accuracy) among the 12 infant care classes. Our ablation study comparing temporal models with a framewise approach (23.17\% accuracy) demonstrates a 70.80\% performance gap, validating the need for temporal modeling. The ICVD provides a foundation for developing automated documentation systems to reduce clinical burden in neonatal care environments and improve existing practices.
Tags
Links
- Source: https://arxiv.org/abs/2608.23838v1
- Canonical: https://arxiv.org/abs/2608.23838v1
Trouble viewing inline? Open PDF directly â
Full Text
31,765 characters extracted from source content.
Expand or collapse full text
Infant Care Video Dataset for Classification of Interventions Using Transformers Igor Bogdanov Affiliation: Department of Systems and Computer Engineering Carleton University Ottawa, Canada igorbogdanov@cmail.carleton.ca James Green Affiliation: Department of Systems and Computer Engineering Carleton University Ottawa, Canada jrgreen@sce.carleton.ca Abstract Healthcare documentation in the neonatal intensive care unit (NICU) presents significant challenges, with nurses spending approximately 25% of their time on record-keeping, while up to 60% of interventions remain undocumented. Motivated by the need to detect interventions from video automatically, we present the Infant Care Video Dataset (ICVD), a collection of 4,144 videos spanning 12 simulated intervention classes designed for developing automated documentation systems. Our manikin-based approach systematically varies conditions, such as camera angle and clinician skin tone, while ensuring privacy compliance. Using video transformer architectures (TimeSformer and MotionFormer), we establish strong baseline performance (93.97% and 93.17% top-1 accuracy) among the 12 infant care classes. Our ablation study comparing temporal models with a framewise approach (23.17% accuracy) demonstrates a 70.80% performance gap, validating the need for temporal modeling. The ICVD provides a foundation for developing automated documentation systems to reduce clinical burden in neonatal care environments and improve existing practices. Index Terms: video transformers, neonatal care, machine learning, intervention classification, healthcare automation, NICU I Introduction Neonatal intensive care units (NICUs) face a critical challenge balancing patient care with documentation requirements. Documentation consumes 25-50% of cliniciansâ time [1]. Nurses perform an average of 35-45 direct care interventions per infant per 12-hour shift, with up to 60% of routine interventions going undocumented due to workflow constraints [2]. Computer vision-based automation offers a promising solution, but development is stalling due to the absence of specialized datasets for this domain [3]. Privacy regulations pose exceptional barriers in neonatal healthcare. While medical video datasets exist for surgical procedures, no publicly available datasets capture the routine care procedures specific to NICU environments [4, 5, 6]. This absence represents a fundamental constraint on developing automated documentation systems. This paper presents three contributions: (1) the Infant Care Video Dataset (ICVD), comprising 4,144 videos of simulated care spanning 12 standardized NICU procedures; (2) performance benchmarks established through transfer learning with state-of-the-art video transformer architectures; and (3) a methodological framework for intervention classification in privacy-sensitive healthcare domains. Our manikin-based approach preserves essential visual characteristics while addressing ethical and privacy constraints, enabling broader data access than datasets requiring restricted protocols. The ICVD targets the documented problem of intervention under-reporting in clinical settings, where correct reporting rates for routine procedures can fall as low as 31% [2]. We identified the selected intervention classes through consultation with practicing NICU nurses. These classes represent high-frequency activities performed repeatedly throughout shifts but inconsistently documented due to workflow constraints. Our experimental results demonstrate that temporal information is critical for accurate intervention classification, with a 70.80% performance gap between frame- and video-based approaches. The TimeSformer [7] and MotionFormer [8] models achieved 93.97% and 93.17% top-1 accuracy, respectively, validating our dataset design decisions for automated documentation systems. I Related Work I-A Medical Video Datasets In the surgical domain, several high-quality video datasets have established benchmarks for workflow analysis, including JIGSAWS [9] and Cholec80 [10]. However, neonatal care reveals a significant gap in procedure-focused datasets. Most existing neonatal collections target physiological monitoring rather than care interventions, such as the NBHR dataset [4] and AUB Neonatal Vitals dataset [5]. Most relevant to this study is the recent NICU Care Activities dataset [3], which contains 289 hours of real infant footage (three types of interventions), but is inaccessible due to privacy issues. ICVD addresses these limitations by providing 12 intervention classes with a manikin-based approach that eliminates privacy concerns while prioritizing accessibility. I-B Action Recognition in Healthcare Video-based action recognition in healthcare has evolved significantly, with transformer-based architectures increasingly replacing CNNs due to their ability to capture long-range temporal dependencies [11]. Recent applications include surgical workflow recognition, though neonatal care presents unique challenges [12]. Majeedi et al. [3] applied temporal transformer models to detect three different caregiving activities in NICU videos, while Hajj-Ali et al. [13] used vision transformers with depth cameras to detect the presence of clinicians in the patient care space. Using a privacy-preserving dataset, our work extends classification to a broader set of intervention classes. I-C NICU Documentation NICU documentation faces unique challenges due to continuous care and frequent interventions. In one study that examined documentation of patient repositioning interventions, documentation compliance was shown to be as low as 31%. Automated systems improved compliance to 82% [2]. Underreporting creates a limited picture and makes it hard to evaluate the impacts of caregiving on the outcomes [14]. NICU nurses may need to record hundreds of data points per shift, often navigating complex interfaces. In most cases, the nurse must leave the patient care space to complete data entry. Ultimately, documentation can consume hours [15], reducing time for direct patient care and potentially impacting clinical decision-making when vital information is missed [16]. I Dataset Design and Collection I-A Design Principles Five key principles guided the ICVD: 1. Clinical Relevance: Intervention classes were selected based on frequency and documentation importance in NICU settings. 2. Action Discreteness: Interventions were designed to be temporally distinct and recognizable through hand movements. 3. Hierarchical Complexity: ICVD includes atomic actions and composite procedures, allowing models to learn relationships between simple and complex interventions. 4. Standardization with Variability: We incorporated controlled variability in lighting, backgrounds, hand coverings, and recording devices. 5. Ethical Accessibility: Using a manikin and showing only the clinicianâs hands creates videos that can be widely distributed without privacy constraints. I-B Procedure Selection We identified 12 distinct intervention classes representing the most frequent hands-on care activities that require documentation but are often underreported: ⢠Giving/Taking Pacifier: Non-nutritive sucking interventions critical for comfort [17]. ⢠Diaper-related: Changing, applying, and removing diapers, frequent daily intervention [3]. ⢠Feeding: Directly impacting growth outcomes and requiring detailed documentation [3]. ⢠Crib handling: Removing and replacing the patient from the crib or overhead warmer bed, marking significant transitions [3]. ⢠Hygiene: Wiping body and wiping face, typically performed multiple times daily [3]. ⢠Temperature management: Covering and uncovering the patient for thermoregulation [18]. The Dataset includes atomic actions and composite sequences (e.g., diaper change that incorporates removing and replacing diapers). I-C Recording Methodology Our recording configuration used eight cameras arranged around the crib (Fig. 1), mounted at various angles at similar distances from the crib center. The setup included two iPhone 11 Pro Max devices, an iPhone 8 Plus, two Arenti 360° View 5G WiFi Pet monitors, an Arenti 4MP Baby Monitor, a Google Pixel 7 Pro, and a Samsung Galaxy S22 Ultra. Including diverse cameras in the Dataset enables the development of robust intervention classification systems that function independently of the specific camera model. Furthermore, recording sessions systematically varied other conditions: natural/artificial lighting, light/dark crib sheets, and five hand covering types. The recording process generated approximately 48 hours of unedited footage. This raw footage was reviewed, segmented, and edited during post-production using Final Cut Pro into 3- to 40-second clips. Each clip captured a single, complete instance of an intervention and was isolated to show only the hands performing the intervention and the manikin, maintaining the privacy-preserving design of the Dataset. The post-production phase yielded 4,144 individual video clips from an initial target of 4,160 with a rigorous quality control process that resulted in a 99.6% acceptance rate. Quality control included assessment of intervention completeness, visual clarity, procedural accuracy, and background consistency, resulting in only 16 videos (0.4%) being rejected from the initial recordings. Fig. 1: Camera configuration used for dataset recording. Eight cameras were positioned around the infant manikin in the crib. The cameras included several smartphone models and baby monitors to capture diverse perspectives and recording quality, representing real-world monitoring conditions. IV Dataset Properties and Organization IV-A Technical Specifications All videos in the ICVD were standardized to ensure consistent technical specifications while preserving essential visual details for intervention classification. Each recording is provided in .mov or .mp4 format with H.264 video encoding at approximately 270 kbps bitrate. The videos are uniformly presented in landscape orientation and were cropped and resized to standardized dimensions of 456Ă256 pixels, while maintaining the original aspect ratio. The frame rate of each clip varies between 24 and 60 fps, depending on the camera output, and provides sufficient temporal resolution to capture the motion dynamics of interventions. Audio tracks were removed during processing to eliminate privacy concerns and reduce file sizes. The mean duration of clips is approximately 17 seconds, with longer durations corresponding to more complex procedures such as diaper changing. The Dataset occupies approximately 2.21 GB, with individual clips averaging 570-600 KB each. IV-B Temporal Characteristics The temporal dimension is critical for differentiating interventions that appear visually similar in static frames. For example, covering and uncovering involve identical visual elements but in reverse temporal order; static image analysis would be insufficient to distinguish between these classes. Similarly, several interventions contain overlapping motion patterns requiring temporal context for proper classification, a challenge noted in recent healthcare action recognition research [11]. Fig. 2 provides samples from diaper-change intervention that involves two similarly looking atomic actions: removal and replacement of the diaper. (a) t=0s (b) t=1s (c) t=2s (d) t=3s Fig. 2: Sample frames from a diaper-change intervention showing: (a) preparing, (b) removing, (c) starting diaper application, and (d) applying a fresh diaper. To validate the importance of temporal information, we conducted an ablation study comparing frame-based models with the whole video transformer approach, confirming that temporal modeling substantially improved classification accuracy, particularly for visually similar intervention pairs. This validation reinforces our design decision to emphasize complete temporal sequences rather than representative keyframes, consistent with findings in surgical workflow analysis [11, 7]. IV-C Data Variability To ensure robustness, we incorporated controlled variability (Fig. 3): Fig. 3: Systematic variability factors in the ICVD dataset. Left: Two background conditions. Center: Five hand covering types. Right: Two performers and eight camera perspectives. 1. Backgrounds: Light/dark crib sheets. 2. Hand coverings: Five different colours of gloves reflecting clinical practice. 3. Performers: One male and one female with varying hand sizes and techniques. 4. Camera perspectives: Eight positions providing varied viewing angles. 5. Lighting: Both artificial and natural lighting scenarios. Fig. 4: Sample frames showcase the visual diversity across intervention types, camera angles, hand coverings, and background conditions. Top row (left to right): blanket-cover with bare hands, putting baby to crib, feeding with green gloves. Middle row: diaper-remove with blue gloves on light sheet, pacifier-give with white gloves on dark sheet, diaper-change with dark blue gloves. Bottom row: wiping-face with blue gloves, blanket-uncover on white sheet, wiping-face with light blue gloves on dark sheet. Note the systematic variation in hand coverings (bare hands, white, green, dark blue, light blue gloves) and background conditions (dark and light sheets). Fig. 4 shows sample frames from different intervention classes in the ICVD dataset. IV-D Organization and Distribution The Dataset follows a three-level hierarchical organization: split level (70-15-15 train-validation-test ratio, reflected in Table I), class level (12 intervention categories), and lighting condition level (dark/light backgrounds). The ICVD maintains class balance with most classes containing 310-340 recordings (Table I). The wiping-body class contains more videos (610) since it was repeated both in the presence and absence of a diaper to capture a greater variety of techniques. TABLE I: Dataset split for model training Split Number of videos Total 4144 Train 2892 Validation 624 Test 631 TABLE I: Number of videos by class and background type Classes Index Light Dark Total Giving Pacifier 7 172 162 334 Changing Diaper 10 160 145 305 Taking Pacifier 5 163 158 321 Feeding 6 163 152 315 Removing from crib 1 165 172 337 Replacing infant in crib 8 166 173 339 Wiping body, w/wo diaper 0 313 297 610 Wiping face 4 165 159 324 Covering 2 162 157 319 Uncovering 9 158 157 315 Applying Diaper 3 156 154 310 Removing Diaper 11 160 155 315 IV-E Access Protocol and Reproducibility We established a controlled access protocol for the ICVD to promote reproducible research while ensuring ethical use. Researchers can request access via https://w.infantcaredataset.org. Approved users are granted a non-exclusive license to maximize ICVDâs impact and facilitate innovation in healthcare documentation automation. V Baseline Experiments V-A Methods Two video transformer architectures, pretrained on Kinetics-400 [19], were fine-tuned on the training dataset to establish state-of-the-art baseline performance. Our experiments focused on two distinct attention mechanisms: TimeSformerâs (TSF) divided space-time attention [7] and MotionFormerâs (MF) trajectory attention [8], both representing different approaches to modeling spatiotemporal relationships in video data [11]. The following fine-tuning pipeline was used for both methods: 1. Preprocessing: Input videos were processed using uniform temporal sampling. TSF extracted 20 frames per clip (stride of 32), while MF used 16 frames per clip (stride of 4), with the same target framerate of 30 FPS. Frames were resized to 224Ă224 pixels using center cropping during evaluation and random cropping during training (scale jittering range 0.8-1.0). Inputs were normalized with mean=[0.45, 0.45, 0.45] and standard deviation=[0.225, 0.225, 0.225] for TSF, while MF used mean=[0.5, 0.5, 0.5] and standard deviation=[0.5, 0.5, 0.5]. Additional augmentations included random horizontal flipping (p = 0.5) and color jittering for MF, which was disabled for TSF. 2. Model architecture: TSF utilizes a ViT-base configuration with 12 transformer layers, 12 attention heads, embedding dimension of 768, and patch size of 16Ă16 pixels [7]. The divided space-time attention mechanism first computes self-attention along the spatial dimension for each frame, followed by temporal attention across frames [7]. MF employs 12 transformer blocks with trajectory attention that explicitly models motion tubes by tracking corresponding tokens across frames, with an embedding dimension of 768, 12 attention heads, and a patch size of 16Ă16 pixels [8]. Both architectures have proven effective for long-range temporal modeling in healthcare videos [11]. 3. Optimization: TSF was fine-tuned using the SGD optimizer with a base learning rate of 0.005, momentum of 0.9, and weight decay of 0.0001, following the optimization strategy in [7]. MF used the AdamW optimizer with a lower base learning rate of 0.0001 and weight decay of 0.05, reflecting its different pretraining approach and architecture characteristics [8]. Both models used a step-based learning rate schedule with relative learning rates at predefined epochs. TSF was trained for 15 epochs (approximately 3 hours of computation), while MF required 35 epochs (approximately 2 hours) due to its lower learning rate and different attention mechanism. All models were trained on a single NVIDIA A100 40GB GPU with a batch size of 8. 4. Ablation design: To assess the importance of temporal information in intervention classification, we designed an ablation study comparing the full TSF model against a framewise (FW) version that processed video frames using space-only attention and single-frame input. [11]. We computed class-balanced macro-averaged metrics for evaluation, including top-1/top-5 accuracy, precision, recall, and F1-scores. V-B Results Both video transformer models achieved exceptional performance (Table I). TSF reached 93.97% top-1 and 100% top-5 accuracy on the test set, with similar results from MF (93.17% top-1; 99.84% top-5). TABLE I: Model Performance Metrics On The Test Set Model Top-1 (%) Top-5 (%) Precision (%) Recall (%) F1 (%) TSF 93.97 100.00 94.11 93.29 92.92 MF 93.17 99.84 93.73 92.32 91.29 FW 23.17 65.87 23.08 23.00 19.45 Our ablation study revealed that the framewise (FW) approach achieved only 23.17% top-1 accuracy, demonstrating a 70.80% performance gap compared to the temporal model. This gap provides compelling evidence for the critical importance of temporal information in intervention classification. V-B1 Class-Level Performance Analysis Examining the performance at the class level highlights specific patterns in model capabilities and limitations. The per-class analysis of TSF and MF results reveals outstanding model performances for most interventions. For example, for TSF, as shown in Fig. 5, six classes achieved perfect 100% accuracy: crib-take (removing from crib), wiping-face, pacifier-give, crib-put (replacing infant in the crib), blanket-uncover, and diaper-remove. Three additional classes achieved excellent performance above 97%: wiping-body (98.91%), blanket-cover (97.96%), and pacifier-take (97.96%). The feeding class performed at 97.92% accuracy. Fig. 5: Per-class accuracy comparison between models. Temporal models achieve near-perfect accuracy on most classes, unlike the framewise model. V-B2 Temporal Context and Hierarchical Activities Two classes exhibited notable challenges for the model. The diaper-apply class achieved 85.42% accuracy, with most confusions occurring with diaper-change (6 instances) and diaper-remove (1 instance). Most significant drop in performance can be observed for the diaper-change class at only 41.30% accuracy, with 25 cases being confused with diaper-remove, as visualized in the confusion matrix (Fig. 6, left). This pattern of confusion is logically consistent, as diaper-change includes elements of both removing and applying a diaper, making it particularly challenging for the model to identify diaper-change as a distinct procedure rather than as its component actions. An analogous phenomenon has also been observed in composite surgical activities [11]. Fig. 6: Normalized confusion matrices comparing models. Left: TimeSformer shows near-perfect classification for most classes. Middle: MotionFormer exhibits similar patterns. Right: The framewise model shows substantial confusion across classes. MF shows a similar pattern (Fig. 6, middle and Fig. 5), with diaper-change achieving only 28.26% accuracy. This consistently poor performance across both architectures on this particular class highlights the challenge of distinguishing composite activities from their parts, a known difficulty in hierarchical action recognition tasks [12, 3]. The framewise model particularly struggled with temporally-defined class pairs: covering/uncovering and diaper-apply/diaper-remove were frequently confused as these classes involve identical visual elements performed in reverse temporal order. Unlike the complete temporal model, the framewise approach could not disambiguate these visually similar actions, resulting in near-random classification between such pairs. The framewise modelâs low precision (23.08%), recall (23.00%), and F1 score (19.45%) further confirm its inability to handle the classification task without temporal context. Classes with more distinctive spatial features (like crib-put at 68.63% and blanket-uncover at 91.67%) achieved somewhat better performance but still fell far short of the temporal modelâs accuracy, demonstrating the limits of static frame analysis for dynamic activities. Fig. 7: Intervention classification performance metrics. Both temporal models substantially outperform the framewise model. Summary metrics for all three models (Fig. 7) demonstrate the stark contrast in performance. Both TSF and MF achieve exceptional top-5 accuracy (100% for TSF, 99.84% for MF) and strong macro-averaged precision, recall, and F1 scores above 91%, indicating robust generalization across the intervention class set. VI Future Work and Limitations Future work should address several limitations and opportunities: 1. Clinical representativeness: The manikin-based approach creates an inherent gap between our simulated environment and NICU settings. Although the interventions were designed to mimic clinical procedures, they lack the variability introduced by infant movement, different body sizes, and unpredictable responses common in real-world care. Future work should validate these models on ethically approved recordings of actual NICU care footage after establishing baseline performance on our controlled Dataset. 2. Dataset scope: The current intervention set of 12 classes excludes clinical procedures and interventions, e.g., respiratory or resuscitation procedures. Expanding the intervention classes would provide a more comprehensive foundation for automated documentation. Furthermore, ICVD treats each intervention as an isolated event, whereas genuine NICU care involves sequences of related interventions. Lastly, it is common for multiple interventions to overlap (e.g., diaper changing and wiping); thus, the problem of intervention detection should likely be framed as a multi-label, rather than multi-class problem. 3. Model robustness: The ICVD recording environment does not fully capture all challenges of actual NICU monitoring systems, which often operate under more variable lighting conditions and more constrained viewing angles than our controlled setting [13, 3]. Future work should explore model robustness across a broader range of video qualities, including low-resolution streams, and conclusions by clinicians and equipment. Furthermore, since the ICVD contains video from several different cameras and viewpoints, an analysis of classification performance for each camera can inform best practices for actual clinical deployment. 4. Clinical translation: The transition from intervention detection to automated documentation, developing systems that can convert classified interventions into appropriate clinical documentation, including relevant observations and measurements, will require not just accurate classification but also context-aware summarization that aligns with clinical documentation standards and Electronic Health Record (EHR) integration capabilities [15]. These directions aim to bridge the gap between technical capability and clinical utility, ultimately working toward systems that can meaningfully reduce the documentation burden. VII Conclusion We have presented the ICVD, a curated collection of 4,144 videos spanning 12 neonatal care intervention classes, and benchmark performance metrics demonstrating the effectiveness of temporal transformer architectures. The substantial performance gap (70.80%) between temporal and framewise approaches provides compelling evidence for the necessity of temporal modeling in healthcare intervention classification. The ICVD addresses a significant data gap in healthcare automation research. With nurses spending 25-50% of their time on documentation tasks and up to 60% of routine care interventions going undocumented, the potential impact of automated intervention detection is substantial. By combining transformer-based video understanding with healthcare domain knowledge, this work establishes a foundation for automated documentation systems that could reduce the administrative burden on NICU staff while improving the completeness and accuracy of patient records. The Datasetâs organization mirrors the widely used Kinetics-400 format [19] and thus facilitates seamless integration with existing deep learning pipelines and supports reproducible research. The ICVD provides a starting point for bridging the gap between advanced computer vision technologies and clinical documentation needs. As healthcare systems worldwide continue to face staffing challenges and increased documentation requirements, such technological interventions may contribute meaningfully to healthcare efficiency and quality of care. Our work demonstrates the feasibility of using privacy-compliant simulated data to develop effective models that could later be adapted to real clinical environments. References [1] B. T. Ulrich, R. Lavandero, K. A. Hart, D. Woods, J. Leggett, and D. Taylor (2006) Critical Care Nursesâ Work Environments: A Baseline Status Report. Critical Care Nurse 26 (5), p. 46â57. External Links: ISSN 0279-5442, 1940-8250, Document Cited by: §I. [2] A. Rose, A. Cooley, T. L. Yap, J. Alderden, V. K. Sabol, J. (. Lin, K. Brooks, and S. M. Kennerly (2022) Increasing Nursing Documentation Efficiency With Wearable Sensors for Pressure Injury Prevention. Critical Care Nurse 42 (2), p. 14â22. External Links: ISSN 0279-5442, 1940-8250, Document Cited by: §I, §I, §I-C. [3] A. Majeedi, R. M. McAdams, R. Kaur, S. Gupta, H. Singh, and Y. Li (2024) Deep learning to quantify care manipulation activities in neonatal intensive care units. npj Digital Medicine 7 (1), p. 172. External Links: ISSN 2398-6352, Document Cited by: §I, §I-A, §I-B, 2nd item, 3rd item, 4th item, 5th item, §V-B2, item 3. [4] B. Huang, W. Chen, C. Lin, C. Juang, Y. Xing, Y. Wang, and J. Wang (2021) A neonatal dataset and benchmark for non-contact neonatal heart rate monitoring based on spatio-temporal neural networks. Engineering Applications of Artificial Intelligence 106, p. 104447. External Links: ISSN 09521976, Document Cited by: §I, §I-A. [5] H. Sharafeddin, L. Charafeddine, J. Khalaf, I. Kanj, and F. Zaraket (2023) Neonatal Video Database and Annotations for Vital Sign Extraction and Monitoring:. In Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods, Lisbon, Portugal, p. 767â774. External Links: Document, ISBN 978-989-758-626-2 Cited by: §I, §I-A. [6] S. Brahnam, L. Nanni, S. McMurtrey, A. Lumini, R. Brattin, M. Slack, and T. Barrier (2020) Neonatal pain detection in videos using the iCOPEvid dataset and an ensemble of descriptors extracted from Gaussian of Local Descriptors. Applied Computing and Informatics. External Links: ISSN 2634-1964, 2210-8327, Document Cited by: §I. [7] G. Bertasius, H. Wang, and L. Torresani (2021) Is Space-Time Attention All You Need for Video Understanding?. arXiv. External Links: Document Cited by: §I, §IV-B, item 2, item 3, §V-A. [8] M. Patrick, D. Campbell, Y. M. Asano, I. Misra, F. Metze, C. Feichtenhofer, A. Vedaldi, and J. F. Henriques (2021) Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers. arXiv. External Links: Document Cited by: §I, item 2, item 3, §V-A. [9] Y. Gao, S. S. Vedula, C. E. Reiley, N. Ahmidi, B. Varadarajan, H. C. Lin, L. Tao, L. Zappella, B. BĂŠjar, D. D. Yuh, et al. (2014) Jhu-isi gesture and skill assessment working set (jigsaws): a surgical activity dataset for human motion modeling. In MICCAI workshop: M2cai, Vol. 3, p. 3. Cited by: §I-A. [10] A. P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. De Mathelin, and N. Padoy (2016) Endonet: a deep architecture for recognition tasks on laparoscopic videos. IEEE transactions on medical imaging 36 (1), p. 86â97. Cited by: §I-A. [11] Y. Liu, M. Boels, L. C. Garcia-Peraza-Herrera, T. Vercauteren, P. Dasgupta, A. Granados, and S. Ourselin (2025) LoViT: Long Video Transformer for surgical phase recognition. Medical Image Analysis 99, p. 103366. External Links: ISSN 13618415, Document Cited by: §I-B, §IV-B, §IV-B, item 2, item 4, §V-A, §V-B2. [12] X. Huang, L. Luan, E. Hatamimajoumerd, M. Wan, P. D. Kakhaki, R. Obeid, and S. Ostadabbas (2023) Posture-based Infant Action Recognition in the Wild with Very Limited Data. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada, p. 4912â4921. External Links: Document, ISBN 9798350302493 Cited by: §I-B, §V-B2. [13] Z. Hajj-Ali, Y. S. Dosso, K. Greenwood, J. Harrold, and J. R. Green (2024) Depth-Based Intervention Detection in the Neonatal Intensive Care Unit Using Vision Transformers. Sensors 24 (23), p. 7753. External Links: ISSN 1424-8220, Document Cited by: §I-B, item 3. [14] D. M. Minteer, P. Simon, D. P. Taylor, W. Jia, Y. Li, M. Sun, and J. P. Rubin (2020) Pressure Ulcer Monitoring PlatformâA Prospective, Human Subject Clinical Study to Validate Patient Repositioning Monitoring Device to Prevent Pressure Ulcers. Advances in Wound Care 9 (1), p. 28â33. External Links: ISSN 2162-1918, 2162-1934, Document Cited by: §I-C. [15] S. Y. Patel, R. S. Rose, and E. C. Webber (2024) Back to Babies: Reducing Documentation Time in the NICU. ACI Open 08 (01), p. e16âe24. External Links: ISSN 2566-9346, Document Cited by: §I-C, item 4. [16] S. Y. Patel, J. P. Palma, J. M. Hoffman, and C. U. Lehmann (2024) Neonatal informatics: past, present and future. Journal of Perinatology 44 (6), p. 773â776. External Links: ISSN 0743-8346, 1476-5543, Document Cited by: §I-C. [17] C. M. Rochefort, B. A. Rathwell, and S. P. Clarke (2016) Rationing of nursing care interventions and its association with nurse-reported outcomes in the neonatal intensive care unit: a cross-sectional survey. BMC nursing 15, p. 1â8. Cited by: 1st item. [18] K. Ăetin and B. Ekici (2023) The Effect of Incubator Cover on Newborn Vital Signs: The Design of Repeated Measurements in Two Separate Groups with No Control Group. Children 10 (7), p. 1224. External Links: ISSN 2227-9067, Document Cited by: 6th item. [19] W. Kay, J. Carreira, K. Simonyan, B. Zhang, C. Hillier, S. Vijayanarasimhan, F. Viola, T. Green, T. Back, P. Natsev, M. Suleyman, and A. Zisserman (2017) The Kinetics Human Action Video Dataset. arXiv. External Links: Document Cited by: §V-A, §VII.