TechRxiv

Radar-Based Swimming Activity Recognition with Temporal Dynamic Convolution and Spectral Data Augmentation

Download (3.29 MB)
preprint
posted on 2023-11-28, 17:50 authored by Yi ZhouYi Zhou, Xuliang Yu, Miguel Lopez-Benitez, Limin Yu, Yutao Yue

Radar-based human activity recognition (HAR) is a popular research field. In this paper, we explore methods to improve the generalization of micro-Doppler-based swimming activity recognition. We identify three primary challenges for this task: a small dataset, inaccurate period estimation, and an inefficient network design that does not account for the unique characteristics of spectrograms. To address the limited dataset size, we propose spectral data augmentation tailored for micro-Doppler spectrograms. We also investigate two strategies, namely repeated augmentation and contrastive pretraining, to effectively utilize these augmentations. To tackle inaccurate period estimation, we introduce a segmentation approach based on energy distribution to handle temporal period variation, and we include a temporal modeling module in the network structure. To exploit the spread pattern of limb motion in the Doppler dimension and the continuous properties of torso motion in the temporal dimension,  we design a module that consists of both 2D convolution and 1D temporal dynamic convolution to serve as the feature extractor. Our evaluation on a self-collected swimming activity recognition dataset demonstrates that our model achieves high classification accuracy with significantly reduced computational costs. The augmentation methods, particularly when combined with contrastive pretraining, result in improved performance across accuracy and robustness metrics.

History

Email Address of Submitting Author

zhouyi1023@tju.edu.cn

Submitting Author's Institution

Xi’an Jiaotong-Liverpool University

Submitting Author's Country

  • China

Usage metrics

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC