This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Micro Gesture Recognition of the Millimeter-Wave Radar Based on Multi-branch Residual Neural Network
Technical Paper
2022-01-7074
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
A formal gesture recognition based on optics has limitations, but millimeter-wave (MMW) radar has shown significant advantages in gesture recognition. Therefore, the MMW radar has become the most promising human-computer interaction equipment, which can be used for human-computer interaction of vehicle personnel. This paper proposes a multi-branch network based on a residual neural network (ResNet) to solve the problems of insufficient feature extraction and fusion of the MMW radar and immense algorithm complexity. By constructing the gesture sample library of six gestures, the MMW radar signal is processed and coupled to establish the relationship between the motion parameters of the distance, speed, and angle of the gesture information and time, and the depth features are extracted. Then the three depth features are fused. Finally, the classification and recognition of MMW radar gesture signals are realized through the full connection layer. Through experiments, the accuracy of fusion gesture classification based on the multi-branch ResNet reached 97.2%. The results show that the proposed multi-branch ResNet has the advantages of the conventional ResNet, can accept multiple inputs, and has the benefits of high recognition accuracy.
Authors
- Panpan Tong - Tongji University
- Caien Weng - Tongji University
- Xin Bi - Tongji University
- Dehai Li - Shenzhen Future Intelligent Connected Transportation System
- Xiongji Yang - Shenzhen Future Intelligent Connected Transportation System
- Guiquan Zhao - Shenzhen Future Intelligent Connected Transportation System
Topic
Citation
Tong, P., Weng, C., Bi, X., Li, D. et al., "Micro Gesture Recognition of the Millimeter-Wave Radar Based on Multi-branch Residual Neural Network," SAE Technical Paper 2022-01-7074, 2022, https://doi.org/10.4271/2022-01-7074.Also In
References
- Ahmed , S. and Cho , S.H. Hand Gesture Recognition Using an IRUWB Radar with an Inception Module-Based Classifier Sensors 20 2 2020 564 10.3390/s20020564
- Dzikri , A. and Kurniawan , D.E. Hand Gesture Recognition for Game 3D Object Using The Leap Motion Controller with Backpropagation Method 2018 International Conference on Applied Engineering (ICAE) Batam, Indonesia 1 5 2018 10.1109/INCAE.2018.8579400
- Zhang , Y. , Dong , S. , Zhu , C. , Zhu , A. et al. Hand Gesture Recognition Based on SIMO Doppler Radar Sensors Short-Range Micro-Motion Sensing with Radar Technology 89 116 2019 10.1049/PBCE125E_ch4
- Li , G. , Zhang , S. , Fioranelli , F. , and Griffiths , H. Effect of Sparsity-Aware Time-Frequency Analysis on Dynamic Hand Gesture Classification with Radar Micro-Doppler Signatures IET Radar, Sonar and Navigation 12 8 2018 815 820 10.1049/ietrsn.2017.0570
- Khan , F. , Leem , S. , and Cho , S.H. Hand-Based Gesture Recognition for Vehicular Applications Using IR-UWB Radar Sensors 17 4 2017 833 10.3390/s17040833
- Zhang , Z. , Tian , Z. , and Zhou , M. SmartFinger: A Finger-Sensing System for Mobile Interaction via MIMO FMCW Radar 2019 IEEE Globecom Workshops (GC Wkshps) Waikoloa, HI, USA 1 5 2019 10.1109/GCWkshps45667.2019.9024578
- Nguyen , M.Q. , Flores-Nigaglioni , A. , and Li , C. Range-Gating Technology for Millimeter-Wave Radar Remote Gesture Control in IoT Applications 2018 IEEE MTT-S International Wireless Symposium (IWS) Chengdu, China 2018 1 4 10.1109/IEEEIWS.2018.8400811
- Zheng , L. , Bai , J. , Zhu , X. , Huang , L. et al. Dynamic Hand Gesture Recognition in In-Vehicle Environment Based on FMCW Radar and Transformer Sensors 21 19 2021 6368 10.3390/s21196368
- Wang , Y. , Wu , J. , Tian , Z. , Zhou , M. et al. Multi-Dimensional Parameter Gesture Recognition Algorithm Based on FMCW Radar Journal of Electronics and Informatics 41 04 2019 822 829
- Wang , Y. , Jia , X. , Zhou , M. , Yang , X. et al Rammar: RAM Assisted Mask R-CNN for FMCW Sensor Based HGD System 2019 IEEE International Conference on Communications (ICC) Shanghai, China 1 6 2019 10.1109/ICC.2019.8761283
- Liu , D. 2019
- Sun , Y. , Fei , T. , Li , X. , Warnecke , A. et al. Real-Time Radar- Based Gesture Detection and Recognition Built in an Edge- Computing Platform IEEE Sensors Journal 20 18 2020 10706 10716 10.1109/JSEN.2020.2994292
- Zhang , X. , Wu , Q. , and Zhao , D. Dynamic Hand Gesture Recognition Using FMCW Radar Sensor for Driving Assistance 2018 10th International Conference on Wireless Communications and Signal Processing (WCSP) Hangzhou, China 1 6 2018 10.1109/WCSP.2018.8555642
- Zhang , W. and Wang , J. Dynamic Hand Gesture Recognition Based on 3D Convolutional Neural Network Models 2019 IEEE 16th International Conference on Networking, Sensing and Control (ICNSC) 224 229 2019 10.1109/ICNSC. 2019.8743159
- Lei , W. , Jiang , X. , Xu , L. , Luo , J. et al. Continuous Gesture Recognition Based on Time Sequence Fusion Using MIMO Radar Sensor and Deep Learning Electronics 9 5 2020 869 10.3390/electronics9050869