This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
A Semantic Slam System Based on Visual-Inertial Information and around View Images for Underground Parking Lot
Technical Paper
2021-01-0078
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Event:
SAE WCX Digital Summit
Language:
English
Abstract
As one of the most challenging driving tasks, parking is a common but particularly troublesome problem in large cities. Recently, an excellent solution-automated valet parking (AVP) has become a hot research topic, which allows the driver to leave the vehicle in a drop-off area, while the vehicle driving into the parking slot by itself. For AVP, the precise localization is an indispensable module. However, the global positioning system (GPS) cannot be used in the underground parking lot and the localization method based on lidar is too expensive. In response to solve this problem, we propose a simultaneous localization and mapping system with the semantic information of parking slots (PS-SLAM), which is based on visual-inertial and around view images. First, the calibration of multi-sensors is conducted to obtain their intrinsic and extrinsic parameters. In this way, the around view image and transformation matrices between sensors can be acquired. Then, the ORB-SLAM3 based on visual-inertial information is used to acquire the pose of the vehicle and sparse point cloud map. Next, the parking slot in the around view image is detected by the deep convolutional neural network (DCNN) model called VPS-Net. Finally, a parking-slot association method is devised to associate the detected parking slots with the point cloud map to generate a semantic map. The field experiments are conducted using a wire control chassis with 4 fisheye cameras, an inertial measurement unit (IMU), and a monocular camera. The results show that the proposed visual semantic SLAM system not only can achieve centimeter-level localization in the indoor parking lot but also generate a semantic map with parking slots.
Authors
Topic
Citation
LI, W., Li, C., Xiao, D., Zhou, D. et al., "A Semantic Slam System Based on Visual-Inertial Information and around View Images for Underground Parking Lot," SAE Technical Paper 2021-01-0078, 2021, https://doi.org/10.4271/2021-01-0078.Data Sets - Support Documents
| Title | Description | Download |
|---|---|---|
| Unnamed Dataset 1 | ||
| Unnamed Dataset 2 | ||
| Unnamed Dataset 3 | ||
| Unnamed Dataset 4 | ||
| Unnamed Dataset 5 |
Also In
References
- Wada , M. , Yoon , K.S. , and Hashimoto , H. Development of Advanced Parking Assistance System IEEE Transactions on Industrial Electronics 50 1 4 17 2003
- Huang , C. , Lu , R. , Lin , X. , and Shen , X. Secure Automated Valet Parking: A Privacy-Preserving Reservation Scheme for Autonomous Vehicles IEEE Transactions on Vehicular Technology 67 11 11169 11180 2018
- Schwesinger , U. , Bürki , M. , Timpner , J. , Rottmann , S. , et al. Automated Valet Parking and Charging for e-Mobility 2016 IEEE Intelligent Vehicles Symposium (IV) IEEE 2016 157 164
- Yang , Q. , Chen , H. , Su , J. , and Li , J. Towards High Accuracy Parking Slot Detection for Automated Valet Parking System SAE Technical Paper 2019-01-5061 2019 10.4271/2019-01-5061.
- Banzhaf , H. , Nienhüser , D. , Knoop , S. , and Zöllner , J.M. The Future of Parking: A Survey on Automated Valet Parking with an Outlook on High Density Parking 2017 IEEE Intelligent Vehicles Symposium (IV) IEEE 2017 1827 1834
- Smith , R.C. , and Cheeseman , P. On the Representation and Estimation of Spatial Uncertainty The International Journal of Robotics Research 5 4 56 68 1986
- Fuentes-Pacheco , J. , Ruiz-Ascencio , J. , and Rendón-Mancha , J.M. Visual Simultaneous Localization and Mapping: A Survey Artificial Intelligence Review 43 1 55 81 2015
- Davison , A.J. , Reid , I.D. , Molton , N.D. , and Stasse , O. MonoSLAM: Real-Time Single Camera SLAM IEEE Transactions on Pattern Analysis and Machine Intelligence 29 6 1052 1067 2007
- Klein , G. and Murray , D. Parallel Tracking and Mapping for Small AR Workspaces 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality 2007 225 234
- Mur-Artal , R. , Montiel , J.M.M. , and Tardós , J.D. ORB-SLAM: A Versatile and Accurate Monocular SLAM System IEEE Transactions on Robotics 31 5 1147 1163 2015
- Mur-Artal , R. , and Tardós , J.D. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras IEEE Transactions on Robotics 33 5 1255 1262 2017
- Campos , C. , Elvira , R. , Rodríguez , J.J.G. , Montiel , J.M.M. et al. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM ArXiv 11898 [Cs] 2007 2020
- Engel , J. , Schöps , T. , and Cremers , D. LSD-SLAM: Large-Scale Direct Monocular SLAM 2014 European Conference on Computer Vision (ECCV) Springer International Publishing 2014 834 849
- Forster , C. , Pizzoli , M. , and Scaramuzza , D. SVO: Fast Semi-Direct Monocular Visual Odometry 2014 IEEE International Conference on Robotics and Automation (ICRA) 2014 15 22
- Engel , J. , Koltun , V. , and Cremers , D. Direct Sparse Odometry IEEE Transactions on Pattern Analysis and Machine Intelligence 40 3 611 625 2018
- Weiss , S. and Siegwart , R. Real-Time Metric State Estimation for Modular Vision-Inertial Systems 2011 IEEE International Conference on Robotics and Automation(ICRA) 2011 4531 4537
- Munguía , R. , Nuño , E. , Aldana , C.I. , and Urzua , S. A Visual-Aided Inertial Navigation and Mapping System International Journal of Advanced Robotic Systems 13 3 94 2016
- Mourikis , A.I. and Roumeliotis , S.I. A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation 2007 IEEE International Conference on Robotics and Automation(ICRA) 2007 3565 3572
- Qin , T. , Li , P. , and Shen , S. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator IEEE Transactions on Robotics 34 4 1004 1020 2018
- Mur-Artal , R. , and Tardós , J.D. Visual-Inertial Monocular SLAM With Map Reuse IEEE Robotics and Automation Letters 2 2 796 803 2017
- Ying , X. , Mei , X. , Yang , S. , Wang , G. et al. Radial Distortion Correction from a Single Image of a Planar Calibration Pattern Using Convex Optimization 2014 IEEE International Conference on Image Processing (ICIP) 2014 3440 3443
- Zhang , Z. A Flexible New Technique for Camera Calibration IEEE Transactions on Pattern Analysis and Machine Intelligence 22 11 1330 1334 2000
- Scaramuzza , D. , Martinelli , A. , and Siegwart , R. A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion Fourth IEEE International Conference on Computer Vision Systems (ICVS’06) 2006 45 45
- Shao , X. , Liu , X. , Zhang , L. , Zhao , S. et al. Revisit Surround-view Camera System Calibration 2019 IEEE International Conference on Multimedia and Expo (ICME) 2019 1486 1491
- Rufli , M. , Scaramuzza , D. , and Siegwart , R. Automatic Detection of Checkerboards on Blurred and Distorted Images 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2008 3121 3126
- Woodman , O.J. An Introduction to Inertial Navigation https://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-696.pdf 2017 1222 1229
- Furgale , P. , Rehder , J. , and Siegwart , R. Unified Temporal and Spatial Calibration for Multi-Sensor Systems 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2013 1280 1286
- Li , W. , Cao , L. , Yan , L. , Li , C. et al. Vacant Parking Slot Detection in the Around View Image Based on Deep Learning Sensors 20 7 2138 2020
- Redmon , J. , and Farhadi , A. YOLOv3: An Incremental Improvement ArXiv 02767 [Cs] 1804 2018
- Zhang , L. , Shen , Y. , Zhang , H. , Zhao , S. , and Yang , Y. DMPR-PS: A Novel Approach for Parking-Slot Detection Using Directional Marking-Point Regression 2019 IEEE International Conference on Multimedia and Expo (ICME) 2019 212 217
- Li , W. , Cao , H. , Liao , J. , Xia , J. et al. Vacant Parking Slot Detection in the Around View Image Based on Deep Learning Frontiers in Neurorobotics 20 14 46 2020