This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
A Multimodal States Based Vehicle Descriptor and Dilated Convolutional Social Pooling for Vehicle Trajectory Prediction
Technical Paper
2020-01-5113
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Event:
Automotive Technical Papers
Language:
English
Abstract
Precise trajectory prediction of surrounding vehicles is critical for decision-making of autonomous vehicles, and learning-based approaches are well recognized for the robustness. However, state-of-the-art learning-based methods ignore (1) the feasibility of the vehicle’s multimodal state information for prediction and (2) the mutually exclusive relationship between the global traffic scene receptive fields and the local position resolution when modeling vehicles’ interactions, which may influence prediction accuracy. Therefore, we propose a “vehicle descriptor”-based long short-term memory (LSTM) model with the dilated convolutional social pooling (VD+DCS-LSTM) to cope with the above issues. Firstly, each vehicle’s multimodal state information is employed as our model’s input, and a new vehicle descriptor (VD) encoded by stacked sparse autoencoders is proposed to reflect the deep interactive relationships between various states, achieving the optimal feature extraction and effective use of multimodal inputs. Secondly, the LSTM encoder is used to encode each vehicle’s historical sequences composed of VDs, and a novel dilated convolutional social pooling (DCS) is proposed to improve modeling vehicles’ spatial interactions. Thirdly, the LSTM decoder is used to predict the probability distribution of future trajectories based on maneuvers. The validity of the overall model was verified over the NGSIM US-101 and I-80 datasets, and our method outperforms the latest benchmark.
Authors
Citation
Zhang, H., Wang, Y., Liu, J., Li, C. et al., "A Multimodal States Based Vehicle Descriptor and Dilated Convolutional Social Pooling for Vehicle Trajectory Prediction," SAE Technical Paper 2020-01-5113, 2021, https://doi.org/10.4271/2020-01-5113.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 | ||
Unnamed Dataset 4 | ||
Unnamed Dataset 5 |
Also In
References
- Lefèvre , S. , Laugier , C. , and Ibañez-Guzmán , J. Exploiting Map Information for Driver Intention Estimation at Road Intersections 2011 IEEE Intelligent Vehicles Symposium (IV) Baden-Baden 2011 583 588
- Danielsson , S. , Petersson , L. , and Eidehall , A. Monte Carlo Based Threat Assessment: Analysis and Improvements 2007 IEEE Intelligent Vehicles Symposium Istanbul 2007
- Firl , J. et al. Predictive Maneuver Evaluation for Enhancement of Car-to-X Mobility Data 2012 IEEE Intelligent Vehicles Symposium Alcala de Henares 2012
- Alahi , A. et al. Social LSTM: Human Trajectory Prediction in Crowded Spaces Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Las Vegas, NV 2016
- Bansal , M. , Krizhevsky , A. , and Ogale , A. Chauffeurnet: Learning to Drive by Imitating the Best and Synthesizing the Worst 2018
- Deo , N. and Trivedi , M.M. Convolutional Social Pooling for Vehicle Trajectory Prediction Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops Salt Lake City, UT 2018
- Deo , N. and Trivedi , M.M. Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver Based LSTMs 2018 IEEE Intelligent Vehicles Symposium (IV) Changshu 2018
- Gupta , A. , Johnson , J. , Fei-Fei , L. et al. Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Salt Lake City, UT 2018 2255 2264
- Kuefler , A. , Morton , J. , Wheeler , T. et al. Imitating Driver Behavior with Generative Adversarial Networks 2017 IEEE Intelligent Vehicles Symposium (IV) Los Angeles, CA 2017 204 211
- Sarkar , A. and Czarnecki , K. 2019
- Jamson , A.H. , Merat , N. , Carsten , O.M.J. et al. Behavioural Changes in Drivers Experiencing Highly-Automated Vehicle Control in Varying Traffic Conditions Transportation Research Part C: Emerging Technologies 30 116 125 2013
- Hu , Y. , Zhan , W. , and Tomizuka , M. Probabilistic Prediction of Vehicle Semantic Intention and Motion 2018 IEEE Intelligent Vehicles Symposium (IV) Changshu 2018 307 313
- Zeiler , M.D. and Fergus , R. Visualizing and Understanding Convolutional Networks European Conference on Computer Vision Cham Springer 2014 818 833
- Zhou , H. , Huang , G.B. , Lin , Z. et al. Stacked Extreme Learning Machines IEEE Transactions on Cybernetics 45 9 2013 2025 2014
- Du , B. , Xiong , W. , Wu , J. et al. Stacked Convolutional Denoising Auto-Encoders for Feature Representation IEEE Transactions on Cybernetics 47 4 1017 1027 2016
- Lei , Y. , Jia , F. , Lin , J. et al. An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning towards Mechanical Big Data IEEE Transactions on Industrial Electronics 63 5 3137 3147 2016
- Ronneberger , O. , Fischer , P. , and Brox , T. U-Net: Convolutional Networks for Biomedical Image Segmentation International Conference on Medical Image Computing and Computer-Assisted Intervention Cham Springer 2015 234 241
- Noh , H. , Hong , S. , and Han , B. Learning Deconvolution Network for Semantic Segmentation Proceedings of the IEEE International Conference on Computer Vision Santiago, Chile 2015 1520 1528
- Yu , F. and Koltun , V. 2015
- Zhen , X. , Chakraborty , R. , Vogt , N. et al. Dilated Convolutional Neural Networks for Sequential Manifold-Valued Data Proceedings of the IEEE International Conference on Computer Vision Seoul, Korea 2019 10621 10631
- Colyar , J. and Halkias , J. 2007
- Colyar , J. and Halkias , J. 2006
- Han , J. , Pei , J. , and Kamber , M. Data Mining: Concepts and Techniques Amsterdam Elsevier 2011
- Kingma , D.P. and Ba , J. Adam: A Method for Stochastic Optimization 2014
- Paszke , A. , Gross , S. , Chintala , S. , et al. Automatic Differentiation in Pytorch 2017
- Chandra , R. , Bhattacharya , U. , Roncal , C. et al. Robusttp: End-to-End Trajectory Prediction for Heterogeneous Road-Agents in Dense Traffic with Noisy Sensor Inputs ACM Computer Science in Cars Symposium Kaiserslautern, Germany 2019 1 9
- Deo , N. , Rangesh , A. , and Trivedi , M.M. How Would Surround Vehicles Move? A Unified Framework for Maneuver Classification and Motion Prediction IEEE Transactions on Intelligent Vehicles 3 2 129 140 2018