This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Weak Supervised Hierarchical Place Recognition with VLAD-Based Descriptor
Technical Paper
2022-01-7099
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Visual Place Recognition (VPR) excels at providing a good location prior for autonomous vehicles to initialize the map-based visual SLAM system, especially when the environment changes after a long term. Condition change and viewpoint change, which influences features extracted from images, are two of the major challenges in recognizing a visited place. Existing VPR methods focus on developing the robustness of global feature to address them but ignore the benefits that local feature can auxiliarily offer. Therefore, we introduce a novel hierarchical place recognition method with both global and local features deriving from homologous VLAD to improve the VPR performance. Our model is weak supervised by GPS label and we design a fine-tuning strategy with a coupled triplet loss to make the model more suitable for extracting local features. In our proposed hierarchical architecture, we firstly rank the database to get top candidates via global features and then we propose a modified DTW algorithm to re-rank the top candidates via local features. Moreover, greater weights are given to the features in regions of interest and the results show that it makes those special local features more important in re-ranking. Further, experiments on Pittsburgh30k and Tokyo247 benchmarks show that our approach outperforms several existing Vlad-based VPR methods.
Authors
Topic
Citation
Fang, K., Li, Z., and Wang, Y., "Weak Supervised Hierarchical Place Recognition with VLAD-Based Descriptor," SAE Technical Paper 2022-01-7099, 2022, https://doi.org/10.4271/2022-01-7099.Also In
References
- Lowry , S. , Sünderhauf , N. , Newman , P. , Leonard , J.J. et al. Visual Place Recognition: A Survey IEEE Transactions on Robotics 32 1 2015 1 19
- Sünderhauf , N. , Shirazi , S. , Jacobson , A. , Dayoub , F. et al. Place Recognition with Convnet Landmarks: Viewpoint-Robust, Condition-Robust, Training-Free Robotics: Science and Systems XI 2015 1 10
- Noh , H. , Araujo , A. , Sim , J. , Weyand , T. et al. Large-Scale Image Retrieval with Attentive Deep Local Features Proceedings of the IEEE International Conference on Computer Vision 3456 3465 2017
- Angeli , A. , Filliat , D. , Doncieux , S. , and Meyer , J.-A. Fast and Incremental Method for Loop-Closure Detection Using Bags of Visual Words IEEE Transactions on Robotics 24 5 2008 1027 1037
- Arandjelovic , R. , Gronat , P. , Torii , A. , Pajdla , T. et al. Netvlad: Cnn Architecture for Weakly Supervised Place Recognition Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 5297 5307 2016
- Chen , Z. , Maffra , F. , Sa , I. , and Chli , M. Only Look Once, Mining Distinctive Landmarks from Convnet for Visual Place Recognition 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 9 16 2017
- Lu , F. , Chen , B. , Zhou , X.-D. , and Song , D. Sta-vpr: Spatio-Temporal Alignment for Visual Place Recognition IEEE Robotics and Automation Letters 6 3 2021 4297 4304
- Cao , B. , Araujo , A. , and Sim , J. Unifying Deep Local and Global Features for Image Search European Conference on Computer Vision 726 743 2020
- Hausler , S. , Garg , S. , Xu , M. , Milford , M. et al. Patch-Netvlad: Multi-scale Fusion of Locally-Global Descriptors for Place Recognition Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 14141 14152 2021
- Sarlin , P.-E. , Cadena , C. , Siegwart , R. , and Dymczyk , M. From Coarse to Fine: Robust Hierarchical Localization at Large Scale Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 12716 12725 2019
- Jégou , H. , Douze , M. , Schmid , C. , and Pérez , P. Aggregating Local Descriptors Into a Compact Image Representation 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition 3304 3311 2010
- Jin Kim , H. , Dunn , E. , and Frahm , J.-M. Learned Contextual Feature Reweighting for Image Geo-Localization Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2136 2145 2017
- Lowe , D.G. Object Recognition from Local Scale-Invariant Features Proceedings of the Seventh IEEE International Conference on Computer Vision 2 1150 1157 1999
- Bay , H. , Tuytelaars , T. , and Gool , L.V. Surf: Speeded Up Robust Features European Conference on Computer Vision 404 417 2006
- DeTone , D. , Malisiewicz , T. , and Rabinovich , A. Superpoint: Self-Supervised Interest Point Detection and Description Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops 224 236 2018
- Dusmanu , M. , Rocco , I. , Pajdla , T. , Pollefeys , M. et al. D2-Net: A Trainable CNN for Joint Description and Detection of Local Features Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 8092 8101 2019
- Yang , B. , Xu , X. , Li , J. , and Zhang , H. Landmark Generation in Visual Place Recognition Using Multi-Scale Sliding Window for Robotics Applied Sciences 9 15 2019 3146
- Simonyan , K. and Zisserman , A. 2014
- Barath , D. and Matas , J. Graph-Cut Ransac Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 6733 6741 2018
- Zhao , J. and Itti , L. Shapedtw: Shape Dynamic Time Warping Pattern Recognition 74 2018 171 184
- Torii , A. , Sivic , J. , Pajdla , T. , and Okutomi , M. Visual Place Recognition with Repetitive Structures Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 883 890 2013
- Torii , A. , Arandjelovic , R. , Sivic , J. , Okutomi , M. et al. 24/7 Place Recognition by View Synthesis Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 1808 1817 2015
- Warburg , F. , Hauberg , S. , Lopez-Antequera , M. , Gargallo , P. al. Mapillary Street-Level Sequences: A Dataset for Lifelong Place Recognition Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2626 2635 2020
- Sünderhauf , N. , Neubert , P. , and Protzel , P. Are We There Yet? Challenging Seqslam on a 3000 km Journey Across All Four Seasons Proceeding of Workshop on Long-Term Autonomy, IEEE International Conference on Robotics and Automation (ICRA) 2013