This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Multi-Sensor Data Fusion Techniques for RPAS Detect, Track and Avoid
Technical Paper
2015-01-2475
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Accurate and robust tracking of objects is of growing interest amongst the computer vision scientific community. The ability of a multi-sensor system to detect and track objects, and accurately predict their future trajectory is critical in the context of mission- and safety-critical applications. Remotely Piloted Aircraft System (RPAS) are currently not equipped to routinely access all classes of airspace since certified Detect-and-Avoid (DAA) systems are yet to be developed. Such capabilities can be achieved by incorporating both cooperative and non-cooperative DAA functions, as well as providing enhanced communications, navigation and surveillance (CNS) services. DAA is highly dependent on the performance of CNS systems for Detection, Tacking and avoiding (DTA) tasks and maneuvers. In order to perform an effective detection of objects, a number of high performance, reliable and accurate avionics sensors and systems are adopted including non-cooperative sensors (visual and thermal cameras, Laser radar (LIDAR) and acoustic sensors) and cooperative systems (Automatic Dependent Surveillance-Broadcast (ADS-B) and Traffic Collision Avoidance System (TCAS)). In this paper the sensors and system information candidates are fully exploited in a Multi-Sensor Data Fusion (MSDF) architecture. An Unscented Kalman Filter (UKF) and a more advanced Particle Filter (PF) are adopted to estimate the state vector of the objects based for maneuvering and non-maneuvering DTA tasks. Furthermore, an artificial neural network is conceptualised/adopted to exploit the use of statistical learning methods, which acts to combined information obtained from the UKF and PF. After describing the MSDF architecture, the key mathematical models for data fusion are presented. Conceptual studies are carried out on visual and thermal image fusion architectures.
Recommended Content
Authors
Topic
Citation
Cappello, F., Sabatini, R., and Ramasamy, S., "Multi-Sensor Data Fusion Techniques for RPAS Detect, Track and Avoid," SAE Technical Paper 2015-01-2475, 2015, https://doi.org/10.4271/2015-01-2475.Also In
References
- ICAO. Global Air Navigation Plan for CNS/ATM Systems 1998
- ICAO. Manual of Air Traffic Services Data Link Applications 1999
- ICAO. Manual on Required Communication Performance(RCP) 2006
- EUROCONTROL. European Organisation for the Safety of Air Navigation 2.1 1999
- Ramasamy , S. , and Sabatini , R. Unifying Cooperative and Non-Cooperative UAS Sense-and-Avoid Conference: Second International Workshop on Metrology for Aerospace(MetroAeroSpace 2015) Benevento, Italy 2015
- Laliberte , A.S. , Rango , A. and Herrick , J.E. Unmanned Aerial Vehicles for Rangeland Mapping and Monitoring: A Comparison of Two Systems Proceedings of the ASPRS Annual Conference Tampa, Florida, USA 2007
- Ramasamy , S. , Sabatini R. Gardi A. Towards a Unified Approach to Cooperative and Non-Cooperative RPAS Detect-and-Avoid Fourth Australasian Unmanned Systems Conference, 2014 (ACUS 2014) Melbourne (Australia) December 2014 10.13140/2.1.4841.3764
- ICAO. Unmanned Aircraft Systems (UAS) 2011
- Crespo , D.C. , Mendes de Leon , P. Achieving the Single European Sky: Goals and Challenges 8 Kluwer Law International 2011
- ICAO. Roadmap for the integration of civil Remotely-Piloted Aircraft Systems into the European Aviation System A Strategic R&D Plan for the integration of civil RPAS into the European Aviation System 2013
- Gu , W. , Mittu , R. , Marble , J. , Taylor , G. , Sibley , C. et al. Towards Modeling the Behavior of Autonomous Systems and Humans for Trusted Operations The Intersection of Robust Intelligence and Trust in Autonomous Systems: Papers from the AAAI Spring Symposium 2014
- ICAO. Introduction to the Aviation System Block Upgrade(ASBU) Modules Strategic Planning for ASBU Modules Implementation 2013
- Baud , O. , Gomord , P. , Honoré , N. , Lawrence , P. , Ostorero , L. , Paupiah , S. , and Taupin , O. Air Traffic Control Tracking Systems Performance Impacts with New Surveillance Technology Sensors Aerospace Technologies Advancements 2010 10.5772/7164
- Huihuan , Q. , Xinyu , W. , Yangsheng , X. Intelligent Surveillance Systems 51 Springer Science & Business Media 2011
- Aggarwal , J. K. Multisensor Fusion for Computer Vision 99 Springer Science & Business Media 2013
- Cappello , F , Subramanian , R , and Sabatini , R. Multi-sensor data fusion techniques for RPAS navigation and guidance AIAC 16: Multinatioinal Aerospace Programs-Benefits and Challenges Engineers Australia 2015
- Sabatini , R. , Cappello , F. , Ramasamy , S. , Gardi , A. and Clothier , R. An Innovative Navigation and Guidance System for Small Unmanned Aircraft using Low-Cost Sensors Journal of Aircraft Engineering and Aerospace Technology 2015
- Dailey , D.J. , Harn , P. , and Lin P-J. ITS Data Fusion Final Research Report, Research Project T9903, Task 9, ATIS/ATMS Regional IVHS Demonstration 1996
- Gad , A. , and Farooq , M. Data Fusion Architecture for Maritime Surveillance Proceedings of the Fifth International Conference on Information Fusion 1 IEEE 2002
- Fasano , G. , Accardo , D. , Moccia , A. , Carbone , C. , Ciniglio , U. , Corraro , F. , and Luongo , S. Multi-Sensor Based Fully Autonomous Non-Cooperative Collision Avoidance System for Unmanned Air Vehicles Journal of Aerospace Computing, Information, and Communication 5 10 338 360 2008 10.2514/1.35145
- Rodriguez , L. , Sabatini , R. , Ramasamy , S. , and Gardi , A. A Novel System for Non-Cooperative UAV Sense-And-Avoid European Navigation Conference (ENC 2013) Vienna, Austria 2013
- Spriesterbach , T.P. , Bruns , K.A. , Baron , L.I. , and Sohlke , J.E. Unmanned Aircraft System Airspace Integration in the National Airspace Using a Ground-Based Sense and Avoid System Johns Hopkins APL Technical Digest 32 3 2013
- Toet , A. , and IJspeert , J.K. Perceptual evaluation of different image fusion schemes Displays 24 1 25 37 2003
- Blum , R. S. , and Liu , Z. Multi-Sensor Image Fusion and Its Applications CRC press 2005
- SESAR 2011. Modernising the European Sky Brussels, Belgium SESAR Consortium
- ICAO. Doc 9750 - Global Air Navigation Capacity &Efficiency Plan 2013-2028 4 Montreal, Quebec, Canada International, Civil Aviation Organization (ICAO) 2014a
- SESAR and the Environment Brussels, Belgium European Commission 2014 Clen Sky 2 - Joint Technical Programme Brussels, Belgium European Commission 2010
- Sabatini , R. , Gardi , A. , Ramasamy , S. , Kistan , T. , and Marino , M. Novel ATM and Avionic Systems for Environmentally Sustainable Aviation Conference: Practical Responses to Climate Change (PRCC) 2014 Engineers Australia Convention 2014, At Melbourne, Australia, Volume: Transport (Aviation) NOVEMBER 2014 10.13140/2.1.1938.0808
- Sabatini , R. A Roadmap for Future Aviation Research in Australia: Improving Aviation Safety, Efficiency and Environmental Sustainability Conference: First International Symposium on Sustainable Aviation (ISSA 2015) Istanbul, Turkey 10.13140/RG.2.1.4833.2962
- Ramasamy , S. , Sabatini , R. , and Gardi , A. Novel Flight Management System for Improved Safety and Sustainability in the CNS+A Context, Conference: Integrated Communication Navigation and Surveillance Conference (ICNS 2015) Herndon, VA, USA 10.1109/ICNSURV.2015.7121225
- Tagarev , T. , and Ivanov , P. Computational Intelligence in Multi-Source Data and Information Fusion Information and Security 2 1999
- Hall , D.L. An introduction to multisensor data fusion Proceedings of the IEEE 1 85 1997
- Cappello , F. , Sabatini , R. , Ramasamy , S. , Marino , M. Particle Filter based Multi-sensor Data Fusion Techniques for RPAS Navigation and Guidance Conference: Second International Workshop on Metrology for Aerospace (MetroAeroSpace2015) Benevento, Italy
- Wan , Eric A. , and Van Der Merwe , R. The unscented Kalman filter for nonlinear estimation Adaptive Systems for Signal Processing, Communications, and Control Symposium 2000. AS-SPCC. The IEEE 2000 IEEE 2000
- Van Der Merwe , R. Sigma-point Kalman filters for probabilistic inference in dynamic state-space models Diss. Oregon Health & Science University 2004
- Oh , S-M. Nonlinear estimation for vision-based air-to-air tracking Diss. Georgia Institute of Technology 2007
- Challa , S. Fundamentals of object tracking Cambridge University Press 2011
- Doucet , A. , & Johansen , A. M. 2009 A tutorial on particle filtering and smoothing: Fifteen years later Handbook of Nonlinear Filtering 12 656 704
- Hussain , M.S. Real-Coded Genetic Algorithm Particle Filters for High-Dimensional State Spaces Doctoral dissertation UCL (University College London)) 2014
- Lai , C.K. , Lone , M. , Thomas , P. , Whidborne , J. , Cooke , A. On-Board Trajectory Generation for Collision Avoidance in Unmanned Aerial Vehicles Proceedings of the IEEE Aerospace Conference 1 14 2011 10.1109/AERO.2011.5747526
- Angelov , P. Sense and Avoid in UAS: Research and Applications John Wiley & Sons 2012
- Challa , S. Fundamentals of object tracking” Cambridge University Press 2011
- European Commission Directorate-General for Enterprise and Industry Roadmap for the integration of civil Remotely-Piloted Aircraft Systems into the European Aviation System 2013
- Spriesterbach TP , Bruns KA , Baron LI , Sohlke JE Unmanned Aircraft System Airspace Integration in the National Airspace Using a Ground-Based Sense and Avoid System Johns Hopkins APL Technical Digest 32 3 2013
- Hottman SB , Hansen KR , Berry M Literature Review on Detect, Sense, and Avoid Technology for Unmanned Aircraft Systems Tech. Report DOT/FAA/AR-08/41 US Department of Transport USA 2009
- Huihuan , Qian , Wu Xinyu , and Xu Yangsheng Intelligent surveillance systems 51 Springer Science & Business Media 2011
- Aggarwal J.K. Multi-sensor fusion for computer vision” 99 Springer Science & Business Media 1993
- Baud Olivier , Gomord Pierre , Honoré Nicolas ,
- Ostorero , L. , Taupin , O. , and Tubery , P. Multi sensor data fusion architectures for Air Traffic Control applications In Tech 978-3-902613-52-3 2009
- Gad , A , and Farooq , M. Data fusion architecture for maritime surveillance Information Fusion, 2002. Proceedings of the Fifth International Conference on 1 IEEE 2002
- Sabatini R , Gardi A , Richardson MA LIDAR Obstacle Warning and Avoidance System for Unmanned Aircraft International Journal of Mechanical, Industrial Science and Engineering 8 4 62 73 April 2014
- Ramasamy , S , Sabatini , R , Gardi , A. Avionics Sensor Fusion for Small Size Unmanned Aircraft Sense-and-Avoid IEEE Workshop on Metrology for Aerospace 271 276 Benevento(Italy May 2014 10.1109/MetroAeroSpace.2014.6865933
- Fasano , G , Accardo , D , Moccia , A , Carbone , C , Ciniglio , U , Corraro , F , Luongo , S. Multi-Sensor-Based Fully Autonomous Non-Cooperative Collision Avoidance System for Unmanned Air Vehicles Journal of Aerospace Computing, Information, and Communication 5 10 338 360 2008 10.2514/1.35145
- Rodriguez , L , Sabatini , R , Ramasamy , S , and Gardi , A. A Novel System for Non-Cooperative UAV Sense-And-Avoid European Navigation Conference (ENC 2013) Vienna, Austria 2013
- Kochenderfer , M.J , Espindle , L.P , Griffith , J.D. , Kuchar , J.K Encounter Modeling for Sense and Avoid Development Proceedings of Integrated Communications, Navigation and Surveillance Conference (ICNS) 1 10 2008 10.1109/ICNSURV.2008.4559177
- Spriesterbach , T.P , Bruns , K.A , Baron , L.I , Sohlke , J.E Unmanned Aircraft System Airspace Integration in the National Airspace Using a Ground-Based Sense and Avoid System Johns Hopkins APL Technical Digest 32 3 2013
- Alexander , Toet , and Franken Eric M. Perceptual evaluation of different image fusion schemes Displays 24 1 2003 25 37
- Hall , David L. , and Llinas James An introduction to multi-sensor data fusion Proceedings of the IEEE 85 1 1997 6 23
- Chandrasekhar , C. , Viswanath , A , and NarayanaReddy , S. FPGA Implementation of Image Fusion Technique Using DWT for Micro Air Vehicle Applications IJECT 5 spl-1 Jan March 2014
- Ramasamy , S , Sabatini , R , and Gardi , A. Avionics sensor fusion for small size unmanned aircraft Sense-and-Avoid Metrology for Aerospace (MetroAeroSpace), 2014 IEEE IEEE 2014
- Arulampalam , M. Sanjeev et al. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking Signal Processing, IEEE Transactions on 50 2 2002 174 188
- Challa , S. Fundamentals of object tracking Cambridge University Press 2011
- Cosenzo , K.A. ,. Fatkin , L.T , and Branscome T.A. Cognitive uncertainty and work shifts in a real-world multi-task environment” ARMY RESEARCH LABABERDEEN PROVING GROUND MD HUMAN RESEARCHAND ENGINEERING DIRECTORATE 2005
- Kok , S , and Domingos , P. Learning the structure of Markov logic networks Proceedings of the 22nd international conference on Machine learning ACM 2005
- Krikke , J. Intelligent surveillance empowers security analysts IEEE Intelligent Systems 21 3 2006 102 104
- Russell , S , and Norvig , P. Artificial intelligence: A modern approach Prentice hall pa 2009