This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Dynamic Target State Estimation for Autonomous Aerial Vehicles using a Monocular Camera System
ISSN: 0148-7191, e-ISSN: 2688-3627
Published September 17, 2007 by SAE International in United States
Annotation ability available
Operations involving autonomous vehicles require knowledge of the surrounding environment including other moving vehicles. The use of vision has been regarded as an enabling technology that can provide such information. Several important applications that would benefit from this technology is autonomous aerial refueling (AAR) and target tracking. This paper considers a sensor fusion approach using traditional IMU/GPS sensors with vision to facilitate the state estimation problem of moving targets. The proposed method makes use of a moving monocular camera to estimate the relative position and orientation of targets within the image by exploiting a known reference motion. The vision state estimation problem is solved using an homography approach that employs images containing both the reference and target vehicles. A simulation involving an unmanned aerial vehicle (UAV) and two ground vehicles is documented in this paper to demonstrate the algorithm and its accuracy. This algorithm along with a system outline and practical issues for autonomous aerial refueling will be described.
CitationCausey, R., Mehta, S., Lind, R., and Dixon, W., "Dynamic Target State Estimation for Autonomous Aerial Vehicles using a Monocular Camera System," SAE Technical Paper 2007-01-3844, 2007, https://doi.org/10.4271/2007-01-3844.
- Avidan S. Shashua A. “Trajectory Triangulation: 3D Reconstruction of Moving Points from a Monocular Image Sequence,” IEEE Transactions on Pattern Analysis and Machine Intelligence 22 4 2000 348 357
- Dobrokhodov V.N. Kaminer I.I Jones K.D. Ghabcheloo R. “Vision-Based Tracking and Motion Estimation for Moving Targets using Small UAVs,” American Control Coference Minneapolis, MN June 2006
- Faugeras O. Lustman F. “Motion and Structure From Motion in a Piecewise Planar Environment,” International Journal of Pattern Recognition and Artificial Intelligence 2 3 1988 485 508
- Fitzgibbon A.W. Zisserman A. “Multibody Structure and Motion: 3D Reconstruction of Independently Moving Objects,” European Conference on Computer Vision Dublin, Ireland July 2000 1 891 906
- Han M. Kanade T. “Reconstruction of a Scene with Multiple Linearly Moving Objects,” International Journal of Computer Vision 59 3 2004 285 300
- Irani M. Anandan P. “A Unified Approach to Moving Oject Detection in 2D and 3D Scenes,” IEEE Transactions on Pattern Analysis and Machine Intelligence 20 6 June 1998 577 589
- Kaminski J.Y. Teicher M. “A General Framework for Trajectory triangulation,” Journal of Mathematical Imaging and Vision 21 2004 27 41
- Longuet-Higgins H. “A Computer Algorithm for Reconstructing a Scene from Two Projections,” Nature 293 1981 133 135
- Ma Y. Soatto S. Kosecka J. Sastry S.S. “An Invitation to 3-D Vision,” Springer-Verlag Publishing New York, NY 2004
- Mehta S. S. Dixon W. E. MacArthur D. Crane C. D. “Visual Servo Control of an Unmanned Ground Vehicle via a Moving Airborne Monocular Camera,” AIAA Guidance, Navigation, and Control Conference and Exhibit Keystone, CO Aug. 2006
- Ozden K.E. Cornelis K. Van Eycken L. Van Gool L. “Reconstructing 3D Trajectories of Independently Moving Objects using Generic Constraints,” Journal of Computer Vision and Image Understanding 96 3 2004 453 471
- Tandale, M.D. Bowers, R. Valasek, J. “Robust Trajectory Tracking Controller for Vision Based Probe and Drogue Autonomous Aerial Refueling,” AIAA Guidance, Navigation, and Control Conference and Exhibit San Francisco, CA Aug. 2005
- Yuan C. Medioni Gerard “3D Reconstruction of Background and Objects Moving on Ground Plane Viewed from a Moving Camera,” IEEE Conference on Computer Vision and Pattern Recognition New York, NY June 2006
- Zhang Z. Hanson A. R. “Scaled Euclidean 3D Reconstruction Based on Externally Uncalibrated Cameras,” IEEE Symposium on Computer Vision 1995 37 42