This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Study on a Fuzzy Q-Learning Approach Using the Driver Priori Knowledge for Intelligent Vehicles’ Autonomous Navigation and Control
Technical Paper
2018-01-1084
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Language:
English
Abstract
The functional elements of decision making system are fuzzy, adaptive and self-learning for intelligent ground vehicles. As is well-known, operating environment of unmanned ground vehicles (UGVs) is complex, unknown and time-changing. And on the other hand, exact dynamic model of the vehicle is relatively difficult to gain. However, the changing of special dynamic parameters and the man-made driving laws of velocities and running direction are easily available. Therefore, this paper attempts to provide an approach based on fuzzy Q-learning algorithm for studying autonomous navigation and control system’s design, which aims to make unmanned vehicles adaptive and robust under complex and time-changing environment. The presented approach utilizes the drivers’ empirical knowledge for. Fuzzy inference system introduces the human beings’ successful experiences into the system, and Q-learning mainly pays more attention to the interaction between the robot and the environment and thus keeps on learning until achieving the goal. Through this method, autonomous navigation and control system can be designed accordingly. This paper used a type of the nonholonomic robotic system for the computational experiments so as to verify the algorithm, which only considers necessary candidate conclusions. The final simulation results show the validity of the designed algorithm. The presented algorithm is not dependent on the dynamic model, and is designed in terms of the special model parameters. Therefore, the mentioned approach has strong versatility and transplantable, which can be easily used for penetration maneuver strategies and autonomous maneuver of other type of intelligent vehicles such as unmanned aerial vehicles (UAVs) or autonomous underwater vehicles (AUVs).
Authors
Topic
Citation
Chang, L., Bai, J., and Huang, L., "Study on a Fuzzy Q-Learning Approach Using the Driver Priori Knowledge for Intelligent Vehicles’ Autonomous Navigation and Control," SAE Technical Paper 2018-01-1084, 2018, https://doi.org/10.4271/2018-01-1084.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 |
Also In
References
- Velagic , J. , Lacevic , B. , and Perunicic , B. A 3-Level Autonomous Mobile Robot Navigation System Designed by Using Reasoning/Search Approaches Robotics and Autonomous Systems 54 989 1004 2006
- Green , P. Parking Crashes and Parking Assistance System Design: Evidence from Crash Databases, the Literature, and Insurance Agent Interviews SAE Technical Paper 2006-01-1685 2006 10.4271/2006-01-1685
- Dadras , S. Path Tracking Using Fractional Order Extremum Seeking Controller for Autonomous Ground Vehicle SAE Technical Paper 2017-01-0094 2017 10.4271/2017-01-0094
- Demirli , K. and Khoshnejad , M. Autonomous Parallel Parking of a Car-like Mobile Robot by a neuro-fuzzy Sensor-Based Controller Fuzzy Sets and Systems 160 2876 2891 2009
- Zhao , Y. and Jr , E.G.C. Robust Automatic Parallel Parking in Tight Spaces Via Fuzzy Logic Robotics and Autonomous Systems. 51 111 127 2005
- Sutton , R. and Barto , A. Reinforcement Learning, an Introduction Cambridge MIT Press 1998
- Er , M.J. , and Deng , C. Online Tuning of Fuzzy Inference Systems Using Dynamic Fuzzy Q-Learning IEEE Trans. On Syst. Man, and Cyber.-Part B: Cybernetics.
- Jouffe , L Fuzzy Inference System Learning by Reinforcement Methods IEEE Trans. on Systems, Man, and Cybernetics-Part C: a Applications and Reviews.
- Yen , G.G. and Hickey , T.W. Reinforcement Learning Algorithms for Robotic Navigation in Dynamic Environments ISA Transaction. 43 217 230 2004
- Calvo , R , Figueiredo , M and Francelin Romero , R. A. Autonmous cognition and reinforcement learning for mobile robots 2010
- Millan , J.d.R. Reinforcement Learning of Goal-Directed Obstacle-Avoiding Reaction Strategies in an Autonomous Mobile Robot Robotics and Autonomous Systems 15 275 299 1995
- Mendez , M.A.O. , Madrigal , J.A.F. Fuzzy logic user adaptive navigation control system for mobile robots in unknown environments 2007
- Zhao , Y. and Jr , E.G.C. Robust Automatic Parallel Parking in Tight Spaces Via Fuzzy Logic Robotics and Autonomous Systems 51 111 127 2005
- Bo , X. , Shiru , Q. Intelligent vehicle’s Path Tracking Based on Fuzzy Control Journal of Transportation Systems Engineering and Information Technology.
- Watkins , C.J.C.H. and Dayan , P. Q-learning. Mach. Learn 8 3 279 192 1992
- Guanlao , R , Musilek , P , Ahmed , F and Kaboli , A Fuzzy Situation based Navigation of Autonmous Mobile Robot using Reinforcement Learning 2004 820 825
- Anam , K , Prihastono , Wicaksono , H Hybridization of Fuzzy Q-Learning and Behavior-Based Control for Autonomous Mobile Robot Navigation in Cluttered Environment ICROS-SICE International Joint Conference 2009 Japan 18-21 2009 1023 1028
- Quintia , P. , Iglesias , R. , Rodriguez , M.A. , and Regueiro , C.V. Simultaneous Learning of Perception and Action in Mobile Robots Robotics and Autonomous Systems. 58 1306 1315 2010
- Onieva , E. , Godoy , J. , and Villagra , J. On-line Learning of a Fuzzy Controller for a Precise Vehicle Cruise Control System Expert Systems with Applications 40 1046 1053 2013
- Gadepally , V , Krishnamurthy , A and Ozguner , U A Framework for Estimating Driver Decisions near Intersections IEEE Transactions on Intelligent Transportation Systems.