Research on Urban Bus Timetable Optimization Based on Deep Reinforcement Learning

Public transportation serves as a crucial component of urban mobility, contributing to the alleviation of urban congestion, reduction of travel expenses, and mitigation of air pollution. Nonetheless, the dynamic passenger demand and the complex traffic conditions render traditional bus timetables inadequate, leading to ineffective allocation of public transportation resources. Consequently, it is essential to create bus timetables that are responsive to actual traffic scenarios and fluctuating passenger demand. This study regards the bus timetable planning problem as a Markov decision-making process within a discrete time framework, proposing a deep reinforcement learning-based optimization model for bus timetables. In particular, the model is designed to account for both bus companies and passengers, incorporating a state space and reward calculation method that emphasizes passenger comfort. Then Deep Q-Network (DQN) methodology is employed to issue instructions on whether a bus departure at each time, and bus timetable is generated gradually over time. Experimental results indicate that the proposed approach significantly reduces bus travel costs and enhances the overall travel experience for passengers in comparison to traditional methods.