Improvement of shift quality evaluation has become more prevalent over the past few years in the development of automatic transmission electronic control system. For the problems of the subjective shift quality evaluation that subjectivity is too strong, the standard cannot be unified and the definition of the objective evaluation index is not clear at present, this paper studies on the methods of objective evaluation of shift quality based on the multi-hierarchical grey relational analysis. Firstly, objective evaluation index system is constructed based on physical quantities, such as the engine speed, the longitudinal acceleration of the vehicle and so on, which broadens the scope of the traditional objective evaluation index further. From the vehicle performance, the mapping relation among the objective evaluation indices of shift quality and durability, fuel efficiency, dynamic performance and comfort is established by the multi-hierarchical grey relational analysis, and finally the mapping relation between the objective evaluation indices and shift quality is obtained, which provides a theoretical basis for the establishment of the evaluation system. An objective evaluation system of shift quality is created by MATLAB-CANoe, including four modules of data input and signal processing, working mode identification, evaluation index extraction and objective evaluation. At last, the consistency test of subjective and objective evaluation of shift quality is performed. The result shows that the correctness of the control quality evaluation system and the feasibility of the method of the online evaluation are verified. Therefore, this paper provides a new idea and method for the scientific evaluation of shift quality.