Abstract: In order to evaluate the comprehensive performance of new energy AGC units, this paper presents a comprehensive performance evaluation method based on Rank boost algorithm. First of all, from the four angles of putting into operation of new energy AGC units, target tracking, regulating speed and frequency regulation participation, the performance index system of new energy AGC is constructed, and an unsupervised machine learning method Rank boost is used for comprehensive performance evaluation. Finally, the effectiveness of the method is analyzed based on the historical statistical data of AGC units in a certain region.