Abstract: Before the power information system being online and operating, information security testing is required to reduce the security risks caused by vulnerabilities. The security level of power information system suppliers is uneven. Evaluate the security level of suppliers and conduct targeted training and guidance objectively and effectively, which is one of the effective ways to improve the security level of power information system. When evaluating the security level of a power information system supplier, if only based on objective indicators such as the number of high, medium and low-risk vulnerabilities, it would be highly evaluated because a certain supplier has only launched a few simple information systems. Based on the network access detection data of the existing power information system suppliers, this paper proposed a quantitative evaluation algorithm based on objective data on the basis of the transformation of the analytic hierarchy algorithm. The judgment matrix that originally required the subjective experience of experts is improved to be composed of evaluation data. When the algorithm evaluates power information system suppliers, the evaluation can be completed without subjective evaluation and the evaluation effect meets the actual needs of production.