Abstract:In order to use augmented reality (AR) technology to realize vision self-examination interactive system, the front-end framework, canvas 2D rendering engine and TensorFlow. JS technology are used, and the system architecture and interactive vision test process are designed. Design and implement the model training page, interactive test UI part and corresponding animation elements. Capturing real-time character actions through a camera to realize simple interaction of the system based on AR, wherein the system can identify which preset combination the expression and gesture combination of the user conforms to, and judge whether the letter direction recognition is correct or not; Through the screen display device in the real vision test scene, the effect of AR interactive vision test is realized, and the system is evaluated to achieve accurate judgment under the condition of good user experience. The results show that through the exploration of AR technology to achieve vision self-examination interactive system, users can check their eyesight at any time and anywhere to care for their eyes and protect their eyesight, and achieve good results.