This paper develops a kind of robot which can play table tennis with people in order to solve the problem of accumulating errors of the implementing agencies corresponding to the degree of freedom of existing table tennis robots. The robot mainly comprises a moving mechanism and a hitting mechanism. Use the design of clamp clamped with G clamp, synchronous dual guide vertical to ball net, single guide parallel to ball net, steering gear control platform and angle of the racket, cylinder push shot. The visual system adopts Kinect-based table tennis recognition algorithm, the information in the image is extracted by image processing methods such as threshold segmentation algorithm and contour extraction algorithm. Realize the robot playing table tennis with people. The results show that the design is feasible and successful, and it has some reference value for peers.