In order to stabilize the video obtained from cameras on kinds of carriers, this paper introduces the scale invariant feature transform (SIFT) algorithm and video stabilization algorithm based on SIFT features. The motions between images are represented with the model of affine model with six parameters, which is estimated by using the SIFT features of images. Then the images are compensated so that the motions would be counteracted and the goal of stabilizing the video would be achieved. At last, peak signal to noise ratio (PSNR) is imported to evaluate the effect of the algorithm. As the experiments show, algorithm proposed in this paper can counteract the motions among images very well and can improve the values of PSNR effectively. Video stabilization of video sequence is also completed with the algorithm.