Aiming at the limitation of the traditional manual video surveillance system, discuss the applying of intelligent video analysis technology in sentry safety threat intelligent recognition. Introduces the intelligent video analysis technology and developing trend, and analyzes the effect of applying it to sentry safety threat alarm. According to the incongruity between sentry faced with safety position and usable safety defend methods, presents a solution for typical scene of sentry, describe its system framework, key device and key technology. The study may offer reference to sentry safety defend.