Abstract: From the characteristics of vision tracking system, we studied different kinds of algorithms and produced a tangential tracking,normal approaching algorithm. Through the effectively control of normal velocity, it improved the system's tracking precision and tracking speed. Experiments have demonstrated satisfactory tracking performances.