Abstract: To meet the higher requirements of the robot control system for real-time visual feedback,a real-time object tracking method based on prediction with least square is presented.By using least squares prediction on the position of moving object,the search region is limited,so that the tracking speed is improved.Experimental results show that the proposed method can meet the requirements for real time response of fast visual servo.