Abstract: A virtual environment modeling system for teleoperate mobile robot has been developed in this paper.In order to overcome the complicated calculation and low robustness of the automatic visual modeling algorithm,a man machine interaction based stereo vision modeling has been developed for the unknown environment.The system implementation and the experimental results on the real scene are enclosed.