This research is dedicated to develop a safety measurement for human-machine cooperative system, in which the machine region and the human region cannot be separated due to the overlap and the movement both from human and from machines. Our proposal here is to automatically monitor the moving objects by image sensing/recognition method, such that the machine system can get enough information about the environment situation and about the production progress at any time, and therefore the machines can accordingly take some corresponding actions automatically to avoid hazard. For this purpose, two types of monitor systems are proposed. The first type is based on the omni directional vision sensor, and the second is based on the stereo vision sensor. Each type may be used alone or together with another type, depending on the safety system’s requirements and the specific situation of the manufacture field to be monitored. In this paper, the description about these two types are given, and as for the special application of these image sensors into safety control, the construction of a hierarchy safety system is proposed. This research is dedicated to develop a safety measurement for human-machine cooperative system, where the machine region and the human region can not be separated due to the overlap and the movement both from human and from machines. Our proposal here is to automatically monitor the moving objects by image sensing / recognition method, such that the machine system can get enough information about the environment situation and about the production progress at any time, and therefore the machines progress at any time, and therefore the machines can not take some actions automatically to avoid hazard. Two types of monitor systems are proposed. The first type is based on the omni directional vision sensor, and the second is based on the stereo vision sensor. Each type may be used alone or together with another type, depending on the safety system’s requirements and the specific situation of the manufacture field to be monitored. In this paper, the description about these two types are given, and a s for the special application of these image sensors into safety control, the construction of a hierarchy safety system is proposed.