Machine vision-based virtual human-machine operation interface system and construction method thereof

Abstract

The invention discloses a machine vision-based virtual human-machine operation interface system and a construction method of the system. The construction method comprises the following steps: arranging a camera just in front of a human machine interface (HMI) displayer, and enabling a camera shooting area to cover the whole HMI displayer; acquiring initial images of all sub-pictures displayed by the HMI displayer; processing the initial images of all the sub-pictures acquired in the step 2 and transmitting the picture information to a virtual HMI client side; acquiring images displayed by the HMI displayer in real time, and extracting and identifying the data by utilizing image processing and a pattern recognition algorithm; using the virtual HMI client side for combining the initial sub-picture information obtained in the step 3 and the data information obtained in the step 4 so as to carry out HMI reconstruction on the virtual HMI client side. According to the construction method, the HMI displayer is used for acquiring data, and the HMI picture reconstruction is carried out on single network, so that the bandwidth of the network where a programmable logic controller (PLC) is located is not occupied, a production side can control the monitoring time and the monitoring content of a monitoring side, and divulging of the important data can be avoided.

Description

technical field [0001] The invention belongs to the technical field of industrial automation, and relates to a machine vision-based virtual man-machine operation interface system and a construction method. Background technique [0002] In the industrial automation production process, the human-machine interface (HMI) is a very important computer program, which can display the production status in the production process. At the same time, production operators can use it to set production parameters and change production status; engineering technicians and craftsmen can diagnose simple faults on the production operation status from the man-machine operation interface. [0003] For multi-party HMI monitoring, it is generally necessary to install HMI programs on multiple machines. Due to the data exchange between the HMI and the PLC, a certain amount of computing load is occupied by the programmable logic controller (PLC), and a certain amount of network bandwidth is also occup...

AI Technical Summary

Problems solved by technology

Therefore, from the perspective of network and PLC load, there will be a certain limit on the number of installed HMI clients; on the other hand, due to the consideration of computer security and production data confidentiality factors, the factory does not want external computers to connect to the network where the HMI is located for monitoring , so there are certain problems in HMI monitoring from off-site

Images