A real-time controlled visual twin factory system
By realizing the interactive depth of field device display between two-dimensional modules and three-dimensional modules in the digital twin factory system, the problem of the inability to achieve two-dimensional and three-dimensional real-time data interaction in the existing technology is solved, and the real-time and operation of factory management are improved Efficiency, realizes parallel real-time display of two-dimensional and three-dimensional graphics.
Patent Information
- Application Number
- CN202180082586.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-12-07
- Filing Date
- 2021-12-07
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-12-07
AI Technical Summary
The existing digital twin factory system cannot realize real-time data interaction between two-dimensional modules and three-dimensional modules, resulting in the inability to realize real-time data interaction between two-dimensional pictures and three-dimensional pictures, affecting the real-time monitoring and optimization of the production process.
A real-time control visual twin factory system was designed. Through the interactive depth of field display between the two-dimensional module and the three-dimensional module, the operator can quickly locate and view the equipment that needs to be viewed, avoiding purposeless investigations, and the three-dimensional module does not It is necessary to process three-dimensional graphic models online in a lightweight manner, reducing server load, and integrating three-dimensional graphic and attribute data through a graphics server to achieve rapid rendering and display.
It realizes parallel real-time display of two-dimensional graphics and three-dimensional graphics, improves operation efficiency, reduces viewing without clear goals, avoids data delays and stuttering in graphics display, and enhances the real-time and accuracy of factory management.
Smart Images

Figure CN117043825B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of digital management technology, and in particular to a real-time controlled visualized twin factory system. Background Art
[0002] The Digital Twin White Paper (2019) of China Academy of Information and Communications Technology defines digital twins as a general enabling technology for interactive mapping of physical space in cyberspace. By comprehensively using information technologies such as perception, computing, and modeling, the physical space can be described, diagnosed, predicted, and decided through software definition, thereby achieving interactive mapping between physical space and cyberspace. Digital twin technology, a general enabling technology to support the digital transformation of the economy and society, is mainly used in application scenarios such as digital factories, Internet of Vehicles, smart cities, smart buildings, and smart healthcare from an application perspective.
[0003] Chinese patent CN111103860A discloses a factory management system and method based on a digital twin platform. The system includes a modeling and simulation module, a production management module, a data acquisition module, a data control module, and a precision service module. It uses real-time data interaction between the simulation workshop and the physical workshop to continuously perform iterative optimization, and upgrade the production line while ensuring that the production process is not interrupted to avoid wasting resources. By analyzing and processing the internal big data, it is possible to further determine the wear and tear between the various components of the production line during the production process. Maintenance personnel can perform maintenance and care based on the wear report analyzed by the data to reduce the state of equipment production line shutdown. By simulating the production process, the maximum load state of the production line can be calculated, and the maximum production capacity output of the production line can be measured. However, the data of this patent is the real-time interaction between the simulation workshop and the physical workshop, not the real-time interaction between the two-dimensional monitoring system and the three-dimensional monitoring system, and it is impossible to achieve real-time data interaction between the two-dimensional screen and the three-dimensional screen.
[0004] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the applicant studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the invention
[0005] In view of the deficiencies in the prior art, the present invention provides a real-time controlled visualized twin factory system, the system comprising at least a two-dimensional module, a three-dimensional module and an equipment module that establish communication connections with each other, the equipment module comprising at least a controlled object and a control unit, the two-dimensional module being used to display the controlled object in a two-dimensional manner so that an operator can control its state; the three-dimensional module being used to display the controlled object in a three-dimensional manner so that an operator can display the controlled object currently controlled or viewed, the control unit being used to send attribute information of the controlled object to the two-dimensional module and / or the three-dimensional module so as to control the controlled object in response to instruction information of the two-dimensional module and / or the three-dimensional module, the three-dimensional graphic component of the controlled object establishing a mapping association relationship with the two-dimensional graphic component of the controlled object, so that the operator can locate the two-dimensional graphic component in the three-dimensional view, wherein the three-dimensional module requests data according to the depth of field range specified in the two-dimensional module, and provides a three-dimensional view of the controlled object and the equipment associated with the controlled object within the depth of field range. The time-controlled visualized twin factory system of the present invention enables operators to quickly identify equipment that needs to be focused on through the interactive display of equipment within the depth of field of two-dimensional modules and three-dimensional modules, thereby avoiding the disadvantage of aimlessly checking equipment to find the cause of the alarm.
[0006] Preferably, in response to clicking on the two-dimensional graphic component of the controlled object, the three-dimensional module displays the three-dimensional graphic component corresponding to the two-dimensional graphic component of the controlled object according to the pre-setting of the two-dimensional graphic component by the operator. The three-dimensional module of the present invention does not need to perform online lightweight processing on the three-dimensional model of the three-dimensional graphic component, which reduces the workload of the server and the display speed of the three-dimensional graphic component is fast.
[0007] Preferably, the coding of the controlled object is pre-set according to a predefined coding rule, the two-dimensional module displays a two-dimensional graphic containing the properties of the controlled object based on the coding information of the controlled object, and the three-dimensional module displays a three-dimensional graphic containing the properties of the controlled object based on the coding information of the controlled object. Each component of the controlled object of the present invention is provided with a separate unique coding, so that the two-dimensional server and the three-dimensional server call and display the two-dimensional graphic component or the three-dimensional graphic component of the controlled object based on the coding of the component, without the need to perform associated calculation and retrieval of each data of the controlled object, and the retrieval speed is faster.
[0008] Preferably, the attribute data of the controlled object can be displayed in parallel in the form of two-dimensional graphics and three-dimensional views in response to the operating instructions of the operator station. Preferably, the three-dimensional display of the three-dimensional module comes from a graphics server in the form of a picture frequency stream, and the graphics server is used to merge the three-dimensional data with the attribute data of the controlled object. The engineering data in the graphics server of the present invention not only includes traditional digital engineering data, but also includes graphical engineering data, real-time process data and real-time personnel positioning data. It is a real process production-based, real-time, cross-platform system. The present invention uses a graphics server to merge three-dimensional graphics and attribute data for a three-dimensional server, so that the three-dimensional server can directly call three-dimensional graphic components and perform simple rendering and display, thereby shortening the call time of the controlled object components.
[0009] Preferably, the 3D module selects the 3D graphics of the device that needs to be displayed in high definition through the depth of field area formed based on the interaction sent by the 2D module. Preferably, the depth of field range refers to the display range that can form a clear image on the display when obtaining a view of a limited distance; the depth of field area refers to the distance range that can clearly display the 3D graphic components of the controlled object.
[0010] The present invention also provides a twin visualization device of a factory system, which includes at least a control system, a server system and at least one operator station. The control system establishes a communication connection with the server system, and the server system establishes a communication connection with at least one of the operator stations. The server system includes at least a two-dimensional server and a three-dimensional server. The attribute data of the controlled object can be displayed in parallel in the form of two-dimensional graphics and three-dimensional views in response to the operation instructions of the operator station. When the operator views the three-dimensional graphics and its attributes within the specified depth of field area, the picture is clear; when the operator views and reaches the edge of the depth of field area, the three-dimensional graphics within the edge are of high definition, and the clarity of the three-dimensional graphics outside the edge is reduced, thereby prompting the operator to view content beyond the depth of field area, so that the operator can re-plan the viewing depth of field area to avoid viewing without a clear target.
[0011] Preferably, the three-dimensional server requests data according to the depth range specified in the two-dimensional server, and displays a three-dimensional view containing the controlled object and equipment associated with the controlled object within the depth range through the operator station.
[0012] Preferably, when the operator defines the depth of field area in the two-dimensional view of the operator station, the three-dimensional server displays the three-dimensional graphic components of the controlled object according to the specified depth of field range.
[0013] Preferably, in response to clicking on an alarm list formed by alarm information records, the three-dimensional server can display the three-dimensional graphic component of the controlled object associated with the clicked alarm information according to the preset setting of the alarm list by the operator station.
[0014] Preferably, for devices with abnormal properties, the two-dimensional server displays a two-dimensional graphic of the device that issues the alarm information, and at least one other device associated with the abnormal problem of the device, in a prominent color and / or logo.
[0015] Preferably, the three-dimensional server preliminarily displays the three-dimensional graphics of the controlled object at a preset angle; wherein, in response to the operator's selection information or display angle request, the three-dimensional server adjusts the display angle of the controlled object to a specified angle.
[0016] The present invention also provides a twin visualization method for a factory system, the method comprising at least: a two-dimensional server displays the controlled object at the operator station in the form of a combination of two-dimensional graphic components and attribute data based on real-time attribute data sent by the control system, and a three-dimensional server displays the three-dimensional graphic components of the controlled object at the operator station in the form of a picture stream, wherein the three-dimensional server requests data according to a depth of field range specified in the two-dimensional server, and displays a three-dimensional view of the controlled object and equipment associated with the controlled object within the depth of field range through the operator station.
[0017] Preferably, the method also includes: when the operator views the three-dimensional graphics and their attributes within the specified depth of field area, the picture is clear; when the operator views and reaches the edge of the depth of field area, the three-dimensional graphics within the edge are high-definition, and the clarity of the three-dimensional graphics outside the edge is reduced, thereby prompting the operator to view content beyond the depth of field area, so that the operator can re-plan the viewing depth of field area to avoid viewing without a clear target. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 It is the basic structure of the real-time controlled visualized twin factory system of the present invention;
[0019] Figure 2 It is a schematic diagram of the network structure of the present invention;
[0020] Figure 3 is a schematic diagram of one of the three-dimensional system display screens of the present invention;
[0021] Figure 4 It is a schematic diagram of a display screen of a three-dimensional system for real-time positioning of personnel of the present invention;
[0022] Figure 5 It is a schematic diagram of the overall structure of the system of the present invention;
[0023] Figure 6 It is one schematic diagram of the two-dimensional display of the present invention;
[0024] Figure 7 It is one of the schematic diagrams of the alarm list jumping to the three-dimensional display of the present invention;
[0025] Figure 8 It is a schematic diagram of two-dimensional display and three-dimensional display of the same component of the present invention.
[0026] Reference numerals list
[0027] 1: Equipment module; F1: Production operation management layer; F2: Data service layer; F3: Data application layer; F4: Operation monitoring layer; F5: Process control layer; 11: Personnel positioning system; 12: Database system; 13: Advanced application terminal; 14: WEB client; 21: Dispatching station; 22: Production analysis client; 23: WEB server; 24: Protection server; 31: Three-dimensional module; 32: Graphic server; 33: Two-dimensional module; 41: First operation station; 42: Second operation station; 43: Engineer station; 44: History recording station; 45: Clock synchronizer; 61: First firewall; 62: Second firewall; 63: Third firewall; 10: Controlled object; 20: Control system; 30: Two-dimensional server; 32: Graphic server; 50: Three-dimensional server; 60: Operator station unit; 70: Field control station; 80: Equipment; 90: Personnel positioning device. DETAILED DESCRIPTION
[0028] The following is a detailed description with reference to the accompanying drawings. In view of the deficiencies in the prior art, the present invention provides a real-time controlled visualized twin factory system, which can also be a real-time control and visualization system for a digital factory, or a digital twin visualization system for a digital factory. The picture frequency stream in the present invention refers to: a video stream that can form a picture. Video stream refers to the transmission of video data, for example, it can be processed as a stable and continuous stream through a network.
[0029] Example 1
[0030] This embodiment provides a real-time control visual twin factory system, such as Figure 1 As shown, it at least includes an equipment module 1 and a server system. The server system at least includes a two-dimensional module 33 and a three-dimensional module 31. The equipment module 1 transmits data with the two-dimensional module 33 and the three-dimensional module 31 in a wired or wireless manner. The two-dimensional module 33 and the three-dimensional module 31 transmit data in a wired or wireless manner. The server system establishes a data connection with at least one operator station to input information to the server system and display information.
[0031] The equipment module 1 is used to collect the operation data of the physical object and control the operation of the controlled object. The controlled object is a physical object of the physical factory, including at least the factory's building structure, engineering equipment, process system, electrical system, instrumentation and control system, and structured engineering of the communication system. The equipment module 1 includes at least an I / O (input / output) unit and a control unit. The acquisition unit and the control unit establish a data transmission relationship in a wired or wireless manner. Preferably, the acquisition unit is an I / O unit, which is connected to the field device and is used to input or output data information of the device. The control unit transmits data to the I / O unit via a data bus. The acquisition unit is used to collect data from the controlled object at the real site in real time and transmit it to the control unit, and can also be used to transmit the output instructions of the control unit to the controlled object at the real site in real time. The control unit transmits the data synchronously to the two-dimensional module 33 and / or the three-dimensional module 31. The I / O unit can be a device for collecting various equipment data, equipment status, and environmental data. For example, various instrumentation equipment is used to collect and monitor changes in process parameter values such as temperature, flow, liquid level, pressure, etc.; the open or closed state of valves; the start or stop state of motors, etc.; real-time data on the physical properties of the outlet medium of the equipment; the concentration monitored by the combustible gas detection probe; the concentration of toxic gases monitored by the toxic gas detection probe; the real-time video images monitored by the on-site camera, etc. I / O units can also be various actuators, such as control valves, switch valves, various actuators, electrical control circuits, etc.
[0032] The control unit is used to monitor the collected data and its changes, output alarm instructions, execute real-time control instructions, and control the controlled object through the I / O unit. Control instructions include: output to the opening instruction of the control valve, output to the on / off instruction of the switch valve; output to the start / stop instruction of the on-site motor, output to the alarm instruction of the on-site sound / light alarm, etc.
[0033] The two-dimensional module 33 is used to display the controlled object in a two-dimensional manner so that the operator can control its state. Preferably, the two-dimensional module 33 is used to display the controlled object and its attributes in a two-dimensional manner. The two-dimensional module defines the number, function, purpose, setting value, input / output data, alarm and related engineering design graphics, colors, data, etc. of various types of equipment, such as Figure 7 The two-dimensional module can display the parameters and properties of all variables in the project, can inform the operator of unexpected process conditions in the form of sound and light alarms, can display real-time or historical trend charts of process data in any combination or single-point mode, and can obtain the process safety interlock protection status, etc. Preferably, the two-dimensional module 33 only stores two-dimensional data information, so as not to occupy the resources of other servers, which is conducive to reducing the workload of the three-dimensional module, thereby improving the processing efficiency of the three-dimensional module.
[0034] The three-dimensional module 31 is used to display the controlled object in a three-dimensional manner so that the operator can display the controlled object currently controlled or viewed, such as Figures 3 to 5 As shown. Among them, the three-dimensional module is only used for three-dimensional graphics rendering, and the three-dimensional graphics are not lightweight, which is conducive to reducing the workload of the three-dimensional module, thereby improving the processing efficiency of the three-dimensional module. After the three-dimensional model of the controlled object is rendered, the three-dimensional module pushes it to at least one operator station for display. The present invention uses a graphics server to fuse three-dimensional graphics and attribute data for a three-dimensional server, so that the three-dimensional server can directly call the three-dimensional graphic components and perform simple rendering and display, thereby shortening the call time of the controlled object components. The operator station does not render the three-dimensional model. Preferably, when displaying the three-dimensional model, the operator station also displays real-time data, alarm data and / or equipment data.
[0035] Among them, the properties of the controlled object can be displayed in parallel in two-dimensional and three-dimensional ways in response to the operation of the operator. Preferably, after the property information of the controlled object is changed by the operator, the relevant module property parameters in the two-dimensional module and the three-dimensional module will change synchronously, so that the two-dimensional module and the three-dimensional module always display the controlled object in a real-time display manner with consistent property information. Compared with the serial working mode of the two-dimensional module and the three-dimensional module in the prior art, the parallel working mode of the two-dimensional module and the three-dimensional module of the present invention does not occupy the control network bandwidth, has a small workload, reduces the data delay display phenomenon of the three-dimensional module and the two-dimensional module, and significantly improves the working efficiency of the graphic display, thereby realizing the parallel real-time display of the two-dimensional graphics and the three-dimensional graphics. Preferably, the two-dimensional graphics and the three-dimensional graphics are displayed in parallel and synchronously.
[0036] Preferably, the 3D graphic component of the controlled object is mapped to the 2D graphic component of the controlled object, that is, the 3D graphic component of the controlled object is mapped with the 2D graphic component, so that the operator can locate the 2D graphic component in the 3D view. Figure 8As shown, when the operator selects a component on the display of the two-dimensional module, the two-dimensional module responds to the selection of the two-dimensional graphic component of the controlled object, and displays the three-dimensional graphic component corresponding to the two-dimensional graphic component of the controlled object according to the preset setting of the two-dimensional graphic component by the operator. For example, one way to jump to the three-dimensional display screen through the two-dimensional display screen is: by right-clicking the device or component on the two-dimensional screen, selecting three-dimensional positioning, and jumping to the associated device in the three-dimensional screen. Jump from the two-dimensional display screen to the associated device in the three-dimensional display screen by entering the corresponding code. The way to jump to the three-dimensional display screen through the alarm list is: by clicking the alarm list to locate the device and its components on the three-dimensional display screen where the alarm occurs. Preferably, for the dual-screen operation station, the present invention can realize the lower screen operation and upper screen display, or the upper screen operation and lower screen display. Preferably, the dual-screen setting is not limited to the setting of the relative position of up and down, left and right, and the dual screen can be set at any position, as long as the operator feels comfortable.
[0037] Preferably, when the operator selects a certain component on the display of the three-dimensional module, the two-dimensional module responds to the selection of the three-dimensional graphic component of the controlled object and displays the two-dimensional graphic corresponding to the three-dimensional graphic component of the controlled object according to the pre-setting of the three-dimensional graphic component by the operator. For example, the operator selects the pre-set instruction of the three-dimensional graphic component of a controlled object in the three-dimensional view, and the two-dimensional module responds to the pre-set instruction information and displays the two-dimensional graphic component corresponding to the three-dimensional graphic component of the controlled object in the two-dimensional view display module.
[0038] Preferably, the two-dimensional view displayed by the two-dimensional module and the three-dimensional view displayed by the three-dimensional module are displayed in parallel screens. Preferably, the two-dimensional view displayed by the two-dimensional module and the three-dimensional view displayed by the three-dimensional module are displayed in parallel screens on the same display device, for example, the two-dimensional view is displayed in parallel at the upper left corner of the three-dimensional view, or the three-dimensional view is displayed in parallel at the upper right corner of the two-dimensional view.
[0039] Preferably, the display of the three-dimensional module comes from the graphics server in the form of a picture stream. The picture stream in the present invention refers to: a video stream that can form a picture. Video stream refers to the transmission of video data, for example, it can be processed as a stable and continuous stream through a network. Among them, the graphics server is used to store static data of the device, including both non-graphic engineering data, such as data tables, specifications, manuals, etc., and graphic engineering data, such as flow charts, equipment manufacturing drawings, floor plans, etc.
[0040] The graphic server is used to merge the three-dimensional data with the attribute data of the controlled object. Among them: the attributes of the controlled object are individually assigned in units of components. For example, the various components of the controlled object are encoded according to predefined unified coding rules. Preferably, the same controlled object in the two-dimensional module and the three-dimensional module uses the same code. Preferably, the code of each component is a unique interface for calling each type of component. By using the code as the calling object when needed, the present invention does not need to perform relationship retrieval, analysis, screening and other operations on the data, and the three-dimensional retrieval speed of the attribute data of the controlled object is fast and the calling efficiency is high.
[0041] like Figure 2 As shown, the real-time data or historical data of the two-dimensional module 33 and the three-dimensional module 31 are derived from a control unit, such as a field control station 70 or a historical recording station 44. A device 80 with several types of sensors is provided in the real field, which is connected to the I / O unit in the control room through cables, and then the detection signal is uploaded to the field control station 70 through the data bus. For example, a certain device in the real field is equipped with a temperature transmitter. When the temperature in the device rises, the output current signal (4-20mA) of the transmitter increases, and the current signal is transmitted to the I / O module in the control room through a cable. After analog / digital (A / D) conversion, the data is uploaded to the field control station 70 for each operation station and the secondary server to call.
[0042] The field control station 70 transmits the real-time data of the real scene to the two-dimensional module and the three-dimensional module in parallel. Preferably, the field control station 70 sends the real-time data of the real scene to the historical record station for transfer and storage to form time-related historical data. Preferably, after the staff inputs the control instruction and / or operation signal through at least one operator station, the operator station sends the control instruction and / or operation signal to the field control station. The field control station sends the control instruction to the I / O unit in response to the control instruction and / or operation signal, and the I / O unit sends the relevant signal to the controlled object in response to the control instruction to control the controlled object of the real scene.
[0043] Preferably, the controlled object of the present invention also includes a personnel positioning device. The real-time data of the personnel positioning information is synchronously displayed in two dimensions and three dimensions in the two-dimensional module and the three-dimensional module. The advantage of incorporating the personnel positioning device into the controlled object of the present invention is that it can display the movement trajectory of the staff in the factory in real time, forming a real-time, cross-platform real-time digital twin factory system based on process production. Preferably, the alarm data of the field control station is sent to the two-dimensional module. In response to the request of the three-dimensional module, the two-dimensional module sends the data to be displayed to the three-dimensional module.
[0044] like Figure 2The figure shows one of the network structures of the real-time digital twin factory system for control and display of the present invention, including a production operation management layer F1, a data service layer F2, a data application layer F3, an operation monitoring layer F4 and a control layer F5. The operation monitoring layer F4 is connected to the control layer F5 through a gateway device. The data application layer F3 is connected to the operation monitoring layer F4 through a gateway device. The data service layer F2 is connected to the data application layer F3 through a gateway device. The control layer includes a plurality of devices 80, an I / O unit and a field control station 70. The I / O unit is arranged between the plurality of devices 80 and the field control station 70. Preferably, the operation monitoring layer F4 includes at least one operation station and an engineer station 42. Preferably, the clock synchronizer 45 of the operation monitoring layer F4 is connected to the field control station 70. The data application layer F3 includes a three-dimensional module 31, a graphics server 32 and a three-dimensional module 31. The data service layer F2 includes a scheduling station 21, a production analysis client 22, a WEB server 23 and a protection server 24. The dispatch station 21, the production analysis client 22, the WEB server 23 and the protection server 24 respectively establish communication connections with each device of the data application layer F3 through at least one gateway device. Preferably, the production operation management layer F1 at least includes a personnel positioning system 11, a database system 12 and a WEB client 14. Among them, the production operation management layer F1 establishes communication connections with the data service layer F2, the data application layer F3 and the operation monitoring layer F4 respectively.
[0045] Preferably, in the three-dimensional module, the personnel location information is integrated with the three-dimensional model. The personnel location information can be displayed in the three-dimensional model through an operator station connected to the three-dimensional module. Preferably, in the two-dimensional module, the personnel location information is integrated with the two-dimensional model. The personnel location information can be displayed in the two-dimensional model through an operator station connected to the two-dimensional module.
[0046] Example 2
[0047] In this embodiment, the two-dimensional module is preferably a two-dimensional server, and the three-dimensional module is preferably a three-dimensional server. Figure 5 As shown, the real-time controlled visualized twin factory system of the present invention at least includes a control system 20, a server system and an operator station unit 60. The server system includes at least a two-dimensional server 30, a graphic server 32 and a three-dimensional server 50. A number of controlled objects 10 establish a communication connection with the control system 20. The control system 20 is used to collect dynamic and static attribute data of the controlled objects and control various working operations such as startup, operation, operation, and shutdown of the controlled objects. The control system 20 establishes a communication connection with the server system in a wired or wireless manner. That is, the control system 20 establishes a communication connection with the two-dimensional server 30, the graphic server 32 and the three-dimensional server 50 respectively in a wired or wireless manner. The server system establishes a communication connection with the operator station unit 60.
[0048] The control system of the present invention includes at least one or more of a dedicated integrated chip, a processor, a server, a server group, and a cloud server with a control function. The two-dimensional server is used to display the controlled object in a two-dimensional manner so that the operator can control its state. Preferably, in at least one operator station in the operator station unit, the operator can operate to display a two-dimensional graphic of any controlled object. Among them, the number, function, purpose, set value, input / output data, alarm and related various engineering design graphics, data and other information of the controlled object are defined in the two-dimensional server. The two-dimensional server displays the parameters and properties of all variables in the control process through a display device, can inform the operator of unexpected process conditions in the form of sound and light alarms, can display real-time or historical trend charts of engineering data in any combination or single-point mode, and can know the engineering safety interlock protection status, etc.
[0049] The three-dimensional server is used to display the controlled object in a three-dimensional manner so that the operator can display the controlled object currently controlled or viewed. Specifically, in at least one operator station in the operator station unit, the operator can operate to display the three-dimensional graph of any controlled object.
[0050] A graphics server is used to store attribute data and engineering data. The engineering data in the prior art only contains pure data information but lacks graphic information, which results in the need to adjust the graphics according to the engineering data when displaying two-dimensional or three-dimensional graphics, resulting in delays in the display or conversion of two-dimensional or three-dimensional graphics, or even freezing. The engineering data of the present invention includes graphic data, real-time process data, and real-time personnel positioning data. The graphic data of the present invention includes various graphic data such as factory structure graphics, controlled object graphics, and connection equipment graphics. Real-time process data, such as various instrumentation equipment, is used to collect and monitor changes in process parameter values such as temperature, pressure, flow, and liquid level; the open or closed state of the valve; the start or stop state of the motor; real-time data of the physical property components of a certain medium; the combustible gas concentration monitored by the combustible gas detection probe; the toxic gas concentration monitored by the toxic gas detection probe; the real-time video screen monitored by the on-site camera, etc. It also includes various types of actuators, such as control valves, switch valves, actuators, electrical control circuits, etc. Real-time personnel positioning data is the real-time position data of personnel carrying positioning devices. The graphics server fuses the attribute data with the graphic data to form a three-dimensional graphic that can be displayed in three dimensions. For example, Figure 5As shown, the graphic data includes a flow chart, an equipment manufacturing diagram, a factory building diagram, a two-dimensional outline diagram of the controlled object, a three-dimensional outline diagram of the controlled object, a personnel sign diagram, etc. The factory building diagram includes a two-dimensional plane diagram and a three-dimensional diagram that are consistent with the proportion of the factory's physical building structure. The attribute data of the controlled object is fused with the graphic data to form a two-dimensional graphic or a three-dimensional graphic with attribute data. For example, in a three-dimensional graphic, the component position of the controlled object displays the attribute data of the component when it is clicked. Preferably, the attribute data includes self-attribute data, working state attributes, warning attributes, etc. The self-attribute data is the data of the controlled object itself, such as model, specification, material, size, position, replaceable reserve quantity, installation time, maintenance time and other information. The working state attribute is the working state data information of the controlled object. The warning attribute is the threshold information or operating state that needs to be alarmed, and the operating state is, for example, abnormal working state, signal overrun, etc.
[0051] Preferably, the two-dimensional graphic component of the controlled object is associated with the three-dimensional graphic component of the controlled object in a mapping manner, so that the operator can locate the two-dimensional graphic component in the three-dimensional view. Figure 7 As shown, specifically, when the operator clicks a certain component on the display of the two-dimensional server, the three-dimensional server responds to the click of the two-dimensional graphic component of the controlled object, and displays the three-dimensional graphic component corresponding to the two-dimensional graphic component of the controlled object according to the pre-setting of the two-dimensional graphic component by the operator. The present invention enables the operator to conveniently switch between two-dimensional graphics and three-dimensional graphics through the setting of mapping association.
[0052] Preferably, the switching method between the two-dimensional graphics and the three-dimensional graphics in the present invention at least includes: point-to-point switching, coded switching, and information-based switching. The switching method between the two-dimensional graphics and the three-dimensional graphics of the present invention is not limited to the listed methods, and may also include other methods that can achieve two-dimensional and three-dimensional graphics switching, for example, switching in response to coded content in the form of voice, switching in response to information content scanned by a two-dimensional code, switching in response to coded information in a video or picture of a smart wearable device, and so on. The point-to-point switching method is, for example: Figure 7 As shown, by clicking on the device or component on the two-dimensional screen, the associated device displayed on the three-dimensional screen is located. The coding switching method is, for example, to directly input the code of the controlled object at the corresponding position on the two-dimensional screen to locate the associated device of the controlled object on the three-dimensional display screen. The switching method based on the alarm information is, for example, as follows: Figure 7 As shown, after the control system issues an alarm message related to the controlled object, an alarm message list is formed. The device and components of the controlled object on the three-dimensional screen where the alarm occurs can be located by clicking on the alarm list.
[0053] Preferably, for the dual-screen operation station, the present invention can realize the lower screen operation and the upper screen display, or the upper screen operation and the lower screen display. Preferably, the dual-screen setting is not limited to the setting of the relative position of up and down, left and right, and the dual screen can be set in any position, as long as the operator feels comfortable.
[0054] Preferably, the three-dimensional server of the present invention displays three-dimensional graphics in the form of a picture frequency stream from a graphics server. Preferably, the attributes of the controlled object can be displayed in parallel in two-dimensional and three-dimensional modes in response to the operation of the operator. Preferably, after the attribute data of the controlled object is changed by the operator, the relevant attribute parameters in the two-dimensional server and the three-dimensional server will change synchronously, so that the two-dimensional server and the three-dimensional server always display the controlled object in a real-time display mode with consistent attribute data. Compared with the serial working mode of the two-dimensional server and the three-dimensional server in the prior art, the parallel working mode of the two-dimensional server and the three-dimensional server of the present invention does not occupy the control network bandwidth, has a small workload, reduces the data delay display phenomenon of the three-dimensional server and the two-dimensional server, and significantly improves the working efficiency of the graphic display, thereby realizing the synchronous real-time display of the two-dimensional graphics and the three-dimensional graphics. Preferably, the control system transmits the real-time data to the two-dimensional server and the three-dimensional server in parallel. Preferably, the server system also includes a history server. The control system sends the real-time data to the history server for transfer and storage to form time-related history data.
[0055] Preferably, the present invention further includes a personnel positioning device 90. The personnel positioning device 90 establishes a communication connection with the server system in a wired or wireless manner. Preferably, the personnel positioning device 90 establishes a communication connection in a wireless manner. The personnel positioning device 90 is a portable device with a positioning function, a positionable marker, an intelligent wearable device, etc.
[0056] The graphic server 32 combines the personnel location information received from the personnel location device 90 with the three-dimensional graphic to form a three-dimensional graphic showing the personnel's real-time location. When the operator clicks on the personnel mark at the real-time location in the three-dimensional graphic, a three-dimensional graphic of the personnel and the controlled objects around them is displayed. The operator can view the three-dimensional graphic and attribute data of the controlled objects and the real-time location of the personnel in real time.
[0057] Preferably, the operator controls the operating status of the controlled object in real time at the operator station, and simultaneously views the working status and property changes of the controlled object in real time in two-dimensional and three-dimensional views, which is more conducive to the operator to grasp and control the controlled objects in the factory in real time, thereby realizing visual management.
[0058] Example 3
[0059] This embodiment is a further improvement of Embodiment 1 and Embodiment 2, and the repeated contents will not be repeated here.
[0060] The real-time controlled visualized twin factory system and method of the present invention can also avoid disadvantages by setting an interactive depth of field area to select two-dimensional graphics and / or three-dimensional graphics of equipment that needs to be displayed in high definition.
[0061] Due to the huge number of controlled objects in the factory, the operator searches and views the controlled objects based on the connection relationship, which can easily blur the main target of the viewing, resulting in more and more controlled objects being viewed, resulting in reduced viewing efficiency. Therefore, the three-dimensional view of the present invention requests data according to the depth of field range specified in the two-dimensional scene, and gives a three-dimensional view of the controlled objects and the equipment associated with the controlled objects within the depth of field range. The depth of field range of the present invention refers to the display range that can form a clear image on the display when obtaining a view of a limited distance. The depth of field area refers to the distance range that can clearly display the three-dimensional graphic components of the controlled object.
[0062] The area delineated on the two-dimensional view may be a specified depth of field range. The depth of field range includes a number of controlled objects. When the operator delineates the depth of field area, the three-dimensional view displays the three-dimensional graphic components of the controlled object according to the specified depth of field range. For example, the operator delineates the depth of field area of the three-dimensional view with an undefined geometric shape on the displayed two-dimensional view, and the two-dimensional module sends the depth of field information to the three-dimensional module. The three-dimensional module displays the depth of field area in a three-dimensional graphic in response to the depth of field information. When the operator views the three-dimensional graphics and its attributes within the specified depth of field area, the picture is clear. When the operator reaches the edge of the depth of field area, the three-dimensional graphics within the edge are of high definition, and the clarity of the three-dimensional graphics outside the edge is reduced, thereby prompting the operator to view content beyond the depth of field area, so that the operator can re-plan the depth of field area to be viewed to avoid viewing without a clear target.
[0063] Preferably, for devices with abnormal properties, the two-dimensional graphic displays the two-dimensional graphic of the device that issued the alarm information, and at least one other device associated with the abnormal problem of the device, in a prominent color and / or logo. That is, the operator can clearly see the device that issued the alarm and the associated devices related to the alarm on the two-dimensional view. The operator can view the three-dimensional graphics and attribute information of the alarm device and its associated devices in detail in a high-definition manner on the three-dimensional view by delineating the depth of field area containing the alarm device and the associated devices on the two-dimensional view. That is, by highlighting the alarm device and its associated devices, the operator can quickly determine the equipment that needs to be focused on, avoiding the disadvantage of aimlessly checking the equipment to find the cause of the alarm.
[0064] If the demarcation method of the depth of field area is not set, when the operator views the device of the three-dimensional view on the display, the three-dimensional module cannot determine the device that the operator is about to view next, and can only display all the devices in the current three-dimensional view in a high-definition manner. However, in practice, there are many three-dimensional graphics and their attributes of devices, and the operator will not view them in detail. This causes the three-dimensional module to send excessive unnecessary data to the display, resulting in data delays on the display end and slow updates of the three-dimensional graphics, affecting the screen update speed of the display. Preferably, the display includes a two-dimensional display, a three-dimensional display and a display device of a wearable device. The present invention specifies the depth of field area, and the three-dimensional module can reduce the amount of data transmitted to the display being viewed. The three-dimensional module filters the high-definition data of the three-dimensional graphics and its attribute data based on the depth of field area sent by the two-dimensional module and the list of devices in the depth of field area, and sends it to the display. That is, the three-dimensional module can filter and transmit data in a targeted manner based on the depth of field area, thereby reducing the transmission of a large amount of unnecessary data.
[0065] Preferably, the depth of field area can be set not only in the two-dimensional view but also in the three-dimensional view. When the operator defines the depth of field area in the three-dimensional view, the three-dimensional module can search for data according to the depth of field area and provide a list of devices in the depth of field area. The operator can view the information he needs according to the list.
[0066] Preferably, the present invention preliminarily displays the three-dimensional graphics of the controlled object at a preset angle. In response to the operator's click information or display angle request, the three-dimensional module adjusts the display angle of the controlled object to a specified angle. Such display is conducive to the operator viewing the operation of each angle of the controlled object and avoiding the limitation of viewing angle.
[0067] It should be noted that the above-mentioned specific embodiments are exemplary, and those skilled in the art can come up with various solutions inspired by the disclosure of the present invention, and these solutions also belong to the disclosure scope of the present invention and fall within the protection scope of the present invention. Those skilled in the art should understand that the present invention specification and its drawings are illustrative and do not constitute a limitation on the claims. The scope of protection of the present invention is defined by the claims and their equivalents. The present invention specification contains multiple inventive concepts, such as "preferably", "according to a preferred embodiment" or "optionally", all of which indicate that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application based on each inventive concept.
Claims
1. A real-time controlled visual twin factory system, the system comprising at least a two-dimensional module, a three-dimensional module and an equipment module that establish communication connections with each other, the equipment module comprising at least a controlled object and a control unit, The two-dimensional module storing two-dimensional data information is used to display the controlled object in a two-dimensional manner so that the operator can control its state; The three-dimensional module is used for three-dimensional graphics rendering without lightweighting the three-dimensional graphics: used to display the controlled object in a three-dimensional manner so that the operator can display the controlled object currently controlled or viewed by the operator, The control unit is used to send the attribute data of the controlled object to the two-dimensional module and / or the three-dimensional module, so as to control the controlled object in response to the instruction information of the two-dimensional module and / or the three-dimensional module, characterized in that: A mapping association relationship is established between the three-dimensional graphic component of the controlled object and the two-dimensional graphic component of the controlled object, so that the operator can locate the two-dimensional graphic component in the three-dimensional view, wherein the three-dimensional module requests data of the depth of field range containing several controlled objects specified based on the demarcated area in the two-dimensional module, and gives a three-dimensional view containing the controlled object and the equipment associated with the controlled object within the depth of field range.
2. The real-time controlled visual twin factory system according to claim 1 is characterized in that: In response to clicking on the two-dimensional graphic component of the controlled object, the three-dimensional module displays the three-dimensional graphic component corresponding to the two-dimensional graphic component of the controlled object according to the preset setting of the two-dimensional graphic component by the operator.
3. The real-time controlled visual twin factory system according to claim 1 is characterized in that: The coding of the controlled object is preset according to a predefined coding rule. The two-dimensional module displays a two-dimensional graph containing attribute data of the controlled object based on the coding information of the controlled object. The three-dimensional module displays a three-dimensional graph including attribute data of the controlled object based on the coding information of the controlled object.
4. The real-time controlled visual twin factory system according to claim 1 is characterized in that: The attribute data of the controlled object can be displayed in parallel in the form of a two-dimensional graphic and a three-dimensional view in response to an operation instruction of an operator station.
5. The real-time controlled visual twin factory system according to claim 1 is characterized in that: The three-dimensional display of the three-dimensional module comes from a graphic server in the form of a picture frequency stream, and the graphic server is used to merge the three-dimensional data with the attribute data of the controlled object.
6. The real-time controlled visual twin factory system according to claim 1 is characterized in that: The three-dimensional module selects the three-dimensional graphics of the device that needs high-definition display through the depth of field area formed based on the interaction and sent by the two-dimensional module.
7. The real-time controlled visual twin factory system according to claim 6 is characterized in that: The depth of field range refers to the display range in which a clear image can be formed on the display when a view of a limited distance is obtained; the depth of field area refers to the distance range in which the three-dimensional graphic components of the controlled object can be clearly displayed.
8. A twin visualization device for a factory system, comprising at least a control system (20), a server system and at least one operator station, wherein the control system (20) establishes a communication connection with the server system, and the server system establishes a communication connection with at least one of the operator stations, wherein the server system at least comprises a two-dimensional server (30) for storing two-dimensional data information and a three-dimensional server (50) for rendering three-dimensional graphics without performing lightweight processing on the three-dimensional graphics, characterized in that: The attribute data of the controlled object can be displayed in parallel in the form of a two-dimensional graphic and a three-dimensional view in response to the operation instruction of the operator station. When the operator views the three-dimensional graphics and their attributes within the specified depth of field area, the picture is clear; When the operator reaches the edge of the depth of field, the 3D graphics within the edge are high-definition, and the clarity of the 3D graphics outside the edge is reduced, thereby prompting the operator that the content viewed exceeds the depth of field, so that the operator can re-plan the depth of field area to avoid viewing without a clear target. The three-dimensional server (50) requests data on a depth of field range containing a number of controlled objects specified based on a demarcated area in the two-dimensional server (30), and displays a three-dimensional view containing the controlled objects and equipment associated with the controlled objects within the depth of field range through the operator station.
9. The twin visualization device of the factory system according to claim 8, characterized in that: When the operator defines the depth of field area in the two-dimensional view of the operator station, the three-dimensional server (50) displays the three-dimensional graphic components of the controlled object according to the specified depth of field range.
10. The twin visualization device of the factory system according to claim 8, characterized in that: In response to clicking on an alarm list formed by alarm information records, the three-dimensional server (50) can display the three-dimensional graphic component of the controlled object associated with the selected alarm information according to the preset setting of the alarm list by the operator station.
11. The twin visualization device of the factory system according to claim 8, characterized in that: For devices with abnormal properties, the two-dimensional server (30) displays a two-dimensional graphic of the device that issues the alarm information, and at least one other device associated with the abnormal problem of the device, in a prominent color and / or logo.
12. The twin visualization device of the factory system according to claim 8, characterized in that: The three-dimensional server (50) preliminarily displays the three-dimensional graphics of the controlled object at a preset angle; In response to the operator's selection information or display angle request, the three-dimensional server (50) adjusts the display angle of the controlled object to a specified angle.
13. A twin visualization method for a factory system, characterized in that: The method at least comprises: The two-dimensional server (30) storing the two-dimensional data information displays the controlled object on the operator station in the form of a combination of two-dimensional graphic components and attribute data based on the real-time attribute data sent by the control system (20). A three-dimensional server (50) for three-dimensional graphics rendering without lightweighting the three-dimensional graphics displays the three-dimensional graphics components of the controlled object on the operator station in the form of a picture stream, wherein: The three-dimensional server (50) requests data on a depth of field range containing a number of controlled objects specified based on a demarcated area in the two-dimensional server (30), and displays a three-dimensional view containing the controlled objects and equipment associated with the controlled objects within the depth of field range through the operator station.
14. The twin visualization method of a factory system according to claim 13, characterized in that: When the operator views the three-dimensional graphics and their attributes within the specified depth of field area, the picture is clear; When the operator reaches the edge of the depth of field area, the three-dimensional graphics within the edge are high-definition, and the clarity of the three-dimensional graphics outside the edge is reduced, thereby prompting the operator that the content viewed exceeds the depth of field area, allowing the operator to re-plan the viewing depth of field area to avoid viewing without a clear target.
