A factory equipment safety index display system and method

Abstract

The present invention relates to a factory equipment safety index display system and method, and belongs to the field of accident emergency processing technology. The system includes a perception module, a processing module and a three-dimensional display module. The perception module is used to collect equipment data of equipment in a digital twin factory. The processing module evaluates the equipment safety index related to the equipment based on the equipment data and sends the equipment safety index to the three-dimensional display module. In a three-dimensional scene, the three-dimensional display module displays the equipment safety index in the form of a digital signboard. The present invention is aimed at an intuitive display of the factory equipment safety index in an immersive scene for a factory that has completed digital twins. It can reflect the operating status of each equipment in the factory in real time in the form of a digital signboard according to the needs of the staff, which helps the staff to find fault points in time and make decisions, reduce the occurrence of safety accidents, and improve the production efficiency of the factory.

Description

Technical Field

[0001] The present invention relates to the technical field of accident emergency treatment, and in particular to a factory equipment safety index display system and method. Background Art

[0002] With the development of modern factories, digital twin technology is widely used in the industrial field, which can realize resource allocation, intelligent production, and significantly improve production efficiency. By definition, digital twin technology maps the various states of physical equipment into a virtual three-dimensional space to form a three-dimensional visualization, so as to make a highly realistic analysis of the established models and collected data in a real-time dynamic way. Digital twin technology is used for monitoring and prediction of physical entities to better manage and optimize factory facilities. The existing digital twin visualization component system can already achieve full-domain perception and mirror virtual reproduction of the real world, build intelligent applications for vertical industries in the digital twin world, and realize comprehensive monitoring, orderly management and intelligent control of the real world through digital twins.

[0003] For factories, in order to ensure the smooth progress of production, it is necessary to regularly send people to monitor and repair each device to avoid the situation where the equipment is already abnormal but is still used for a long time without any errors. The digital twin factory can collect the data of the equipment and send it to the monitoring port, so that the staff can understand the operating status of the equipment at any time. However, the equipment in the factory is often of various types and large in number, which leads to a lot of and messy data collected. The existing display systems of various digital twin data cannot determine how to display them in a targeted manner. Even if the display system is integrated with data analysis software, the staff can only know whether the current equipment has an abnormality, but still cannot determine the specific location of the fault point that causes the equipment abnormality. The different functions of the staff also make it impossible for them to fully grasp the characteristics of all equipment. In particular, when a certain device is abnormal, the corresponding equipment and supporting facilities associated with it are abnormal at the same time, which leads to too many faulty equipment and parameters that need to be displayed, and it is difficult for the staff to observe the required key parameters among the many displayed parameters. The existing display system is difficult to distinguish the purpose of its display, and it cannot selectively display the corresponding parameters. As a result, when a certain device is abnormal, it is still difficult for the staff to quickly and accurately determine the location of the fault point.

[0004] Chinese patent application CN115730114A discloses a device data visualization method based on digital twins, including the following steps: S1, obtain the modeling data of the device and establish the corresponding device model; S2, obtain the attribute data of the device and add it to the device model to build the digital twin model of the device; S3, based on business needs, collect the operation data of the device through IOT sensors; S4, process and analyze the operation data of the device to obtain the operation status of the device; S5, combine the digital twin model of the device to display the attribute data and operation status of the device in real time. This patent can quickly and accurately understand the specific abnormal content when the device is abnormal.

[0005] Chinese patent application CN114241358A discloses a method, device, computer equipment, storage medium and computer program product for displaying the status of substation equipment based on a digital twin substation. The patent can achieve the technical effect of timely and accurate warning and intuitive presentation of abnormal working status of substation equipment. The method includes: obtaining a monitoring image obtained by monitoring the substation equipment in the substation, identifying whether the substation equipment is in an abnormal working state according to the monitoring image, and if the substation equipment is in an abnormal working state, determining the grid area corresponding to the substation equipment in the digital twin substation, sending information indicating that the substation equipment is in an abnormal working state to the user terminal corresponding to the grid area, and presenting the status indicator light of the grid area corresponding to the substation equipment in the digital twin substation with the prompt effect corresponding to the aforementioned abnormal working state.

[0006] However, the defects of the above two patents are that when a certain device in the factory fails, its related devices and supporting facilities will also experience synchronous abnormalities. The amount of data required for analysis is too much, and it is difficult for staff to observe the key data that caused the failure from the numerous data. For example, a certain device has multiple abnormal conditions such as pressure drop, temperature drop, and liquid level rise, and the related devices also have the same situation. Simple operating status analysis cannot effectively determine the first device to experience the abnormal situation, and the fault point that causes the abnormality of the device may not be the failure of the device itself, but the failure caused by the leakage of the valve connected to it. The above patents cannot display effective information on the operating status, but instead slow down the maintenance efficiency of the staff.

[0007] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the applicant studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the invention

[0008] The existing virtual maintenance system displays various safety indicators of the equipment on the display screen simultaneously for the staff to view in the virtual scene, but it ignores the staff's own functions and work experience, resulting in the lack of intuitiveness of the relevant safety indicators displayed in the virtual scene, and it is difficult for the staff to judge the equipment safety information. This unrestricted display will also take up a lot of virtual computing resources, while affecting the staff's observation field of view. Some key data or images are easily covered by multiple data, making it difficult for the staff to quickly find the fault point.

[0009] In view of the shortcomings of the prior art, the present invention provides a factory equipment safety index display system, including a perception module and a processing module in a digital twin factory. The perception module is used to collect equipment data of equipment in the digital twin factory and send it to the processing module. The system also includes a three-dimensional display module. The processing module evaluates the equipment safety index related to the equipment based on the equipment data and sends the equipment safety index to the three-dimensional display module. In a three-dimensional scene, the three-dimensional display module displays the equipment safety index in the form of a digital sign. The present invention is for a factory that has completed a digital twin and intuitively displays the factory equipment safety index in an immersive scene. It can reflect the operating status of each equipment in the factory in real time in the form of a digital sign according to the needs of the staff, which helps the staff to find fault points in time and make decisions, reduce the occurrence of safety accidents, and improve the factory's production efficiency.

[0010] In order to display the fault of the equipment operation status, the existing technology attempts to display the real-time status of the equipment by combining the equipment's operation data to build an associated digital twin model of the equipment. For example, CN115730114A discloses a device data visualization method based on digital twins. The technical solution first obtains the modeling data of the equipment, establishes the corresponding equipment model, and then obtains the attribute data of the equipment and adds it to the equipment model to build a digital twin model of the equipment; based on business needs, the operation data of the equipment is collected through IOT sensors, and the operation data of the equipment is processed and analyzed to obtain the operation status of the equipment. Then, the digital twin model of the equipment is combined to display the attribute data and operation status of the equipment in real time, and the attribute data of the equipment can be displayed in a visual pop-up window. The visualization information in this technical solution can only be displayed on the equipment model construction terminal, and it is impossible to use a virtualized simulation terminal to perform a visual real-time display when an abnormality occurs in the operation safety status of a specific device.

[0011] According to a preferred embodiment, the system also includes a simulation module capable of projecting a digital signboard in the field of vision of the staff. The three-dimensional display module projects the equipment safety index related to the equipment in the form of a digital signboard in the field of vision observed by the staff through the simulation module to display the equipment safety index. The three-dimensional display module projects the equipment safety index and the equipment safety index directly in the field of vision of the staff in the form of a digital signboard (which can be a list of various parameters and a virtual operation image of various types of equipment) and suspends them in the real factory environment. When the staff arrives at the fault point, the operation status of the equipment is indicated by an intuitive digital display process. This embodiment of the present invention constitutes a distinguishing technical feature from the above-mentioned existing patent CN115730114A. It can be seen that the embodiment is to solve the technical problem that the data accumulation caused by the centralized equipment status visualization display model leads to the inability of the staff to accurately grasp the specific operation status of the equipment. Specifically, the simulation module of the present invention can be a distributed display terminal that can move with the staff. On the one hand, since the simulation module only needs to display the equipment safety index information of the equipment that the staff currently needs to process, the information processing amount of the simulation module is significantly reduced. On the other hand, the three-dimensional display module projects the equipment safety index related to the equipment in the form of a digital sign into the field of view observed by the staff through the simulation module to display the equipment safety index. The simulation module can adjust the equipment safety index associated with the equipment information according to the specific equipment information in the real factory environment, so that the equipment safety index can be updated in real time as the staff's field of view changes, thereby achieving the effect of continuous inspection of equipment in the real factory environment, thereby significantly improving the efficiency of equipment safety status inspection.

[0012] According to a preferred embodiment, the processing module detects the equipment safety index of the equipment based on the category of the faulty equipment, the speed of change of the equipment safety index and / or the change value of the equipment safety index. The equipment safety index of the present invention can reflect the possible fault points of the equipment failure to a certain extent, and provide data support for the subsequent troubleshooting work of the staff. The evaluation of the operating status of the equipment in the prior art mainly relies on the online prediction of the measured data, so as to realize the evaluation of the operating status of the equipment. For example, CN114662770A discloses a state monitoring and health assessment method and system based on a boiler digital twin model, which first obtains the measured data of the boiler equipment of the thermal power unit to be monitored and health assessed, and based on the measured data and the predicted data, uses the cubature Kalman filter to perform data assimilation to obtain the estimation result, and finally realizes the state monitoring and health assessment of the boiler equipment of the thermal power unit based on the estimation result. This technical solution mainly realizes the overall evaluation of the overall operating status of the equipment. Compared with the above-mentioned prior art, the processing module of the present invention can detect the fault occurrence point in the overall equipment. That is, the technical problem to be solved by the above-mentioned distinguishing technical features of the present invention is how to realize the accurate troubleshooting and positioning of the equipment fault point. The processing module of the present invention detects the equipment safety index of the equipment based on the type of faulty equipment, the speed of change of the equipment safety index and / or the change value of the equipment safety index, thereby associating the degree of change of the equipment safety index with a specific equipment, so that the staff can troubleshoot the fault points where the equipment safety index has changed significantly according to the equipment type, without having to check each possible fault point of the equipment one by one, which significantly improves the efficiency of equipment fault troubleshooting and positioning.

[0013] According to a preferred embodiment, the corresponding functions of the staff are recorded in the simulation module. When the processing module calculates the equipment safety index of the equipment, the three-dimensional display module is connected to the simulation module to obtain the corresponding functions of the staff. Preferably, the three-dimensional display module provides a display of personalized digital signs based on the functions of the staff to facilitate the staff to judge the fault point. For some large industrial equipment, the troubleshooting work after a fault occurs is quite complicated. For example, the shutdown of the equipment may be caused by different factors such as mechanical failure or electrical failure, so staff with different functions are required to troubleshoot the equipment. The equipment parameters that staff with different functions are concerned about are also different. If all the current equipment information is displayed at the same time, the staff needs to screen the current equipment information to obtain effective information that can be used for troubleshooting, which significantly increases the difficulty of equipment information processing for the staff, thereby reducing the efficiency of equipment troubleshooting. Different from the technical problem of how to achieve the overall operating status evaluation of a single device in the above-mentioned prior art, the technical problem to be solved by the above-mentioned embodiment of the present invention is how to improve the equipment troubleshooting efficiency of staff with different functions. The present invention selectively displays digital signage, and the display of digital signage has different priority display levels according to the fault type and the function of the staff, so as to effectively help the staff to find the fault point after the production accident occurs. The present invention is not limited to providing relevant operating parameters of large-scale industrial equipment, but can also provide operating parameters of its supporting facilities (such as connecting pipelines and valve components), so that the staff can locate the fault point in the virtual space and improve the efficiency of fault detection.

[0014] According to a preferred embodiment, the three-dimensional display module determines the type of equipment failure based on the equipment safety index calculated by the processing module, and selectively displays the digital signage based on the correlation between the equipment failure type and the staff's function. In the case where the processing module of the present invention calculates the equipment safety index of the equipment, the three-dimensional display module is connected to the simulation module to obtain the corresponding function of the staff. The three-dimensional display module selectively displays the digital signage based on the corresponding function of the staff, so that the displayed digital signage meets the actual needs of the staff, and the relevant safety indicators displayed in the virtual scene are intuitive, and the staff can quickly judge the equipment safety information.

[0015] According to a preferred embodiment, in response to a request for a specified range related to a restriction sent by the simulation module, the three-dimensional display module displays the equipment within the specified range in the form of a digital sign, so that the display of the digital sign within the specified range is better than the display of the object in the virtual scene. As in the technical solution of the above-mentioned existing patent CN115730114A, the existing virtual maintenance system synchronously displays the various safety indicators of the equipment on the display screen for the staff to view in the virtual scene, thereby realizing the overall visualization of the overall operating status of the equipment, which is beneficial for the display terminal in the central control room. However, for the staff who need to perform actual troubleshooting in a real factory environment, most of the above-mentioned display content is useless information, and it ignores the staff's own functions and work experience, resulting in the lack of intuitiveness of the relevant safety indicators displayed in the virtual scene, and it is difficult for the staff to judge the equipment safety information. The above-mentioned unrestricted visualization display technical solution not only requires a large amount of virtual computing resources, but also affects the staff's observation field of view. Some key data or images are easily covered by multiple data, resulting in the staff being unable to quickly find the fault point. For example, displaying a large number of parameters of equipment and supporting facilities on the same screen or in the same field of view will bury the data at the fault point, which is not conducive to the troubleshooting of the staff. The technical problem to be solved by the above-mentioned embodiments of the present invention is how to establish restriction conditions that meet the working characteristics of the staff so that the staff can understand the equipment safety information more intuitively and easily. The present invention obtains the real scene currently observed by the staff according to the simulation module, and realizes the combination of virtual scene and real scene by projecting the relevant information of each device in the real scene into the field of view of the staff, so that the staff can obtain the relevant information of the equipment in real time and effectively, thereby improving the work efficiency of the staff.

[0016] According to a preferred embodiment, the three-dimensional display module monitors the way in which the staff delimits the range in the field of vision after superimposing the virtual scene with gestures through the simulation module, and determines the request for the specified range related to the restriction condition. It can be seen from the above-mentioned embodiment different from the prior art that the technical problem to be solved by the present invention is how to reduce the data processing load of the three-dimensional display module while realizing effective device information display. If the real-time parameters of each device in the factory are synchronously displayed in the virtual space, whether it is the three-dimensional display module or the simulation module, the data processing amount required by the server is large, the data transmission amount of the three-dimensional display module is also large, and it is difficult for the staff to observe the required key parameters among the many displayed parameters. Especially when a production accident occurs in the factory, the staff needs to quickly determine the fault point of the equipment. At this time, the staff needs to perform a large number of inspections on the relevant components of the equipment, and the three-dimensional display module and the simulation module will also perform a large amount of data processing. Therefore, if the real-time parameters of each device are synchronously displayed according to the technical means of the prior art, the efficiency of the safety index detection in the virtual space is reduced. The present invention reduces the number of device safety indexes required to be displayed by the digital signage by accurately displaying the digital signage within the specified range, thereby reducing the data transmission amount of the three-dimensional display module and avoiding the delay of the display of each digital signage in the virtual scene. The present invention displays the devices within the specified range with high precision, so that the important information of the devices within the specified range can be displayed after one transmission process of the data, thereby reducing the sending of invalid data.

[0017] According to a preferred embodiment, the three-dimensional display module controls the digital signage to display the device safety index of the equipment within the specified range in a manner that displays additional information. The present invention displays the equipment and digital signage within the specified range in high definition in a virtual scene, and displays the equipment and digital signage outside the specified range in a virtualized manner, and the digital signage displays additional information, so that the required additional information can be displayed according to the needs of the staff and the actual operation of the equipment, thereby improving the troubleshooting efficiency of the staff.

[0018] The present invention also relates to a method for displaying a factory equipment safety index, the method comprising: collecting equipment data of equipment in a digital twin factory; evaluating the equipment safety index related to the equipment based on the equipment data; and displaying the equipment safety index in a three-dimensional scene in the form of a digital signboard. The present invention displays the relevant parameters of the equipment in the form of a digital signboard based on the equipment safety index in a three-dimensional scene, so that the display of the digital signboard has restrictive conditions. The present invention displays the safety indicators of the equipment through a digital signboard with restrictive conditions, thereby providing the staff with a more intuitive and easy-to-understand equipment safety index.

[0019] According to a preferred embodiment, the method further includes: projecting the equipment safety index related to the equipment in the form of a digital sign in the field of vision observed by the staff through the simulation module to display the equipment safety index. The present invention designs a display system for the equipment safety index in a virtual scene, simulates the real-time acquired equipment safety index with the display scene of the factory, and provides clear, accurate and real-time equipment safety index information in a virtual and real way. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a simplified topological diagram of a factory equipment safety index display system according to a preferred embodiment of the present invention;

[0021] Figure 2 It is a simplified module connection relationship diagram of a factory equipment safety index display system according to a preferred embodiment of the present invention.

[0022] Reference numerals list

[0023] 1: Perception module; 2: Processing module; 3: Three-dimensional display module; 4: Simulation module; 5: Digital signage. DETAILED DESCRIPTION

[0024] The following is a detailed description with reference to the accompanying drawings.

[0025] First, the technical terms in the present invention are explained.

[0026] Digital twin factory: A digital twin factory is an industrial application that uses sensors, three-dimensional technology, and data collection and monitoring systems to move the factory into a virtual space to achieve resource allocation and intelligent production. The digital twin factory can restore the real production scene of the factory 1:1. It restores the factory equipment through three-dimensional technology and accesses various data of the factory to truly reflect the production actions in the factory. The factory that has completed the digital twin is equipped with complex and diverse connected device sensors and PLC programmable logic controllers, which can obtain management data generated by the internal control links of the factory and data generated by IoT sensors such as thermometers and hygrometers and robotic arms, thereby improving the collaborative execution of the factory.

[0027] Three-dimensional virtual scene: A virtual factory constructed by three-dimensional technology, which includes the mapping of factory equipment or other real objects in the three-dimensional virtual scene, and the mapping method also includes the physical, spatial relationships and production attributes of factory equipment or other real objects.

[0028] Perception module 1: includes various sensors connected to equipment in real factories, such as sensors that can obtain management data generated by the internal control links of the factory, and IoT sensors such as thermometers and hygrometers, robotic arms, etc. Perception module 1 can obtain the operating parameters and safety indicators of the equipment in real time.

[0029] Processing module 2: a dedicated integrated chip, CPU, server, etc. capable of running a factory equipment safety index display system of the present invention.

[0030] Equipment safety indicators: operating parameters of each equipment in the digital twin factory.

[0031] Equipment safety index: A quantitative value of the degree of danger or failure of the corresponding equipment calculated based on the operating parameters of each equipment in the digital twin factory.

[0032] Simulation module 4: smart devices carried by staff, such as smart glasses (AR glasses or virtual 3D glasses, etc.), smart watches, etc. In the present invention, it particularly refers to AR glasses or virtual 3D glasses that can superimpose virtual digital signage 5 with real scenes and display them in the staff's field of vision. Specifically, in the present invention, the simulation module 4 can be AR glasses or VR head-mounted display devices or MR head-mounted display devices. VR head-mounted display devices or MR head-mounted display devices can be integrated in a protective helmet to protect the head of the staff. For example, the Vision Pro head-mounted display device. The above-mentioned protective helmet can be a safety helmet that protects the top of the head. The above-mentioned protective helmet can also be a full helmet style (Formula racing helmet) or a three-quarter or even half helmet style (rally racing helmet). The simulation module 4 can be integrated into the goggles of the protective helmet to provide protection and virtual guidance. The staff wears the simulation module 4 to enter the real factory where the fault occurs. The present invention facilitates the staff to troubleshoot by superimposing the information of the three-dimensional virtual scene in the real factory scene. The three-dimensional display module 3 superimposes the information of the faulty equipment in the form of a digital sign 5 on the real factory scene observed by the staff, and integrates the virtual digital sign 5 with the real-world scene, thereby assisting the staff in troubleshooting.

[0033] Digital signage 5: Display information related to equipment operating parameters In the present invention, the digital signage 5 can provide the staff with various equipment operating parameters by displaying them in a three-dimensional virtual scene.

[0034] Restriction conditions: the relevant restriction conditions displayed by the digital signage 5. In the present invention, the restriction conditions of the digital signage 5 include the range artificially defined by the staff, the functions or needs of the staff, and the safety index of the device. Example 1

[0035] Existing factories need to run multiple large-scale industrial equipment at the same time, among which the mobile staff and the complex workshop working environment make safety accidents in the factory frequent. In the prior art, the factory management system mostly relies on fixed inspection personnel, inspection standards and specifications, and the knowledge and experience of technical personnel to manage the relevant risks of equipment. However, it takes a lot of time for the inspection personnel to dynamically collect various parameters of the equipment in the real factory environment. Even if the factory that has completed the digital twin performs data collection, it lacks data fusion analysis and the display of the actual situation. At present, the prior art lacks an intelligent early warning model for data prediction based on real-time data of the equipment, lacks a knowledge base related to equipment failure, and at the same time, because the existing digital twin factory is a complex system composed of many elements, under the influence of the interactive coupling of the above-mentioned multiple risk factors, it leads to the difficulty of the prior art to realize the management of the production status in the factory through intelligence. In this regard, the present invention provides a new idea for solving the management of production status in the factory based on digital twin technology. How to visualize the safety index of the equipment in the factory that has completed the digital twin in real time, how to selectively map the operation of the equipment and its components in the virtual space to perform interactive feedback between the virtual model and the physical entity are technical problems that the prior art urgently needs to solve.

[0036] In response to the above problems, the present invention uses digital means to construct an entity corresponding to a real factory in a virtual space to simulate the production status of the factory in a real environment and dynamically display the changes in the equipment safety index. The staff can enter the virtual space through the simulation module 4 to observe the operating status of the factory production equipment, so as to conduct a more comprehensive analysis of the situation that is difficult for the intelligent model to judge. The present invention provides a more real-time and efficient safety index display for the physical entity of the real equipment through technical means such as virtual-real interactive feedback and digital signage 5 display.

[0037] Moreover, due to the complex interactive relationship between the equipment in the factory, that is, large industrial equipment is often connected to several pipelines and corresponding valve components. The failure or safety accident of the large industrial equipment may not be caused by the equipment itself. The more likely cause of the failure is the looseness of the pipeline or the excessive pressure of the valve component. In the existing digital twin factory, only large equipment displays equipment parameters, resulting in the lack of comprehensiveness of the equipment safety index displayed when the staff enters the virtual space through the virtual device, and the lack of selectivity in the display method of the equipment parameters. The parameters displayed by each device are too many at the same time or lack important equipment operation parameters. For example, if the real-time parameters of each device in the factory are displayed synchronously in the virtual space, the data processing required by the server is large, the transmission volume of the data required to be displayed is large, and it is difficult for the staff to observe the required key parameters among the many displayed parameters. Especially when a production accident occurs in the factory, the staff needs to quickly determine the fault point of the equipment. The method of synchronously displaying the real-time parameters of each device reduces the efficiency of safety index detection in the virtual space. If the real-time parameters of each device in the factory are displayed only after the staff interacts or triggers, the displayed parameters may not be the fault point in the production accident. When the fault point is a valve or other micro-component, traditional digital means are difficult to effectively select and display the corresponding fault parameters, resulting in staff misjudgment of the fault point.

[0038] The purpose of the present invention is to provide an intuitive display of the factory equipment safety index in an immersive scenario for a factory that has completed digital twinning. It can reflect the operating status of each device in the factory in real time in the form of a digital sign 5 according to the needs of the staff, which helps the staff to find fault points in time and make decisions, reduce the occurrence of safety accidents, and improve factory production efficiency.

[0039] like Figure 2 As shown, this embodiment provides a factory equipment safety index display system, including a perception module 1, a processing module 2 and a three-dimensional display module 3. The perception module 1 detects the equipment in the factory and transmits the detected equipment data to the processing module 2. The processing module 2 processes and analyzes the detected equipment data. After completing the processing and analysis, the processing module 2 sends the results of the processing and analysis to the three-dimensional display module 3. The three-dimensional display module 3 combines the equipment data with the entities in the virtual scene in response to the processing and analysis results of the processing module 2. The processing module 2 establishes communication connections with the three-dimensional display module 3 and at least one perception module 1 respectively. The communication connection method can be WiFi, radio, etc. The processing module 2 can be connected to more than two perception modules 1 at the same time. The above-mentioned equipment data can be safety indicators of equipment after a production accident occurs in the scene, including temperature, pressure, liquid level or radiation value, etc.

[0040] The factory equipment safety index display system of this embodiment can be used for virtual troubleshooting after a production accident in the factory. For example, in the event of a leak of hazardous materials inside the factory, staff are required to quickly detect the fault point in the factory. There are often large-scale industrial equipment and various types of pipelines, valve components, etc. inside the factory. The fault point of a large-scale industrial equipment failure may be concentrated on its supporting facilities. In the existing virtual scene, it is difficult to selectively display the status values ​​of the relevant supporting facilities where the fault point may exist, resulting in the inability of staff to quickly troubleshoot the fault point. In this regard, the present invention selectively displays a digital sign 5, and the display of the digital sign 5 has different priority display levels according to the type of fault and the function of the staff, thereby effectively helping the staff to troubleshoot the fault point after the production accident occurs. The present invention is not limited to providing the relevant operating parameters of large-scale industrial equipment, but can also provide the operating parameters of its supporting facilities (such as connecting pipelines and valve components), so that the staff can locate the fault point in the virtual space and improve the efficiency of troubleshooting.

[0041] According to a preferred embodiment, the three-dimensional display module 3 establishes a connection relationship with several digital signboards 5 and controls the change of their display content. The processing module 2 calculates the equipment safety index corresponding to the equipment based on the equipment data sent by the perception module 1. The three-dimensional display module 3 receives the equipment safety index calculated by the processing module 2 to selectively display the digital signboard 5. The processing module 2 is provided with a three-dimensional database corresponding to the two-dimensional map layout of the factory. When the perception module 1 sends the equipment data to the processing module 2, the processing module 2 determines the equipment safety index of several equipment in the factory and sends the several equipment safety indexes to the three-dimensional display module 3.

[0042] Preferably, the processing module 2 detects the equipment safety index of the device based on the type of the faulty device, the speed of change of the equipment safety index and / or the change value of the equipment safety index.

[0043] Preferably, a safety index strategy is preset in the processing module 2. The safety index strategy establishes an association relationship between the equipment safety index change amount, the equipment safety index value and the equipment safety index of the equipment. The processing module 2 confirms the equipment safety index of the current equipment based on the association relationship between the equipment safety index change amount, the equipment safety index value and the equipment safety index. When the equipment safety index of the equipment is reduced to a safety threshold, the processing module 2 sends a safety warning message to the three-dimensional display module 3, so that the three-dimensional display module 3 controls the digital signage 5 corresponding to the equipment in the virtual scene to display the core fault information and key index changes of the equipment.

[0044] Preferably, the staff can carry the simulation module 4. The staff can enter the virtual scene or project the virtual scene into the real scene through the simulation module 4. The corresponding functions of the staff are recorded in the simulation module 4. When the processing module 2 calculates the equipment safety index of the equipment, the three-dimensional display module 3 is connected to the simulation module 4 to obtain the corresponding functions of the staff. The three-dimensional display module 3 selectively displays the digital signage 5 based on the corresponding functions of the staff. Preferably, the three-dimensional display module 3 provides a display of personalized digital signage 5 based on the functions of the staff to facilitate the staff to judge the fault point.

[0045] In the real maintenance process, it is often necessary for several staff members with different functions to check the faulty equipment separately in order to determine the location of the fault point. However, due to the different functions of each staff member, the data monitored and obtained during the troubleshooting process may be invalid data for a certain staff member. For example, it is difficult for mechanical maintenance staff to judge the changes in the electrical parameters of the equipment, while it is difficult for electrical maintenance staff to judge the changes such as pipeline breakage and valve leakage of the equipment. The existing virtual maintenance system displays various safety indicators of the equipment on the display screen simultaneously for the staff to view in the virtual scene, but it ignores the staff's own functions and work experience, resulting in the lack of intuitiveness of the relevant safety indicators displayed in the virtual scene, and it is difficult for the staff to judge the equipment safety information. This unrestricted display will also take up a lot of virtual computing resources, and at the same time affect the staff's observation field of view. Some key data or images are easily covered by multiple data, resulting in the staff being unable to quickly find the fault point. Displaying a large number of parameters of equipment and supporting facilities on the same screen or in the same field of view will bury the data at the fault point, which is not conducive to the staff's troubleshooting. Therefore, how to select the display information of the digital signboard 5 and how to establish restriction conditions that meet the working characteristics of the staff so that the staff can understand the equipment safety information more intuitively and easily are technical problems to be solved by the present invention.

[0046] Specifically, in one embodiment, the functions of the staff can include electrical maintenance, mechanical maintenance, and special equipment maintenance. The three-dimensional display module 3 displays the safety indicators of the corresponding equipment operation based on the functions of the staff. For example, when the function of the staff is electrical maintenance, the three-dimensional display module 3 will give priority to displaying the safety indicators of the circuits, cables, and transformers corresponding to the faulty equipment, so that the staff can quickly determine the fault point. When the function of the staff is mechanical maintenance, the three-dimensional display module 3 will give priority to displaying the supporting pipes, valves, bearings, welding machines, and wind coal of the faulty equipment, so that the staff can understand the safety indicators of its supporting facilities. When the function of the staff is special equipment maintenance, the three-dimensional display module 3 will give priority to displaying the self-safety indicators of the faulty equipment. The self-safety indicators include the temperature, pressure, and internal liquid level of the equipment.

[0047] In another embodiment, the three-dimensional display module 3 determines the type of equipment failure according to the equipment safety index calculated by the processing module 2, and selectively displays the digital sign 5 based on the correlation between the type of equipment failure and the function of the staff. In the case where there is a strong correlation between the type of equipment failure and the function of the staff, the three-dimensional display module 3 displays the digital sign 5 in priority to the display of other objects in the virtual scene. The above-mentioned strong correlation means that the type of equipment failure is consistent with the maintenance function of the staff or the staff has a historical record of similar maintenance situations. Therefore, the three-dimensional display module 3 provides auxiliary data to the staff in a way that the digital sign 5 is preferentially displayed in the field of vision of the staff.

[0048] like Figure 1 As shown, for example, the staff wears an AR glasses-type simulation module 4. The three-dimensional display module 3 superimposes various information in the form of a digital sign 5 through the simulation module 4 in the real factory scene observed by the staff. The three-dimensional display module 3 uses image recognition, spatial modeling, and positioning of the simulation module 4 and determines the direction of the staff's field of vision. When the staff observes a certain device, the device safety indicators and equipment safety index of the device are displayed synchronously to display the operating status of the device. The three-dimensional display module 3 projects the equipment safety indicators and equipment safety index directly into the staff's field of vision in the form of a digital sign 5 (which can be a list of various parameters and a virtual operating image of various types of equipment), and suspends them in a real factory environment. When the staff arrives at the fault point, the operating status of the equipment is indicated by an intuitive digital display process.

[0049] The existing 3D virtual environment is limited to the display of the display screen, which cannot better realize the production status management operation in the factory. In addition, due to the large amount of production data generated by the digital twin factory, the production status of each device in the factory cannot be effectively displayed during the interaction between the real factory and the 3D virtual environment. The staff needs to frequently observe the display screen or various sensor devices to obtain the relevant parameters of the faulty equipment, which delays the time for the staff to successfully determine the fault point, resulting in low efficiency in troubleshooting.

[0050] Preferably, when the equipment safety index of the device is high, the three-dimensional display module 3 is displayed only in the form of a symbolic image of the device or in the form of a dynamic image of the device's operating status. When the equipment safety index of the device is medium, the three-dimensional display module 3 is displayed in the form of a symbolic image of the device or a dynamic image of the device's operating status, and additionally with relevant equipment safety indicators. When the equipment safety index of the device is low, the three-dimensional display module 3 is displayed in the form of a symbolic image of the device or a dynamic image of the device's operating status, and additionally with relevant equipment safety indicators and a flashing effect. The three-dimensional display module 3 can also open the permission to view the monitoring screen around the device based on the staff's request.

[0051] The present invention directly displays the operating status of the equipment through the combination of virtual images and digital signage 5, thereby facilitating the staff to quickly troubleshoot the fault point. The virtual image is directly superimposed on the staff's real field of view to improve the efficiency of troubleshooting. The staff can directly obtain the operating parameters related to the equipment through the simulation module 4, without having to observe the various monitoring components of the equipment or the sensors that display its operating parameters. The present invention obtains the real scene currently observed by the staff according to the simulation module 4, and realizes the combination of the virtual scene and the real scene by projecting the relevant information of each device in the real scene into the staff's field of view, so that the staff can obtain the relevant information of the equipment in real time and effectively, thereby improving the work efficiency of the staff.

[0052] Preferably, the three-dimensional display module 3 displays the device safety index in the form of a digital sign 5 according to the restriction conditions. The three-dimensional display module 3 determines the restriction conditions of the device safety index sent by the processing module 2 and forms a digital sign 5 in the virtual scene.

[0053] In the prior art, for displaying images in a virtual scene, it is generally necessary to first send a non-clear virtual image, and then send the entire high-definition virtual image in response to a request from a terminal. The disadvantage of the above method is that a terminal may only need a local high-definition virtual image, but it is difficult for a terminal to select or judge the local range it needs, resulting in the need for the entire image to be clear during the request process, thereby increasing the transmission of invalid data and causing a large delay between the virtual scene and the real scene.

[0054] Preferably, in response to the request for the specified range related to the restriction condition sent by the simulation module 4, the three-dimensional display module 3 displays the devices within the specified range in the form of a digital sign 5, so that the display of the digital sign 5 within the specified range is superior to the display of other objects in the virtual scene. Preferably, in response to the request for the specified range sent by the simulation module 4, the three-dimensional display module 3 displays the devices and digital sign 5 within the specified range in high definition in the virtual scene, and displays the devices and digital sign 5 outside the specified range in a virtual manner. Preferably, the three-dimensional display module 3 controls the digital sign 5 to display the relevant information of the devices within the specified range in a manner with additional information. The above-mentioned additional information can be the safety index of the equipment with different dangers displayed by different colors, contrasts or brightness. The three-dimensional display module 3 prompts the safety index of the equipment with high danger by controlling the digital sign 5 to flash. The three-dimensional display module 3 also performs high-precision equipment monitoring by opening the monitoring screen around the equipment within the specified range for viewing. The present invention reduces the number of device safety indexes that need to be displayed on the digital signage 5 by accurately displaying the devices within the specified range, thereby reducing the data transmission volume of the three-dimensional display module 3 and avoiding the delay of the display of each digital signage 5 in the virtual scene. The present invention displays the devices within the specified range with high precision, so that the data can display the important information of the devices within the specified range after one transmission process, thereby reducing the transmission of invalid data.

[0055] Preferably, the above-mentioned designated range can be sent by the staff through the simulation module 4. The staff can define the designated range in the field of view after superimposing the virtual scene by circling in the real scene. For example, the staff obtains the field of view of the superimposed real scene and virtual scene through the simulation module 4, and the staff circle a range in his field of view through gestures to specify the high-precision range. The three-dimensional display module 3 determines the designated range requested by the staff based on the gestures of the staff, and displays the equipment safety index of the equipment within the designated range in the form of a digital sign 5.

[0056] Throughout the text, the features referred to as “preferably” are merely optional and should not be understood as having to be set. Therefore, the applicant reserves the right to abandon or delete the relevant preferred features at any time.

[0057] It should be noted that the above-mentioned specific embodiments are exemplary, and those skilled in the art can come up with various solutions inspired by the disclosure of the present invention, and these solutions also belong to the disclosure scope of the present invention and fall within the protection scope of the present invention. Those skilled in the art should understand that the present invention specification and its drawings are illustrative and do not constitute a limitation on the claims. The scope of protection of the present invention is defined by the claims and their equivalents. The present invention specification contains multiple inventive concepts, such as "preferably", "according to a preferred embodiment" or "optionally", which means that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application based on each inventive concept.

Claims

1. A factory equipment safety index display system, comprising a perception module (1) and a processing module (2) in a digital twin factory, wherein the perception module (1) is used to collect equipment data of equipment in the digital twin factory and send it to the processing module (2), characterized in that: The system further comprises a three-dimensional display module (3), wherein the processing module (2) establishes communication connections with the three-dimensional display module (3) and at least one of the perception modules (1), respectively; the processing module (2) evaluates a device safety index related to the device based on the device data and sends the device safety index to the three-dimensional display module (3); and the three-dimensional display module (3) combines the device data with entities in the virtual scene in response to the processing and analysis results of the processing module (2). In a three-dimensional scene, the three-dimensional display module (3) projects the equipment safety index in the form of a digital signboard (5) in the field of vision observed by the staff through the simulation module (4) that can move with it and suspends it in the real factory environment to display the equipment safety index, wherein the digital signboard is in the form of a list of various parameters and virtual operation images of various types of equipment.

2. The factory equipment safety index display system according to claim 1 is characterized in that: The processing module (2) detects the equipment safety index of the equipment based on the type of the faulty equipment, the speed of change of the equipment safety index and / or the value of change of the equipment safety index.

3. The factory equipment safety index display system according to claim 1 is characterized in that: The simulation module (4) records the corresponding functions of the staff. When the processing module (2) calculates the equipment safety index of the equipment, the three-dimensional display module (3) is connected to the simulation module (4) to obtain the corresponding functions of the staff, wherein: The three-dimensional display module (3) provides a display of a personalized digital sign (5) based on the staff's functions to facilitate the staff in making fault point judgments.

4. The factory equipment safety index display system according to claim 1 is characterized in that: The three-dimensional display module (3) determines the type of equipment failure based on the equipment safety index calculated by the processing module (2), and selectively displays the digital signage (5) based on the correlation between the type of equipment failure and the function of the staff.

5. The factory equipment safety index display system according to claim 1 is characterized in that: In response to a request for a specified range related to a restriction condition of the digital signage (5) sent by the simulation module (4), the three-dimensional display module (3) displays the devices within the specified range in the form of the digital signage (5), so that the display of the digital signage (5) within the specified range is superior to the display of objects in the virtual scene.

6. The factory equipment safety index display system according to claim 5 is characterized in that: The three-dimensional display module (3) monitors, through the simulation module (4), the way in which the staff uses gestures to define a range in the field of vision after superimposing the virtual scene, and determines a request for a designated range related to the restriction condition.

7. The factory equipment safety index display system according to claim 6 is characterized in that: The three-dimensional display module (3) controls the digital signage (5) to display the device safety index of the device within the specified range in a manner that displays additional information.

8. A method for displaying a factory equipment safety index, characterized in that: The method comprises: Collect equipment data from equipment in the digital twin factory; evaluating a device safety index associated with the device based on the device data; In a three-dimensional scene, the equipment safety index is projected in the form of a digital sign (5) in the field of vision observed by the staff through a simulation module (4) that can move with it and is suspended in a real factory environment to display the equipment safety index, wherein the digital sign is in the form of a list of various parameters and a virtual operating image of various types of equipment.

Images