Virtual-real fusion safety management and control early warning method and system for high-voltage test site

Abstract

The invention relates to a high-voltage test site-oriented virtual-real fusion safety control early warning method and system, and the method comprises the steps: importing new point cloud map data, a three-dimensional scene model or an existing mixed reality scheme scene, and forming a virtual-real fusion scene; according to the method, multi-dimensional resources are added in a virtual-real fusion scene through a drag-and-drop method, the multi-dimensional resources are adsorbed and arranged by setting comprehensive anchor points, and the names and numbers of the comprehensive anchor points are matched by setting an automatic script manager so as to configure the multi-dimensional resources; a security auxiliary algorithm is configured to perform security control early warning on the virtual-real fusion scene, and parameters of the security auxiliary algorithm are set; the edited data file is synchronized to an on-site MR device through a server for safety management and control early warning; and after safety management and control early warning is completed, a virtual-real fusion scene is eliminated. Compared with the prior art, the virtual-real fusion security management and control early warning scheme can be easily and quickly configured, and the personnel requirement and the technical requirement are reduced.

Description

Technical Field

[0001] This invention relates to the field of intelligent power safety management and control technology, and in particular to a virtual-real integrated safety management and early warning method and system for high-voltage test sites. Background Technology

[0002] In high-voltage testing, safety is always the primary consideration. Safety management plans need to be developed for high-voltage testing sites. Mixed reality technology can achieve a seamless integration of these plans with the real-world equipment, better assisting on-site personnel in ensuring safety. However, traditional mixed reality scene development relies on specialized software and collaborative development among technical professionals, resulting in high costs and long development times. Therefore, there is a need to develop innovative mixed reality scene development software that is low-tech and easy to use.

[0003] For example, the invention with publication number CN119515638A discloses a construction safety early warning method and system based on mixed reality. It converts the longitude and latitude of geographic coordinate system data into planar coordinates, and then converts the planar coordinates into a local coordinate system of a spatial mapping grid formed by simultaneous positioning and mapping technologies. Through coordinate transformation, geographic coordinate system data can be accurately mapped to the model spatial coordinate system of the mixed reality device, breaking through the limitation of traditional mixed reality technology in integrating external high-precision positioning data and achieving high-precision device positioning. At the same time, an initial weight value is assigned to each grid cell in the spatial mapping grid, and the weight is dynamically adjusted to change the grid size, realizing dynamic management of spatial mapping grid data. After initial alignment using the spatial mapping capability of the mixed reality device, detailed real spatial mapping grid data is retained, providing a data foundation for subsequent dynamic collision detection.

[0004] The above solution is divided into design, debugging, and application stages, all of which require packaging and transmission of the adaptation and debugging process for specific MR devices.

[0005] Therefore, existing professional mixed reality scene production software still has significant shortcomings, specifically in the following aspects:

[0006] (1) It cannot simultaneously support scene switching across multiple software platforms: Windows MR glasses, Android MR glasses and iPad are commonly used MR devices, but packaging an app adapted for iPad requires a dedicated iOS environment, which is very inconvenient.

[0007] (2) Professional development software needs to be packaged frequently during the solution debugging process: Taking Unity software as an example, after modifying the mixed reality solution, the entire project file needs to be repackaged for testing. During the testing process, it needs to be packaged frequently, and various bugs will be encountered during the packaging process, resulting in packaging failure. In addition, the installation package is large. At the same time, if the network signal at the test site is poor, the installation time is long.

[0008] (3) High production cost: Existing professional mixed reality scene production software requires dedicated personnel for development and maintenance, which is too high for small and numerous mixed reality scene development projects. Summary of the Invention

[0009] The purpose of this invention is to overcome the shortcomings of the existing technology, such as the need for frequent packaging and high manufacturing costs, and to provide a virtual-real integrated safety management and early warning method and system for high-pressure test sites.

[0010] The objective of this invention can be achieved through the following technical solutions:

[0011] A virtual-real integrated safety management and early warning method for high-voltage test sites includes the following steps:

[0012] Importing Scene Steps: Import new point cloud map data, 3D scene models, or existing mixed reality solution scenes to create a virtual-real fusion scene;

[0013] Scene editing steps: Add multi-dimensional resources to the virtual-real fusion scene using a drag-and-drop method; snap and arrange the multi-dimensional resources by setting comprehensive anchor points; configure the multi-dimensional resources by matching the naming and numbering of the comprehensive anchor points using an automated script manager; configure a security auxiliary algorithm to perform security control and early warning for the virtual-real fusion scene, and set the parameters of the security auxiliary algorithm.

[0014] Synchronization Scene Steps: The edited virtual-real fusion scene data file is synchronized to the on-site MR equipment via the server for safety management and early warning;

[0015] Scene clearing steps: After completing the security control and early warning, clear all integrated anchor points and multi-dimensional resources in the virtual-real fusion scene.

[0016] Furthermore, the point cloud map data is generated by scanning the test site using a 3D laser scanner; the point cloud map data obtained after scanning is preprocessed and converted in format, irrelevant information is deleted, thereby extracting coordinate data and color data, and the data format is converted into ASCII encoded PLY, CSV or XYZRGB format to obtain the final point cloud map data.

[0017] Furthermore, the three-dimensional scene model is a three-dimensional model file based on the fbx format.

[0018] Furthermore, the existing mixed reality solution scenario includes a scenario file containing drag-and-drop information for multi-dimensional resources.

[0019] Furthermore, the multidimensional resources include 3D models, audio, video, images, text, and curve data.

[0020] Furthermore, the safety assistance algorithm includes an image recognition algorithm, a distance warning algorithm, and a health monitoring algorithm;

[0021] The image recognition algorithm is used to identify voltage and current values ​​in virtual-real fusion scenarios, and to configure the time interval between the MR device and the server, as well as to enable or disable image recognition. The algorithm first acquires and selects the voltage and current display area on the industrial control software interface, then identifies the voltage and current values ​​within the selected area. Finally, it compares the identified voltage value with a set maximum voltage threshold; if the voltage exceeds the maximum voltage threshold, an alarm is triggered. Similarly, it compares the identified current value with a set maximum current threshold; if the current exceeds the maximum current threshold, an alarm is triggered.

[0022] The distance warning algorithm is used to calculate the distance between the person wearing the MR device and the powered device. If the calculated distance value is less than or equal to the corresponding distance setting value, an alarm is triggered. It is also used to configure whether the distance warning is effective. The specific processing of the distance warning algorithm is as follows: when editing the mixed reality scene, the powered device or powered area is defined, and the spatial position of the MR camera is calculated in real time. With this spatial position as the center of the sphere and the set safety distance as the radius of the sphere, if the spatial coordinate point of the defined powered device or the spatial coordinate plane of the powered area collides or is tangent to the sphere where the MR camera is located, it is determined that the spatial distance between the person and the powered device or powered area has just reached the distance setting value. If the spatial position of the camera does not move or continues to move towards the powered device or powered area, the MR device will trigger an alarm.

[0023] The health monitoring algorithm is used to detect the heart rate and blood pressure of the person wearing the MR device. If the heart rate exceeds the set maximum heart rate threshold, an alarm will be triggered; if the heart rate is less than the set minimum heart rate threshold, an alarm will be triggered; if the blood pressure exceeds the set maximum blood pressure threshold, an alarm will be triggered.

[0024] Furthermore, the integrated anchor points arrange the various multi-dimensional resources in a fixed format;

[0025] The automated script manager is also used to import and parse content files with fixed content formats, and to configure and display information for integrated anchor points.

[0026] Furthermore, the data file for the virtual-real fusion scene is a JSON file, which contains the spatial location, form, content, and playback settings of multi-dimensional resources.

[0027] Furthermore, the data files of the virtual-real fusion scene are pushed to MR devices via a server. These MR devices include Windows-based MR glasses, Android-based MR glasses, and iPads.

[0028] This invention also provides a virtual-real fusion safety management and early warning system based on the above-described virtual-real fusion safety management and early warning method for high-voltage test sites, comprising:

[0029] The Import Scene module is used to import new point cloud map data, 3D scene models, or existing mixed reality solution scenes to form a virtual-real fusion scene.

[0030] The scene editing module is used to add multi-dimensional resources to the virtual-real fusion scene through drag-and-drop. It can also snap and arrange the multi-dimensional resources by setting comprehensive anchor points, and configure the multi-dimensional resources by setting an automated script manager to match the naming and numbering of the comprehensive anchor points. It can also configure a security auxiliary algorithm to perform security control and early warning for the virtual-real fusion scene, and set the parameters of the security auxiliary algorithm.

[0031] The synchronized scene module is used to synchronize the edited virtual-real fusion scene data files to the on-site MR equipment via the server for safety management and early warning.

[0032] The Scene Clearing module is used to clear all integrated anchor points and multi-dimensional resources in the virtual-real fusion scene after completing the security control and early warning.

[0033] Compared with the prior art, the present invention has the following advantages:

[0034] (1) This invention proposes to add multi-dimensional resources to the scene by dragging and dropping after importing scene data, and to arrange the spatial position of the multi-dimensional resources by comprehensive anchor points. The content information, scene preview and automatic playback settings of the multi-dimensional resources are set by an automated script manager. The safety auxiliary algorithm can be configured to set various safety parameters according to the on-site environment, and to achieve safety control and early warning of equipment voltage, current, distance between personnel and live equipment and personnel heart rate and blood pressure.

[0035] After scene editing is completed, an innovative method for pushing information data is proposed. There is no need to package point cloud data or 3D model data. Simply send the JSON file containing the spatial location, shape, content and playback settings of multi-dimensional resources in the mixed reality scene to the MR device on site through the server. It is both convenient and fast.

[0036] (2) Verified by high-pressure test scenarios, this method makes full use of the high convenience of the development function of the virtual-real integrated intelligent safety management and early warning system, reducing the professional development software to a low-threshold and convenient software system, which greatly reduces the personnel and technical requirements for the development of mixed reality solutions. Attached Figure Description

[0037] Figure 1 This is a flowchart illustrating a virtual-real fusion safety management and early warning method for high-voltage test sites provided in an embodiment of the present invention.

[0038] Figure 2 This is a schematic diagram illustrating the usage process of a virtual-real fusion safety management and early warning method for high-voltage test sites provided in this embodiment of the invention;

[0039] Figure 3 This is a schematic diagram of the system data flow direction for a virtual-real fusion safety management and early warning method for high-voltage test sites provided in an embodiment of the present invention. Detailed Implementation

[0040] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0041] Therefore, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the invention without inventive effort are within the scope of protection of the invention.

[0042] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0043] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, or the orientation or positional relationship in which the product of this invention is usually placed during use. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0044] It should be noted that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0045] Furthermore, terms such as "horizontal" and "vertical" do not imply that components must be absolutely horizontal or suspended, but rather that they can be slightly tilted. For example, "horizontal" simply means that its direction is more horizontal than "vertical," and does not mean that the structure must be completely horizontal, but can be slightly tilted.

[0046] Example 1

[0047] like Figure 1 and Figure 2 As shown, this embodiment provides a virtual-real integrated safety management and early warning method for high-voltage test sites, including the following steps:

[0048] Scene import step S1: Import new point cloud map data, 3D scene models, or existing mixed reality solution scenes to form a virtual-real fusion scene;

[0049] Scene editing step S2: Add multi-dimensional resources to the virtual-real fusion scene using drag-and-drop method; snap and arrange multi-dimensional resources by setting comprehensive anchor points; configure multi-dimensional resources by matching the naming and numbering of comprehensive anchor points using the automated script manager; configure security auxiliary algorithms for security control and early warning of the virtual-real fusion scene, and set the parameters of the security auxiliary algorithms.

[0050] Synchronization Scene Step S3: Synchronize the edited virtual-real fusion scene data file to the on-site MR equipment via the server for safety management and early warning;

[0051] Scene clearing step S4: After completing the security control and early warning, clear all integrated anchor points and multi-dimensional resources in the virtual-real fusion scene.

[0052] Preferably, in step S1, the point cloud map data is generated by scanning the test site using a 3D laser scanner; the point cloud map data obtained after scanning is preprocessed and converted in format, irrelevant information is deleted, thereby extracting coordinate data and color data, and the data format is converted to ASCII encoded PLY, CSV or XYZRGB format to obtain the final point cloud map data.

[0053] The 3D scene model is a 3D model file based on the FBX format.

[0054] Existing mixed reality scenarios include scene files, which contain drag-and-drop information for multi-dimensional resources.

[0055] Preferably, in step S2, the multidimensional resources include 3D models, audio, video, images, text, and curve data.

[0056] Safety assistance algorithms include image recognition algorithms, distance warning algorithms, and health monitoring algorithms;

[0057] Image recognition algorithms are used to identify voltage and current values ​​in virtual-real fusion scenarios, as well as to configure the time interval between the MR device and the server and to enable or disable image recognition. An alarm is triggered if the identified voltage value exceeds the set maximum voltage threshold, and if the identified current value exceeds the set maximum current threshold, an alarm is triggered.

[0058] Image recognition relies on on-site MR equipment, a server, a high-definition camera with WiFi in the control room, and an industrial control software interface. The image recognition algorithm can be set with a recognition interval, typically 1 second. The server connects to the on-site MR equipment and the high-definition camera via a wireless network. The image recognition algorithm is deployed on the server. When the industrial control software in the control room is started, the camera captures the interface of the industrial control software and transmits it to the server as video. According to the set recognition interval, the image of the industrial control software interface is extracted in frame-by-frame. The image recognition algorithm on the server first selects the voltage and current display area of ​​the industrial control software interface, then identifies the voltage and current values ​​of the selected area, and finally compares the recognition result with the set maximum voltage threshold and maximum current threshold, outputs the result, and transmits the result to the on-site MR equipment for display and alarm prompts.

[0059] The distance warning algorithm is used to calculate the distance between a person wearing an MR device and the live equipment. If the calculated distance value is less than or equal to the corresponding distance setting value, an alarm will be triggered. It is also used to configure whether the distance warning is effective.

[0060] The distance warning algorithm relies on the spatial depth calculation function of the MR device's camera module. During mixed reality scene editing, the algorithm needs to define the energized equipment or energized area. After a person wearing the MR device enters the high-voltage test site, the MR device's camera module calculates the spatial position of the MR camera in real time. Using this spatial position as the center and a set safety distance as the radius of the sphere, if the spatial coordinates of the defined energized equipment or energized area collide with or are tangent to the sphere, it is determined that the spatial distance between the person and the energized equipment or energized area has just reached the set distance value. If the camera's spatial position remains unchanged or continues to move towards the energized equipment or energized area, the MR device will issue an alarm.

[0061] The health monitoring algorithm is used to detect the heart rate and blood pressure of the person wearing the MR device. If the heart rate exceeds the set maximum heart rate threshold, an alarm will be triggered; if the heart rate is less than the set minimum heart rate threshold, an alarm will be triggered; if the blood pressure exceeds the set maximum blood pressure threshold, an alarm will be triggered.

[0062] Preferably, the anchor points are arranged in a fixed format for each multi-dimensional resource;

[0063] The automation script manager is also used to import and parse content files with fixed content formats, and to configure and display information for integrated anchor points.

[0064] Preferably, in step S3, the data file for the virtual-real fusion scene is a JSON file, which contains the spatial location, form, content, and playback settings of multi-dimensional resources.

[0065] In step S4, the data files of the virtual-real fusion scene are pushed to the MR devices via the server. The MR devices include Windows version MR glasses, Android version MR glasses, and iPad.

[0066] In this embodiment, step S1 specifically includes:

[0067] Import Scene: Select new point cloud map data or 3D scene model to import into the system, or import an existing mixed reality solution scene.

[0068] The point cloud map data of the test site was generated by scanning with a 3D laser scanner. The point cloud model had to be preprocessed and format converted to remove irrelevant information and extract coordinate and color data. The data format was then uniformly converted to ASCII encoded PLY, CSV, and XYZRGB formats.

[0069] A 3D scene model is a 3D model file represented by .fbx, which contains data such as materials and textures.

[0070] Existing mixed reality scenarios use scene files saved by the system, which contain drag-and-drop information for related multi-dimensional resources: position, rotation, scaling, etc.

[0071] Step S2 specifically includes:

[0072] Editing the scene: Add multi-dimensional resources to the scene using drag-and-drop methods, set the parameters of the safety assistance algorithm using AI API functions, and create the solution using comprehensive anchor points and an automated script manager.

[0073] Adding multi-dimensional resources to a scene via drag-and-drop involves using a drag-and-drop layout algorithm based on a zero-coding platform, adapted to the drag-and-drop spatial layout method of mixed reality platforms; multi-dimensional resources include 3D models, audio, video, images, text, curve data, etc.

[0074] Specifically, taking image resources as an example, when editing, the mouse on the PC moves on a two-dimensional plane at a certain angle in the three-dimensional scene. To adjust the image resource to the correct position, the coordinates of the image's X, Y, and Z axes need to be adjusted. Therefore, first drag the image to the center of the screen, and the X, Y, and Z axes will be displayed in the lower right corner of the image UI to determine the image's spatial coordinates in the three-dimensional scene. Adjust the view to a bird's-eye view of the image, and then drag the X and Y axes to adjust them to the relevant positions. Then switch the view to the image's frontal view and drag the Z axis to adjust it to the corresponding height, thereby achieving drag-and-drop spatial layout of the resource.

[0075] The safety assistance algorithm parameters for AIAPI functions include:

[0076] (1) Image recognition algorithm API parameters, specifically:

[0077] Maximum voltage: Set the maximum voltage threshold. An alarm will be triggered when the detected value exceeds the set value.

[0078] Maximum current: Set the maximum current threshold. An alarm will be triggered when the detected value exceeds the set value.

[0079] Interval time: The time interval between the recognition by the AI ​​cloud server;

[0080] Effectiveness: The master control switch, identified by AI, can be turned off or on.

[0081] (2) Distance warning algorithm API parameters, specifically:

[0082] Safe distance: The distance between the person wearing the MR device and the live equipment. An alarm will be triggered if the distance calculated by the MR device is less than or equal to the set value.

[0083] Validity: The main control switch for safe distance detection is valid.

[0084] (3) Health monitoring algorithm API parameters, specifically:

[0085] Maximum heart rate: Set the maximum heart rate threshold. An alarm will be triggered when the detected value exceeds the set value.

[0086] Minimum heart rate: Set the minimum heart rate threshold. An alarm will be triggered when the detected heart rate value is lower than the set value.

[0087] Maximum blood pressure: Set the maximum blood pressure threshold. An alarm will be triggered when the detected value exceeds the set value.

[0088] A composite anchor point is a three-dimensional spatial coordinate system for arranging multi-dimensional resources in a fixed format; it can be named and numbered.

[0089] The Automation Script Manager is a tool for importing, parsing, visualizing, and editing Excel files with fixed content formats. When used in conjunction with composite anchors, the Automation Script Manager can automatically match the naming and numbering of composite anchors.

[0090] Step S3 specifically includes:

[0091] Synchronize Scene: Scene data files are synchronized from the server to the MR devices at the field.

[0092] The scene data file is a JSON file that stores the spatial location, form, content, and playback settings of multi-dimensional resources in the mixed reality scene.

[0093] Step S4 specifically includes:

[0094] Clear Scene: Removes all integrated anchor points and multi-dimensional resources from the scene.

[0095] Synchronizing with the MR devices on-site via the server specifically involves pushing a JSON file to the MR devices via the server; MR devices include Windows MR glasses, Android MR glasses, and iPads.

[0096] After developing a mixed reality safety management and control plan for high-voltage test sites using a virtual-real fusion intelligent safety management and early warning system, the plan can be released and tested upon completion.

[0097] like Figure 3 As shown, in terms of data flow between devices, this solution first installs a virtual-real fusion security management and early warning system on a Windows platform on a desktop or laptop computer. After completing scene editing and saving, the scene is synchronized to the server and forwarded to the MR device through the server. The MR device on site uses the scene of the virtual-real fusion security management and early warning system to test and use the published scene.

[0098] Example 1

[0099] This embodiment provides a virtual-real fusion safety management and early warning system based on the virtual-real fusion safety management and early warning method for high-voltage test sites as described in Embodiment 1, including:

[0100] The Import Scene module is used to import new point cloud map data, 3D scene models, or existing mixed reality solution scenes to form a virtual-real fusion scene.

[0101] The scene editing module is used to add multi-dimensional resources to the virtual-real fusion scene through drag-and-drop. It allows multi-dimensional resources to be snapped and arranged by setting comprehensive anchor points, and to configure multi-dimensional resources by matching the naming and numbering of comprehensive anchor points through an automated script manager. It also configures security auxiliary algorithms to perform security control and early warning for the virtual-real fusion scene, and sets the parameters of the security auxiliary algorithms.

[0102] The synchronized scene module is used to synchronize the edited virtual-real fusion scene data files to the on-site MR equipment via the server for safety management and early warning.

[0103] The Scene Clearing module is used to clear all integrated anchor points and multi-dimensional resources in the virtual-real fusion scene after completing the security control and early warning.

[0104] It should be noted that the specific content and beneficial effects of the system in this application can be found in the above method embodiments, and will not be repeated here.

[0105] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0106] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The solutions in the embodiments of the present invention can be implemented using various computer languages, such as the object-oriented, component-oriented programming language C# and the interpreted scripting language JavaScript.

[0107] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0108] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0109] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0110] The preferred embodiments of the present invention have been described in detail above. It should be understood that those skilled in the art can make numerous modifications and variations based on the concept of the present invention without creative effort. Therefore, all technical solutions that can be obtained by those skilled in the art based on the concept of the present invention through logical analysis, reasoning, or limited experimentation on the basis of existing technology should be within the scope of protection defined by the claims.

Claims

1. A virtual-real integrated safety management and early warning method for high-voltage test sites, characterized in that, Includes the following steps: Importing Scene Steps: Import new point cloud map data, 3D scene models, or existing mixed reality solution scenes to create a virtual-real fusion scene; Scene editing steps: Add multi-dimensional resources to the virtual-real fusion scene using a drag-and-drop method; snap and arrange the multi-dimensional resources by setting comprehensive anchor points; configure the multi-dimensional resources by matching the naming and numbering of the comprehensive anchor points using an automated script manager; configure a security auxiliary algorithm to perform security control and early warning for the virtual-real fusion scene, and set the parameters of the security auxiliary algorithm. Synchronize scene steps: Synchronize the edited virtual-real fusion scene data file to the on-site MR equipment via the server for safety management and early warning; Clear scene steps: After completing the safety management and early warning, clear all integrated anchor points and multi-dimensional resources in the virtual-real fusion scene.

2. The virtual-real fusion safety control and early warning method for high-voltage test sites according to claim 1, characterized in that, The point cloud map data is generated by scanning the test site using a 3D laser scanner. The point cloud map data obtained after scanning is preprocessed and converted in format to remove irrelevant information, thereby extracting coordinate data and color data. The data format is then converted to ASCII encoded PLY, CSV, or XYZRGB formats to obtain the final point cloud map data.

3. The virtual-real fusion safety control and early warning method for high-voltage test sites according to claim 1, characterized in that, The three-dimensional scene model is a three-dimensional model file based on the fbx format.

4. The virtual-real fusion safety control and early warning method for high-voltage test sites according to claim 1, characterized in that, The existing mixed reality solution scenario includes a scene file, which contains drag-and-drop information for multi-dimensional resources.

5. A virtual-real fusion safety control and early warning method for high-voltage test sites according to claim 1, characterized in that, The multidimensional resources include 3D models, audio, video, images, text, and curve data.

6. The virtual-real fusion safety management and early warning method for high-voltage test sites according to claim 1, characterized in that, The safety assistance algorithm includes an image recognition algorithm, a distance warning algorithm, and a health monitoring algorithm; The image recognition algorithm is used to identify voltage and current values ​​in virtual-real fusion scenarios, and to configure the time interval between the MR device and the server, as well as to enable or disable image recognition. The algorithm first acquires and selects the voltage and current display area on the industrial control software interface, then identifies the voltage and current values ​​within the selected area. Finally, it compares the identified voltage value with a set maximum voltage threshold; if the voltage exceeds the maximum voltage threshold, an alarm is triggered. Similarly, it compares the identified current value with a set maximum current threshold; if the current exceeds the maximum current threshold, an alarm is triggered. The distance warning algorithm is used to calculate the distance between the person wearing the MR device and the powered device. If the calculated distance value is less than or equal to the corresponding distance setting value, an alarm is triggered. It is also used to configure whether the distance warning is effective. The specific processing of the distance warning algorithm is as follows: when editing the mixed reality scene, the powered device or powered area is defined, and the spatial position of the MR camera is calculated in real time. With this spatial position as the center of the sphere and the set safety distance as the radius of the sphere, if the spatial coordinate point of the defined powered device or the spatial coordinate plane of the powered area collides or is tangent to the sphere where the MR camera is located, it is determined that the spatial distance between the person and the powered device or powered area has just reached the distance setting value. If the spatial position of the camera does not move or continues to move towards the powered device or powered area, the MR device will trigger an alarm. The health monitoring algorithm is used to detect the heart rate and blood pressure of the person wearing the MR device. If the heart rate exceeds the set maximum heart rate threshold, an alarm will be triggered; if the heart rate is less than the set minimum heart rate threshold, an alarm will be triggered; if the blood pressure exceeds the set maximum blood pressure threshold, an alarm will be triggered.

7. The virtual-real fusion safety management and early warning method for high-voltage test sites according to claim 1, characterized in that, The integrated anchor points arrange the various multi-dimensional resources in a fixed format; The automated script manager is also used to import and parse content files with fixed content formats, and to configure and display information for integrated anchor points.

8. The virtual-real fusion safety management and early warning method for high-voltage test sites according to claim 1, characterized in that, The data file for the virtual-real fusion scene is a JSON file, which contains the spatial location, form, content, and playback settings of multi-dimensional resources.

9. A virtual-real fusion safety control and early warning method for high-voltage test sites according to claim 1, characterized in that, The data files of the virtual-real fusion scene are pushed to MR devices via a server. These MR devices include Windows MR glasses, Android MR glasses, and iPads.

10. A virtual-real fusion safety control and early warning system based on the virtual-real fusion safety control and early warning method for high-voltage test sites as described in any one of claims 1-9, characterized in that, include: The Import Scene module is used to import new point cloud map data, 3D scene models, or existing mixed reality solution scenes to form a virtual-real fusion scene. The scene editing module is used to add multi-dimensional resources to the virtual-real fusion scene through drag-and-drop. It can also snap and arrange the multi-dimensional resources by setting comprehensive anchor points, and configure the multi-dimensional resources by setting an automated script manager to match the naming and numbering of the comprehensive anchor points. It can also configure a security auxiliary algorithm to perform security control and early warning for the virtual-real fusion scene, and set the parameters of the security auxiliary algorithm. The synchronized scene module is used to synchronize the edited virtual-real fusion scene data files to the on-site MR equipment via the server for safety management and early warning. The Scene Clearing module is used to clear all integrated anchor points and multi-dimensional resources in the virtual-real fusion scene after completing the security control and early warning.

Images