3d visual monitoring system and display method

Abstract

The invention provides a 3d visual monitoring system and a display method, and relates to the technical field of monitoring systems, and the monitoring system comprises a data docking unit which is used for obtaining basic data of a to-be-displayed device and a corresponding basic model; the animation configuration unit is used for processing the basic model according to preset configuration data to generate corresponding animation configuration data, the animation configuration data comprises a plurality of animation point locations, the animation configuration data comprises a plurality of animation point locations, and the animation point locations are used for displaying state changes of the to-be-displayed equipment; and the rendering unit is used for rendering according to the corresponding animation configuration data based on the real-time user input data to obtain an animation display result. According to the invention, the management process of the coal mine is optimized, the decision-making ability and response speed of operators are greatly improved, and finally the production efficiency and safety level of the whole coal mine are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of monitoring systems, and in particular to a 3D visual monitoring system and a display method. Background Art

[0002] In the coal mine production process, the traditional SCADA (Supervisory Control and Data Acquisition) software has obvious limitations in the complex underground environment due to its flowchart display method. Specifically, the system cannot effectively and truly reflect the working status, operating conditions and environmental changes of various equipment in the mine. This defect makes it difficult for production managers to obtain real-time and accurate information, thus affecting decision-making efficiency and mining safety.

[0003] In order to overcome these shortcomings, the industry has gradually begun to explore the use of 3D systems to simulate underground environments. Compared with traditional flat display methods, 3D systems can provide more intuitive visualization effects and better help users understand the operating environment. However, existing 3D systems are often built on open source game engines, and the model modification process is cumbersome and lacks the flexibility to respond quickly to dynamic needs. This means that in the face of changing operating conditions, later modifications and maintenance work will become more difficult, reducing the adaptability of the overall system.

[0004] In addition, in the actual scenario of intelligent comprehensive mining, the operations of the coal mining machine and the hydraulic support are closely related, and the animation control accuracy of the two is very high. For example, the cutter head angle and rotation speed of the coal mining machine, as well as the push distance, column height and inclination of the hydraulic support, all need to be precisely controlled. Due to the complex underground environment and large differences in terrain, the working status and data performance of each device vary greatly. However, the existing general model editing platform can usually make a basic association between the execution of model animation and point data, but there is still room for improvement in the detailed control of animation execution accuracy. Summary of the invention

[0005] The problem solved by the present invention is one or more of the above-mentioned problems in the prior art.

[0006] In order to solve the above problems, the present invention provides a 3D visualization monitoring system and a display method.

[0007] In a first aspect, the present invention provides a 3D visual monitoring system, comprising:

[0008] The data docking unit is used to obtain basic data of the device to be displayed, and obtain a corresponding basic model according to the device to be displayed;

[0009] The animation configuration unit is used to process the basic model according to preset configuration data to generate corresponding animation configuration data, wherein the animation configuration data includes a plurality of animation points, and the animation points are used to display the state change of the device to be displayed;

[0010] The rendering unit is used to render according to the corresponding animation configuration data based on the real-time user input data to obtain an animation display result.

[0011] Optionally, the animation configuration unit includes a generation module and an effect evaluation module;

[0012] The generating module is used to process the preset configuration data based on a linear interpolation method to obtain a plurality of temporary animation points;

[0013] The effect evaluation module is used to construct temporary curve data according to the temporary animation points, and adjust the temporary curve data according to preset curve data to obtain adjusted target curve data, and obtain the animation configuration data according to the adjusted target curve data and the basic model.

[0014] Optionally, the rendering unit includes a conversion module, an extension module and a WASM module;

[0015] The conversion module is used to compress the animation configuration data to obtain a compressed file;

[0016] The expansion module comprises obtaining corresponding array buffer data according to the compressed file;

[0017] The WASM module is used to decompress the array buffer data to obtain target decompressed data, and the target decompressed data is used to obtain an initial animation display result.

[0018] Optionally, the rendering unit further includes a scene display module, which is used to load the target decompressed data in a preset target scene and obtain the corresponding animation display result according to the real-time user input data.

[0019] Optionally, the data docking unit includes an interface module, and the interface module is used to connect with other systems to achieve data sharing and intercommunication.

[0020] Optionally, the interface module includes a device query interface, a device attribute query interface, a device list query interface and a real-time data query interface.

[0021] Optionally, the rendering unit further includes an encryption module, and the encryption module is used to encrypt data during processing.

[0022] Optionally, the animation configuration unit further includes a preprocessing module, and the preprocessing module is used to verify the preset configuration data.

[0023] Optionally, the animation configuration unit further includes a display module, and the display module is used to perform animation display according to the animation configuration data and collect user feedback information.

[0024] In a second aspect, the present invention provides a 3D visualization display method, which is applied to the 3D visualization monitoring system. The 3D visualization display method includes:

[0025] Obtain the basic data of the device to be displayed and the corresponding basic model;

[0026] Processing the basic model according to preset configuration data to generate corresponding animation configuration data, wherein the animation configuration data includes a plurality of animation points, and the animation points are used to display the state change of the device to be displayed;

[0027] Based on the real-time user input data, rendering is performed according to the corresponding animation configuration data to obtain an animation display result.

[0028] The beneficial effects of the 3D visualization monitoring system and display method of the present invention are as follows: the main application scenario of the system is the intelligent fully mechanized mining face of a coal mine, and its design is intended to improve the monitoring and management efficiency of the fully mechanized mining face of a coal mine. By adopting 3D visualization technology, the system can provide users with real-time dynamic display effects. The main components of this system include a data docking unit, an animation configuration unit, and a rendering unit. The functions and processes of each part are described in detail below, and the beneficial effects brought about by them are explained.

[0029] The data docking unit is responsible for obtaining basic data from the equipment to be displayed. These basic data may include equipment status, working parameters, location information, etc. The unit also needs to find and load the corresponding basic model based on the acquired equipment data, such as the specific form of the equipment in 3D space. This can be a mine car, hydraulic support equipment, and coal mining machine equipment, etc., to ensure that the model seen by the user is consistent with the actual equipment. Through data docking, the accuracy and real-time nature of the information are ensured, which makes it convenient for managers to quickly understand the operation status of each equipment.

[0030] The animation configuration unit processes the basic model according to the preset configuration data. The preset data can come from the common working state of the device or the user-defined control strategy. The animation configuration data generated by this unit includes multiple animation points, which clarify the state changes of the device at each time node in the animation. Such as the start, stop, and movement trajectory of the device. That is, the animation configuration unit processes the basic model through the preset configuration data, and the generated animation configuration data can more accurately reflect the real state changes of the device to be displayed. This accuracy helps to improve the effectiveness of device management and monitoring. And through the configuration of multiple animation points, the change process of the device in different states can be vividly and intuitively displayed, which enhances the user's understanding and perception and supports real-time monitoring. And the automatic generation process of animation configuration data simplifies the tedious steps of traditional manual configuration, improves the overall work efficiency, and reduces the possibility of human errors. At the same time, the preset configuration data can be adjusted according to actual needs, so that the animation display can flexibly adapt to different devices and operating conditions, ensuring that the device status can be effectively displayed in a changing environment.

[0031] The rendering unit dynamically renders according to real-time user input data (such as operating instructions, equipment status changes, etc.) and animation configuration data to generate corresponding animation display results. The unit uses advanced rendering technology (such as real-time rendering and lighting calculation) to generate realistic animation effects to ensure that users can get a stable and smooth visual experience in different situations. Through real-time rendering, users can intuitively feel the changes in equipment operation under various conditions. This function not only improves monitoring efficiency, but also helps operators make timely decisions at critical moments and reduce potential safety hazards.

[0032] In summary, the 3D visual monitoring system improves the coal mine operation monitoring capability through effective data docking, animation configuration and rendering, while providing intuitive real-time information to operators, providing technical support for improving operation safety and efficiency. The implementation of this system not only optimizes the management process of coal mines, but also greatly improves the decision-making ability and response speed of operators, ultimately helping to improve the production efficiency and safety level of the entire coal mine. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is one of the structural schematic diagrams of a 3D visual monitoring system according to an embodiment of the present invention;

[0034] Figure 2 This is a second structural diagram of a 3D visual monitoring system according to an embodiment of the present invention;

[0035] Figure 3 The present invention is a flowchart of a 3D visualization display method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0036] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. Although certain embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be interpreted as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not intended to limit the scope of protection of the present invention.

[0037] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.

[0038] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to"; the term "based on" means "based at least in part on"; the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments"; the term "optionally" means "optional embodiments". The relevant definitions of other terms will be given in the following description. It should be noted that the concepts of "first", "second", etc. mentioned in the present invention are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0039] It should be noted that the modifications of "one" and "plurality" mentioned in the present invention are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0040] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only used for illustrative purposes, and are not used to limit the scope of these messages or information.

[0041] like Figure 1 As shown, a 3D visual monitoring system provided by an embodiment of the present invention includes:

[0042] The data connection unit is used to obtain the basic data of the device to be displayed and the corresponding basic model.

[0043] Specifically, the data docking unit is a key component of the system, and its main function is to obtain the basic data of the equipment to be displayed and its corresponding basic model. The unit can collect the basic data of various equipment on the fully mechanized mining surface of the coal mine in real time, including but not limited to coal mining machines, hydraulic supports and conveyor belts.

[0044] The data docking unit mainly provides information related to equipment and its attributes. For example, a fully mechanized coal mining face may include the following equipment and their related attributes: coal mining machine: its attributes include coal mining machine direction, coal mining machine speed and coal mining machine cutter head rotation, etc.; hydraulic support: its attributes include "support height", "pushing distance" and "guard angle", etc.; conveyor belt: its attributes include conveyor belt speed, etc.

[0045] By accurately acquiring and integrating these devices and their properties, the data docking unit provides important data support for other parts of the system, ensuring the real-time and accuracy of the information.

[0046] In summary, the data docking unit plays a vital role in the coal mine comprehensive mining system. It not only improves the accuracy and processing efficiency of the data, but also greatly improves the user's operating experience and supports efficient equipment management and real-time monitoring.

[0047] The animation configuration unit is used to process the basic model according to preset configuration data to generate corresponding animation configuration data, wherein the animation configuration data includes multiple animation points, and the animation points are used to display the state changes of the device to be displayed.

[0048] Specifically, the animation configuration unit is responsible for analyzing and processing the acquired basic models to adapt to different animation requirements. This includes combining the models of different devices with their properties to generate the visualization components required for animation. By analyzing the preset configuration data, the animation configuration unit creates animation configuration data containing multiple animation points. These animation points represent the different states or positions of the equipment to be displayed during the animation process. For example, the movement, running speed, and cutter head rotation of the coal mining machine at different mining stages will be gradually displayed through a series of animation points, thereby visualizing the overall operation process.

[0049] The animation configuration unit can intuitively display complex equipment status through animation, allowing operators to more clearly understand the operating status and change process of the equipment, enhancing the visualization effect of the system.

[0050] And by setting clear animation points, users can get a smoother and more intuitive operation experience when interacting with the system. This is essential for real-time monitoring and operation guidance, especially in complex environments such as coal mining operations. At the same time, by dynamically displaying the status changes of equipment, managers can more easily analyze the operation of equipment, find problems in time and take corresponding measures, thereby improving overall operational efficiency and safety. The animation configuration unit relies on its ability to process preset configuration data, allowing the system to flexibly adjust animation performance according to different needs and support multiple operation scenarios without reconstructing the basic model.

[0051] In summary, the animation configuration unit not only improves the visual display of equipment status, but also enhances user experience, supports learning and training, and enhances decision-making capabilities, ultimately helping to improve overall work efficiency and safety.

[0052] The rendering unit is used to render according to the corresponding animation configuration data based on the real-time user input data to obtain an animation display result.

[0053] Specifically, the main function of the rendering unit is to render based on real-time user input data and corresponding animation configuration data to generate dynamic animation display results. The rendering unit continuously monitors and receives real-time input data from the user. These data may include device operating instructions, environmental change information, and other relevant parameters. The unit uses previously generated animation configuration data, including multiple animation points and device status information, combined with user input data, to provide accurate dynamic demonstration for the device.

[0054] Through computer graphics technology, the rendering unit processes the basic model and animation configuration data to convert different device states and actions into visual images. This usually involves the calculation of rendering effects such as lighting, shadows, and textures to ensure the realism and aesthetics of the display results. Finally, the rendering unit generates dynamic animation display results and feeds them back to the user interface in real time. Users can observe the different state changes of the device through the visual interface and get intuitive operation feedback.

[0055] Receiving user input data in real time allows the system to make dynamic adjustments based on user instructions, providing a more interactive user experience and allowing users to perceive changes more intuitively during operation.

[0056] Through advanced rendering technology, the rendering unit can provide highly realistic animation effects, including precise response, smooth movement and delicate details. This helps to better simulate the actual working state of the equipment. And real-time animation display can help operators quickly analyze the state changes and operation results of the equipment and make accurate decisions in time, especially in complex and dynamic working environments. And fast rendering response can speed up the user's operation process, reduce the time wasted waiting for rendering results, and improve overall work efficiency.

[0057] In summary, the rendering unit not only improves the interactivity and realism between users and the system, but also effectively supports the decision-making process, improves work efficiency, and further enhances the effectiveness and reliability of the overall system.

[0058] In this embodiment, the system aims to improve the monitoring and management efficiency of the fully mechanized mining face of a coal mine, and provide users with real-time dynamic display through 3D visualization technology. The main components of this system include a data docking unit, an animation configuration unit, and a rendering unit. The functions and processes of each part are described in detail below, and the beneficial effects brought about by them are explained.

[0059] The data docking unit is responsible for obtaining basic data from the equipment to be displayed. These basic data may include equipment status, working parameters, location information, etc. The unit also needs to find and load the corresponding basic model based on the acquired equipment data, such as the specific form of the equipment in 3D space. This can be a mine car, hydraulic support equipment, and coal mining machine equipment, etc., to ensure that the model seen by the user is consistent with the actual equipment. Through data docking, the accuracy and real-time nature of the information are ensured, which makes it convenient for managers to quickly understand the operation status of each equipment.

[0060] The animation configuration unit processes the basic model according to the preset configuration data. The preset data can come from the common working state of the device or the user-defined control strategy. The animation configuration data generated by this unit includes multiple animation points, which clarify the state changes of the device at each time node in the animation. Such as the start, stop, and movement trajectory of the device. That is, the animation configuration unit processes the basic model through the preset configuration data, and the generated animation configuration data can more accurately reflect the real state changes of the device to be displayed. This accuracy helps to improve the effectiveness of device management and monitoring. And through the configuration of multiple animation points, the change process of the device in different states can be vividly and intuitively displayed, which enhances the user's understanding and perception and supports real-time monitoring. And the automatic generation process of animation configuration data simplifies the tedious steps of traditional manual configuration, improves the overall work efficiency, and reduces the possibility of human errors. At the same time, the preset configuration data can be adjusted according to actual needs, so that the animation display can flexibly adapt to different devices and operating conditions, ensuring that the device status can be effectively displayed in a changing environment.

[0061] The rendering unit dynamically renders according to real-time user input data (such as operating instructions, equipment status changes, etc.) and animation configuration data to generate corresponding animation display results. The unit uses advanced rendering technology (such as real-time rendering and lighting calculation) to generate realistic animation effects to ensure that users can get a stable and smooth visual experience in different situations. Through real-time rendering, users can intuitively feel the changes in equipment operation under various conditions. This function not only improves monitoring efficiency, but also helps operators make timely decisions at critical moments and reduce potential safety hazards.

[0062] In summary, the 3D visual monitoring system improves the coal mine operation monitoring capability through effective data docking, animation configuration and rendering, while providing intuitive real-time information to operators, providing technical support for improving operation safety and efficiency. The implementation of this system not only optimizes the management process of coal mines, but also greatly improves the decision-making ability and response speed of operators, ultimately helping to improve the production efficiency and safety level of the entire coal mine.

[0063] Alternatively, if Figure 2 As shown, the animation configuration unit includes a generation module and an effect evaluation module;

[0064] The generating module is used to process the preset configuration data based on a linear interpolation method to obtain a plurality of temporary animation points;

[0065] The effect evaluation module is used to construct temporary curve data according to the temporary animation points, and adjust the temporary curve data according to preset curve data to obtain adjusted target curve data, and obtain the animation configuration data according to the adjusted target curve data and the basic model.

[0066] Optionally, the animation configuration unit further includes a preprocessing module, and the preprocessing module is used to verify the preset configuration data.

[0067] Optionally, the animation configuration unit further includes a display module, and the display module is used to perform animation display according to the animation configuration data and collect user feedback information.

[0068] Specifically, the animation configuration unit consists of two main modules: the generation module and the effect evaluation module, which work together to generate high-quality animation configuration data. The generation module can create smooth and natural animation points through linear interpolation and effect evaluation, while the effect evaluation module ensures that the final curve meets the preset ideal standards, thereby significantly improving the overall quality of the animation.

[0069] The generation module is responsible for processing the preset configuration data using linear interpolation to obtain multiple temporary animation points. Through linear interpolation, the generation module can calculate the middle point along a straight line between two known points. This method makes the changes between the generated animation points smoother and more natural, ensuring that the transition process does not appear abrupt. After the processing is completed, the generation module outputs a series of temporary animation points, which will be used for subsequent animation curve construction and effect evaluation.

[0070] The main task of the effect evaluation module is to construct temporary curve data based on the generated temporary animation points, and evaluate and adjust them. First, a temporary curve is generated based on the temporary animation points, which represents the trajectory of the device status changing over time. The effect evaluation module compares the temporary curve data with the preset ideal curve data. This process helps to identify deviations during the animation display process. Based on these comparisons, the module further adjusts the temporary curve data to generate the final target curve data. The basis for adjustment may include various factors such as motion acceleration, smoothness, and realism. Based on the adjusted target curve data, the effect evaluation module is combined with the basic model to generate the final animation configuration data. These data will be used to drive the animation display and show the changes in the device status.

[0071] In summary, the collaborative work of the generation module and the effect evaluation module in the animation configuration unit can not only generate high-quality animation configuration data, but also bring significant benefits in terms of user experience, operational stability and system development.

[0072] In some embodiments, the validity and consistency of the input data are ensured by the preprocessing module for subsequent processing. By verifying whether the input data conforms to the predetermined format, such as data format, range, and whether it is linear, it is actually a validity verification. For example, the height of the hydraulic support should be a numerical type, and a range check should be performed to ensure that the value is within a reasonable range (for example, negative values ​​or values ​​beyond physical limits are not allowed). Or check whether the data shows a linear growth trend to avoid discontinuity or instability in the subsequent interpolation process. If the data does not meet the linear condition, the system will prompt the user to make adjustments.

[0073] Then, according to the generation module, a set of optimized animation points are generated using linear interpolation to make the animation process smooth and meet the needs of users. Linear interpolation is performed on the preprocessed data points (pre-processed preset configuration data) to generate smooth animation points. These points provide the basis for subsequent animation evaluation and ensure the continuity of the motion trajectory. For example, the user may provide 5 sets of data (pre-configured configuration data) representing the height of the hydraulic support under certain conditions or time, such as the relationship between time and corresponding height. Using the linear interpolation algorithm, about 100 sets of intermediate data points are generated based on these 5 sets of data. These generated data will fill the gaps between the original data points to ensure smooth transitions during animation playback. For example, if the data entered by the user is (0, 0), (1, 200), (2, 400), (3, 600), (4, 800), using linear interpolation, the corresponding height changes in each unit time can be generated, thereby forming a complete height change curve.

[0074] Finally, the effect evaluation module evaluates the generated animation points by using the preset curve data to ensure that they meet the physical reality and design expectations. The preset curve data can be obtained through the physics engine. The processing process of the effect evaluation module is: with the help of the physics engine tool, global parameters such as gravity and friction are set to generate animations that reflect the real physical characteristics. The animation generated by the physics engine is compared with the generated animation points (temporary curve data) to analyze the accuracy during the transition process and identify potential deviations.

[0075] If a transition point is found to be inconsistent with the standard, there are two ways to adjust it: 1. Directly adjust the point: fine-tune the relevant animation points according to actual needs and deviations. 2. Adjust the physical model parameters: modify the physical model parameters such as gravity and friction, and re-simulate in a physics-based background until the generated animation accuracy meets the user's expectations.

[0076] Finally, the generated animation points are displayed to users through the display module, and user feedback is collected to continuously improve the system. That is, the generated animation points are visualized through the interface, allowing users to observe and understand the animation effects. At the same time, users can evaluate the generated animation based on their own observations and make relevant adjustments in the interface, such as adding or removing points, modifying motion parameters, etc. The system can dynamically adjust algorithm-related parameters based on user feedback and optimize the subsequent animation generation process. This feedback mechanism will continuously improve the animation effects and user experience, making the system more intelligent and personalized.

[0077] Through the integration of these steps, the entire animation generation system can operate more scientifically and standardized, ensuring that the final result not only meets user expectations but also has high quality and high efficiency.

[0078] Alternatively, if Figure 2 As shown, the rendering unit includes a conversion module, an extension module and a WASM module;

[0079] The conversion module is used to compress the animation configuration data to obtain a compressed file;

[0080] The expansion module comprises obtaining corresponding array buffer data according to the compressed file;

[0081] The WASM module is used to decompress the array buffer data to obtain target decompressed data, and the target decompressed data is used to obtain an initial animation display result.

[0082] Optionally, the rendering unit further includes an encryption module, and the encryption module is used to encrypt data during processing.

[0083] Specifically, in the rendering unit, in addition to the conversion module, extension module, and WASM module, an encryption module is also introduced to ensure the security of information during data processing.

[0084] The main function of the conversion module is to compress the animation configuration data to reduce the file size and improve storage and transmission efficiency. It receives the original animation configuration data, which may include animation frames, object characteristics, event descriptions, etc. It uses compression algorithms (such as Gzip, LZ77, etc.) to compress the data, generate a compressed file, and pass it to the extension module.

[0085] The extension module is responsible for generating array buffer data based on the compressed file for subsequent modules to process. That is, it receives the compressed file from the conversion module. It parses the compressed file and extracts the valid data. It maps the extracted data into an array buffer format for quick access and processing of subsequent decompression operations. It generates array buffer data and passes it to the WASM module.

[0086] The WASM (WebAssembly) module is responsible for efficiently decompressing the array buffer data and generating the target decompressed data for animation display. That is, it obtains the array buffer data output by the extension module. It calls the corresponding decompression algorithm (such as DEFLATE) to restore the array buffer data to the original animation configuration data and generate the target decompressed data, which will be used to render the animation effect.

[0087] In order to solve the problem of ensuring security during the model file transmission process and ensure that the resource loading time will not be significantly extended, this embodiment adds an encryption module, and the encryption module does not encrypt the entire model file, but encrypts a certain buffer of the file. This method avoids processing the entire file, thereby shortening the encryption and decryption time.

[0088] Usually, important data parts are selected for encryption, such as texture data, key parameters, or model configuration information, which are critical to the security of the model. For example, a symmetric encryption algorithm (such as AES) can be used, which is characterized by using the same key for encryption and decryption. This means that only one key needs to be maintained, which can be used to encrypt and decrypt files, simplifying management complexity.

[0089] During encryption, a key is randomly generated to encrypt the data in the buffer, and the key (usually transmitted in a secure manner) is combined with the encrypted data. The decryption logic is encapsulated in the WASM module so that the decryption process can run in an efficient environment. WebAssembly (WASM) provides faster execution speed than traditional JavaScript and is suitable for data-intensive operations. When the ZIP file (compressed file) is transmitted to the client, a fetch request is first made to obtain the file, and after obtaining the ArrayBuffer (array buffer data), the required encrypted data is extracted through the WASM module and the decryption process is performed. After the ZIP file passes the fetch request, the WASM module intercepts the data stream and extracts the encrypted part of the buffer. At the same time, the key generated during encryption is used for decryption operations to restore the encrypted data to the original data for subsequent processing.

[0090] The decrypted data can be directly passed to GLTFLoader for loading, ensuring that the model can be formatted and rendered normally. By handling the decryption process in WASM, the entire decryption and loading process can be completed in milliseconds, avoiding the impact on user experience. Because the decryption and loading process is completed quickly enough, users can hardly feel any delay, ensuring the responsiveness of the application.

[0091] In some embodiments, in the rendering process, that is, in the rendering process of a 3D scene, loading of model resources (animation configuration data) is a critical and time-consuming operation.

[0092] This embodiment significantly reduces the model file size by packaging the GLB model resources (animation configuration data) into a ZIP compression package, thereby reducing the transmission time. Among them, the GLB model refers to a binary format of 3D model data encoded in GLTF (GL Transmission Format) format. GLB files usually contain the geometry, materials, textures, animations and other related information of the 3D model, which is convenient for efficient loading and rendering on the Web and mobile devices.

[0093] In addition, in order to solve the problem that Three.js (a JavaScript library for creating and displaying 3D graphics that can be used in web browsers. Through Three.js, developers can build complex 3D scenes, animations and interactions in a relatively simple way, and are widely used in web games, visualization effects and virtual reality) does not support direct loading of ZIP files, a series of optimization schemes are adopted to improve the efficiency and security of model loading. That is, the above problems are solved through the mutual cooperation between the modules in the rendering unit. The process is as follows: the conversion module packs and compresses a large number of 3D model files (usually in GLB format) into ZIP format. Due to the high efficiency of the ZIP compression algorithm, this process can reduce the size of the model file by about 80%. The compressed file is easy to be efficiently transmitted over the network, greatly reducing the use of network bandwidth and transmission time. The ZIP file loading is extended by the extension module, that is, in the loading process, the ZIP file is first obtained through the fetch request and its ArrayBuffer is obtained. Before the model formatting step, the ArrayBuffer of the ZIP file is intercepted by the compiled WASM module. The built-in decompression method of the WASM module is called to decompress the ZIP file. This process can be completed within milliseconds, greatly improving the speed of model loading. The decompressed data will be passed to GLTFLoader (GLTF loader module. It is a module in the Three.js library that is used to load GLTF (GL Transmission Format) files, allowing developers to easily import and display GLTF format models and scenes in their 3D applications) for subsequent formatting and loading, ensuring the consistency and efficiency of the entire process.

[0094] In order to ensure the security of model resources during processing, the compressed ZIP file will be encrypted during transmission. The goal of encryption is to protect data and prevent unauthorized access and downloading. The encryption module encrypts part of the buffer of the ZIP file by intercepting it, avoiding encryption of the entire file while ensuring the security of important data segments. This method significantly reduces the amount of encrypted data and improves transmission efficiency. At the same time, the logic of data decryption is also placed in the WASM module. This means that the performance of the decryption process can be optimized, combined with the decompression process, to achieve fast loading of resources.

[0095] Through the technical solution of the embodiment, the model loading operation in the 3D scene becomes more efficient and safe, providing developers with a fast and safe solution to improve the user experience. This technology can be widely used in various Web-based 3D applications, games and virtual reality experiences.

[0096] Optionally, the rendering unit further includes a scene display module, and the scene display module is used to load the target decompressed data in a preset target scene, and obtain the corresponding animation display result according to the real-time user input data.

[0097] Specifically, the process of animation rendering based on real-time user input data includes:

[0098] First, you need to set up a preset target scene (such as a 3D environment or interface) and load the initial animation configuration data (target decompressed data) from a file or database. Use the user input data captured in real time to modify the animation configuration. This involves dynamically adjusting the keyframes and properties of the animation based on the user's selection or operation.

[0099] In the scene, the modified animation configuration is applied to the 3D model or element for real-time rendering. The 3D engine (such as Three.js) updates the time step according to the current animation parameters and calculates the display effect of the model in each frame. The real-time rendering results are output to the screen for the user to view. This may involve updating each frame of the scene to appear more smooth and natural.

[0100] Through the above steps, an interactive animation display system based on real-time user input can be realized. The key lies in real-time capture of user input, dynamic adjustment of animation configuration and effective rendering of animation results, so as to ensure that users can perceive the changes in animation in real time and improve the interactive experience.

[0101] When constructing a preset target scene, it involves the integration of scene editing, equipment management, and model warehouse units to build a virtual work surface that is similar to the actual work scene.

[0102] Optionally, the 3D visual monitoring system further includes a scene editing unit, a scene list unit, a device management unit and a model warehouse unit, and the process includes:

[0103] The main goal of the scene editing phase is to use 3D models to build a virtual work surface similar to the actual working environment. Users can drag and drop or other operations in the scene editing unit to place the pre-built model (animation configuration data) to the specified location to form a complete scene.

[0104] In addition, the scene list unit is used to manage multiple scenes built in the management editor. Users can access different scenes and call and display them through different web addresses for testing and verification.

[0105] The equipment management unit is responsible for maintaining all equipment information in a specific industry (such as coal mines). For example, in the workflow of a coal mine, equipment such as coal mining machines, hydraulic supports, conveyors, and crushers may be included.

[0106] Users can add, delete, modify or query devices. In this way, the information of real devices in the industry can be effectively managed.

[0107] Each device may have multiple instances. For example, a hydraulic support device may have hundreds of instances, and the status of each instance may be different. This distinction is very important because real-time monitoring and control of the status of each instance can reflect the actual operation status and performance.

[0108] The model warehouse unit stores 3D modeling files of various equipment. When editing a scene, the model files required by the user will be called from the warehouse. On a fully-mechanized mining surface in a coal mine, the same 3D model may be used to represent multiple equipment instances (such as hydraulic supports). This relationship is 1 to n, that is, one device can be associated with multiple equipment instances, but these instances all share the same 3D model. This reduces model redundancy and improves resource utilization.

[0109] The status of each real device can be composed of the following three parameters: Device ID: uniquely identifies the type of each device. Device instance ID: uniquely identifies each device instance and distinguishes different instances of the same type of device. Device attributes: includes real-time status information of the device, such as operating status, fault status, load, etc.

[0110] The state of each device will control the display of animation effects in the virtual scene. This means that the real-time state of the device instance (such as start, stop, move, etc.) can be visualized in the 3D scene through the corresponding animation. For example, when the state of a hydraulic support device instance changes to "running", the corresponding animation in the scene shows the working state of the instance.

[0111] Through the close integration of scene editing, equipment management and model warehouse units, a virtual working environment can be effectively constructed to reflect the status of actual equipment in real time. Users can dynamically control the animation effects in the virtual scene through the real-time information of the equipment, making the virtual environment more vivid and realistic, and improving work efficiency and safety.

[0112] Optionally, the data docking unit includes an interface module, and the interface module is used to connect with other systems to achieve data sharing and intercommunication.

[0113] Optionally, the interface module includes a device query interface, a device attribute query interface, a device list query interface and a real-time data query interface.

[0114] Specifically, Figure 2As shown in the figure, in order to achieve seamless connection with the existing coal mine monitoring system, the interface module is set, that is, the standardized API interface design can ensure compatibility with multiple monitoring systems, thereby achieving data sharing and intercommunication. The purpose of the interface module is to integrate data from different monitoring systems into the new 3D scene system to provide users with comprehensive information support. And by acquiring and sharing data in real time, it assists users in making effective decisions and improves mine operation efficiency and safety.

[0115] The device query interface allows users to query the information of all devices in the system, including device type, device identification and status, etc. When building a 3D scene, scene editors can use this interface to obtain information about available devices and add them to the virtual scene.

[0116] The device attribute query interface provides a detailed description of the attributes of a specific device, including the device's real-time status, geographic location, performance indicators, etc. When the user needs to know the detailed status or attributes of the device during operation, this interface can be called to obtain the corresponding information for further analysis and decision-making.

[0117] The device list query interface returns a list of all current devices and their associated instance information, including basic status and location data for each instance. When previewing and rendering a scene, the 3D editor can use this interface to obtain a comprehensive list of devices to ensure that the device instances contained in the rendered scene are the latest.

[0118] The real-time data query interface provides real-time monitoring data of the equipment, such as the current operating status, performance indicators, fault alarms, etc. During the operation of the 3D scene, the model status can be continuously updated through this interface to achieve real-time feedback. For example, when a device fails, the corresponding device animation in the 3D scene will automatically reflect the "fault" status.

[0119] In order to seamlessly connect with different monitoring systems, this embodiment supports flexible configuration of HTTP interface addresses. System administrators can set the interface address according to the address of the monitoring system or data service actually used to ensure fast connection with the data service. Through HTTP requests (such as GET, POST, etc.), dynamic interaction with different data sources can be achieved, ensuring that the 3D editor can be fully edited and previewed during the configuration period, and can achieve real-time updates during the runtime period.

[0120] By designing a standardized API interface, the 3D scene editing system can be seamlessly connected with the existing coal mine monitoring system to ensure data sharing and interoperability. This not only improves the editing and rendering capabilities of 3D scenes, but also helps support decision-making in mine operations and improves the efficiency and safety of overall operations.

[0121] like Figure 3As shown, a 3D visualization display method provided by an embodiment of the present invention includes:

[0122] Obtain the basic data of the device to be displayed and the corresponding basic model;

[0123] Processing the basic model according to preset configuration data to generate corresponding animation configuration data, wherein the animation configuration data includes a plurality of animation points, and the animation points are used to display the state change of the device to be displayed;

[0124] Based on the real-time user input data, rendering is performed according to the corresponding animation configuration data to obtain an animation display result.

[0125] The advantages of the 3D visualization display method of this embodiment over the prior art are the same as the advantages of the above-mentioned 3D visualization monitoring system over the prior art, which will not be repeated here.

[0126] Although the present invention is disclosed as above, the protection scope of the present invention is not limited thereto. Those skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention, and these changes and modifications will fall within the protection scope of the present invention.

Claims

1. A 3D visual monitoring system, characterized in that: include: The data docking unit is used to obtain the basic data of the equipment to be displayed and the corresponding basic model; The animation configuration unit is used to process the basic model according to preset configuration data to generate corresponding animation configuration data, wherein the animation configuration data includes a plurality of animation points, and the animation points are used to display the state change of the device to be displayed; The rendering unit is used to render according to the corresponding animation configuration data based on the real-time user input data to obtain an animation display result.

2. The 3D visual monitoring system according to claim 1, characterized in that: The animation configuration unit includes a generation module and an effect evaluation module; The generating module is used to process the preset configuration data based on a linear interpolation method to obtain a plurality of temporary animation points; The effect evaluation module is used to construct temporary curve data according to the temporary animation points, and adjust the temporary curve data according to preset curve data to obtain adjusted target curve data, and obtain the animation configuration data according to the adjusted target curve data and the basic model.

3. The 3D visual monitoring system according to claim 1, characterized in that: The rendering unit includes a conversion module, an extension module and a WASM module; The conversion module is used to compress the animation configuration data to obtain a compressed file; The expansion module comprises obtaining corresponding array buffer data according to the compressed file; The WASM module is used to decompress the array buffer data to obtain target decompressed data, and the target decompressed data is used to obtain an initial animation display result.

4. The 3D visual monitoring system according to claim 3, characterized in that: The rendering unit further includes a scene display module, which is used to load the target decompressed data in a preset target scene and obtain the corresponding animation display result according to the real-time user input data.

5. The 3D visual monitoring system according to claim 1, characterized in that: The data docking unit includes an interface module, and the interface module is used to connect with other systems to achieve data sharing and intercommunication.

6. The 3D visual monitoring system according to claim 5, characterized in that: The interface module includes a device query interface, a device attribute query interface, a device list query interface and a real-time data query interface.

7. The 3D visual monitoring system according to claim 3, characterized in that: The rendering unit further includes an encryption module, and the encryption module is used to encrypt the data in the processing process.

8. The 3D visual monitoring system according to claim 2, characterized in that: The animation configuration unit further includes a preprocessing module, and the preprocessing module is used to verify the preset configuration data.

9. The 3D visual monitoring system according to claim 2, characterized in that: The animation configuration unit further comprises a display module, and the display module is used to perform animation display according to the animation configuration data and collect user feedback information.

10. A 3D visualization display method, characterized in that: Applied to the 3D visualization monitoring system according to any one of claims 1 to 9, the 3D visualization display method comprises: Obtain the basic data of the device to be displayed and the corresponding basic model; Processing the basic model according to preset configuration data to generate corresponding animation configuration data, wherein the animation configuration data includes a plurality of animation points, and the animation points are used to display the state change of the device to be displayed; Based on the real-time user input data, rendering is performed according to the corresponding animation configuration data to obtain an animation display result.

Images