A method and system for industrial data visualization based on virtual reality

Abstract

The present invention discloses a method and system for industrial data visualization based on virtual reality. The method comprises the following steps: analyzing comprehensive clarity data to obtain comprehensive clarity evaluation coefficients, analyzing mapping visualization data to obtain mapping visualization evaluation coefficients, performing threshold comparison on the comprehensive clarity evaluation coefficients, performing preliminary regulation according to the comparison results, performing comprehensive evaluation on the comprehensive clarity evaluation coefficients and the mapping visualization evaluation coefficients to obtain mapping quality evaluation coefficients, performing threshold comparison on the mapping quality evaluation coefficients, and performing final regulation according to the comparison results. The present invention achieves the effect of improving the mapping quality of a three-dimensional data model mapped to a three-dimensional interactive environment by performing threshold comparison on the mapping quality evaluation coefficients and performing final regulation according to the comparison results, thereby solving the problem of insufficient mapping quality of a three-dimensional data model mapped to a three-dimensional interactive environment in the prior art.

Description

Technical Field

[0001] The present invention relates to the technical field of electrical data processing, and in particular to an industrial data visualization method and system based on virtual reality. Background Art

[0002] With the advancement of virtual reality (VR) technology, the development of medical imaging, and the innovation of big data analysis tools, these technologies have jointly provided researchers with a new interactive three-dimensional environment, which enables complex biomedical data, such as molecular structure and cell dynamics, to be presented in an intuitive and controllable way.

[0003] For example, the invention patent with publication number: CN118260462A discloses an industrial big data visualization system and method thereof, including: a data acquisition module: to collect equipment information, and to classify the collected equipment data according to key data and storage data; a memory module: to temporarily store data that needs to be mobilized by a visualization display module; a data storage module: to store equipment data collected by the data acquisition module; a visualization display module: to display the memory module data in a visual manner and to interact with the user; by prioritizing equipment data and determining resource usage, the system can help users reasonably schedule and manage resources, ensure real-time transmission and processing of key data, and at the same time maximize the utilization efficiency of system resources and reduce production costs.

[0004] For example, the invention patent with publication number: CN118132643A discloses an industrial Internet of Things data visualization publishing method, including: a front-end module, a data preprocessing module, a data analysis module and a data storage module; the front-end module includes three functions: data preprocessing, data analysis and result visualization and model download; the data preprocessing module provides word segmentation, format conversion and data augmentation preprocessing methods for training or data to be analyzed; the data analysis module calls the diagnostic model to classify the preprocessed data and returns the result; the data storage module includes file storage and database storage; specifically including, S1: preprocessing of data; S2: construction of a classification model for data; S3: fusion of data; S4: realizing a visualization platform to analyze and visualize the data and publish the data.

[0005] However, in the process of implementing the technical solution of the invention in the embodiments of the present application, the present application found that the above technology has at least the following technical problems:

[0006] In the prior art, when displaying industrial processes, equipment and performance data in three-dimensional graphics and interactive environments, if the network delay is too high, there is a problem of insufficient mapping quality of the three-dimensional data model to the three-dimensional interactive environment. Summary of the invention

[0007] The embodiments of the present application provide a virtual reality-based industrial data visualization method and system, thereby solving the problem of insufficient mapping quality of three-dimensional data models mapped to three-dimensional interactive environments in the prior art, and achieving the effect of improving the mapping quality of three-dimensional data models mapped to three-dimensional interactive environments.

[0008] An embodiment of the present application provides an industrial data visualization method based on virtual reality, comprising the following steps: collecting cell data related to the medical industry, preprocessing the cell data related to the medical industry to obtain preprocessed cell data related to the medical industry, converting the preprocessed cell data related to the medical industry into a three-dimensional data model, and building a three-dimensional interactive environment through virtual reality technology; mapping the three-dimensional data model to the three-dimensional interactive environment, collecting comprehensive clarity data and mapping visualization data during the mapping process, analyzing the comprehensive clarity data to obtain a comprehensive clarity evaluation coefficient, analyzing the mapping visualization data to obtain a mapping visualization evaluation coefficient; performing threshold comparison on the comprehensive clarity evaluation coefficient, performing preliminary regulation based on the comparison result, performing comprehensive evaluation on the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient to obtain a mapping quality evaluation coefficient, performing threshold comparison on the mapping quality evaluation coefficient, and performing final regulation based on the comparison result.

[0009] Furthermore, cell data related to the medical industry are collected, and the specific process for preprocessing the cell data related to the medical industry is as follows: the cell data related to the medical industry include amino acid sequences, DNA sequences, interaction point coordinates with target proteins, cell membrane coordinates, organelle coordinates and molecular marker coordinates of specific diseases; the preprocessing of cell data related to the medical industry includes cleaning, format conversion, multimodal integration and data enhancement.

[0010] Furthermore, the specific conversion process of converting the pre-processed medical industry-related cell data into a three-dimensional data model is as follows: directly obtaining the microscope image and volume rendering data of the cells from the database, reconstructing the three-dimensional morphology of the cells, extracting the cell surface from the volume rendering data using surface reconstruction technology, assigning different colors and transparencies to different organelles or molecular parts, adding lighting effects to the three-dimensional model, simulating the lighting conditions in the real environment, designing an interface for users to interact with the three-dimensional model, and obtaining a three-dimensional data model.

[0011] Furthermore, the specific construction process of building a three-dimensional interactive environment through virtual reality technology is as follows: creating a three-dimensional space in the VR development environment as a basic scene for visualizing cell data related to the medical industry, reducing the number of polygons, and optimizing textures and materials.

[0012] Furthermore, the specific mapping process of mapping the three-dimensional data model into the three-dimensional interactive environment is as follows: importing the three-dimensional data model into the virtual space, designing the logic of user interaction with the virtual environment, defining interactive actions, designing an easy-to-operate user interface, allowing users to select different data sets, view modes and interaction options, and integrating the sensor data of the VR hardware into the VR.

[0013] Furthermore, the specific collection process of comprehensive clarity data and mapping visualization data during the mapping process is as follows: comprehensive clarity data includes: pixels per inch, total number of pixels, voxel size, number of voxels, LOD level, rendering time and rendering distance; mapping visualization data includes: spatial positioning accuracy, interactive response time, interactive response accuracy and frame rate.

[0014] Furthermore, a threshold comparison is performed on the comprehensive clarity evaluation coefficient. The specific process for performing preliminary adjustments based on the comparison results is as follows: directly obtain the mapping resolution evaluation threshold from the database, compare the comprehensive clarity evaluation coefficient with the mapping resolution evaluation threshold; if the comprehensive clarity evaluation coefficient is greater than or equal to the mapping resolution evaluation threshold, there is no need to adjust the mapping resolution; if the comprehensive clarity evaluation coefficient is less than the mapping resolution evaluation threshold, perform preliminary adjustments on the mapping resolution; preliminary adjustments include: removing invisible objects or parts, optimizing the rendering order of transparent objects, using graphics processing units for parallel processing, and screening voxels that have a large impact on visualization for high-resolution rendering.

[0015] Furthermore, the mapping quality assessment coefficient is threshold-compared, and the specific process of making final adjustments based on the comparison results is: directly obtain the mapping quality assessment threshold from the database, compare the mapping quality assessment coefficient with the mapping quality assessment threshold; if the mapping quality assessment coefficient is greater than or equal to the mapping quality assessment threshold, there is no need to adjust the mapping quality; if the mapping quality assessment coefficient is less than the mapping quality assessment threshold, make a final adjustment on the mapping quality; the final adjustment includes: dynamically adjusting the detail level according to the viewing distance, using a linear color mapping algorithm or a logarithmic color mapping algorithm, and using multi-threading technology to improve rendering efficiency.

[0016] Furthermore, the specific method for obtaining the mapping quality assessment coefficient is as follows:

[0017] ;

[0018] ;

[0019] In the formula, It is represented as the mapping quality evaluation coefficient, which is used to evaluate the impact of mapping resolution and mapping visualization on mapping quality. MR is represented as the comprehensive clarity evaluation coefficient. It is represented as the weight factor of the comprehensive clarity evaluation coefficient, MV is represented as the mapping visualization evaluation coefficient, It is expressed as a weight factor for mapping the visualization evaluation coefficient, and e is expressed as a natural constant.

[0020] The embodiment of the present application provides an industrial data visualization system based on virtual reality, which includes a model building module, a data analysis module and a threshold comparison module:

[0021] Model building module: used to collect cell data related to the medical industry, pre-process the cell data related to the medical industry, obtain the pre-processed cell data related to the medical industry, convert the pre-processed cell data related to the medical industry into a three-dimensional data model, and build a three-dimensional interactive environment through virtual reality technology;

[0022] Data analysis module: used to map the 3D data model into the 3D interactive environment, collect the comprehensive clarity data and mapping visualization data in the mapping process, analyze the comprehensive clarity data to obtain the comprehensive clarity evaluation coefficient, and analyze the mapping visualization data to obtain the mapping visualization evaluation coefficient;

[0023] Threshold comparison module: used to perform threshold comparison on the comprehensive clarity evaluation coefficient, make preliminary adjustments based on the comparison results, comprehensively evaluate the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient to obtain the mapping quality evaluation coefficient, perform threshold comparison on the mapping quality evaluation coefficient, and make final adjustments based on the comparison results.

[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0025] 1. By comprehensively evaluating the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient, a mapping quality evaluation coefficient is obtained, and then a threshold comparison is performed on the mapping quality evaluation coefficient. The final adjustment is performed according to the comparison result, thereby achieving the effect of improving the mapping quality of the three-dimensional data model mapped to the three-dimensional interactive environment, and effectively solving the problem of insufficient mapping quality of the three-dimensional data model mapped to the three-dimensional interactive environment in the prior art.

[0026] 2. By analyzing the mapping visualization data, the mapping visualization evaluation coefficient is obtained, and then the threshold of the comprehensive clarity evaluation coefficient is compared. Preliminary adjustments are made based on the comparison results, thereby achieving the effect of improving the accuracy of mapping quality assessment.

[0027] 3. By converting the pre-processed medical industry-related cell data into a three-dimensional data model, a three-dimensional interactive environment is constructed through virtual reality technology; the three-dimensional data model is mapped to the three-dimensional interactive environment, thereby improving the efficiency of disease diagnosis. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A flowchart of an industrial data visualization method based on virtual reality provided in an embodiment of the present application;

[0029] Figure 2 A schematic diagram of mapping visualization evaluation coefficients in a virtual reality-based industrial data visualization method provided in an embodiment of the present application;

[0030] Figure 3 A schematic diagram of the structure of an industrial data visualization system based on virtual reality provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The embodiment of the present application solves the problem of insufficient mapping quality of three-dimensional data models mapped to three-dimensional interactive environments in the prior art by providing a virtual reality-based industrial data visualization method and system. A mapping quality evaluation coefficient is obtained by comprehensively evaluating a comprehensive clarity evaluation coefficient and a mapping visualization evaluation coefficient, and then a threshold comparison is performed on the mapping quality evaluation coefficient. A final adjustment is performed based on the comparison result, thereby achieving the effect of improving the mapping quality of the three-dimensional data model mapped to the three-dimensional interactive environment.

[0032] The technical solution in the embodiment of the present application is to solve the above-mentioned problem of insufficient mapping quality of the three-dimensional data model to the three-dimensional interactive environment. The overall idea is as follows:

[0033] The mapping quality evaluation coefficient is obtained by comprehensively evaluating the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient, and then the mapping quality evaluation coefficient is compared by threshold, and the final adjustment is made according to the comparison result, thereby achieving the effect of improving the mapping quality of the three-dimensional data model mapped to the three-dimensional interactive environment.

[0034] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0035] like Figure 1As shown, it is a flow chart of an industrial data visualization method based on virtual reality provided in an embodiment of the present application, the method comprising the following steps: collecting cell data related to the medical industry, preprocessing the cell data related to the medical industry to obtain preprocessed cell data related to the medical industry, converting the preprocessed cell data related to the medical industry into a three-dimensional data model, and building a three-dimensional interactive environment through virtual reality technology; mapping the three-dimensional data model to the three-dimensional interactive environment, collecting comprehensive clarity data and mapping visualization data in the mapping process, analyzing the comprehensive clarity data to obtain a comprehensive clarity evaluation coefficient, analyzing the mapping visualization data to obtain a mapping visualization evaluation coefficient; performing threshold comparison on the comprehensive clarity evaluation coefficient, performing preliminary regulation according to the comparison result, performing comprehensive evaluation on the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient to obtain a mapping quality evaluation coefficient, performing threshold comparison on the mapping quality evaluation coefficient, and performing final regulation according to the comparison result.

[0036] In this embodiment, the specific method for obtaining the comprehensive clarity evaluation coefficient is:

[0037] ;

[0038] ;

[0039] In the formula, MR is the comprehensive clarity evaluation coefficient, PPI is the number of pixels per inch, TNOP is the total number of pixels, VS is the voxel size, NOV is the number of voxels, LOD is the LOD level, RT is the rendering time, and RD is the rendering distance. A weighting factor expressed as pixels per inch, Expressed as a weight factor of the total number of pixels, Expressed as a weight factor for the voxel size, Expressed as a weighting factor for the number of voxels, Expressed as a weight factor for the LOD level, Expressed as a weight factor for rendering time, Expressed as a weighting factor for rendering distance.

[0040] The weight factor of pixels per inch, the weight factor of total pixels, the weight factor of voxel size, the weight factor of number of voxels, the weight factor of LOD level, the weight factor of rendering time and the weight factor of rendering distance respectively indicate the numerical values ​​of the influence of pixels per inch, total number of pixels, voxel size, number of voxels, LOD level, rendering time and rendering distance on the comprehensive clarity evaluation coefficient.

[0041] When in use, the weight factor of the number of pixels per inch, the weight factor of the total number of pixels, the weight factor of the voxel size, the weight factor of the number of voxels, the weight factor of the LOD level, the weight factor of the rendering time and the weight factor of the rendering distance can be directly obtained from the database according to the rendering resolution and the pixel fill rate, and the corresponding relationship can be a pre-set mapping relationship. For example, a mapping set is constructed according to the rendering resolution and the pixel fill rate and their corresponding weight factors of the number of pixels per inch, the weight factor of the total number of pixels, the weight factor of the voxel size, the weight factor of the number of voxels, the weight factor of the LOD level, the weight factor of the rendering time and the weight factor of the rendering distance, and the value of the rendering resolution and the pixel fill rate is input into the mapping set in real time to obtain the weight factor of the number of pixels per inch, the weight factor of the total number of pixels, the weight factor of the voxel size, the weight factor of the number of voxels, the weight factor of the LOD level, the weight factor of the rendering time and the weight factor of the rendering distance. The mapping relationship can be one-to-one or many-to-one.

[0042] The higher the PPI, the more total pixels the screen of the same size has, and the smaller the voxels, the more voxels there are in the same volume. An increase in the number of voxels can improve the resolution of the data, but it will also increase the demand for computing and storage. The smaller the voxel size, the higher the LOD level the system can support, because smaller voxels can provide finer details. The more total pixels, the higher the LOD level the screen can display, and the more voxels, the more detail information the system can store and process, thereby supporting higher LOD levels.

[0043] The specific method for obtaining the mapping visualization evaluation coefficient is:

[0044] ;

[0045] ;

[0046] In the formula, MV represents the mapping visualization evaluation coefficient, SPA represents the spatial positioning accuracy, ERT represents the interactive response time, ERA represents the interactive response accuracy, and FR represents the frame rate. Expressed as the weight factor of spatial positioning accuracy, Expressed as the weight factor of the interactive response time, Expressed as the weight factor of the interactive response accuracy, Expressed as a weighting factor for frame rate.

[0047] Spatial positioning accuracy refers to the error value between the point where a response is made after an operation in a virtual reality system and the actual operation point. It can be obtained by testing using a reference object with a known precise position and direction, and the value range is 0.1-1mm.

[0048] The interactive response time refers to the time it takes for the system to respond to user input when the user performs interactive operations in the virtual environment. It can be obtained through a high-precision timer and the value range is 10-60ms.

[0049] Interaction response accuracy refers to the percentage of the number of times the system correctly responds to user input when the user performs interactive operations in a virtual environment to the total number of operations. It can be obtained through motion capture technology and the value range is 90-99%.

[0050] The weight factor of spatial positioning accuracy, the weight factor of interactive response time, the weight factor of interactive response accuracy and the weight factor of frame rate respectively represent the numerical values ​​of the influence of spatial positioning accuracy, interactive response time, interactive response accuracy and frame rate on the mapping visualization evaluation coefficient.

[0051] When in use, the weight factor of spatial positioning accuracy, the weight factor of interactive response time, the weight factor of interactive response precision and the weight factor of frame rate can be directly obtained from the database according to the value of the mapping visualization evaluation coefficient, and the corresponding relationship can be a pre-set mapping relationship. For example, a mapping set of the mapping visualization evaluation coefficient and its corresponding weight factor of spatial positioning accuracy, weight factor of interactive response time, weight factor of interactive response precision and weight factor of frame rate is constructed, and the value of the real-time mapping visualization evaluation coefficient is input into the mapping set to obtain the weight factor of spatial positioning accuracy, weight factor of interactive response time, weight factor of interactive response precision and weight factor of frame rate. The mapping relationship can be one-to-one or many-to-one.

[0052] In a specific embodiment, an example of mapping visualization evaluation coefficient data is shown in the following table.

[0053] Table 1 Example table of mapping visualization evaluation coefficient data

[0054]

[0055] When the weight factors of spatial positioning accuracy, interactive response time, interactive response precision, and frame rate are 0.7, 0.1, 0.1, and 0.1, respectively, Figure 2 From the data in Table 1, it can be seen that when the interactive response time, interactive response accuracy and frame rate remain unchanged, the greater the spatial positioning accuracy, the greater the mapping visualization evaluation coefficient.

[0056] If the positioning is inaccurate, even if the interactive response time is short, the user's operation may not get the expected result. The frame rate directly affects the interactive response time. A high frame rate can reduce the perceived delay of interactive operations, making the interactive response time shorter. If the frame rate is low, the positioning data may not be updated frequently enough, thus affecting the spatial positioning accuracy.

[0057] Furthermore, cell data related to the medical industry are collected, and the specific process for preprocessing the cell data related to the medical industry is as follows: the cell data related to the medical industry include amino acid sequences, DNA sequences, interaction point coordinates with target proteins, cell membrane coordinates, organelle coordinates and molecular marker coordinates of specific diseases; the preprocessing of cell data related to the medical industry includes cleaning, format conversion, multimodal integration and data enhancement.

[0058] In this embodiment, cleaning: remove invalid, erroneous and redundant data to ensure data quality. Format conversion: convert data from different sources and formats into a unified format for subsequent processing. Multimodal integration: combine data from different experiments or technologies, such as combining microscopic imaging data and genomic data. Data enhancement: increase the diversity and quantity of data through algorithms, improve the generalization ability of the model, and use virtual reality technology to intuitively observe and analyze molecular and cellular data in three-dimensional space, greatly improving research efficiency.

[0059] Furthermore, the specific conversion process of converting the pre-processed medical industry-related cell data into a three-dimensional data model is as follows: directly obtaining the microscope image and volume rendering data of the cells from the database, reconstructing the three-dimensional morphology of the cells, extracting the cell surface from the volume rendering data using surface reconstruction technology, assigning different colors and transparencies to different organelles or molecular parts, adding lighting effects to the three-dimensional model, simulating the lighting conditions in the real environment, designing an interface for users to interact with the three-dimensional model, and obtaining a three-dimensional data model.

[0060] In this embodiment, computed tomography (CT) or optical coherence tomography (OCT) data is used to reconstruct the three-dimensional morphology of cells, and surface reconstruction techniques such as marching cubes algorithm are applied to extract the cell surface from volume rendering data, and color and transparency are assigned as well as lighting effects are added to make the three-dimensional model more realistic and enhance the user's visual experience.

[0061] Furthermore, the specific construction process of building a three-dimensional interactive environment through virtual reality technology is as follows: creating a three-dimensional space in the VR development environment as a basic scene for visualizing cell data related to the medical industry, reducing the number of polygons, and optimizing textures and materials.

[0062] In this embodiment, a three-dimensional space is created in Unity or Unreal Engine as a basic scene for visualization of cell data related to the medical industry. The number of polygons of the three-dimensional model in the scene is reduced by simplifying the model or using low-polygon modeling technology, and the appropriate texture resolution and compression format are selected to reduce the texture size. At the same time, material properties such as reflection, refraction, and lighting response are optimized. Reducing the number of polygons and optimizing texture materials can significantly improve rendering performance, reduce hardware resource consumption, and make it run more smoothly in a VR environment.

[0063] Furthermore, the specific mapping process of mapping the three-dimensional data model into the three-dimensional interactive environment is as follows: importing the three-dimensional data model into the virtual space, designing the logic of user interaction with the virtual environment, defining interactive actions, designing an easy-to-operate user interface, allowing users to select different data sets, view modes and interaction options, and integrating the sensor data of the VR hardware into the VR.

[0064] In this embodiment, the created three-dimensional data model (such as cell structure, molecular model, etc.) is imported into the virtual reality environment, and the operations that the user can perform in the virtual environment are defined, such as rotating, scaling, moving and selecting objects. The interaction logic is designed to ensure that the user's behavior can be responded to correctly. For example, selecting a molecule can view its detailed information. According to the characteristics of the VR hardware, specific interactive actions are defined, such as handheld controller buttons, gesture recognition or voice commands. An easy-to-operate user interface (UI) is developed to allow users to access different functions, such as selecting data sets, switching view modes and adjusting interaction options. The sensor data of the VR headset and handheld controller are integrated into the virtual environment to ensure that the user's actions can affect the objects in the virtual space in real time. Multiple users can collaborate in the same virtual environment and jointly analyze and discuss data even if they are in different geographical locations.

[0065] Furthermore, the specific collection process of comprehensive clarity data and mapping visualization data during the mapping process is as follows: comprehensive clarity data includes: pixels per inch, total number of pixels, voxel size, number of voxels, LOD level, rendering time and rendering distance; mapping visualization data includes: spatial positioning accuracy, interactive response time, interactive response accuracy and frame rate.

[0066] In this embodiment, the number of pixels per inch refers to the number of pixels that can be displayed per inch on the device screen, which is provided by the display device manufacturer or measured using professional measurement tools. The total number of pixels refers to the sum of all pixels on the screen, which can be obtained by referring to the device specification manual or the display settings of the operating system. The voxel size refers to the actual physical size represented by each voxel in the three-dimensional space, which can be obtained through device calibration or data set metadata during the data acquisition process. The number of voxels refers to the total number of voxels that constitute the three-dimensional data set, which can be directly calculated based on the data set size. The LOD level refers to the level of detail, which can be obtained through the LOD algorithm. The spatial positioning accuracy refers to the positioning accuracy of the user or device in the three-dimensional space, using a high-precision tracking system and calibration testing. The interactive response time refers to the time from user operation to system response, which can be measured by performance testing software. The interactive response accuracy refers to the accuracy of the system's response to user interactive operations, which can be obtained by recording the deviation between the system response and the expected response. The frame rate refers to the number of frames displayed per second, which can be obtained by frame rate testing software or application built-in performance monitoring tools.

[0067] Furthermore, a threshold comparison is performed on the comprehensive clarity evaluation coefficient. The specific process for performing preliminary adjustments based on the comparison results is as follows: directly obtain the mapping resolution evaluation threshold from the database, compare the comprehensive clarity evaluation coefficient with the mapping resolution evaluation threshold; if the comprehensive clarity evaluation coefficient is greater than or equal to the mapping resolution evaluation threshold, there is no need to adjust the mapping resolution; if the comprehensive clarity evaluation coefficient is less than the mapping resolution evaluation threshold, perform preliminary adjustments on the mapping resolution; preliminary adjustments include: removing invisible objects or parts, optimizing the rendering order of transparent objects, using graphics processing units for parallel processing, and screening voxels that have a large impact on visualization for high-resolution rendering.

[0068] In this embodiment, remove invisible objects or parts: delete model elements that are not visible in the current view to reduce the rendering burden. Optimize the rendering order of transparent objects: adjust the rendering order of transparent objects to reduce rendering errors and improve rendering efficiency. Use GPU for parallel processing: use the parallel processing capabilities of the graphics processing unit (GPU) to accelerate the data processing and rendering process. Screen and render at high resolution: render voxels with a large visual impact (such as important parts of cells) at high resolution, while other parts can be appropriately reduced in resolution. By removing invisible objects and optimizing the rendering order, unnecessary rendering calculations are reduced and the overall rendering efficiency is improved.

[0069] Furthermore, the mapping quality assessment coefficient is threshold-compared, and the specific process of making final adjustments based on the comparison results is: directly obtain the mapping quality assessment threshold from the database, compare the mapping quality assessment coefficient with the mapping quality assessment threshold; if the mapping quality assessment coefficient is greater than or equal to the mapping quality assessment threshold, there is no need to adjust the mapping quality; if the mapping quality assessment coefficient is less than the mapping quality assessment threshold, make a final adjustment on the mapping quality; the final adjustment includes: dynamically adjusting the detail level according to the viewing distance, using a linear color mapping algorithm or a logarithmic color mapping algorithm, and using multi-threading technology to improve rendering efficiency.

[0070] In this embodiment, the level of detail is dynamically adjusted: the level of detail (LOD) of the model is automatically adjusted according to the viewing distance between the user and the model, showing less details at a distance and more details at a close distance. Color mapping algorithm: a linear color mapping algorithm or a logarithmic color mapping algorithm is used to optimize color display to ensure color accuracy and visual contrast. Multithreading technology: multithreading technology is used to improve the efficiency of data processing and rendering and reduce rendering delay. By dynamically adjusting the level of detail and optimizing color mapping, it is ensured that the model can maintain a high visual quality at different viewing distances.

[0071] Furthermore, the specific method for obtaining the mapping quality assessment coefficient is as follows:

[0072] ;

[0073] ;

[0074] In the formula, It is represented as the mapping quality evaluation coefficient, which is used to evaluate the impact of mapping resolution and mapping visualization on mapping quality. MR is represented as the comprehensive clarity evaluation coefficient. It is represented as the weight factor of the comprehensive clarity evaluation coefficient, MV is represented as the mapping visualization evaluation coefficient, It is expressed as a weight factor for mapping the visualization evaluation coefficient, and e is expressed as a natural constant.

[0075] In this embodiment, the weight factor of the comprehensive definition evaluation coefficient and the weight factor of the mapping visualization evaluation coefficient respectively represent the numerical values ​​of the influence of the comprehensive definition evaluation coefficient and the mapping visualization evaluation coefficient on the mapping quality evaluation coefficient.

[0076] When in use, the weight factor of the comprehensive clarity assessment coefficient and the weight factor of the mapping visualization assessment coefficient can be directly obtained from the database according to the value of the mapping quality assessment coefficient, and the corresponding relationship can be a pre-set mapping relationship. For example, a mapping set of the mapping quality assessment coefficient and its corresponding weight factor of the comprehensive clarity assessment coefficient and the weight factor of the mapping visualization assessment coefficient is constructed, and the real-time value of the mapping visualization assessment coefficient is input into the mapping set to obtain the weight factor of the comprehensive clarity assessment coefficient and the weight factor of the mapping visualization assessment coefficient. The mapping relationship can be one-to-one or many-to-one.

[0077] like Figure 3 As shown, it is a structural diagram of an industrial data visualization system based on virtual reality provided in an embodiment of the present application. An industrial data visualization system based on virtual reality provided in an embodiment of the present application includes: a model building module, a data analysis module and a threshold comparison module:

[0078] Model building module: used to collect cell data related to the medical industry, pre-process the cell data related to the medical industry, obtain the pre-processed cell data related to the medical industry, convert the pre-processed cell data related to the medical industry into a three-dimensional data model, and build a three-dimensional interactive environment through virtual reality technology;

[0079] Data analysis module: used to map the 3D data model into the 3D interactive environment, collect the comprehensive clarity data and mapping visualization data in the mapping process, analyze the comprehensive clarity data to obtain the comprehensive clarity evaluation coefficient, and analyze the mapping visualization data to obtain the mapping visualization evaluation coefficient;

[0080] Threshold comparison module: used to perform threshold comparison on the comprehensive clarity evaluation coefficient, make preliminary adjustments based on the comparison results, comprehensively evaluate the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient to obtain the mapping quality evaluation coefficient, perform threshold comparison on the mapping quality evaluation coefficient, and make final adjustments based on the comparison results.

[0081] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0082] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0083] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0084] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0085] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0086] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for industrial data visualization based on virtual reality, characterized in that: The following steps are involved: Collecting cell data related to the medical industry, preprocessing the cell data related to the medical industry to obtain preprocessed cell data related to the medical industry, converting the preprocessed cell data related to the medical industry into a three-dimensional data model, and constructing a three-dimensional interactive environment through virtual reality technology; Mapping the three-dimensional data model into a three-dimensional interactive environment, collecting comprehensive clarity data and mapping visualization data during the mapping process, analyzing the comprehensive clarity data to obtain a comprehensive clarity evaluation coefficient, and analyzing the mapping visualization data to obtain a mapping visualization evaluation coefficient; Perform threshold comparison on the comprehensive clarity evaluation coefficient, make preliminary adjustments based on the comparison results, conduct comprehensive evaluation on the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient to obtain the mapping quality evaluation coefficient, perform threshold comparison on the mapping quality evaluation coefficient, and make final adjustments based on the comparison results; The specific process of performing threshold comparison on the comprehensive clarity evaluation coefficient and performing preliminary regulation according to the comparison result is as follows: directly obtaining the mapping resolution evaluation threshold from the database, comparing the comprehensive clarity evaluation coefficient with the mapping resolution evaluation threshold, if the comprehensive clarity evaluation coefficient is greater than or equal to the mapping resolution evaluation threshold, there is no need to regulate the mapping resolution, if the comprehensive clarity evaluation coefficient is less than the mapping resolution evaluation threshold, the mapping resolution is preliminarily regulated; Initial adjustments include: removing invisible objects or parts, optimizing the rendering order of transparent objects, using graphics processing units for parallel processing, and filtering voxels that have a large impact on visualization for high-resolution rendering; The specific process of performing threshold comparison on the mapping quality assessment coefficient and performing final regulation according to the comparison result is as follows: directly obtaining the mapping quality assessment threshold from the database, comparing the mapping quality assessment coefficient with the mapping quality assessment threshold, if the mapping quality assessment coefficient is greater than or equal to the mapping quality assessment threshold, there is no need to regulate the mapping quality, if the mapping quality assessment coefficient is less than the mapping quality assessment threshold, finally regulating the mapping quality; The final adjustments include: dynamically adjusting the level of detail according to the viewing distance, using a linear color mapping algorithm or a logarithmic color mapping algorithm, and using multi-threading technology to improve rendering efficiency.

2. The industrial data visualization method based on virtual reality as claimed in claim 1, characterized in that: The specific process of collecting cell data related to the medical industry and preprocessing the cell data related to the medical industry is as follows: Cell data related to the medical industry include amino acid sequences, DNA sequences, coordinates of interaction sites with target proteins, cell membrane coordinates, organelle coordinates, and molecular markers of specific diseases; Preprocessing of cell data related to the medical industry includes cleaning, format conversion, multimodal integration and data enhancement.

3. The industrial data visualization method based on virtual reality as claimed in claim 1, characterized in that: The specific conversion process of converting the pre-processed medical industry-related cell data into a three-dimensional data model is as follows: Directly obtain microscope images and volume rendering data of cells from the database, reconstruct the three-dimensional morphology of cells, use surface reconstruction technology to extract the cell surface from the volume rendering data, assign different colors and transparencies to different organelles or molecular parts, add lighting effects to the three-dimensional model, simulate the lighting conditions in the real environment, design an interface for users to interact with the three-dimensional model, and obtain a three-dimensional data model.

4. The industrial data visualization method based on virtual reality according to claim 1, characterized in that: The specific construction process of constructing a three-dimensional interactive environment by using virtual reality technology is as follows: Create a three-dimensional space in the VR development environment as the basic scene for visualizing cell data related to the medical industry, reduce the number of polygons, and optimize textures and materials.

5. The industrial data visualization method based on virtual reality according to claim 1, characterized in that: The specific mapping process of mapping the three-dimensional data model into the three-dimensional interactive environment is as follows: Import 3D data models into the virtual space, design the logic for user interaction with the virtual environment, define interactive actions, design an easy-to-operate user interface, allow users to select different data sets, view modes and interaction options, and integrate sensor data from VR hardware into VR.

6. The industrial data visualization method based on virtual reality according to claim 1, characterized in that: The specific process of collecting the comprehensive clarity data and mapping visualization data in the mapping process is as follows: Comprehensive clarity data includes: pixels per inch, total pixels, voxel size, number of voxels, LOD level, rendering time and rendering distance; Mapping visualization data includes: spatial positioning accuracy, interactive response time, interactive response accuracy and frame rate.

7. The industrial data visualization method based on virtual reality according to claim 1, characterized in that: The specific method for obtaining the mapping quality assessment coefficient is: ； ； In the formula, It is represented as the mapping quality evaluation coefficient, which is used to evaluate the impact of mapping resolution and mapping visualization on mapping quality. MR is represented as the comprehensive clarity evaluation coefficient. It is represented as the weight factor of the comprehensive clarity evaluation coefficient, MV is represented as the mapping visualization evaluation coefficient, It is expressed as a weight factor for mapping the visualization evaluation coefficient, and e is expressed as a natural constant.

8. An industrial data visualization system based on virtual reality, used to execute the method according to any one of claims 1 to 7, characterized in that: Including model building module, data analysis module and threshold comparison module: Model building module: used to collect cell data related to the medical industry, pre-process the cell data related to the medical industry, obtain the pre-processed cell data related to the medical industry, convert the pre-processed cell data related to the medical industry into a three-dimensional data model, and build a three-dimensional interactive environment through virtual reality technology; Data analysis module: used to map the 3D data model into the 3D interactive environment, collect the comprehensive clarity data and mapping visualization data in the mapping process, analyze the comprehensive clarity data to obtain the comprehensive clarity evaluation coefficient, and analyze the mapping visualization data to obtain the mapping visualization evaluation coefficient; Threshold comparison module: used to perform threshold comparison on the comprehensive clarity evaluation coefficient, make preliminary adjustments based on the comparison results, comprehensively evaluate the comprehensive clarity evaluation coefficient and the mapping visualization evaluation coefficient to obtain the mapping quality evaluation coefficient, perform threshold comparison on the mapping quality evaluation coefficient, and make final adjustments based on the comparison results.

Images