Three-dimensional visualization method and three-dimensional visualization device for intelligent cabin production line

Abstract

The invention provides a three-dimensional visualization method and device for an intelligent cabin production line, and the method comprises the steps: carrying out the three-dimensional modeling of the intelligent cabin production line based on a multi-level modeling algorithm, obtaining an initial three-dimensional model, and obtaining the image information of the environment where the intelligent cabin production line is located, rendering the initial three-dimensional model by using the image information to obtain a target three-dimensional model corresponding to the intelligent cabin production line; acquiring real-time operation data of production equipment through monitoring equipment deployed on the production equipment in the intelligent cabin production line; and dynamically associating the real-time operation data with the target three-dimensional model so as to visually display the real-time operation data through the target three-dimensional model. According to the method and the device, the structure and the operation state of the production line are presented in a highly accurate and intuitive manner, and the transparency and the manageability of the production process are greatly improved.

Description

Technical Field

[0001] The present application relates to the field of three-dimensional model technology, and in particular to a three-dimensional visualization method and a three-dimensional visualization device for an intelligent cockpit production line. Background Art

[0002] With the rapid development of intelligent cockpit technology, 3D visualization and control systems are becoming increasingly popular in the automotive manufacturing sector. These systems utilize high-precision 3D modeling and complex data correlation to enable real-time monitoring and optimization of production line operations.

[0003] However, existing technologies face numerous challenges in achieving these capabilities. Real-time data synchronization and complex scene rendering place significant pressure on system performance, potentially leading to slower system response times or delays. Furthermore, the system relies heavily on hardware devices, with high-performance graphics processing units (GPUs) and computing resources crucial for smooth system operation, increasing the overall cost and technical barriers to entry. Existing technologies may also present risks in terms of data security and privacy protection, particularly during data collection, transmission, and storage. Additional security measures are needed to prevent data leakage and unauthorized access. Summary of the Invention

[0004] In view of this, the purpose of this application is to provide a three-dimensional visualization method and a three-dimensional visualization device for an intelligent cockpit production line. Through multi-level modeling and three-dimensional visualization technology, the structure and operation status of the production line can be presented in a highly accurate and intuitive manner, greatly improving the transparency and manageability of the production process.

[0005] In a first aspect, an embodiment of the present application provides a three-dimensional visualization method for an intelligent cockpit production line, the three-dimensional visualization method comprising:

[0006] Based on a multi-level modeling algorithm, a three-dimensional model is performed on the intelligent cockpit production line to obtain an initial three-dimensional model corresponding to the intelligent cockpit production line;

[0007] Acquiring image information of an environment where the smart cockpit production line is located, and rendering the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line;

[0008] Acquiring real-time operating data of the production equipment through monitoring equipment deployed on the production equipment in the smart cockpit production line;

[0009] The real-time operation data is dynamically associated with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model.

[0010] Furthermore, the three-dimensional modeling of the smart cockpit production line is performed based on the multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the smart cockpit production line, including:

[0011] Obtaining a spatial layout diagram corresponding to the smart cockpit production line, and dividing the smart cockpit production line into levels based on the spatial layout diagram to determine multiple production levels and a target layout diagram corresponding to each production level;

[0012] For each production level, based on the target layout corresponding to the production level, determine the parameter information corresponding to each production location in the production level, as well as the parameter information corresponding to each production equipment in each production location;

[0013] Build a structural framework model for each production location based on the parameter information corresponding to each production location, and build a device model for each production device based on the parameter information corresponding to each production device;

[0014] According to the target layout diagram, the equipment model of each production equipment is added to the structural framework model of the corresponding production location to obtain a three-dimensional model corresponding to the production level;

[0015] According to the spatial layout diagram, the three-dimensional models corresponding to each production level are spliced to obtain an initial three-dimensional model corresponding to the smart cockpit production line.

[0016] Furthermore, the rendering of the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line includes:

[0017] Converting the initial three-dimensional model into a mesh three-dimensional model;

[0018] determining a target image in the image information corresponding to a grid element of the grid three-dimensional model;

[0019] The grid three-dimensional model is converted into a texture three-dimensional model according to a target image corresponding to each grid element, and the texture three-dimensional model is used as the target three-dimensional model.

[0020] Furthermore, after dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the three-dimensional visualization method further includes:

[0021] For each production equipment, when a fault is detected in the production equipment based on the real-time operation data of the production equipment, the equipment model corresponding to the production equipment in the target three-dimensional model is displayed in a specific color.

[0022] Furthermore, after dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the three-dimensional visualization method further includes:

[0023] In response to a user selecting any device model in the target three-dimensional model, determining a target device and obtaining historical operating data of the target device within a first historical time period;

[0024] A data change curve graph corresponding to the target device is generated based on the historical operation data and displayed.

[0025] Furthermore, after obtaining the target three-dimensional model corresponding to the smart cockpit production line, the three-dimensional visualization method further includes:

[0026] Sending the target three-dimensional model to a virtual reality interactive device;

[0027] An operation instruction for the target three-dimensional model sent by the virtual reality interaction device is received, the target three-dimensional model is adjusted based on the operation instruction, and the adjusted target three-dimensional model is sent to the virtual reality interaction device.

[0028] Furthermore, after obtaining the target three-dimensional model corresponding to the smart cockpit production line, the three-dimensional visualization method further includes:

[0029] Get the second historical time period selected by the user;

[0030] Obtain historical production data corresponding to the smart cockpit production line in a second historical time period, and dynamically display the historical production status of the smart cockpit production line based on the target three-dimensional model and in combination with the historical production data.

[0031] In a second aspect, an embodiment of the present application further provides a three-dimensional visualization device for an intelligent cockpit production line, the three-dimensional visualization device comprising:

[0032] A model building module is used to perform three-dimensional modeling of the intelligent cockpit production line based on a multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the intelligent cockpit production line;

[0033] a model rendering module, configured to obtain image information of the environment in which the smart cockpit production line is located, and render the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line;

[0034] An operation data acquisition module, configured to acquire real-time operation data of the production equipment through monitoring equipment deployed on the production equipment in the smart cockpit production line;

[0035] A data association module is used to dynamically associate the real-time operation data with the target three-dimensional model so as to visualize the real-time operation data through the target three-dimensional model.

[0036] In a third aspect, an embodiment of the present application further provides an electronic device comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of the three-dimensional visualization method of the smart cockpit production line as described above are performed.

[0037] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is run by a processor, the steps of the three-dimensional visualization method of the smart cockpit production line as described above are executed.

[0038] An embodiment of the present application provides a three-dimensional visualization method and a three-dimensional visualization device for an intelligent cockpit production line. First, based on a multi-level modeling algorithm, the intelligent cockpit production line is three-dimensionally modeled to obtain an initial three-dimensional model corresponding to the intelligent cockpit production line; then, image information of the environment in which the intelligent cockpit production line is located is obtained, and the initial three-dimensional model is rendered using the image information to obtain a target three-dimensional model corresponding to the intelligent cockpit production line; real-time operation data of the production equipment in the intelligent cockpit production line is obtained through monitoring equipment deployed on the production equipment; finally, the real-time operation data is dynamically associated with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model.

[0039] This application utilizes multi-level modeling and 3D visualization technology to present the structure and operational status of a production line in a highly accurate and intuitive manner, significantly enhancing the transparency and manageability of the production process. Furthermore, through the collection of operational data, real-time synchronization of production data is achieved, ensuring data consistency between the virtual and physical workshops. This allows the production status to be reflected in real time within the 3D visualization system, facilitating the timely identification and resolution of problems.

[0040] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without creative work.

[0042] Figure 1 A flowchart of a three-dimensional visualization method for an intelligent cockpit production line provided in an embodiment of the present application;

[0043] Figure 2 This is one of the structural schematic diagrams of a three-dimensional visualization device for an intelligent cockpit production line provided in an embodiment of the present application;

[0044] Figure 3 This is a second structural diagram of a three-dimensional visualization device for an intelligent cockpit production line provided in an embodiment of the present application;

[0045] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application for which protection is claimed, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work falls within the scope of protection of the present application.

[0047] First, the application scenarios to which this application is applicable are introduced. This application can be applied in the field of three-dimensional model technology.

[0048] With the rapid development of intelligent cockpit technology, 3D visualization and control systems are becoming increasingly popular in the automotive manufacturing sector. These systems utilize high-precision 3D modeling and complex data correlation to enable real-time monitoring and optimization of production line operations.

[0049] Research has found that existing technologies face numerous challenges in implementing these capabilities. Real-time data synchronization and complex scene rendering place significant pressure on system performance, potentially leading to slower or delayed system responses. Furthermore, the system relies heavily on hardware devices, and high-performance graphics processing units (GPUs) and computing resources are crucial for smooth system operation, increasing the overall cost and technical barriers to entry. Existing technologies may also present certain risks in terms of data security and privacy protection, particularly during data collection, transmission, and storage, requiring additional security measures to prevent data leakage and unauthorized access.

[0050] Based on this, an embodiment of the present application provides a three-dimensional visualization method for an intelligent cockpit production line. Through multi-level modeling and three-dimensional visualization technology, it can present the structure and operating status of the production line in a highly accurate and intuitive manner, greatly improving the transparency and manageability of the production process.

[0051] See also Figure 1 , Figure 1 This is a flow chart of a three-dimensional visualization method for an intelligent cockpit production line provided in an embodiment of the present application. Figure 1 As shown in , the three-dimensional visualization method provided by the embodiment of the present application includes:

[0052] S101, based on a multi-level modeling algorithm, perform three-dimensional modeling on the smart cockpit production line to obtain an initial three-dimensional model corresponding to the smart cockpit production line.

[0053] Here, multi-level modeling is a technology that decomposes a complex system into different levels of abstraction for modeling, and realizes modularization and parallel development of system design through hierarchical division. According to the embodiment provided in this application, when three-dimensionally modeling the smart cockpit production line, the multiple levels can be divided according to the production sequence, for example, it can be divided into factory level, production line level, work station level, parts level, etc., which is not specifically limited in this application. The smart cockpit is a car cockpit that integrates a digital interactive system, which includes a deep integration of hardware (display, HUD, seats) and software (on-board OS, voice assistant). The smart cockpit production line is a spatial and logical combination of equipment, personnel, and logistics systems organized to realize the manufacturing of smart cockpits.

[0054] Regarding step S101, in the specific implementation, a multi-level modeling algorithm is used to perform 3D modeling of the intelligent cockpit production line to obtain an initial 3D model corresponding to the intelligent cockpit production line. Here, when performing 3D modeling, digital design software such as CATIA can be used, and this application does not specifically limit this.

[0055] As an optional embodiment, with respect to step S101 above, performing three-dimensional modeling of the smart cockpit production line based on a multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the smart cockpit production line includes:

[0056] Step 1011: Obtain a spatial layout diagram corresponding to the smart cockpit production line, and divide the smart cockpit production line into levels based on the spatial layout diagram to determine multiple production levels and a target layout diagram corresponding to each production level.

[0057] The spatial layout diagram for the intelligent cockpit production line is a technical drawing that visually presents the physical space planning and equipment distribution of the intelligent cockpit production line. It displays the spatial relationships between the production levels and production locations in two or three dimensions, including precise dimensioning and functional zoning. The spatial layout diagram can be used to determine the relative position and spatial dimensions of each production level.

[0058] Regarding the above step 1011, during the specific implementation, the spatial layout diagram corresponding to the smart cockpit production line is obtained, and the smart cockpit production line is divided into levels based on the spatial layout diagram to determine multiple production levels and the target layout diagram corresponding to each production level.

[0059] Step 1012 , for each production level, based on the target layout corresponding to the production level, determine parameter information corresponding to each production location in the production level, and parameter information corresponding to each production equipment in each production location.

[0060] During the specific implementation of step 1012, for each production level, based on the target layout corresponding to that production level, parameter information corresponding to each production location within that production level, as well as parameter information corresponding to each piece of production equipment within each production location, is determined. This ensures that the scale of the model, when subsequently constructed based on this parameter information, is consistent with the scale of the actual production line.

[0061] Step 1013: construct a structural framework model of each production location based on the parameter information corresponding to each production location, and construct a device model of each production device based on the parameter information corresponding to each production device.

[0062] Regarding the above step 1013, during the specific implementation, a structural framework model of each production location is constructed based on the parameter information corresponding to each production location, and an equipment model of each production equipment is constructed based on the parameter information corresponding to each production equipment. Usually, start with the structural framework of the production line, such as the ground, support structure, walkways, etc. The production line is divided into multiple levels, and each level can be independently modeled and optimized to improve efficiency. Based on the collected data, create a three-dimensional form of each production location and equipment through precise measurement and reference to product dimensions. Based on the equipment drawings of the actual production line, use CATIA to perform detailed three-dimensional modeling of various types of production equipment. Each device should include details of multiple aspects such as mechanical structure, electrical connection, transmission system, etc.

[0063] Step 1014 , according to the target layout diagram, the equipment model of each production equipment is added to the structural framework model of the corresponding production location to obtain a three-dimensional model corresponding to the production level.

[0064] Regarding the above step 1014, during the specific implementation, since the location of each production equipment is recorded in the target layout diagram, here, according to the target layout diagram corresponding to the production level, the equipment model of each production equipment is added to the structural framework model of the production location to which it belongs, and the three-dimensional model corresponding to the production level is obtained.

[0065] Step 1015: According to the spatial layout diagram, the three-dimensional models corresponding to each production level are spliced to obtain an initial three-dimensional model corresponding to the smart cockpit production line.

[0066] During the implementation of step 1015, the 3D models corresponding to each production level are spliced together according to the spatial layout of the smart cockpit production line to obtain an initial 3D model of the smart cockpit production line. This initial 3D model encompasses all levels of the smart cockpit production line, from the equipment level to the production line level and workshop level, fully reflecting the production line's structure and operational logic.

[0067] S102: Acquire image information of the environment where the smart cockpit production line is located, and use the image information to render the initial three-dimensional model to obtain a target three-dimensional model corresponding to the smart cockpit production line.

[0068] Regarding step S102, during implementation, image information of the environment surrounding the smart cockpit production line is obtained and used to render the initial 3D model, resulting in a target 3D model corresponding to the smart cockpit production line. This initial 3D model can then be imported into an OSG (Open Scene Graph) 3D graphics engine for rendering and processing, leveraging OSG's efficient graphics rendering capabilities and flexible scene management capabilities to achieve a 3D visualization of the production line.

[0069] As an optional embodiment, with respect to the above step S102, rendering the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line includes:

[0070] Step 1021: convert the initial three-dimensional model into a mesh three-dimensional model.

[0071] Step 1022: Determine a target image in the image information that corresponds to a grid element of the grid three-dimensional model.

[0072] Step 1023 : Convert the mesh 3D model into a texture 3D model according to the target image corresponding to each mesh element, and use the texture 3D model as the target 3D model.

[0073] In the specific implementation of steps 1021-1023, the initial 3D model is first converted into a meshed 3D model. Then, a target image corresponding to each mesh element of the meshed 3D model is determined in the image information. Based on the target image corresponding to each mesh element, the meshed 3D model is converted into a textured 3D model with texture, and the textured 3D model is used as the target 3D model.

[0074] S103: Acquire real-time operating data of the production equipment through monitoring equipment deployed on the production equipment in the smart cockpit production line.

[0075] With respect to the above-mentioned step S103, during the specific implementation, the real-time operating data of the production equipment is obtained by the monitoring equipment deployed on the production equipment in the smart cockpit production line. Here, in terms of data association, based on the OPC communication method and data access method, control system simulation and data acquisition are performed through sensors. The monitoring data is configured through sensors, data association is completed, and a hierarchical data monitoring system is established to ensure the real-time mapping and synchronization of production data from the physical workshop to the virtual workshop. As an example, the OPC acquisition module can be used to collect data from the production equipment in real time. The transport layer transmits data through the industrial network, and usually uses protocols such as Modbus, OPC DA / HDA, and MQTT.

[0076] S104: Dynamically associate the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model.

[0077] Regarding step S104, during implementation, the equipment's real-time operating data is dynamically associated with the target 3D model, enabling visualization of the real-time operating data through the target 3D model. Here, virtual data visualization technology is combined to dynamically associate real-time production data with the 3D model, enabling data visualization and monitoring. This dual mapping of data and model enables real-time and intuitive reflection of the production line's operating status within the 3D visualization system, facilitating monitoring and management. For example, the data processing layer can utilize a SCADA system for data processing and monitoring. The display layer presents data through a visual interface, supporting multi-level views and alarm display. This allows for visualization of the production line's real-time operating status. The target 3D model also displays connections between different equipment or workstations, such as conveyor belt connections and material flow paths between equipment. Operational status modeling primarily focuses on visualizing the operating status and operational processes of production line equipment. By modeling the equipment's operational status, it is possible to visualize the production line's operating status in real time, detect potential issues, and perform predictive maintenance.

[0078] According to the three-dimensional visualization method provided by the present application, after dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the three-dimensional visualization method further includes:

[0079] For each production equipment, when a fault is detected in the production equipment based on the real-time operation data of the production equipment, the equipment model corresponding to the production equipment in the target three-dimensional model is displayed in a specific color.

[0080] In the specific implementation of the above steps, for each production device, fault monitoring is performed using the acquired real-time operating data of the production device. When a fault is detected in the production device based on the real-time operating data, the corresponding device model in the target three-dimensional model is displayed in a specific color. The specific color may be red, which is not specifically limited in this application. Specifically, as an optional embodiment, when no fault is detected in the production device based on the real-time operating data, the device model of the production device is displayed in its original color to indicate that the production device is not abnormal. When a fault is detected in the production device based on the real-time operating data, the corresponding device model in the target three-dimensional model is displayed in a specific color to indicate that the production device is abnormal. This facilitates the user to determine whether any production device has an abnormality by observing the color information of the model in the target three-dimensional model. Alternatively, when a fault in a production device is detected, the location of the production device can be notified to the relevant personnel via text message or phone call, for example, by sending a text message to the relevant personnel's mobile phone, etc., which is not specifically limited in this application. In this way, combined with virtual data visualization technology, the system can dynamically display production data, support multi-level monitoring and early warning functions, help improve production efficiency and equipment utilization, and reduce downtime.

[0081] According to the three-dimensional visualization method provided by the present application, after dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the three-dimensional visualization method further includes:

[0082] I: In response to a user's selection operation on any device model in the target three-dimensional model, a target device is determined, and historical operation data of the target device in a first historical time period is obtained.

[0083] II: Generate a data change curve graph corresponding to the target device based on the historical operation data and display it.

[0084] In the specific implementation of steps I and II above, in response to a user selecting any device model in the target three-dimensional model, a target device is determined, and historical operating data of the target device within a first historical time period is obtained. Based on the historical operating data of the target device, a data change curve graph corresponding to the target device is generated and displayed.

[0085] According to the three-dimensional visualization method provided by the present application, after obtaining the target three-dimensional model corresponding to the smart cockpit production line, the three-dimensional visualization method further includes:

[0086] A: Send the target three-dimensional model to a virtual reality interactive device.

[0087] B: receiving an operation instruction for the target three-dimensional model sent by the virtual reality interaction device, adjusting the target three-dimensional model based on the operation instruction, and sending the adjusted target three-dimensional model to the virtual reality interaction device.

[0088] Here, a virtual reality interactive device refers to a hardware device used to perceive user actions and enable natural interaction. A virtual reality interactive device may be a pair of VR glasses, which is not specifically limited in this application. A virtual reality interactive device can provide a perceptual experience similar to the real physical world through virtual remote sensing technology.

[0089] Regarding steps A and B above, during implementation, the target 3D model is sent to a virtual reality interaction device. The virtual reality interaction device can display the target 3D model while capturing the user's operations or behaviors, allowing interaction with the virtual environment through gestures, eye tracking, or other natural interaction methods. Operational instructions for the target 3D model are received from the virtual reality interaction device, and the target 3D model is adjusted based on the operation instructions. The adjusted target 3D model is then sent to the virtual reality interaction device, allowing the user to interact with the target 3D model in a natural way. In this way, through virtual remote sensing technology, users no longer need to directly operate physical devices, but instead control them through an interactive interface in the virtual environment. When users interact with the system, virtual remote sensing not only provides input signals but also provides real-time feedback. Virtual remote sensing can also create an immersive virtual environment, enhancing the user's sensory experience. Through devices such as head-mounted displays (HMDs), panoramic displays, and stereo sound, users can feel as if they are in a real production line environment, intuitively observing the production process and controlling related equipment in real time. This not only improves the user's operational experience but also enhances the interactivity of the interactive system. Virtual remote sensing, incorporated into the intelligent cockpit production line's 3D visualization control system, significantly enhances the user experience and system interactivity by introducing interactive methods such as gesture control, device operation, and real-time feedback. OSG, with its powerful 3D rendering and input processing capabilities, supports both virtual remote sensing and human-computer interaction, ensuring the entire system possesses both efficient visualization capabilities and rich interactivity.

[0090] In this way, this application is based on the rendering and human-computer interaction functions of the OSG three-dimensional graphics engine, and the system provides a smooth and intuitive user experience. Operators can remotely monitor and operate through functions such as virtual remote sensing, which improves the convenience and safety of operations.

[0091] According to the three-dimensional visualization method provided by the present application, after obtaining the target three-dimensional model corresponding to the smart cockpit production line, the three-dimensional visualization method further includes:

[0092] (1) Obtain the second historical time period selected by the user.

[0093] (2) Obtain historical production data corresponding to the smart cockpit production line in the second historical time period, and dynamically display the historical production status of the smart cockpit production line based on the target three-dimensional model and the historical production data.

[0094] For the above steps (1) to (2), in the specific implementation, the second historical time period selected by the user is obtained, and the historical production data corresponding to the smart cockpit production line in the second historical time period is obtained. Here, after obtaining the historical production data, the data can also be preprocessed, such as cleaning the data, removing outliers and missing values, which is not specifically limited in this application. Then, based on the target three-dimensional model and combined with the historical production data, the historical production status of the smart cockpit production line is dynamically displayed. Here, the historical production data is assigned to historical time points, and the equipment status of the smart cockpit production line is mapped to the entity in the target three-dimensional model according to the historical production data at different historical time points. According to the changes in the equipment status, the corresponding animation effect is generated to dynamically display the historical production status of the smart cockpit production line. In this way, the historical data within the historical time period selected by the user can be obtained, the equipment status in the three-dimensional model can be dynamically adjusted according to the historical data, and the historical status of the production line can be dynamically reproduced in the three-dimensional model, thereby restoring the actual operation of the production line within the time period.

[0095] The three-dimensional visualization method of the smart cockpit production line provided in an embodiment of the present application first performs three-dimensional modeling of the smart cockpit production line based on a multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the smart cockpit production line; then, image information of the environment in which the smart cockpit production line is located is obtained, and the initial three-dimensional model is rendered using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line; real-time operation data of the production equipment is obtained through monitoring equipment deployed on the production equipment in the smart cockpit production line; finally, the real-time operation data is dynamically associated with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model.

[0096] Through multi-level modeling and 3D visualization technology, this application can present the structure and operating status of the production line in a highly accurate and intuitive manner, greatly improving the transparency and manageability of the production process. It also achieves real-time synchronization of production data through the collection of operating data, ensuring data consistency between the virtual workshop and the physical workshop, so that the production status can be reflected in the 3D visualization system in real time, facilitating the timely discovery and resolution of problems. Through the comprehensive application of technologies such as digital modeling, 3D visualization, data association and human-computer interaction, this application has significantly improved the intelligence level and operating efficiency of the smart cockpit production line, providing strong technical support for production management.

[0097] See also Figure 2 、 Figure 3 , Figure 2 This is one of the structural schematic diagrams of a three-dimensional visualization device for an intelligent cockpit production line provided in an embodiment of the present application. Figure 3 This is a second structural diagram of a three-dimensional visualization device for an intelligent cockpit production line provided in an embodiment of the present application. Figure 2 As shown in , the three-dimensional visualization device 200 includes:

[0098] A model building module 201 is configured to perform three-dimensional modeling of the intelligent cockpit production line based on a multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the intelligent cockpit production line;

[0099] A model rendering module 202 is configured to obtain image information of the environment in which the smart cockpit production line is located, and render the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line;

[0100] An operation data acquisition module 203 is configured to acquire real-time operation data of the production equipment through monitoring devices deployed on the production equipment in the smart cockpit production line;

[0101] The data association module 204 is configured to dynamically associate the real-time operation data with the target three-dimensional model, so as to visualize the real-time operation data through the target three-dimensional model.

[0102] Furthermore, when the model building module 201 is used to perform three-dimensional modeling on the smart cockpit production line based on the multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the smart cockpit production line, the model building module 201 is further used to:

[0103] Obtaining a spatial layout diagram corresponding to the smart cockpit production line, and dividing the smart cockpit production line into levels based on the spatial layout diagram to determine multiple production levels and a target layout diagram corresponding to each production level;

[0104] For each production level, based on the target layout corresponding to the production level, determine the parameter information corresponding to each production location in the production level, as well as the parameter information corresponding to each production equipment in each production location;

[0105] Build a structural framework model for each production location based on the parameter information corresponding to each production location, and build a device model for each production device based on the parameter information corresponding to each production device;

[0106] According to the target layout diagram, the equipment model of each production equipment is added to the structural framework model of the corresponding production location to obtain a three-dimensional model corresponding to the production level;

[0107] According to the spatial layout diagram, the three-dimensional models corresponding to each production level are spliced to obtain an initial three-dimensional model corresponding to the smart cockpit production line.

[0108] Furthermore, when the model rendering module 202 is used to render the initial three-dimensional model using the image information to obtain the target three-dimensional model corresponding to the smart cockpit production line, the model rendering module 202 is further used to:

[0109] Converting the initial three-dimensional model into a mesh three-dimensional model;

[0110] determining a target image in the image information corresponding to a grid element of the grid three-dimensional model;

[0111] The grid three-dimensional model is converted into a texture three-dimensional model according to a target image corresponding to each grid element, and the texture three-dimensional model is used as the target three-dimensional model.

[0112] For further information, see Figure 3 The three-dimensional visualization device 200 further includes a fault monitoring module 205. After dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the fault monitoring module 205 is configured to:

[0113] For each production equipment, when a fault is detected in the production equipment based on the real-time operation data of the production equipment, the equipment model corresponding to the production equipment in the target three-dimensional model is displayed in a specific color.

[0114] For further information, see Figure 3 The three-dimensional visualization device 200 further includes a curve graph generating module 206. After dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the curve graph generating module 206 is configured to:

[0115] In response to a user selecting any device model in the target three-dimensional model, determining a target device and obtaining historical operating data of the target device within a first historical time period;

[0116] A data change curve graph corresponding to the target device is generated based on the historical operation data and displayed.

[0117] For further information, see Figure 3 The three-dimensional visualization device 200 further includes an interaction module 207. After obtaining the target three-dimensional model corresponding to the intelligent cockpit production line, the interaction module 207 is used to:

[0118] Sending the target three-dimensional model to a virtual reality interactive device;

[0119] An operation instruction for the target three-dimensional model sent by the virtual reality interaction device is received, the target three-dimensional model is adjusted based on the operation instruction, and the adjusted target three-dimensional model is sent to the virtual reality interaction device.

[0120] For further information, see Figure 3 The three-dimensional visualization device 200 further includes a historical production status display module 208. After obtaining the target three-dimensional model corresponding to the smart cockpit production line, the historical production status display module 208 is used to:

[0121] Get the second historical time period selected by the user;

[0122] Obtain historical production data corresponding to the smart cockpit production line in a second historical time period, and dynamically display the historical production status of the smart cockpit production line based on the target three-dimensional model and in combination with the historical production data.

[0123] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown in FIG, the electronic device 400 includes a processor 410 , a memory 420 and a bus 430 .

[0124] The memory 420 stores machine-readable instructions executable by the processor 410. When the electronic device 400 is running, the processor 410 communicates with the memory 420 via the bus 430. When the machine-readable instructions are executed by the processor 410, the above-mentioned Figure 1 The steps of the three-dimensional visualization method of the intelligent cockpit production line in the method embodiment shown are specifically implemented in accordance with the method embodiment and will not be described in detail here.

[0125] The embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 The steps of the three-dimensional visualization method of the intelligent cockpit production line in the method embodiment shown are specifically implemented in accordance with the method embodiment and will not be described in detail here.

[0126] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0127] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. There may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some communication interface, indirect coupling or communication connection of devices or units, which may be electrical, mechanical or other forms.

[0128] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0129] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0130] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0131] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The scope of protection of the present application is not limited thereto. Although the present application has been described in detail with reference to the above-mentioned embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-mentioned embodiments within the technical scope disclosed in the present application, or perform equivalent replacements for some of the technical features thereof. These modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A 3D visualization method for an intelligent cockpit production line, characterized in that: The three-dimensional visualization method comprises: Based on a multi-level modeling algorithm, a three-dimensional model is performed on the intelligent cockpit production line to obtain an initial three-dimensional model corresponding to the intelligent cockpit production line; Acquiring image information of an environment where the smart cockpit production line is located, and rendering the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line; Acquiring real-time operating data of the production equipment through monitoring equipment deployed on the production equipment in the smart cockpit production line; The real-time operation data is dynamically associated with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model.

2. The three-dimensional visualization method according to claim 1, characterized in that: The method of performing three-dimensional modeling of the intelligent cockpit production line based on the multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the intelligent cockpit production line includes: Obtaining a spatial layout diagram corresponding to the smart cockpit production line, and dividing the smart cockpit production line into levels based on the spatial layout diagram to determine multiple production levels and a target layout diagram corresponding to each production level; For each production level, based on the target layout corresponding to the production level, determine the parameter information corresponding to each production location in the production level, as well as the parameter information corresponding to each production equipment in each production location; Build a structural framework model for each production location based on the parameter information corresponding to each production location, and build a device model for each production device based on the parameter information corresponding to each production device; According to the target layout diagram, the equipment model of each production equipment is added to the structural framework model of the corresponding production location to obtain a three-dimensional model corresponding to the production level; According to the spatial layout diagram, the three-dimensional models corresponding to each production level are spliced to obtain an initial three-dimensional model corresponding to the smart cockpit production line.

3. The three-dimensional visualization method according to claim 1, characterized in that: The rendering of the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line includes: Converting the initial three-dimensional model into a mesh three-dimensional model; determining a target image in the image information corresponding to a grid element of the grid three-dimensional model; The grid three-dimensional model is converted into a texture three-dimensional model according to a target image corresponding to each grid element, and the texture three-dimensional model is used as the target three-dimensional model.

4. The three-dimensional visualization method according to claim 2, characterized in that: After dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the three-dimensional visualization method further includes: For each production equipment, when a fault is detected in the production equipment based on the real-time operation data of the production equipment, the equipment model corresponding to the production equipment in the target three-dimensional model is displayed in a specific color.

5. The three-dimensional visualization method according to claim 2, characterized in that: After dynamically associating the real-time operation data with the target three-dimensional model to visualize the real-time operation data through the target three-dimensional model, the three-dimensional visualization method further includes: In response to a user selecting any device model in the target three-dimensional model, determining a target device and obtaining historical operating data of the target device within a first historical time period; A data change curve graph corresponding to the target device is generated based on the historical operation data and displayed.

6. The three-dimensional visualization method according to claim 1, characterized in that: After obtaining the target three-dimensional model corresponding to the smart cockpit production line, the three-dimensional visualization method further includes: Sending the target three-dimensional model to a virtual reality interaction device; An operation instruction for the target three-dimensional model sent by the virtual reality interaction device is received, the target three-dimensional model is adjusted based on the operation instruction, and the adjusted target three-dimensional model is sent to the virtual reality interaction device.

7. The three-dimensional visualization method according to claim 1, characterized in that: After obtaining the target three-dimensional model corresponding to the smart cockpit production line, the three-dimensional visualization method further includes: Get the second historical time period selected by the user; Obtain historical production data corresponding to the smart cockpit production line in a second historical time period, and dynamically display the historical production status of the smart cockpit production line based on the target three-dimensional model and in combination with the historical production data.

8. A three-dimensional visualization device for an intelligent cockpit production line, characterized in that: The three-dimensional visualization device comprises: A model building module is used to perform three-dimensional modeling of the intelligent cockpit production line based on a multi-level modeling algorithm to obtain an initial three-dimensional model corresponding to the intelligent cockpit production line; a model rendering module, configured to obtain image information of the environment in which the smart cockpit production line is located, and render the initial three-dimensional model using the image information to obtain a target three-dimensional model corresponding to the smart cockpit production line; An operation data acquisition module, configured to acquire real-time operation data of the production equipment through monitoring equipment deployed on the production equipment in the smart cockpit production line; A data association module is used to dynamically associate the real-time operation data with the target three-dimensional model so as to visualize the real-time operation data through the target three-dimensional model.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory communicate through the bus. When the processor is running, the machine-readable instructions execute the steps of the three-dimensional visualization method of the intelligent cockpit production line as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, executes the steps of the three-dimensional visualization method for the intelligent cockpit production line according to any one of claims 1 to 7.

Images