Production line three-dimensional visual reproduction method, storage medium and electronic equipment

Abstract

The invention discloses a production line three-dimensional visual reproduction method, a storage medium and electronic equipment, and the method comprises the steps: obtaining the real-time process data of the operation of all equipment in a production line, and filtering and fusing the real-time process data to obtain the real-time operation data of the equipment. According to the method, a digital twin production line corresponding to a real production line is constructed, the digital twin production line comprises a moving part model and an environment part model corresponding to each device, and the moving part models act according to real-time operation data, so that three-dimensional visualization of the real production line is realized. In the digital twin production line, each device acts according to the real-time operation data of the devices in the actual production line, and the device failure process can be reproduced in real time in the virtual three-dimensional environment, so that positioning and troubleshooting can be carried out in time when the devices are abnormal.

Description

Technical Field

[0001] The present application relates to the technical field of application of industrial Internet of Things in intelligent manufacturing, and in particular to a three-dimensional visualization reproduction method for a production line, a storage medium and an electronic device. Background Art

[0002] In current industrial application scenarios, video surveillance is often used to record the operation process of on-site equipment, which is used as an auxiliary tool for equipment anomalies and fault cause analysis. Video surveillance uses cameras. In actual applications, the cameras are divided into different angles. Each camera monitors the scene within its monitoring range and then reports to the processing system, which determines whether the operation process of the on-site equipment is abnormal. The camera captures the scene and can only identify the faults that appear. Most faults may be caused by abnormal operation data of multiple devices. Therefore, when a fault occurs, a solution that can quickly locate the fault location is needed. Summary of the invention

[0003] The present application aims to provide a three-dimensional visualization reproduction method of a production line, a storage medium and an electronic device, so as to quickly locate the fault position when a production line fault is detected.

[0004] In a first aspect, the technical solution of the present application provides a method for three-dimensional visualization reproduction of a production line, comprising:

[0005] Obtain real-time process data of each device in the production line;

[0006] Filtering the real-time process data, and fusing the filtered real-time process data to obtain real-time operation data of the device;

[0007] A digital twin production line corresponding to the real production line is constructed, wherein the digital twin production line includes a moving component model and an environmental component model corresponding to each device, and the moving component model acts according to the real-time operation data.

[0008] The three-dimensional visualization reproduction method of the production line described in some schemes, wherein a digital twin production line corresponding to the real production line is constructed, wherein the digital twin production line includes a moving component model corresponding to each device, and wherein the moving component model acts according to the real-time operation data, including:

[0009] The design data of the actual production line is called, and the moving parts model corresponding to each device recorded in the design data is extracted and embedded in the digital twin production line.

[0010] The three-dimensional visualization reproduction method of the production line described in some schemes, wherein the digital twin production line corresponding to the real production line is constructed, the digital twin production line includes a moving part model corresponding to each device, and the moving part model acts according to the real-time operation data, and further includes:

[0011] Collecting video / image information of the environment where the actual production line is located;

[0012] Generate an environmental component model based on the video / image information, and embed the environmental component model into the digital twin production line.

[0013] The three-dimensional visualization reproduction method of the production line described in some solutions also includes:

[0014] The information data of the digital twin production line is stored in real time.

[0015] The three-dimensional visualization reproduction method of the production line described in some solutions also includes:

[0016] Receive a playback command signal, retrieve and play the stored information data of the digital twin production line according to the playback command signal.

[0017] In some solutions, the three-dimensional visualization reproduction method of the production line, wherein the real-time process data is filtered, and the filtered real-time process data is integrated to obtain the real-time operation data of the equipment, and the filtered real-time process data is integrated, including:

[0018] The real-time process data of different devices at the same workstation are synchronized in time sequence and integrated into real-time operation data in the form of a single data stream;

[0019] The real-time operation data is converted into corresponding device control signals, and the converted device control signals are integrated into the real-time operation data in the form of a single data stream.

[0020] The three-dimensional visualization reproduction method of the production line described in some solutions also includes:

[0021] Acquiring capacity data of the actual production line, and if the capacity data indicates a capacity bottleneck, displaying real-time process data of the bottleneck station in the digital twin production line;

[0022] A quality traceability demand signal is obtained, and quality data of each joint node involved in the processing flow process corresponding to the quality traceability demand is displayed in the digital twin production line.

[0023] In a second aspect, the technical solution of the present application provides a computer-readable storage medium, in which program information is stored. After a computer reads the program information, the computer executes the three-dimensional visualization reproduction method of the production line described in any one of the first aspects.

[0024] In a third aspect, the technical solution of the present application provides an electronic device, comprising at least one processor and at least one memory, wherein at least one of the memories stores program information, and after reading the program information, at least one of the processors executes the three-dimensional visualization reproduction method of the production line described in any one of the first aspects.

[0025] In a fourth aspect, the technical solution of the present application provides a computer program product, including a computer program / instruction, characterized in that when the computer program / instruction is executed by a processor, the steps of the three-dimensional visualization reproduction method of the production line described in any one of the first aspects are implemented.

[0026] The above technical solution has the following beneficial effects:

[0027] The three-dimensional visualization reproduction method, storage medium and electronic device of the production line provided in the present application obtain the real-time process data of each device in the production line, and obtain the real-time operation data of the device after filtering and fusing it. A digital twin production line corresponding to the real production line is constructed, and the digital twin production line includes a moving component model and an environmental component model corresponding to each device. The moving component model acts according to the real-time operation data, thereby realizing the three-dimensional visualization of the actual production line. In the digital twin production line, each device acts according to the real-time operation data of the device in the actual production line, and can reproduce the equipment failure process in real time or in a virtual three-dimensional environment, so that the equipment can be located and troubleshooted in time when it is abnormal. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a flow chart of a method for three-dimensional visualization reproduction of a production line in one embodiment of the present application;

[0029] Figure 2 This is a flow chart of a method for three-dimensional visualization reproduction of a production line in another embodiment of the present application;

[0030] Figure 3 A schematic diagram of the hardware connection relationship of an electronic device described in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The specific implementation of the present application is further described below with reference to the accompanying drawings.

[0032] It is easy to understand that according to the technical solution of the present application, without changing the essential spirit of the present application, a variety of structural modes and implementation modes that can be replaced by those skilled in the art can be replaced with each other. Therefore, the following specific implementation modes and drawings are only exemplary descriptions of the technical solution of the present application, and should not be regarded as the entirety of the present application or as a limitation or restriction on the technical solution of the application.

[0033] The directional terms such as up, down, left, right, front, back, front, back, top, bottom, etc. mentioned or may be mentioned in this specification are defined relative to the structures shown in the drawings. They are relative concepts and may change accordingly according to different positions and different usage conditions. Therefore, these or other directional terms should not be interpreted as restrictive terms.

[0034] The embodiment of the present application provides a method for reproducing a three-dimensional visualization of a production line, which can be applied to a processor, and the processor can be set in a production line control system, such as Figure 1 As shown, the method comprises the following steps:

[0035] S10: Acquire real-time process data of each device in the production line.

[0036] Specifically, the industrial Internet of Things technology can be used to collect real-time process data of equipment operation. In an actual production line, there can be many types of equipment, such as robots, various PLCs, various MESs or other field equipment. Therefore, real-time process data includes robot data, PLC data, MES data or other field data. These data can be sent by the equipment control device or after sensor detection.

[0037] S20: Filter the real-time process data, and fuse the filtered real-time process data to obtain real-time operation data of the device.

[0038] By filtering, obviously abnormal data and data that has no analytical significance can be removed, thereby reducing the amount of meaningless data to be processed and improving processing efficiency.

[0039] The fusion can be processed according to different actual situations. Because in the actual production line, the real-time process data of each device may not be directly applied to the virtual three-dimensional environment, it is necessary to integrate different real-time process data to obtain a single data stream, so that the single data stream can correspond to a virtual three-dimensional device module in the virtual three-dimensional environment.

[0040] S30: Construct a digital twin production line corresponding to the real production line, wherein the digital twin production line includes a moving component model and an environmental component model corresponding to each device, and the moving component model acts according to the real-time operation data.

[0041] Digital twin refers to the technology that uses physical models, sensor data and simulation processes to create digital mappings of physical objects in virtual space. The characteristics of digital twin technology include interoperability, scalability, and real-time performance. In specific implementation, the existing digital twin platform can be used to map the actual production line.

[0042] The method provided in the above embodiment obtains the real-time process data of each device in the production line, and obtains the real-time operation data of the device after filtering and fusing it. A digital twin production line corresponding to the real production line is constructed, and the digital twin production line includes a moving component model and an environmental component model corresponding to each device. The moving component model acts according to the real-time operation data, thereby realizing three-dimensional visualization of the actual production line. In the digital twin production line, each device acts according to the real-time operation data of the device in the actual production line, and can reproduce the device failure process in real time or in a virtual three-dimensional environment, so that the device can be located and troubleshooted in time when it is abnormal.

[0043] In some embodiments, the digital twin production line corresponding to the real production line is constructed in step S30, and the digital twin production line includes a moving component model corresponding to each device, and the moving component model acts according to the real-time operation data, including drive data fusion for reproducing the production line operation process, specifically including:

[0044] S301: Call the design data of the actual production line, extract the moving part model corresponding to each device recorded in the design data, and embed it into the digital twin production line.

[0045] That is, when the production line is designed, the 3D models of each device have been pre-designed, and these 3D models are used as models of moving parts. This step can directly retrieve the relevant model data in the design data without the need for separate processing, making rational use of existing resources and improving efficiency.

[0046] According to the behavioral model definition of the equipment, in each digital twin production line refresh cycle, the motion data of the equipment is calculated using the received real-time operation data in conjunction with the kinematic definition. This data will serve as the basis for the corresponding moving parts model state when the digital twin production line is refreshed next time.

[0047] S302: Collect video / image information of the environment where the actual production line is located; generate an environmental component model based on the video / image information, and embed the environmental component model into the digital twin production line.

[0048] Environmental components may include fixed frames, partitions, protective covers, walls, etc. These components are fixed in the environment and can be identified by taking pictures with a camera or the like. By using the camera's setting position, shooting angle, resolution and other information, the position of each environmental component in the actual production line can be determined, and based on this position, the retrieved model can be directly embedded into the digital twin production line in a mapping manner.

[0049] Through the solution of this embodiment, it is possible to achieve complete correspondence between the actual production line and the digital twin production line, and both moving parts and stationary environmental parts in the environment can be mapped and restored in the digital twin production line.

[0050] Furthermore, if Figure 2 As shown, the method further comprises the following steps:

[0051] S40: Storing information data of the digital twin production line in real time.

[0052] That is, the action status of each moving component model in the digital twin production line at each moment is recorded and stored for subsequent viewing.

[0053] S50: Receive a playback command signal, retrieve and play the stored information data of the digital twin production line according to the playback command signal.

[0054] In this solution, when the stored information data of the digital twin production line is played back, the on-site equipment operation process of the actual production line can be reproduced, and the operating status of the equipment when it fails can be observed from any perspective by integrating process data such as sensors.

[0055] Further preferably, in step S20, the real-time process data is filtered, and the filtered real-time process data is merged to obtain the real-time operation data of the device, and the filtered real-time process data is merged, including:

[0056] S201: The real-time process data of different devices at the same workstation are synchronized in time sequence and integrated into real-time operation data in the form of a single data stream.

[0057] For example, a workstation may contain multiple moving parts, such as a lift and a robot. The data sources of these two moving parts are different. In order to synchronously drive the digital twin to restore the movement process of the on-site equipment, it is necessary to synchronize and fuse the data from these two independent sources to generate a single data stream to drive the movement of the digital twin.

[0058] S202: Convert the real-time operation data into corresponding device control signals, and integrate the converted device control signals into real-time operation data in the form of a single data stream.

[0059] For example, the original data of the equipment may not be able to directly drive the digital twin to accurately restore the on-site actions. For example, in the process of the gripper grasping the workpiece, the original data may only have the opening and closing signals of the gripper, and cannot provide the part model on the gripper. In this case, it is necessary to fuse the action signal of the gripper and the material flow data to determine the part information and grasping and releasing actions grasped by the gripper at this time, and fuse them into a single signal to transmit to the digital twin to drive the twin to restore the on-site actions in real time.

[0060] In some schemes, such as Figure 2 As shown, the method also includes:

[0061] S60: Acquire the capacity data of the actual production line, and if the capacity data indicates a capacity bottleneck, display the real-time process data of the bottleneck workstation in the digital twin production line;

[0062] For example, when a production line encounters a capacity bottleneck, the capacity data in the production control system can be integrated with the digital twin production line to directly display the real-time operation status of the bottleneck workstation in the three-dimensional environment of the digital twin production line, making it convenient for operators to quickly locate the problem points that cause the capacity bottleneck and assist in on-site decision-making.

[0063] S70: Obtain a quality traceability demand signal, and display quality data of each joint node involved in the processing flow process corresponding to the quality traceability demand in the digital twin production line.

[0064] When it is necessary to trace the production process of a product or a batch of products, the quality process data and the digital twin production line can be integrated to display the processing flow process of the traceable product in the three-dimensional environment of the digital twin production line, and display the quality data of the joint nodes, so that operators can quickly trace and troubleshoot quality problems.

[0065] An embodiment of the present application also provides a computer-readable storage medium, in which program information is stored. After a computer reads the program information, it executes the three-dimensional visualization reproduction method of a production line described in any one of the schemes in the above method embodiments.

[0066] An embodiment of the present application also provides a computer program product, including a computer program / instruction, characterized in that when the computer program / instruction is executed by a processor, the three-dimensional visualization reproduction method of the production line described in any one of the schemes in the above method embodiments is implemented.

[0067] The present application also provides an electronic device, such as Figure 3As shown, the electronic device includes at least one processor 31 and at least one memory 32, at least one of the memories 32 stores program information, and at least one of the processors 31 reads the program information and executes the three-dimensional visualization reproduction method of the production line described in any of the above method embodiments. The device may also include: an input device 33 and an output device 34. The processor 31, the memory 32, the input device 33 and the output device 34 can be connected in communication. The memory 32, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The processor 31 executes various functional applications and data processing by running the non-volatile software programs, instructions and modules stored in the memory 32, that is, the three-dimensional visualization reproduction method of the production line provided by any of the above schemes is realized. The memory 32 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required by at least one function; the data storage area may store data created according to the use of the three-dimensional visualization reproduction method of the production line, etc. In addition, the memory 32 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 32 may optionally include a memory remotely arranged relative to the processor 31, and these remote memories may be connected to a device for executing the three-dimensional visualization reproduction method of the production line through a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof. The input device 33 may receive input user clicks, and generate signal inputs related to user settings and function controls of the three-dimensional visualization reproduction method of the production line. The output device 34 may include a display device such as a display screen. When the one or more modules are stored in the memory 32, when they are run by the one or more processors 31, the three-dimensional visualization reproduction method of the production line in any of the above-mentioned method embodiments is executed.

[0068] As needed, the above technical solutions can be combined to achieve the best technical effect.

[0069] The above are only the principles and preferred embodiments of the present application. It should be noted that, for ordinary technicians in this field, on the basis of the principles of the present application, several other modifications can be made, which should also be considered as the protection scope of the present application.

Claims

1. A method for three-dimensional visualization reproduction of a production line, characterized in that: include: Obtain real-time process data of each device in the production line; Filtering the real-time process data, and fusing the filtered real-time process data to obtain real-time operation data of the device; A digital twin production line corresponding to the real production line is constructed, wherein the digital twin production line includes a moving component model and an environmental component model corresponding to each device, and the moving component model acts according to the real-time operation data.

2. The method for three-dimensional visualization of a production line according to claim 1, characterized in that: The digital twin production line corresponding to the real production line is constructed, and the digital twin production line includes a moving component model corresponding to each device, and the moving component model acts according to the real-time operation data, including: The design data of the actual production line is called, and the moving parts model corresponding to each device recorded in the design data is extracted and embedded in the digital twin production line.

3. The three-dimensional visualization reproduction method of a production line according to claim 2, characterized in that: The digital twin production line corresponding to the real production line is constructed, wherein the digital twin production line includes a moving component model corresponding to each device, and the moving component model acts according to the real-time operation data, and further includes: Collecting video / image information of the environment where the actual production line is located; Generate an environmental component model based on the video / image information, and embed the environmental component model into the digital twin production line.

4. The three-dimensional visualization reproduction method of a production line according to any one of claims 1 to 3, characterized in that: Also includes: The information data of the digital twin production line is stored in real time.

5. The method for three-dimensional visualization of a production line according to claim 4, characterized in that: Also includes: Receive a playback command signal, retrieve and play the stored information data of the digital twin production line according to the playback command signal.

6. The method for three-dimensional visualization of a production line according to claim 5, characterized in that: The filtering of the real-time process data and fusing the filtered real-time process data to obtain the real-time operation data of the device, wherein the fusing of the filtered real-time process data includes: The real-time process data of different devices at the same workstation are synchronized in time sequence and integrated into real-time operation data in the form of a single data stream; The real-time operation data is converted into corresponding device control signals, and the converted device control signals are integrated into the real-time operation data in the form of a single data stream.

7. The method for three-dimensional visualization of a production line according to claim 6, characterized in that: Also includes: Acquiring capacity data of the actual production line, and if the capacity data indicates a capacity bottleneck, displaying real-time process data of the bottleneck station in the digital twin production line; A quality traceability demand signal is obtained, and quality data of each joint node involved in the processing flow process corresponding to the quality traceability demand is displayed in the digital twin production line.

8. A computer-readable storage medium, characterized in that: The storage medium stores program information, and the computer reads the program information and executes the three-dimensional visualization reproduction method of the production line according to any one of claims 1 to 7.

9. An electronic device, characterized in that: The electronic device includes at least one processor and at least one memory, at least one of the memories stores program information, and at least one of the processors reads the program information and executes the three-dimensional visualization reproduction method of the production line according to any one of claims 1-7.

10. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the steps of the production line three-dimensional visualization reproduction method described in any one of claims 1-7 are implemented.

Images