Equipment online three-dimensional modeling visual management method and system

Abstract

The invention discloses an equipment online three-dimensional modeling visual management method. The method comprises the following steps: acquiring normal data of equipment during operation; a sensor is connected with an operation part of the equipment to obtain operation data; sending the operation data to a processing end of a client; and the processing end judges whether the running parts have problems or not based on the normal data and the running data, and if yes, the parts with the problems are displayed on the processing end of the client in a visual mode. The method has the remarkable advantages in the aspects of real-time monitoring, fault early warning, data-driven decision making, maintenance efficiency improvement, customer satisfaction improvement and the like, and a powerful guarantee can be provided for stable operation of equipment and long-term benefits of customers.

Description

Technical Field

[0001] The present invention relates to the field of digital twin technology, and in particular to an online three-dimensional modeling visualization management system for equipment. Background Art

[0002] Device data twin (DTD, Digital Twin of Devices) technology, as a core component of the industrial Internet and intelligent manufacturing fields, accurately reproduces the real-time status and dynamic behavior of physical devices through deep digital means.

[0003] Customers usually only know how to use the equipment they sell, but do not understand its operating principle. When there is a problem with the equipment, they can only notify the manufacturer to send maintenance personnel to the site for maintenance. This is a waste of time. Therefore, how to combine digital twins to detect equipment and identify problematic parts in a timely manner has become an urgent problem to be solved in this field. Summary of the invention

[0004] In view of the above-mentioned defects, the purpose of the present invention is to propose a method and system for visual management of online three-dimensional modeling of equipment, which can realize self-detection and prompt of faults of actual equipment, and solve the problem of time waste caused by the need for maintenance personnel to come for on-site maintenance.

[0005] To achieve this purpose, the present invention adopts the following technical solution: a method for visual management of online 3D modeling of equipment, comprising the following steps:

[0006] Get normal data of the device during operation;

[0007] Connect with the running parts of the equipment through sensors to obtain running data;

[0008] Sending operation data to the client's processing end;

[0009] The processing end determines whether there is a problem with the operating parts based on normal data and operating data. If there is a problem, the problematic parts are displayed in a visual form to the customer's processing end.

[0010] Preferably, the following steps need to be performed before displaying the information in a visual form on the client's processing end:

[0011] Build a 3D model database of parts;

[0012] Construct a coordinate system, obtain the center coordinates of each part in the equipment in the assembled state, and the assembly relationship between the parts, and synthesize the center coordinates and assembly relationship of each part into an assembly file;

[0013] Convert assembly files into digital signals and send them to the client’s processing end;

[0014] The processing end calls the three-dimensional model data, constructs a three-dimensional model of the equipment based on the center coordinates and assembly relationships of the parts, and displays the three-dimensional model of the equipment in a visual form on the customer's processing end.

[0015] Preferably, sending the operation data to the client's processing terminal comprises the following steps:

[0016] The sensor establishes the communication connection with the processing end;

[0017] Convert the operation data into the specified data format;

[0018] Send the converted operation data to the processing end.

[0019] Preferably, the specific steps of converting the operating data into a prescribed data format are as follows:

[0020] The operation data includes operation instruction data and parameter data;

[0021] Find the corresponding code in the preset instruction code table according to the operation instruction data, and combine the code upload time to generate the first data;

[0022] The first data and parameter data with the same upload time are stored in the same data file.

[0023] Preferably, the specific steps of judging whether there is a problem with the running parts based on the normal data and the running data are as follows:

[0024] Obtain all codes at the same upload time in the data file, and find out whether there are conflicting codes based on the code table. If so, determine that there is a problem;

[0025] Obtaining a first difference between the parameter data and the normal data, and if the first difference is greater than a threshold, determining that there is a problem;

[0026] Parts corresponding to the execution problem code and / or parts whose first difference is greater than a threshold are obtained as problem parts, and the problem parts are marked.

[0027] Preferably, the network medium for establishing the communication connection is a wireless medium;

[0028] The wireless medium includes at least one of Bluetooth, WIFI and 4G;

[0029] The database includes at least one of an OSS storage platform and a local database;

[0030] The communication connection is based on the TCP / IP protocol.

[0031] The equipment online 3D modeling visualization management system described above uses the equipment online 3D modeling visualization management method described above, including a normal data acquisition module, an operation data acquisition module and a visualization module;

[0032] The normal data acquisition module is used to obtain normal data of the device during operation;

[0033] The operation data acquisition module is used to connect with the operation parts of the equipment through sensors to acquire operation data;

[0034] Sending operating data to the customer's visualization module;

[0035] The visualization module is used to determine whether there is a problem with the operating parts based on normal data and operating data. If there is a problem, the problematic parts are displayed in a visualized form on the customer's processing end.

[0036] Preferably, the visualization module includes a three-dimensional model visualization submodule;

[0037] The three-dimensional model visualization submodule is used to construct a three-dimensional model database of parts;

[0038] Construct a coordinate system, obtain the center coordinates of each part in the equipment in the assembled state, and the assembly relationship between the parts, and synthesize the center coordinates and assembly relationship of each part into an assembly file;

[0039] Convert assembly files into digital signals and send them to the client’s processing end;

[0040] The processing end calls the three-dimensional model data, constructs a three-dimensional model of the equipment based on the center coordinates and assembly relationships of the parts, and displays the three-dimensional model of the equipment in a visual form on the customer's processing end.

[0041] Preferably, it also includes a data communication submodule, and the data communication submodule is used to establish the communication connection between the sensor and the processing end;

[0042] Convert the operation data into the specified data format;

[0043] Send the converted operation data to the visualization module.

[0044] Preferably, the data communication submodule includes a format conversion unit;

[0045] The format conversion unit is used to find the corresponding code in the preset instruction code table according to the operation instruction data, and combine the code upload time to generate the first data;

[0046] The first data and parameter data with the same upload time are stored in the same data file;

[0047] The visualization module further includes a judgment submodule, which is used to obtain all codes at the same upload time in the data file, find out whether there are conflicting codes based on the code table, and if so, judge that there is a problem;

[0048] Obtain the difference between the parameter data and the normal data. If the difference is greater than a threshold, it is determined that there is a problem.

[0049] Parts having execution problem codes and / or first difference values ​​greater than a threshold are obtained as problem parts, and the problem parts are marked.

[0050] One of the above technical solutions has the following advantages or beneficial effects: The present invention has significant advantages in achieving real-time monitoring, fault warning, data-driven decision-making, improved maintenance efficiency and improved customer satisfaction, and can provide strong guarantees for the stable operation of the equipment and the long-term interests of customers. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 is a flow chart of an embodiment of the method of the present invention.

[0052] Figure 2 It is a schematic diagram of the structure of an embodiment of the system of the present invention. DETAILED DESCRIPTION

[0053] The embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0054] In the description of the embodiments of the present invention, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0055] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, the meaning of "plurality" is two or more. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0056] like Figures 1-2 As shown, a method for visual management of 3D modeling of equipment online includes the following steps:

[0057] Get normal data of the device during operation;

[0058] Connect with the running parts of the equipment through sensors to obtain running data;

[0059] Sending operation data to the client's processing end;

[0060] The processing end determines whether there is a problem with the operating parts based on normal data and operating data. If there is a problem, the problematic parts are displayed in a visual form to the customer's processing end.

[0061] In the present invention, a three-dimensional twin digital model is constructed at the processing end to display the equipment purchased by the customer. Before the user uses it, the manufacturer will collect the normal data of the equipment during operation, and install corresponding sensors on each part of the equipment to obtain the operation data of the equipment during operation. By matching and judging the operation data with the normal data, it can be known which component has a problem. When a problem occurs, the problematic part will be displayed in a three-dimensional model. The customer only needs to monitor on the processing end, and there is no need for maintenance personnel to come to detect the problem, realizing the real-time monitoring and fault warning functions of the equipment.

[0062] The present invention has significant advantages in achieving real-time monitoring, fault warning, data-driven decision-making, improved maintenance efficiency and improved customer satisfaction, and can provide strong guarantees for the stable operation of equipment and the long-term interests of customers.

[0063] Preferably, the following steps need to be performed before displaying the information in a visual form on the client's processing end:

[0064] Build a 3D model database of parts;

[0065] Construct a coordinate system, obtain the center coordinates of each part in the equipment in the assembled state, and the assembly relationship between the parts, and synthesize the center coordinates and assembly relationship of each part into an assembly file;

[0066] Convert assembly files into digital signals and send them to the client’s processing end;

[0067] The processing end calls the three-dimensional model data, constructs a three-dimensional model of the equipment based on the center coordinates and assembly relationships of the parts, and displays the three-dimensional model of the equipment in a visual form on the customer's processing end.

[0068] Since there are many parts in the equipment, and parts used by different equipment are also reused. In order to better display the user's equipment in a visual form and reduce the difficulty of visualization. In the present invention, parts of different equipment will be constructed and stored in a three-dimensional model database. When constructing a three-dimensional model of the equipment, it will be assembled in the coordinate system. After the equipment is assembled, the center coordinates of different parts are obtained. The location of the parts can be known through the center coordinates. When constructing the three-dimensional model of the equipment, the corresponding parts can be called out according to the assembly file, and the position of the parts can be determined according to the center coordinates, thereby realizing the rapid display of the three-dimensional model of the equipment.

[0069] Preferably, sending the operation data to the client's processing terminal comprises the following steps:

[0070] The sensor establishes the communication connection with the processing end;

[0071] Convert the operation data into the specified data format;

[0072] Send the converted operation data to the processing end.

[0073] Converting the running data into the prescribed data format can ensure the standardization and consistency of the data, so that the processing end can correctly parse and process the received data.

[0074] In addition, in some usage scenarios, due to poor signals, the transmitted data may be lost, or data can only be sent at intervals. By converting the operating data into a specified data format, the data transmission efficiency can be optimized, and data redundancy and transmission time can be reduced. The transmission of data packets can be reduced, and the data transmission interval time can be offset by reducing the data transmission time, thereby achieving timely fault reminders.

[0075] Preferably, the specific steps of converting the operating data into a prescribed data format are as follows:

[0076] The operation data includes operation instruction data and parameter data;

[0077] Find the corresponding code in the preset instruction code table according to the operation instruction data, and combine the code upload time to generate the first data;

[0078] The first data and parameter data with the same upload time are stored in the same data file.

[0079] Since the situations in which the fault occurs are divided into two categories, one is the fault caused by operating errors, and the other is the fault caused by abnormal operating conditions. In order to better distinguish and detect the fault location and cause. In the present invention, the operation data will be divided into operation instruction data and parameter data; wherein the operation instruction data can be the operation instruction executed by the parts, such as requiring robot A to rotate counterclockwise and robot B to swing to the left. The parameter data are the input parameters of the parts when performing the operation and the physical parameters detected during the operation; for example, the input parameters are the rotation angle of robot A, the swing angle of robot B, etc., and the physical parameters are the temperature, humidity, pressure and other parameters at the joints of machine A.

[0080] Since the operation instruction data only needs to determine whether there are conflicting operation instruction data being executed at the same time to determine whether there are faulty parts, the judgment process does not require specific data parameter records, so it only needs to be simplified into corresponding codes. Parameter data requires accurate data for judgment, so it is necessary to retain the parameter data without any simplification.

[0081] Preferably, the specific steps of judging whether there is a problem with the running parts based on the normal data and the running data are as follows:

[0082] Obtain all codes at the same upload time in the data file, and find out whether there are conflicting codes based on the code table. If so, determine that there is a problem;

[0083] Obtaining a first difference between the parameter data and the normal data, and if the first difference is greater than a threshold, determining that there is a problem;

[0084] Parts corresponding to the execution problem code and / or parts whose first difference is greater than a threshold are obtained as problem parts, and the problem parts are marked.

[0085] Manufacturers need to build the corresponding code table in advance. For example, when robot A is performing reverse rotation (code A), robot B cannot perform left swing (code B). At this time, the relationship between code A and code B needs to be associated in the code table. When code A appears, find the code associated with code A in the code table, and then determine whether there is a related code at the same time in the data file to determine whether there is an operational error that causes the fault. The judgment of the corresponding parameter data is relatively simple. Usually, the condition parameters of the equipment during operation need to be maintained within a reasonable range. When they exceed the reasonable range, it means that a problem has occurred. Therefore, it is only necessary to determine whether the first difference is greater than the threshold to determine whether there is an abnormal operating condition and a fault has occurred.

[0086] Preferably, the network medium for establishing the communication connection is a wireless medium;

[0087] The wireless medium includes at least one of Bluetooth, WIFI and 4G;

[0088] The database includes at least one of an OSS storage platform and a local database;

[0089] The communication connection is based on the TCP / IP protocol.

[0090] The equipment online 3D modeling visualization management system described above uses the equipment online 3D modeling visualization management method described above, including a normal data acquisition module, an operation data acquisition module and a visualization module;

[0091] The normal data acquisition module is used to obtain normal data of the device during operation;

[0092] The operation data acquisition module is used to connect with the operation parts of the equipment through sensors to acquire operation data;

[0093] Sending operating data to the customer's visualization module;

[0094] The visualization module is used to determine whether there is a problem with the operating parts based on normal data and operating data. If there is a problem, the problematic parts are displayed in a visualized form on the customer's processing end.

[0095] Preferably, the visualization module includes a three-dimensional model visualization submodule;

[0096] The three-dimensional model visualization submodule is used to construct a three-dimensional model database of parts;

[0097] Construct a coordinate system, obtain the center coordinates of each part in the equipment in the assembled state, and the assembly relationship between the parts, and synthesize the center coordinates and assembly relationship of each part into an assembly file;

[0098] Convert assembly files into digital signals and send them to the client’s processing end;

[0099] The processing end calls the three-dimensional model data, constructs a three-dimensional model of the equipment based on the center coordinates and assembly relationships of the parts, and displays the three-dimensional model of the equipment in a visual form on the customer's processing end.

[0100] Preferably, it also includes a data communication submodule, and the data communication submodule is used to establish the communication connection between the sensor and the processing end;

[0101] Convert the operation data into the specified data format;

[0102] Send the converted operation data to the visualization module.

[0103] Preferably, the data communication submodule includes a format conversion unit;

[0104] The format conversion unit is used to find the corresponding code in the preset instruction code table according to the operation instruction data, and combine the code upload time to generate the first data;

[0105] The first data and parameter data with the same upload time are stored in the same data file;

[0106] The visualization module further includes a judgment submodule, which is used to obtain all codes at the same upload time in the data file, find out whether there are conflicting codes based on the code table, and if so, judge that there is a problem;

[0107] Obtain the difference between the parameter data and the normal data. If the difference is greater than a threshold, it is determined that there is a problem.

[0108] Parts having execution problem codes and / or first difference values ​​greater than a threshold are obtained as problem parts, and the problem parts are marked.

[0109] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0110] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. A method for visual management of 3D modeling on equipment line, characterized in that: The steps include: Get normal data of the device during operation; Connect with the running parts of the equipment through sensors to obtain running data; Sending operation data to the client's processing end; The processing end determines whether there is a problem with the operating parts based on normal data and operating data. If there is a problem, the problematic parts are displayed in a visual form to the customer's processing end.

2. The method for visual management of 3D modeling of equipment online according to claim 1, characterized in that: The following steps need to be performed before the data can be displayed in a visual form on the client's processing end: Build a 3D model database of parts; Construct a coordinate system, obtain the center coordinates of each part in the equipment in the assembled state, and the assembly relationship between the parts, and synthesize the center coordinates and assembly relationship of each part into an assembly file; Convert assembly files into digital signals and send them to the client’s processing end; The processing end calls the three-dimensional model data, constructs a three-dimensional model of the equipment based on the center coordinates and assembly relationships of the parts, and displays the three-dimensional model of the equipment in a visual form on the customer's processing end.

3. The method for visual management of 3D modeling of equipment online according to claim 1, characterized in that: Sending the operation data to the client's processing end includes the following steps: The sensor establishes the communication connection with the processing end; Convert the operation data into the specified data format; Send the converted operation data to the processing end.

4. The method for visual management of 3D modeling of equipment online according to claim 3, characterized in that: The specific steps to convert the running data into the specified data format are as follows: The operation data includes operation instruction data and parameter data; Find the corresponding code in the preset instruction code table according to the operation instruction data, and combine the code upload time to generate the first data; The first data and parameter data with the same upload time are stored in the same data file.

5. The method for visual management of 3D modeling of equipment online according to claim 4, characterized in that: The specific steps to determine whether there is a problem with the running parts based on normal data and running data are as follows: Obtain all codes at the same upload time in the data file, and find out whether there are conflicting codes based on the code table. If so, determine that there is a problem; Obtaining a first difference between the parameter data and the normal data, and if the first difference is greater than a threshold, determining that there is a problem; Parts corresponding to the execution problem code and / or parts whose first difference is greater than a threshold are obtained as problem parts, and the problem parts are marked.

6. The method for visual management of 3D modeling of equipment online according to claim 3, characterized in that: The network medium for establishing the communication connection is a wireless medium; The wireless medium includes at least one of Bluetooth, WIFI and 4G; The database includes at least one of an OSS storage platform and a local database; The communication connection is based on the TCP / IP protocol.

7. The equipment online 3D modeling visualization management system described above uses the equipment online 3D modeling visualization management method described in any one of claims 1 to 6, characterized in that: It includes a normal data acquisition module, an operation data acquisition module and a visualization module; The normal data acquisition module is used to obtain the normal data of the device during operation; The operation data acquisition module is used to connect with the operation parts of the equipment through sensors to acquire operation data; Sending operating data to the customer's visualization module; The visualization module is used to determine whether there is a problem with the operating parts based on normal data and operating data. If there is a problem, the problematic parts are displayed in a visualized form on the customer's processing end.

8. The equipment online 3D modeling visualization management system according to claim 7, characterized in that: The visualization module includes a three-dimensional model visualization submodule; The three-dimensional model visualization submodule is used to construct a three-dimensional model database of parts; Construct a coordinate system, obtain the center coordinates of each part in the equipment in the assembled state, and the assembly relationship between the parts, and synthesize the center coordinates and assembly relationship of each part into an assembly file; Convert assembly files into digital signals and send them to the client’s processing end; The processing end calls the three-dimensional model data, constructs a three-dimensional model of the equipment based on the center coordinates and assembly relationships of the parts, and displays the three-dimensional model of the equipment in a visual form on the customer's processing end.

9. The equipment online 3D modeling visualization management system according to claim 7, characterized in that: It also includes a data communication submodule, which is used to establish the communication connection between the sensor and the processing end; Convert the operation data into the specified data format; Send the converted operation data to the visualization module.

10. The equipment online 3D modeling visualization management system according to claim 9, characterized in that: The data communication submodule includes a format conversion unit; The format conversion unit is used to find the corresponding code in the preset instruction code table according to the operation instruction data, and combine the code upload time to generate the first data; The first data and parameter data with the same upload time are stored in the same data file; The visualization module further includes a judgment submodule, which is used to obtain all codes at the same upload time in the data file, find out whether there are conflicting codes based on the code table, and if so, judge that there is a problem; Obtain the difference between the parameter data and the normal data. If the difference is greater than a threshold, it is determined that there is a problem. Parts having execution problem codes and / or first difference values ​​greater than a threshold are obtained as problem parts, and the problem parts are marked.

Images