A digital twin method and system for cement mixing construction

Abstract

The present invention provides a cement mixing construction digital twin method and system, wherein the method includes: obtaining multimodal data of a cement mixing construction site; constructing a digital twin model based on the multimodal data; analyzing the recommended viewing angle of the digital twin model; and adjusting the area of ​​the digital twin model under the recommended viewing angle to adapt to the recommended viewing angle. With the cement mixing construction digital twin method and system of the present invention, supervisors can conduct comprehensive monitoring and management of cement mixing construction by viewing the digital twin model, thereby reducing labor costs. In addition, the system sets recommended viewing angles for supervisors, thereby improving the supervisory efficiency of supervisors.

Description

Technical Field

[0001] The present invention relates to the technical field of digital twins, and in particular to a cement mixing construction digital twin method and system. Background Art

[0002] Cement mixing piles are a commonly used foundation reinforcement method for reinforcing saturated soft soil foundations. It uses cement as a curing agent, and uses deep mixing machinery to spray cement slurry into the soft soil while drilling, solidifying the soft soil into cement soil with sufficient strength, deformation modulus and stability, thereby reinforcing the foundation.

[0003] During cement mixing construction, in order to ensure the efficiency and stability of cement mixing construction, it is necessary to monitor and manage the cement mixing construction. Generally, when monitoring and managing cement mixing construction, supervisors are mostly arranged to perform manual work at the cement mixing construction site, which has a high labor cost. In addition, there may be more than one cement mixing construction site at a project site, and supervisors cannot conduct comprehensive supervision, and the supervision efficiency is low.

[0004] Therefore, a solution is urgently needed. Summary of the invention

[0005] One of the purposes of the present invention is to provide a digital twin method for cement mixing construction. Supervisors can comprehensively monitor and manage cement mixing construction by viewing the digital twin model, thereby reducing labor costs. In addition, the system sets recommended viewing perspectives for supervisors, thereby improving the supervisory efficiency of supervisors.

[0006] An embodiment of the present invention provides a cement mixing construction digital twin method, comprising:

[0007] Acquire multimodal data of cement mixing construction sites;

[0008] Based on the multimodal data, construct a digital twin model;

[0009] Analyze the recommended viewing perspectives of the digital twin model;

[0010] The area of ​​the digital twin model at the recommended viewing angle is adjusted to adapt to the recommended viewing angle.

[0011] Preferably, the analyzing the recommended viewing angle of the digital twin model includes:

[0012] Controlling a virtual camera to enter the digital twin model;

[0013] Previewing the digital twin model;

[0014] During the preview of the digital twin model, the virtual camera is controlled to move; during the movement of the virtual camera, the virtual camera changes the moving position to shoot, and the shooting pictures shot at different moving positions all meet the first standard picture condition;

[0015] Sorting the pictures taken by the virtual camera at different moving positions according to the order of shooting to obtain a picture sequence;

[0016] Determine a partial sequence that meets a standard sequence condition from the picture sequence;

[0017] Determining a target shot picture that meets a second standard picture condition from the picture sequence;

[0018] Obtaining the shooting angle of the virtual camera to shoot the target shooting picture;

[0019] The shooting angle of view is used as the recommended viewing angle of view.

[0020] Preferably, the first standard picture condition includes:

[0021] During the preview of the digital twin model, all of the first model elements of the first element type in the digital twin model fall into the captured picture;

[0022] A maximum value of straight-line distances between each of the first model elements in the photographing picture and a boundary line of the photographing picture is smaller than a distance threshold.

[0023] Preferably, the standard sequence conditions include:

[0024] The sum of the feature weights corresponding to at least one difference feature between every two adjacent captured images in the local sequence in the feature weight library is less than or equal to the weight sum threshold.

[0025] Preferably, the second standard picture condition includes:

[0026] The target shot picture is located between two adjacent partial sequences in the picture sequence;

[0027] and / or,

[0028] The target shot picture is located outside the local sequence in the picture sequence and at least one model element of the second element type in the digital twin model falls into the target shot picture.

[0029] Preferably, the adjusting the area in the digital twin model under the recommended viewing angle to adapt to the recommended viewing angle includes:

[0030] Constructing a viewing angle direction vector of the recommended viewing angle;

[0031] Constructing a display direction vector of each information display frame in the area;

[0032] The display direction of each of the information display frames is adjusted until the vector angle between the display direction vector of each information display frame and the viewing angle direction vector is equal to the angle threshold.

[0033] A cement mixing construction digital twin system provided by an embodiment of the present invention includes:

[0034] An acquisition module is used to acquire multimodal data of a cement mixing construction site;

[0035] A construction module, used to construct a digital twin model based on the multimodal data;

[0036] An analysis module, used to analyze the recommended viewing perspectives of the digital twin model;

[0037] An adjustment module is used to adjust the area in the digital twin model under the recommended viewing angle to adapt to the recommended viewing angle.

[0038] Preferably, the analysis module analyzes the recommended viewing perspective of the digital twin model, including:

[0039] Controlling a virtual camera to enter the digital twin model;

[0040] Previewing the digital twin model;

[0041] During the preview of the digital twin model, the virtual camera is controlled to move; during the movement of the virtual camera, the virtual camera changes the moving position to shoot, and the shooting pictures shot at different moving positions all meet the first standard picture condition;

[0042] Sorting the pictures taken by the virtual camera at different moving positions according to the order of shooting to obtain a picture sequence;

[0043] Determine a partial sequence that meets a standard sequence condition from the picture sequence;

[0044] Determining a target shot picture that meets a second standard picture condition from the picture sequence;

[0045] Obtaining the shooting angle of the virtual camera to shoot the target shooting picture;

[0046] The shooting angle of view is used as the recommended viewing angle of view.

[0047] Preferably, the first standard picture condition includes:

[0048] During the preview of the digital twin model, all of the first model elements of the first element type in the digital twin model fall into the captured picture;

[0049] A maximum value of straight-line distances between each of the first model elements in the photographing picture and a boundary line of the photographing picture is smaller than a distance threshold.

[0050] Preferably, the standard sequence conditions include:

[0051] The sum of the feature weights corresponding to at least one difference feature between every two adjacent captured images in the local sequence in the feature weight library is less than or equal to the weight sum threshold.

[0052] Preferably, the second standard picture condition includes:

[0053] The target shot picture is located between two adjacent partial sequences in the picture sequence;

[0054] and / or,

[0055] The target shot picture is located outside the local sequence in the picture sequence and at least one model element of the second element type in the digital twin model falls into the target shot picture.

[0056] Preferably, the adjustment module adjusts the area in the digital twin model under the recommended viewing angle to adapt to the recommended viewing angle, including:

[0057] Constructing a viewing angle direction vector of the recommended viewing angle;

[0058] Constructing a display direction vector of each information display frame in the area;

[0059] The display direction of each of the information display frames is adjusted until the vector angle between the display direction vector of each information display frame and the viewing angle direction vector is equal to the angle threshold.

[0060] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.

[0061] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0063] Figure 1 Schematic diagram of a cement mixing construction digital twin method according to an embodiment of the present invention;

[0064] Figure 2 This is a schematic diagram of a cement mixing construction digital twin system in an embodiment of the present invention. DETAILED DESCRIPTION

[0065] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0066] The embodiment of the present invention provides a cement mixing construction digital twin method, such as Figure 1 As shown, including:

[0067] S1. Obtain multimodal data of cement mixing construction site;

[0068] S2. constructing a digital twin model based on the multimodal data;

[0069] S3. Analyze the recommended viewing perspective of the digital twin model;

[0070] S4. Adjust the area in the digital twin model under the recommended viewing angle to adapt to the recommended viewing angle.

[0071] Multimodal data includes: geographic parameters of cement mixing construction site, operating parameters of each cement mixing pile, real-time location of operators, storage parameters of cement mixing raw materials, etc. The constructed digital twin model is a digital twin of the cement mixing construction site, and the digital twin model restores the on-site conditions of the cement mixing construction site 1:1; when viewing the digital twin model under the recommended viewing perspective, it is more suitable for monitoring and managing the cement mixing construction site; the area of ​​the digital twin model under the recommended viewing perspective is adjusted to adapt to the recommended viewing perspective, so that when viewing the digital twin model under the recommended viewing perspective, the area display is appropriate. Supervisors can conduct comprehensive monitoring and management of cement mixing construction by viewing the digital twin model, which reduces labor costs. In addition, the system sets recommended viewing perspectives for supervisors, which improves the supervisory efficiency of supervisors.

[0072] In one embodiment, analyzing the recommended viewing perspective of the digital twin model includes:

[0073] Controlling a virtual camera to enter the digital twin model;

[0074] Previewing the digital twin model;

[0075] During the preview of the digital twin model, the virtual camera is controlled to move; during the movement of the virtual camera, the virtual camera changes the moving position to shoot, and the shooting pictures shot at different moving positions all meet the first standard picture condition;

[0076] Sorting the pictures taken by the virtual camera at different moving positions according to the order of shooting to obtain a picture sequence;

[0077] Determine a partial sequence that meets a standard sequence condition from the picture sequence;

[0078] Determining a target shot picture that meets a second standard picture condition from the picture sequence;

[0079] Obtaining the shooting angle of the virtual camera to shoot the target shooting picture;

[0080] The shooting angle of view is used as the recommended viewing angle of view.

[0081] The first standard picture condition includes:

[0082] During the preview of the digital twin model, all of the first model elements of the first element type in the digital twin model fall into the captured picture;

[0083] A maximum value of straight-line distances between each of the first model elements in the photographing picture and a boundary line of the photographing picture is smaller than a distance threshold.

[0084] The standard sequence conditions include:

[0085] The sum of the feature weights corresponding to at least one difference feature between every two adjacent captured images in the local sequence in the feature weight library is less than or equal to the weight sum threshold.

[0086] The second standard picture condition includes:

[0087] The target shot picture is located between two adjacent partial sequences in the picture sequence;

[0088] and / or,

[0089] The target shot picture is located outside the local sequence in the picture sequence and at least one model element of the second element type in the digital twin model falls into the target shot picture.

[0090] When rehearsing the digital twin model, the future on-site conditions of the cement mixing construction site are predicted, such as: the operating parameters of each cement mixing pile in the next 10 minutes (the operation of the cement mixing shaft can be predicted based on the historical operating parameters of the cement mixing pile), the real-time location of the operators (the movement of the operators can be predicted based on the historical movement trajectory of the operators), the storage parameters of cement mixing raw materials (the usage of cement mixing raw materials can be predicted based on the future cement mixing plan), etc. The predicted future on-site conditions are simulated in the digital twin model to achieve rehearsal; when rehearsing the digital twin model, the virtual camera is controlled to move inside it. The constraint condition of the movement of the virtual camera is the shooting conditions taken at different moving positions. The pictures all meet the first standard picture conditions. When the shooting picture meets the first standard picture conditions, it means that the shooting perspective of the virtual camera shooting the shooting picture can perform global monitoring and management of the predicted cement mixing construction site, and the shooting perspective can be used as the target for later screening out the recommended viewing perspective; specifically for the first standard picture conditions, the first element type is the model element type related to cement mixing construction, such as: the operation image of the cement mixing pile, the operation parameters of the cement mixing pile, the workers next to the cement mixing pile, etc.; when multiple first model elements of the first element type in the digital twin model all fall into the shooting picture, if the shooting perspective of the shooting image is used as the recommended viewing perspective, the supervisor can see all the elements related to the cement mixing construction under the recommended viewing perspective. The relevant on-site conditions can be realized to achieve global supervision; secondly, the distance threshold can be 20 meters; ensuring that the maximum value of the straight-line distance between each first model element and the boundary line of the shooting picture is less than the distance threshold can make the shooting picture sufficiently enlarged while ensuring that all the first model elements are included, avoiding excessive space surplus. If the shooting angle of the shot image is used as the recommended viewing angle, the supervisor can see the clear on-site conditions under the recommended viewing angle; specifically to the standard sequence conditions, the difference features include: the difference between the operating parameters of the cement mixing piles, the difference between the real-time positions of the operators, the difference between the storage parameters of the cement mixing raw materials, etc.; there are feature weights corresponding to different difference features in the feature weight library. The larger the feature weight, The more the corresponding difference features need to be paid attention to by the supervisors, the more valuable it is to supervise the supervisors; when the sum of the feature weights corresponding to at least one difference feature between each pair of adjacent shooting pictures in the local sequence in the feature weight library is less than or equal to the weight and threshold, it means that the shooting pictures in the local sequence do not need to be paid attention to by the supervisors; specifically, in the second standard picture condition, when the target shooting picture is located between two adjacent local sequences in the picture sequence, it means that the target shooting picture needs the attention of the supervisors, and when its shooting angle is used as the recommended viewing angle, the supervisors may capture special events when viewing the digital twin model under the recommended viewing angle; the second element type is the model element that represents the shooting picture that requires the attention of the supervisors, such as: irrelevant personnel, etc.The target shooting picture is outside the local sequence in the picture sequence and at least one model element of the second element type in the digital twin model falls into the target shooting picture, which also indicates that the target shooting picture needs the attention of the supervisor. When its shooting angle is used as the recommended viewing angle, the supervisor may capture special events when viewing the digital twin model under the recommended viewing angle. Therefore, the shooting angle of the virtual camera shooting the target shooting picture is obtained; and the shooting angle is used as the recommended viewing angle. ;

[0091] When analyzing the recommended viewing angle, the embodiment of the present invention previews the digital twin model, introduces the first standard picture condition, the standard sequence condition and the second standard picture condition, and quickly determines the shooting angle of the target shooting picture that can be used as the recommended viewing angle, thereby improving the efficiency of the recommended viewing angle analysis; supervisors do not need to drag the digital twin model to find a suitable viewing angle by themselves, and the system adaptively recommends viewing angles for them, which improves humanization and greatly improves the efficiency of supervisors using digital twin models to supervise cement mixing construction sites.

[0092] In one embodiment, the adjusting the area in the digital twin model at the recommended viewing angle to adapt to the recommended viewing angle includes:

[0093] Constructing a viewing angle direction vector of the recommended viewing angle;

[0094] Constructing a display direction vector of each information display frame in the area;

[0095] The display direction of each of the information display frames is adjusted until the vector angle between the display direction vector of each information display frame and the viewing angle direction vector is equal to the angle threshold.

[0096] The angle threshold is 180 degrees; when the vector angle between the display direction vector of the information display box and the viewing angle direction vector is equal to the angle threshold, it means that the display of the information display box is facing the recommended viewing angle. When the user views the digital twin model at the recommended viewing angle, the content in the information display box can be viewed directly, which improves rationality.

[0097] An embodiment of the present invention provides a cement mixing construction digital twin system, such as Figure 2 As shown, including:

[0098] Acquisition module 1, used to acquire multimodal data of cement mixing construction site;

[0099] Construction module 2, used to construct a digital twin model based on the multimodal data;

[0100] An analysis module 3, used to analyze the recommended viewing perspective of the digital twin model;

[0101] The adjustment module 4 is used to adjust the area in the digital twin model under the recommended viewing angle to adapt to the recommended viewing angle.

[0102] The analysis module 3 analyzes the recommended viewing perspective of the digital twin model, including:

[0103] Controlling a virtual camera to enter the digital twin model;

[0104] Previewing the digital twin model;

[0105] During the preview of the digital twin model, the virtual camera is controlled to move; during the movement of the virtual camera, the virtual camera changes the moving position to shoot, and the shooting pictures shot at different moving positions all meet the first standard picture condition;

[0106] Sorting the pictures taken by the virtual camera at different moving positions according to the order of shooting to obtain a picture sequence;

[0107] Determine a partial sequence that meets a standard sequence condition from the picture sequence;

[0108] Determining a target shot picture that meets a second standard picture condition from the picture sequence;

[0109] Obtaining the shooting angle of the virtual camera to shoot the target shooting picture;

[0110] The shooting angle of view is used as the recommended viewing angle of view.

[0111] The first standard picture condition includes:

[0112] During the preview of the digital twin model, all of the first model elements of the first element type in the digital twin model fall into the captured picture;

[0113] A maximum value of straight-line distances between each of the first model elements in the photographing picture and a boundary line of the photographing picture is smaller than a distance threshold.

[0114] The standard sequence conditions include:

[0115] The sum of the feature weights corresponding to at least one difference feature between every two adjacent captured images in the local sequence in the feature weight library is less than or equal to the weight sum threshold.

[0116] The second standard picture condition includes:

[0117] The target shot picture is located between two adjacent partial sequences in the picture sequence;

[0118] and / or,

[0119] The target shot picture is located outside the local sequence in the picture sequence and at least one model element of the second element type in the digital twin model falls into the target shot picture.

[0120] The adjustment module 4 adjusts the area in the digital twin model under the recommended viewing angle to adapt to the recommended viewing angle, including:

[0121] Constructing a viewing angle direction vector of the recommended viewing angle;

[0122] Constructing a display direction vector of each information display frame in the area;

[0123] The display direction of each of the information display frames is adjusted until the vector angle between the display direction vector of each information display frame and the viewing angle direction vector is equal to the angle threshold.

[0124] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A cement mixing construction digital twin method, characterized in that: include: Acquire multimodal data of cement mixing construction sites; Based on the multimodal data, construct a digital twin model; Analyze the recommended viewing perspectives of the digital twin model; Adjusting the area of ​​the digital twin model at the recommended viewing angle to adapt to the recommended viewing angle; The analysis of the recommended viewing perspectives of the digital twin model includes: Controlling a virtual camera to enter the digital twin model; Previewing the digital twin model; During the preview of the digital twin model, the virtual camera is controlled to move; during the movement of the virtual camera, the virtual camera changes the moving position to shoot, and the shooting pictures shot at different moving positions all meet the first standard picture condition; Sorting the pictures taken by the virtual camera at different moving positions according to the order of shooting to obtain a picture sequence; Determine a partial sequence that meets a standard sequence condition from the picture sequence; Determining a target shot picture that meets a second standard picture condition from the picture sequence; Obtaining the shooting angle of the virtual camera to shoot the target shooting picture; Using the shooting angle of view as the recommended viewing angle of view; The first standard picture condition includes: During the preview of the digital twin model, all of the first model elements of the first element type in the digital twin model fall into the captured picture; The maximum value of the straight-line distances between each of the first model elements in the photographed picture and the boundary line of the photographed picture is less than a distance threshold; The standard sequence conditions include: The sum of the feature weights corresponding to at least one difference feature between every two adjacent captured images in the local sequence in the feature weight library is less than or equal to the weight sum threshold; The second standard picture condition includes: The target shot picture is located between two adjacent partial sequences in the picture sequence; and / or, The target shot picture is located outside the local sequence in the picture sequence and at least one model element of the second element type in the digital twin model falls into the target shot picture.

2. A cement mixing construction digital twin method as claimed in claim 1, characterized in that: The adjusting the area in the digital twin model at the recommended viewing angle to adapt to the recommended viewing angle includes: Constructing a viewing angle direction vector of the recommended viewing angle; Constructing a display direction vector of each information display frame in the area; The display direction of each of the information display frames is adjusted until the vector angle between the display direction vector of each information display frame and the viewing angle direction vector is equal to the angle threshold.

3. A cement mixing construction digital twin system, characterized in that: include: An acquisition module is used to acquire multimodal data of a cement mixing construction site; A construction module, used to construct a digital twin model based on the multimodal data; An analysis module, used to analyze the recommended viewing perspectives of the digital twin model; An adjustment module, configured to adjust the area of ​​the digital twin model at the recommended viewing angle to adapt to the recommended viewing angle; The analysis module analyzes the recommended viewing perspective of the digital twin model, including: Controlling a virtual camera to enter the digital twin model; Previewing the digital twin model; During the preview of the digital twin model, the virtual camera is controlled to move; during the movement of the virtual camera, the virtual camera changes the moving position to shoot, and the shooting pictures shot at different moving positions all meet the first standard picture condition; Sorting the pictures taken by the virtual camera at different moving positions according to the order of shooting to obtain a picture sequence; Determine a partial sequence that meets a standard sequence condition from the picture sequence; Determining a target shot picture that meets a second standard picture condition from the picture sequence; Obtaining the shooting angle of the virtual camera to shoot the target shooting picture; Using the shooting angle of view as the recommended viewing angle of view; The first standard picture condition includes: During the preview of the digital twin model, all of the first model elements of the first element type in the digital twin model fall into the captured picture; The maximum value of the straight-line distances between each of the first model elements in the photographed picture and the boundary line of the photographed picture is less than a distance threshold; The standard sequence conditions include: The sum of the feature weights corresponding to at least one difference feature between every two adjacent captured images in the local sequence in the feature weight library is less than or equal to the weight sum threshold; The second standard picture condition includes: The target shot picture is located between two adjacent partial sequences in the picture sequence; and / or, The target shot picture is located outside the local sequence in the picture sequence and at least one model element of the second element type in the digital twin model falls into the target shot picture.

Images