Engineering visualization display method, device, equipment and storage medium

Abstract

The present invention relates to the field of engineering software technology, and discloses a method, apparatus, device, and storage medium for engineering visualization display. The method comprises: obtaining a target building information model; obtaining an actual engineering image captured by the image sensing unit, and performing feature extraction on the actual engineering image to obtain target signal features; determining image coordinate values ​​of the target building information model based on the target signal features; and displaying the target building information model on the image display unit based on the image coordinate values. The above-mentioned solution can accurately match the captured image with the target building information model, and display portions of the target building information model on the image display unit according to the coordinates, thereby significantly improving the application effect of BIM technology in complex engineering environments and increasing the accuracy of the corresponding display between the BIM model and the actual engineering scene.

Description

Technical Field

[0001] The present invention relates to the technical field of engineering software, and in particular to an engineering visualization display method, device, equipment and storage medium. Background Art

[0002] When the project is large in scale, the construction period is long, the work intensity is high, and the drawings and equipment information are complex and numerous, the traditional technology based on document-based communication and coordination methods are difficult to effectively display the complex nodes of the project.

[0003] BIM (Building Information Modeling) is a new tool in architecture, engineering, and civil engineering. At its core, BIM uses digital technology to create a virtual three-dimensional model of a building project, providing it with a complete, realistic-to-construction information database. This database contains not only geometric information, specialized attributes, and status information describing building components, but also status information for non-component objects (such as space and motion). BIM models enable project visualization and construction simulation.

[0004] However, in complex engineering environments, BIM simulation lacks intuitiveness and convenience, and is difficult to correspond to real construction sites. Summary of the Invention

[0005] In view of this, the present invention provides an engineering visualization display method, device, equipment and storage medium, which can improve the accuracy of the corresponding display of BIM models and actual engineering scenes.

[0006] In a first aspect, the present invention provides a method for project visualization, the method being executed by a computer device, the method comprising:

[0007] Obtaining a target building information model;

[0008] Acquire the actual engineering image captured by the image sensing unit, and perform feature extraction on the actual engineering image to obtain target signal features;

[0009] determining image coordinate values ​​of the target building information model based on the target signal characteristics;

[0010] The target building information model is displayed on the image display unit based on the image coordinate values.

[0011] In a possible implementation, obtaining target light source information collected by an image sensing unit;

[0012] The location information of the terminal device is obtained according to the target light source information.

[0013] In a possible implementation, the method further includes:

[0014] Acquiring target light source information collected by the image sensing unit;

[0015] The location information of the terminal device is obtained according to the target light source information.

[0016] In a possible implementation, acquiring the location information of the terminal device according to the target light source information includes:

[0017] Inputting the image coordinate values ​​into a first network model to obtain predicted position information;

[0018] The location information of the terminal device is acquired based on the predicted location information and the target light source information.

[0019] In a possible implementation, the method further includes:

[0020] Obtaining sample images and sample location information;

[0021] Inputting the sample image into the first network model for processing to obtain training position information;

[0022] Parameters of the first network model are updated based on the training location information and the sample location information.

[0023] In a possible implementation, determining the image coordinate value of the target building information model based on the target signal feature includes:

[0024] The target signal feature is input into a second network model to determine the image coordinate value of the target building information model.

[0025] In a possible implementation, before determining the image coordinate value of the target building information model based on the target signal feature, the method further includes:

[0026] Get the sample image and the corresponding sample coordinate values;

[0027] Inputting the sample image into the second network model for processing to obtain training coordinate values;

[0028] Based on the sample coordinate values ​​and the training coordinate values, the parameters of the second network model are updated.

[0029] In a second aspect, the present invention provides an engineering visualization display device, comprising:

[0030] A model acquisition module is used to obtain a target building information model;

[0031] a feature extraction module, configured to obtain the actual engineering image captured by the image sensing unit, and perform feature extraction on the actual engineering image to obtain target signal features;

[0032] a coordinate determination module, configured to determine the image coordinate values ​​of the target building information model based on the target signal characteristics;

[0033] A model display module is configured to display the target building information model on the image display unit based on the image coordinate values.

[0034] In a third aspect, the present invention provides a computer device comprising: a memory and a processor, wherein the memory and the processor are communicatively connected to each other, computer instructions are stored in the memory, and the processor executes the above-mentioned detailed diagram annotation method by executing the computer instructions.

[0035] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the above-mentioned engineering visualization display method.

[0036] In a fifth aspect, the present invention provides a computer program product, comprising computer instructions, which are used to enable a computer to execute the above-mentioned engineering visualization display method.

[0037] The technical solution provided by this application may have the following beneficial effects:

[0038] When it is necessary to match the target building information model with the actual project image, the actual project image captured by the image sensing unit can be first obtained, and feature extraction can be performed on the actual project image to obtain the target signal characteristics. The image coordinate values ​​of the target building information model are then determined based on the signal target characteristics. Based on the image coordinate values, the target building information model is displayed on the image display unit. The above solution can match the captured image with the accurate coordinates in the target building information model and display the portion of the target building information model on the image display unit according to the coordinates, thereby significantly improving the application effect of BIM technology in complex engineering environments and improving the accuracy of the corresponding display of BIM models and actual engineering scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0040] Figure 1 The figure is a structural diagram of an engineering visualization display system according to an exemplary embodiment.

[0041] Figure 2 The figure is a flowchart of a method for project visualization display according to an exemplary embodiment.

[0042] Figure 3 The figure is a flowchart of another method for engineering visualization display according to an exemplary embodiment.

[0043] Figure 4 This is a structural diagram of an engineering visualization display device provided in an embodiment of the present application.

[0044] Figure 5 Schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0045] To make the purpose, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of the present invention.

[0046] In the description of the embodiments of the present application, the term "corresponding" may indicate a direct or indirect correspondence between the two, or an association relationship between the two, or a relationship between indication and being indicated, configuration and being configured, etc.

[0047] Figure 1 FIG. 1 is a structural diagram of an engineering visualization display system according to an exemplary embodiment. Figure 1 As shown, the engineering design system includes a target terminal 101 and a target server 102 .

[0048] Optionally, the target terminal may be a computer device with high-performance processing capabilities, such as a PC (Personal Computer), a mobile terminal, or a tablet computer.

[0049] BIM (Building Information Modeling) software can be installed on the target terminal. Optionally, the BIM software can be various software derived from the Revit software as a basic platform. Revit software has project template files, which play a very important role in the actual design process. Its unified standard settings provide convenience for design, greatly improving the efficiency of designers while meeting design standards. The project template provides the initial state of the project. Several default template files are provided in each Revit software, and you can also create your own templates. Any new project based on the template inherits all families, settings (such as units, fill styles, line styles, line widths, and view scales) and geometries from the template.

[0050] Revit software also includes a Revit family library, a database of Revit families organized by properties, parameters, and other attributes. As projects progress, companies or organizations in related industries accumulate their own unique family libraries. Later, they can directly access family library data and modify parameters based on actual needs, improving work efficiency.

[0051] Optionally, the project template file and Revit family library can be adaptively designed by the designer based on the engineering requirements. The designer can upload the project template file or family library and Revit family library corresponding to the engineering requirements to the corresponding target server, and then share them with other users who need to perform engineering design.

[0052] Optionally, the project visualization display system also includes a terminal device having an image acquisition unit and an image display unit. The image acquisition unit can be used to acquire images of the project corresponding to the BIM model. The terminal device corresponds the image acquisition results with the BIM model and displays the corresponding BIM model on the image display unit, thereby realizing the corresponding display of the virtual model and the real environment, making it easier for construction personnel to understand the current project status.

[0053] Optionally, the above-mentioned server can be a server cluster or a distributed system composed of multiple physical servers, or it can be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, as well as big data and artificial intelligence platforms and other technical operations and computing services.

[0054] Optionally, the system may further include a management device for managing the system (such as managing the connection status between each module and the server, etc.), and the management device and the server are connected via a communication network. Optionally, the communication network is a wired network or a wireless network.

[0055] Optionally, the above-mentioned wireless network or wired network uses standard communication technology and / or protocol. The network is typically the Internet, but may also be any other network, including but not limited to any combination of a local area network, a metropolitan area network, a wide area network, a mobile, a limited or wireless network, a private network, or a virtual private network. In some embodiments, the data exchanged over the network is represented using technologies and / or formats including hypertext markup language, extensible markup language, etc. In addition, conventional encryption technologies such as secure socket layer, transport layer security, virtual private network, internet protocol security, etc. may be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technologies may also be used to replace or supplement the above-mentioned data communication technologies.

[0056] Since water conservancy project buildings are usually complex and diverse special-shaped structures and hidden projects are difficult to maintain, BIM simulation lacks intuitiveness and convenience, cannot truly reflect the construction site, and is not conducive to the continuity of the construction process.

[0057] Traditional augmented reality (AR) solutions based on scene 3D point clouds are not suitable for construction scenes because such scenes are usually complex and changeable. In particular, construction scenes under construction may change every day, which makes the constructed scene 3D point clouds basically unusable in practice.

[0058] In order to solve the above problems, the present invention provides a method for visualizing an engineering project. Figure 2 This is a flowchart of a method for engineering visualization display according to an exemplary embodiment. The method is executed by a computer device, which may be a computer device such as Figure 1 The target terminal 110 in the engineering visualization display system shown in FIG. Figure 2 As shown, the engineering visualization display method may include the following steps:

[0059] Step 201: Acquire a target building information model.

[0060] Use BIM software or platforms to import or load the 3D information model of the target building. This model contains the building's geometric information, professional attributes, status information, etc.

[0061] Specific method: You can obtain BIM files (such as Revit files) from the design team, or create models directly in BIM software.

[0062] Technical details: Ensure that the information in the model is comprehensive and accurate, covering all components of the building and their properties.

[0063] Step 202: Acquire the actual engineering image captured by the image sensing unit, and perform feature extraction on the actual engineering image to obtain target signal features.

[0064] In an embodiment of the present application, the terminal device has an image acquisition unit and an image display unit; optionally, the terminal device may be a smart phone, the image acquisition unit of the terminal device may be a camera, and the image display unit of the terminal device may be a mobile phone screen; further, if the terminal device is connected to AR glasses, the image acquisition unit of the terminal device may be an image sensor on the AR glasses, and the image display unit of the terminal device may be a lens on the AR glasses.

[0065] That is, the terminal device can use the image acquisition unit to collect actual images of the construction site, and then use image processing technology to extract features from these images to identify and extract useful signal features.

[0066] Specifically, in an embodiment of the present application, the terminal device can use computer vision technology, such as edge detection, shape recognition, pattern matching, etc., to extract key information from the image (such as the outline, size, position, etc. of the building components).

[0067] Step 203: Determine the image coordinate value of the target building information model based on the target signal feature.

[0068] After obtaining the target signal features, it is necessary to match the extracted target signal features with the information in the BIM model to correspond to the image coordinate value of each feature point in the actual engineering image in the BIM model.

[0069] Specifically, an algorithm (such as an ICP algorithm or a RANSAC algorithm) may be used to match feature points of the actual image with feature points of the BIM model to calculate the image coordinate transformation relationship.

[0070] Step 204: Display the target building information model on the image display unit based on the image coordinate values.

[0071] After obtaining the coordinate values ​​on the BIM model, the BIM model can be projected onto the actual engineering image according to the determined image coordinate values ​​and displayed on a display device (such as a display screen, AR glasses, etc.).

[0072] Specifically, since the relationship between each feature point on the actual image and the coordinate points on the BIM model is obtained, the virtual BIM model is superimposed on the actual image through the above relationship, allowing users to intuitively see the comparison between the BIM model and the actual construction site.

[0073] By comparing and overlaying the BIM model with actual project images, the above solution can more intuitively present the current status and design goals of the project, helping engineering personnel quickly understand and identify problems. The automated feature extraction and image matching process reduces human intervention and improves the convenience and efficiency of operations, especially in complex engineering environments. Through precise feature extraction and coordinate matching, the consistency of the BIM model and the actual project site is ensured, reducing construction errors and deviations caused by information asymmetry or miscommunication. The real-time display of the comparison between the BIM model and the actual project can help construction managers identify and correct problems in a timely manner, improving the accuracy and efficiency of construction management. The intuitive visualization effect facilitates communication and coordination between different professionals, supports more effective decision-making, and ensures that the project proceeds smoothly as planned.

[0074] In summary, when it is necessary to match a target building information model with an actual engineering image, the actual engineering image captured by the image sensing unit can be first acquired, and feature extraction can be performed on the actual engineering image to obtain target signal features. The image coordinate values ​​of the target building information model can then be determined based on the signal target features. Based on the image coordinate values, the target building information model can be displayed on the image display unit. This solution can match the captured image with the exact coordinates in the target building information model, and display portions of the target building information model on the image display unit according to the coordinates, thereby significantly improving the application of BIM technology in complex engineering environments and increasing the accuracy of the corresponding display between the BIM model and the actual engineering scene.

[0075] Figure 3 This is a flowchart of another method for engineering visualization display according to an exemplary embodiment. The method is executed by a computer device, which may be a computer device such as Figure 1 The target terminal 110 in the engineering visualization display system shown in FIG. Figure 3 As shown, the engineering visualization display method may include the following steps:

[0076] Step 301: Acquire a target building information model.

[0077] In the embodiment of the present application, the terminal device imports or loads the 3D information model of the target engineering building from the BIM system for subsequent processing. The model contains the building's geometric information, material properties, structural status, etc.

[0078] Step 302: Acquire the actual engineering image captured by the image sensing unit, and perform feature extraction on the actual engineering image to obtain target signal features.

[0079] The implementation of step 302 is similar to that of step 202 and will not be repeated here.

[0080] Step 303: Input the target signal feature into the second network model to determine the image coordinate value of the target building information model.

[0081] In other words, obtaining the image coordinates of the target building information model—that is, mapping the target signal features to the coordinates of the target building information model—can be achieved using a machine learning model. The second network model can then process the input target signal features and directly output the predicted image coordinates.

[0082] Before using the second network model, it is also necessary to train the second network model. Specifically, obtain a sample image and the corresponding sample coordinate value; input the sample image into the second network model for processing to obtain the training coordinate value; based on the sample coordinate value and the training coordinate value, update the parameters of the second network model.

[0083] The sample image may be captured on the engineering building corresponding to the target building information model, and the sample image may contain pre-annotated sample coordinate values, which serve as coordinates corresponding to the target signal features extracted from the sample image. Based on the sample coordinate values ​​and the predicted values ​​output by the second network model based on the sample image, the parameters of the second network model may be updated, thereby completing the training process. The trained second network model can predict relatively accurate image coordinate values ​​based on the target signal features extracted from the actual engineering image captured.

[0084] Step 304: Display the target building information model on the image display unit based on the image coordinate values.

[0085] Furthermore, in the embodiment of the present application, in addition to displaying the target building information model corresponding to the actual engineering image on the image display unit, the current position of the terminal device can also be detected in real time through the image.

[0086] In large-scale engineering buildings, general navigation and positioning functions are difficult to play a role. If the image sensing unit can determine the coordinates of the actual engineering picture currently collected on the target building information model, it can naturally also roughly determine the current location of the terminal device based on its coordinates on the target building information model. The specific solution can be as follows.

[0087] In a possible implementation, the terminal device may obtain target light source information collected by the image sensing unit;

[0088] The location information of the terminal device is obtained based on the target light source information.

[0089] Optionally, the target light source information is visible light. Visible light communication (VLC) technology utilizes LED green light sources for data transmission, offering advantages such as high efficiency, low power consumption, and energy conservation and environmental protection. Compared to traditional wireless communication technologies, VLC technology does not generate radio frequency radiation and can simultaneously provide lighting and communication functions. This technology transmits information through light modulation, making it more secure than traditional wireless communication technologies because it cannot be eavesdropped or interfered with. Existing LED lamps can be transformed into communication devices with simple modifications.

[0090] Therefore, in an embodiment of the present application, various LED lamps are installed in the engineering scene corresponding to the target building information model, and each LED lamp is frequency-modulated according to a specified rule. When the image sensing unit on the terminal device collects the target light source information, the corresponding signal can be obtained based on the frequency, color temperature and other information of the target light source information, thereby obtaining the location information of the terminal device.

[0091] However, in fact, the transmission range of the LED lamp's light source is still relatively large, that is, it is possible to obtain the target light source information emitted by the LED lamp in a larger range of the engineering scene. At this time, the specific location of the target terminal can also be determined through the actual engineering image captured by the image acquisition unit of the terminal device.

[0092] In order to achieve the above functions, a machine learning model can also be used for processing. For example, the first network model is a machine learning model that can determine the exact position in the engineering scene based on the image coordinate value.

[0093] Specifically, the terminal device may input the image coordinate value into the first network model to obtain predicted position information;

[0094] The location information of the terminal device is obtained based on the predicted location information and the target light source information.

[0095] When the predicted position information output by the first network model is obtained, it is necessary to first determine whether it corresponds to the position of the target light source information. For example, the difference between the predicted position information output by the first network model and the position corresponding to the target light source information should be less than or equal to the specified range; if it is greater than the specified range, it means that the predicted position information predicted by the first network model is significantly different from the position corresponding to the target light source information, and a misjudgment may have occurred, which requires manual confirmation.

[0096] Furthermore, before processing the image coordinate values ​​through the first network model, the first network model must first be trained. Specifically, the terminal device can first obtain a sample image and sample location information; input the sample image into the first network model for processing to obtain training location information; and update the parameters of the first network model based on the training location information and the sample location information.

[0097] Before executing the above steps of the embodiment of the present application, it is necessary to generate the above target building information model, which specifically includes the following steps:

[0098] Step 1: Based on the main body of the project and its ancillary facilities, a parametric model is established based on BIM software, and relevant model dimensions and material information are edited to establish a complete project model. Specifically, an adaptive family of engineering structural components is created in the Building Information Model (BIM) development software (Revit). Each structural component is named and summarized according to profession, function, etc., and finally a flexible parametric family library is formed. The created parameter family group is linked to all completed projects and families through Revit, and spatial positioning and layout control are performed through the axis grid and elevation. Constraints such as rotation and scaling are used to assemble the family components to the appropriate position. The integrity of the three-dimensional model is checked to see whether the logical relationship between the family components is accurate and whether there are conflicts between the various professions. Finally, a complete three-dimensional BIM model is formed.

[0099] Step 2: Extract the element information from the BIM model and import the attribute information corresponding to the model and each material element into the project file of the 3D rendering software to complete the model rendering. Specifically, you can use the Revit API interface to develop and extract the data information of the 3D model. The attribute information, material texture information, and network structure of the family model file can be extracted separately. The model information can be exported and stored to facilitate data query and management, providing a good data foundation for information sharing and subsequent AR display of the model.

[0100] In engineering, a primitive is the smallest complete unit that makes up a project file. Any model in a project can be called a primitive, a component with a definite, practical meaning. This is a general term that can be understood as the data information of a 3D model, the attribute information, material texture information, and network structure of a family model file.

[0101] Step 3: Use the mobile device's image sensor to capture and identify images and extract signal features to create a dataset. A neural network algorithm is used to train this data, generate a neural network model, and import it into 3D rendering software. Specifically, create a database using Vuforia, upload the identified image to the Target Manager, perform grayscale processing and feature recognition, and integrate feature point information. The neural network algorithm is then used to train the data and generate a neural network model. Download the dataset, package it into a UnityPackage, upload it to the Unity3D platform, and import it into the corresponding project.

[0102] After completing the above steps, the BIM model feature points can be associated with the identified image, and the image sensor can be used to capture real-world environmental features. Coordinate conversion can be used to enable the virtual camera to track the BIM model that matches the image, thereby rendering the BIM model in a precise position in three-dimensional space. Specifically, the terminal device creates a license key to ensure the normal operation of the AR development tool (Vuforia SDK) and pastes the key into the three-dimensional rendering software (Unity3D) to complete the system environment configuration. At this time, the terminal device also collects real-world scene images in real time to extract signal features, and inputs the signal features into the trained neural network model to obtain the position coordinates corresponding to the source LED.

[0103] In summary, when it is necessary to match a target building information model with an actual engineering image, the actual engineering image captured by the image sensing unit can be first acquired, and feature extraction can be performed on the actual engineering image to obtain target signal features. The image coordinate values ​​of the target building information model can then be determined based on the signal target features. Based on the image coordinate values, the target building information model can be displayed on the image display unit. This solution can match the captured image with the exact coordinates in the target building information model, and display portions of the target building information model on the image display unit according to the coordinates, thereby significantly improving the application of BIM technology in complex engineering environments and increasing the accuracy of the corresponding display between the BIM model and the actual engineering scene.

[0104] In the embodiments of the present application, an engineering visualization display device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments, and the details already described will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0105] Figure 4 This is a schematic diagram of the structure of an engineering visualization display device provided in an embodiment of the present application. Figure 4 As shown, the device includes:

[0106] Model acquisition module 401, used to obtain the target building information model;

[0107] A feature extraction module 402 is configured to obtain the actual engineering image captured by the image sensing unit and perform feature extraction on the actual engineering image to obtain target signal features;

[0108] A coordinate determination module 403 is configured to determine the image coordinate values ​​of the target building information model based on the target signal characteristics;

[0109] The model display module 404 is configured to display the target building information model on the image display unit based on the image coordinate values.

[0110] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0111] The device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0112] The embodiment of the present invention further provides a computer device having the above-mentioned apparatus. Figure 5 , Figure 5 is a structural diagram of a computer device provided by an optional embodiment of the present invention, such as Figure 5 As shown, the computer device includes: one or more processors 10, memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components utilize different buses to communicate with each other and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in the memory or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Equally, multiple computer devices can be connected, and each device provides part of the necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 5 A processor 10 is taken as an example.

[0113] The processor 10 may be a central processing unit, a network processor, or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic, or any combination thereof.

[0114] The memory 20 stores instructions that can be executed by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0115] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created based on the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely located relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0116] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid-state drive; the memory 20 may also include a combination of the above types of memory.

[0117] The computer device further includes a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0118] The embodiment of the present invention also provides a computer-readable storage medium. The above-mentioned method according to the embodiment of the present invention can be implemented in hardware, firmware, or implemented as a computer code that can be recorded in a storage medium, or implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memory. It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor or hardware, the method shown in the above embodiment is implemented.

[0119] A portion of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the form in which the computer program instruction exists in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc. Accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium that can be accessed by the computer.

[0120] Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention. Such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for engineering visualization display, characterized in that: The method is performed by a terminal device having an image sensing unit and an image display unit, and the method includes: Obtaining a target building information model; Acquire the actual engineering image captured by the image sensing unit, and perform feature extraction on the actual engineering image to obtain target signal features; determining image coordinate values ​​of the target building information model based on the target signal characteristics; displaying the target building information model on the image display unit based on the image coordinate values; The method further comprises: Acquiring target light source information collected by the image sensing unit; Acquiring location information of the terminal device according to the target light source information; The acquiring the location information of the terminal device according to the target light source information includes: Inputting the image coordinate values ​​into a first network model to obtain predicted position information; The location information of the terminal device is acquired based on the predicted location information and the target light source information.

2. The method according to claim 1, characterized in that The method further comprises: Obtaining sample images and sample location information; Inputting the sample image into the first network model for processing to obtain training position information; Parameters of the first network model are updated based on the training location information and the sample location information.

3. The method according to claim 1 or 2, characterized in that The determining the image coordinate value of the target building information model based on the target signal feature includes: The target signal feature is input into a second network model to determine the image coordinate value of the target building information model.

4. The method according to claim 3, characterized in that Before determining the image coordinate value of the target building information model based on the target signal feature, the method further includes: Get the sample image and the corresponding sample coordinate values; Inputting the sample image into the second network model for processing to obtain training coordinate values; Based on the sample coordinate values ​​and the training coordinate values, the parameters of the second network model are updated.

5. An engineering visualization display device, characterized in that: The device is provided on a terminal device, which has an image sensing unit and an image display unit, and includes: A model acquisition module is used to obtain a target building information model; A feature extraction module is used to obtain the actual engineering image collected by the image sensing unit, and perform feature extraction on the actual engineering image to obtain target signal features; a coordinate determination module, configured to determine the image coordinate values ​​of the target building information model based on the target signal characteristics; a model display module, configured to display the target building information model on the image display unit based on the image coordinate values; The device further comprises: A light source acquisition module, configured to acquire target light source information collected by the image sensing unit; A location acquisition module, configured to acquire location information of the terminal device based on the target light source information; The location acquisition module is also used for: Inputting the image coordinate values ​​into a first network model to obtain predicted position information; The location information of the terminal device is acquired based on the predicted location information and the target light source information.

6. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the engineering visualization display method according to any one of claims 1 to 4 by executing the computer instructions.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the engineering visualization display method according to any one of claims 1 to 4.

8. A computer program product, characterized in that The method comprises computer instructions for causing a computer to execute the engineering visualization display method according to any one of claims 1 to 4.

Images