A ship lock operation state display method based on three-dimensional oblique photography

Abstract

The present application discloses to belong to the technical field of the inclined photography of ship lock operation, specifically to a ship lock operation state display method based on three-dimensional inclined photography, comprising the following operation steps: step one: loading the inclined camera on the same flight platform to collect the ship lock surrounding image, shooting multi-angle images with a certain degree of overlap and pos data, the photo data collected by the inclined camera is processed and matched with space triangulation by automatic modeling software DJI ZhiTu, then the photo data is imported by using the automatic modeling software DJI ZhiTu, after selecting the mapping scene and the related output model format, setting whether to output the cloud point, etc., the real scene three-dimensional model is quickly established through the matching of the point view and the photo library, the present application has the advantages that multiple sensors can synchronously collect from multiple different angles, the real scene three-dimensional model can be quickly and accurately established, and the work efficiency is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of oblique photography of ship lock operation, in particular to a ship lock operation state display method based on three-dimensional oblique photography. BACKGROUND

[0002] Oblique photography technology is a high-tech developed in the field of international surveying and mapping in recent years. It overturns the limitation that the past orthographic image can only be taken from a vertical angle. Through the use of multiple sensors on the same flight platform, it collects images from five different angles, including one vertical and four oblique angles, and introduces users to a real and intuitive world that meets human visual perception.

[0003] Three-dimensional electronic map, or 3D electronic map, is a three-dimensional, abstract description of the real world or part of it according to a certain scale. Network three-dimensional electronic map not only provides map search functions such as map query and travel navigation through intuitive geographic scene simulation, but also integrates a series of services such as life information, e-government, e-commerce, virtual community, and travel navigation.

[0004] Currently, most ship lock application systems display ship positions in the form of two-dimensional maps, and ship lock operation conditions are mostly displayed in planar form. Only a few ship locks use pure three-dimensional model technology to display ship position information.

[0005] Most existing technologies display ship position information in the form of two-dimensional maps, which has the following defects: the map can only be zoomed in a limited range, the specific environment of the ship lock cannot be seen, and the actual operation details of the ship lock cannot be displayed.

[0006] Most ship lock operation conditions are displayed in planar form, which has the following defects: it is not intuitive, and the planar graph cannot directly correspond to the actual surrounding environment of the ship lock.

[0007] A few ship locks use pure three-dimensional models to display the situation of the ship lock, which has the following defects: the cost of manually creating the model is high and the production period is long, and there is an error between the actual situation and the model.

[0008] Therefore, we propose a ship lock operation state display method based on three-dimensional oblique photography. SUMMARY

[0009] In view of the above and / or existing problems in a ship lock operation state display method based on three-dimensional oblique photography, the present application is proposed.

[0010] Therefore, the purpose of the present application is to provide a ship lock operation state display method based on three-dimensional oblique photography, which can solve the above-mentioned problems by using oblique photography technology to construct a three-dimensional model of the ship lock, superimposing operation-related data of the ship lock on the ship lock model, and obtaining information of the ship in real time through websocket technology to display the ship in the lock chamber and the pilot channel on the three-dimensional model of the ship lock.

[0011] To solve the above technical problems, according to one aspect of the present application, the present application provides the following technical solutions:

[0012] A ship lock operation state display method based on three-dimensional oblique photography, comprising the following operation steps:

[0013] Step one: mounting a tilt camera on the same flight platform to collect images around the ship lock, shooting multi-angle images with a certain degree of overlap and pos data, and processing and matching space triangulation of the photograph data collected by the tilt camera through automatic modeling software DJI Zhitu, then importing the photograph data into the automatic modeling software DJI Zhitu, selecting the mapping scene and related output model format, setting whether to output cloud points, etc.

[0014] Step two: matching a certain image containing a gopher point in the photo library to realize the matching of the gopher view and the photo library, and matching at least four gopher images for each gopher point, and generating a three-dimensional oblique photography model of the ship lock after the gopher point is completed;

[0015] Step three: after publishing the generated three-dimensional model folder to the server, loading the corresponding oblique photography model json file through cesium technology, and superimposing the oblique photography model on the three-dimensional sphere, so that the three-dimensional model of the ship lock can be seen on the sphere;

[0016] Step four: based on step three, labeling information such as the function and name of the building;

[0017] Step five: obtaining the udp data related to the operation of the ship lock by calling the related interface of the ship lock control system;

[0018] Step six: superimposing the operation-related data of the ship lock on the ship lock model;

[0019] Step seven: obtaining the information of the ship in real time through mature websocket technology, displaying the ship in the lock chamber and the pilot channel on the three-dimensional model of the ship lock, and displaying the ship in the form of a three-dimensional model.

[0020] As a preferred scheme of the ship lock operation state display method based on three-dimensional oblique photography, in the step two, for the shaking or moving of part of the objects due to wind and other factors, the automatically generated model may be blurred, ghosted, have holes and other problems, which can be repaired or deleted by the post-modeling software.

[0021] As a preferred scheme of the ship lock operation state display method based on three-dimensional oblique photography, in the step three, Cesium is a map engine based on JavaScript and using WebGL.

[0022] As a preferred scheme of the ship lock operation state display method based on three-dimensional oblique photography, in the step three, the ship position and information are displayed on the ship lock and the channel by using the Cesium technology.

[0023] As a preferred scheme of the ship lock operation state display method based on three-dimensional oblique photography, in the step seven, the WebSocket makes the data exchange between the client and the server more simple, allows the server to actively push data to the client, in the WebSocket API, the browser and the server only need to complete a handshake, and a persistent connection can be directly created between the two for bidirectional data transmission.

[0024] As a preferred scheme of the ship lock operation state display method based on three-dimensional oblique photography, in the step seven, the existing websocket technology is used to receive the ship lock operation related udp data pushed by the server to the ship lock operation display system, and the ship lock operation related data is superimposed on the ship lock model.

[0025] As a preferred scheme of the ship lock operation state display method based on three-dimensional oblique photography, in the step seven, the existing websocket technology is used to receive the real-time ship information and its position information pushed by the server to the ship lock operation display system, and the ships in the lock chamber and the approach channel are displayed on the three-dimensional model of the ship lock by using the Cesium technology.

[0026] Compared with the prior art, the unmanned aerial vehicle is used for shooting by using oblique photography, and a three-dimensional model can be generated, which is more consistent with the actual environment.

[0027] Compared with the prior art, the unmanned aerial vehicle is used for shooting by using oblique photography, and a three-dimensional model can be generated, which is more consistent with the actual environment.

[0028] Compared with the prior art, the unmanned aerial vehicle is used for shooting by using oblique photography, and a three-dimensional model can be generated, which is more consistent with the actual environment.

[0029] Technical features: multiple sensors are synchronized from multiple different angles to quickly establish a real three-dimensional model

[0030] Technical advantages: quickly and accurately establish a real three-dimensional model, improve work efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0031] Figure 1 The code segment diagram of cesium loaded oblique photography provided by the present application is provided.

[0032] Figure 2 The related interface of the system provided by the present application Figure 1 ;

[0033] Figure 3 The related interface of the system provided by the present application Figure 2 .DETAILED DESCRIPTION

[0034] To make the purpose, technical scheme and advantages of the present application clearer, the embodiments of the present application will be described in further detail below with reference to the drawings.

[0035] The present application provides a ship lock operation state display method based on three-dimensional oblique photography, which has the advantages of multiple sensors collecting from multiple different angles simultaneously, quickly establishing a real three-dimensional model, and quickly and accurately establishing a real three-dimensional model to improve work efficiency. Please refer to Figures 1-3 , comprising the following operation steps:

[0036] Step 1: mount oblique cameras on the same flight platform to collect ship lock surrounding images, shoot multi-angle images with a certain degree of overlap and pos data, and process and match space triangulation of the photograph data collected by the oblique cameras through automatic modeling software DJI Zhitu, then import the photograph data into the automatic modeling software DJI Zhitu, select the mapping scene and related output model format, whether to output cloud points, etc.

[0037] Step 2: match a certain image containing a control point in the photo library to realize the matching of the control point view and the photo library, match at least 4 control point images for each control point, generate an oblique photography three-dimensional model of the ship lock after the control point is completed, and the generated oblique photography model is real and contains rich real environment information, has the advantages of high efficiency, low cost, accurate data, flexible operation, etc. For some objects that shake or move due to wind and other factors, the automatically generated model may be blurred, ghosted, have holes, etc. The post-processing model repair software can repair or delete the object.

[0038] Step three: after publishing the generated three-dimensional model folder to the server, load the corresponding oblique photography model json file using cesium technology, and superimpose the oblique photography model on the three-dimensional sphere, so that the three-dimensional model of the ship lock can be seen on the sphere, and the ship position and information can be displayed on the ship lock and the channel using the cesium technology;

[0039] Wherein Cesium is a map engine based on JavaScript written using WebGL abroad;

[0040] Step four: on the basis of step three, mark the function and name of the building, etc.

[0041] Step five: call the related interface of the ship lock control system to obtain the related udp data of the ship lock operation;

[0042] Step six: superimpose the related data of the ship lock operation on the ship lock model, such as the water level inside and outside the lock chamber, the traffic light, the waiting lock condition, etc.

[0043] Step seven: real-time obtain the ship information through mature websocket technology, display the ship in the lock chamber and the approach channel on the three-dimensional model of the ship lock, and display the ship in the form of a three-dimensional model;

[0044] Wherein WebSocket makes the data exchange between the client and the server more simple, allows the server to actively push data to the client, in the WebSocket API, the browser and the server only need to complete a handshake, and a persistent connection can be directly created between the two for bidirectional data transmission;

[0045] Through the existing websocket technology, the server actively pushes the related udp data of the ship lock operation to the ship lock operation display system, and superimposes the related data of the ship lock operation on the ship lock model, such as the water level inside and outside the lock chamber, the traffic light, the waiting lock condition, etc.

[0046] Through the existing websocket technology, the server actively pushes the real-time ship information and its position information to the ship lock operation display system, and displays the ship in the lock chamber and the approach channel on the three-dimensional model of the ship lock through the cesium technology, so that the ship is displayed in the form of a three-dimensional model, which is more intuitive;

[0047] The present application is based on the existing oblique photography technology, processes and matches the collected photograph data to space triangulation, loads the oblique photography model through the cesium technology, and displays the ship lock and its surrounding construction and environment, and constructs the three-dimensional modeling of the ship lock and channel information;

[0048] Among them, the oblique photography technology is to carry multiple sensors on the same flight platform, collect images from five different angles including one vertical and four oblique angles, and obtain more complete and accurate information of ground objects;

[0049] Among them, the space triangulation is to import the photo data into the automatic modeling software DJI ZhiTu, select the mapping scene and related output model format, and set whether to output the cloud points, match a certain image containing the image control points in the photo library, realize the matching of the piercing point view and the photo library, and generate the oblique photography three-dimensional model of the ship lock after the piercing point is completed.

[0050] Among them, Cesium is a cross-platform and cross-browser JavaScript library for displaying three-dimensional earth and maps.

[0051] Although the present application has been described with reference to the embodiments above, various improvements can be made thereto and equivalents can be substituted therefor without departing from the scope of the present application. In particular, the features of the disclosed embodiments can be combined together in any manner as long as there is no structural conflict, and the combinations are not exhaustively described in the specification only for the purpose of omitting the length and saving resources. Therefore, the present application is not limited to the specific embodiments disclosed herein, but includes all technical solutions falling within the scope of the claims.

Claims

1. A method for displaying the operational status of a ship lock based on three-dimensional oblique photography, characterized in that: The following steps are included: Step 1: On the same flight platform, an oblique camera is mounted to collect images around the lock, capturing multi-angle images and POS data with overlap. The photo data collected by the oblique camera is processed and matched with spatial triangulation by DJI Terra automated modeling software. Then, DJI Terra automated modeling software is used to import the photo data, select the mapping scene and related output model format, and set whether to output cloud points. Step 2: Match the puncture point view with the photo library by matching an image containing the control point in the photo library. Each control point is matched with at least 4 puncture point images. After the puncture is completed, an oblique photogrammetric 3D model of the lock is generated. Step 3: After publishing the generated 3D model folder to the server, use Cesium technology to load the corresponding oblique photogrammetry model JSON file and overlay the oblique photogrammetry model on the 3D sphere. At this point, you can see the 3D model of the lock on the sphere. Step 4: Based on Step 3, label the building's function and name; Step 5: Obtain UDP data related to lock operation by calling the relevant interfaces of the lock control system; Step Six: Overlay the lock operation data onto the lock model; Step 7: Use mature WebSocket technology to obtain real-time information about the ships and display the ships in the lock chamber and the pilot channel on the lock's 3D model. The ships are displayed in the form of a 3D model.

2. The method for displaying the operational status of a ship lock based on three-dimensional oblique photography according to claim 1, characterized in that, In step two, if some objects sway or move due to wind, the automatically generated model may be blurry, have ghosting, or have holes. These issues can be repaired or the object can be deleted using post-modeling software.

3. The method for displaying the operational status of a ship lock based on three-dimensional oblique photography according to claim 1, characterized in that, In step three, Cesium is a WebGL-based map engine written in JavaScript.

4. The method for displaying the operational status of a ship lock based on three-dimensional oblique photography according to claim 1, characterized in that, In step three, Cesium technology is used to display the ship's position and information on the locks and waterways.

5. The method for displaying the operational status of a ship lock based on three-dimensional oblique photography according to claim 1, characterized in that, In step seven, WebSocket simplifies data exchange between the client and the server, allowing the server to proactively push data to the client. In the WebSocket API, the browser and the server only need to complete a handshake once to establish a persistent connection and perform bidirectional data transmission.

6. The method for displaying the operational status of a ship lock based on three-dimensional oblique photography according to claim 1, characterized in that, In step seven, the existing WebSocket technology is used to receive UDP data related to the lock operation actively pushed by the server to the lock operation display system, and the lock operation-related data is overlaid on the lock model.

7. The method for displaying the operational status of a ship lock based on three-dimensional oblique photography according to claim 1, characterized in that, In step seven, the real-time ship information and its location information are received by the server actively pushing to the lock operation display system through the existing WebSocket technology, and then the ships in the lock chamber and the pilot channel are displayed on the lock 3D model through Cesium technology.

Images