Bidirectional media file backtracking method based on geographic information data model and related device

By constructing a virtual camera and calculating the actual frame proportional relationship in a virtual three-dimensional space, the problem of media files being unable to record geographical location is solved, and the positioning function of media files is realized.

CN118916503AInactive Publication Date: 2024-11-08BOHAI ORIENTAL (BEIJING) INFORMATION TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410961830.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The current media file cannot record the actual geographical location points of some locations in the geographic information data model, resulting in the inability to locate through the media file when an abnormal situation occurs.

Method used

By importing the geographic information data model and media files into the virtual three-dimensional space, a virtual camera is constructed based on the shooting position and angle, and the shooting distance and actual frame proportional relationship are calculated, and the actual geographical location point of the target location point in the media file is determined.

Benefits of technology

It realizes the traceback of the location in the media file to the actual geographical location point of the geographic information data model, and can be positioned through the media file, solving the problem of the inability to record the spatial location.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118916503A_ABST
    Figure CN118916503A_ABST
Patent Text Reader

Abstract

The invention provides a bidirectional media file backtracking method based on a geographic information data model and a related device, and the method comprises the steps: in a virtual three-dimensional space, according to the position and angle of a media file during shooting, combining with parameters such as a shooting distance; the actual picture, position and angle of the media file during shooting are reproduced on the geographic information data model with the geographic information, so that the association between the place in the media file and the actual geographic position point in the geographic information data model is realized, and the place included in the media file can be traced back to the actual geographic position point of the geographic information data model. Therefore, positioning is realized through the media file.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of aerial photography, and in particular to a method and a related device for bidirectionally tracing back media files based on a geographic information data model. Background Art

[0002] Aerial modeling is a technology that uses unmanned vehicles to quickly and over a large area to obtain accurate three-dimensional models of the photographed target. After using unmanned vehicles for aerial modeling, a geographic information data model can be constructed. When the unmanned vehicle is used to continue aerial photography, multiple media files can be obtained, and the media files are used to reflect the geographic information adjustments corresponding to the geographic information data model.

[0003] However, the multiple media files currently captured only record the shooting position and shooting angle of the unmanned vehicle, and cannot record the actual geographical location of certain locations in the geographic information data model. In other words, the current media files cannot record the spatial location of certain locations, and when an abnormal situation occurs at the location, it cannot be located through the media files. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a method and related device for bidirectionally tracing back media files based on a geographic information data model, which can trace the locations included in the media files back to the actual geographical location points of the geographic information data model, thereby realizing positioning through media files.

[0005] To achieve the above purpose, this application has the following technical solutions:

[0006] The present application provides a method for bidirectionally tracing back media files based on a geographic information data model, comprising:

[0007] Importing a geographic information data model and a media file into a virtual three-dimensional space, wherein the media file is obtained by photographing the geographic environment, and the geographic information data model is obtained by photographing and modeling using an unmanned vehicle, and the media file carries the shooting position and shooting angle of the unmanned vehicle;

[0008] Constructing a virtual position and a virtual angle of a virtual camera in a virtual three-dimensional space according to the shooting position and the shooting angle, and determining a shooting distance of the virtual camera according to the virtual position and the virtual angle;

[0009] Calculate the actual frame of the virtual camera in the virtual three-dimensional space and the ratio between the actual frame and the media file according to the shooting distance;

[0010] Determine, according to the proportional relationship, a virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file;

[0011] The actual geographical location point corresponding to the virtual three-dimensional location point is determined according to the virtual three-dimensional location point and the virtual angle, and the position coordinates of the actual geographical location point are acquired according to the geographic information data model.

[0012] Optionally, the structural parameters of the virtual camera are the same as the structural parameters of the shooting equipment of the unmanned vehicle;

[0013] The calculating, according to the shooting distance, of the actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file comprises:

[0014] The actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file are calculated according to the shooting distance and the structural parameters of the virtual camera.

[0015] Optionally, determining the actual geographical location point corresponding to the virtual three-dimensional location point according to the virtual three-dimensional location point and the virtual angle includes:

[0016] A detection ray is projected at the virtual three-dimensional position point based on the direction of the virtual angle, and the intersection of the detection ray and the geographic information data model is the actual geographic location point corresponding to the virtual three-dimensional position point.

[0017] Optionally, the media file includes a picture file and / or a video file, the video file includes a plurality of video frames, and the video frames carry the shooting position and shooting angle of the unmanned vehicle.

[0018] Optionally, the method further comprises:

[0019] Acquire a connection angle between the actual geographical location point and a virtual location of each of the media files in the plurality of media files;

[0020] Calculating an angle difference between the connection angle corresponding to each of the media files and a virtual angle of each of the media files;

[0021] It is determined whether the angle difference is less than or equal to an error threshold; if so, it is determined that the media file is an associated file of the actual geographic location point.

[0022] Optionally, the method further comprises:

[0023] sorting the plurality of associated files according to the distance between the actual geographical location point and the virtual location of each of the plurality of associated files to obtain a sorting result;

[0024] Determine the association degree between each of the associated files in the plurality of associated files and the actual geographical location point according to the sorting result.

[0025] The present application provides a device for bidirectionally tracing back media files based on a geographic information data model, comprising:

[0026] An import unit, used to import a geographic information data model and a media file into a virtual three-dimensional space, wherein the media file is obtained by photographing a geographic environment, and the geographic information data model is obtained by photographing and modeling an unmanned vehicle, and the media file carries a shooting position and shooting angle of the unmanned vehicle;

[0027] A construction unit, configured to construct a virtual position and a virtual angle of a virtual camera in a virtual three-dimensional space according to the shooting position and the shooting angle, and determine a shooting distance of the virtual camera according to the virtual position and the virtual angle;

[0028] A calculation unit, configured to calculate, according to the shooting distance, an actual frame of the virtual camera in the virtual three-dimensional space and a proportional relationship between the actual frame and the media file;

[0029] A first determining unit, configured to determine a virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file according to the proportional relationship;

[0030] The second determining unit is used to determine the actual geographical location point corresponding to the virtual three-dimensional location point according to the virtual three-dimensional location point and the virtual angle, and obtain the position coordinates of the actual geographical location point according to the geographic information data model.

[0031] The present application provides a device for bidirectionally tracing back media files based on a geographic information data model, the device comprising: a processor and a memory;

[0032] The memory is used to store instructions;

[0033] The processor is used to execute the instructions in the memory and perform the method as described in any one of the above embodiments.

[0034] The present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program is executed on a computer device, the computer device executes the method described in any one of the above embodiments.

[0035] The present application provides a computer program product, including a computer program. When the computer program is run on a computer device, the computer device executes the method described in any one of the above embodiments.

[0036] The present application provides a method for bidirectionally tracing back media files based on a geographic information data model, the method comprising: importing the geographic information data model and the media file into a virtual three-dimensional space, the media file is obtained by photographing the geographic environment, the geographic information data model is obtained by photographing and modeling using an unmanned vehicle, and the media file carries the shooting position and shooting angle of the unmanned vehicle. The virtual position and virtual angle of the virtual camera are constructed in the virtual three-dimensional space according to the shooting position and shooting angle, the shooting distance of the virtual camera is determined according to the virtual position and virtual angle, the actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file are calculated according to the shooting distance, the virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file is determined according to the proportional relationship, the actual geographical location point corresponding to the virtual three-dimensional position point is determined according to the virtual three-dimensional position point and the virtual angle, and the position coordinates of the actual geographical location point are obtained according to the geographic information data model. That is to say, in the virtual three-dimensional space, based on the position and angle of the media file when it was shot, combined with parameters such as the shooting distance, the actual frame, position, and angle of the media file when it was shot are reproduced on a geographic information data model with geographic information, thereby realizing the association between the places in the media file and the actual geographical location points in the geographic information data model, and being able to trace the places included in the media file back to the actual geographical location points in the geographic information data model, thereby realizing positioning through the media file. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0038] Figure 1 A schematic flow chart of a method for bidirectionally tracing back media files based on a geographic information data model provided by an embodiment of the present application is shown;

[0039] Figure 2 A schematic diagram of a geographic information data model and a media file in a virtual three-dimensional space provided by an embodiment of the present application is shown;

[0040] Figure 3 A schematic diagram of structural parameters of a virtual camera provided in an embodiment of the present application is shown;

[0041] Figure 4 A schematic diagram of a shooting distance provided in an embodiment of the present application is shown;

[0042] Figure 5A schematic diagram of the calculation process of the actual picture frame provided in an embodiment of the present application is shown;

[0043] Figure 6 A schematic diagram of determining a virtual three-dimensional position point provided in an embodiment of the present application is shown;

[0044] Figure 7 Another schematic diagram of a geographic information data model and a media file in a virtual three-dimensional space provided by an embodiment of the present application is shown;

[0045] Figure 8 A schematic diagram of a connection angle provided in an embodiment of the present application is shown;

[0046] Fig. 9 A schematic diagram of an angle difference provided in an embodiment of the present application is shown;

[0047] Fig.10 A schematic diagram of associated file screening provided by an embodiment of the present application is shown;

[0048] Fig.11 A schematic diagram of determining the degree of association of associated files provided in an embodiment of the present application is shown;

[0049] Fig.12 A schematic diagram of the structure of a device for bidirectionally tracing back media files based on a geographic information data model provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0050] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below with reference to the accompanying drawings.

[0051] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present application. Therefore, the present application is not limited to the specific embodiments disclosed below.

[0052] This application is described in detail with reference to schematic diagrams. When describing the embodiments of this application in detail, for the sake of convenience, the cross-sectional diagrams showing the device structure will not be partially enlarged according to the general scale, and the schematic diagrams are only examples, which should not limit the scope of protection of this application. In addition, in actual production, the three-dimensional dimensions of length, width and depth should be included.

[0053] The multiple media files currently captured only record the shooting location and shooting angle of the unmanned vehicle, and cannot record the actual geographical location points of certain locations in the media files in the geographic information data model. In other words, the current media files cannot record the spatial locations of certain locations captured, and when an abnormal situation occurs at the location, such as a safety hazard in the infrastructure, it cannot be located through the media files, that is, it is impossible to mark and point out the spatial location corresponding to the location where the abnormal situation occurs through the media files.

[0054] In addition, when one wants to know the multiple media files corresponding to the actual geographic location points in the geographic information data model, since the multiple media files only record the shooting position and shooting angle of the unmanned vehicle, and do not record the spatial position of the places included in the media files, it is impossible to directly obtain the media files associated with the actual geographic location points.

[0055] Based on this, the present application provides a method for bidirectionally tracing back media files based on a geographic information data model, the method comprising: importing the geographic information data model and the media file into a virtual three-dimensional space, the media file is obtained by photographing the geographic environment, the geographic information data model is obtained by photographing and modeling using an unmanned vehicle, and the media file carries the shooting position and shooting angle of the unmanned vehicle. The virtual position and virtual angle of the virtual camera are constructed in the virtual three-dimensional space according to the shooting position and shooting angle, the shooting distance of the virtual camera is determined according to the virtual position and virtual angle, the actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file are calculated according to the shooting distance, the virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file is determined according to the proportional relationship, the actual geographical location point corresponding to the virtual three-dimensional position point is determined according to the virtual three-dimensional position point and the virtual angle, and the position coordinates of the actual geographical location point are obtained according to the geographic information data model. That is to say, in the virtual three-dimensional space, based on the position and angle of the media file when it was shot, combined with parameters such as the shooting distance, the actual frame, position, and angle of the media file when it was shot are reproduced on a geographic information data model with geographic information, thereby realizing the association between the places in the media file and the actual geographical location points in the geographic information data model, and being able to trace the places included in the media file back to the actual geographical location points in the geographic information data model, thereby realizing positioning through the media file.

[0056] In order to better understand the technical solution and technical effects of the present application, specific embodiments will be described in detail below with reference to the accompanying drawings.

[0057] refer to Figure 1 FIG. 1 is a flow chart of a method for bidirectionally tracing back media files based on a geographic information data model provided by an embodiment of the present application, the method comprising the following steps:

[0058] S101, importing geographic information data models and media files into a virtual three-dimensional space.

[0059] In the embodiment of the present application, the geographic information data model is obtained by shooting and modeling using an unmanned vehicle, and the geographic information data model includes multiple actual geographic location points, and the geographic information data model carries the location coordinates of each actual geographic location point, wherein the location coordinates include longitude, latitude and altitude. The geographic information data model can also be called digital terrain.

[0060] The media file is obtained by photographing the geographical environment, and the media file carries the shooting position and shooting angle of the unmanned vehicle. When the unmanned vehicle carries a shooting device, the media file carries the shooting position and shooting angle of the shooting device.

[0061] Specifically, the media file may include a picture file and / or a video file. The picture file carries the shooting position and shooting angle of the unmanned vehicle. The video file includes multiple video frames, and the video frames carry the shooting position and shooting angle of the unmanned vehicle.

[0062] The image file carries the shooting position and shooting angle of the unmanned vehicle, which can be implemented in the following two ways:

[0063] As a possible implementation method, before the unmanned vehicle takes a photo, the planned shooting position and shooting angle are "recorded" in detail, and the shooting is strictly carried out in accordance with the plan. The "record" can be retrieved later to obtain the shooting position and shooting angle when the image file was taken.

[0064] As another possible implementation method, when the unmanned vehicle is taking pictures, the shooting device synchronously "records" the shooting position and shooting angle of the shooting device at the moment of shooting in the corresponding image file. The "record" can then be retrieved to obtain the shooting position and shooting angle when the image file was taken.

[0065] Since the video file includes multiple video frames, the shooting position and shooting angle of a certain video frame can be obtained by interpolation calculation according to the shooting position and shooting angle of the starting frame, key frame and end frame of the video file and the percentage of each video frame occupying all video frames. Therefore, the video file carrying the shooting position and shooting angle of the unmanned vehicle can be implemented in the following two ways:

[0066] As a possible implementation method, before the unmanned vehicle shoots, the planned "shooting position and shooting angle of the starting frame", "shooting position and shooting angle of each key frame", and "shooting position and shooting angle of the ending frame" are "recorded" in detail. If the shooting is strictly carried out in accordance with the plan, the "record" can be retrieved later to obtain the shooting position and shooting angle of the starting frame", "shooting position and shooting angle of each key frame", and "shooting position and shooting angle of the ending frame" for subsequent interpolation calculations.

[0067] As another possible implementation method, when an unmanned vehicle is shooting, the shooting device synchronously "records" the "shooting position and shooting angle of the starting frame", "the shooting position and shooting angle of each key frame", and "the shooting position and shooting angle of the completion frame" in the corresponding video frame. The "record" can then be retrieved to obtain the shooting position and shooting angle of the starting frame, "the shooting position and shooting angle of each key frame", and "the shooting position and shooting angle of the completion frame" for subsequent interpolation calculations.

[0068] After obtaining the geographic information data model and media files, the geographic information data model and media files can be imported into the virtual three-dimensional space. Figure 2 shown. Figure 2 The geographic information data model in includes a building model. Figure 2 The rectangular solid line frame in the middle represents the frame size of the media file, the intersection of the cross lines in the rectangular solid line frame is the shooting position of the media file, and the direction of the yellow dotted arrow is the shooting angle.

[0069] S102, constructing a virtual position and a virtual angle of a virtual camera in a virtual three-dimensional space according to the shooting position and the shooting angle, and determining a shooting distance of the virtual camera according to the virtual position and the virtual angle.

[0070] In the embodiments of the present application, considering that the virtual three-dimensional space can be used to construct the correspondence between the location in the media file and the actual geographical location point in the geographic information data model, a virtual camera can be constructed in the virtual three-dimensional space to simulate the shooting equipment of the unmanned vehicle using the virtual camera. Specifically, the virtual position and virtual angle of the virtual camera can be constructed in the virtual three-dimensional space according to the shooting position and the shooting angle, wherein the shooting position corresponds to the virtual position, and the shooting angle corresponds to the virtual angle.

[0071] When constructing a virtual camera, the structural parameters of the virtual camera are the same as those of the unmanned vehicle's shooting equipment, where the structural parameters include the field of view (FOV) angle and the sensor resolution aspect ratio. Figure 3 As shown, when constructing a virtual camera, the red area is the FOV angle.

[0072] In the embodiment of the present application, after a virtual camera is constructed in a virtual three-dimensional space, the shooting distance of the virtual camera can be determined according to the virtual position and the virtual angle. Specifically, a detection ray can be projected at the virtual position with the direction of the virtual angle as a reference, and the intersection of the detection ray and the geographic information data model is the collision point, and the distance between the collision point and the virtual position is the shooting distance.

[0073] refer to Figure 4 As shown, Figure 4 The intersection of the cross lines in the middle rectangular solid frame is the virtual position, and the blue solid arrow is the shooting distance.

[0074] S103, calculating the actual frame of the virtual camera in the virtual three-dimensional space and the ratio between the actual frame and the media file according to the shooting distance.

[0075] In an embodiment of the present application, after determining the shooting distance, the actual frame of the virtual camera in the virtual three-dimensional space can be calculated based on the shooting distance. After obtaining the actual frame, the proportional relationship between the actual frame and the media file can also be calculated, so that the locations in the subsequent media files can be determined in the actual frame.

[0076] Considering that the structural parameters of the virtual camera are the same as those of the shooting equipment of the unmanned vehicle, the actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file can be calculated according to the shooting distance and the structural parameters of the virtual camera.

[0077] As an example, refer to Figure 5 As shown, the actual width and height of the picture can be calculated according to the following formula:

[0078]

[0079] Among them, D is the width of the actual frame, H is the height of the actual frame, a is the aspect ratio of the sensor resolution, FOV is the field of view angle, and S is the shooting distance.

[0080] The proportional relationship between the actual frame and the media file may refer to the relationship between the ratio of the width and height of the virtual three-dimensional position point in the actual frame and the ratio of the width and height of the target position point in the media file. Usually, the ratio of the width and height of the virtual three-dimensional position point in the actual frame and the ratio of the width and height of the target position point in the media file are equal, so that a one-to-one correspondence between the virtual three-dimensional position point and the target position point can be achieved. Subsequently, the virtual three-dimensional position point in the actual frame corresponding to any target position point in the media file can be calculated using this proportional relationship.

[0081] Specifically, the aspect ratio of the virtual 3D position point to the actual picture frame may include a width ratio and a height ratio, wherein the width ratio refers to the ratio of the width of the actual picture frame occupied by the virtual 3D position point, and the height ratio refers to the ratio of the height of the actual picture frame occupied by the virtual 3D position point. Correspondingly, the aspect ratio of the target position point to the media file may also include a width ratio and a height ratio, wherein the width ratio refers to the ratio of the width of the media file occupied by the target position point, and the height ratio refers to the ratio of the height of the media file occupied by the target position point.

[0082] refer to Figure 6 As shown, the ratio of the width of the media file occupied by the target position point is: the target position point divides the width of the media file into two parts of 1:5, with the left side being 1 and the right side being 5. The ratio of the height of the media file occupied by the target position point is: the target position point divides the height of the media file into two parts of 1:4, with the upper side being 1 and the lower side being 4.

[0083] S104: Determine a virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file according to the proportional relationship.

[0084] In an embodiment of the present application, after determining the proportional relationship between the actual frame and the media file, the virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file can be determined according to the proportional relationship, that is, the virtual three-dimensional position point in the actual frame corresponding to the location in the media file can be determined according to the proportional relationship. The target position point is any location in the media file. In other words, the virtual three-dimensional position point in the actual frame of the virtual camera in the virtual three-dimensional space when shooting can be determined according to the proportional relationship.

[0085] Specifically, refer to Figure 6 As shown, the target position point is a red dot in the media file. According to the aspect ratio of the target position point in the media file, the virtual 3D position point of the actual frame corresponding to the target position point is obtained by interpolation calculation. In other words, the ratio of the width of the media file occupied by the target position point is 1:5, and the ratio of the height of the media file occupied by the target position point is 1:4. Then, the ratio of the width of the actual frame occupied by the virtual 3D position point is also 1:5, and the ratio of the height of the actual frame occupied by the virtual 3D position point is also 1:4. Then, according to the aspect ratio of the virtual 3D position point to the actual frame, the virtual 3D position point of the actual frame corresponding to the target position point is calculated.

[0086] S105, determining the actual geographical location point corresponding to the virtual three-dimensional location point according to the virtual three-dimensional location point and the virtual angle, and acquiring the position coordinates of the actual geographical location point according to the geographic information data model.

[0087] In an embodiment of the present application, after obtaining the virtual three-dimensional position point of the actual frame corresponding to the target position point in the media file, the actual geographical location point corresponding to the virtual three-dimensional position point can be determined based on the virtual three-dimensional position point and the virtual angle. Since the geographic information data model carries the position coordinates of each actual geographical location point, the position coordinates of the actual geographical location point can be obtained based on the geographic information data model.

[0088] Specifically, a detection ray may be projected at the virtual three-dimensional position point based on the direction of the virtual angle, and the intersection of the detection ray and the geographic information data model is the actual geographic location point corresponding to the virtual three-dimensional position point.

[0089] refer to Figure 6 As shown, Figure 6 The intersection of the cross lines in the rectangular solid frame is the virtual position, the starting point of the red solid arrow is the virtual three-dimensional position point, the red solid arrow is the detection ray projected at the virtual three-dimensional position point with the direction of the virtual angle as the reference, and the end point of the red solid arrow is the intersection of the detection ray and the geographic information data model, which is the actual geographic location point.

[0090] It can be seen that the method for bidirectionally tracing back media files based on the geographic information data model provided by the embodiment of the present application combines the shooting position and shooting angle of the media file when it was shot with the structural parameters of the shooting equipment of the unmanned vehicle and the calculated shooting distance, and calculates so that the actual frame of the media file is unfolded in the virtual three-dimensional space, and locates it in the geographic information location environment provided by the geographic information data model. In other words, the present application can reproduce the actual frame, shooting position and shooting angle of the media file when it was shot on the geographic information data model with geographic information, thereby locating the place in the media file.

[0091] In an embodiment of the present application, after determining the actual geographic location point in the geographic information data model corresponding to the target location point in the media file, multiple media files associated with the actual geographic location point can also be obtained, so as to facilitate detailed analysis of the situation of the actual geographic location point using multiple media files.

[0092] Considering that after the geographic information data model is imported into the virtual three-dimensional space, any actual geographic location point in the virtual three-dimensional space carries location coordinates, if a media file associated with any actual geographic location point is to be obtained, multiple media files may also be imported into the virtual three-dimensional space.

[0093] refer to Figure 7 As shown, Figure 7 The intersection of the cross lines in the solid rectangular frame is the virtual position, and the yellow dotted arrow is the virtual angle. Figure 7The figure shows the situations of shooting media files at three different virtual locations and different virtual angles. The red marked points are the actual geographical locations.

[0094] In order to obtain a media file associated with an actual geographic location, the angle of the line between the actual geographic location point and the virtual location of each media file in a plurality of media files may be obtained, the angle difference between the angle of the line corresponding to each media file and the virtual angle of each media file may be calculated, and it may be determined whether the angle difference is less than or equal to an error threshold. If it is less than or equal to the error threshold, the media file may be determined to be an associated file of the actual geographic location point. In other words, when the angle difference is greater than the error threshold, it means that the shooting angle of the media file is not aligned with the actual geographic location point, and the media file is irrelevant to the actual geographic location point. When the angle difference is less than or equal to the error threshold, it means that the shooting angle of the media file is aligned with the actual geographic location point, and the media file is relevant to the actual geographic location point.

[0095] refer to Figure 8 As shown, the red marked points and the intersection points of the cross lines in the rectangular solid line frame can be connected respectively to obtain the connection angle between the actual geographic location point and the virtual location of each media file in multiple media files, that is, the direction of the blue solid arrow is the connection angle. Fig. 9 As shown, the angle difference between the yellow dotted arrow and the blue realization arrow is the angle difference between the connection angle corresponding to each media file and the virtual angle of each media file. Fig. 9 The angle difference between the virtual angle and the line angle of the top media file is relatively large, which means that the shooting angle of the media file is not aligned with the actual geographic location point, that is, the top media file has no correlation with the actual geographic location point. Fig. 9 The difference between the virtual angle and the connecting angle of the two media files in the middle and lower part is small, which means that the shooting angle of the media files is aligned with the actual geographic location point, that is, the two media files below are associated with the actual geographic location point. These two media files are determined as the associated files of the actual geographic location point. Fig.10 shown.

[0096] In an embodiment of the present application, after the associated files associated with the actual geographic location point are screened from multiple media files, the association degrees of the associated files may be sorted, so that the user can more easily know the association degrees of the associated files more clearly.

[0097] Specifically, the degree of association can be determined based on the distance between the actual geographical location point and the virtual location of each associated file in the multiple associated files. The multiple associated files can be sorted according to the distance between the actual geographical location point and the virtual location of each associated file in the multiple associated files to obtain a sorting result, and the degree of association between each associated file in the multiple associated files and the actual geographical location point can be determined based on the sorting result.

[0098] refer to Fig.10 As shown in the figure, the length of the start point and the end point of the blue solid arrow is the distance between the actual geographic location point and the virtual location of the associated file.

[0099] As a possible implementation method, the association degrees of multiple associated files can be sorted in ascending order of the distance between the actual geographic location point and the virtual location of the associated files, that is, the association degrees of multiple associated files are sorted from near to far according to the shooting distance, wherein the association degrees of multiple associated files are in descending order, that is, the distance and the association degree between the actual geographic location point and the virtual location of the associated files are inversely proportional, the closer the distance, the higher the association degree, and the farther the distance, the lower the association degree. This is because the closer the distance, the more details of the media file obtained by shooting, and the more it can reflect the actual situation of the actual geographic location point.

[0100] refer to Fig.11 As shown, the media file with the smallest distance between the actual geographical location point and the virtual location of the associated file is selected as the associated file with the highest association degree.

[0101] It can be seen that the present application can achieve filtering according to the actual geographic location point to obtain the media files associated with it, and combine positioning through the location in the media file to achieve two-way connection and two-way filtering between the geographic information data model and the media file.

[0102] Based on the method for bidirectionally tracing back media files based on a geographic information data model provided in the above embodiments, the present application embodiment also provides a device for bidirectionally tracing back media files based on a geographic information data model, referring to Fig.12 , which is a schematic diagram of a device for bidirectionally tracing back media files based on a geographic information data model provided in an embodiment of the present application. The device 200 for bidirectionally tracing back media files based on a geographic information data model provided in an embodiment of the present application includes:

[0103] An importing unit 210 is used to import a geographic information data model and a media file into a virtual three-dimensional space, wherein the media file is obtained by photographing a geographic environment, and the geographic information data model is obtained by photographing and modeling an unmanned vehicle, and the media file carries a photographing position and a photographing angle of the unmanned vehicle;

[0104] A construction unit 220, configured to construct a virtual position and a virtual angle of a virtual camera in a virtual three-dimensional space according to the shooting position and the shooting angle, and determine a shooting distance of the virtual camera according to the virtual position and the virtual angle;

[0105] A calculation unit 230, configured to calculate, according to the shooting distance, an actual frame of the virtual camera in the virtual three-dimensional space and a ratio between the actual frame and the media file;

[0106] A first determining unit 240 is used to determine a virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file according to the proportional relationship;

[0107] The second determining unit 250 is used to determine the actual geographical location point corresponding to the virtual three-dimensional location point according to the virtual three-dimensional location point and the virtual angle, and obtain the position coordinates of the actual geographical location point according to the geographic information data model.

[0108] Optionally, the structural parameters of the virtual camera are the same as the structural parameters of the shooting equipment of the unmanned vehicle;

[0109] The calculation unit 230 is used to:

[0110] The actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file are calculated according to the shooting distance and the structural parameters of the virtual camera.

[0111] Optionally, the second determining unit 250 is configured to:

[0112] A detection ray is projected at the virtual three-dimensional position point based on the direction of the virtual angle, and the intersection of the detection ray and the geographic information data model is the actual geographic location point corresponding to the virtual three-dimensional position point.

[0113] Optionally, the media file includes a picture file and / or a video file, the video file includes a plurality of video frames, and the video frames carry the shooting position and shooting angle of the unmanned vehicle.

[0114] Optionally, the device further includes a third determining unit, the third determining unit being configured to:

[0115] Acquire a connection angle between the actual geographical location point and a virtual location of each of the media files in the plurality of media files;

[0116] Calculating an angle difference between the connection angle corresponding to each of the media files and a virtual angle of each of the media files;

[0117] It is determined whether the angle difference is less than or equal to an error threshold; if so, it is determined that the media file is an associated file of the actual geographic location point.

[0118] Optionally, the device further includes a fourth determining unit, the fourth determining unit being configured to:

[0119] sorting the plurality of associated files according to the distance between the actual geographical location point and the virtual location of each of the plurality of associated files to obtain a sorting result;

[0120] Determine the association degree between each of the associated files in the plurality of associated files and the actual geographical location point according to the sorting result.

[0121] Based on the method for bidirectionally tracing back media files based on a geographic information data model provided in the above embodiment, the embodiment of the present application further provides a device for bidirectionally tracing back media files based on a geographic information data model. The device for bidirectionally tracing back media files based on a geographic information data model includes:

[0122] The processor and the memory may be one or more processors. In some embodiments of the present application, the processor and the memory may be connected via a bus or other means.

[0123] The memory may include a read-only memory and a random access memory, and provides instructions and data to the processor. A portion of the memory may also include an NVRAM. The memory stores an operating system and operating instructions, executable modules or data structures, or a subset thereof, or an extended set thereof, wherein the operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic services and processing hardware-based tasks.

[0124] The processor controls the operation of the terminal device and may also be referred to as a CPU.

[0125] The method disclosed in the above embodiment of the present application can be applied to a processor or implemented by a processor. The processor can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor can be combined to perform. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0126] The embodiment of the present application also provides a computer-readable storage medium for storing program code, where the program code is used to execute any one of the methods of the aforementioned embodiments.

[0127] In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0128] It should be noted that the computer-readable medium mentioned above in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0129] When introducing elements of various embodiments of the present application, the articles "a," "an," "the," and "said" are intended to mean that there are one or more elements. The words "comprising," "including," and "having" are all inclusive and mean that there may be additional elements in addition to the listed elements.

[0130] It should be noted that a person skilled in the art can understand that all or part of the processes in the above method embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes in the above method embodiments. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0131] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0132] The present application also provides a computer program product. When the computer program product is run on a computer device, the computer device executes any one of the methods of the foregoing embodiments.

[0133] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0134] The above is only a preferred implementation of the present application. Although the present application has been disclosed as a preferred embodiment, it is not intended to limit the present application. Any technician familiar with the art can use the above disclosed methods and technical contents to make many possible changes and modifications to the technical solution of the present application without departing from the scope of the technical solution of the present application, or modify it into an equivalent embodiment of equivalent changes. Therefore, any simple modification, equivalent change and modification made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application still falls within the scope of protection of the technical solution of the present application.

Claims

1. A method for bidirectionally tracing back media files based on geographic information data model, It is characterized in that include: Importing a geographic information data model and a media file into a virtual three-dimensional space, wherein the media file is obtained by photographing the geographic environment, and the geographic information data model is obtained by photographing and modeling using an unmanned vehicle, and the media file carries the shooting position and shooting angle of the unmanned vehicle; Constructing a virtual position and a virtual angle of a virtual camera in a virtual three-dimensional space according to the shooting position and the shooting angle, and determining a shooting distance of the virtual camera according to the virtual position and the virtual angle; Calculate the actual frame of the virtual camera in the virtual three-dimensional space and the ratio between the actual frame and the media file according to the shooting distance; Determine, according to the proportional relationship, a virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file; The actual geographical location point corresponding to the virtual three-dimensional location point is determined according to the virtual three-dimensional location point and the virtual angle, and the position coordinates of the actual geographical location point are acquired according to the geographic information data model.

2. The method according to claim 1, It is characterized in that The structural parameters of the virtual camera are the same as those of the shooting equipment of the unmanned vehicle; The calculating, according to the shooting distance, of the actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file comprises: The actual frame of the virtual camera in the virtual three-dimensional space and the proportional relationship between the actual frame and the media file are calculated according to the shooting distance and the structural parameters of the virtual camera.

3. The method according to claim 1, It is characterized in that Determining the actual geographical location point corresponding to the virtual three-dimensional location point according to the virtual three-dimensional location point and the virtual angle comprises: A detection ray is projected at the virtual three-dimensional position point based on the direction of the virtual angle, and the intersection of the detection ray and the geographic information data model is the actual geographic location point corresponding to the virtual three-dimensional position point.

4. The method according to claim 1, It is characterized in that The media file includes a picture file and / or a video file, and the video file includes a plurality of video frames, and the video frames carry the shooting position and shooting angle of the unmanned vehicle.

5. The method according to claim 1, It is characterized in that The method further comprises: Acquire a connection angle between the actual geographical location point and a virtual location of each of the media files in the plurality of media files; Calculating an angle difference between the connection angle corresponding to each of the media files and a virtual angle of each of the media files; It is determined whether the angle difference is less than or equal to an error threshold; if so, it is determined that the media file is an associated file of the actual geographic location point.

6. The method according to claim 5, It is characterized in that The method further comprises: sorting the plurality of associated files according to the distance between the actual geographical location point and the virtual location of each of the plurality of associated files to obtain a sorting result; Determine the association degree between each of the associated files in the plurality of associated files and the actual geographical location point according to the sorting result.

7. A device for bidirectionally tracing back media files based on a geographic information data model, It is characterized in that include: An import unit, used to import a geographic information data model and a media file into a virtual three-dimensional space, wherein the media file is obtained by photographing a geographic environment, and the geographic information data model is obtained by photographing and modeling an unmanned vehicle, and the media file carries a shooting position and shooting angle of the unmanned vehicle; A construction unit, configured to construct a virtual position and a virtual angle of a virtual camera in a virtual three-dimensional space according to the shooting position and the shooting angle, and determine a shooting distance of the virtual camera according to the virtual position and the virtual angle; A calculation unit, configured to calculate, according to the shooting distance, an actual frame of the virtual camera in the virtual three-dimensional space and a proportional relationship between the actual frame and the media file; A first determining unit, configured to determine a virtual three-dimensional position point in the actual frame corresponding to the target position point in the media file according to the proportional relationship; The second determining unit is used to determine the actual geographical location point corresponding to the virtual three-dimensional location point according to the virtual three-dimensional location point and the virtual angle, and obtain the position coordinates of the actual geographical location point according to the geographic information data model.

8. A device for bidirectionally tracing back media files based on a geographic information data model, It is characterized in that The device comprises: a processor and a memory; The memory is used to store instructions; The processor is used to execute the instructions in the memory to perform the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, It is characterized in that The computer-readable storage medium is used to store a computer program, and when the computer program is executed on a computer device, the computer device executes the method according to any one of claims 1 to 6.

10. A computer program product comprising a computer program, It is characterized in that When the computer program is executed on a computer device, the computer device is caused to execute the method according to any one of claims 1 to 6.