Aerial photography modeling system
By setting wide-angle and narrow-angle cameras side by side in the aerial photography system, combined with ground reception equipment, the aircraft altitude information is corrected in real time, the problem of low model accuracy in the aerial photography three-dimensional modeling system is solved, and the modeling effect and accuracy are improved.
Patent Information
- Application Number
- CN202310425121.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-20
- Publication Date
- 2024-11-08
AI Technical Summary
The existing aerial three-dimensional modeling system constructs a model after the shooting process, resulting in low accuracy of the model and the inability to accurately locate the aircraft in real time, affecting the effect of three-dimensional modeling.
Using wide-angle and narrow-angle cameras arranged side by side on the aircraft, the image information correction positioning module is used to determine the height information of the first camera through the image information collected by the narrow-angle camera, and a three-dimensional model is constructed using the wide-angle camera, combining the ground receiving equipment and the display module to display the image in real time. information to improve the accuracy and effectiveness of modeling.
By correcting the altitude information of the aircraft in real time and expanding the viewing angle range, the accuracy and effect of three-dimensional modeling are significantly improved, and the problem of low model accuracy in the prior art is solved.
Smart Images

Figure CN118918276A_ABST
Abstract
Description
Technical Field
[0001] One or more embodiments of the present specification relate to the field of optical technology, and more particularly, to an aerial photography modeling system. Background Art
[0002] Three-dimensional modeling is not a very new technology. In foreign countries, geological modeling has been developed for decades. However, in recent years, three-dimensional modeling has been continuously applied to more fields. People use drones to take aerial photos or shoot videos, and then make them into maps, videos and other products through post-processing. The use of high technology has facilitated people's exploration of large areas of unknown areas. At present, aerial three-dimensional modeling is mostly carried out after the shooting process is completed, which makes it impossible to build an accurate model. Summary of the invention
[0003] In view of this, an object of one or more embodiments of the present specification is to provide an aerial photography modeling system to solve the problem of accuracy in building a model.
[0004] In a first aspect, an aerial photography modeling system is provided, the aerial photography modeling system comprising an aircraft, a first camera arranged on the aircraft; and a second camera arranged on the aircraft; wherein the first camera and the second camera are arranged side by side, and the camera axes of the first camera and the second camera are arranged in parallel; the first camera is a wide-angle camera; and the second camera is a narrow-angle camera; and further comprising:
[0005] A positioning module and a control module arranged on the aircraft;
[0006] The control module is used to correct the height information of the first camera determined by the positioning module according to the image information taken by the second camera; and to construct a three-dimensional model according to the image information taken by the first camera.
[0007] In the above technical solution, by setting the first camera and the second camera to collect images, and using the image information collected by the second camera as the height correction module of the positioning module, the height information of the aircraft can be located more accurately. In addition, by using a wide-angle camera for the first camera, a wider viewing angle can be captured, thereby improving the effect of constructing a three-dimensional model.
[0008] In a specific possible implementation manner, the first camera and the second camera are suspended below the aircraft.
[0009] In a specific implementation scheme, the height of the lens of the first camera is consistent with that of the lens of the second camera.
[0010] In a specific possible implementation manner, the control module is specifically used to determine the height information of the second camera according to the reflective information of a set building in the image taken by the second camera.
[0011] In a specific possible implementation manner, the viewing angles of the first camera and the second camera at least partially overlap.
[0012] In a specific implementation scheme, it also includes a ground receiving device, and the control module is arranged on the ground receiving device.
[0013] In a specific possible implementation scheme, the ground receiving device also includes a display module, and the display module is used to display the three-dimensional model constructed according to the image information captured by the first camera.
[0014] In a specific possible implementation scheme, the display module is also used to display image information captured by the first camera and the second camera.
[0015] In a specific implementation scheme, the first camera and the second camera are anti-shake cameras.
[0016] In a specific possible implementation manner, the aircraft is rotatably connected to a horizontal platform;
[0017] The first camera and the second camera are arranged on the horizontal platform;
[0018] The control module is also used to control the horizontal platform to maintain a horizontal state when the aircraft is flying. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate one or more embodiments of the present specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only one or more embodiments of the present specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0020] Figure 1 A schematic diagram of the structure of the aerial photography modeling system provided in an embodiment of the present application;
[0021] Figure 2 A structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0022] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.
[0023] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of this specification should be understood by people with ordinary skills in the field to which this disclosure belongs. The "first", "second" and similar words used in one or more embodiments of this specification do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0024] The technical carriers involved in the payment described in the embodiments of this specification may include, for example, Near Field Communication (NFC), WIFI, 3G / 4G / 5G, POS card swiping technology, QR code scanning technology, bar code scanning technology, Bluetooth, infrared, short message service (SMS), multimedia message service (MMS), etc.
[0025] The biological characteristics involved in the biological identification described in the embodiments of this specification may include, for example, eye characteristics, voiceprints, fingerprints, palm prints, heartbeats, pulses, chromosomes, DNA, human tooth marks, etc. Eye prints may include irises, sclera and other biological characteristics.
[0026] The aerial photography modeling system provided in the embodiment of the present application is applied to three-dimensional modeling. Currently, three-dimensional modeling is performed after shooting is completed, resulting in low modeling accuracy. For this reason, the embodiment of the present application provides an aerial photography modeling system to improve the modeling effect.
[0027] refer to Figure 1 , Figure 1The structural block diagram of the aerial modeling system provided in the embodiment of the present application is shown. The aerial modeling system provided in the embodiment of the present application mainly includes an aircraft 10, a camera device, a positioning module 50 and a control module 70. Among them, the aircraft 10 is used as a main body for flying, driving the camera device and other equipment into the sky. The camera device is used for aerial photography and image capture; the positioning module 50 is used to position the aircraft 10 to obtain position information; and the control module 70 is used as a processor to perform image processing according to the signals of the positioning module 50 and the camera device to construct a three-dimensional model. The structure of each component is described in detail below.
[0028] First, the aircraft 10 is explained. The aircraft 10 provided in the embodiment of the present application is a four-wing aircraft, which is driven by four propellers to fly, thereby obtaining a stable posture.
[0029] The camera device is used to capture images, and when set, the camera device is set in the aircraft 10. When specifically set, the camera device includes two cameras, which are named as a first camera 30 and a second camera 40 for the convenience of description, wherein the first camera 30 and the second camera 40 are arranged side by side below the aircraft 10, and are suspended below the aircraft 10. In addition, when set, the camera axes of the first camera 30 and the second camera 40 are arranged in parallel, and the viewing angles of the first camera 30 and the second camera 40 partially overlap.
[0030] When the first camera 30 and the second camera 40 are specifically arranged, the first camera 30 and the second camera 40 are fixed to the first camera 30 and the second camera 40 in a suspended manner. Exemplarily, the aircraft 10 is rotatably connected to the horizontal platform 20; and the first camera 30 and the second camera 40 are arranged on the horizontal platform 20. If the horizontal platform 20 is connected to the aircraft 10 through a universal joint, the first camera 30 and the second camera 40 are arranged on the side of the horizontal platform 20 away from the aircraft 10. When controlled by the control module 70, the control module 70 can control the horizontal platform 20 to maintain a horizontal state when the aircraft 10 flies. Specifically, if a driving mechanism is provided at the part where the horizontal platform 20 is connected to the aircraft 10, the driving mechanism can be used to control the horizontal platform 20 to maintain a relative level. When the posture of the aircraft 10 is shaking during flight, the driving mechanism can be used to drive the horizontal platform 20 to maintain a level. The driving mechanism can be a plurality of driving cylinders respectively articulated with the aircraft 10 and the horizontal platform 20, so as to adjust the level of the horizontal platform 20 by telescoping different driving cylinders.
[0031] When the first camera 30 and the second camera 40 are set, the height of the lens of the first camera 30 and the lens of the second camera 40 are consistent, so that the images formed by the two cameras are consistent when shooting. As an optional solution, the first camera 30 and the second camera 40 are anti-shake cameras, which can further maintain stability during shooting.
[0032] In the embodiment of the present application, the first camera 30 and the second camera 40 are cameras with different functions, wherein the first camera 30 is a wide-angle camera for capturing images for modeling. The second camera 40 is a narrow-angle camera for positioning adjustment. When shooting, the first camera 30 and the second camera 40 shoot separately. When set, the viewing angle range of the first camera 30 and the second camera 40 at least partially overlap. So that when the first camera 30 and the second camera 40 shoot, the images can be partially overlapped.
[0033] When shooting, the second camera 40 shoots the image information of the reference object, and the control module 70 can correct the height information of the first camera 30 determined by the positioning module 50 according to the image information shot by the second camera 40; and build a three-dimensional model according to the image information shot by the first camera 30. Exemplarily, the second camera 40 is used to determine the height information of the second camera 40 according to the reflection information of the building set in the image shot by the second camera 40. When shooting, the control device stores reflection information of different objects at different heights. When shooting, the second camera 40 is used to shoot the reflection information of different reference objects. The control device compares the reflection information of different objects at different heights stored with the reflection information of the reference object shot by the second camera 40 to determine the height information of the second camera 40, that is, the height information of the first camera 30. For example, if the second camera 40 shoots the reflection information of the asphalt road, and the control device stores the reflection information of the asphalt road at different heights, the height information of the second camera 40 can be determined according to the comparison between the two. And the height information is used as the height information of the first camera 30 determined by the positioning module 50 to obtain more accurate image information.
[0034] When modeling, the control module 70 processes the image according to the corrected height information of the first camera 30 to obtain the height information of different buildings in the image, and determines the three-dimensional modeling model based on the height information and the position information of the horizontal coordinate located by the positioning module 50, so that the three-dimensional model can be obtained more accurately.
[0035] As an optional solution, the aerial photography modeling system provided in the embodiment of the present application further includes a ground receiving device 60, and the control module 70 is arranged on the ground receiving device 60. In the specific setting, the control module 70 is arranged on the ground receiving device 60 to reduce the total weight of the aircraft 10 during flight. In addition, the ground receiving device 60 also includes a display module 80, and the display module 80 is used to display the three-dimensional model constructed according to the image information captured by the first camera 30. The display module 80 is used to display the three-dimensional model modeled according to the picture captured by the first camera 30. In addition, the display module 80 is also used to display the image information captured by the first camera 30 and the second camera 40.
[0036] It can be seen from the above description that the aerial modeling system provided in the embodiment of the present application performs image acquisition by setting a first camera 30 and a second camera 40, and uses the image information acquired by the second camera 40 as a height correction module of the positioning module 50, thereby more accurately locating the height information of the aircraft 10. In addition, by using a wide-angle camera in the first camera 30, a wider viewing angle range can be captured, thereby improving the effect of constructing a three-dimensional model.
[0037] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0038] For the convenience of description, the above devices are described in terms of functions divided into various modules. Of course, when implementing one or more embodiments of this specification, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0039] The device of the above embodiment is used to implement the corresponding aerial modeling system in the above embodiment, and has the beneficial effects of the corresponding aerial modeling system embodiment, which will not be described in detail here.
[0040] Figure 2 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0041] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0042] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0043] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0044] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0045] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0046] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0047] The computer-readable media of this embodiment include permanent and non-permanent, removable and non-removable media that can be used by any aerial modeling system or technology to implement information storage. The information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0048] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. In line with the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of different aspects of one or more embodiments of the present specification as described above, which are not provided in detail for the sake of simplicity.
[0049] In addition, to simplify the description and discussion, and in order not to obscure one or more embodiments of the present specification, known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, the device may be shown in the form of a block diagram so as to avoid obscuring one or more embodiments of the present specification, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which one or more embodiments of the present specification will be implemented (i.e., these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it is apparent to those skilled in the art that one or more embodiments of the present specification may be implemented without these specific details or with variations in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.
[0050] Although the present disclosure has been described in conjunction with specific embodiments of the present disclosure, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0051] One or more embodiments of this specification are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of this specification should be included in the scope of protection of this disclosure.
Claims
1. An aerial photography modeling system, It is characterized in that The invention comprises an aircraft, a first camera arranged on the aircraft, and a second camera arranged on the aircraft; wherein the first camera and the second camera are arranged side by side, and the camera axes of the first camera and the second camera are arranged in parallel; the first camera is a wide-angle camera; and the second camera is a narrow-angle camera; and further comprises: A positioning module and a control module arranged on the aircraft; The control module is used to correct the height information of the first camera determined by the positioning module according to the image information taken by the second camera; and to construct a three-dimensional model according to the image information taken by the first camera.
2. The aerial modeling system according to claim 1, It is characterized in that The first camera and the second camera are suspended below the aircraft.
3. The aerial modeling system according to claim 1, It is characterized in that The height of the lens of the first camera is consistent with that of the lens of the second camera.
4. The aerial modeling system according to claim 3, It is characterized in that The control module is specifically used to determine the height information of the second camera according to the reflection information of the set building in the image taken by the second camera.
5. The aerial modeling system according to claim 1, It is characterized in that The viewing angles of the first camera and the second camera at least partially overlap.
6. The aerial modeling system according to any one of claims 1 to 5, It is characterized in that It also includes a ground receiving device, and the control module is arranged on the ground receiving device.
7. The aerial modeling system according to claim 1, It is characterized in that The ground receiving device also includes a display module, which is used to display the three-dimensional model constructed according to the image information captured by the first camera.
8. The aerial modeling system according to claim 1, It is characterized in that The display module is also used to display image information captured by the first camera and the second camera.
9. The aerial modeling system according to claim 1, It is characterized in that The first camera and the second camera are anti-shake cameras.
10. The aerial modeling system according to claim 1, It is characterized in that The aircraft is rotatably connected to a horizontal platform; The first camera and the second camera are arranged on the horizontal platform; The control module is also used to control the horizontal platform to maintain a horizontal state when the aircraft is flying.
