Movable platform
By using a load component and a rotation axis drive component in a panoramic camera, combined with first and second image sensors, the shortcomings of panoramic cameras in terms of field of view overlap and coverage are solved, enabling higher quality panoramic image generation and high-quality image acquisition in both panoramic and non-panoramic modes.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- SZ SHANZHI TECH CO LTD
- Filing Date
- 2025-04-15
- Publication Date
- 2026-05-12
AI Technical Summary
Existing panoramic cameras have shortcomings in image stitching, particularly in terms of shooting quality and performance, especially in terms of field of view overlap and coverage.
A load assembly is used, on which first and second image sensors are mounted. Driven by a rotating axis drive assembly, images with different fields of view are acquired respectively, and panoramic images or high-quality target field of view images are generated under different postures.
It improves the shooting effect and performance of panoramic cameras, ensuring the stability and coverage of image quality in both panoramic and non-panoramic modes, and meeting different shooting needs.
Smart Images

Figure CN224233762U_ABST
Abstract
Description
[0001] This application claims priority to patent application filed on May 29, 2024, with application number PCT / CN2024 / 096165, entitled "Mobile Platform Control Method, Apparatus, Mobile Platform and Computer-Readable Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of aerial photography technology, and more particularly to a mobile platform. Background Technology
[0003] Currently, panoramic cameras can use two fisheye lenses to stitch together images to create a panoramic image, but there is still some room for improvement in panoramic cameras. Utility Model Content
[0004] Based on this, this application provides a shooting device to improve the shooting effect or performance of a panoramic camera.
[0005] In a first aspect, this application provides a shooting device, including:
[0006] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0007] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0008] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. The field of view of the first image sensor includes a first central field of view and a first edge field of view. When the load is in the first posture, the first edge field of view at least covers the target field of view. When the load is in the first posture, the shooting device is in panoramic shooting mode.
[0009] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture is different from the second posture, the first central field of view range at least covers the target field of view range when the load is in the second posture, and the shooting device is in a non-panoramic shooting mode when the load is in the second posture.
[0010] Secondly, this application also provides a shooting device, including:
[0011] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0012] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0013] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image, wherein when the load is in the first posture, the shooting device is in panoramic shooting mode;
[0014] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture and the second posture are different, and the image quality of the target field of view acquired by the first image sensor when the load is in the second posture is higher than the image quality of the target field of view acquired by the first image sensor when the load is in the first posture. When the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0015] Thirdly, this application also provides a shooting device, including:
[0016] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0017] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0018] When the load is driven by the rotating axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. The first image sensor includes a center pixel region and an edge pixel region. When the load is in the first posture, the shooting device is in a panoramic shooting mode.
[0019] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture and the second posture are different, and when the load is in the second posture, the first image sensor uses the center pixel region to acquire the image in the target direction, and when the load is in the first posture, the first image sensor uses the edge pixel region to acquire the image in the target direction. When the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0020] Fourthly, this application also provides a shooting device, including:
[0021] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0022] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0023] When the load is driven by the rotary axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0024] When the load is driven by the rotary axis drive assembly to a second posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images, wherein the first posture and the second posture are different.
[0025] Fifthly, this application also provides a shooting device, including:
[0026] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0027] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0028] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image, wherein the panoramic image does not include the shooting device itself, and the shooting device is in panoramic shooting mode when the load is in the first posture;
[0029] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image of the movement direction of the shooting device, wherein the first posture and the second posture are different, and when the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0030] Sixthly, this application also provides a shooting device, including:
[0031] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0032] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0033] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image, wherein the panoramic image does not include the shooting device itself, and the shooting device is in panoramic shooting mode when the load is in the first posture;
[0034] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image of the direction of interest of the shooting device, wherein the first posture and the second posture are different, and when the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0035] Seventhly, this application also provides a shooting device, including:
[0036] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0037] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0038] When the load is driven by the rotary axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0039] When the rotating shaft drive assembly drives the load out of the first posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images.
[0040] Eighthly, this application also provides a shooting device, including:
[0041] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0042] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0043] When the load is driven to a first posture by the rotating shaft drive assembly, the shooting device enters a panoramic shooting mode. In the panoramic shooting mode, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0044] When the rotating axis drive assembly drives the load out of the first posture, the shooting device exits the panoramic shooting mode. When the shooting device is controlled to exit the panoramic shooting mode, the first image sensor is used to acquire a third image and the second image sensor stops acquiring images.
[0045] Ninthly, this application also provides a shooting device, including:
[0046] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0047] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0048] When the shooting device enters the panoramic shooting mode, the rotating axis drive assembly is used to drive the load to a first posture. In the panoramic shooting mode, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0049] When the shooting device exits the panoramic shooting mode, the rotation axis drive assembly is used to drive the load out of the first posture, and when the shooting device exits the panoramic shooting mode, the first image sensor is used to acquire a third image and control the second image sensor to stop acquiring images.
[0050] Tenthly, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0051] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0052] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. The field of view of the first image sensor includes a first central field of view and a first edge field of view. When the load is in the first posture, the first edge field of view at least covers the target field of view. When the load is in the first posture, the shooting device is in panoramic shooting mode.
[0053] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture is different from the second posture, the first central field of view range at least covers the target field of view range when the load is in the second posture, and the shooting device is in a non-panoramic shooting mode when the load is in the second posture.
[0054] Eleventhly, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0055] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0056] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image, wherein when the load is in the first posture, the shooting device is in panoramic shooting mode;
[0057] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture and the second posture are different, and the image quality of the target field of view acquired by the first image sensor when the load is in the second posture is higher than the image quality of the target field of view acquired by the first image sensor when the load is in the first posture. When the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0058] In a twelfth aspect, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0059] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0060] When the load is driven by the rotating axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. The first image sensor includes a center pixel region and an edge pixel region. When the load is in the first posture, the shooting device is in a panoramic shooting mode.
[0061] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture and the second posture are different, and when the load is in the second posture, the first image sensor uses the center pixel region to acquire the image in the target direction, and when the load is in the first posture, the first image sensor uses the edge pixel region to acquire the image in the target direction. When the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0062] In a thirteenth aspect, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0063] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0064] When the load is driven by the rotary axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0065] When the load is driven by the rotary axis drive assembly to a second posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images, wherein the first posture and the second posture are different.
[0066] In a fourteenth aspect, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0067] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0068] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire the first image, the second image sensor is used to acquire the second image, and the first image and the second image are used to generate a panoramic image, wherein the panoramic image does not include the shooting device itself, and the shooting device is in panoramic shooting mode when the load is in the first posture;
[0069] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image of the movement direction of the shooting device, wherein the first posture and the second posture are different, and when the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0070] In a fifteenth aspect, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0071] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0072] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image, wherein the panoramic image does not include the shooting device itself, and the shooting device is in panoramic shooting mode when the load is in the first posture;
[0073] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image of the direction of interest of the shooting device, wherein the first posture and the second posture are different, and when the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0074] In a sixteenth aspect, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0075] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0076] When the load is driven by the rotary axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0077] When the rotating shaft drive assembly drives the load out of the first posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images.
[0078] In a seventeenth aspect, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0079] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0080] When the load is driven to a first posture by the rotating shaft drive assembly, the shooting device enters a panoramic shooting mode. In the panoramic shooting mode, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0081] When the rotating axis drive assembly drives the load out of the first posture, the shooting device exits the panoramic shooting mode. When the shooting device exits the panoramic shooting mode, the first image sensor is used to acquire a third image and the second image sensor stops acquiring images.
[0082] In an eighteenth aspect, this application also provides a shooting device capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor for sensing information of a first field of view, the second image sensor for sensing information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view; the shooting device includes:
[0083] A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft;
[0084] When the shooting device enters the panoramic shooting mode, the rotating axis drive assembly is used to drive the load to a first posture. In the panoramic shooting mode, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0085] When the shooting device exits the panoramic shooting mode, the rotation axis drive assembly is used to drive the load out of the first posture. When the shooting device exits the panoramic shooting mode, the first image sensor is used to acquire a third image and the second image sensor stops acquiring images.
[0086] In a nineteenth aspect, this application also provides an imaging device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The imaging device includes:
[0087] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. The field of view of the first image sensor includes a first central field of view and a first edge field of view. When the load is in the first posture, the first edge field of view at least covers the target field of view. When the load is in the first posture, the shooting device is in panoramic shooting mode.
[0088] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture is different from the second posture, the first central field of view range at least covers the target field of view range when the load is in the second posture, and the shooting device is in a non-panoramic shooting mode when the load is in the second posture.
[0089] In a twentieth aspect, this application also provides a shooting device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The shooting device includes:
[0090] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image, wherein when the load is in the first posture, the shooting device is in panoramic shooting mode;
[0091] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image, wherein the first posture and the second posture are different, and the image quality of the target field of view acquired by the first image sensor when the load is in the second posture is higher than the image quality of the target field of view acquired by the first image sensor when the load is in the first posture. When the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0092] In a twentieth aspect, this application also provides a shooting device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The shooting device includes:
[0093] When the load is driven by the rotating axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. The first image sensor includes a center pixel region and an edge pixel region. When the load is in the first posture, the shooting device is in a panoramic shooting mode.
[0094] When the load is driven by the rotating axis drive assembly to a second posture, the shooting device enters a panoramic shooting mode. In the panoramic shooting mode, the first image sensor is used to acquire a third image. The first posture and the second posture are different. When the load is in the second posture, the first image sensor uses the center pixel area to acquire the image in the target direction. When the load is in the first posture, the first image sensor uses the edge pixel area to acquire the image in the target direction. When the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0095] In a twentieth aspect, this application also provides an imaging device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The imaging device includes:
[0096] When the load is driven by the rotary axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0097] When the load is driven by the rotary axis drive assembly to a second posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images, wherein the first posture and the second posture are different.
[0098] In a twentieth aspect, this application also provides an imaging device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The imaging device includes:
[0099] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire the first image, the second image sensor is used to acquire the second image, and the first image and the second image are used to generate a panoramic image, wherein the panoramic image does not include the shooting device itself, and the shooting device is in panoramic shooting mode when the load is in the first posture;
[0100] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image of the movement direction of the shooting device, wherein the first posture and the second posture are different, and when the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0101] In a twentieth aspect, this application also provides an imaging device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The imaging device includes:
[0102] When the load is driven by the rotating shaft drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image, wherein the panoramic image does not include the shooting device itself, and the shooting device is in panoramic shooting mode when the load is in the first posture;
[0103] When the load is driven by the rotating axis drive assembly to a second posture, the first image sensor is used to acquire a third image of the direction of interest of the shooting device, wherein the first posture and the second posture are different, and when the load is in the second posture, the shooting device is in a non-panoramic shooting mode.
[0104] In a twentieth aspect, this application also provides an imaging device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The imaging device includes:
[0105] When the load is driven by the rotary axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0106] When the rotating shaft drive assembly drives the load out of the first posture, the first image sensor is used to acquire a third image, and the second image sensor is controlled to stop acquiring images.
[0107] In a twentieth aspect, this application also provides an imaging device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The imaging device includes:
[0108] When the load is driven to a first posture by the rotating shaft drive assembly, the shooting device enters a panoramic shooting mode. In the panoramic shooting mode, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0109] When the rotating axis drive assembly drives the load out of the first posture, the shooting device exits the panoramic shooting mode. When the shooting device exits the panoramic shooting mode, the first image sensor is used to acquire a third image and the second image sensor stops acquiring images.
[0110] In a twentieth aspect, this application also provides an imaging device capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The imaging device includes:
[0111] When the shooting device enters the panoramic shooting mode, the rotating axis drive assembly is used to drive the load to a first posture. In the panoramic shooting mode, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image.
[0112] When the shooting device exits the panoramic shooting mode, the rotation axis drive assembly is used to drive the load out of the first posture. When the shooting device exits the panoramic shooting mode, the first image sensor is used to acquire a third image and the second image sensor stops acquiring images.
[0113] In its twentieth aspect, this application also provides a photographing device, comprising:
[0114] body;
[0115] The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0116] A single-axis drive assembly, the single-axis drive assembly including a pitch axis drive assembly, one end of the pitch axis drive assembly being connected to the load for driving the load to rotate about the pitch axis;
[0117] When the load is driven to a first attitude by the pitch axis drive assembly, the first image sensor is used to acquire a first image above the shooting device, and the second image sensor is used to acquire a second image below the shooting device. The first image and the second image are used to generate a panoramic image, wherein the shooting device itself is not in the panoramic image.
[0118] In its twentieth aspect, this application also provides a photographing device, comprising:
[0119] The fuselage is capable of mounting a load, the load including at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view.
[0120] A single-axis drive assembly, the single-axis drive assembly including a pitch axis drive assembly, one end of the pitch axis drive assembly being connected to the load for driving the load to rotate about the pitch axis;
[0121] When the load is driven to a first attitude by the pitch axis drive assembly, the first image sensor is used to acquire a first image above the shooting device, and the second image sensor is used to acquire a second image below the shooting device. The first image and the second image are used to generate a panoramic image, wherein the shooting device itself is not in the panoramic image.
[0122] In a thirtieth aspect, this application also provides a photographing device, including:
[0123] The device includes a fuselage capable of mounting a load and a single-axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers a panoramic field of view. The single-axis drive assembly includes a pitch axis drive assembly, one end of which is connected to the load and used to drive the load to rotate about a pitch axis.
[0124] When the load is driven to a first attitude by the pitch axis drive assembly, the first image sensor is used to acquire a first image above the shooting device, and the second image sensor is used to acquire a second image below the shooting device. The first image and the second image are used to generate a panoramic image, wherein the shooting device itself is not in the panoramic image.
[0125] The shooting device disclosed in this application drives a load including at least two image sensors to different postures via a rotating shaft drive assembly, thereby enabling the shooting device to switch between panoramic shooting mode and non-panoramic shooting mode. In panoramic shooting mode, two image sensors can be used to acquire images and generate panoramic images; while in non-panoramic shooting mode, one of the image sensors on the load is used to acquire images, thus improving the shooting effect or performance of the panoramic camera.
[0126] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description
[0127] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0128] Figure 1 This is a schematic diagram for image quality analysis of panoramic cameras;
[0129] Figure 2 This is a schematic diagram for image quality analysis of panoramic cameras on aircraft.
[0130] Figure 3 This is a schematic block diagram of the structure of the shooting device provided in the embodiments of this application;
[0131] Figure 4This is a schematic diagram of a panoramic camera installed on an aircraft, as provided in an embodiment of this application.
[0132] Figure 5 This is a top-view schematic diagram of a panoramic camera installed on an aircraft, as provided in an embodiment of this application.
[0133] Figure 6 This is a side view schematic diagram of a panoramic camera installed on an aircraft, as provided in an embodiment of this application.
[0134] Figure 7 This is a front-view schematic diagram of a panoramic camera installed on an aircraft, as provided in an embodiment of this application.
[0135] Figure 8 This is a schematic diagram showing the optical axis of the panoramic camera provided in this application facing upwards / downwards;
[0136] Figure 9 This is a schematic diagram showing the optical axis of the panoramic camera provided in the embodiments of this application facing forward / backward;
[0137] Figure 10 This is a schematic diagram showing the optical axis of the panoramic camera provided in the embodiments of this application pointing in an oblique direction;
[0138] Figure 11 This is another schematic diagram showing the optical axis of the panoramic camera provided in this application pointing obliquely;
[0139] Figure 12 This is a schematic diagram showing that the pitch axis gimbal provided in this application embodiment is set in the center of the panoramic camera;
[0140] Figure 13 This is a schematic diagram showing the tilt axis gimbal offset relative to the center of the panoramic camera provided in this embodiment of the application;
[0141] Figure 14 This is a schematic diagram of the panoramic camera in a first posture according to an embodiment of this application;
[0142] Figure 15 This is a schematic diagram of the field of view of the panoramic camera provided in the embodiments of this application;
[0143] Figure 16 This is another schematic diagram illustrating the field of view of the panoramic camera provided in the embodiments of this application;
[0144] Figure 17 This is a schematic diagram of the panoramic camera in a second posture according to an embodiment of this application;
[0145] Figure 18 This is a schematic diagram of the mode setting interface provided in an embodiment of this application;
[0146] Figure 19This is a schematic diagram of panoramic camera image quality analysis in aerial photography mode provided in an embodiment of this application;
[0147] Figure 20 This is a schematic diagram of panoramic camera image quality analysis in FPV mode provided in an embodiment of this application;
[0148] Figure 21 This is a schematic diagram illustrating panoramic camera image quality analysis under another aerial photography mode provided in this application embodiment;
[0149] Figure 22 This is a schematic diagram of an aircraft landing on the ground, provided in an embodiment of this application;
[0150] Figure 23 This is another schematic block diagram of the shooting device provided in the embodiments of this application;
[0151] Figure 24 This is a top view schematic diagram of an aircraft equipped with a visual sensor provided in an embodiment of this application;
[0152] Figure 25 This is a front-view schematic diagram of an aircraft equipped with a visual sensor provided in an embodiment of this application;
[0153] Figure 26 This is a side view schematic diagram of an aircraft equipped with a visual sensor provided in an embodiment of this application;
[0154] Figure 27 This is another schematic block diagram of the shooting device provided in the embodiments of this application. Detailed Implementation
[0155] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0156] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.
[0157] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.
[0158] It should also be understood that the term "and / or" as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.
[0159] A panoramic camera is a camera capable of capturing a 360-degree panoramic view. It typically consists of a pair of fisheye lenses placed back-to-back or multiple wide-angle lenses arranged in a circle, capable of simultaneously capturing the surrounding environment. These images are then stitched together using special software to create a panoramic image or video.
[0160] See Figure 1 This is a schematic diagram illustrating image quality analysis for a panoramic camera, provided in an embodiment of this application. For example... Figure 1 As shown, a panoramic camera consists of two fisheye lenses stacked vertically (or horizontally, or symmetrically, in other directions). Each fisheye lens has a field of view (FOV) greater than 180 degrees. Each fisheye lens captures images within its corresponding FOV range. The two images from the two fisheye lenses can be stitched together to create a 360-degree panoramic image. Due to the inherent optical characteristics of fisheye lenses, generally, the image quality is better at the center of the field of view and worse at the edges. For example... Figure 1 As shown, the image quality of a panoramic camera is better at the top and bottom (corresponding to the center of the image from the top and bottom fisheye lenses). If the main focus is on the horizontal direction, the image is captured using the pixel area of the fisheye lens that is biased towards the edge, which will result in poor image quality.
[0161] In related technologies, a panoramic camera is mounted on an aircraft and fixedly connected to the aircraft fuselage via a specific mechanical structure. The panoramic camera can generate a complete 360-degree spherical panoramic image. For example, ... Figure 2 The diagram shows a panoramic camera setup on an aircraft. Two fisheye lenses are positioned at the top and bottom of the fuselage, their positions relative to the fuselage fixed and cannot be rotated or moved. Therefore, the image quality of this panoramic aircraft is best directly above and below (corresponding to the center of the images from the top and bottom fisheye lenses), while the image quality is poorer in the four directions (forward, backward, left, and right) where the aircraft is flying (corresponding to the edges of the images from the top and bottom fisheye lenses). This panoramic camera distribution can meet the needs of panoramic shooting, but since users are more concerned with the forward / downward / upward viewpoints, aerial photography uses the edges of the fisheye lenses with lower image quality to capture images from the user's primary focus. This results in poor image quality from the user's primary focus, leading to a poor user experience.
[0162] In light of the aforementioned issue of poor image quality and visual appeal at the edge seams of the lens in panoramic cameras, this application proposes a solution for a panoramic camera with an adjustable rotation angle. The orientation of the panoramic camera can be flexibly adjusted via a rotation axis drive component, allowing the movable platform to use the pixel areas with better image quality in the panoramic camera to capture the target object / target orientation / main focus angle, thereby achieving better image quality at the main focus angle.
[0163] The main focus perspective can be the direction of movement of the mobile platform (e.g., the flight direction of the aircraft), the direction of the target object or the target direction selected by the user, or the main focus perspective of the mobile platform in different modes (e.g., the focus perspective in FPV mode is mainly the forward flight direction of the aircraft, while the focus perspective in aerial photography mode is mainly the forward flight direction or the forward downward view direction).
[0164] Based on this, embodiments of this application provide a shooting device for improving the image quality of captured images. Some embodiments of this application will be described in detail below with reference to the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.
[0165] The shooting equipment involved in this application includes, but is not limited to, mobile platforms and panoramic cameras. Mobile platforms include, but are not limited to, aircraft, mobile robots, mobile vehicles, boats, and handheld products (such as handheld gimbals, selfie sticks, cameras, and mobile phones). Aircraft can be, for example, drones or manned aircraft, and can include aerial and underwater aircraft. Application scenarios for aircraft include, but are not limited to, general aerial photography, flight experience, industry inspection / operations, agricultural operations, logistics transportation, and aerial performances. Aircraft can be fixed-wing aircraft or multi-rotor aircraft, and multi-rotor aircraft can include birotor, quadcopter, and hexacopter aircraft. Cameras can include various devices with shooting functions, such as mobile phones, iPads, computers, watches, action cameras, and SLR cameras. The following embodiments use aircraft as an example for illustration.
[0166] The following embodiments use an aircraft as an example of a mobile platform. In other implementations, the aircraft mentioned in this application can be replaced with other types of mobile platforms to implement the embodiments mentioned in this application.
[0167] This application combines a panoramic camera with an aircraft through a specific configuration design to better meet the needs of various scenarios such as panoramic shooting, conventional aerial photography, FPV aerial photography, landing, or storage.
[0168] Please see Figure 3 , Figure 3This is a schematic block diagram illustrating the structure of a shooting device provided in an embodiment of this application. Figure 3 As shown, the imaging device 1000 includes a load 100, a rotation axis drive assembly 200, one or more memories 300, and one or more processors 400. In other possible implementations, the imaging device 1000 includes the rotation axis drive assembly 200, one or more memories 300, and one or more processors 400, and the imaging device 1000 is capable of mounting the load 100; for example, the imaging device 1000 is detachably connected to the load 100. Alternatively, the imaging device 1000 includes one or more memories 300, one or more processors 400, and the imaging device 1000 is capable of mounting the load 100 and the rotation axis drive assembly 200; for example, the imaging device 1000 is detachably connected to both the load 100 and the rotation axis drive assembly 200. This application does not limit the structure of the imaging device 1000.
[0169] The load 100 includes at least a first image sensor 101 and a second image sensor 102. The first image sensor 101 is used to sense information about a first field of view, and the second image sensor 102 is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers the panoramic field of view. It should be noted that this embodiment describes the load 100 as including the first image sensor 101 and the second image sensor 102 as an example. In other possible implementations, the load 100 may include other numbers of image sensors, as long as the set of field of view of each of the image sensors at least covers the panoramic field of view.
[0170] For example, the optical axes of the first image sensor 101 and the second image sensor 102 are parallel to each other, and the main sensing directions of the first image sensor 101 and the second image sensor 102 are opposite. For instance, both the optical axes of the first image sensor 101 and the second image sensor 102 are vertical, with the main sensing direction of the first image sensor 101 being vertically upward and the main sensing direction of the second image sensor 102 being vertically downward. Alternatively, the optical axes of the first image sensor 101 and the second image sensor 102 are collinear, and the main sensing directions of the first image sensor 101 and the second image sensor 102 are opposite, meaning the first image sensor 101 and the second image sensor 102 are arranged back-to-back. The opposite main sensing directions of the first image sensor 101 and the second image sensor 102 ensure that the combined field of view of each of the first image sensor 101 and the second image sensor 102 can cover a panoramic field of view.
[0171] For example, the field of view of the first image sensor 101 is greater than or equal to 180 degrees, the field of view of the second image sensor 102 is greater than or equal to 180 degrees, and the panoramic image includes a 360-degree panorama. Alternatively, the field of view of the first image sensor 101 and the second image sensor 102 may reach 190 degrees, the main sensing direction of the first image sensor 101 and the main sensing direction of the second image sensor 102 may be opposite, and the combined field of view of the first image sensor 101 and the second image sensor 102 may cover a 360-degree panoramic field of view. The panoramic image generated based on the first image sensor 101 and the second image sensor 102 includes a 360-degree panorama.
[0172] For example, both the first image sensor 101 and the second image sensor 102 are fisheye lenses. This application describes an embodiment using fisheye lenses as an example; however, in other possible implementations, the first image sensor 101 and the second image sensor 102 can also be other types of cameras, which are not limited in this application.
[0173] For example, the rotary axis drive assembly 200 includes a pitch axis drive assembly, such as a pitch axis gimbal. In other possible implementations, the rotary axis drive assembly 200 may also be other rotary axis gimbals, such as roll axis gimbals, which are not limited in this application.
[0174] The rotation angle of the load 100 driven by the rotary shaft drive assembly 200 can be within any range or a preset range. Here, "any range" means that the load 100 can rotate without restriction around the rotation shaft. The preset range can be achieved by setting a limit angle for the rotary shaft drive assembly 200. This limit angle can be a mechanical limit angle or an electronic limit angle for the drive motor of the rotary shaft drive assembly 200, which is not limited in this application.
[0175] For example, let's take the filming equipment 1000 as an example of an aircraft. Figures 4 to 7The diagram illustrates a panoramic camera mounted on an aircraft. In this diagram, 100 represents the panoramic camera, 200 represents the pitch axis gimbal, and 1000 represents the quadcopter. The panoramic camera 100 includes a first fisheye lens 101 and a second fisheye lens 102. These two fisheye lenses are a pair of fisheye lenses with collinear optical axes, positioned back-to-back. Each fisheye lens has a field of view greater than or equal to 180 degrees, such as 190 degrees or 220 degrees. The field of view of the first and second fisheye lenses 101 and 102 are vertically distributed and in opposite directions. The first and second fisheye lenses 101 and 102 can work together to capture a 360-degree panoramic image, ensuring that a 360-degree panoramic image is acquired simultaneously. This embodiment describes a panoramic camera with two cameras as an example. In other possible implementations, the panoramic camera can have other numbers of cameras, as long as the set of field of view of each camera can capture a 360-degree panoramic image.
[0176] For example, the pitch axis gimbal 200 is located at the nose of the aircraft 1000. In other possible implementations, the pitch axis gimbal 200 can also be located at other positions on the aircraft 1000, such as the tail or the side of the fuselage. This application does not limit this. This application describes the embodiment using a pitch axis gimbal as an example. In other possible implementations, other rotation axis gimbals, such as roll axis gimbals, can also be used. This application does not limit this.
[0177] The panoramic camera 100 can rotate around its pitch axis to change the orientation of its optical axis. For example, as... Figures 8 to 11 As shown, this illustrates different states of the panoramic camera: optical axis pointing upwards / downwards, optical axis pointing forwards / backwards, and optical axis pointing diagonally. Among these... Figure 8 This is a schematic diagram showing the optical axis of a panoramic camera pointing upwards / downwards. Figure 9 This is a diagram illustrating the forward / backward orientation of the optical axis of a panoramic camera. Figure 10 and Figure 11 This is a schematic diagram showing the optical axis of a panoramic camera pointing at an angle.
[0178] It should be noted that the pitch axis rotation angle is continuously variable and can be adjusted in increments of 100° and 200°. Figure 8 With an initial angle of 0 degrees, the camera can rotate within an arbitrary or specified range. The arbitrary range means the panoramic camera 100 can rotate without restriction around the pitch axis gimbal 200. The specified range can be an angle introduced based on the actual application, such as ±135 degrees or ±165 degrees. The specific specified angle can be designed according to the actual situation. This specified angle can be achieved by setting a limit angle on the pitch axis gimbal 200, which can be a mechanical limit angle or an electronic limit angle of the gimbal drive motor.
[0179] In one possible implementation, when the aircraft is in panoramic shooting mode or storage mode, the attitude of the panoramic camera can be controlled to switch to... Figure 8 In this state, Figure 8 In this configuration, the optical axes of the two fisheye lenses of the panoramic camera are pointing upwards / downwards respectively, or alternatively, the optical axes of the fisheye lenses are vertical. In this state, each fisheye lens can capture images of 360 degrees horizontally and 180 degrees / more than 180 degrees vertically above and below the aircraft, which are then stitched together to create a 360-degree horizontal and 360-degree vertical panoramic image. Alternatively, in the storage mode, the two fisheye lenses protruding from the fuselage can be switched to a vertical orientation for better storage. The aircraft is in... Figure 8 In the state shown, the panoramic camera's field of view is as follows: Figures 15-16 As shown, since the field of view of a single fisheye camera can exceed 180°, for example reaching 190°, and two fisheye cameras are placed back-to-back with their optical axes aligned, and the aircraft's fuselage is located between the two fisheye cameras, i.e., within the blind spot of either fisheye camera, the aircraft can achieve "stealth" in the generated panoramic image, meaning the fuselage will not appear in the panoramic image.
[0180] In one possible implementation, when the aircraft is in normal aerial photography, FPV aerial photography, or landing mode, the pitch axis gimbal can be rotated to change the attitude of the panoramic camera, switching the panoramic camera's attitude to... Figure 9 In the state shown, Figure 9 In a panoramic camera, the optical axes of the two fisheye lenses point forward and backward respectively, or they can be described as having a horizontal optical axis. When the aircraft is in aerial photography mode or close-up tracking mode, the user's subject or main point of interest is generally in front of the aircraft. Figure 9 When shooting in the indicated state, you can use the area with better imaging effect of the fisheye lens to capture images in the horizontal / forward direction. The image quality in the front and rear directions of the aircraft is good, thus improving the image quality of the main focus perspective. Alternatively, in landing mode, switch the fisheye lens to an off-ground direction to avoid the fisheye lens being hit by the landing surface when the aircraft lands.
[0181] In one possible implementation, when the aircraft is performing normal aerial photography or FPV aerial photography mode, the pitch axis gimbal can be rotated to change the attitude of the panoramic camera, switching the panoramic camera's attitude to... Figure 10 In the state shown, Figure 10 In this panoramic camera, the optical axes of the two fisheye lenses are angled, or it can be described as the optical axes of the fisheye lenses having an angle with both the horizontal and vertical directions. In this configuration, images of the front / above of the aircraft can be captured from an upward angle. For example... Figure 20The diagram shown is a schematic representation of panoramic camera image quality analysis in FPV mode according to an embodiment of this application. Typically, compared to ordinary aerial photography mode, FPV mode is mostly controlled manually. It breaks away from fixed camera movement modes, offering a more free-flowing viewpoint and prioritizing a first-person perspective experience. The operator can manually switch the display viewpoint. Furthermore, in FPV mode, the aircraft's attitude angle changes more significantly; for example, FPV mode can perform various high-difficulty maneuvers such as dives and rolls, resulting in more impactful visuals. Figure 20 As shown, the aircraft's fuselage is tilted forward at approximately 45°, indicating a high-angle, high-speed flight state—a common flight attitude for FPV aircraft. This is suitable for FPV aerial photography. The user's subject is typically positioned in the direction of the aircraft's flight, specifically in the upward-forward direction of the fuselage. Figure 10 When shooting in the indicated state, the pixel area with better imaging effect of the fisheye lens can be used to capture the image of the front and upper direction of the fuselage, so as to shoot the image of the main focus of the aircraft from an upward angle, thereby improving the image quality of the main focus of the viewpoint.
[0182] In one possible implementation, when the aircraft is performing normal aerial photography or FPV aerial photography mode, the pitch axis gimbal can be rotated to change the attitude of the panoramic camera, switching the panoramic camera's attitude to... Figure 11 In this state, Figure 11 In this panoramic camera, the optical axes of the two fisheye lenses are angled, or it can be described as the optical axes of the fisheye lenses having an angle with both the horizontal and vertical directions. In this configuration, images can be captured from above / below the aircraft, utilizing the area with better fisheye lens imaging to improve image quality at the main point of interest. For example... Figure 21 The diagram shown is a schematic of panoramic camera image quality analysis in aerial photography mode according to an embodiment of this application. When shooting in aerial photography mode, due to the high altitude of the aircraft, the user's subject is generally located below and in front of the aircraft. Figure 11 By shooting in the posture shown, the pixel area with better imaging effect of the fisheye lens can be used to capture the image of the fuselage at an angle downwards, so as to pitch the image of the aircraft's main focus and improve the image quality in the angle downwards direction of the fuselage.
[0183] Optional, in Figures 9-11In this mode, the rear fisheye view is obstructed by the drone's fuselage. The rear fisheye lens can be turned off, ceasing image acquisition. This exits the panoramic shooting mode, allowing the panoramic camera's processing power to be concentrated on the front fisheye image, further improving image quality. Furthermore, editing video footage from panoramic drones is complex, requiring the extraction of the desired square frame from the spherical panoramic view. When shooting conventional or FPV aerial photography, if the panoramic drone simultaneously records the entire view from both fisheye cameras, it generates a large amount of redundant image information, increasing the difficulty of post-processing and editing. Therefore, after exiting panoramic shooting mode, the panoramic camera uses only one fisheye lens to acquire images, resulting in footage similar to conventional aerial photography, facilitating post-editing and saving on the amount of footage captured.
[0184] In summary, the aircraft can flexibly adjust the orientation of the panoramic camera through rotation axis drive components such as the pitch axis gimbal, so that the aircraft can use the pixel area with better image quality to capture information about the target object or the target orientation, thereby improving the image quality of the main focus view.
[0185] In addition, by setting up a rotating shaft drive assembly, the problem of preventing the fisheye lens from hitting the ground during the landing phase of the aircraft can also be solved.
[0186] For example, the rotation axis of the rotary shaft drive assembly 200 passes through the center of the load 100. By passing through the center of the load 100, the motor torque required for the rotary shaft drive assembly 200 to drive the load 100 to rotate a certain angle is minimized, thus minimizing the rotary shaft control torque when the load 100 rotates. For example, as... Figures 6-11 As shown, the pitch axis gimbal 200 is positioned at the center of the panoramic camera 100, which minimizes the pitch control torque during panoramic camera rotation. Alternatively, the rotation axis drive assembly 200 can be offset from the center of the load 100. For example, as... Figures 12-13 As shown, the pitch axis gimbal 200 is offset relative to the center of the panoramic camera 100. The specific settings can be flexibly adjusted according to actual conditions, and this application does not impose any limitations on this.
[0187] For example, the rotation axis drive assembly 200 is disposed at the head of the shooting device 1000. In other possible implementations, the rotation axis drive assembly 200 may also be disposed at the tail or side of the shooting device 1000, and this application does not limit this to any particular implementation.
[0188] The rotation axis drive assembly 200 drives the load 100 to rotate around the rotation axis, allowing the load 100 to be in different postures, including a first posture, a second posture, etc. For different postures, the orientations of the optical axes of the first image sensor 101 and the second image sensor 102 are different. For the same posture, the orientations of the optical axes of the first image sensor 101 and the second image sensor 102 are not unique. It should be noted that in this embodiment, the first image sensor 101 and the second image sensor 102 are arranged vertically on the body of the imaging device 1000 to form the load 100 layout. In other possible implementations, the first image sensor 101 and the second image sensor 102 can also be arranged horizontally on the imaging device 1000, such as at the front and back or left and right sides of the body to form the load 100 layout.
[0189] The following describes the orientation of the optical axis of the first image sensor 101 and the second image sensor 102 under different postures, with the first image sensor 101 and the second image sensor 102 arranged in the vertical direction of the camera body of the shooting device 1000.
[0190] In some implementations, when the load 100 is in a first orientation, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 are approximately vertical. For example, as... Figure 8 As shown, when the panoramic camera is in its first pose, the optical axes of the two fisheye lenses are parallel to the vertical direction.
[0191] In some implementations, when the load 100 is in a first posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 form a first angle with the vertical direction. This first angle is less than or equal to a first preset angle threshold. For example, if the first preset angle threshold is set to 5 degrees, then when the load 100 is in the first posture, the first angle between the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 and the vertical direction is within 5 degrees. The first preset angle threshold can be flexibly set according to actual conditions and is not limited in this application.
[0192] In some implementations, when the load 100 is in a first posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 are parallel to the vertical direction of the camera body of the imaging device 1000. For example, as Figure 8 or Figure 14 As shown, when the panoramic camera is in its first orientation, the optical axes of the two fisheye lenses are parallel to the vertical direction of the aircraft's fuselage.
[0193] In some implementations, when the load 100 is in a first posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 form a second angle with the vertical direction of the camera body of the imaging device 1000. This second angle is less than or equal to a second preset angle threshold. For example, if the second preset angle threshold is set to 5 degrees, then when the load 100 is in the first posture, the second angle between the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 and the vertical direction of the camera body of the imaging device 1000 is within 5 degrees. The second preset angle threshold can be flexibly set according to actual conditions and is not limited in this application.
[0194] It is understandable that as the load 100 rotates around the rotation axis at different angles, the first image sensor 101 and the second image sensor 102 can be used to acquire images from the imaging device 1000 in different directions, including the following scenarios:
[0195] In one implementation, when the load 100 is in a first posture, the first image sensor 101 is used to acquire an image above the shooting device 1000 and the second image sensor 102 is used to acquire an image below the shooting device 1000; or, the first image sensor 101 is used to acquire an image below the shooting device 1000 and the second image sensor 102 is used to acquire an image above the shooting device 1000. For example, as... Figure 8 As shown, when the panoramic camera is in the first orientation, the upper fisheye lens captures the image above the aircraft, and the lower fisheye lens captures the image below the aircraft. For example, the first image sensor 101 has a vertical field of view greater than or equal to 180 degrees and a horizontal field of view greater than or equal to 360 degrees, and the second image sensor 102 has a vertical field of view greater than or equal to 180 degrees and a horizontal field of view greater than or equal to 360 degrees. The panoramic image includes a horizontal 360-degree panorama and a vertical 360-degree panorama. For example, as... Figure 15 and Figure 16 As shown, the first image sensor 101 protrudes above the aircraft's fuselage, and the second image sensor 102 protrudes below the fuselage. The vertical field of view of a single fisheye lens in the panoramic camera can exceed 180 degrees, for example, reaching 190 degrees. The two fisheye lenses of the panoramic camera are placed back-to-back with their optical axes collinear, and the aircraft's fuselage is located between the two fisheye lenses, i.e., in the blind spot of either fisheye lens. Therefore, in the generated panoramic image, the aircraft can achieve "stealth," meaning the fuselage will not appear in the panoramic image.
[0196] In another implementation, the first image sensor 101 is used to acquire images to the left of the imaging device 1000 and the second image sensor 102 is used to acquire images to the right of the imaging device 1000; or, the first image sensor 101 is used to acquire images to the right of the imaging device 1000 and the second image sensor 102 is used to acquire images to the left of the imaging device 1000; or, the first image sensor 101 is used to acquire images in front of the imaging device 1000 and the second image sensor 102 is used to acquire images behind the imaging device 1000; or, the first image sensor 101 is used to acquire images behind the imaging device 1000 and the second image sensor 102 is used to acquire images in front of the imaging device 1000. For example, the first image sensor 101 protrudes from the front of the aircraft fuselage, and the second image sensor 102 protrudes from the rear of the aircraft. The optical axis of the first image sensor 101 faces forward, and the optical axis of the second image sensor 102 faces backward. Both the first image sensor 101 and the second image sensor 102 are fisheye lenses, and the two fisheye lenses acquire images from the front and rear of the aircraft, respectively. For example, the first image sensor 101 has a horizontal field of view greater than or equal to 180 degrees and a vertical field of view greater than or equal to 360 degrees, and the second image sensor 102 has a horizontal field of view greater than or equal to 180 degrees and a vertical field of view greater than or equal to 360 degrees. The panoramic image includes a horizontal 360-degree panorama and a vertical 360-degree panorama. For example, the horizontal field of view of the two fisheye lenses can exceed 180 degrees, for example, reaching 190 degrees, and the vertical field of view can reach 360 degrees, so that the generated panoramic image includes a horizontal 360-degree panorama and a vertical 360-degree panorama.
[0197] In some implementations, when the load 100 is in the second posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 are approximately horizontal. For example, as Figure 9 As shown, when the panoramic camera is in the second pose, the optical axes of the two fisheye lenses are parallel to the horizontal direction.
[0198] In some implementations, when the load 100 is in the second posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 form a third angle with the horizontal direction. This third angle is less than or equal to a third preset angle threshold, which can be flexibly set according to actual conditions and is not limited in this application. For example, as... Figure 10 and Figure 11 As shown, when the panoramic camera is in the second pose, the third angle between the optical axes of the two fisheye lenses and the horizontal direction is 45 degrees.
[0199] In some implementations, when the load 100 is in the second posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 are parallel to the horizontal direction of the camera body of the imaging device 1000. For example, as Figure 9 or Figure 17 As shown, when the panoramic camera is in its second attitude, the optical axes of the two fisheye lenses are parallel to the horizontal direction of the aircraft's fuselage.
[0200] In some implementations, when the load 100 is in the second posture, the optical axes of the first image sensor 101 and the second image sensor 102 are parallel to the direction of movement of the imaging device 1000. For example, when the panoramic camera is in the second posture, the optical axes of the two fisheye lenses are parallel to the flight direction of the aircraft to acquire information about the flight direction of the aircraft.
[0201] In some implementations, when the load 100 is in the second posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 are parallel to the direction of interest of the imaging device 1000. The direction of interest can be the direction of the target object selected by the user, or the target direction, to acquire information about the direction of interest.
[0202] In some implementations, when the load 100 is in the second posture, the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 form a fourth angle with the horizontal direction of the camera body of the imaging device 1000. For example, this fourth angle is greater than zero and less than 90 degrees. That is, when the load 100 is in the second posture, the fourth angle between the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 and the horizontal direction of the camera body of the imaging device 1000 is within 90 degrees.
[0203] It is understandable that in the layout of the first image sensor 101 and the second image sensor 102 set in front of or behind the camera body of the shooting device 1000, or on the left and right sides of the camera body, the orientation of the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 corresponding to the first and second postures of the load 100 will change accordingly.
[0204] The rotation angle of the load 100 in a given posture can be input by the user or automatically determined by the shooting device 1000. For example, the user inputs a lever value through the physical controls of the shooting device 1000's control device, which is mapped to a rotation angle command for the load 100. The control device can be a mobile phone, tablet, computer, or other terminal device; it can also be a remote control; it can be a portable wearable device (e.g., a head-mounted wearable device (such as glasses), a wrist-worn wearable device (such as a watch, bracelet, etc.)); or it can be a server. The wearable device includes a head-mounted display device, which can include a virtual reality (VR) display device or a first-person view (FPV) display device. The physical controls of the control device include, but are not limited to, joysticks, physical buttons, or dials; this embodiment is not limited to these. Alternatively, the user can indicate a corresponding screen area on the control device's display interface, which is mapped to a rotation angle command for the load 100. Furthermore, the shooting device 1000 automatically determines the rotation angle of the load 100 to the corresponding posture based on the direction of movement (e.g., the flight direction of an aircraft), the direction of interest, or the current mode.
[0205] The imaging device 1000 in this application includes multiple different modes. For example, the imaging device 1000 includes one or more modes selected from panoramic imaging mode, FPV mode, aerial imaging mode, landing mode, takeoff mode, or storage mode. In panoramic imaging mode, the imaging device 1000 itself is not present in the panoramic image generated. The second orientation of the load 100 differs in different modes; that is, the orientation of the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 differs in different modes.
[0206] As one embodiment of this application, the panoramic cameras of the aircraft are distributed vertically, and a rotation axis drive component (such as a pitch axis drive component) is added to enable switching between multiple modes, such as panoramic shooting mode (fisheye lens optical axis vertical, dual-lens mode), FPV mode (fisheye lens optical axis horizontal, single-lens mode, single-lens image quality is also better), landing mode (fisheye lens optical axis horizontal, camera shell close to the ground), or storage mode (fisheye lens optical axis vertical). By setting the rotation axis drive component, the aircraft can use the higher-quality pixel area of the fisheye lens to capture images at the main focus angle, thereby achieving better image quality.
[0207] As one embodiment of this application, the rotation axis drive assembly can be a pitch axis drive assembly, which can drive the fisheye lens to switch between different angles to enable the aircraft to switch between different modes. For example, as shown in... Figures 4 to 7Taking the aircraft shown as an example, the different modes of the aircraft can include one or more of the following modes: panoramic shooting mode, FPV mode, aerial photography mode, landing mode, takeoff mode, and storage mode, etc.
[0208] 1) Panoramic Shooting Mode (Dual Lens Mode, select manual or automatic mode to enter this mode): By adjusting the pitch angle, the panoramic camera is in its first position, causing the optical axis of the panoramic camera to switch to the vertical direction. The upper fisheye lens captures a panoramic view of the aircraft from above, and the lower fisheye lens captures a panoramic view of the aircraft from below. Both the upper and lower fisheye lenses protrude from the fuselage. The images captured by the two fisheye lenses are stitched together to obtain a 360-degree panoramic image. Furthermore, because the fuselage is elongated, it will be located in the blind spot of the stitching between the two fisheye lenses, and the fuselage will be invisible in the frame.
[0209] 2) Aerial mode or FPV mode (single-lens mode, manually or automatically select to enter this mode): By adjusting the pitch angle, the panoramic camera enters a second attitude, allowing the panoramic camera's optical axis to switch to the horizontal direction, the aircraft's flight direction, the aircraft's focus direction, or the user-selected viewpoint. In this mode, only one of the two fisheye lenses needs to work; the other can be deactivated, utilizing the best shooting area at the center of the fisheye lens to capture images and achieve better image quality. Compared to ordinary aerial mode, FPV mode is mostly purely manual, allowing for a departure from fixed camera movement and providing a more free-flowing viewpoint. It emphasizes a first-person perspective experience, allowing the operator to manually switch the display viewpoint. Furthermore, in FPV mode, the aircraft's attitude angle changes more significantly; for example, FPV mode can perform various high-difficulty maneuvers such as dives and rolls, resulting in more impactful footage.
[0210] 3) Landing mode and / or takeoff mode (automatically triggered during landing and / or takeoff or manually triggered by the user): By adjusting the pitch angle, the panoramic camera is in a second attitude, so that the orientation of the panoramic camera is switched to the non-takeoff / non-landing surface direction. For example, the optical axis of the panoramic camera is switched to the horizontal direction or the direction parallel to the landing / takeoff plane, so that the side of the panoramic camera without the fisheye lens is facing the landing / takeoff plane and protruding out of the aircraft. This avoids the curved surface of the fisheye lens hitting the landing / takeoff plane during landing and also serves to support the aircraft.
[0211] 4) Storage mode (automatic or manual trigger, lens optical axis vertical): For example, after detecting that the user has picked up the aircraft from the ground (e.g., by detecting the height off the ground), the panoramic camera is in the first attitude by adjusting the pitch angle, so that the optical axis of the panoramic camera switches to the vertical direction, so that the panoramic camera does not protrude from the nose of the aircraft, making it easier to store the panoramic camera.
[0212] For example, in panoramic shooting mode, two fisheye lenses need to work simultaneously to capture images and stitch them into a panoramic image. In other modes, such as FPV mode, descent mode, and storage mode, which are not panoramic shooting modes, the panoramic camera can switch to single-lens mode, that is, only one fisheye lens needs to be turned on to capture images, and the other fisheye lens can be turned off.
[0213] As an embodiment of this application, the solution of this application can optimize image quality in single-lens mode. For example, after switching from panoramic shooting mode to FPV mode, the in-camera processor can process the image data of only one lens. Compared with processing the image data of two lenses, more computing power can be used to adjust the image quality parameters. Compared with processing two channels of image data, the output image quality is better (such as 4K to 8K).
[0214] The angle of the second attitude of a panoramic camera can be different in different modes. For example, in FPV mode, the optical axis of the panoramic camera switches to the direction of the aircraft's flight (such as the downward tilt direction), while in landing mode, the optical axis of the panoramic camera switches to the horizontal direction. Although the panoramic camera is in the second attitude in both modes, the angle of the second attitude is different in the two modes.
[0215] For example, the switching between multiple modes by the shooting device 1000 can be performed automatically by the shooting device 1000 or manually triggered by the user. For instance, based on the load 100 being in a first posture, where the optical axis of the first image sensor 101 and the optical axis of the second image sensor 102 are parallel to the vertical direction, the shooting device 1000 automatically switches to panoramic shooting mode. Another example is... Figure 18 As shown, the mode settings interface displays mode options such as panoramic shooting mode, FPV mode, aerial shooting mode, landing mode, take-off mode, or storage mode. If the user selects the FPV mode option, the shooting device 1000 will be switched to FPV mode. If the user selects the panoramic shooting mode, the shooting device 1000 will be switched to panoramic shooting mode.
[0216] In one implementation, the orientation of the load 100 can be adjusted based on the current mode of the imaging device 1000. For example, if the user selects panoramic shooting mode, the imaging device 1000 switches to panoramic shooting mode, and the imaging device 1000 controls the rotation axis drive component 200 to adjust the angle of the load 100, such as the pitch angle, thereby adjusting the pitch angle of the load 100 to the vertical direction. This allows the optical axis of the first image sensor 101 to be oriented towards the upper side of the imaging device 1000 to capture images above the imaging device 1000, while the optical axis of the second image sensor 102 is oriented towards the lower side of the imaging device 1000 to capture images below the imaging device 1000. The images acquired by the first image sensor 101 and the second image sensor 102 can generate a panoramic image. If the user selects the FPV mode, the shooting device 1000 will exit the panoramic shooting mode and enter the FPV mode. The shooting device 1000 will control the rotation axis drive component 200 to adjust the angle of the load 100, such as the pitch angle, so as to adjust the pitch angle of the load 100 to the tilt direction. In this way, the optical axis of the first image sensor 101 can be oriented obliquely upward towards the shooting device 1000 to acquire the image in the oblique upward direction of the shooting device 1000. At this time, the second image sensor 102 can stop acquiring images and only acquire images through the first image sensor 101.
[0217] In another implementation, the current mode of the shooting device 1000 can be adjusted based on the posture of the load 100. For example, if the user controls the shooting device 1000 to adjust the angle of the load 100, such as the pitch angle, by controlling the rotation axis drive component 200, thereby adjusting the pitch angle of the load 100 to the vertical direction, the shooting device 1000 will enter a panoramic shooting mode. In this way, the optical axis of the first image sensor 101 can be oriented towards the upper side of the shooting device 1000 to capture images above the shooting device 1000, while the optical axis of the second image sensor 102 can be oriented towards the lower side of the shooting device 1000 to capture images below the shooting device 1000. The images captured by the first image sensor 101 and the second image sensor 102 can generate a panoramic image. If the user controls the shooting device 1000 to adjust the angle of the load 100, such as the pitch angle, by controlling the rotation axis drive component 200 through the control device, thereby adjusting the pitch angle of the load 100 to the tilt direction, the shooting device 1000 will enter FPV mode. In this way, the optical axis of the first image sensor 101 can be oriented obliquely upward towards the shooting device 1000 to capture images obliquely upward towards the shooting device 1000, while the second image sensor 102 can stop capturing images and only capture images through the first image sensor 101.
[0218] In this application, the memory 300 of the imaging device 1000 can be a Flash chip, a ROM (Read-Only Memory) disk, an optical disk, a USB flash drive, or a portable hard drive, etc. The memory 300 stores various computer program instructions for the processor 400 to execute.
[0219] The processor 400 and the memory 300 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus. The processor 400 can be an MCU (Micro-controller Unit), a CPU (Central Processing Unit), or a DSP (Digital Signal Processor), etc.
[0220] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0221] When the rotating shaft drive assembly 200 drives the load 100 to a first posture, the first image sensor 101 is controlled to acquire a first image, the second image sensor 102 is controlled to acquire a second image, and a panoramic image is generated based on the first image and the second image. The field of view of the first image sensor 101 includes a first central field of view and a first edge field of view. When the load 100 is in the first posture, the first edge field of view at least covers the target field of view. When the load 100 is in the first posture, the shooting device 1000 is in panoramic shooting mode.
[0222] When the rotating shaft drive assembly 200 drives the load 100 to a second posture, it controls the first image sensor 101 to acquire a third image. The first posture is different from the second posture. When the load 100 is in the second posture, the first central field of view range at least covers the target field of view range. When the load 100 is in the second posture, the shooting device 1000 is in a non-panoramic shooting mode.
[0223] The target field of view can be the field of view corresponding to the movement direction of the shooting device 1000 (e.g., the flight direction of the aircraft), the field of view corresponding to the direction of the target object of interest selected by the user, or the field of view corresponding to the main viewpoint that the shooting device 1000 focuses on in different modes (e.g., the focus viewpoint in FPV mode is mainly the forward flight direction, and the focus viewpoint in aerial photography mode is mainly the forward flight direction or the forward downward view direction).
[0224] When the load 100 is in the first posture, the shooting device 1000 is in panoramic shooting mode; when the load 100 is in the second posture, the shooting device 1000 is in non-panoramic shooting mode. The first or second posture of the load 100 can be automatically controlled or user-controlled. Similarly, the panoramic or non-panoramic shooting mode of the shooting device 1000 can also be automatically controlled or user-controlled.
[0225] For example, processor 400 is also used for:
[0226] In response to the shooting device 1000 entering panoramic shooting mode, the control rotation axis drive component 200 drives the load 100 to a first posture. In response to the shooting device 1000 exiting panoramic shooting mode, the control rotation axis drive component 200 drives the load 100 to exit the first posture.
[0227] In other words, the mode of the shooting device 1000 is the trigger condition for adjusting the posture of the load 100. When the shooting device 1000 enters the panoramic shooting mode, it automatically adjusts the load 100 to the first posture; when the shooting device 1000 exits the panoramic shooting mode, it automatically adjusts the load 100 to exit the first posture. This eliminates the need for manual adjustment of the load 100's posture by the user, thus improving the user experience.
[0228] For example, processor 400 is also used for:
[0229] In response to the shooting device 1000 being in aerial shooting mode or FPV mode, the control rotation axis drive assembly 200 drives the load 100 to a second posture.
[0230] Among them, the aerial photography mode or FPV mode is a single-lens mode. In response to the shooting device 1000 being in aerial photography mode or FPV mode, the load 100 is automatically adjusted to a second posture. After the load 100 is in the second posture, only one of the two fisheye lenses is controlled to work, while the other stops working. The image is captured using the best shooting area at the center of the working fisheye lens, thus obtaining better image quality. Furthermore, the user does not need to manually adjust the load 100 to the second posture, thereby improving the user experience.
[0231] In one possible implementation, such as Figure 8As shown, with the optical axes of the two fisheye lenses of the panoramic camera vertical and the camera in its first orientation, the aircraft is in panoramic shooting mode. Each fisheye lens can capture images of 360 degrees horizontally and 180 degrees or more vertically above and below the aircraft, which are then stitched together to create a 360-degree horizontal and 360-degree vertical panoramic image. It can be understood that for a target's field of view in the direction in front of the aircraft, the edge field of view of the fisheye lens (corresponding to the edge of the fisheye lens's image) at least covers that target's field of view. Furthermore, when the panoramic camera is in the orientation as shown... Figure 8 In the first pose shown, the field of view of the panoramic camera is as follows: Figures 15 to 16 As shown, since the field of view of a single fisheye lens can exceed 180 degrees, for example, reaching 190 degrees, two fisheye cameras are placed back to back with their optical axes aligned, and the aircraft's fuselage is located between the two fisheye lenses, i.e., within the blind spot of either fisheye lens. Therefore, in the generated panoramic image, the aircraft can achieve "stealth," meaning that the aircraft itself is not included in the panoramic image.
[0232] In one possible implementation, such as Figure 9 As shown, when the optical axes of the two fisheye lenses of the panoramic camera are horizontal and the panoramic camera is in its second attitude, the aircraft is in a non-panoramic shooting mode, such as aerial photography mode, landing mode, or takeoff mode. A single fisheye lens can then be used to capture images in front of the aircraft. For example... Figure 19 The diagram shown is a schematic representation of panoramic camera image quality analysis in aerial photography mode according to an embodiment of this application. When the aircraft is conducting aerial photography or close-up tracking, the target object or main point of interest captured by the panoramic camera is generally located in front of the aircraft. Figure 9 Shooting in the indicated state allows the use of the fisheye lens's superior imaging capabilities to capture images in the horizontal / forward direction. The image quality in the forward and backward directions is also good, thus improving the image quality of the main point of interest. When using a fisheye lens to capture images in front of the aircraft, the center field of view (corresponding to the center of the fisheye lens's image) must at least cover the target field of view (corresponding to the field of view in front of the aircraft). Since the image quality corresponding to the center field of view of the fisheye lens is better than that corresponding to the edge field of view, the image quality of the target field of view captured by the fisheye lens in the second attitude is higher than that in the first attitude. Therefore, the second attitude improves the image quality of the images captured in front of the aircraft compared to the first attitude. Alternatively, in landing mode, the fisheye lens can be switched to a non-ground orientation to avoid the fisheye lens being damaged by the landing surface when the aircraft lands.
[0233] In one possible implementation, such as Figure 10As shown, when the optical axes of the two fisheye lenses of the panoramic camera are at an angle to the horizontal direction, and the panoramic camera is in its second attitude, the aircraft is in a non-panoramic shooting mode, such as FPV mode. The fisheye lenses can be used to capture images of the front / top of the aircraft from a low angle (for example, when the aircraft is flying forward, its nose is lower than its tail, and the fuselage is in a forward-lower-rear-high state; therefore, when the aircraft is flying forward, the fisheye lens facing diagonally upwards towards the aircraft can capture information about the front of the aircraft). Figure 20 The diagram shown is a schematic of panoramic camera image quality analysis in FPV mode according to an embodiment of this application. The aircraft fuselage is tilted forward at approximately 45 degrees, in a high-angle, high-speed flight state, which is a common flight attitude for FPV aircraft. With the panoramic camera in the second attitude, the aircraft is in FPV mode. The target object captured by the panoramic camera is generally located in the direction of the aircraft's flight, that is, in the forward and upward direction of the aircraft fuselage. Figure 10 When shooting in the indicated state, the image can be captured in the upper-front direction of the aircraft using the pixel area with better imaging effect of the fisheye lens. This allows for shooting from a low angle at the aircraft's main point of interest (POI) to improve the image quality of the POI. Using a fisheye lens to capture the image of the aircraft's upper-front direction (flight direction) corresponding to the POI, the center field of view of the fisheye lens (corresponding to the center of the fisheye lens's image) must at least cover the target field of view (corresponding to the field of view in the flight direction). Since the image quality corresponding to the center field of view of the fisheye lens is better than that corresponding to the edge field of view, the image quality of the target field of view captured by the fisheye lens in the second attitude is higher than that in the first attitude. Therefore, the second attitude improves the image quality of the captured image in the aircraft's flight direction compared to the first attitude.
[0234] In one possible implementation, such as Figure 11 As shown, when the optical axes of the two fisheye lenses of the panoramic camera are at an angle to the horizontal direction, and the panoramic camera is in its second attitude, the aircraft is in a non-panoramic shooting mode, such as aerial photography mode. The fisheye lenses can be used to capture images from above / below the aircraft, utilizing the area with better fisheye lens imaging to improve the image quality of the main point of interest. Figure 21 The diagram shown is a schematic representation of panoramic camera image quality analysis in aerial photography mode according to an embodiment of this application. When shooting in aerial photography mode, due to the high altitude of the aircraft, the target object or main point of interest captured by the panoramic camera is generally located below and in front of the aircraft. Figure 11The shooting posture shown allows the use of a fisheye lens to capture images of the aircraft's lower front view at an angle, thus improving image quality in this direction. The fisheye lens captures images of the aircraft's main field of view, improving image quality in this angled downward direction. When capturing images of the aircraft's lower front view using a fisheye lens, the center field of view (corresponding to the center of the fisheye lens's image) must at least cover the target field of view (corresponding to the lower front view of the aircraft). Since the image quality corresponding to the center field of view of the fisheye lens is better than that corresponding to the edge field of view, the image quality of the target field of view captured by the fisheye lens in the second posture is higher than that in the first posture. Therefore, the second posture improves the image quality of the lower front view of the aircraft compared to the first posture.
[0235] In summary, the aircraft can flexibly adjust the orientation of the panoramic camera using the pitch axis gimbal, allowing the aircraft to capture images using pixel areas with better image quality, thereby improving the image quality of the captured images.
[0236] In addition, by setting up a rotating shaft drive assembly, the problem of preventing the fisheye lens from hitting the ground during the landing phase of the aircraft can also be solved.
[0237] For example, controlling the first image sensor 101 to acquire a third image includes: controlling the first image sensor 101 to acquire a third image in the direction of movement of the imaging device 1000, or controlling the first image sensor 101 to acquire a third image in the direction of interest.
[0238] The direction of movement of the shooting device 1000 can be, for example, the flight direction of an aircraft. The direction of interest can be a user-specified direction, such as the direction of the target object or the target direction selected by the user. For example, the user can indicate the direction of interest using controls such as a joystick, physical buttons, or dials on the control device. Alternatively, the user can indicate the direction of interest through the display interface of the control device. This application does not impose specific limitations on this.
[0239] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0240] When the rotating shaft drive assembly 200 drives the load 100 to a first posture, the first image sensor 101 is controlled to acquire a first image, the second image sensor 102 is controlled to acquire a second image, and a panoramic image is generated based on the first image and the second image. When the load 100 is in the first posture, the shooting device 1000 is in panoramic shooting mode.
[0241] When the rotating shaft drive assembly 200 drives the load 100 to a second posture, it controls the first image sensor 101 to acquire a third image. The first posture and the second posture are different, and the image quality of the target field of view acquired by the first image sensor 101 when the load 100 is in the second posture is higher than the image quality of the target field of view acquired by the first image sensor 101 when the load is in the first posture. When the load 100 is in the second posture, the shooting device 1000 is in a non-panoramic shooting mode.
[0242] The relevant descriptions and implementation methods can be found in the relevant sections of the foregoing embodiments, and will not be repeated here.
[0243] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0244] When the rotating shaft drive assembly 200 drives the load 100 to a first posture, the first image sensor 101 is controlled to acquire a first image, the second image sensor 102 is controlled to acquire a second image, and a panoramic image is generated based on the first image and the second image. The first image sensor 101 includes a center pixel area and an edge pixel area. When the load 100 is in the first posture, the shooting device 1000 is in a panoramic shooting mode.
[0245] When the rotating axis drive assembly 200 drives the load 100 to a second posture, it controls the first image sensor 101 to acquire a third image. The first posture and the second posture are different. When the load 100 is in the second posture, the first image sensor 101 uses the center pixel area to acquire the image in the target direction. When the load 100 is in the first posture, the first image sensor 101 uses the edge pixel area to acquire the image in the target direction. When the load 100 is in the second posture, the shooting device 1000 is in a non-panoramic shooting mode.
[0246] Each image sensor includes a central pixel region and an edge pixel region. The central pixel region corresponds to the central field of view (e.g., the center of the image in a fisheye lens), and the edge pixel region corresponds to the edge field of view (e.g., the edge of the image in a fisheye lens). Specific descriptions and implementation methods can be found in the relevant sections of the foregoing embodiments, and will not be repeated here.
[0247] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0248] When the rotating shaft drive assembly 200 drives the load 100 to a first posture, it controls the first image sensor 101 to acquire a first image, controls the second image sensor 102 to acquire a second image, and generates a panoramic image based on the first image and the second image.
[0249] When the rotating shaft drive assembly 200 drives the load 100 to a second posture, it controls the first image sensor 101 to acquire a third image and controls the second image sensor 102 to stop acquiring images, wherein the first posture and the second posture are different.
[0250] For example, when the panoramic camera is in the position of... Figures 9 to 11 In the second attitude state, the aircraft is in non-panoramic shooting mode. The rear fisheye lens's field of view is obstructed by the aircraft's fuselage. This allows the rear fisheye lens to be turned off, ceasing image acquisition. In other words, the panoramic camera is in single-lens mode, concentrating all image processing power on the front fisheye lens. This reduces computational overhead, allowing more power to be used for image quality tuning compared to processing data from two fisheye lenses. This improves the final image quality of a single fisheye lens, further enhancing overall image quality. Furthermore, since video editing from aircraft is complex, requiring the extraction of a square frame from the spherical panoramic view, and especially in aerial or FPV shooting scenarios, recording both fisheye lenses simultaneously generates a large amount of redundant image information, increasing post-processing and editing difficulty. Therefore, in non-panoramic shooting mode, using only one fisheye lens provides footage similar to aerial shots, facilitating post-editing and saving on the amount of footage captured.
[0251] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0252] When the rotating shaft drive assembly 200 drives the load 100 to a first posture, the first image sensor 101 is controlled to acquire a first image, the second image sensor 102 is controlled to acquire a second image, and a panoramic image is generated based on the first image and the second image. The panoramic image does not include the shooting device 1000 itself. When the load 100 is in the first posture, the shooting device 1000 is in panoramic shooting mode.
[0253] When the rotating axis drive assembly 200 drives the load 100 to a second posture, it controls the first image sensor 101 to acquire a third image of the moving direction of the shooting device 1000. The first posture and the second posture are different. When the load 100 is in the second posture, the shooting device 1000 is in a non-panoramic shooting mode.
[0254] The relevant descriptions and implementation methods can be found in the relevant sections of the foregoing embodiments, and will not be repeated here.
[0255] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0256] When the rotating shaft drive assembly 200 drives the load 100 to a first posture, the first image sensor 101 is controlled to acquire a first image, the second image sensor 102 is controlled to acquire a second image, and a panoramic image is generated based on the first image and the second image. The panoramic image does not include the shooting device 1000 itself. When the load 100 is in the first posture, the shooting device 1000 is in panoramic shooting mode.
[0257] When the rotating axis drive assembly 200 drives the load 100 to a second posture, it controls the first image sensor 101 to acquire a third image of the shooting device 1000 in the direction of interest. The first posture and the second posture are different. When the load 1000 is in the second posture, the shooting device 1000 is in a non-panoramic shooting mode.
[0258] The relevant descriptions and implementation methods can be found in the relevant sections of the foregoing embodiments, and will not be repeated here.
[0259] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0260] When the rotating shaft drive assembly 200 drives the load 100 to a first posture, it controls the first image sensor 101 to acquire a first image, controls the second image sensor 102 to acquire a second image, and generates a panoramic image based on the first image and the second image.
[0261] When the rotary axis drive assembly 200 drives the load 100 out of the first posture, it controls the first image sensor 101 to acquire the third image and controls the second image sensor 102 to stop acquiring images.
[0262] The exit of load 100 from the first posture can be in the second posture or in any other posture other than the first and second postures; this application does not limit this. When load 100 exits the first posture, load 100 is in single-lens mode. For specific descriptions and implementation methods, please refer to the relevant parts of the foregoing embodiments, which will not be repeated here.
[0263] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0264] When the rotating shaft drive assembly 200 drives the load 100 to be in the first posture, the shooting device 1000 is controlled to enter the panoramic shooting mode. In the panoramic shooting mode, the first image sensor 101 is used to acquire the first image, the second image sensor 102 is used to acquire the second image, and the first image and the second image are used to generate a panoramic image.
[0265] When the rotating shaft drive assembly 200 drives the load 100 to exit the first posture, the shooting device 1000 is controlled to exit the panoramic shooting mode. Controlling the shooting device 1000 to exit the panoramic shooting mode includes controlling the first image sensor 101 to acquire a third image and controlling the second image sensor 102 to stop acquiring images.
[0266] In other words, based on the current attitude of the payload 100, the shooting device 1000 can be automatically controlled to switch modes. The attitude of the payload 100 is the trigger condition for mode switching. This can be achieved by the user adjusting the attitude of the payload 100. After the payload 100 is adjusted to the first attitude, the shooting device 1000 is automatically controlled to enter panoramic shooting mode; conversely, after the payload 100 is adjusted to leave the first attitude, the shooting device 1000 is automatically controlled to leave panoramic shooting mode. For example, when the panoramic camera is in the first attitude, the aircraft is controlled to enter panoramic shooting mode; when the panoramic camera is in the second attitude, the aircraft is controlled to enter non-panoramic shooting mode. Therefore, this eliminates the need for manual mode switching by the user, thereby improving the user experience.
[0267] The relevant descriptions and implementation methods involved can be found in the relevant parts of the foregoing embodiments, and will not be repeated here.
[0268] In some embodiments, at least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0269] In response to the shooting device 1000 entering the panoramic shooting mode, the rotating axis drive assembly 200 is controlled to drive the load 100 to a first posture, and the first image sensor 101 is controlled to acquire a first image, the second image sensor 102 is controlled to acquire a second image, and a panoramic image is generated based on the first image and the second image.
[0270] In response to the shooting device 1000 exiting the panoramic shooting mode, the rotation axis drive assembly 200 is controlled to drive the load 100 to exit the first posture, the first image sensor 101 is controlled to acquire the third image, and the second image sensor 102 is controlled to stop acquiring images.
[0271] In other words, based on the current mode of the shooting device 1000, the attitude of the payload 100 can be automatically adjusted. The mode of the shooting device 1000 is the trigger condition for attitude adjustment. This can be triggered by the user operating the shooting device 1000 to enter panoramic shooting mode, automatically adjusting the payload 100 to the first attitude, and then performing the corresponding shooting operation after the payload 1000 is in the first attitude. Similarly, it can be triggered by the shooting device 1000 exiting panoramic shooting mode, automatically adjusting the payload 100 to exit the first attitude, and then performing the corresponding shooting operation after the payload 1000 has exited the first attitude. For example, when the aircraft enters panoramic shooting mode, the pitch angle of the panoramic camera's fisheye lens is automatically adjusted to bring the panoramic camera to the first attitude; when the aircraft exits panoramic shooting mode, the pitch angle of the panoramic camera's fisheye lens is automatically adjusted to bring the panoramic camera out of the first attitude. Therefore, this eliminates the need for the user to manually adjust the attitude of the payload 100, thereby improving the user experience.
[0272] The relevant descriptions and implementation methods involved can be found in the relevant parts of the foregoing embodiments, and will not be repeated here.
[0273] In some embodiments, the processor 400 is further configured to:
[0274] In response to the shooting device 1000 being in the take-off or landing phase, the control rotation axis drive assembly 200 drives the load 100 to a second attitude.
[0275] Since the shooting device 1000 needs to avoid being captured in the image as much as possible, the fisheye lens needs to protrude beyond the shooting device 1000. Figure 6 As shown, the upper fisheye lens 101 protrudes from the upper end of the aircraft, and the lower fisheye lens 102 protrudes from the lower end of the aircraft to ensure that the aircraft fuselage is not included in the frame when shooting panoramic views. Based on this, the shooting device 1000 encounters the problem of the fisheye lens hitting the ground upon landing during descent. However, in this embodiment, during the takeoff or landing phase of the shooting device 1000, the attitude of the load 100 can be adjusted using the rotary shaft drive assembly 200 to place the load 100 in a second attitude, thereby switching the fisheye lens to an orientation that is not close to the takeoff / landing surface, thus avoiding the problem of the fisheye lens being hit by the landing surface. For example, as... Figure 22 The diagram shown is a schematic representation of an aircraft landing on the ground, as provided in this application. The aircraft can employ methods such as... Figure 22 The aircraft is taking off and landing in the manner shown. At this time, the fisheye lens is not at the lowest point of the fuselage, thus avoiding the fisheye lens being hit by the takeoff or landing surface.
[0276] For example, to prevent the camera from having a horizontal velocity component when it lands on the ground due to wind or external interference, causing the lens to be driven by external force and pointing towards the ground, a limiting angle will be added to the pitch angle of the rotation axis drive assembly 200, thereby preventing the lens from hitting the ground due to excessive pitch angle adjustment.
[0277] In some embodiments, the processor 400 is further configured to:
[0278] In response to the shooting device 1000 being in storage mode, the control rotation axis drive assembly 200 drives the load 100 to a first posture, and controls the first image sensor 101 and the second image sensor 102 to stop working.
[0279] For example, the storage mode is determined based on the height of the shooting device 1000 above the ground. For instance, in response to detecting that the shooting device 1000's height above the ground has reached a preset height threshold, the shooting device 1000 is controlled to enter the storage mode. The preset height threshold can be flexibly set according to actual conditions, and this application does not limit it.
[0280] The shooting device 1000 is in retractable mode, and the load 100 is adjusted to a first attitude, switching the two fisheye lenses protruding from the fuselage to a vertical position for better retraction. In retractable mode, the first image sensor 101 and the second image sensor 102 are deactivated. For example, in response to the aircraft being in retractable mode, the panoramic camera is adjusted to a position such as... Figure 8 The first posture shown switches the two fisheye lenses that protrude from the body to a vertical position for better storage.
[0281] In some embodiments, such as Figure 23 As shown, the imaging device 1000 also includes a visual sensor 500, which is used to collect environmental information around the imaging device 1000. Based on the collected environmental information, the visual sensor 500 can be used to assist the imaging device 1000 in obstacle avoidance and / or positioning.
[0282] For example, the vision sensor 500 includes a binocular vision sensor, which comprises a first vision sensor and a second vision sensor. For instance, the vision sensor 500 may include a pair of fisheye lenses with parallel optical axes. In other possible implementations, the vision sensor 500 may also be other types of cameras, which are not limited in this application.
[0283] For example, the vision sensor 500 is disposed at the head of the shooting device 1000. In other possible implementations, the vision sensor 500 may also be disposed at the tail or side of the shooting device 1000, which is not limited in this application.
[0284] For example, such as Figures 24 to 26 The diagram shown is a schematic of a visual sensor 500 on an aircraft according to an embodiment of this application. The visual sensor 500 can be arranged in the space between the nose and the nose rotor of the aircraft for visual obstacle avoidance and visual positioning in front of and / or below the aircraft fuselage. In other possible implementations, the visual sensor 500 can also be located on the nose, rotor guard, landing gear, or other parts of the aircraft.
[0285] It is understandable. For aircraft, the head is the nose of the aircraft. For other types of shooting equipment, the head is different. For example, for a mobile vehicle, the head is the front of the mobile vehicle.
[0286] For example, the visual sensor 500 can acquire environmental information in front of and / or below the imaging device 1000. For instance, when the optical axis of the visual sensor 500 is facing forward, it can acquire environmental information in front of the aircraft. When the optical axis of the visual sensor 500 is facing downward, it can acquire environmental information below the aircraft. When the optical axis of the visual sensor 500 is angled downward, it can acquire environmental information in both front of and below the aircraft.
[0287] For example, the visual sensor 500 is tilted at the head of the imaging device 1000, for instance, the visual sensor 500 is tilted downwards at the head of the imaging device 1000 so that it can simultaneously collect environmental information in front of and below the imaging device 1000 (such as an aircraft). In other possible implementations, the visual sensor 500 may also be tilted upwards at the head of the imaging device 1000, which is not limited in this application.
[0288] The imaging device 1000 in this embodiment can acquire 360-degree panoramic images of its surroundings via the load 100. Therefore, if a user wants to view images from different directions of the imaging device 1000, the device does not need to be turned to obtain the corresponding image. Based on this, the user only needs to focus on the environmental information in front of and below the imaging device 1000 to avoid collisions. With the visual sensor 500 tilted downwards at the head of the imaging device 1000, its optical axis points downwards. The visual sensor 500 can simultaneously acquire environmental information in front of and below the imaging device 1000 to assist in obstacle avoidance and / or positioning. This configuration saves on the number of sensors, improves sensor utilization, and reduces material costs, size, and weight of the imaging device 1000.
[0289] For example, the optical axis of the vision sensor 500 forms a set angle with the horizontal direction of the camera body of the imaging device 1000. This angle is greater than or equal to 30 degrees and less than or equal to 60 degrees. For example, as shown in... Figures 24 to 26 Taking the visual sensor 500 on the aircraft shown as an example, the visual sensor 500 is a fisheye lens, and the angle between the optical axis of the fisheye lens and the horizontal direction of the aircraft fuselage can be, for example, 45 degrees (the optical axis of the fisheye lens points forward and downward). Depending on different obstacle avoidance requirements, this angle can also be designed to be any angle within the range of 0 degrees to 90 degrees, and this application does not limit it.
[0290] For example, the field of view of the visual sensor 500 is greater than or equal to 180 degrees. Of course, the field of view of the visual sensor 500 can also be a wide-angle range less than 180 degrees. For instance, when the angle between the optical axis of the visual sensor 500 and the horizontal direction is -45 degrees, and the field of view of the visual sensor 500 reaches 180 degrees, the vertical field of view coverage of the visual sensor 500 is +45 degrees to -135 degrees. Therefore, the visual sensor 500 can simultaneously acquire environmental information in the forward and downward directions of the imaging device 1000 to assist the imaging device 1000 in obstacle avoidance and / or positioning.
[0291] For example, the vision sensor 500 may include a pair of fisheye cameras with parallel optical axes. The angle between the optical axes and the horizontal direction of the camera body can be, for example, -45° (the negative sign indicates that the fisheye optical axis is pointing forward and downward; depending on different obstacle avoidance requirements, it can also be designed to be any angle within the range of 0 to -90°). The FOV of the fisheye camera lens can be, for example, greater than 180°. In this case, the vertical field of view coverage of the binocular vision sensor is +45 to -135°. Of course, the FOV of the vision sensor can also be a wide-angle range of less than 180°.
[0292] Please see Figure 27 , Figure 27 This is a schematic block diagram illustrating the structure of a shooting device provided in an embodiment of this application. Figure 27 As shown, the imaging device 1000 includes a body 600, a load 100, a single-axis drive assembly 201, one or more memories 300, and one or more processors 400. In other possible implementations, the imaging device 1000 includes the single-axis drive assembly 201, one or more memories 300, and one or more processors 400, and the imaging device 1000 is capable of mounting the load 100. Alternatively, the imaging device 1000 includes one or more memories 300, one or more processors 400, and the imaging device 1000 is capable of mounting the load 100 and the single-axis drive assembly 201. This application does not limit the structure of the imaging device 1000.
[0293] The load 100 includes at least a first image sensor 101 and a second image sensor 102, as described in the foregoing embodiments, and will not be repeated here. The single-axis drive assembly 201 includes a pitch axis drive assembly, one end of which is connected to the load 100 and used to drive the load 100 to rotate about the pitch axis. In other possible implementations, the single-axis drive assembly 201 can also be other rotary axis drive assemblies, such as a roll axis drive assembly, which is not limited in this application.
[0294] At least one processor 400 invokes computer program instructions stored in memory 300 to perform the following operations:
[0295] When the pitch axis drive assembly drives the load 100 in a first attitude, it controls the first image sensor to acquire a first image above the shooting device 1000, controls the second image sensor 102 to acquire a second image below the shooting device, and generates a panoramic image based on the first and second images, wherein the shooting device 1000 itself is not in the panoramic image.
[0296] The relevant descriptions and implementation methods can be found in the relevant sections of the foregoing embodiments, and will not be repeated here.
[0297] The above embodiments illustrate the use of a shooting device including a load and a rotation axis drive assembly (e.g., a pitch axis drive assembly). In other possible embodiments, the load and / or rotation axis drive assembly (e.g., a pitch axis drive assembly) may not be part of the shooting device, but rather detachably connected to it via a connection method. This connection method can be a quick-release connection, such as magnetic, snap-fit, or screw connection, but is not limited to these methods. In one possible implementation, the load is not part of the shooting device, but is connected to it via some connection method, while the rotation axis drive assembly is part of the shooting device. For example, the shooting device may or may not have a load installed. When a load is installed, the rotation axis drive assembly drives the load to achieve attitude adjustment, thereby realizing the function described in the above embodiments. In another possible implementation, the load and rotation axis drive assembly are not part of the shooting device, but are connected to it via some connection method. For example, the shooting device may or may not have a load and rotation axis drive assembly installed. When a load and rotation axis drive assembly are installed, the rotation axis drive assembly drives the load via some communication interface to achieve attitude adjustment, thereby realizing the function described in the above embodiments. The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A mobile platform, characterized in that, include: The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view. A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft; The rotary axis drive assembly can drive the load to a first posture or a second posture. When the rotary axis drive assembly drives the load to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. When the load is driven by the rotary axis drive assembly to a second posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images, wherein the first posture and the second posture are different.
2. A mobile platform, characterized in that, The mobile platform is capable of mounting a load, the load including at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers a panoramic field of view. The mobile platform includes: A rotary shaft drive assembly is used to drive the load to rotate about a rotary shaft; The rotary axis drive assembly can drive the load to a first posture or a second posture. When the rotary axis drive assembly drives the load to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. When the load is driven by the rotary axis drive assembly to a second posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images, wherein the first posture and the second posture are different.
3. A mobile platform, characterized in that, The movable platform is capable of mounting a load and a rotation axis drive assembly. The load includes at least a first image sensor and a second image sensor. The first image sensor is used to sense information about a first field of view, and the second image sensor is used to sense information about a second field of view. The first and second field of view are different and at least partially overlap, and the set of the first and second field of view at least covers a panoramic field of view. The rotation axis drive assembly is used to drive the load to rotate about a rotation axis. The rotation axis drive assembly is capable of driving the load to either a first or a second posture. When the load is driven by the rotary axis drive assembly to a first posture, the first image sensor is used to acquire a first image, the second image sensor is used to acquire a second image, and the first image and the second image are used to generate a panoramic image. When the load is driven by the rotary axis drive assembly to a second posture, the first image sensor is used to acquire a third image, and the second image sensor stops acquiring images, wherein the first posture and the second posture are different.
4. The mobile platform according to any one of claims 1 to 3, characterized in that, The optical axes of the first image sensor and the second image sensor are parallel to each other, and the main sensing directions of the first image sensor and the second image sensor are opposite; and / or, The optical axes of the first image sensor and the second image sensor are collinear. And / or, The field of view of the first image sensor is greater than or equal to 180 degrees, the field of view of the second image sensor is greater than or equal to 180 degrees, and the panoramic image includes a 360-degree panorama. And / or, When the load is in the first posture, the first image sensor is used to acquire an image above the movable platform and the second image sensor is used to acquire an image below the movable platform, or the first image sensor is used to acquire an image below the movable platform and the second image sensor is used to acquire an image above the movable platform, wherein the vertical field of view of the first image sensor is greater than or equal to 180 degrees and the horizontal field of view is greater than or equal to 360 degrees, and the vertical field of view of the second image sensor is greater than or equal to 180 degrees and the horizontal field of view is greater than or equal to 360 degrees, and the panoramic image includes a horizontal 360-degree panoramic view and a vertical 360-degree panoramic view; and / or, The first image sensor is used to acquire an image to the left of the movable platform and the second image sensor is used to acquire an image to the right of the movable platform; or, the first image sensor is used to acquire an image to the right of the movable platform and the second image sensor is used to acquire an image to the left of the movable platform; or, the first image sensor is used to acquire an image to the front of the movable platform and the second image sensor is used to acquire an image to the rear of the movable platform; or, the first image sensor is used to acquire an image to the rear of the movable platform and the second image sensor is used to acquire an image to the front of the movable platform. The first image sensor has a horizontal field of view greater than or equal to 180 degrees and a vertical field of view greater than or equal to 360 degrees, and the second image sensor has a horizontal field of view greater than or equal to 180 degrees and a vertical field of view greater than or equal to 360 degrees. The panoramic image includes a horizontal 360-degree panoramic view and a vertical 360-degree panoramic view; and / or, Both the first image sensor and the second image sensor are fisheye lenses.
5. The mobile platform according to any one of claims 1 to 3, characterized in that, The first image sensor is used to acquire a third image, including: the first image sensor is used to acquire a third image in the direction of movement of the movable platform, or the first image sensor is used to acquire a third image in the direction of interest.
6. The mobile platform according to any one of claims 1 to 3, characterized in that, The rotary axis drive assembly includes a pitch axis drive assembly.
7. The mobile platform according to any one of claims 1 to 3, characterized in that, When the load is in the first posture, the optical axes of the first image sensor and the second image sensor are approximately vertical; or... When the load is in the first posture, the optical axis of the first image sensor and the optical axis of the second image sensor form a first angle with the vertical direction; or, When the load is in the first posture, the optical axes of the first image sensor and the second image sensor are parallel to the vertical direction of the movable platform's body; or, When the load is in the first posture, the optical axes of the first image sensor and the second image sensor form a second angle with the vertical direction of the movable platform's body; or, When the load is in the second posture, the optical axes of the first image sensor and the second image sensor are approximately horizontal; or... When the load is in the second posture, the optical axes of the first image sensor and the second image sensor form a third angle with the horizontal direction; or... When the load is in the second posture, the optical axes of the first image sensor and the second image sensor are parallel to the horizontal direction of the movable platform's body; or, When the load is in the second posture, the optical axes of the first image sensor and the second image sensor are parallel to the direction of movement of the movable platform; or, When the load is in the second posture, the optical axes of the first image sensor and the second image sensor are parallel to the direction of interest of the movable platform; or, When the load is in the second posture, the optical axis of the first image sensor and the optical axis of the second image sensor form a fourth angle with the horizontal direction of the body of the movable platform.
8. The mobile platform according to any one of claims 1 to 3, characterized in that, When the movable platform enters panoramic shooting mode, the rotation axis drive assembly drives the load to be in the first posture; and / or, When the movable platform exits the panoramic shooting mode, the rotation axis drive assembly drives the load to exit the first posture; And / or, When the mobile platform is in the takeoff or landing phase, the rotary axis drive assembly drives the load to a second attitude; And / or, When the mobile platform is in aerial photography mode or FPV mode, the rotary axis drive assembly drives the load to a second posture; And / or, When the movable platform is in storage mode, the rotary axis drive assembly drives the load to the first posture, and the first image sensor and the second image sensor cease operation; and / or, The mobile platform includes multiple different modes, each corresponding to a different second posture; and / or, The mobile platform includes one or more of the following modes: panoramic shooting mode, FPV mode, aerial shooting mode, landing mode, take-off mode, or storage mode.
9. The mobile platform according to any one of claims 1 to 3, characterized in that, The rotation axis drive assembly drives the load to rotate within a preset range; and / or, The rotation axis of the rotary shaft drive assembly passes through the center of the load, or the rotation axis of the rotary shaft drive assembly is offset from the center of the load; and / or, The rotary axis drive assembly is disposed at the head of the movable platform; and / or, The movable platform itself is not present in the panoramic image.
10. The mobile platform according to any one of claims 1 to 3, characterized in that, The mobile platform also includes a vision sensor for acquiring environmental information surrounding the mobile platform; and / or, The vision sensor includes a binocular vision sensor, which comprises a first vision sensor and a second vision sensor; and / or, The visual sensor is disposed at the head of the movable platform; and / or, The visual sensor can collect environmental information in front of and / or below the mobile platform; And / or, The visual sensor is tilted and positioned at the head of the movable platform; and / or, The visual sensor is tilted downwards and positioned at the head of the movable platform; and / or, The visual sensor can simultaneously acquire environmental information from both the front and bottom of the mobile platform; and / or, The optical axis of the vision sensor forms a predetermined angle with the horizontal direction of the movable platform's body; and / or, The field of view of the vision sensor is greater than or equal to 180 degrees; and / or, The visual sensor is used to assist the mobile platform in obstacle avoidance and / or positioning.
11. The mobile platform according to any one of claims 1 to 3, characterized in that, The mobile platform includes aircraft, mobile robots, mobile vehicles, ships, or handheld products.
12. A mobile platform, characterized in that, include: body; The load includes at least a first image sensor and a second image sensor, the first image sensor being used to sense information of a first field of view, and the second image sensor being used to sense information of a second field of view, wherein the first field of view and the second field of view are different and at least partially overlap, and the set of the first field of view and the second field of view at least covers the panoramic field of view. A single-axis drive assembly, the single-axis drive assembly including a pitch axis drive assembly, one end of the pitch axis drive assembly being connected to the load for driving the load to rotate about the pitch axis; When the pitch axis drive assembly drives the load to a first attitude, the first image sensor is used to acquire a first image above the movable platform, and the second image sensor is used to acquire a second image below the movable platform. The first image and the second image are used to generate a panoramic image, wherein the movable platform itself is not present in the panoramic image.