Photographing method and electronic device

Abstract

The application provides a shooting method and an electronic device. The electronic device can be configured with a gimbal camera. In the method, when the gimbal camera is turned on, the electronic device can not first unfold the gimbal. The electronic device can unfold the gimbal according to a user operation, and display a gimbal control panel for the user to control the rotation of the gimbal. In this way, when the electronic device is fixed, the user can shoot a video with flexible visual angle, and meet the personalized shooting needs of the user.

Description

Technical Field

[0001] This application relates to the field of terminals, and more particularly to a shooting method and an electronic device. Background Technology

[0002] Currently, when mobile phones and other electronic devices are fixed on stands or other surfaces, the shooting angle of their front / rear cameras is fixed and inflexible. When users want more flexible shooting, they need to hold the device by hand. When shooting handheld, the lens shakes significantly, causing other shooting problems for the user. Summary of the Invention

[0003] This application provides a shooting method and an electronic device.

[0004] In a first aspect, this application provides a shooting method applied to an electronic device, the electronic device including a first camera mounted on a gimbal, the method including: receiving a first operation; responding to the first operation, opening a camera application and activating the first camera; displaying a first preview interface, the first preview interface including an image captured by the first camera and a first control; receiving a second operation on the first control; deploying the gimbal and continuing to display the image captured by the first camera on the first preview interface; the gimbal control panel includes M controls, the M controls being used to control the rotation of the gimbal, M being a positive integer.

[0005] Prior to receiving a second operation on the first control, the first camera and gimbal are housed in the back panel of the electronic device.

[0006] Implementing the method provided in the first aspect, the electronic device can be equipped with a gimbal, and a first camera is mounted on the gimbal. The gimbal camera mentioned below refers to the camera mounted on the gimbal. When the camera on the gimbal is activated, the electronic device may not initially deploy the gimbal. When the user requires the gimbal, the electronic device can deploy the gimbal according to user operation and display the gimbal control panel. The user can control the rotation of the gimbal through the gimbal control panel to meet the user's shooting needs.

[0007] In some embodiments, after the gimbal is deployed, the method further includes: receiving a third operation on the first control; and in response to the third operation, folding the gimbal and storing the gimbal and the first camera in the back panel. That is, after the gimbal is deployed, the user can click the first control again to control the electronic device to retract the gimbal.

[0008] In some embodiments, after deploying the gimbal, the method further includes: automatically retracting the gimbal and the first camera into the back panel in low-power and / or overheating environments. This allows the electronic device to promptly reduce power consumption and / or mitigate heat generation issues.

[0009] After the gimbal and the first camera are housed in the back panel, the method also includes stopping the display of the gimbal control panel.

[0010] In some embodiments, after the gimbal and the first camera are housed in the backplate, the method further includes: continuing to display the image captured by the first camera on the first preview interface. This allows the user to continue using the gimbal camera uninterruptedly and continue shooting. By housing the gimbal camera and accommodating user selection or power saving, it also ensures continuous shooting by the gimbal camera, eliminating the need for the user to reopen the gimbal camera to restore shooting and preview functions, thus providing a relatively stable and smooth user experience.

[0011] In some embodiments, after retracting the gimbal and the first camera back into the back panel, the method further includes turning off the first camera. Turning off the gimbal camera can effectively reduce power consumption, optimize the user experience of the electronic device, or extend its usage time in low-power and / or overheating environments.

[0012] In some embodiments, after deploying the gimbal, the method further includes: exiting the camera application; during a first time period after exiting the camera application, turning off the first camera and not retracting the gimbal into the back panel; and during a second time period following the first time period, automatically retracting the gimbal and the first camera into the back panel; wherein the first time period and the second time period are continuous. In this way, the electronic device can avoid the problem of frequent deployment and folding of the gimbal caused by the user briefly exiting the camera application, which helps save power consumption, extend the gimbal's lifespan, and improve the user experience.

[0013] In some embodiments, when the gimbal is deployed, the camera application is in a first shooting mode; the method further includes switching to a second shooting mode, wherein the gimbal control panel includes N controls, where N is not equal to M and N is a positive integer. That is, the electronic device can selectively provide gimbal functionality according to the business characteristics of different shooting modes, avoiding resource waste.

[0014] In some embodiments, after deploying the gimbal, the method further includes: displaying a third control and a fourth control, wherein the third control is used to switch to a third shooting mode, which is a shooting mode using the first camera, and the fourth control is used to switch to a fourth shooting mode, which is a shooting mode using other cameras outside the gimbal; the third control can be selected, and the fourth control cannot be selected.

[0015] The third control includes, for example, the "Multi-camera Simultaneous Recording" control, the "Automatic Composition" control, and the "Dual Capture in One Shot" control, as illustrated in subsequent embodiments. The fourth control includes, for example, the "Macro" control and the "Document Scanning" control, as illustrated in subsequent embodiments. In this way, the electronic device can prevent users from switching to other shooting modes that do not use the gimbal after unfolding it, thus avoiding the waste of gimbal resources. It also avoids the problem of frequent unfolding and folding of the gimbal caused by switching between different modes, which helps save power consumption, extend the gimbal's lifespan, and improve the user experience.

[0016] In some embodiments, a second control is also displayed in the first preview interface. The second control is used to set the zoom ratio. Before the second operation on the first control is detected, the zoom ratio adjustment range corresponding to the second control is the first range. After the second operation on the first control is detected, the zoom ratio adjustment range corresponding to the second control is the second range, and the first range covers the second range.

[0017] In some embodiments, a second camera is also provided on the back panel of the electronic device. The first interval includes the zoom range supported by the first camera and the zoom range supported by the second camera; the second interval is the zoom range supported by the first camera. That is, after the gimbal is deployed, the electronic device can reduce the focusing range of the zoom bar to the range supported by the gimbal camera. In this way, the electronic device can reduce the need for the user to switch back panel cameras after the gimbal is deployed, thus saving gimbal resources.

[0018] In some embodiments, the method further includes: receiving a user operation on a third control, and in response to the operation, entering a third shooting mode; in the third shooting mode, rotating the gimbal in response to a first command input by the user, and automatically performing a shooting operation when a first target object appears in the preview interface, to obtain a first photo including the first target object, and the first target object.

[0019] In some embodiments, before automatically performing the shooting operation, the method further includes: adjusting the posture and / or focal length of the first camera so that the position of the first target object in the preview interface matches a preset composition template.

[0020] In some embodiments, the method further includes associating a first instruction with a first target object.

[0021] The third control is the "Auto-framing" control. Implementing the above method, after entering the shooting mode corresponding to the third control (e.g., Auto-framing mode), the electronic device can determine the user's desired subject based on user input. Then, the electronic device can rotate the gimbal camera to find the desired subject. After finding the desired subject, the electronic device can automatically capture and save a photo containing the subject for the user to view and use, without requiring user intervention.

[0022] In some embodiments, the method further includes: receiving a user operation on a third control, and in response to the operation, entering a third shooting mode; in the third shooting mode, in response to a first user operation, performing a first shooting operation to obtain a first photo, the first photo including a first object; changing the position of the first object in the preview interface by rotating the gimbal, and automatically performing a second shooting operation to obtain a second photo including the first object.

[0023] In some embodiments, the electronic device also changes the position of the first object in the preview interface by adjusting the focal length of the first camera, and the adjusted position of the first object in the preview interface matches the preset composition template.

[0024] The third control is the "One-Shot-Two-Get" control. Implementing the above method, after entering the shooting mode corresponding to the third control (e.g., One-Shot-Two-Get mode), after the user manually takes a photo, the electronic device can recompose the image and automatically capture a new photo containing content of interest to the user for selection.

[0025] In some embodiments, the first preview interface includes a first preview window, in which the electronic device displays an image captured by a first camera. The method further includes: receiving a user operation on a third control, and in response to the operation, entering a third shooting mode; in the third shooting mode, displaying a second preview window in the first preview interface including the first preview window, and displaying an image captured by a second camera in the second preview window, wherein the second camera is mounted on the back panel of the electronic device; receiving a first operation from the user, wherein the first camera tracks a first object; and recording images captured by the first camera and the second camera.

[0026] The third control is the "Multi-camera Simultaneous Recording" control. Implementing the above method, after entering the shooting mode corresponding to the third control (e.g., multi-camera simultaneous recording mode), the electronic device can simultaneously activate the rear camera and the gimbal camera for multi-channel shooting. During shooting, the electronic device can set the gimbal camera to track a specific object. Based on the stable tracking capability provided by the gimbal's rotation, the electronic device can acquire multiple video streams without handheld operation in fixed scenarios, and these video streams are rich in content and exhibit significant parallax effects.

[0027] Secondly, this application provides a shooting method applied to an electronic device. The electronic device includes a first camera mounted on a gimbal. When the first camera is off, the first camera and the gimbal are folded and stored in the back panel of the electronic device. The method includes: detecting a first operation to open a camera application; responding to the first operation, turning on the first camera without unfolding the gimbal and displaying a first preview interface; the first preview interface displays an image captured by the first camera and a first control; after detecting a second operation on the first control, unfolding the gimbal and displaying a gimbal control panel on the first preview interface; the gimbal control panel is provided with one or more controls for controlling the rotation of the gimbal; detecting a shooting operation; and responding to the shooting operation by saving the image currently captured by the first camera.

[0028] In some embodiments, after deploying the gimbal, the method further includes: detecting a third operation on the first control, and in response to the third operation, folding the gimbal and retracting the gimbal and the first camera back into the back panel.

[0029] In some embodiments, after deploying the gimbal, the method further includes: folding the gimbal in a low power and / or overheating environment, and retracting the gimbal and the first camera back into the back panel.

[0030] In the above embodiment, after retracting the gimbal and the first camera back into the back panel, the method further includes: continuing to display the image captured by the first camera on the first preview interface.

[0031] In some embodiments, after deploying the gimbal, the method further includes: exiting the camera application, turning off the first camera, but not folding the gimbal; after exiting for a first duration, folding the gimbal and retracting the gimbal and the first camera back into the backplate.

[0032] The method of deploying the gimbal includes: deploying the gimbal in a first shooting mode; in some embodiments, the method further includes: switching to a second shooting mode, adding one or more controls in the gimbal control panel, or stopping the display of one or more controls in the gimbal control panel.

[0033] In some embodiments, after the gimbal is deployed, the method further includes: displaying a third control and a fourth control, wherein the third control is used to switch to a third shooting mode, which is a shooting mode using the first camera, and the fourth control is used to switch to a fourth shooting mode, which is a shooting mode using other cameras outside the gimbal; the third control can be selected, and the fourth control cannot be selected.

[0034] Optionally, the first preview interface also displays a second control, which is used to set the zoom ratio; before the second operation on the first control is detected, the zoom ratio adjustment range corresponding to the second control is the first range; after the second operation on the first control is detected, the zoom ratio adjustment range corresponding to the second control is the second range, and the first range covers the second range.

[0035] The back panel of the electronic device is also equipped with a second camera. The first section includes the zoom range supported by the first camera and the zoom range supported by the second camera; the second section is the zoom range supported by the first camera.

[0036] Thirdly, this application provides a shooting method applied to an electronic device. The method includes: in a fifth shooting mode, activating a gimbal camera and displaying an image captured by the gimbal camera in a preview interface; receiving first information input by a user; rotating the gimbal in response to the first information; and automatically performing a shooting operation when a first target object appears in the preview interface to obtain a first photograph including the first target object, wherein the first information indicates the first target object.

[0037] Implementing the method provided in the first aspect, in a specific shooting mode (i.e., the fifth shooting mode, a specific shooting mode among the third shooting modes involving a gimbal camera), the electronic device can determine the user's desired shooting object based on user input. Then, the electronic device can rotate the gimbal camera to find the user's desired shooting object. After finding the user's desired shooting object, the electronic device can automatically capture and save a photo containing the object for the user to view and use.

[0038] In some embodiments, after the electronic device opens the camera application and enters a specific shooting mode, it receives first information input by the user, and then determines the user's desired shooting object based on the first information. The first information input by the user can be text information, or voice / image information.

[0039] In other embodiments, the electronic device may also receive a user's voice command and automatically open the camera application according to the voice command. In this case, receiving the first information input by the user includes: receiving the first voice command input by the user; responding to the first voice command, opening the camera application and entering the fifth shooting mode; and determining the first information according to the first voice command.

[0040] In other words, when a user opens the camera app using voice control and enters a specific shooting mode, they can add instructions to the voice commands to indicate their desired subject. The electronic device can then directly determine the desired subject based on the voice command, eliminating the need for further user input. This allows the electronic device to rotate the gimbal camera earlier to locate the desired subject.

[0041] In some embodiments, the first information further indicates a second target object, and the method further includes: automatically performing a shooting operation after the second target object appears in the preview interface to obtain a second wonderful photo including the second target object.

[0042] In other words, the electronic device can determine multiple desired subjects based on a single user input. During the gimbal rotation, once a desired subject appears, the device automatically captures the image. This allows users to obtain multiple photos with different content at once, satisfying their personalized needs.

[0043] In some embodiments, the method further includes: stopping the rotation of the gimbal and turning off the gimbal camera after the rotation time of the gimbal reaches a preset maximum scanning time. The maximum scanning time can be preset by the developer (which cannot be changed by the user), or it can be set by the user according to their own needs (which the user can change).

[0044] In some embodiments, after automatically performing the shooting operation, the method further includes: stopping the gimbal rotation and turning off the gimbal camera after the number of photos taken has reached a preset maximum value; the photos taken are those automatically captured by the gimbal camera based on the first information. The maximum number of photos taken can be preset by the developer or set by the user according to their own needs.

[0045] In this way, electronic devices will not rotate the gimbal camera indefinitely to find the subject the user wants to shoot and capture photos, which helps to save power and extend battery life.

[0046] In some embodiments, before automatically performing the shooting operation, the method further includes: adjusting the attitude and / or focal length of the gimbal camera so that the position of the first target object within the field of view matches a preset composition template.

[0047] In this way, the photos users receive not only include the subjects they expect to photograph, but also high-quality photos with compositions that meet aesthetic standards, thus better meeting users' shooting needs and enhancing their shooting experience.

[0048] In some embodiments, rotating the gimbal includes rotating the device gimbal along a pre-set track.

[0049] In some embodiments, rotating the gimbal includes rotating the gimbal toward an area where objects are densely distributed in the current image. This makes the rotation of the gimbal camera more flexible. The electronic device can find the subject the user wants to capture more quickly.

[0050] In some embodiments, after receiving the first information input by the user, the method further includes: displaying prompt information in the preview interface, the prompt information being related to the first information. In this way, the user can determine the currently set desired shooting object at any time through the aforementioned prompt information.

[0051] In some embodiments, the first highlight photo is a still photo composed of a single frame or a moving photo composed of multiple frames.

[0052] Fourthly, this application provides a shooting method applied to an electronic device. The method includes: in a sixth shooting mode, turning on a gimbal camera and displaying an image captured by the gimbal camera in a preview interface; detecting a first user operation, and in response to the first user operation, performing a first shooting operation to obtain a first photo, the first photo including a first object; changing the position of the first object within the framing range, and automatically performing a second shooting operation to obtain a second photo including the first object.

[0053] Implementing the method provided in the second aspect, in a specific shooting mode (i.e., the sixth shooting mode, another specific shooting mode in the third shooting mode involving the gimbal camera), after the user manually takes a photo, the electronic device can recompose and automatically capture a new photo containing content of interest to the user for selection.

[0054] In some embodiments, the method further includes: determining a subject of interest to the user (i.e., a desired subject) based on previously taken photos, wherein the first subject is the subject of interest to the user.

[0055] In other embodiments, the first object is the object closest to the center point of the first photograph. In this case, the electronic device can determine the user's desired subject in real time based on the current framing.

[0056] In other embodiments, before detecting the first user action, the method further includes detecting a second user action on a preview window in the preview interface, the second user action corresponding to the first object. The electronic device can also determine the user's desired subject based on the most recent touch operation on the preview image.

[0057] Changing the position of the first object within the frame includes: rotating the gimbal and / or adjusting the focal length of the gimbal camera. This allows the electronic device to more flexibly adjust the position of the first object within the frame.

[0058] In some embodiments, the adjusted position of the first object within the frame matches a preset composition template. Thus, even users with limited shooting skills can still capture aesthetically pleasing photos using this feature, satisfying their shooting and sharing needs.

[0059] In some embodiments, the method further includes: receiving a second voice command input by the user, and in response to the second voice command, opening the camera application and entering the sixth shooting mode. That is, the user can control the electronic device to open the camera application and directly enter the specific sixth shooting mode through a voice command to implement the above shooting method.

[0060] In some embodiments, the second photograph is a still photograph composed of a single frame or a moving photograph composed of multiple frames.

[0061] Fifthly, this application provides a shooting method applied to an electronic device. The method includes: in a seventh shooting mode, deploying a gimbal and displaying a third preview interface; the third preview interface includes a first preview window and a second preview window, the first preview window displaying an image captured by a first camera, and the second preview window displaying an image captured by a second camera, the first camera being mounted on the gimbal and the second camera being mounted on the back panel of the electronic device; detecting an operation on a third object in the third preview interface, and the first camera tracking the third object; detecting a user operation to start recording at a first moment, detecting a user operation to end recording at a second moment, and recording the images captured by the first and second cameras between the first and second moments.

[0062] By implementing the method provided in the first aspect, the electronic device can simultaneously activate both the rear-panel camera and the gimbal camera for multi-channel shooting. During shooting, the electronic device can also configure the gimbal camera to track a specific object. Based on the stable tracking capability provided by the gimbal's rotation, the electronic device can capture multi-channel video with significant parallax and rich content, even in scenarios where user hand-held movement is not required.

[0063] In some embodiments, the focal length of the first camera is longer than that of the second camera. That is, the focal length of the gimbal camera is longer than that of the rear-panel camera. In this case, the gimbal camera can be used to record close-up video, while the rear-panel camera can be used to record panoramic video. In this way, the electronic device can meet the user's need to simultaneously focus on both panoramic and close-up views.

[0064] In some embodiments, during recording, the method further includes: detecting an operation on a second object in a third preview interface, and the first camera tracking the second object. That is, during recording, the electronic device allows the user to switch the tracked object at any time to meet the user's personalized shooting needs.

[0065] In some embodiments, the method further includes: activating the first camera and displaying a second preview interface, the second preview interface including a third preview window displaying an image captured by the first camera, the first camera and the gimbal being folded and stored in the back panel of the electronic device; detecting an operation to select a shooting mode, entering a seventh shooting mode, and activating the second camera. That is, before entering the seventh shooting mode, when the gimbal rotation is not required, the electronic device can use the camera mounted on the gimbal without unfolding it; after entering the seventh shooting mode, the electronic device unfolds the gimbal only when rotation is required. In this way, the electronic device can reduce the number of times the gimbal is unfolded and folded, thus reducing power consumption.

[0066] In some embodiments, the method further includes: activating the second camera and displaying a second preview interface, the second preview interface including a third preview window displaying an image captured by the second camera; detecting an operation to select a shooting mode, entering a seventh shooting mode, and activating the first camera. That is, in a scenario where a rear-panel camera is being used, after entering the seventh shooting mode, the electronic device can automatically deploy the gimbal and activate the gimbal camera, so that the user can quickly use the gimbal and the gimbal camera.

[0067] In some embodiments, recording images captured by the first camera and the second camera between a first moment and a second moment includes: recording a first close-up video from the first camera between the first moment and the second moment, and recording images captured by the second camera between the first moment and the second moment to obtain a first panoramic video.

[0068] In some embodiments, the method further includes: displaying a first close-up video and a first panoramic video separately in a gallery application. That is, the electronic device can record images in different preview windows to obtain multiple independent videos, and display each video independently in the gallery so that the user can use each video later.

[0069] In some embodiments, the method further includes: processing a first close-up video and a first panoramic video using a first template to obtain a second video, and displaying the second video in a gallery application, wherein the first template is one selected by the user from a plurality of video clip templates.

[0070] This allows users to immediately specify an editing template after recording ends. The electronic device can then process the previously recorded close-up and panoramic videos according to the user-specified template, resulting in a edited video. Users can quickly obtain cinematic-quality videos that combine panoramic and close-up shots.

[0071] In some embodiments, before entering the seventh shooting mode, the zoom magnification range supported by the electronic device is a first range; after entering the seventh shooting mode, the zoom magnification range supported by the electronic device is a second range; the first range covers the second range. The first range is the set of zoom magnification ranges for all cameras installed on the electronic device, and the second range is the zoom magnification range for the first camera.

[0072] In this way, after the gimbal is deployed, the electronic device can stop the function of switching cameras by adjusting the zoom level, thus avoiding switching to other cameras and wasting gimbal resources.

[0073] In some embodiments, the method further includes: receiving a third voice command input by the user, and in response to the third voice command, opening a camera application, entering a seventh shooting mode, and opening the first and second cameras. That is, users can control the electronic device to open the camera application and directly enter a specific shooting mode via voice commands, saving user operations and improving the shooting experience.

[0074] In some embodiments, the first preview window and the second preview window are in a picture-in-picture style, with the area of ​​the first preview window being smaller than that of the second preview window. This allows users to more easily select and switch tracking objects within a larger panoramic image.

[0075] In some embodiments, the method further includes: detecting an operation on a first preview window, displaying an image captured by a second camera in the first preview window, and displaying an image captured by the first camera in a second preview window. That is, the electronic device also supports users switching the image content in different preview windows, satisfying users' personalized preview needs anytime, anywhere.

[0076] In a sixth aspect, this application provides an electronic device including one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store a computer program, which, when the one or more processors execute the computer program, causes the electronic device to perform a method as described in the first aspect and any possible implementation thereof, or to perform a method as described in the second aspect and any possible implementation thereof, or to perform a method as described in the third aspect and any possible implementation thereof, or to perform a method as described in the fourth aspect and any possible implementation thereof.

[0077] In a seventh aspect, embodiments of this application provide a chip system applied to an electronic device. The chip system includes one or more processors, which are configured to invoke computer instructions to cause the electronic device to perform a method as described in the first aspect and any possible implementation thereof, or to perform a method as described in the second aspect and any possible implementation thereof, or to perform a method as described in the third aspect and any possible implementation thereof, or to perform a method as described in the fourth aspect and any possible implementation thereof.

[0078] Eighthly, this application provides a computer-readable storage medium including a computer program that, when the computer program is run on an electronic device, causes the electronic device to perform the method described in the first aspect and any possible implementation thereof, or to perform the method described in the second aspect and any possible implementation thereof, or to perform the method described in the third aspect and any possible implementation thereof, or to perform the method described in the fourth aspect and any possible implementation thereof.

[0079] Ninthly, this application provides a computer program product containing instructions that, when the computer program product is run on an electronic device, causes the electronic device to perform the method described in the first aspect and any possible implementation thereof, or to perform the method described in the second aspect and any possible implementation thereof, or to perform the method described in the third aspect and any possible implementation thereof, or to perform the method described in the fourth aspect and any possible implementation thereof.

[0080] Understandably, the electronic device provided in the sixth aspect, the chip system provided in the seventh aspect, the computer storage medium provided in the eighth aspect, and the computer program product provided in the ninth aspect are all used to execute the method provided in this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description

[0081] Figure 1 This is a schematic diagram of a mobile phone back panel provided in an embodiment of this application;

[0082] Figure 2 This is a schematic diagram of the framing range of a rear camera provided in an embodiment of this application;

[0083] Figure 3 This is a schematic diagram of a mobile phone structure equipped with a gimbal camera, provided in an embodiment of this application;

[0084] Figure 4This is a flowchart illustrating a shooting method based on a gimbal camera provided in an embodiment of this application;

[0085] Figures 5A-5H These are schematic diagrams of a set of user interfaces provided in the embodiments of this application;

[0086] Figures 6A-6G These are schematic diagrams of a set of user interfaces provided in the embodiments of this application;

[0087] Figure 7 This is a flowchart illustrating a shooting method based on a gimbal camera provided in an embodiment of this application;

[0088] Figures 8A-8C This is another set of user interface diagrams provided in the embodiments of this application;

[0089] Figure 9 This is a set of preset track schematic diagrams provided in the embodiments of this application;

[0090] Figure 10 This is a schematic diagram illustrating the adjustment of the attitude and / or focal length of the gimbal camera provided in an embodiment of this application;

[0091] Figure 11 This is a schematic diagram of a shooting scene provided in an embodiment of this application;

[0092] Figure 12 This is a flowchart of another shooting method based on a gimbal camera provided in an embodiment of this application;

[0093] Figures 13A-13E This is another set of user interface diagrams provided in the embodiments of this application;

[0094] Figure 14 This is a flowchart of a shooting method based on a backplane camera and a gimbal camera provided in an embodiment of this application;

[0095] Figures 15A-15F This is another set of user interface diagrams provided in the embodiments of this application;

[0096] Figure 16 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0097] Figure 17 This is a timing diagram of the unfolding and folding gimbal of the electronic device provided in the embodiments of this application. Detailed Implementation

[0098] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be a limitation of this application.

[0099] A mobile phone includes a front-facing camera and a rear-facing camera. The rear-facing camera typically comprises multiple lenses, such as a wide-angle lens, an ultra-wide-angle lens, a telephoto lens, and a macro lens. These multiple lenses are fixedly mounted on the back panel of the phone. Therefore, the rear-facing camera is often also referred to as the back panel camera.

[0100] Figure 1 This is a schematic diagram of a mobile phone back panel provided in an embodiment of this application.

[0101] like Figure 1 As shown, a camera module 11 is provided on the back panel of the mobile phone. The camera module 11 is the rear camera. The camera module 11 includes multiple cameras, such as cameras 12-14, and a flash 15. For example, camera 12 can be a wide-angle camera (wide-angle cameras are also commonly referred to as main cameras), camera 13 can be an ultra-wide-angle camera, and camera 14 can be a telephoto camera. It is understood that the arrangement of cameras varies on different mobile phones, and this application embodiment does not limit this arrangement.

[0102] Figure 2 This is a schematic diagram of the framing range of a rear camera provided in an embodiment of this application.

[0103] In this diagram, A1 represents the optical axis of camera 12 (wide-angle camera), A2 represents the optical axis of camera 13 (ultra-wide-angle camera), and A3 represents the optical axis of camera 14 (telephoto camera); S1 represents the field of view of camera 12 (wide-angle camera), S2 represents the field of view of camera 13 (ultra-wide-angle camera), and S3 represents the field of view of camera 14 (telephoto camera). The field of view can refer to the area of ​​the scene that the lens can capture. It can also refer to the image field: the image field refers to the area of ​​sharp image formed by the lens on the focal plane.

[0104] like Figure 2 As shown, because the rear cameras are fixedly mounted on the back of the phone, their optical axes are parallel and their optical centers are close together. The difference in the field of view (i.e., parallax) between different cameras is small. Therefore, even when switching between different cameras, the phone struggles to capture videos with large parallax and flexible perspectives. Especially in scenarios involving tracking a target object, the limited field of view causes the phone to frequently lose track of the object, affecting the user's shooting experience.

[0105] Therefore, firstly, this application provides a mobile phone equipped with a gimbal camera.

[0106] Figure 3 This is a schematic diagram of a mobile phone structure equipped with a gimbal camera, provided in an embodiment of this application.

[0107] like Figure 3As shown, mobile phone 10 is a mobile phone equipped with a gimbal camera. A fixing component 22 is provided on the back panel 21 of mobile phone 10. One end of an arm 23 is coupled to the fixing component 22, and a camera 31 is mounted on the other end. Multiple rotors, such as rotors 231, 232, 233, and 234, are provided on the arm 23. The movable support structure composed of the fixing component 22 and the arm 23 with multiple rotors is called a gimbal. The camera mounted on the gimbal (e.g., camera 31) is the gimbal camera.

[0108] The mobile phone 10 can unfold or de-fold the gimbal based on user operation. Upon detecting a user operation to unfold the gimbal, the mobile phone 10 can rotate the rotor to unfold the arm 23 stored in the back plate 21. Then, by rotating one or more rotors on the gimbal, the mobile phone 10 can control the camera 31 to align with any plane in three-dimensional space, capturing images of the corresponding plane, thus meeting the user's need for shooting videos with large parallax and flexible viewing angles. Upon detecting a user operation to de-fold the gimbal, the mobile phone 10 can rotate the rotor to fold the arm 23, causing the arm 23 and camera 31 to retract back into the back plate 21. The back plate 21 has a storage slot 29, with the opening of the slot facing away from the display screen and the bottom wall of the slot located near the display screen; alternatively, the slot may be recessed towards the display screen. The aforementioned retraction of the arm 23 and camera 31 into the back plate 21 refers to the mobile phone 10 storing the arm 23 and camera 31 into the storage slot 29 of the back plate 21. When the arm 23 and camera 31 are retracted into the storage slot 29 of the back plate 21, at least a portion of the camera 31 is located on the side of the plane of the back plate 21 facing away from the display screen. That is, when the camera 31 is retracted into the back plate 21, the camera 31 may be partially recessed into / protruding from the plane of the back plate 21, or it may be flush with the plane of the back plate 21.

[0109] like Figure 3 As shown, the state in which arm 23 is folded and the camera 31 is retracted into the back plate 21 is called the retracted state; the state in which arm 23 is unfolded and the camera 31 is positioned above the top edge of the phone is called the unfolded state. In this embodiment, the gimbal camera can operate in either the unfolded state or the retracted state.

[0110] like Figure 3 As shown, a camera (e.g., camera 31) is mounted on the gimbal of the mobile phone 10. Preferably, this camera is a wide-angle camera (main camera). In this case, camera 32 mounted on the back panel 14 can be an ultra-wide-angle camera, and camera 33 can be a telephoto camera. It is understood that more cameras can be mounted on the gimbal, and more or fewer cameras can be mounted on the back panel. This application embodiment does not limit the number and type of gimbal cameras and back panel cameras.

[0111] For the mobile phone 10 equipped with a gimbal camera, this application provides a shooting method based on the gimbal camera. Figure 4 This is a flowchart of a shooting method based on a gimbal camera provided in an embodiment of this application.

[0112] S101. Launch the camera application, enter the photo mode, and use the gimbal main camera to capture images in the retracted state.

[0113] The phone 10 has a camera app installed for taking pictures. Upon detecting a user interaction with the camera app icon (such as a tap), the phone 10 can launch the camera app. By default, the camera app first activates the main camera, also known as the wide-angle camera, enters shooting mode, and displays the photo preview interface.

[0114] Figure 5A This is a schematic diagram of the desktop of the mobile phone 10 provided in this application embodiment. For example... Figure 5A As shown, the home screen of the phone can display multiple application icons, such as the Gallery app icon, Weather app icon, and Camera app icon. (Reference) Figure 5B When a user needs to take a photo, they can tap the camera app icon to instruct the phone 10 to launch the camera app and take a picture. In response to this user action, the phone 10 launches the camera app. By default, when launching the camera app, the phone 10 activates its main camera and enters the first shooting mode. Figure 5C The image captured by the main camera is displayed in the photo preview interface (first preview interface).

[0115] Optionally, users can also wake up the smart assistant by using a voice wake-up word (such as "Hey, YOYO") or a specific pre-action (such as raising a hand or a touch gesture), input voice commands to the smart assistant (such as "Open camera"), and then quickly launch the camera application and enter the photo mode through the smart assistant.

[0116] In this embodiment, when the main camera is mounted on the gimbal, by default, the phone 10 keeps the gimbal folded when the main camera (first camera) is activated, i.e., the gimbal is not unfolded. The phone 10 uses the gimbal's main camera to capture images in the retracted state.

[0117] S102: User operation on the PTZ control is detected, the PTZ is expanded, and the PTZ control panel is displayed.

[0118] like Figure 5C As shown, the photo preview interface includes a gimbal control 331 (first control). The gimbal control 331 can be used to control the unfolding or folding of the gimbal. Figure 5CIn the scenario shown (i.e., using the gimbal's main camera in the retracted state), after detecting a user operation on the gimbal control 331, the phone 10 can unfold the gimbal in response to the user operation, continuing to use the gimbal's main camera to capture images in the unfolded state. Understandably, during the unfolding process, as the gimbal moves, the spatial position of the main camera changes, and correspondingly, the field of view of the main camera also changes, and the image captured by the gimbal's main camera in the preview window 315 also changes accordingly. Optionally, the phone 10 can also display a transition animation during the unfolding process.

[0119] refer to Figure 5D In response to the user's actions described above, the mobile phone 10 will also display the gimbal control panel 332. Preferably, the gimbal control panel 332 is a semi-transparent control panel to avoid obstruction.

[0120] like Figure 5D As shown, the gimbal control panel 332 includes a joystick 341. Users can control the gimbal to rotate up / down / left / right by sliding the joystick 341, increasing the framing range and thus meeting the user's flexible shooting needs. Up / down rotation changes the pitch angle and can be achieved through rotors 233 and / or 234; left / right rotation changes the yaw angle and can be achieved through rotor 231.

[0121] Optionally, the PTZ control panel 332 also includes a "stabilization mode" control, a "tracking" control, a "lock" control, and a "horizontal / vertical switching" control.

[0122] The "Stabilization Mode" control is used to set the gimbal's stabilization mode, such as Optical Image Stabilization (OIS) mode, Pitch Lock mode, and First Person View (FPV) mode. In OIS mode, the phone 10 compensates for hand shake by physically moving the gimbal camera; in Pitch Lock mode, the phone 10 fixes the gimbal's pitch axis, preventing the gimbal camera from changing its pitch angle with the phone's rotation; in FPV mode, the phone 10 sets the gimbal camera to completely follow the direction of the phone's rotation.

[0123] The "Tracking" control is used to set tracking modes, such as click tracking, first-shot tracking, pre-composed tracking, and Selfie tracking. Click tracking determines the target object to be tracked based on the user's click action; first-shot tracking tracks the first identified object; pre-composed tracking predicts the target object's trajectory and always captures the target object according to a pre-set composition. Gimbal tracking involves rotating the gimbal rotor to keep the gimbal camera's optical axis pointing towards the target object, ensuring the target object remains within the gimbal camera's field of view, allowing the user to continuously observe the target object in the gimbal camera's image stream.

[0124] The "Lock" control is used to lock the pitch and yaw.

[0125] The "Horizontal / Portrait Switch" control is used to set the landscape / portrait aspect ratio. The phone can adjust the gimbal camera's roll angle based on the user-defined landscape / portrait aspect ratio to achieve the desired landscape / portrait style.

[0126] like Figure 5D As shown, the photo preview interface also includes a switching control 334. In this embodiment, before the gimbal is deployed, the switching control 334 can be used to switch between the front and rear cameras. Here, the rear camera includes a back panel camera fixed to the back panel and a gimbal camera mounted on the gimbal. After the gimbal is deployed, the switching control 334 can be used to control the gimbal to rotate 180° around the yaw axis. In some embodiments, the switching control 334 can also be used to control the gimbal to rotate around the yaw axis, so that the gimbal camera faces the display screen. Optionally, after the gimbal camera faces the display screen and a human image is detected, the mobile phone 10 can mirror the image captured by the gimbal camera, effectively making it equivalent to the front camera, for the user to take a selfie.

[0127] Optionally, after the gimbal is deployed, the phone can update the zoom bar (secondary control) to shrink or shrink the zoom range. For example... Figure 5C As shown, before the gimbal is deployed (i.e., in the retracted state), the zoom range of the phone 10 is 0.6-15x (the first range, where 0.6-1x is provided by the ultra-wide-angle camera, 1-10x by the wide-angle camera, and 10-15x by the telephoto camera); as Figure 5DAs shown, after the gimbal is deployed, the zoom range of the phone 10 can be updated to 1-10x (the second range, entirely provided by the wide-angle camera). That is, after the gimbal is deployed, the phone 10 no longer supports users switching cameras via the zoom bar. This is because, in the deployed state, the optical axis of the gimbal's main camera is far from the optical axes of other rear camera lenses. Switching between the gimbal camera and the rear camera would result in a certain degree of image jump, affecting the user's viewing experience. On the other hand, switching the rear camera after the gimbal is deployed would waste gimbal resources, which does not meet the requirements of energy saving and consumption reduction. After the gimbal is deployed, the phone 10 no longer supports users switching cameras via the zoom bar, which improves the user experience and avoids resource waste. In this way, while ensuring shooting quality, the operation process is simplified, allowing users to focus more on the current shooting task.

[0128] S103, switch shooting modes and update the gimbal control panel.

[0129] Optionally, in the unfolded state, the mobile phone 10 can detect user operations that switch shooting modes. In response to the aforementioned user operations, the mobile phone 10 can switch shooting modes and update the gimbal control panel according to the switched shooting mode. Specifically, the mobile phone 10 can add or delete one or more function controls in the gimbal control panel (enable / deactivate the function corresponding to the control) according to the switched shooting mode.

[0130] refer to Figure 5D The mobile phone 10 can detect user interaction with the "Record" control in the mode bar 311. In response to this user interaction, the mobile phone 10 can switch to recording mode (second shooting mode). (See reference) Figure 5E After switching to recording mode, the PTZ control panel 332 can add a "Roll" control and a "Record Mode" control. The "Roll" control can be used to control the PTZ camera to roll (rotate around the roll axis). The "Record Mode" control can be used to set the recording mode, such as directional recording or omnidirectional recording.

[0131] The mode bar 311 also includes a "More" control. Upon detecting user interaction with the "More" control, the phone 10 can display multiple mode controls not shown in the mode bar 311. Each mode control corresponds to a shooting mode. (Reference) Figures 5F-5GUpon detecting user interaction with the "More" control, the phone 10 can display controls for "Slow Motion," "Panorama," and "Time-lapse." The "Slow Motion" control corresponds to slow motion mode, used for shooting slow-motion videos. The "Panorama" control corresponds to panorama mode, used for shooting panoramic photos. The "Time-lapse" control corresponds to time-lapse mode, used for shooting time-lapse videos. The "Macro" control corresponds to macro mode: using the macro camera to shoot macro photos. The "Multi-camera Simultaneous Recording" control corresponds to multi-camera simultaneous recording mode: using multiple cameras to shoot videos simultaneously. The "Document Scan" control corresponds to document scanning control: using the macro camera to scan and input a document. The "Auto Composition" control corresponds to auto composition mode: rotating the gimbal camera to scan three-dimensional space, finding a subject of interest for the user, composing the shot, and automatically capturing the subject. The "Dual Capture" control corresponds to dual capture mode: after taking a photo based on user input, automatically rotating the gimbal to recompose the shot and automatically capturing the subject of interest. Upon detecting user interaction with any of the above controls, the phone 10 can switch to the corresponding shooting mode. Similarly, after switching shooting modes, the phone can add or remove function controls in the gimbal control panel according to the new shooting mode, which will not be elaborated here.

[0132] The shooting modes provided by mobile phone 10 include gimbal-supported mode and non-gimbal mode. Gimbal-supported mode refers to a shooting mode that uses a gimbal camera to complete the shot; non-gimbal mode refers to a shooting mode that uses a specific rear camera to complete the shot. For example, in mode bar 311 and... Figure 5G Of the many shooting modes shown, the macro mode and document scanning mode, which use a rear-panel macro camera, are non-gimbal-mounted cameras. The other shooting modes are gimbal-supported modes.

[0133] like Figure 5G As shown, in the expanded state, in response to user interaction with the "More" control, the phone 10 can set the mode controls corresponding to the non-gimbal mode ("Macro" control and "Document Scan" control) to be unselectable, thereby preventing the user from selecting the non-gimbal mode, switching cameras, and leaving the gimbal idle. The phone 10 can indicate which mode controls are unselectable by using a strikethrough or graying out. (Reference) Figure 5H In some embodiments, the mobile phone 10 may also directly not display the mode controls corresponding to non-gimbal modes, such as not displaying the "macro" control and the "document scanning" control. It is understood that before deploying the gimbal, in other gimbal-supported modes (such as portrait mode and night mode), the mobile phone 10 may also display the gimbal control 331 for the user to deploy the gimbal; in non-gimbal modes (such as macro mode and document scanning mode), the mobile phone 10 does not display the gimbal control 331.

[0134] Not limited to video recording mode, after the gimbal is deployed, the phone can also switch to other gimbal-supported modes according to user operation, such as night mode and automatic composition mode. These will not be listed here.

[0135] Table 1 is a schematic table of gimbal function classification provided in the embodiments of this application.

[0136] Table 1

[0137]

[0138] As shown in Table 1, gimbal functions can be divided into basic functions and extended functions. For any gimbal support mode, mobile phone 10 can provide all basic functions, and one or more extended functions suitable for the current mode. Figures 5C-5D As shown, in photo mode, the phone 10 may not provide the scrolling function and the function to set the audio mode. Specifically, in photo mode, the phone 10 may only provide the click tracking function and selfie tracking function from the tracking function, but not the first-entry tracking and pre-composition tracking functions. For example, in night mode, the phone 10 may not provide the tracking function and the scrolling function. Developers can configure extended functions for different shooting modes based on experience, and this application embodiment does not impose any limitations on this.

[0139] Understandably, after the gimbal is deployed, the Phone 10 can also disable some functions that do not contribute to or affect the normal operation of the gimbal camera, in order to improve the user experience and reduce power consumption. For example, after the gimbal is deployed, the Phone 10 can disable the flash function (i.e., turn off the flash and restrict the user from using the flash), disable the capture function (including automatic capture without user shooting, assisted capture and anti-flicker capture, etc., which require user shooting), disable the intelligent shooting function involving camera switching, document scanning function, and object recognition function, etc.

[0140] S104. Record video.

[0141] refer to Figure 6A In video recording mode, after the gimbal is deployed, the mobile phone 10 can detect user operation on the shutter control 321. In response to this user operation, the mobile phone 10 begins recording. (Reference) Figures 6B-6C During recording, users can rotate the gimbal to adjust the field of view of the gimbal camera using the joystick 341 in the gimbal control panel 332, and / or update the shooting parameters of the gimbal camera using other controls (such as switching the tracking object, setting the roll camera movement, etc.).

[0142] refer to Figures 6D-6EUpon detecting another operation on the shutter control 321, the mobile phone 10 stops recording and displays a frame in the playback control 336 to indicate the previously recorded video for the user to browse.

[0143] S105, User operation on the gimbal control detected, fold the gimbal.

[0144] refer to Figure 6F After use, the user can click the gimbal control 331 again. In response to this user action, the rotor on the rotating arm 23 of the phone 10 folds the gimbal. (Reference) Figure 6G During the folding process, the phone 10 can keep its gimbal camera on and continue to capture images using the gimbal camera. At the same time, the phone 10 can stop displaying the gimbal control panel 332.

[0145] In a scenario where the gimbal is deployed, the phone 10 can also detect user actions such as exiting the camera app, like swiping up to return to the home screen. The camera app then switches to background operation. In response to this user action, the phone 10 rotates the rotor on the arm 23, folding the gimbal. Furthermore, the phone 10 can turn off the gimbal camera to reduce power consumption.

[0146] In some embodiments, after exiting the camera app and switching it to background operation, the phone 10 can continue to keep the gimbal deployed. After exiting for a first duration (e.g., 1 minute), or after detecting that the camera app has stopped running (killed), the phone 10 then folds the gimbal and turns off the gimbal camera to prevent the user from repeatedly folding and unfolding the camera app again in a short period of time, which would increase power consumption and affect the user experience. The shutdown includes shutdown triggered by the user manually closing the camera app and shutdown triggered by low battery / overheating.

[0147] In some embodiments, the mobile phone 10 can be connected to wearable devices such as watches. In this case, upon detecting user interaction with the gimbal control and unfolding the gimbal, the wearable device can also display the gimbal control panel. Users can also control the rotation of the mobile phone 10's gimbal by interacting with the gimbal control panel on the wearable device, thereby capturing images that meet their needs.

[0148] By implementing the above method, users can choose whether to deploy the gimbal when using the pan-tilt camera. When the gimbal is not needed, users can keep it retracted in the back panel and only use the pan-tilt camera to capture images. When it is necessary to use the pan-tilt to change the framing, users can deploy the gimbal using the pan-tilt control 331, control the rotation of the gimbal through the pan-tilt control panel, adjust the framing of the pan-tilt camera, and thus shoot videos with large parallax and flexible viewing angles.

[0149] Figure 7This is a flowchart of a shooting method based on a gimbal camera provided in an embodiment of this application.

[0150] S201, Enter automatic composition mode.

[0151] refer to Figure 8A The mobile phone 10 can detect user operations on the "Auto-compose" control. In response to the aforementioned user operation, the mobile phone 10 enters the Auto-compose mode (fifth shooting mode) and displays the Auto-compose preview interface. It is understood that the Auto-compose mode is merely an example. In other embodiments, the Auto-compose mode described in this application may also be referred to as other modes, such as Auto-shooting mode, Scanning and Capture mode, etc., and this application does not limit it in this regard.

[0152] refer to Figure 8B In automatic composition mode, the phone 10 can stop displaying the gimbal control panel 332. Optionally, after stopping the display of the gimbal control panel 332, the phone 10 can also redisplay the gimbal control panel 332 after detecting a specific user operation (such as a swipe down operation at the top of the preview window 315) to allow the user to adjust the gimbal. The phone 10 can also stop displaying the gimbal controls 331 to prevent the user from retracting the gimbal in automatic composition mode, thus affecting the normal operation of automatic composition mode. In addition, the automatic composition preview interface also includes a voice control 313.

[0153] S202. Identify the target subject for photography.

[0154] refer to Figure 8B The mobile phone 10 can detect user operations on the voice control 313. (Reference) Figure 8C In response to the user's actions, the phone 10 can activate its microphone to collect sound signals and obtain the user's voice commands, such as: "Please take some photos of the party, especially photos of moments like raising a glass, playing games, singing together, laughing, and enjoying food." After the input is finished, the phone 10 can perform semantic analysis on the voice commands to obtain the target objects to be photographed, such as wine glasses, games, smiles, food, and singing.

[0155] Optionally, after detecting user operation on the voice control 313, the mobile phone 10 can also display a text input control. After detecting user operation on the text input control, the mobile phone 10 can display a keyboard. The mobile phone 10 can receive user input in the form of text / images through the keyboard, and then determine the target object to be photographed based on the input. Here, the target object to be photographed can also be called the target subject, which refers to the object that the electronic device determines needs to be photographed, and this application does not limit this.

[0156] Within a preset time period, even without receiving user input (voice / text / image, primary information), the phone 10 can still determine the target subject based on previously learned user shooting preferences. The phone 10 can identify frequently photographed objects through tags, such as people, cats, dogs, food, and flowers. Therefore, the phone 10 can determine the frequently photographed objects (i.e., the user's shooting preferences) as the target subject.

[0157] In desktop mode, the phone 10 can also receive user voice commands (first voice command). In response to the voice command, the phone 10 can launch the camera application, enter automatic framing mode, and determine the target subject from the voice command. At this time, the phone 10 can automatically deploy the gimbal without the user needing to click the gimbal control 331. Furthermore, after entering automatic framing mode, the phone 10 no longer needs to receive user input; it determines the target subject based on the user's input.

[0158] S203. Scan the three-dimensional space to find the target subject for photography.

[0159] After identifying the target subject, the mobile phone 10 can rotate its rotor to scan three-dimensional space along a preset track to find the target subject.

[0160] Figure 9 This is a schematic diagram of a set of preset tracks provided in the embodiments of this application. The black rectangle at the center of the sphere represents the gimbal camera. R1 to R5 are five preset tracks. Specifically, R1 is the track swept by the optical axis C when the gimbal camera rotates around the yaw axis when pitch = 0; R2 is the track swept by the optical axis C when the gimbal camera rotates around the yaw axis when pitch < 0 (top view); R3 is the track swept by the optical axis C when the gimbal camera rotates around the yaw axis when pitch > 0 (bottom view); R4 is the track swept by the optical axis C when the gimbal camera rotates around the pitch axis when yaw is fixed; and R5 is the track swept by the optical axis C when both yaw and pitch = 0 rotate simultaneously. Optionally, after scanning along track R1, the gimbal camera can also scan along track R2 and / or track R3 to expand the field of view of the gimbal camera, thereby finding a wider range of target objects.

[0161] Taking R1 as an example, the optical axis C of the gimbal camera is parallel to the plane formed by the roll / pitch axis of the horizontal coordinate system (i.e., the pitch angle θ of the gimbal camera is 0). In this posture, supported by arm 12, the gimbal camera can rotate around the yaw axis in a plane perpendicular to the yaw axis. The track R1 swept by the optical axis C is the scanning track of the gimbal camera. During scanning along R1, the gimbal camera can capture objects near R1, and the larger the field of view (FOV) of the gimbal camera, the more objects near R1 it can capture, i.e., the larger the framing range. The other tracks can refer to R1. The gimbal camera can also scan along R2, R3, R4, and R5 to expand the framing range of the gimbal camera. It is understood that this application embodiment does not limit the specific style and combination of scanning tracks. The mobile phone 10 can select one or more of the above tracks. After scanning along one track, the mobile phone 10 can control the gimbal camera to continue scanning along the next track, thereby expanding the field of view of the gimbal camera and searching for the target object over a wider area. Optionally, the mobile phone 10 may also have more or fewer preset tracks. This application embodiment does not impose any limitations on this.

[0162] In some embodiments, the gimbal can also rotate randomly. The mobile phone 10 can then locate the target object from the images captured by the gimbal camera during this random movement. In other embodiments, the mobile phone 10 can also identify the image currently reported by the gimbal camera and rotate the gimbal according to the distribution of objects in the image. For example, the mobile phone 10 can control the gimbal to rotate in a direction where objects are densely distributed.

[0163] S204. After identifying the target subject, adjust the gimbal camera posture and / or focal length to make the composition of the target subject within the frame conform to aesthetic standards, and automatically capture the adjusted image that conforms to aesthetic standards.

[0164] Figure 10 This is a schematic diagram illustrating the adjustment of the attitude and / or focal length of a gimbal camera according to an embodiment of this application.

[0165] like Figure 10As shown, during scanning at 1x (1×) focal length, when rotating to the first pose (α1, β1, γ1), the target object, such as a smiling girl (the first target object), appears in image F1 captured by the gimbal camera. This is because the target object is located in the lower right corner of the viewfinder, and the phone 10 can determine that the current position of the target object within the viewfinder does not match the preset composition template; that is, the composition of the current target object within the viewfinder does not meet aesthetic standards. Therefore, the phone 10 can adjust the pose and / or focal length of the gimbal camera. For example, the phone 10 can adjust the gimbal camera from the original first pose (α1, β1, γ1) to the second pose (α2, β2, γ2), so that the target object is located at the trisection point Point1 below the viewfinder, as referenced in image F2. Then, the phone 10 can perform a zoom operation on the gimbal camera, for example, switching from 1× focal length to 2x (2×) focal length. As shown in image F3, after zooming, the target subject within the field of view is centered horizontally and meets the optimal segmentation ratio vertically, and its composition conforms to aesthetic standards.

[0166] Therefore, the phone 10 can automatically capture the adjusted target image that meets aesthetic standards, such as F3 as mentioned above, generate a photo (the first great photo), and save it to local storage for the user to view at any time. Optionally, when generating a photo, the phone 10 can save only the target image frame to generate a still photo. Optionally, the phone 10 can also save the target image and multiple frames before and after the target image to generate a moving photo.

[0167] Preferably, the mobile phone 10 can learn composition templates suitable for different shooting subjects, and then select the composition template that best matches the current shooting subject according to different shooting subjects. Based on the above composition template, the posture and / or focal length of the gimbal camera are adjusted so that the composition of the target shooting subject in the field of view meets aesthetic standards.

[0168] S205. When the number of images captured equals M1, stop scanning and capturing images.

[0169] Mobile phone 10 can automatically capture a threshold value M1 (maximum value), where M1 is a positive integer. Developers can set the specific value of M1 based on experience. This application embodiment does not limit this. Optionally, for example, 10≤M1≤20. In other embodiments, mobile phone 10 can also receive user input and determine M1 based on the above input.

[0170] The initial value N for the number of captured images can be 0, where N is an integer. After each frame is captured, the number of captured images is incremented by 1. Then, the mobile phone 10 can identify whether the current number of captured images has reached M1. When the number of captured images reaches M1 (i.e., the number of captured images = M1), the mobile phone 10 immediately stops scanning and capturing images.

[0171] If the number of images captured has not reached M1 (i.e., the number of images captured < M1) and the current scanning time has not reached the preset maximum scanning time (i.e., no timeout), the mobile phone 10 can return to its original track position and continue scanning. For example, referring to Figure 6, in the second posture and 2× focal length, after capturing image F3, the gimbal camera can return to the first posture and 1× focal length, and then continue scanning the three-dimensional space to find other target objects.

[0172] Developers can set the maximum scan duration based on experience. Optionally, the maximum scan duration is 10 min ≤ maximum scan duration ≤ 20 min. In some embodiments, the mobile phone 10 can also receive user input and determine the maximum scan duration based on the user input. The scan duration can be a second duration, a duration set in the system, or a duration preset in the system; this application does not limit this.

[0173] If no target object is detected and no photo is taken, the phone 10 immediately stops scanning and taking pictures after the current scanning time reaches the maximum scanning time (i.e., timeout). Furthermore, the phone 10 can also exit the camera app and turn off the cameras (including the gimbal camera and other cameras mounted on the back panel) to save power.

[0174] With the automatic composition mode offered by the iPhone 10, users only need to pre-set some shooting requirements. The iPhone 10, placed in a fixed position, can automatically scan three-dimensional space to find and capture photos that meet the user's shooting needs. (Reference) Figure 11 The phone 10 can automatically rotate its gimbal camera to scan three-dimensional space, find and capture the content the user desires, such as people in motion (31-33), animals (34), etc. Thus, in multi-object scenarios such as sports, parties, and meetings, based on the above functions, users can immerse themselves in the activity and capture wonderful moments without having to hold the phone 10 and manually find the target subject or compose the shot, greatly enhancing the user's shooting experience.

[0175] Figure 12 This is a flowchart of another shooting method based on a gimbal camera provided in an embodiment of this application.

[0176] S301, Enter Double-Shot Mode.

[0177] refer to Figure 13AThe mobile phone 10 can detect user operations on the "Dual Shot" control. In response to the user operation, the mobile phone 10 enters the dual shot mode (sixth shooting mode) and displays the dual shot preview interface. It is understood that the dual shot mode is merely an example. In other embodiments, the dual shot mode described in this application may also be referred to as other modes, such as auxiliary shooting modes, etc., and this application does not limit this.

[0178] refer to Figure 13B In the dual-capture mode, the phone 10 can stop displaying the gimbal control 331 to prevent the user from retracting the gimbal in the dual-capture mode and affecting the normal operation of the dual-capture mode.

[0179] Similarly, in desktop mode, phone 10 can also receive user voice commands (second voice commands). In response to these voice commands, phone 10 can launch the camera application and enter dual-shot mode. At this time, phone 10 can automatically deploy the gimbal without the user needing to click the gimbal control 331.

[0180] S302. Rotate the gimbal to aim at the subject.

[0181] refer to Figures 13B-13C In dual-shot mode, users can rotate the gimbal using the joystick 341 on the gimbal control panel 332 to adjust the framing range of the gimbal camera, aiming it at the desired subject (e.g., a puppy). Users can also click on the subject (e.g., a puppy) to control the gimbal camera to aim at and track the subject. Users can also update the gimbal camera's shooting parameters using other controls on the gimbal control panel 332, such as switching stabilization modes, which will not be listed here.

[0182] S303: The user's shooting action is detected, the current image is captured, and the first photo is generated.

[0183] refer to Figure 13C The mobile phone 10 can detect user operation (first user operation) on the shutter control 321. In response to the above user operation, the mobile phone 10 can capture the image G1 currently displayed in the preview window 315 (first shooting operation) and generate a first photo. (See reference) Figure 13D Accordingly, the phone 10 can display a thumbnail of the first photo on the playback control 322.

[0184] S304. Determine the target subject in the first photo, adjust the gimbal camera posture and / or focal length to make the composition of the target subject within the frame conform to aesthetic standards, and automatically capture the adjusted image that conforms to aesthetic standards.

[0185] The phone 10 can also determine the target subject based on previously learned user shooting preferences. The phone 10 can identify frequently photographed objects (i.e., user shooting preferences) as target subjects. After obtaining the first photo, the phone 10 can recognize objects in the first photo and determine whether the first photo includes the target subject.

[0186] After identifying the target subject (e.g., a puppy, the first subject), the phone 10 adjusts the posture and / or focal length of the gimbal camera to match the position of the target subject within the frame with a preset composition template, ensuring the composition of the target subject within the frame conforms to aesthetic standards. Then, the phone 10 automatically captures the adjusted, aesthetically pleasing image of the target subject (the second shooting operation), generating a second photo. For details on how the phone 10 adjusts the posture and / or focal length of the gimbal camera to ensure the composition of the target subject within the frame conforms to aesthetic standards, please refer to [link to relevant documentation]. Figure 10 This will not be elaborated upon here.

[0187] refer to Figure 13E After obtaining the target image G2 that meets aesthetic standards, the mobile phone 10 can perform an automatic shooting operation to generate a second photo. Accordingly, the mobile phone 10 can display a thumbnail of the second photo on the playback control 322, and use the thumbnail to indicate to the user that the mobile phone 10 has performed an automatic capture operation.

[0188] In some embodiments, after obtaining the first photo, the mobile phone 10 can further determine the target subject based on the area ratio of the object in the first photo and the distance between the object and the center point. For example, the mobile phone 10 can determine the object with the largest area ratio in the first photo as the target subject. Alternatively, the mobile phone 10 can also determine the object closest to the center point in the first photo as the target subject. In some embodiments, the mobile phone 10 can also determine the object as the target subject based on a focusing operation (second user operation) on an object in the preview image (e.g., the puppy mentioned above). Then, the mobile phone 10 can also adjust the posture and / or focal length of the gimbal camera to make the composition of the target subject within the framing range conform to aesthetic standards, and then perform an automatic capture operation to generate a second photo.

[0189] With the "One Shot, Two Shots" mode offered by the iPhone 10, after a user manually takes a photo, the phone can recompose the shot and capture a new photo containing content of interest to the user. This allows users with limited shooting skills to take aesthetically pleasing photos, satisfying their needs for shooting and sharing.

[0190] Figure 14 This is a flowchart of a shooting method based on a backplane camera and a gimbal camera provided in an embodiment of this application.

[0191] S401. Enter multi-camera simultaneous recording mode and turn on the rear camera.

[0192] refer to Figure 15A The mobile phone 10 can detect user operations on the "Multi-camera Simultaneous Recording" control. In response to the user operation, the mobile phone 10 enters the multi-camera simultaneous recording mode (seventh shooting mode) and displays the multi-camera simultaneous recording preview interface (third preview interface). It is understood that the multi-camera simultaneous recording mode is merely an example. In other embodiments, the multi-camera simultaneous recording mode described in this application may also be referred to as other modes, such as the dual-camera simultaneous recording mode, etc., and this application does not limit it in this regard.

[0193] When entering multi-camera recording mode, the phone can activate another rear camera with a field of view larger than the gimbal camera, such as an ultra-wide-angle camera.

[0194] refer to Figure 15B The phone can display a preview interface for simultaneous recording with multiple cameras. For example... Figure 15B As shown, the multi-camera simultaneous recording preview interface may include a large preview window 315 (second preview window) and an embedded small preview window 316 (first preview window). The mobile phone 10 can display the panoramic image captured by the camera with a large field of view (i.e., the ultra-wide-angle lens on the back panel, the second camera) in the large preview window 315, and display the close-up image captured by the camera with a small field of view (the wide-angle lens on the gimbal, the first camera) in the small preview window 316.

[0195] Similarly, after entering multi-camera simultaneous recording mode, the phone 10 can stop displaying the gimbal control panel 332 to avoid obstruction. Optionally, after stopping the display of the gimbal control panel 332, the phone 10 can also redisplay the gimbal control panel 332 after detecting a specific user operation, allowing the user to adjust the gimbal. The phone 10 can also stop displaying the gimbal controls 331 to prevent the user from retracting the gimbal in automatic composition mode, thus affecting the normal operation of automatic composition mode.

[0196] Similarly, in desktop mode, phone 10 can also receive user voice commands (third voice commands). In response to these voice commands, phone 10 can launch the camera application and enter multi-camera simultaneous recording mode. At this time, phone 10 can automatically deploy the gimbal, eliminating the need for the user to click the gimbal control 331.

[0197] S402. Rotate the gimbal to point the gimbal camera at the target object selected by the user and track the target object.

[0198] When entering multi-camera simultaneous recording mode, by default, the optical axis of the gimbal camera is parallel to the optical axis of the rear camera. After detecting a touch operation on the screen, the phone 10 can set the object corresponding to the touch operation as the target object, rotate the gimbal, and aim the gimbal camera at the target object to track it.

[0199] refer to Figure 15C The mobile phone 10 can detect a tap operation on the screen. In response to this operation, the mobile phone 10 can set the object T1 (the third object) corresponding to the operation as the target object. Then, the mobile phone 10 can rotate the gimbal to point the gimbal camera at object T1 and track object T1. (Reference) Figure 15D The small preview window 316 can always display a close-up image centered on object T1, meeting the user's need to monitor object T1 anytime, anywhere. Furthermore, based on the gimbal's rotation and tilt capabilities, the telephoto camera on the gimbal can continuously track object T1. Users don't need to worry about losing the object. Understandably, a rear-panel camera not on the gimbal, unable to rotate or tilt, would face the possibility of losing object T1.

[0200] S403. Update the target object. Point the PTZ camera at the updated target object and track the target object.

[0201] Mobile phone 10 can detect user actions that update the target object. In response to the above actions, mobile phone 10 can update the target object. Then, mobile phone 10 can rotate the gimbal, pointing the gimbal camera at the updated target object to track the new target object.

[0202] refer to Figure 15E During the tracking of object T1, mobile phone 10 can detect another tap operation on the screen. In response to this operation, mobile phone 10 can update the target object to the object T2 (the second object) corresponding to the operation. Then, mobile phone 10 can rotate the gimbal so that the gimbal camera is aimed at object T2, thereby tracking object T2. (Reference) Figure 15F When tracking object T2, a close-up image centered on object T2 can always be displayed in the small preview window 316 to meet the user's need to focus on object T2 anytime, anywhere.

[0203] S404, Record panoramic and close-up videos.

[0204] After setting the target object, the user can click the shutter control 321. In response to the user's operation, the mobile phone 10 starts recording video. The mobile phone 10 can activate its microphone for sound recording. In this embodiment, the mobile phone 10 can activate both the microphone on the main body of the phone and the microphone in the gimbal camera. The sound collected by the microphone on the main body of the phone is used for the panoramic video captured by the rear camera, and the sound collected by the microphone in the gimbal camera is used for the close-up video captured by the gimbal camera.

[0205] Understandably, during recording, users can also click on other objects in the preview window 315. In response to these user actions, the phone 10 can switch the tracked target object at any time.

[0206] During recording, the phone 10 encodes the image stream in preview window 315 and the image stream in small preview window 316 respectively. Encoding the image stream in preview window 315 yields a panoramic video (first panoramic video), and encoding the image stream in small preview window 316 yields a close-up video (first close-up video). After recording ends, the phone 10 can display the panoramic video and close-up video respectively in the gallery application. Therefore, users can crop and edit the panoramic and close-up videos according to their personalized needs to obtain a cinematic video with a combination of panoramic and close-up elements.

[0207] In some embodiments, after recording ends, the mobile phone 10 can also immediately display an editing template. The mobile phone 10 can automatically crop and edit the panoramic video and the close-up video according to the editing template (first template) selected by the user, to obtain a video with a cinematic quality that combines panoramic and close-up shots (second video), thereby further reducing user operations and allowing users to obtain a video with a cinematic quality that combines panoramic and close-up shots more quickly, thus improving the user experience.

[0208] During editing, the phone 10 can prioritize identifying highlights in both close-up and panoramic videos, then combine these highlights to create a cinematic video that interweaves panoramic and close-up elements. The timestamps of the highlights in the close-up and panoramic videos may or may not overlap. For example, after obtaining 50 seconds of panoramic and 50 seconds of close-up video, the phone 10 can identify highlights from 0-15s, 22-30s, and 40-47s in the panoramic video, and highlights from 5-9s, 17-25s, 31-38s, and 45-55s in the close-up video. The phone 10 can then combine these highlights to create a video that interweaves panoramic and close-up elements.

[0209] The phone can determine highlight moments based on image and content parameters. Image parameters include, but are not limited to, exposure, motion blur, and noise; content parameters include, but are not limited to, faces, smiles, blinks, and specific actions (such as jumping, spinning, waving, dancing, running, etc.). When the exposure is too high (too bright) / too low (too dark), or when the image has motion blur, or when the image is noisy, the image score is low, indicating a non-highlight moment. When a face appears in the image, especially a smiling / blinking face, or when a specific action is present, the content score is high, indicating a highlight moment.

[0210] During preview or recording, the mobile phone 10 can also detect user operations on the switching control 334. In some embodiments, in response to the above operations, the mobile phone 10 can rotate the gimbal so that the gimbal camera faces the display screen, equivalent to a front-facing camera. Optionally, in some embodiments, in response to the above operations, the mobile phone 10 can also control the gimbal to rotate 180°. In some embodiments, in response to the above operations, the mobile phone 10 can also switch between the rear camera and the front camera (without affecting the gimbal camera). Optionally, in some embodiments, in multi-camera simultaneous recording mode, the mobile phone 10 can also disable the switching control 334, that is, it does not support the user using the switching control 334 to switch cameras or quickly rotate the gimbal.

[0211] Optionally, during recording, the phone 10 can also display a capture control. In response to the above operation, the phone 10 saves the current image reported by the gimbal camera and the current image reported by the rear camera at the moment the capture operation occurs. The phone 10 can then display these images in the gallery application for user use.

[0212] In some scenarios, users may click on large, indistinct objects such as water or sky, rather than smaller, clearly defined objects like people, cats, or dogs. The phone 10 will then determine that no object has been detected. In this embodiment, when no object is detected, the phone 10 can determine the target direction corresponding to the touch operation based on its location, and then rotate the gimbal to align the gimbal camera's shooting direction (i.e., optical axis) with the target direction. In some embodiments, the phone 10 can also maintain the current shooting direction of the gimbal camera when no object is detected. This way, if a user accidentally touches the screen, the accidental touch will not affect the gimbal camera's ability to continue tracking the target object, improving tracking stability and the quality of close-up videos.

[0213] In some embodiments, during the tracking of a target object, the mobile phone 10 can also detect whether the target object being tracked is within the field of view of the rear camera. When the target object is within the field of view of the rear camera, the mobile phone 10 can rotate the gimbal to keep the gimbal camera pointing at the target object and track the target object.

[0214] When a target object is detected to be outside the field of view of the main rear camera, the mobile phone 10 determines that the target object is lost. The mobile phone 10 stops rotating the gimbal and starts timer X. Preferably, the timing duration of timer X (i.e., the loss duration) is 2s ≤ 5s. Before timer X ends, i.e., when the loss duration is less than a preset threshold N1, if the target object is detected to reappear within the field of view of the rear camera (i.e., re-appear), the mobile phone 10 can rotate the gimbal, point the gimbal camera at the target object, and continue tracking the target object. If timer X ends and the target object is not re-appeared, the mobile phone 10 stops tracking the target object. After stopping tracking an object, the mobile phone 10 will not check whether the object has been re-appeared. After detecting a new touch operation, the mobile phone 10 will determine a new target object based on the touch operation and track the new target object.

[0215] In this way, the PTZ camera will not track objects that are not present in the panoramic image for an extended period of time.

[0216] In the multi-camera simultaneous recording mode offered by the smartphone 10, the phone can use both the rear camera and the gimbal camera to shoot multiple videos simultaneously. Specifically, the phone 10 can stably track a user-selected target object for an extended period using the gimbal camera, thereby capturing panoramic and close-up videos with significant parallax and rich content, satisfying the user's need to simultaneously focus on both panoramic and close-up shots.

[0217] Not limited to mobile phones, electronic devices such as tablets, laptops, in-vehicle devices, smart home devices (such as televisions), and internet conferencing equipment can also be configured. Figure 3 The example shown is a gimbal, on which one or more cameras are mounted. This application embodiment... Figure 4 , Figure 7 , Figure 12 , Figure 14 The shooting method shown can also be implemented on other electronic devices equipped with a gimbal camera. This application does not limit this application.

[0218] Figure 16 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application.

[0219] like Figure 16 As shown, the electronic device includes a system on chip (SoC), internal memory 82, external memory interface 83, display screen 84, camera module 85, communication module 86, audio module 87, sensor module 88, and gimbal 89.

[0220] A System-on-a-Chip (SoC) contains multiple processors, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), and a baseband processor. These different processors can be independent devices or integrated into a single large device.

[0221] Upper-layer applications, such as smart assistants and camera applications, run on the SoC to provide corresponding functions to users.

[0222] The SoC connects to one or more internal memories 82. These internal memories 82 include random access memory (RAM) and non-volatile memory (NVM). RAM can be directly read and written by the processor on the SoC and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. NVM can also store executable programs and user and application data. Executable programs and data stored in NVM can be pre-loaded into RAM for direct read and write operations by the processor on the SoC. The processor may also include a cache unit, which can be used to store recently used or repeatedly used instructions or data.

[0223] The computer program code for the imaging method provided in this application embodiment can be stored in the NVM. After power-on, the electronic device can load the aforementioned computer program code stored in the NVM into the SoC for execution, thereby implementing the method. Figure 4 , Figure 7 , Figure 12 , Figure 14 The shooting method shown allows the user to deploy the gimbal and control its rotation to meet their shooting needs.

[0224] Optionally, some electronic devices may also be equipped with an external memory interface 83. The external memory interface 83 can be used to connect to an external NVM to expand the storage capacity of the electronic device. The computer program code of the shooting method provided in this application embodiment can also be stored in an external NVM connected through the external memory interface 83.

[0225] Display screen 84 is used for display. Display screen 84 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be manufactured using organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniled, microled, micro-oled, quantum dot light-emitting diodes (QLEDs), etc.

[0226] Electronic devices can implement display functions through GPUs, displays, and application processors, etc. Figures 5A-5H , Figures 6A-6G , Figures 8A-8C , Figures 13A-13E , Figures 15A-15F The user interface shown.

[0227] The camera module 85 includes one or more cameras, such as the ultra-wide-angle camera and telephoto camera shown in the mobile phone 10. These one or more cameras are mounted on the back panel of the electronic device, i.e., back panel cameras.

[0228] A camera includes a photosensitive element. This element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. An object passes through the lens, generating an optical image that is projected onto the photosensitive element. The photosensitive element converts the light signal into an electrical signal, which is then passed to an image sensor (ISP) for conversion into a digital image signal. The ISP outputs the digital image signal to a digital signal processing unit (DSP). The DSP converts the digital image signal into image signals in standard formats such as RGB and YUV. In some embodiments, the ISP can be integrated into the camera itself.

[0229] In this embodiment, after the camera application is activated, in the retracted state, the electronic device can raise the corresponding back-panel camera in the camera module 85 according to the user's operation of adjusting the zoom level or selecting a specific shooting mode, and use the back-panel camera to capture images. After entering the dual-lens recording mode, the electronic device can call the camera module 85 to activate at least one back-panel camera and capture panoramic images.

[0230] Communication module 86 includes a wireless communication module and a mobile communication module. The wireless communication module can be used to provide wireless communication solutions for electronic devices, including WLAN (e.g., Wi-Fi), Bluetooth, Bluetooth Low Energy (BLE), Global Positioning System (GPS), Global Navigation Satellite System (GNSS), BeiDou Navigation Satellite System (BDS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR). The mobile communication module is used to provide mobile communication solutions for electronic devices, including 2G / 3G / 4G / 5G. Electronic devices can achieve wireless communication functions through communication module 86.

[0231] Electronic devices can achieve wireless communication functions through the communication module 86, such as obtaining composition templates that meet aesthetic standards from the server, obtaining users' shooting preferences from the server, sharing photos taken, obtaining editing templates, and sharing videos.

[0232] The audio module 87 includes a microphone module 92, a speaker, and a receiver. The microphone module 92 includes one or more microphones. A microphone, also called a "microphone" or "transmitter," is used to convert sound signals into electrical signals. Taking a mobile phone as an example, the microphone module 92 typically includes three microphones. These three microphones are usually located on the bottom bezel of the mobile phone. In this embodiment, when omnidirectional sound pickup is selected, the electronic device can call the microphone module 92 to collect sound signals.

[0233] A speaker, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. A receiver, also called a "handset," is used to convert audio electrical signals into sound signals. When playing video, electronic devices can turn on the speaker to play the audio file from the video. Receivers are commonly used for playing audio in telephone conversations.

[0234] In this embodiment, the mobile phone 10 can use its microphone to capture user voice and obtain user voice commands. During shooting, the camera application can use the microphone to capture ambient sound. Specifically, in dual-lens simultaneous recording mode, after recording begins, the electronic device can activate the microphone module 92 to capture sound signals for panoramic video.

[0235] The sensor module 88 includes a touch sensor and a body inertial measurement unit (IMU).

[0236] A touch sensor, also known as a "touch device," can be integrated into a display screen 84. The touch sensor and display screen 84 together form a touchscreen, also called a "touchscreen." The touch sensor detects touch operations applied to or near it. It then transmits the detected touch operation to the application processor to determine the type of touch event, such as... Figures 5A-5H , Figures 6A-6G , Figures 8A-8C , Figures 13A-13E , Figures 15A-15F The click operation is shown. Based on the detected touch operation, the electronic device can provide visual output related to the touch operation through the display screen 84, such as switching interfaces, taking pictures, updating controls, etc.

[0237] The main IMU is installed in the main body of the electronic device (the electronic part other than the gimbal, such as the main body of the mobile phone) to acquire the attitude data of the main body of the electronic device, such as pitch angle, yaw angle, roll angle, etc.

[0238] In addition to touch sensors, sensor module 88 may also include other sensors, such as pressure sensors, barometric pressure sensors, magnetic sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, ambient light sensors, bone conduction sensors, etc., to enable electronic devices to achieve richer sensing capabilities.

[0239] The above components—SoC, internal memory 82, external memory interface 83, display screen 84, camera module 85, communication module 86, audio module 87, and sensor module 88—are all located in the main body of the electronic device.

[0240] The gimbal 89 includes a gimbal motor, a gimbal IMU, a camera module 90, and a microphone module 91.

[0241] The gimbal motor is used to control the rotation of the rotor on arm 12, which in turn controls the rotation of the gimbal camera.

[0242] The gimbal IMU is mounted on the gimbal and is used to acquire attitude data such as the pitch angle, yaw angle, and roll angle of the gimbal camera.

[0243] The camera module 90 includes one or more cameras, such as a wide-angle camera (main camera). In this embodiment, after opening the camera application, the electronic device can invoke the camera module 90 to activate the gimbal main camera. In the retracted state, after detecting a user's operation of adjusting the zoom ratio or selecting a specific shooting mode, the electronic device can use the corresponding back-panel camera in the camera module 85 to capture images by pulling up the back-panel camera. In the extended state, the electronic device can avoid switching cameras by shrinking the zoom range.

[0244] The microphone module 91 includes one or more microphones. These microphones are also mounted on the pan / tilt unit, close to the camera module 90. In this embodiment, when directional sound pickup is selected, the electronic device can use the microphone module 91 to collect sound signals.

[0245] The SoC, internal memory 82, external memory interface 83, display screen 84, camera module 85, communication module 86, audio module 87, sensor module 88, and gimbal 89 are connected via a bus and communicate and exchange data based on the aforementioned bus. The aforementioned bus includes, but is not limited to, an inter-integrated circuit (I2C) bus, an inter-integrated circuit sound (I2S) bus, a pulse code modulation (PCM) bus, a universal asynchronous receiver / transmitter (UART) bus, a mobile industry processor interface (MIPI) bus, a general-purpose input / output (GPIO) interface bus, and / or a universal serial bus (USB) interface bus.

[0246] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device. Optionally, the electronic device may also include more components, such as buttons, motors, indicators, subscriber identification module (SIM) card interfaces, etc. The embodiments of this application do not impose such limitations.

[0247] Figure 17 This is a timing diagram of the unfolding and folding gimbal of the electronic device provided in the embodiments of this application.

[0248] like Figure 17As shown, the electronic device has an operating system (OS) and a camera application installed. The camera application includes a pop-up module, a gimbal control module, and a gimbal driver.

[0249] After detecting a user operation on the gimbal control 331, the OS can send an activation command to the camera application. In response to this command, the camera application calls the pop-up module and sends an unfold command to it. In response to this command, the pop-up module calls the gimbal control module, which then initializes. During initialization, the gimbal control module can obtain attitude data of the electronic device's main body from the main IMU (e.g., gravity sensor data gyro, three-axis accelerometer data acc, compass data ecompass) to determine the current attitude of the electronic device's main body. Simultaneously, the gimbal control module also obtains attitude data of the gimbal from the gimbal IMU to determine the current attitude of the gimbal camera and how to rotate the gimbal. After initialization, the gimbal control module can call the gimbal driver to control the rotation of each rotor on the gimbal arm 23, unfolding the gimbal so that the optical axis of the gimbal camera is parallel and in the same direction as before unfolding.

[0250] After successful deployment, the gimbal driver can return a startup completion indication to the gimbal control module. The gimbal control module can then further transmit this indication to the camera application. In response to this indication, the camera application can confirm that the gimbal has deployed successfully. The electronic device can then receive user input on the gimbal control panel and adjust the framing and shooting parameters of the gimbal camera accordingly.

[0251] If the gimbal fails to deploy, the gimbal driver can return a startup failure indication to the gimbal control module. The gimbal control module can then further transmit this indication to the camera application. In response to this indication, the camera application can confirm the gimbal deployment failure. The camera application can display a corresponding message to inform the user that the gimbal deployment has failed. In the event of unsuccessful deployment, the gimbal driver can control the rotation of each rotor on the gimbal arm 23 to return to the folded state, ensuring that the user can continue to use the camera in the folded state.

[0252] Upon detecting a user action to turn off the gimbal, the OS can send a shutdown command to the camera application. In response to this command, the camera application invokes the pop-up module and sends the shutdown command to it. The pop-up module then forwards the shutdown command to the gimbal driver. In response, the gimbal driver controls the rotors on the gimbal arm 23 to rotate, folding the gimbal. The camera application can then continue to capture images using the gimbal camera in the folded state.

[0253] After triggering the exit of the camera application, the OS also sends a shutdown command to the camera application. Exiting the camera application includes setting it to run in the background and stopping (killing) the camera application. After the camera application passes the shutdown command to the gimbal driver, the gimbal driver controls the rotors on the gimbal arm 23 to rotate, folding the gimbal. After triggering the exit of the camera application, the camera application shuts down the gimbal camera and no longer uses the gimbal camera to capture images.

[0254] Similarly, after successfully shutting down the gimbal, the gimbal driver can return a shutdown completion indication to the gimbal control module. The gimbal control module can then further transmit this indication to the camera application. In response to this indication, the camera application can confirm that the gimbal was successfully shut down. If the gimbal fails to shut down, the gimbal driver can return a shutdown failure indication to the gimbal control module. The gimbal control module can then further transmit this indication to the camera application. In response to this indication, the camera application can confirm that the gimbal failed to shut down. The camera application can display a corresponding prompt to indicate to the user that the gimbal shutdown failed. In the event of unsuccessful shutdown, the gimbal driver can control the rotation of each rotor on the gimbal arm 23 to return to the deployed state, ensuring that the user can continue to use the camera in the deployed state.

[0255] The term "user interface (UI)" used in the specification, claims, and drawings of this application refers to the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form acceptable to the user. The user interface of an application is source code written in a specific computer language such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on the terminal device, ultimately presenting user-recognizable content such as images, text, and buttons. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined using tags or nodes, such as XML tags. <textview> 、 <imgview> 、

[0256] <videoview>Nodes define the controls contained in the interface. A node corresponds to a control or property in the interface, and after parsing and rendering, the node is presented as the content visible to the user. In addition, many applications, such as hybrid applications, often contain web pages within their interfaces. A web page, also known as a webpage, can be understood as a special control embedded in the application interface. Web pages are source code written in a specific computer language, such as Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), JavaScript (JS), etc. Web page source code can be loaded and displayed as user-readable content by a browser or a web page display component with browser-like functionality. The specific content contained in a webpage is also defined through tags or nodes in the webpage source code; for example, HTML uses tags or nodes to define the content. 、 、 <video> 、 <canvas>Used to define the elements and attributes of a webpage.

[0257] The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0258] As used in the specification and appended claims of this application, the singular expressions "a," "an," "the," "the," "the," and "this" are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any or all possible combinations of one or more of the listed items. As used in the above embodiments, depending on the context, the term "when" can be interpreted as meaning "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining..." or "in response to determining..." or "when (the stated condition or event) is detected" or "in response to detecting (the stated condition or event)."

[0259] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0260] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. A shooting method applied to electronic devices, characterized in that, The electronic device includes a first camera, which is mounted on a gimbal; the method includes: First operation received; In response to the first operation, the camera application is opened and the first camera is activated; Display a first preview interface, which includes the image captured by the first camera and a first control; Received a second operation on the first control; The gimbal is unfolded, and the image captured by the first camera continues to be displayed on the first preview interface, along with the gimbal control panel. The gimbal control panel includes M controls, which are used to control the rotation of the gimbal, where M is a positive integer.

2. The method according to claim 1, characterized in that, Before receiving the second operation on the first control, the first camera and the gimbal are housed in the back panel of the electronic device.

3. The method according to claim 1, characterized in that, After deploying the gimbal, the method further includes: A third operation was received on the first control; In response to the third operation, the gimbal is folded, and the gimbal and the first camera are stored in the back panel.

4. The method according to claim 1, characterized in that, After the gimbal is deployed, the method further includes: In low power and / or overheating environments, the gimbal and the first camera are automatically retracted into the back panel.

5. The method according to claim 3 or 4, characterized in that, After storing the gimbal and the first camera in the back panel, the method further includes: continuing to display the image captured by the first camera on the first preview interface.

6. The method according to claim 3 or 4, characterized in that, The method further includes: turning off the first camera.

7. The method according to claim 1, characterized in that, After the gimbal is deployed, the method further includes: Exit the camera application; During a first time period after exiting the camera application, the first camera is turned off and the gimbal is not retracted into the back panel; during a second time period following the first time period, the gimbal and the first camera are automatically retracted into the back panel; wherein the first time period and the second time period are continuous.

8. The method according to claim 1, characterized in that, When the gimbal is deployed, the camera application is in a first shooting mode; the method further includes: Switch to the second shooting mode; in the second shooting mode, the gimbal control panel includes N controls, where N is not equal to M and N is a positive integer.

9. The method according to claim 1, characterized in that, After the gimbal is deployed, the method further includes: The third control and the fourth control are displayed. The third control is used to switch to a third shooting mode, which is a shooting mode using the first camera. The fourth control is used to switch to a fourth shooting mode, which is a shooting mode using other cameras besides the gimbal. The third control is selectable, while the fourth control is not selectable.

10. The method according to claim 1, characterized in that, The first preview interface also displays a second control, which is used to set the zoom level; Before the detection of the second operation on the first control, the zoom ratio adjustment range corresponding to the second control is the first range; After the second operation on the first control is detected, the zoom ratio adjustment range corresponding to the second control becomes the second range, and the first range covers the second range.

11. The method according to claim 10, characterized in that, The back panel of the electronic device is also provided with a second camera. The first interval includes the zoom magnification adjustment range supported by the first camera and the zoom magnification adjustment range supported by the second camera; the second interval is the zoom magnification change range supported by the first camera.

12. The method according to claim 9, characterized in that, The method further includes: Upon receiving a user operation on the third control, the system responds to the operation and enters the third shooting mode; In the third shooting mode, in response to a first command input by the user, the gimbal is rotated, and when a first target object appears in the preview interface, a shooting operation is automatically performed to obtain a first photo including the first target object.

13. The method according to claim 12, characterized in that, Before automatically performing the shooting operation, the method further includes: adjusting the posture and / or focal length of the first camera so that the position of the first target object in the preview interface matches the preset composition template.

14. The method according to claim 12, characterized in that, The first instruction is associated with the first target object.

15. The method according to claim 9, characterized in that, The method further includes: Upon receiving a user operation on the third control, the system responds to the operation and enters the third shooting mode; In the third shooting mode, in response to the first user operation, the first shooting operation is performed to obtain the first photo, which includes the first object; By rotating the gimbal to change the position of the first object in the preview interface, a second shooting operation is automatically performed to obtain a second photo including the first object.

16. The method according to claim 15, characterized in that, The electronic device also changes the position of the first object in the preview interface by adjusting the focal length of the first camera, and the adjusted position of the first object in the preview interface matches the preset composition template.

17. The method according to claim 9, characterized in that, The first preview interface includes a first preview window, in which the electronic device displays an image captured by a first camera. The method further includes: Upon receiving a user operation on the third control, the system responds to the operation and enters the third shooting mode; In the third shooting mode, a second preview window is displayed in the first preview interface, which includes the first preview window, and the image captured by the second camera is displayed in the second preview window. The second camera is mounted on the back panel of the electronic device. Upon receiving a first operation from the user, the first camera tracks the first object. The images captured by the first camera and the second camera are recorded.

18. An electronic device, characterized in that, It includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store a computer program that, when the one or more processors execute the computer program, causes the method as described in any one of claims 1-17 to be performed.

19. A computer-readable storage medium comprising a computer program, characterized in that, When the computer program is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-17.

Images