Shooting method and electronic equipment

Abstract

The invention provides a shooting method and electronic equipment. The method can be applied to electronic equipment such as mobile phones and tablet personal computers. In the method, a user can set some expected shooting objects in advance. The electronic equipment placed at a fixed position can unfold the pan-tilt camera to scan a three-dimensional space and find a shooting object expected by a user. After the shooting object expected by the user is found, the electronic equipment can automatically capture and store the image containing the object for the user to browse and use.

Description

Technical Field

[0001] This application relates to the field of terminals, and more particularly to a shooting method and an electronic device. Background Technology

[0002] In scenarios such as sports, parties, and meetings, users often need to set up their electronic devices (such as mobile phones) to automatically capture memorable moments. However, currently, when mobile phones and other electronic devices are fixed on stands or other tabletops, the shooting angle of their front / rear cameras is fixed. Therefore, the number of memorable moments that can be captured is limited, and the image quality is low. Summary of the Invention

[0003] This application provides a shooting method and an electronic device.

[0004] Firstly, this application provides a shooting method applied to an electronic device. The method includes: receiving a first instruction input by a user; in a first shooting mode, displaying an image captured by a first camera in a preview interface of a camera application, the first camera being mounted on a gimbal; rotating the gimbal in response to the first instruction; and automatically performing a shooting operation when a first target object appears in the preview interface to obtain a first photograph including the first target object, wherein the first target object is associated with the first instruction.

[0005] By implementing the method provided in the first aspect, an electronic device can automatically capture images of a target object related to a first command input by the user. Specifically, the electronic device can automatically rotate its gimbal camera to locate the target object in response to the first command. After locating the target object, the electronic device can automatically capture and save a photo containing the target object for the user to view and use. In this way, based on the user's commands to the electronic device, it can automatically capture images using a gimbal and camera, improving the user's shooting experience in various scenarios and enabling the user to easily capture photos related to the first command issued.

[0006] In some embodiments, the method further includes: responding to a first instruction, activating a camera application, and entering a first shooting mode. The first instruction is a voice instruction, and includes first information used to indicate a first target object. The first information is an instruction or data that explicitly or implicitly identifies the first target object to be focused on or photographed. This first information may directly contain the characteristics, name, color, location, or other relevant information of the first target object so that the electronic device can identify and operate upon it. Alternatively, the first information may not directly contain information about the first target object; instead, the electronic device can deduce the first target object to be photographed based on the received first information. This deduction process can be implemented based on artificial intelligence, neural networks, or deep learning technologies.

[0007] In other words, when an electronic device opens the camera application based on a received user voice command, it can directly enter the first shooting mode and identify the subject the user desires. This allows the electronic device to rotate the gimbal camera earlier to find the desired subject.

[0008] In other embodiments, the electronic device may receive user input after the camera application is turned on and a specific shooting mode is entered, and the user may specify the subject to be photographed based on the input.

[0009] In some embodiments, the first information further indicates a second target object, and the method further includes: when the second target object appears in the preview interface, automatically performing a shooting operation to obtain a second photo including the second target object.

[0010] In other words, the electronic device can determine multiple desired subjects based on a single user input. During the gimbal rotation, once a desired subject appears, the device automatically captures the image. This allows users to obtain multiple photos with different content at once, satisfying their personalized needs.

[0011] In some embodiments, rotating the gimbal includes: in response to first information, rotating the gimbal within a first track to make a first target object appear in the preview interface, wherein the first track is a preset track or a random track. In this way, the electronic device can utilize the wide travel of the gimbal to automatically adjust the framing range of the first camera, thereby making the target object appear in the preview interface and ensuring better shooting results.

[0012] In some embodiments, the method further includes: stopping the rotation of the gimbal and turning off the first camera after the rotation duration of the gimbal reaches a preset maximum duration. The maximum duration can be preset by the developer (which cannot be changed by the user) or set by the user according to their own needs (which the user can change).

[0013] In some embodiments, after automatically performing the shooting operation, the method further includes: stopping the gimbal rotation and turning off the first camera after the number of photos taken has reached a preset maximum value; the photos taken are those captured by the first camera automatically performing the shooting operation. The maximum number of photos taken can be preset by the developer or set by the user according to their own needs.

[0014] In this way, the electronic device will not rotate the first camera indefinitely to find the subject the user wants to photograph and capture photos, which helps to save power and extend battery life.

[0015] In some embodiments, before automatically performing the shooting operation, the method further includes: adjusting the pose and / or focal length of the first camera so that the position of the first target object in the preview interface matches a preset composition template.

[0016] In this way, electronic devices can automatically compose the image and optimize the composition during the shooting process. The photos that users get are not only photos of the subjects they expect to photograph, but also high-quality photos with compositions that meet aesthetic standards, thereby better meeting users' shooting needs and improving their shooting experience.

[0017] In some embodiments, rotating the gimbal includes rotating the device gimbal along a pre-set track.

[0018] In some embodiments, rotating the gimbal includes rotating the gimbal towards an area with a dense distribution of objects in the preview interface. This allows for more flexible rotation of the first camera and enables it to locate target objects that the user may be interested in more quickly. The electronic device can find the user's desired subject more rapidly. Here, "object" can refer to the subject being photographed or the target object mentioned below; it can also refer to all objects (e.g., people, animals, scenery, buildings, etc.) identified by the electronic device automatically detecting the scene in the preview interface based on the detection results.

[0019] When the first target object appears in the preview interface, the first camera is in a first posture. After adjusting the posture and / or focal length of the first camera, the first camera is in a second posture. After automatically executing the shooting operation, the method further includes: the first camera returns to the first posture, and the electronic device continues to rotate the gimbal along a preset first track.

[0020] In some embodiments, the method further includes: rotating the gimbal within a first track, the gimbal being in a first posture; adjusting the posture and / or focal length of the first camera so that the gimbal rotates within a second track, the second track being different from the first track; automatically performing a shooting operation when a third target object appears in the preview interface; and after the shooting operation is completed, the first camera returns to the first posture, and the electronic device continues to rotate the gimbal within the first track.

[0021] In other words, after adjusting the composition, the electronic device can rotate the gimbal to control the first camera back to its original position before the composition was completed. This allows the first camera to continue scanning three-dimensional space to find the subject the user desires.

[0022] In some embodiments, the method further includes displaying a prompt message in the preview interface, the prompt message being related to the first information. In this way, the user can determine the currently set desired shooting object at any time through the aforementioned prompt message.

[0023] In some embodiments, the first photograph is a still photograph composed of a single frame or a moving photograph composed of multiple frames.

[0024] Secondly, this application provides a shooting method applied to an electronic device. The method includes: in a second shooting mode, turning on a first camera and displaying an image captured by the first camera in a preview interface; receiving a first user operation and, in response to the first user operation, performing a first shooting operation to obtain a first photo, the first photo including a first object; and automatically performing a second shooting operation after the position of the first object changes in the preview interface to obtain a second photo including the first object.

[0025] Implementing the method provided in the second aspect, after a user manually takes a photo, the electronic device can recompose the image and automatically capture a new photo containing content of interest to the user for selection.

[0026] In some embodiments, the method further includes: determining a subject of interest to the user (i.e., a desired subject) based on previously taken photos, wherein the first subject is the subject of interest to the user.

[0027] In other embodiments, the first object is the object closest to the center point of the first photograph. In this case, the electronic device can determine the user's desired subject in real time based on the current framing.

[0028] In other embodiments, before detecting the first user action, the method further includes detecting a second user action on a preview window in the preview interface, the second user action corresponding to the first object. The electronic device can also determine the user's desired subject based on the most recent touch operation on the preview image.

[0029] Changing the position of the first object within the preview interface includes: rotating the gimbal and / or adjusting the focal length of the first camera. This allows the electronic device to more flexibly adjust the position of the first object within the preview interface.

[0030] In some embodiments, the adjusted position of the first object within the preview interface matches a preset composition template. Thus, even users with limited shooting skills can still capture aesthetically pleasing photos using this feature, satisfying their shooting and sharing needs.

[0031] In some embodiments, the method further includes: receiving a second voice command input by the user, and in response to the second voice command, opening the camera application and entering a second shooting mode. That is, the user can control the electronic device to open the camera application and directly enter a specific second shooting mode through a single voice command to implement the above shooting method.

[0032] In some embodiments, the second photograph is a still photograph composed of a single frame or a moving photograph composed of multiple frames.

[0033] Thirdly, this application provides an electronic device including one or more processors and one or more memories; wherein the one or more memories are coupled to one or more processors, and the one or more memories are used to store a computer program, such that when the one or more processors execute the computer program, the electronic device performs the method described in the first aspect and any possible implementation thereof, or performs the method described in the second aspect and any possible implementation thereof.

[0034] Fourthly, embodiments of this application provide a chip system applied to an electronic device. The chip system includes one or more processors, which are configured to invoke computer instructions to cause the electronic device to perform a method as described in the first aspect and any possible implementation thereof, or to perform a method as described in the second aspect and any possible implementation thereof.

[0035] Fifthly, this application provides a computer-readable storage medium including a computer program that, when run on an electronic device, causes the electronic device to perform the method described in the first aspect and any possible implementation thereof, or to perform the method described in the second aspect and any possible implementation thereof.

[0036] In a sixth aspect, this application provides a computer program product containing instructions that, when the computer program product is run on an electronic device, causes the electronic device to perform the method described in the first aspect and any possible implementation thereof, or to perform the method described in the second aspect and any possible implementation thereof.

[0037] Understandably, the electronic device provided in the third aspect, the chip system provided in the fourth aspect, the computer storage medium provided in the fifth aspect, and the computer program product provided in the sixth aspect are all used to execute the method provided in this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description

[0038] Figure 1 This is a schematic diagram of a mobile phone structure equipped with a gimbal camera, provided in an embodiment of this application;

[0039] Figure 2 This is a flowchart illustrating a shooting method based on a gimbal camera provided in an embodiment of this application;

[0040] Figures 3A-3F These are schematic diagrams of a set of user interfaces provided in the embodiments of this application;

[0041] Figures 4A-4D This is a schematic diagram of the user interface for launching the camera application and entering the automatic composition mode through a smart assistant, provided in an embodiment of this application.

[0042] Figure 5A This is a schematic diagram of a scanning track provided in an embodiment of this application;

[0043] Figures 5B-5C These are schematic diagrams of two other scanning tracks provided in the embodiments of this application;

[0044] Figure 5D These are schematic diagrams of two other scanning tracks provided in the embodiments of this application;

[0045] Figure 6 This is a schematic diagram illustrating the adjustment of the attitude and / or focal length of the gimbal camera provided in an embodiment of this application;

[0046] Figure 7 This is a schematic diagram of the shooting scene provided in the embodiments of this application;

[0047] Figure 8 This is a flowchart of another shooting method based on a gimbal camera provided in an embodiment of this application;

[0048] Figures 9A-9F This is another set of user interface diagrams provided in the embodiments of this application;

[0049] Figure 10 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0050] Figure 11 This is a schematic diagram of the hardware and software structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0051] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be a limitation of this application.

[0052] Mobile phones typically include a front-facing camera and a rear-facing camera. The rear-facing camera usually comprises multiple lenses, such as a wide-angle lens, an ultra-wide-angle lens, a telephoto lens, and a macro lens. The wide-angle lens is often referred to as the main camera. These multiple cameras are fixedly mounted on the back of the phone.

[0053] Different cameras typically have different fields of view (FOV). FOV, also known as viewing angle or field of view, refers to the range of angles that a camera's optical system can image onto. In a shooting scene, the FOV of an image refers to the angle corresponding to the area of ​​the actual scene in front of the lens that can be captured and imaged onto the image sensor. In other words, the FOV of an image indicates the range of the scene in the image. A larger FOV indicates a larger range of scene content (i.e., the field of view) and more objects included in the image. Generally, the larger the focal length of the camera, the smaller the FOV of the image captured by the camera. In one possible implementation, electronic device 100 can adjust the FOV of the captured image by using cameras with different focal lengths.

[0054] When a phone is fixed on a stand or other surface, the shooting angle of the rear camera is fixed. For example, when using the main camera (FOV is usually 60° to 84°), the phone can only capture images within a horizontal range of 60° to 84°; when using the ultra-wide-angle camera (FOV is usually 94° to 118°), the phone can only capture images within a horizontal range of 94° to 118°, and cannot capture images of the entire three-dimensional space.

[0055] In practical applications, this limitation is particularly evident in multi-object scenarios such as sports, parties, and meetings. In these situations, users often want to capture exciting scenes happening in every corner of the entire three-dimensional space to capture more content and details. However, because the shooting angle of a mobile phone is fixed, users cannot set their phones to automatically scan the entire three-dimensional space. This further prevents users from setting their phones to automatically capture images across the entire three-dimensional space in these scenarios, potentially causing them to miss many wonderful moments.

[0056] Therefore, firstly, this application embodiment provides a mobile phone equipped with a gimbal camera.

[0057] Figure 1 This is a schematic diagram of a mobile phone structure equipped with a gimbal camera, provided in an embodiment of this application.

[0058] like Figure 1As shown, mobile phone 10 is a mobile phone equipped with a gimbal camera. A fixing component 11 is provided on the back panel 14 of mobile phone 10. One end of arm 12 is coupled to the fixing component 11, and a camera 13 is mounted on the other end of arm 12. When the camera 13 is activated, arm 12 flips, unfolding the arm 12 stored in the back panel 14 and extending the camera 13. When the camera 13 is deactivated, arm 12 folds, retracting the camera 13 back into the back panel 14. The state in which arm 12 and camera 13 are retracted into the back panel 14 is called the retracted state; the state in which arm 12 is unfolded and camera 13 is extended is called the unfolded state.

[0059] Arm 12 is equipped with multiple rotors, such as rotors 21, 22, 23, and 24. Mobile phone 10 can control camera 13 to align with any plane in three-dimensional space via arm 12, which includes the aforementioned rotors, thereby obtaining an image of the corresponding plane. The movable support platform (which can align with any plane in three-dimensional space) composed of fixed component 11 and arm 12 including multiple rotors is called a gimbal. The camera assembly (e.g., camera 13) mounted on the gimbal is called a gimbal camera.

[0060] like Figure 1 As shown, a camera is mounted on the gimbal of the mobile phone 10, and multiple cameras are mounted on the back panel 14. The type of the camera mounted on the gimbal (i.e., the gimbal camera) can be the same as or different from the type of the camera mounted on the back panel 14 (i.e., the back panel camera, such as camera 17 and camera 18).

[0061] For example, gimbal camera 13 can be a wide-angle camera (main camera), back panel camera 17 can be an ultra-wide-angle camera, and back panel camera 18 can be a telephoto camera. Optionally, gimbal camera 13 can be a wide-angle camera, back panel camera 17 can also be a wide-angle camera, and back panel camera 18 can be an ultra-wide-angle camera. It is understood that more cameras can be installed on the back panel 14, such as telephoto cameras, macro cameras, etc., and this application embodiment does not limit this.

[0062] In some embodiments, multiple cameras are mounted on the gimbal of the mobile phone 10, and multiple cameras are also mounted on the back panel 14. Similarly, one or more cameras on the gimbal can be of the same type as the cameras on the back panel. For example, two cameras are mounted on the gimbal, and two cameras are mounted on the back panel 14, wherein one gimbal camera is a wide-angle camera, one gimbal camera is a telephoto camera, one back panel camera is a wide-angle camera, and one back panel camera is an ultra-wide-angle camera.

[0063] Specifically, in some embodiments, the number and type of the gimbal cameras correspond one-to-one with the backplate cameras. For example, three cameras are mounted on the gimbal, and three cameras are also mounted on the backplate 14. The three gimbal cameras are a wide-angle camera, an ultra-wide-angle camera, and a telephoto camera, respectively; the three backplate cameras are also a wide-angle camera, an ultra-wide-angle camera, and a telephoto camera, respectively.

[0064] In some embodiments, the gimbal of the mobile phone 10 has multiple cameras, while the back panel 14 has only one camera. For example, the gimbal has two cameras, a wide-angle camera and a telephoto camera, while the back panel 14 has only one ultra-wide-angle camera.

[0065] In some embodiments, the cameras of the mobile phone 10, such as a wide-angle camera, an ultra-wide-angle camera, and a telephoto camera, can all be mounted on the gimbal, and no cameras can be mounted on the back panel 14.

[0066] This application does not limit the number or type of gimbal cameras and backplane cameras.

[0067] For a mobile phone 10 equipped with a gimbal camera, this application provides a shooting method based on the gimbal camera.

[0068] In this method, the mobile phone 10 can be set to an automatic composition mode. After entering the automatic composition mode, the gimbal camera on the mobile phone 10 can scan three-dimensional space along a predetermined trajectory to find the user's desired shooting object (i.e., the target shooting object). After finding the target shooting object, the gimbal camera can adjust its posture to make the composition of the target shooting object within the framing range conform to aesthetic standards, and then capture the image that conforms to the aesthetic standards.

[0069] The gimbal is equipped with: a wide-angle camera (main camera);

[0070] The back panel is equipped with: an ultra-wide-angle camera and a telephoto camera;

[0071] Taking the 10A phone with the above configuration as an example, Figure 2 This is a flowchart of a shooting method based on a gimbal camera provided in an embodiment of this application.

[0072] S101. Launch the camera app and enter photo mode.

[0073] The phone 10A has a camera app installed for taking pictures. Upon detecting a user interaction (such as a tap) on the camera app icon, the phone 10A can launch the camera app. By default, the camera app first activates the main camera, also known as the wide-angle camera, enters shooting mode, and displays the photo preview interface.

[0074] Figure 3AThis is a desktop illustration of the mobile phone 10A provided in an embodiment of this application. For example... Figure 3A As shown, the home screen of the 10A phone can display multiple application icons, such as the Gallery app icon, Weather app icon, and Camera app icon. (Reference) Figure 3B When a user needs to take a photo, they can tap the camera app icon to instruct the phone 10A to launch the camera app and begin shooting. In response to this user action, the phone 10A launches the camera app, defaulting to activating the main camera and displaying... Figure 3C The photo preview interface shown displays the image captured by the main camera in preview window 315.

[0075] When the main camera is set on the gimbal, the phone 10A only activates the main camera and does not deploy the gimbal (i.e., the main camera is used in the retracted state).

[0076] S102. Enter automatic composition mode and deploy the gimbal.

[0077] The photo preview interface includes a preview window 315 and a mode bar 311. The mode bar 311 includes multiple mode controls. Each mode control corresponds to a shooting mode, such as night scene mode, portrait mode, photo mode, video mode, etc. In this embodiment, the mode bar 311 also includes a mode control 312. The mode control 312 corresponds to the automatic composition mode (first shooting mode). In this embodiment, the mode control 312 is referred to as "automatic composition mode" as merely an example; it could also be called other modes, such as automatic shooting mode, etc. This application does not limit its scope. (Reference) Figures 3C-3D After detecting user operation on the mode control 312, the mobile phone 10A can enter the automatic composition mode.

[0078] In this embodiment, after entering the automatic composition mode, the mobile phone 10A can deploy the gimbal (i.e., use the main camera in the deployed state). Optionally, during the deployment of the gimbal, the preview window 315 continues to display the image captured by the main camera of the gimbal. Since the gimbal deployment process is fast and the change in framing is obvious, optionally, in other embodiments, the preview window 315 may also display a transition animation to better guide the user's visual experience.

[0079] In some embodiments, when the main camera is set on the gimbal, the phone 10A can immediately deploy the gimbal and activate the gimbal main camera when the camera application is launched.

[0080] S103. Identify the target subject for photography.

[0081] In automatic framing mode, the mobile phone 10A can determine the target subject through user input. This input includes voice input and text input. The target subject, also referred to as the target object, refers to the object determined by the electronic device to be photographed; this application does not limit this definition.

[0082] For example, refer to Figure 3D In automatic composition mode, the mobile phone 10A can display control 313. The mobile phone 10A can detect user operations on control 313. (Reference) Figure 3E In response to the aforementioned user operation, the mobile phone 10A can display the keypad 314. The mobile phone 10A can obtain user input in text form (i.e., text input) through the keypad 314, such as: "Please help me take some party photos, especially photos of moments like raising glasses, games, singing together, laughter, and food" (first information). Based on the semantic analysis of the above text input, the mobile phone 10A can determine the target subject for photography from the above text input, such as wine glasses, games, smiles, food, and singing.

[0083] Optionally, in automatic composition mode, users can wake up the smart assistant with their voice and then use voice input (the first voice command) to have the phone 10A identify the target subject. Alternatively, after waking up the smart assistant, users can also input text or images. The smart assistant can then identify the target subject based on the text or image and send the identified subject to the camera app.

[0084] Optional, see reference Figure 3F After input is completed, the phone 10A can display a numerical identifier, such as "1", on the control 313 to indicate the number of times the user has entered the command. Optionally, the phone 10A can display prompts indicating the target subject near the control 313, such as "Party: wine glass, game, smiley face, food, singing", so that the user can know at any time the target subject currently identified by the phone 10A.

[0085] Within a preset time period, even without receiving voice or text input from the user, the 10A phone can still determine the target subject based on previously recorded user shooting preferences. The 10A can identify frequently photographed subjects—i.e., the user's shooting preferences—by marking image content, and then designate objects from these preferences as target subjects. These objects include, but are not limited to, people, cats, dogs, food, and flowers.

[0086] In desktop mode, users can also activate the smart assistant and input voice commands, text commands, or a combination of text and images. Responding to the user's input, the phone 10A can launch the camera application through the smart assistant, enter automatic composition mode, and take a picture according to the instructions. At this time, the instructions used to launch the camera application can also specify the target subject. The phone 10A can determine the target subject based on these instructions. Therefore, in this method, after entering automatic composition mode, the phone 10A no longer needs user input to determine the target subject.

[0087] Figures 4A-4D This is a schematic diagram of the user interface for launching the camera application and entering the automatic composition mode via a smart assistant, as provided in an embodiment of this application. (Reference) Figures 4A-4B In desktop mode, the phone 10A can detect when the user uses voice to wake up the smart assistant, such as saying "Hey, YOYO." In response, the phone 10A can wake up the smart assistant. The phone 10A can then display a dialog window 317. The user can then say to the smart assistant, "Please open the camera and take some photos of the party, especially moments of toasting, games, singing, laughter, and food" (first voice command). (Reference) Figures 4C-4D In response to the above command, the phone 10A can launch the camera application and enter automatic composition mode. Simultaneously, the phone 10A can extract the target subject from the voice command, such as "party: wine glass, game, smile, food, singing." At this point, refer to... Figure 4D The phone 10A can display control 313 and prompts indicating the target subject, such as "Party: wine glass, game, smile, food, singing". The user can confirm through control 313 and prompts that the phone 10A is in automatic composition mode and has identified the target subject.

[0088] In one possible implementation, the phone 10A can also wake up the smart assistant via a pre-action gesture. For example, upon detecting a hand-raising gesture (the phone 10A being picked up), the phone 10A can wake up the smart assistant, and then the phone 10A can obtain the user's voice command, such as "Please take some party photos for me, especially…". In response to the command, the phone 10A can launch the camera app, enter automatic composition mode, and extract the target subject from the voice command. In this case, the user does not need to first wake up the smart assistant with a specific wake word (e.g., "Hey, YOYO").

[0089] In scenarios where the camera directly enters composition mode, the 10A phone can simultaneously deploy the gimbal and activate the main camera.

[0090] In automatic framing mode, the phone 10A can also determine the target subject based on touch operations performed on the screen. For example, after an object of interest (such as the user themselves) appears in the preview window 315, the user can tap on that object. In response to this user action, the phone 10A can identify that object as the target subject for shooting.

[0091] After identifying the target subject, the user can leave the phone 10A and let the phone 10A automatically compose and capture the predetermined target subject.

[0092] S104. Scan the three-dimensional space to find the target subject for photography.

[0093] In one possible implementation, the electronic device can control the gimbal to move along a first track to locate the target object. As the electronic device rotates the gimbal within the first track, the content displayed in the preview window changes accordingly. The electronic device can compare the content displayed in the preview window with the target object; the specific comparison method and algorithm are not limited in this application.

[0094] The first track can be a preset scanning track in the automatic shooting engine. After entering the automatic framing mode and identifying the target subject, the phone 10A can scan three-dimensional space according to the preset scanning track to find the target subject. The first track can also be a scanning track set by the user, and this application does not limit this.

[0095] Figure 5A This is a schematic diagram of a scanning track provided in an embodiment of this application.

[0096] The black rectangle at the center of the sphere represents the gimbal camera. For example... Figure 5A As shown, the optical axis C of the gimbal camera is parallel to the plane formed by the horizontal coordinate axes X / Y (i.e., the pitch angle θ of the gimbal camera is 0). In this orientation, supported by arm 12, the gimbal camera can rotate around the Z-axis in a plane perpendicular to the coordinate axis Z. The track R1 swept by the optical axis C is the scanning track of the gimbal camera. During scanning along R1, the gimbal camera can capture objects near R1, and the larger the FOV of the gimbal camera, the more objects near R1 it can capture, i.e., the larger the field of view.

[0097] Figures 5B-5C These are schematic diagrams of two other scanning tracks provided in the embodiments of this application. For example... Figure 5B As shown, the optical axis C of the gimbal camera intersects the plane formed by the horizontal coordinate axes X and Y, with a pitch angle θ < 0. In this orientation, when the camera rotates around the coordinate axis Z, the track R2 swept by the optical axis C is another scanning track of the gimbal camera. (As shown...) Figure 5C As shown, the optical axis C of the gimbal camera intersects the plane formed by the horizontal coordinate axes X and Y, with a pitch angle θ > 0. In this orientation, when rotating around the coordinate axis Z, the track R3 swept by the optical axis C is another scanning track for the gimbal camera. Optionally, 20° ≤ θ ≤ 50°.

[0098] Optionally, after scanning along track R1, the gimbal camera can also scan along track R2 and / or track R3 to expand the field of view of the gimbal camera and thus find the target subject in a wider range.

[0099] Figure 5D These are schematic diagrams of two other scanning tracks provided in the embodiments of this application. For example... Figure 5D As shown, the gimbal camera can also scan along R4 and R5 to expand its field of view. It is understood that this application does not limit the specific pattern or combination of scanning tracks.

[0100] In some embodiments, the gimbal can also rotate randomly. The gimbal camera can acquire images of objects in three-dimensional space based on the aforementioned random motion, and locate the target object.

[0101] In some embodiments, the gimbal can also move along random scanning tracks, which can be any one or a combination of the three scanning tracks described above. For example, such as... Figures 5A-5C As shown, the gimbal can first rotate within track R1, and before the scan along track R1 is finished, it can start rotating within track R2 or track R3, thereby achieving more flexible and faster target acquisition.

[0102] In other embodiments, the mobile phone 10A can also identify objects in the image (image captured by the gimbal camera) in the current preview interface and determine the movement direction of the gimbal based on the distribution of the objects. Optionally, the mobile phone 10A can control the gimbal to move towards the edge where objects are densely distributed. For example, when objects are densely distributed at the upper left edge of the image, the mobile phone 10A can control the gimbal to rotate to the left and upward.

[0103] S105. Locate the target subject for your photography.

[0104] During the scanning of three-dimensional space, the phone 10A can display the images captured by the gimbal camera in real time in the preview window 315. At the same time, the phone 10A can perform image recognition on the images captured by the gimbal camera to determine whether the image contains the target object, such as a wine glass, a game, a smiling face, food, or singing.

[0105] In one possible implementation, the target object appears in the preview interface when the electronic device rotates the gimbal to a first position on the first track and the gimbal is in a first posture, or in other words, the target object is identified in the preview interface.

[0106] During the rotation of the gimbal by the electronic device, the gimbal's attitude can remain unchanged, or it can move in other directions with a small amplitude; this application does not limit this.

[0107] The aforementioned first position can be any position within the first track.

[0108] S106. Adjust the gimbal to change the camera's posture and / or focal length so that the composition of the target subject within the frame conforms to aesthetic standards.

[0109] In one possible implementation, the electronic device can rotate the gimbal to adjust the camera's posture and / or position, and then automatically perform a shooting operation; after the electronic device automatically performs the shooting operation, it can adjust the gimbal to the first position and the first posture and continue to rotate the gimbal on the first track.

[0110] When rotating the gimbal to the first position and the first posture, the target object may be located at the edge of the preview interface, or there may be other objects in the preview interface that interfere with the shooting. Therefore, the electronic device can rotate the gimbal to adjust the posture and / or position of the camera, and then automatically perform the shooting operation. After shooting, the gimbal is adjusted back to the first position and the first posture and the gimbal continues to rotate on the first track.

[0111] In this context, rotating the gimbal to adjust the camera's posture and / or position can refer to the electronic device rotating the gimbal to move away from (deviate from) the first track, making the target object in the preview interface closer to the lens; or, the electronic device can adjust the posture of the first camera by rotating the gimbal to change the position of the target object in the preview interface, or simultaneously adjust the posture and position of the first camera to change the position of the target object in the preview interface.

[0112] In one possible implementation, in addition to rotating the gimbal to adjust the camera's attitude and / or position, the electronic device can also adjust the camera's focal length before automatically performing the shooting operation. Similarly, during the automatic shooting operation, the electronic device can adjust the focal length of the first camera to its previous focal length. The original focal length of the first camera can be a first focal length, and the adjusted focal length can be a second focal length, where the first focal length can be longer than the second focal length.

[0113] In one possible implementation, the electronic device rotates the gimbal to adjust the posture and / or position of the first camera, and / or adjusts the focal length of the first camera, so that the composition of the subject in the preview interface conforms to aesthetic standards.

[0114] Specifically, after identifying the target subject, the 10A phone can adjust the posture and / or focal length of the gimbal camera to match the position of the target subject within the frame with a preset composition template, thus ensuring that the composition of the target subject within the frame meets aesthetic standards.

[0115] Figure 6 This is a schematic diagram illustrating the adjustment of the attitude and / or focal length of a gimbal camera according to an embodiment of this application.

[0116] like Figure 6 As shown, during scanning at a focal length of 1x (1×), when rotating to the first pose (α1,β1,γ1), the target subject appears in the image F1 captured by the gimbal camera, such as a smiling girl (the first target subject). After determining that the target subject is in the lower right corner of the frame, the mobile phone 10A can determine that the composition of the current target subject within the frame does not meet aesthetic standards.

[0117] Therefore, the phone 10A can adjust the attitude and / or focal length of the gimbal camera. For example, the phone 10A can adjust the gimbal camera from its original first attitude (α1, β1, γ1) to a second attitude (α2, β2, γ2), positioning the target subject at the trisection point Point1 below the viewfinder, as shown in image F2. Then, the phone 10A can zoom the gimbal camera, for example, switching from a 1× focal length to a 2× focal length. As shown in image F3, after zooming, the target subject within the viewfinder is horizontally centered and meets the preferred vertical division ratio, thus conforming to aesthetic standards.

[0118] Understandably, the 10A phone can also learn compositions suitable for different subjects, and then select the most suitable composition for the current subject based on the different subjects. Based on the above composition, it adjusts the posture and / or focal length of the gimbal camera so that the composition of the target subject within the frame meets aesthetic standards.

[0119] In scenarios with multiple cameras, the gimbal camera can optionally first perform physical zoom, such as switching the main camera to a telephoto lens, to obtain high-quality images. When the physical zoom range is exceeded, the gimbal camera then performs digital zoom. In scenarios where physical zoom is not supported, the gimbal camera directly performs digital zoom.

[0120] S107, Automatic Capture.

[0121] After obtaining a target image that contains the target subject and whose composition meets aesthetic standards (e.g.) Figure 6 After capturing the image shown in image F3, the mobile phone 10A can perform an automatic snapshot operation and save the target image to local storage for user browsing.

[0122] Optionally, when saving the target image, the mobile phone 10A may save only the target image frame to generate a still photo (first photo). Optionally, the mobile phone 10A may also save the target image and multiple frames before and after the target image to generate a moving photo (first photo).

[0123] S108, Number of captured images = M1.

[0124] In the camera application, an automatic capture threshold in automatic composition mode can be set to a first value M1 (maximum value), where M1 is a positive integer. Developers can set the specific value of M1 based on experience. Optionally, for example, 10 ≤ M1 ≤ 20. This application embodiment does not impose this limitation. The initial value N of the number of captured images can be 0, where N is an integer. After each captured frame, the number of captured images is incremented by 1. The mobile phone 10A can determine whether the number of captured images has reached M1. In one possible implementation, the user can also set the value of M1 before shooting, and this application does not limit this.

[0125] S109. Stop scanning and capturing images.

[0126] When the number of captured images reaches M1 (i.e., the number of captured images = M1), the mobile phone 10A immediately executes S108.

[0127] If the number of captured images has not reached M1 (i.e., the number of captured images < M1) and the current scanning time has not reached the designated scanning time (i.e., no timeout), the mobile phone 10A can return to the original predetermined track and continue scanning. The scanning time can be a primary duration, a duration set in the system, or a duration preset in the system; this application does not limit this.

[0128] For example, refer to Figure 6 In the second pose and at a focal length of 2×, after capturing an image at F3, the gimbal camera can return to the first pose and at a focal length of 1×, and then continue to scan the three-dimensional space along a predetermined path (e.g., R1, R2, R3, etc.) to find other target objects to capture.

[0129] Developers can set the scan duration (maximum duration) based on experience. Optionally, the scan duration can be between 10 minutes and 20 minutes. In some embodiments, the mobile phone 10A can also receive user input and determine the scan duration based on the user input.

[0130] If no target object is detected and no image is captured, the phone 10A will execute S108 after the current scanning time reaches the preset scanning time (i.e., timeout), stopping scanning and capturing images. Furthermore, after executing S108, the phone 10A can also exit the camera application and turn off the cameras (including the gimbal camera and other cameras mounted on the back panel) to save power.

[0131] The gimbal is equipped with a telephoto camera;

[0132] The back panel features: a wide-angle camera (main camera) and an ultra-wide-angle camera;

[0133] Taking the above-described configuration of the phone 10B as an example, when launching the camera application, the phone 10B defaults to activating the main camera on the back panel, displaying the image captured by the main camera in the preview window 315. After entering the automatic composition mode, the phone 10B can activate the gimbal camera (such as a telephoto camera mounted on a gimbal), displaying the image captured by the gimbal camera in the preview window 315. Subsequent operations are described in S103 to S109, and will not be repeated here.

[0134] The gimbal is equipped with: a wide-angle camera (main camera 1) and a telephoto camera;

[0135] The back panel features: a wide-angle camera (main camera 2) and an ultra-wide-angle camera;

[0136] Taking the above-described configuration of the 10C phone as an example, optionally, when launching the camera application, the 10C phone can activate the wide-angle camera (i.e., main camera 1) on the back panel. After entering automatic composition mode, the 10C phone can then deploy the gimbal and switch to the wide-angle camera (i.e., main camera 2) or telephoto camera on the gimbal. Subsequent operations are described in S103 to S109, and will not be repeated here.

[0137] pass Figure 2 The shooting method shown allows users to simply set their shooting requirements in advance. The phone 10, placed in a fixed position, can then automatically scan the three-dimensional space to find and capture photos that meet those requirements. (Reference) Figure 7 The phone 10 can automatically rotate the gimbal camera to scan three-dimensional space, find and capture the content the user expects, such as people in motion 31-33, animals 34, etc.

[0138] In this way, in multi-person scenarios such as sports, parties, and meetings, based on the above functions, users can not only immerse themselves in the activities, but also capture wonderful moments of the activities without having to hold their mobile phones to find target subjects and compose shots, which greatly improves the shooting experience in multi-person activities.

[0139] Taking the 10A mobile phone as an example again Figure 8This is a flowchart of another shooting method based on a gimbal camera provided in the embodiments of this application.

[0140] S201. Open the camera app and enter photo mode.

[0141] After detecting a user action of clicking the camera app icon, the phone 10A can launch the camera app, turn on the main camera, and display the photo preview interface, showing the image captured by the main camera in the preview window 315.

[0142] S202, Enter the dual-shot mode and deploy the gimbal.

[0143] refer to Figure 9A In this embodiment, the mode bar 311 also includes a mode control 316. Mode control 316 corresponds to the "one-shot-two-shot" mode (second shooting mode). Similarly, the term "one-shot-two-shot" for mode control 316 is merely an example; mode control 312 could also be referred to as other modes, and this application does not limit this. (See reference...) Figure 9B After detecting user operation on mode control 316, mobile phone 10 can enter the one-shot dual-mode.

[0144] Similarly, in scenarios where the main camera is mounted on the gimbal, in photo mode, the phone 10A only activates the main camera without deploying the gimbal, using the main camera in its retracted state. Upon entering the dual-shot mode, the phone 10A then deploys the gimbal, using the main camera in its deployed state.

[0145] Taking the 10B phone as an example, when launching the camera application, the 10B phone defaults to turning on the main camera on the back panel, and displays the image captured by the main camera in the preview window 315; after entering the dual-shot mode, the 10B phone can turn on the gimbal camera (such as a telephoto camera mounted on the gimbal), and display the image captured by the gimbal camera in the preview window 315.

[0146] Taking the iPhone 10C as an example, optionally, when launching the camera app, the iPhone 10C can activate the wide-angle camera (i.e., main camera 1) on the back panel. After entering dual-camera mode, the iPhone 10C then deploys the gimbal and switches to either the wide-angle camera (i.e., main camera 2) or the telephoto camera on the gimbal. Understandably, different configurations of the iPhone 10C can employ different camera activation strategies during the above process.

[0147] Similarly, users can also wake up the smart assistant through voice commands (second voice commands) and control the phone 10 (including phones 10A, 10B, and 10C) to launch the camera application and enter the dual-shot mode.

[0148] S203, User shooting operation detected.

[0149] refer to Figure 9CAfter entering the dual-shot mode, the user can control the gimbal camera to rotate and aim it at the target object (such as a puppy). Then, the user can click the shutter control 321 to take the picture (first user operation).

[0150] S204. Determine the first image corresponding to the moment the user takes a picture, and save the first image to obtain the first photo.

[0151] by Figure 9C For example, at this moment, the image G1 displayed in the preview window 315 is the first image corresponding to the user's shooting operation. Therefore, the shooting operation of clicking the shutter control 321 is also called the shooting operation of the first image. In response to the above shooting operation, the mobile phone 10 can save the first image (i.e., image G1) and obtain the first photo. (Reference) Figure 9D In response to the above shooting operation, the mobile phone 10 will also display a thumbnail of the first image on the playback control 322, and indicate the shooting result (i.e. the first photo) to the user through the thumbnail.

[0152] S205, The first image includes the target object.

[0153] In response to the above shooting operation, the mobile phone 10 will also identify the specific content of the first image to determine whether the first image includes the target shooting object.

[0154] In this embodiment, optionally, the mobile phone 10 determines the target shooting object (first object) based on previously recorded user shooting preferences, such as people, cats, dogs, food, flowers, buildings, etc., that the user frequently photographs. In other embodiments, referring to the description in S102, the mobile phone 10 can also determine the target shooting object through the user's voice or text input in the dual-shot mode, which will not be elaborated here. In some embodiments, the mobile phone 10 can also identify the shooting object that the user focuses on in the first image (e.g., the object with the largest area, the object closest to the center point, etc.) and set it as the target shooting object (first object). In some embodiments, the mobile phone 10 can also determine the above object as the target shooting object based on the click focus operation (second user operation) on an object in the preview image (e.g., the puppy mentioned above).

[0155] S206. Adjust the gimbal camera's posture and / or focal length to ensure that the composition of the target subject within the frame conforms to aesthetic standards.

[0156] After taking the first photo, the phone 10 can adjust the posture and / or focal length of the gimbal camera to match the position of the target subject within the frame with the preset composition template, so that the composition of the target subject within the frame meets aesthetic standards.

[0157] For example, mobile phone 10 can determine that the first image includes a target subject, such as a puppy. After determining that the target subject is in the upper left corner of the frame, mobile phone 10 can determine that the composition of the target subject within the frame does not meet aesthetic standards. Therefore, refer to... Figures 9D-9E The phone can control the gimbal camera to rotate left and up, increasing the focal length and thus obtaining an image G2 that meets aesthetic standards.

[0158] S207. Determine a second image whose composition meets aesthetic standards, and save the second image to obtain the second photograph.

[0159] refer to Figures 9E-9F After obtaining an image G2 (i.e., the second image) that meets aesthetic standards, the mobile phone 10 can automatically capture G2, save G2, and obtain the second photo. After the automatic capture operation is performed on G2, the mobile phone 10 can display a thumbnail of G2 on the playback control 322, indicating to the user that the mobile phone 10 has performed the automatic capture operation and showing the user the shooting result (i.e., the second photo).

[0160] Implementation Figure 8 The shooting method shown allows the phone 10 to recompose the shot after the user manually takes a picture, capturing a new image that includes content of interest to the user. This way, even users with limited shooting skills can take aesthetically pleasing photos using this feature, satisfying their shooting and sharing needs.

[0161] Not limited to mobile phones, electronic devices such as tablets, laptops, in-vehicle devices, smart home devices (such as televisions), and internet conferencing equipment can also be configured. Figure 1 The example shown is a gimbal, on which one or more cameras are mounted. This application embodiment... Figure 2 or Figure 8 The shooting method shown can also be implemented on other electronic devices equipped with a gimbal camera. This application does not limit this application.

[0162] Figure 10 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application.

[0163] like Figure 10 As shown, the electronic device includes a system on chip (SoC), internal memory 82, external memory interface 83, display screen 84, camera module 85, communication module 86, audio module 87, sensor module 88, and gimbal 89.

[0164] A System-on-a-Chip (SoC) contains multiple processors, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), and a baseband processor. These different processors can be independent devices or integrated into a single large device.

[0165] Upper-layer applications, such as smart assistants and camera applications, run on the SoC and provide corresponding functions to users.

[0166] The intelligent assistant is a program based on artificial intelligence (AI) that can determine relevant outputs based on user input such as voice, text, or images for user use. In this embodiment, the intelligent assistant can open the camera application and enter a specific mode of the camera application, such as automatic composition mode or dual-shot mode, based on user input such as voice, text, or images; it can also determine the user's desired shooting object (i.e., the target shooting object) based on user input such as voice, text, or images.

[0167] The SoC connects to one or more internal memories 82. These internal memories 82 include random access memory (RAM) and non-volatile memory (NVM). RAM can be directly read and written by the processor on the SoC and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. NVM can also store executable programs and user and application data. Executable programs and data stored in NVM can be pre-loaded into RAM for direct read and write operations by the processor on the SoC. The processor may also include a cache unit, which can be used to store recently used or repeatedly used instructions or data.

[0168] The computer program code for the imaging method provided in this application embodiment can be stored in the NVM. After power-on, the electronic device can load the aforementioned computer program code stored in the NVM into the SoC for execution, thereby implementing the method. Figure 2 or Figure 8 The shooting method shown helps users capture stunning photos that contain content of interest and whose composition meets aesthetic standards.

[0169] Optionally, some electronic devices may also be equipped with an external memory interface 83. The external memory interface 83 can be used to connect to an external NVM to expand the storage capacity of the electronic device. The computer program code of the shooting method provided in this application embodiment can also be stored in an external NVM connected through the external memory interface 83.

[0170] Display screen 84 is used for display. Display screen 84 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be manufactured using organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniled, microled, micro-oled, quantum dot light-emitting diodes (QLEDs), etc.

[0171] Electronic devices can implement display functions through GPUs, displays, and application processors, etc. Figures 3A-3F , Figures 4A-4D , Figures 9A-9F The user interface shown.

[0172] Communication module 86 includes a wireless communication module and a mobile communication module. The wireless communication module can be used to provide wireless communication solutions for electronic devices, including WLAN (e.g., Wi-Fi), Bluetooth, Bluetooth Low Energy (BLE), Global Positioning System (GPS), Global Navigation Satellite System (GNSS), BeiDou Navigation Satellite System (BDS), frequency modulation (FM), near-field communication (NFC), and infrared (IR). The mobile communication module is used to provide mobile communication solutions for electronic devices, including 2G / 3G / 4G / 5G.

[0173] Electronic devices can achieve wireless communication functions through the communication module 86, such as obtaining composition templates that meet aesthetic standards from the server, obtaining users' shooting preferences from the server, and sharing the photos taken.

[0174] The audio module 87 includes a microphone, a speaker, and a receiver. A microphone, also called a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. A speaker, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. A receiver, also called a "phone," is used to convert audio electrical signals into sound signals.

[0175] In this embodiment, the smart assistant can use the microphone to capture the user's voice and obtain the user's voice commands. During the shooting process, the camera application can use the microphone to capture ambient sound. When playing photos / videos, the gallery application can use the speaker to play the sound from the photos / videos.

[0176] The sensor module 88 includes a touch sensor and a mobile phone inertial measurement unit (IMU).

[0177] A touch sensor, also known as a "touch device," can be integrated into a display screen 84. The touch sensor and display screen 84 together form a touchscreen, also called a "touchscreen." The touch sensor detects touch operations applied to or near it. It then transmits the detected touch operation to the application processor to determine the type of touch event, such as... Figures 3A-3F , Figures 4A-4D , Figures 9A-9F The click operation is shown. Based on the detected touch operation, the electronic device can provide visual output related to the touch operation through the display screen 84, such as switching interfaces, taking pictures, updating controls, etc.

[0178] The mobile phone's IMU is used to acquire the posture data of the mobile phone body.

[0179] In addition to touch sensors, sensor module 88 may also include other sensors, such as pressure sensors, barometric pressure sensors, magnetic sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, ambient light sensors, bone conduction sensors, etc., to enable electronic devices to achieve richer sensing capabilities.

[0180] The above components—SoC, internal memory 82, external memory interface 83, display screen 84, communication module 86, audio module 87, and sensor module 88—are all located in the main body of the phone outside the gimbal, specifically between the display screen, mid-frame, and back panel.

[0181] The gimbal 89 includes a gimbal motor, a gimbal IMU, and a camera module 90. The gimbal motor, gimbal IMU, and camera module 90 are all mounted on the gimbal. Optionally, the gimbal 89 also includes one or more microphones. When the gimbal is deployed, these microphones can perform directional sound pickup as the gimbal rotates.

[0182] The gimbal motor is used to control the rotation of the rotor on arm 12, which in turn controls the rotation of the gimbal camera.

[0183] The gimbal IMU is used to acquire attitude data such as pitch angle, yaw angle, and roll angle of the gimbal camera.

[0184] The camera module 90 includes one or more cameras, such as the wide-angle camera shown in mobile phone 10A, the telephoto camera shown in mobile phone 10B, and both the wide-angle and telephoto cameras shown in mobile phone 10C. These one or more cameras are mounted on a gimbal, i.e., a gimbal camera. The camera includes a photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. An object passes through the lens, generating an optical image that is projected onto the photosensitive element. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP (Image Signal Processor) for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the ISP can be integrated within the camera.

[0185] In this embodiment, before entering a specific mode, such as automatic composition mode or dual-shot mode, the electronic device can use the gimbal camera in a retracted state to capture images. After entering the specific mode, the electronic device can deploy the gimbal and use the gimbal camera in the deployed state. In the deployed state, the electronic device can rotate the gimbal to help the user capture excellent photos containing content of interest to the user and with composition that meets aesthetic standards.

[0186] Optionally, in some electronic devices, the electronic device also includes a camera module 85. The camera module 85 also includes one or more cameras, such as the ultra-wide-angle camera and telephoto camera shown in mobile phone 10A, and the wide-angle camera (main camera) and ultra-wide-angle camera shown in mobile phone 10B. These one or more cameras are mounted on the back panel of the electronic device, i.e., back panel cameras. In some embodiments, the electronic device may also use the back panel camera to capture images before entering a specific mode; after entering a specific mode, the electronic device deploys the gimbal and uses the gimbal camera to capture images.

[0187] The SoC, internal memory 82, external memory interface 83, display screen 84, camera module 85, communication module 86, audio module 87, sensor module 88, and gimbal 89 are connected via a bus and communicate and exchange data based on the aforementioned bus. The aforementioned bus includes, but is not limited to, an inter-integrated circuit (I2C) bus, an inter-integrated circuit sound (I2S) bus, a pulse code modulation (PCM) bus, a universal asynchronous receiver / transmitter (UART) bus, a mobile industry processor interface (MIPI) bus, a general-purpose input / output (GPIO) interface bus, and / or a universal serial bus (USB) interface bus.

[0188] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device. Optionally, the electronic device may also include more components, such as buttons, motors, indicators, and a subscriber identification module (SIM) card interface. The embodiments of this application do not impose such limitations.

[0189] Figure 11 This is a schematic diagram of the hardware and software structure of an electronic device provided in an embodiment of this application.

[0190] like Figure 11 As shown, upper-layer applications such as the smart assistant and camera app run on the SoC. The smart assistant can launch the camera app and enter specific modes of the camera app based on the user's voice, text, or image input, such as automatic composition mode or dual-shot mode. The smart assistant can also identify the target subject by the user's voice, text, or image input, and then send the target subject to the camera app for its use.

[0191] The automatic shooting engine is the program that corresponds to the automatic composition mode and the double shot mode.

[0192] After triggering the automatic framing mode, the camera application can run the automatic shooting engine. The automatic shooting engine can activate the image sensing module, the automatic shooting module, and the gimbal control module. The image sensing module can identify the image reported by the camera and determine whether it contains the target subject of interest to the user. After identifying the target subject, the image sensing module can send a shooting command to the automatic shooting module. The shooting command may carry the frame number of the target image. In response to the above command, the automatic shooting module can perform the shooting operation and capture the target image.

[0193] After the gimbal control module is activated, it communicates with the gimbal driver IC on the gimbal 89 via the gimbal driver, thereby controlling the gimbal motor to rotate, scan three-dimensional space, and find the target object of interest to the user. The phone's IMU and the gimbal's IMU report their respective attitude data to the gimbal control module. The gimbal control module can determine whether the phone 10 is placed stably based on the attitude data from the phone's IMU. If it is not placed stably, the phone 10 can display a prompt message, prompting the user to adjust the position and / or attitude of the phone 10 to ensure stable placement. In a stable placement scenario, the gimbal control module can determine the current attitude of the gimbal camera based on the attitude data reported by the gimbal IMU, and then determine how to control the gimbal motor to rotate based on the current attitude, thereby achieving the function of scanning three-dimensional space and adjusting the composition.

[0194] When the automatic shooting engine is running, it can turn the camera on / off via the camera driver. The aforementioned camera includes camera module 85 (i.e., the back panel camera mounted on the back panel of the electronic device) and camera module 90 (i.e., the gimbal camera mounted on the gimbal). Taking phone 10A as an example, when the camera application is running, the application can use the camera driver to call camera module 90 to activate the wide-angle camera on the gimbal. Taking phone 10B as an example, when the camera application is running, it can use the camera driver to call camera module 85 to activate the wide-angle camera on the back panel; after triggering the automatic composition mode, the automatic shooting engine can use the camera driver to call camera module 90 to activate the telephoto camera on the gimbal.

[0195] The term "user interface (UI)" used in the specification, claims, and drawings of this application refers to the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form acceptable to the user. The user interface of an application is source code written in a specific computer language such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on the terminal device, ultimately presenting user-recognizable content, such as images, text, buttons, and other controls. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined using tags or nodes, such as XML tags. <textview> 、 <imgview> 、

[0196] <videoview>Nodes define the controls contained in the interface. A node corresponds to a control or property in the interface, and after parsing and rendering, the node is presented as the content visible to the user. In addition, many applications, such as hybrid applications, often contain web pages within their interfaces. A web page, also known as a webpage, can be understood as a special control embedded in the application interface. Web pages are source code written in a specific computer language, such as Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), JavaScript (JS), etc. Web page source code can be loaded and displayed as user-readable content by a browser or a web page display component with browser-like functionality. The specific content contained in a webpage is also defined through tags or nodes in the webpage source code; for example, HTML uses tags or nodes to define the content. 、 、 <video> 、 <canvas>Used to define the elements and attributes of a webpage.

[0197] The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0198] As used in the specification and appended claims of this application, the singular expressions "a," "an," "the," "the," "the," and "this" are intended to also include the plural expressions, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any or all possible combinations of one or more of the listed items. As used in the above embodiments, depending on the context, the term "when" can be interpreted as meaning "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining..." or "in response to determining..." or "when (the stated condition or event) is detected" or "in response to detecting (the stated condition or event)."

[0199] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0200] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. A shooting method applied to electronic devices, characterized in that, The method includes: Receive the first instruction input by the user; In the first shooting mode, the image captured by the first camera is displayed in the preview interface of the camera application. The first camera is mounted on a gimbal and rotates in response to the first command. When the first target object appears in the preview interface, the shooting operation is automatically performed to obtain a first photo including the first target object, which is related to the first command.

2. The method according to claim 1, characterized in that, The method further includes: responding to the first instruction, opening the camera application, entering the first shooting mode, turning on the gimbal and turning on the first camera.

3. The method according to claim 1, characterized in that, The first instruction is a voice instruction, and the first instruction includes first information, which is used to instruct the first target object.

4. The method according to claim 1, characterized in that, The first instruction is also related to the second target object, and the method further includes: when the second target object appears in the preview interface, automatically performing a shooting operation to obtain a second photo including the second target object.

5. The method according to claim 1, characterized in that, Responding to the first instruction to rotate the gimbal includes: responding to the first instruction to rotate the gimbal within a first track so that the first target object appears in the preview interface.

6. The method according to claim 5, characterized in that, The first track is a preset track or a user-defined track.

7. The method according to claim 5, characterized in that, When the gimbal is rotated to a first position on the first track and the gimbal is in a first posture, the first target object appears in the preview interface, and the method further includes: After rotating the gimbal to adjust the attitude and / or position of the first camera, the shooting operation is automatically executed; After adjusting the gimbal to the first position and the first posture, continue rotating the gimbal on the first track.

8. The method according to any one of claims 1-7, characterized in that, The method further includes: after the gimbal has rotated for a first duration, stopping the gimbal rotation and turning off the first camera.

9. The method according to any one of claims 1-7, characterized in that, After the automatic shooting operation is performed, the method further includes: after the number of photos taken reaches a first value, stopping the rotation of the gimbal and turning off the first camera, wherein the photos taken are those taken by the first camera automatically performing the shooting operation.

10. The method according to any one of claims 1-7, characterized in that, Before automatically performing the shooting operation, the method further includes: adjusting the posture and / or focal length of the first camera so that the position of the first target object in the preview interface matches the composition template.

11. The method according to claim 1, characterized in that, The rotation of the gimbal includes: rotating the gimbal toward an area where objects are densely distributed in the preview interface.

12. The method according to claim 3, characterized in that, The method further includes: displaying prompt information in the preview interface, the prompt information being related to the first information.

13. The method according to claim 1, characterized in that, The first photograph is either a static photograph composed of a single frame or a dynamic photograph composed of multiple frames.

14. A shooting method applied to an electronic device, characterized in that, The method includes: In the second shooting mode, the first camera is turned on, and the image captured by the first camera is displayed in the preview interface; Upon receiving a first user operation, in response to the first user operation, a first shooting operation is performed to obtain a first photo, wherein the first photo includes a first object; By rotating the gimbal to change the position of the first object in the preview interface, a second shooting operation is automatically performed to obtain a second photo including the first object.

15. The method according to claim 14, characterized in that, The adjusted position of the first object in the preview interface matches the composition template.

16. The method according to claim 14, characterized in that, The method further includes: receiving a second voice command input by the user, and in response to the second voice command, opening the camera application and entering the second shooting mode.

17. The method according to claim 14, characterized in that, The method further includes: When the preview interface includes multiple objects, the object that the user is interested in is determined based on the photos the user has previously taken, and the first object is the object that the user is interested in.

18. The method according to claim 14, characterized in that, Before receiving the first user operation, the method further includes: A second user operation is received on the preview window in the preview interface, and the second user operation corresponds to the first object.

19. The method according to claim 14, characterized in that, The first object is the object in the first photo that is closest to the center point of the photo.

20. The method according to claim 14, characterized in that, The second photograph is a static photograph composed of a single frame or a dynamic photograph composed of multiple frames.

21. An electronic device, characterized in that, It includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store a computer program that, when the one or more processors execute the computer program, causes the method as described in any one of claims 1-20 to be performed.

22. A computer-readable storage medium comprising a computer program, characterized in that, When the computer program is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-20.

Images