Shooting control method, mobile terminal and computer-readable storage medium

By automatically adjusting the mobile terminal parameters by acquiring information about the photographer and the subject, the problem of cumbersome operation when shooting with a mobile terminal is solved, improving convenience and user experience, especially the shooting effect when there are interference objects.

CN113923339BActive Publication Date: 2025-10-28ZTE CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010653357.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-08
Publication Date
2025-10-28
Estimated Expiration
2040-07-08

AI Technical Summary

Technical Problem

When users take photos using mobile devices, they need to manually adjust the device to obtain a suitable shooting angle. This is especially cumbersome when there are obstructions, affecting the convenience of shooting and the user experience.

Method used

By acquiring the photographer's feature information and the shooting information of multiple subjects, the target subject is determined, and the shooting parameters of the mobile terminal are automatically adjusted based on the target subject's information, including the deformation of the display unit, the focal length of the camera, and the sensitivity of the microphone, in order to optimize the shooting effect.

Benefits of technology

It improves the convenience of shooting with mobile devices, enhances the user experience, and ensures that parameters can be automatically selected and adjusted to achieve the best shooting results when shooting multiple subjects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113923339B_ABST
    Figure CN113923339B_ABST
Patent Text Reader

Abstract

This application discloses a shooting control method, a mobile terminal, and a computer-readable storage medium, applied in the field of image processing. The shooting control method specifically includes: acquiring feature information of the photographer and shooting information of multiple subjects, to determine a target subject from the multiple subjects based on the photographer's feature information and the shooting information of the multiple subjects; and adjusting the shooting parameters of the mobile terminal according to the shooting information corresponding to the target subject to capture the image. The technical solution of this application enables the mobile terminal to automatically adjust shooting parameters, improving the convenience of shooting and enhancing the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of image processing, and more specifically to a shooting control method, a mobile terminal, and a computer-readable storage medium. Background Technology

[0002] With the widespread use of mobile devices such as smartphones, people can use them to take photos and videos to record their lives. However, when using mobile devices to take pictures, users need to manually adjust the device to ensure the camera achieves a suitable shooting angle and captures a clear image. When there are distracting objects in the frame, users need to continuously adjust the device to keep the camera focused on the subject, making the process cumbersome. Therefore, enabling mobile devices to automatically adjust shooting parameters, improving ease of use and enhancing the user experience, has become an urgent problem to be solved. Summary of the Invention

[0003] This application provides a shooting control method, a mobile terminal, and a computer-readable storage medium, enabling the mobile terminal to automatically adjust shooting parameters, improving shooting convenience and enhancing user experience.

[0004] In a first aspect, embodiments of this application provide a shooting control method, the method comprising:

[0005] The system acquires the photographer's feature information and the shooting information of multiple subjects to determine a target subject from among the multiple subjects based on the photographer's feature information and the shooting information of the multiple subjects; and adjusts the shooting parameters of the mobile terminal according to the shooting information corresponding to the target subject to shoot the target subject.

[0006] Secondly, embodiments of this application provide a mobile terminal, the mobile terminal including a processor and a memory:

[0007] The memory is used to store computer programs; the processor is used to execute the computer programs and, when executing the computer programs, to implement the shooting control method as described above.

[0008] Thirdly, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement the shooting control method described above.

[0009] This application discloses a shooting control method, a mobile terminal, and a computer-readable storage medium. By acquiring the photographer's feature information and shooting information of multiple subjects, a target subject is determined from the multiple subjects based on these features. Finally, the shooting parameters of the mobile terminal are adjusted according to the shooting information corresponding to the determined target subject, thereby capturing the target subject. When multiple subjects exist within the shooting field of view of the mobile terminal, the mobile terminal can determine the target subject from among them and automatically adjust the shooting parameters accordingly to complete the shooting of the target subject, improving the convenience for users when shooting with the mobile terminal and enhancing the user experience. Attached Figure Description

[0010] Figure 1 This is a schematic block diagram of a mobile terminal provided in an embodiment of this application;

[0011] Figure 2 This is a schematic diagram of the structure of a mobile terminal provided in an embodiment of this application;

[0012] Figure 3a This is a schematic diagram of the shooting range of the display unit before bending, provided in an embodiment of this application;

[0013] Figure 3b This is a schematic diagram of the shooting range of the display unit after it is bent, as provided in the embodiment of this application;

[0014] Figure 4 This is a schematic flowchart illustrating the steps of a shooting control method provided in an embodiment of this application;

[0015] Figure 5 This is a schematic diagram illustrating an application scenario of a shooting control method provided in an embodiment of this application;

[0016] Figure 6a This is a display content on a mobile terminal display unit provided in the embodiments of this application;

[0017] Figure 6b This is a display content on a mobile terminal display unit provided in the embodiments of this application;

[0018] Figure 6c This is a display content on a mobile terminal display unit provided in the embodiments of this application;

[0019] Figure 7 This is a schematic diagram illustrating another application scenario of the shooting control method provided in the embodiments of this application;

[0020] Figure 8a This is a display content on a mobile terminal display unit provided in the embodiments of this application;

[0021] Figure 8b This is a display content on a mobile terminal display unit provided in the embodiments of this application;

[0022] Figure 8c This is a type of display content on a mobile terminal display unit provided in the embodiments of this application. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0024] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0025] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0026] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0027] Embodiments of this application provide a shooting control method, a mobile terminal, and a computer-readable storage medium. The shooting control method, when multiple subjects exist within the shooting range of the mobile terminal, identifies a target subject from among them and automatically adjusts shooting parameters based on the target subject to complete the shooting of the target subject, thereby improving the convenience for users when shooting with the mobile terminal and enhancing the user experience.

[0028] Please see Figure 1 , Figure 1 This is a schematic block diagram of a mobile terminal provided in an embodiment of this application. The mobile terminal 100 may include a processor 101 and a memory 102, wherein the processor 101 and the memory 102 can be connected via a bus.

[0029] The memory 102 may include a non-volatile storage medium and internal memory.

[0030] Non-volatile storage media can store operating systems and computer programs. These computer programs include program instructions that, when executed, cause the processor to perform any shooting control method.

[0031] The processor 101 provides computing and control capabilities to support the operation of the entire terminal device.

[0032] Internal memory provides an environment for the execution of computer programs in non-volatile storage media. When these computer programs are executed by a processor, they enable the processor to perform any shooting control method.

[0033] Please see Figure 2 , Figure 2 This is a schematic diagram of the structure of a mobile terminal provided in an embodiment of this application. The mobile terminal 100 may further include a display unit 103, a microphone group 104, a front camera 105, and a rear camera. The display unit 103, microphone group 104, front camera 105, and rear camera are all signal-connected to the processor 101.

[0034] The display unit 103 is a flexible display unit that can be bent or folded, such as a foldable screen or a bendable screen. The display unit 103 adjusts the bending parameters in response to the control of the processor 101, wherein the bending parameters include the bending position and the bending angle.

[0035] The display unit 103 can be a screen that can be partially bent or folded, or it can be a flexible screen that can be bent or folded entirely. For example Figure 3a and Figure 3b The diagrams shown illustrate the changes in the shooting range of the display unit before and after bending. The display unit 103 adjusts the bending parameters in response to the control of the processor 101, thereby changing the shooting angle and range, enabling better shooting of the target object and improving the shooting effect.

[0036] In practice, the deformation of the display unit 103 can be controlled by pre-setting a deformation driving circuit below the display unit 103 or by pre-setting a deformation control module in the bendable part of the display unit 103.

[0037] The microphone group 104 contains at least three microphones, and the three microphones are respectively positioned at different angles on the mobile terminal 100, for example... Figure 2 As shown, the microphone group 104 contains four microphones, which are respectively set at four different angles of the mobile terminal 100.

[0038] The front camera 105 is used to capture image information of the photographer who is taking pictures using the mobile terminal 100, and sends the captured image information to the processor 101, which processes the image information to obtain the feature information of the photographer.

[0039] In some embodiments, when the photographer takes a selfie using the front camera 105 of the mobile terminal 100, the photographer is the subject of the photo. Therefore, the front camera 105 can also be used to collect the shooting information of the subject. The front camera 105 can also be located in the bendable area of ​​the display unit 103.

[0040] The rear camera is located in the bendable area of ​​the display unit 103 and is used to collect shooting information of the subject. In some embodiments, the rear camera can also be used to collect image information of the photographer who is taking pictures using the mobile terminal 100.

[0041] In some embodiments, the mobile terminal 100 further includes a sensor connected to the processor 101. The sensor can cooperate with the front camera 105 or the rear camera to collect feature information of the subject. The sensor can be located on one side of the front camera 105, on the same side as the rear camera, or on both sides. For example, the sensor can be an infrared sensor, cooperating with the front camera 105 or the rear camera to capture images of the subject's eyes, thereby determining the focus position of the subject's gaze on the display unit 103.

[0042] Understandable. Figure 1 and Figure 2 The structure shown is merely a block diagram of a portion of the structure related to the solution of this application and does not constitute a limitation on the mobile terminal to which the solution of this application is applied. A specific mobile terminal may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0043] It should be understood that processor 101 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, the general-purpose processor can be a microprocessor or any conventional processor.

[0044] In one embodiment, the processor 101 is configured to run a computer program stored in a memory to perform the following steps:

[0045] The system acquires the photographer's feature information and the shooting information of multiple subjects to determine a target subject from among the multiple subjects based on the photographer's feature information and the shooting information of the multiple subjects; and adjusts the shooting parameters of the mobile terminal according to the shooting information corresponding to the target subject to shoot the target subject.

[0046] In some embodiments, when the processor 101 determines the target subject from the plurality of subjects based on the feature information of the photographer and the shooting information of the plurality of subjects, it is configured to:

[0047] Based on the shooting information of each of the shooting objects, determine whether there is an interfering object among the multiple shooting objects; if there is an interfering object among the multiple shooting objects, then determine the target shooting object based on the characteristic information of the photographer and the shooting information of the interfering object.

[0048] In some embodiments, the shooting information of the shooting object includes at least one of image information and sound information; the processor 101, when implementing the step of determining whether there is an interfering object among the plurality of shooting objects based on the shooting information of each shooting object, is configured to:

[0049] Based on the image information, determine whether the image ratio of each of the photographed objects exceeds a first preset threshold, where the image ratio refers to the ratio of the image of the photographed object to the field of view of the mobile terminal; if the image ratio of the photographed object exceeds the first preset threshold, then the photographed object is determined to be an interference object; or based on the sound information, determine whether the volume of each of the photographed objects exceeds a second preset threshold; if the volume of the photographed object exceeds the second preset threshold, then the photographed object is determined to be an interference object.

[0050] In some embodiments, when the processor 101 determines the target object based on the feature information of the photographer and the shooting information of the interfering object, it is configured to:

[0051] The position information of the interfering object relative to the mobile terminal is determined based on the shooting information of the interfering object, and the position information includes the angle of the interfering object relative to the mobile terminal; the target shooting object is determined based on the angle of the interfering object relative to the mobile terminal and the feature information of the photographer.

[0052] In some embodiments, the feature information of the photographer includes at least one of the photographer's facial orientation information and the focus information of the gaze on the display unit of the mobile terminal; when the processor 101 determines the target object to be photographed based on the angle of the interference object relative to the mobile terminal and the feature information of the photographer, it is configured to:

[0053] Based on the photographer's facial orientation information, determine whether the angle of the photographer's facial orientation and the angle of the interference object relative to the mobile terminal are in the same direction; if the angle of the photographer's facial orientation and the angle of the interference object relative to the mobile terminal are in the same direction, then the interference object is determined to be the target subject; or based on the focus information of the photographer's gaze on the display unit of the mobile terminal, determine whether the angle of the photographer's gaze and the angle of the interference object relative to the mobile terminal are in the same direction; if the angle of the photographer's gaze and the angle of the interference object relative to the mobile terminal are in the same direction, then the interference object is determined to be the target subject.

[0054] In some embodiments, when the processor 101 adjusts the shooting parameters of the mobile terminal according to the shooting information corresponding to the target shooting object, it is configured to:

[0055] The position information of the target object relative to the mobile terminal is obtained, so as to adjust the shooting parameters of the mobile terminal according to the position information of the target object relative to the mobile terminal.

[0056] In some embodiments, the location information includes the angle and distance of the target object relative to the mobile terminal; when the processor 101 implements the adjustment of the shooting parameters of the mobile terminal according to the position of the target object relative to the mobile terminal, it is configured to:

[0057] The deformation angle of the display unit of the mobile terminal is adjusted according to the angle of the target object relative to the mobile terminal; or the camera parameters of the mobile terminal's camera, including the focal length of the camera, are adjusted according to the distance of the target object relative to the mobile terminal; or the sound recording parameters of the mobile terminal's microphone group, including the sensitivity of each microphone in the microphone group, are adjusted according to the distance of the target object relative to the mobile terminal.

[0058] In some embodiments, when the processor 101 implements the adjustment of the deformation angle of the display unit of the mobile terminal according to the angle of the target object relative to the mobile terminal, it is configured to:

[0059] The shooting angle of the mobile terminal's camera is determined based on the angle of the target object relative to the mobile terminal; based on the shooting angle of the mobile terminal's camera, the deformation parameters of the mobile terminal's display unit are determined based on a preset correspondence between the shooting angle of the camera and the deformation parameters of the display unit, so as to adjust the deformation angle of the mobile terminal's display unit according to the deformation parameters of the mobile terminal's display unit.

[0060] For ease of understanding, the following will combine Figure 1 The mobile terminal described above provides a detailed introduction to the shooting control method provided in the embodiments of this application. It should be noted that the mobile terminal described above does not constitute a limitation on the application scenarios of the shooting control method provided in the embodiments of this application.

[0061] For ease of description, this application's embodiments use the example of a photographer using the rear camera of a mobile terminal to photograph a subject for detailed explanation. Please refer to... Figure 4 , Figure 4 This is a schematic flowchart illustrating the steps of a shooting control method provided in an embodiment of this application. The method may include the following steps:

[0062] S201. Obtain the characteristic information of the photographer and the shooting information of multiple subjects, so as to determine the target subject from multiple subjects based on the characteristic information of the photographer and the shooting information of multiple subjects.

[0063] After the photographer opens the camera app installed on their mobile device, the app's viewfinder will be displayed on the device's screen. Once the photographer starts shooting, the mobile device enters shooting mode. In shooting mode, the mobile device selects a subject within the viewfinder as the primary subject and photographs it. In practice, the primary subject can be selected actively or specified by the photographer.

[0064] During the process of capturing the main subject, the mobile terminal uses both the front and rear cameras to collect information in real time and send it to the processor for processing. The front camera captures image information of the photographer and sends it to the processor, which processes and identifies the photographer's features. The rear camera captures image information of each subject within the field of view and sends the information of each subject to the processor.

[0065] The photographer's features include at least one of the photographer's facial orientation and the focus of their gaze on the display unit of the mobile terminal.

[0066] The image information of the photographer includes the face image of the photographer. The processor processes and recognizes the image information of the photographer to obtain the feature information of the photographer. For example, it can be to perform image recognition on the face image of the photographer, recognize the pupil outline and the diagonal line of the corner of the eye in the face image, and then calculate the focus position of the gaze on the screen based on the displacement between the center of the pupil of a single eye and the center of the diagonal line of the corner of the eye, as well as the displacement between the midpoint of the line connecting the centers of the pupils of both eyes and the center of the eye image.

[0067] For example, eye-tracking technology can be used to obtain the focal position of the gaze on the screen. The sensor set on the mobile terminal emits infrared light, the front camera captures the video of the human eye, the processor processes the video of the human eye to obtain the position of the pupil and corneal reflection point, and finally the gaze angle is determined based on the offset of the pupil and corneal reflection point.

[0068] Another example is to train a neural network model by using the image of the photographer's face as input to the neural network model, thereby obtaining the photographer's facial orientation information.

[0069] After acquiring the photographer's feature information and the subject's shooting information, the processor can determine the target subject from multiple subjects based on the photographer's feature information and the subject's shooting information.

[0070] In some embodiments, determining a target subject from multiple subjects includes: determining whether there is an interfering object among the multiple subjects based on the shooting information of each subject; if there is an interfering object among the multiple subjects, determining the target subject based on the characteristic information of the photographer and the shooting information of the interfering object.

[0071] Interference objects refer to those that cause sound or image interference to the main subject during the shooting process. The mobile terminal can determine whether interference objects exist among multiple subjects based on the shooting information acquired for each subject, allowing for timely adjustments to shooting parameters and optimization of shooting results.

[0072] The captured information includes at least one of the image information of the subject captured by the rear camera and the audio information of the subject collected by the microphone array. When identifying a potential source of interference, a preset threshold can be set to determine whether the subject is a source of interference.

[0073] In some embodiments, determining whether there is an interfering object among multiple shooting objects based on the shooting information of each shooting object includes: determining whether the image ratio of each shooting object exceeds a first preset threshold based on image information; if the image ratio of the shooting object exceeds the first preset threshold, then determining that the shooting object is an interfering object; or determining whether the volume of each shooting object exceeds a second preset threshold based on sound information; if the volume of the shooting object exceeds the second preset threshold, then determining that the shooting object is an interfering object.

[0074] Here, the image ratio refers to the ratio of the image of the subject to the field of view of the mobile terminal. The first preset threshold can be, for example, an image ratio threshold. The processor processes and calculates the image information of the subject to obtain the field of view ratio of each subject, that is, the ratio of the image of the subject to the field of view of the mobile terminal. It determines whether the field of view ratio of the subject exceeds the first preset threshold. If the field of view ratio of the subject exceeds the first preset threshold, the subject is considered to be an interfering object that may interfere with the current shooting effect.

[0075] The second preset threshold could be, for example, a volume threshold. The processor determines the volume of the sound emitted by the subject based on the sound information of the subject and determines whether the volume of the subject exceeds the second preset threshold. If the volume of the subject exceeds the second preset threshold, the subject is considered to be an interfering object that may interfere with the current shooting effect.

[0076] In some embodiments, if it is determined that there are no interfering objects in the subject being photographed, then the main subject being photographed will continue to be photographed to ensure the photographing effect of the main subject.

[0077] In some embodiments, when the photographer is taking pictures of people, before determining whether there are any interfering objects among the subjects, facial recognition can be performed on each subject to determine whether each subject appearing in the field of view of the mobile terminal is a person. If a subject appearing in the field of view of the mobile terminal is not a person, then the determination of interfering objects for that subject is not required.

[0078] For example, if a boy and a large tree appear in the field of view of a mobile terminal, face recognition is first performed on each subject to detect whether they are people. If the tree is not a person, the tree can be ignored and it can be assumed that there are no interfering objects in the field of view, thus reducing the amount of computation.

[0079] Once it is determined that there is a distracting object among the subjects to be photographed, the target subject can be determined based on the photographer's characteristic information and the shooting information of the distracting object. Determining the target subject based on the photographer's characteristic information and the shooting information of the distracting object includes: determining the position information of the distracting object relative to the mobile terminal based on the shooting information of the distracting object; and determining the target subject based on the angle of the distracting object relative to the mobile terminal and the photographer's characteristic information.

[0080] The shooting information of the interfering object is selected from the image information of each shooting object. The shooting information includes at least one of the image information of the interfering object captured by the rear camera and the sound information of the interfering object collected by the microphone group. The position information includes the angle of the interfering object relative to the mobile terminal.

[0081] When determining the position of an interfering object relative to a mobile terminal based on image information, a neural network model can be pre-trained, using the image information of the interfering object as input to the model to obtain the angle of the interfering object relative to the mobile terminal. During neural network model training, sample images of the object taken from different angles relative to the mobile terminal, along with the angle of the object relative to the mobile terminal at those angles, are used as training samples to train the neural network model.

[0082] When determining the position of the interfering object relative to the mobile terminal based on sound information, for example, the same segment of sound information collected by each microphone in the microphone group can be processed to calculate the relative position of the sound source with respect to each microphone, thereby determining the position of the sound source and obtaining the angle of the interfering object relative to the mobile terminal.

[0083] In some embodiments, when the microphone group collects sound information from multiple different interfering objects, the sound information of each interfering object can be extracted from the mixed sound information of multiple interfering objects by utilizing acoustic characteristics and spectral characteristics.

[0084] After determining the angle of each subject relative to the mobile terminal, the target subject can be determined based on the angle of each subject relative to the mobile terminal and the characteristic information of the photographer.

[0085] In some embodiments, the photographer's characteristic information includes at least one of the photographer's facial orientation information and the focus information of the photographer's gaze on the display unit of the mobile terminal. Determining the target subject based on the angle of the interfering object relative to the mobile terminal and the photographer's characteristic information includes: determining whether the photographer's facial orientation and the angle of the interfering object relative to the mobile terminal are in the same direction based on the photographer's facial orientation information; if the photographer's facial orientation and the angle of the interfering object relative to the mobile terminal are in the same direction, then the interfering object is determined to be the target subject; or determining whether the photographer's gaze and the angle of the interfering object relative to the mobile terminal are in the same direction based on the focus information of the photographer's gaze on the display unit of the mobile terminal; if the photographer's gaze and the angle of the interfering object relative to the mobile terminal are in the same direction, then the interfering object is determined to be the target subject.

[0086] Specifically, if the angle of the photographer's face relative to the interfering object is determined to be in the same direction as the angle of the interfering object relative to the mobile terminal, then the photographer's line of sight is considered to be in the same direction as the direction of the interfering object relative to the mobile terminal. The interfering object is then identified as the new target subject, meaning the main subject has changed. The shooting parameters of the mobile terminal are then adjusted so that the mobile terminal can capture the target subject. If the angle of the photographer's face relative to the interfering object is determined to be in the same direction as the angle of the interfering object relative to the mobile terminal, then the photographer's line of sight is considered to be in the same direction as the direction of the interfering object relative to the mobile terminal. The interfering object is then determined to be not the target subject. The shooting parameters of the mobile terminal are then adjusted to optimize the shooting effect.

[0087] Similarly, if it is determined that the focus direction of the photographer's line of sight is in the same direction as the angle of the interfering object relative to the mobile terminal, then the direction of the photographer's line of sight relative to the interfering object is considered to be consistent with that of the mobile terminal. The interfering object is then identified as the new target subject, meaning the main subject has changed. The shooting parameters of the mobile terminal are then adjusted so that the mobile terminal can capture the target subject. If it is determined that the focus direction of the photographer's line of sight is not in the same direction as the angle of the interfering object relative to the mobile terminal, then the direction of the photographer's line of sight relative to the interfering object is considered to be inconsistent with that of the mobile terminal. The interfering object is then determined not to be the target subject, and the shooting parameters of the mobile terminal are adjusted to optimize the shooting effect.

[0088] S202. Adjust the shooting parameters of the mobile terminal according to the shooting information corresponding to the target shooting object in order to shoot the target shooting object.

[0089] After identifying the target subject, the processor can adjust the shooting parameters of the mobile terminal based on the shooting information corresponding to the target subject, thereby taking a picture of the target subject.

[0090] In some embodiments, adjusting the shooting parameters of the mobile terminal according to the shooting information corresponding to the target shooting object includes: obtaining the position information of the target shooting object relative to the mobile terminal, so as to adjust the shooting parameters of the mobile terminal according to the position information of the target shooting object relative to the mobile terminal.

[0091] During the process of identifying the target subject, the position information of each subject relative to the mobile terminal has been determined based on the subject's shooting information. Therefore, the position information of the target subject relative to the mobile terminal can be directly retrieved from this information, and the shooting parameters of the mobile terminal can be adjusted based on the position information of the target subject relative to the mobile terminal.

[0092] In some embodiments, adjusting the shooting parameters of the mobile terminal according to the position information of the target object relative to the mobile terminal includes: adjusting the deformation angle of the display unit of the mobile terminal according to the angle of the target object relative to the mobile terminal; or adjusting the imaging parameters of the camera of the mobile terminal according to the distance of the target object relative to the mobile terminal, the imaging parameters including the focal length of the camera; or adjusting the sound reception parameters of the microphone group of the mobile terminal according to the distance of the target object relative to the mobile terminal, the sound reception parameters including the sensitivity of each microphone in the microphone group.

[0093] The location information includes not only the angle of the target object relative to the mobile terminal, but also the distance of the target object relative to the mobile terminal. The shooting parameters of the mobile terminal include at least one of the deformation angle of the mobile terminal's display unit, the camera's image capture parameters, and the microphone's sound recording parameters.

[0094] When adjusting the shooting parameters of a mobile terminal, the deformation parameters of the display unit of the mobile terminal can be adjusted according to the angle of the target camera object relative to the mobile terminal. The deformation parameters include deformation angle and deformation position.

[0095] In some embodiments, adjusting the deformation angle of the display unit of the mobile terminal according to the angle of the target object relative to the mobile terminal includes: determining the shooting angle of the camera of the mobile terminal according to the angle of the target object relative to the mobile terminal; determining the deformation parameters of the display unit of the mobile terminal based on a preset correspondence between the shooting angle of the camera and the deformation parameters of the display unit, so as to adjust the deformation angle of the display unit of the mobile terminal according to the deformation parameters of the display unit of the mobile terminal.

[0096] The angle of the target object relative to the mobile terminal includes the angle of the target object relative to the mobile terminal. To achieve better shooting results, the mobile terminal's camera can be positioned directly facing the target object. In other words, the angle of the target object relative to the mobile terminal can be the shooting angle of the mobile terminal's camera.

[0097] Based on the shooting angle of the mobile terminal's camera, the deformation parameters of the display unit are determined using the pre-stored correspondence between the camera's shooting angle and the deformation parameters of the display unit. After determining the deformation parameters, the mobile terminal's display unit can adjust the screen bending according to these parameters, thereby enabling the camera to reach the shooting angle and optimizing the shooting effect.

[0098] It can also adjust the camera parameters of the mobile terminal's camera based on the distance of the target object relative to the mobile terminal. The camera parameters include the camera's focal length.

[0099] It can also adjust the microphone parameters of the mobile terminal based on the distance between the target object and the mobile terminal. The microphone parameters include the sensitivity of each microphone in the microphone group.

[0100] The shooting control method provided in the above embodiments acquires the photographer's feature information and shooting information of multiple subjects, thereby determining the target subject from among the multiple subjects based on the photographer's feature information and the shooting information of the multiple subjects. Finally, it adjusts the shooting parameters of the mobile terminal according to the shooting information corresponding to the determined target subject, thereby shooting the target subject. When there are multiple subjects within the shooting range of the mobile terminal, the mobile terminal can determine the target subject from among the multiple subjects and automatically adjust the shooting parameters according to the target subject, thereby completing the shooting of the target subject, improving the convenience for users when shooting with the mobile terminal, and enhancing the user experience.

[0101] Please see Figure 5 , Figure 5 This is a schematic diagram illustrating an application scenario of a shooting control method provided in an embodiment of this application. When shooting in public places, due to the large number of people and high population mobility, other people may accidentally enter the field of view of the mobile terminal, affecting the shooting.

[0102] like Figure 5 The image shows a scene where a photo is taken in a public place. A is the subject of the photo, and B is the photographer. A mobile device is used to take a photo of subject A.

[0103] After photographer E turns on the mobile device and enters shooting mode, the mobile device begins to photograph subject A. At this time, the content displayed on the mobile device's display unit is as follows: Figure 6a As shown.

[0104] During the filming of subject A, the front camera on the mobile terminal continuously captures image information of the photographer B and sends the captured image information to the processor, enabling the processor to obtain the feature information of photographer B. The rear camera continuously captures image information of all subjects within the field of view, including subject A, and sends the captured image information of the subjects to the processor.

[0105] If a shooting object C is detected within the field of view at a certain moment during the shooting process, the processor determines the image ratio of the shooting object C based on the shooting information of the shooting object C. When the image ratio of the shooting object C is greater than a first preset threshold, the shooting object C is determined to be an interference object. At this time, the processor determines the angle of the shooting object C relative to the mobile terminal based on the shooting information of the shooting object C, and determines whether the shooting object C is the target shooting object based on the feature information of the photographer B.

[0106] When the photographer B's facial orientation changes from subject A to subject C, subject C is identified as the target subject. Based on the angle of subject C relative to the mobile terminal, the mobile terminal's shooting parameters are determined. The mobile terminal then adjusts its display unit according to these parameters, causing the camera to face subject C and capture the image. The content displayed on the display unit at this time is as follows: Figure 6b As shown.

[0107] When photographer B's facial orientation remains unchanged and always faces the subject A, it is determined that subject C is not the target subject. Based on the angle of subject C relative to the mobile terminal, the mobile terminal's shooting parameters are determined, such as adjusting the camera's focal length and controlling the distortion of the display unit, to reduce the image proportion of subject C within the frame, thereby reducing interference with subject A and improving the shooting effect. At this time, the content displayed on the display unit is as follows: Figure 6c As shown.

[0108] Please see Figure 7 , Figure 7 This is a schematic diagram illustrating another application scenario of the shooting control method provided in this application embodiment. In a meeting scenario, when it is necessary to record meeting details via video, since multiple people often speak at the meeting, the photographer needs to constantly adjust the position of the mobile terminal to adjust the shooting angle to achieve a better shooting effect.

[0109] like Figure 7 As shown, this is a meeting scene with four participants (A, B, C, and D) who are the subjects of the video recording, and E, the videographer, who is using a mobile device to record the meeting video.

[0110] After photographer E turns on their mobile device and enters recording mode, the device begins recording the meeting video. Photographer E faces participant A, setting participant A as the primary subject of the recording. While participant A is speaking, the content displayed on the mobile device's screen is as follows: Figure 8a As shown, the display unit can also display the volume of participant A's speech.

[0111] During participant A's speech, the microphone array on the mobile terminal continuously collects the sound information of the four participants, and the front camera on the mobile terminal continuously collects the image information of the photographer E, and sends the collected image information to the processor so that the processor can obtain the feature information of the photographer E.

[0112] If participant C starts speaking at the same time as participant A is being filmed, the processor determines the volume of participant C based on the collected sound information of participant C. If the volume of participant C is greater than the second preset threshold, participant C is determined to be an interference object. At this time, the processor determines the angle and distance of participant C relative to the mobile terminal based on the sound information of participant C collected by the microphone group, and determines whether participant C is the target filming object based on the feature information of the photographer E.

[0113] If participant C is identified as the target subject, the shooting parameters of the mobile terminal are determined based on the angle and distance of participant C relative to the mobile terminal. The mobile terminal then adjusts the display unit according to these parameters, causing the camera to face participant C and capture the image. The content displayed on the display unit at this time is as follows: Figure 8b As shown.

[0114] If it is determined that participant C is not the target subject, the microphone parameters of the mobile terminal are adjusted according to the distance between participant C and the mobile terminal to optimize the sound pickup effect on participant A and thus the shooting effect. At this time, the content displayed on the display unit is as follows: Figure 8c As shown.

[0115] The embodiments of this application also provide a computer-readable storage medium storing a computer program, the computer program including program instructions, and the processor executing the program instructions to implement any of the shooting control methods provided in the embodiments of this application.

[0116] The computer-readable storage medium can be an internal storage unit of the mobile terminal described in the foregoing embodiments, such as the hard drive or memory of the mobile terminal. Alternatively, the computer-readable storage medium can be an external storage device of the mobile terminal, such as a plug-in hard drive, smart media card (SMC), secure digital card (SD), flash card, etc., equipped on the mobile terminal.

[0117] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A shooting control method, characterized in that, The method includes: Acquire the photographer's characteristic information and the shooting information of multiple subjects; Based on the shooting information of each of the shooting objects, determine whether there are interfering objects among the multiple shooting objects; If there is an interfering object among the multiple shooting objects, the target shooting object is determined according to the characteristic information of the photographer and the position information of the interfering object relative to the mobile terminal. The position information includes the angle of the interfering object relative to the mobile terminal, and the position information is obtained based on the shooting information of the interfering object. Obtain the angle of the target object relative to the mobile terminal; The shooting angle of the mobile terminal's camera is determined based on the angle of the target object relative to the mobile terminal; Based on the shooting angle of the mobile terminal's camera, the deformation parameters of the mobile terminal's display unit are determined according to a preset correspondence between the shooting angle of the camera and the deformation parameters of the display unit. The deformation angle of the mobile terminal's display unit is then adjusted according to the deformation parameters of the mobile terminal's display unit to capture the target object.

2. The shooting control method according to claim 1, characterized in that, The shooting information of the shooting object includes at least one of image information and sound information; the step of determining whether there is an interfering object among the multiple shooting objects based on the shooting information of each shooting object includes: Based on the image information, determine whether the image ratio of each of the photographed objects exceeds a first preset threshold, wherein the image ratio refers to the ratio of the image of the photographed object to the field of view of the mobile terminal; If the image ratio of the photographed object exceeds a first preset threshold, then the photographed object is determined to be an interfering object; or Based on the sound information, determine whether the volume of each of the photographed objects exceeds a second preset threshold; If the volume of the object being photographed exceeds a second preset threshold, then the object being photographed is determined to be an interference object.

3. The shooting control method according to claim 1, characterized in that, The photographer's characteristic information includes at least one of the photographer's facial orientation information and the focus information of their gaze on the display unit of the mobile terminal; the step of determining the target object based on the angle of the interfering object relative to the mobile terminal and the photographer's characteristic information includes: Based on the facial orientation information of the photographer, determine whether the angle of the photographer's facial orientation and the angle of the interference object relative to the mobile terminal are in the same direction; If the angle of the photographer's face relative to the interference object is the same as the angle of the interference object relative to the mobile terminal, then the interference object is determined to be the target object; or Based on the focusing information of the photographer's gaze on the display unit of the mobile terminal, it is determined whether the focusing direction of the photographer's gaze is the same as the angle of the interfering object relative to the mobile terminal; If the focusing direction of the photographer's line of sight is the same as the angle of the interfering object relative to the mobile terminal, then the interfering object is determined to be the target object to be photographed.

4. A mobile terminal, characterized in that, The mobile terminal includes a processor and a memory: The memory is used to store computer programs; The processor is configured to execute the computer program and, when executing the computer program, implement the shooting control method as described in any one of claims 1 to 3.

5. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement the shooting control method as described in any one of claims 1 to 3.

Citation Information

Patent Citations

  • Focusing plane adjusting method and electronic device

    CN105611167A

  • Focal length adjusting method and related product

    CN110248091A