Shooting method, device, equipment and medium

Abstract

The invention discloses a shooting method and device, equipment and a medium, and belongs to the technical field of shooting. The method comprises the following steps: displaying a shooting preview interface, wherein the shooting preview interface comprises a first shooting preview picture captured by a first camera; shooting through the first camera according to the first shooting parameter to obtain a target object image; the first shooting parameter is generated based on the shooting parameter of the second camera under the condition that the first camera does not capture the target object and the second camera captures the target object.

Description

Technical Field

[0001] The present application belongs to the field of photographing technology, and specifically relates to a photographing method, device, equipment and medium. Background Art

[0002] In daily life, users hope to capture the moment of a moving object with a camera, such as the moment of crossing the finish line in a race. However, the captured images often contain motion artifacts, resulting in a decrease in image quality.

[0003] In the prior art, when a user needs to take a snapshot, the user usually checks whether a person appears in the camera screen. Once a person is found in the camera screen, the user immediately controls the camera to take the snapshot.

[0004] However, this shooting method in the prior art is prone to capturing images with inappropriate parameters, resulting in a problem of poor captured image quality. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a shooting method, device, equipment and medium, which can solve the technical problem of poor captured image quality existing in the related art.

[0006] In a first aspect, an embodiment of the present application provides a shooting method, which is applied to an electronic device, wherein the electronic device includes a first camera and a second camera, and the method includes:

[0007] Displaying a shooting preview interface, wherein the shooting preview interface includes a first shooting preview picture captured by the first camera;

[0008] Obtaining an image of the target object by photographing with the first camera according to first photographing parameters;

[0009] The first shooting parameter is generated based on the shooting parameter of the second camera when the first camera has not captured the target object and the second camera has captured the target object.

[0010] In a second aspect, an embodiment of the present application provides a photographing device, including:

[0011] A display module, used to display a shooting preview interface, wherein the shooting preview interface includes a first shooting preview picture captured by the first camera;

[0012] An image capturing module, configured to capture an image of a target object using the first camera according to first capturing parameters;

[0013] The first shooting parameter is generated based on the shooting parameter of the second camera when the first camera has not captured the target object and the second camera has captured the target object.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the steps of the method described in the first aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the first aspect.

[0018] In an embodiment of the present application, when the target object is captured by the second camera, the second camera can generate first shooting parameters for the target object in advance. When the target object appears in the first camera, the first camera can directly use the first shooting parameters to capture the target object. In this way, when the target object enters the first shooting preview screen, the shooting parameters of the first camera can be quickly adjusted, thereby improving the image quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A schematic diagram of a shooting scene provided in an embodiment of the present application;

[0020] Figure 2 A flowchart of a shooting method provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of a shooting preview interface provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of the field of view provided in an embodiment of the present application;

[0023] Figure 5 A process diagram of the target object movement provided in the embodiment of the present application;

[0024] Figure 6A schematic diagram of the camera background workflow provided by an embodiment of the present application;

[0025] Figure 7 A flowchart of the interface display during the image shooting process provided by the embodiment of the present application;

[0026] Figure 8 A schematic diagram of the structure of a photographing device provided in an embodiment of the present application;

[0027] Fig. 9 A schematic diagram of the framework of an electronic device provided in an embodiment of the present application;

[0028] Fig.10 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0030] The terms "first", "second", etc. in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are usually a class, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0031] The following is a detailed description of the shooting method, device, equipment and medium provided in the embodiments of the present application in combination with specific embodiments and their application scenarios.

[0032] The shooting method provided in the embodiment of the present application can be applied to snapshot scenes, capturing the moment when a person enters the screen. For example, in a running competition, capture the moment when an athlete crosses the finish line. At present, when a user uses an electronic device to capture a photo, if the user needs to capture a photo with zero delay and high image quality, the user is generally required to set the shooting parameters in advance. Among them, the shooting parameters can be specifically divided into exposure and exposure time. A reasonable exposure can ensure that the brightness of the face and the overall picture are appropriate, while a reasonable exposure time ensures that there is no motion ghosting problem for the person.

[0033] However, in actual applications, pre-setting shooting parameters is not user-friendly to ordinary users (for example, due to lack of professional camera knowledge, it is difficult for ordinary users to adjust reasonable shooting parameters by themselves), and the preset shooting parameters are often not suitable for the picture before taking the photo (that is, before the person enters the picture), which will result in a poor preview experience of the picture presented by the electronic device before the person enters the picture.

[0034] In response to the problems existing in the above scenarios, the shooting method provided in the embodiments of the present application is used to use a second camera with a larger field of view to capture the person in advance and adjust the shooting parameters, and then synchronize the second camera with a small field of view to achieve that when the person enters the field of view of the first camera, the picture of the first camera can be quickly adjusted (that is, directly follow the shooting parameters adjusted by the second camera). This ensures the quality of the captured image, and there is no need for the user to set the shooting parameters in advance.

[0035] The electronic device provided in the embodiments of the present application can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, a wearable device, a vehicle-mounted terminal, etc. Taking the electronic device as a mobile phone as an example, for example, Figure 1 A schematic diagram of a shooting scene provided in an embodiment of the present application, such as Figure 1 As shown, the mobile phone is equipped with a first camera and a second camera (not shown), the picture captured by the first camera is displayed on the shooting preview interface 11, and the second camera can capture the target object in a larger range (here for the convenience of comparison, briefly Figure 1 The area occupied by the shooting preview interface 11 is used as the coverage range of the first camera, and the filling area 12 is used as the coverage range of the second camera).

[0036] refer to Figure 1 , the person first moves towards the range covered by the second camera. When the person enters the range covered by the second camera and does not enter the range covered by the first camera (refer to Figure 1 When the second camera is able to capture the image of the person, it can quickly adjust the shooting parameters according to the captured image. Then the target object continues to move and enters the coverage area of ​​the first camera (refer to Figure 1 At this time, the first camera directly uses the parameters adjusted by the second camera to capture, and high-quality captured pictures can be obtained.

[0037] Figure 2This is a flowchart of a shooting method provided in an embodiment of the present application. The method can be applied to an electronic device, with the electronic device as the execution subject. The electronic device is equipped with two cameras. There are differences between the two cameras, which will be described in detail later. For the sake of distinction, one of the cameras in the embodiment of the present application is called the first camera and the other camera is called the second camera. For example, the electronic device may refer to Figure 1 The mobile phone shown. Figure 2 As shown, the method may include the following steps:

[0038] Step S210: display the shooting preview interface.

[0039] The shooting preview interface includes a first shooting preview picture captured by the first camera.

[0040] In this embodiment, the electronic device displays a shooting preview interface, which includes a real-time picture, which is a picture captured by the first camera. Exemplarily, in other implementations, the shooting preview interface includes a first control, and the user can trigger the first camera to take a picture by clicking the first control.

[0041] For example, Figure 3 A schematic diagram of a shooting preview interface provided in an embodiment of the present application, such as Figure 3 As shown, the shooting preview interface is divided into a first area 31 and a second area 32 , the second area 32 displays a real-time image, and the first area 31 displays a first control 310 .

[0042] In some other embodiments, the electronic device receives user input to the camera application, and displays the shooting preview interface in response to the input. That is, before displaying the shooting preview interface, the user needs to start the camera application in the electronic device. Exemplarily, after the camera application is started, the shooting preview interface is displayed by default.

[0043] Step S220: photographing the target object image using the first camera according to the first photographing parameter.

[0044] The first shooting parameter is generated based on the shooting parameter of the second camera when the first camera has not captured the target object and the second camera has captured the target object.

[0045] In this embodiment, the first shooting parameter may include one or more parameters such as exposure time, exposure amount and exposure gain. For the convenience of description, the parameters such as exposure time, exposure amount and exposure gain are collectively referred to as exposure parameters.

[0046] The exposure amount may refer to the exposure time multiplied by the gain. For example, increasing the exposure amount will brighten the picture.

[0047] The first shooting parameter is that before the target object appears in the first shooting preview picture, the second camera has captured the target object and has generated shooting parameters matching the target object.

[0048] In this embodiment, the target object may be in continuous motion (snapshot is usually also applied to such continuous motion scenes). When the target object is in motion, the second camera will preferentially capture the target object. After the second camera captures the target object, the second camera can automatically adjust its own exposure parameters according to the captured image to seek to obtain a high-quality image that contains a match to the target object (for example, adjusting the exposure to make the captured target object brighter).

[0049] Exemplarily, adjusting the shooting parameters of the second camera may specifically refer to: adjusting the exposure parameters according to the facial brightness of the target object presented in the picture of the second camera, so that the facial brightness tends to be expected, and ignoring or underestimating the influence of the ambient brightness.

[0050] In this embodiment, after the second camera adjusts the shooting parameters, the target object continues to move and enters the range of the first camera and is captured by the first camera. Figure 3 , the target object will be displayed in area 32 for the user to preview, that is, the target object will appear in the first shooting preview screen, and the user can trigger the first input through the first control 310, and the electronic device receives the first input to the first control in the shooting preview interface; and in response to the first input, the target object image is captured by the first camera according to the first shooting parameter. In this way, the user can quickly perform the capture operation and capture the person.

[0051] Among them, the first camera directly uses the shooting parameters adjusted by the second camera when capturing, which ensures the quality of the captured pictures.

[0052] In the embodiment of the present application, by utilizing the second camera to preferentially capture the target object and adjust the shooting parameters in advance, when the target object is captured by the first camera and appears in the preview interface, the user controls the first camera to shoot. In this way, the first camera can directly quote the shooting parameters adjusted by the second camera to shoot, thereby obtaining a snapshot with appropriate picture brightness and appropriate motion smear, avoiding the problem of users being unable to capture high-quality images when directly using the camera to shoot. In addition, there is no need for users to set the shooting parameters in advance before capturing, which solves the problem of users setting the shooting parameters in advance for capturing, resulting in poor picture preview experience and high requirements for users' professional shooting knowledge.

[0053] It has been mentioned above that there are differences between the two cameras (i.e., the first camera and the second camera). Further, in some embodiments, the difference between the first camera and the second camera can be described by the field of view range. The field of view range of the first camera is smaller than the field of view range of the second camera.

[0054] In this embodiment, the field of view range may refer to an angular region of scene width and height that can be captured by the camera.

[0055] In some embodiments, the field of view of the first camera being smaller than the field of view of the second camera may specifically mean that the angular area of ​​the scene width that can be captured by the first camera is smaller than the angular area of ​​the scene width that can be captured by the second camera.

[0056] In addition, in some other embodiments, the field of view of the first camera is smaller than the field of view of the second camera, which may specifically mean that the angle area of ​​the scene height that can be captured by the first camera is smaller than the angle area of ​​the scene height that can be captured by the second camera.

[0057] In addition, in some other embodiments, the field of view of the first camera is smaller than the field of view of the second camera, which can specifically mean that the angular area of ​​the scene width and height that can be captured by the first camera is smaller than the angular area of ​​the scene width and height that can be captured by the second camera.

[0058] Among them, the field of view can directly affect the performance and shooting effects of the camera in different application scenarios.

[0059] For example, Figure 4 A schematic diagram of the field of view provided in the embodiment of the present application is shown in FIG. Figure 4 As shown, two different filling areas (i.e., filling area 41 and filling area 42) are used to characterize the field of view. Among them, filling area 41 is the field of view of the second camera, and filling area 42 is the field of view of the first camera. At this time, the angle area of ​​the scene width that can be captured by the first camera is smaller than the angle area of ​​the scene width that can be captured by the second camera. The angle area of ​​the scene height that can be captured by the first camera is smaller than the angle area of ​​the scene height that can be captured by the second camera. That is, the angle areas of the scene width and height that can be captured by the first camera are both smaller than the angle areas of the scene width and height that can be captured by the second camera.

[0060] When the field of view of the first camera is smaller than the field of view of the second camera, Figure 5 The process diagram of the target object movement provided in the embodiment of the present application is as follows: Figure 5 As shown in the figure, taking the target object as a person as an example, when the person moves in the real environment, it can be specifically divided into the following three steps:

[0061] Step S510: The person first appears outside the field of view of the first camera and the second camera.

[0062] Step S520: When the person continues to move, the person enters the field of view of the second camera.

[0063] Step S530: When the person continues to move, the person enters the field of view of the first camera.

[0064] It can be understood that when taking a snapshot, the user usually needs to stand in a fixed position in advance, and the object to be captured will move towards that position. When the object to be captured moves to that position, the user can capture the photo, that is, the movement trajectory of the object to be captured will actually be the same as the above steps S510-S530.

[0065] In the embodiment of the present application, two cameras with different fields of view are configured for the electronic device to meet the needs of users in different shooting scenes, providing more flexible shooting options and richer photography experience. When the second camera captures the target object in advance, the shooting parameters can be adjusted in advance. In this way, by adjusting the parameters of the second camera in advance, the first camera can be assisted to obtain better shooting effects, thereby improving the adaptability of the electronic device in different scenes.

[0066] The following describes in detail how to adjust the shooting parameters of the second camera after the target object enters the field of view of the second camera through some embodiments.

[0067] In this embodiment, when the target object enters the field of view of the second camera, the second camera can first continuously capture a number of frames of images containing the target object. Then, the position of the target object in each frame of the image captured by the second camera is detected; and according to the position of the target object in each frame of the image, the motion data of the target object is determined; and finally, based on the motion data, the first shooting parameter is determined.

[0068] In this embodiment, during the motion of the target object, the first camera and the second camera may be turned on all the time. The second camera calculates the motion level of the target object through a motion detection algorithm. When the electronic device executes the motion detection algorithm, it may detect the position change of the target object between frames, and define the motion level according to the degree of position change of the target object between frames.

[0069] Exemplarily, the motion level can be divided into three levels: high, medium, and low. For example, when the target object is stationary, it can be classified as low. For another example, the electronic device detects the first frame image and finds that the position of the target image is D1, and detects the second frame image and finds that the position of the target object is D2. If D2-D1 is greater than the set gear threshold, it is classified as high, and if D2-D1 is within the set gear threshold range, it is classified as medium.

[0070] In addition, in some implementations, the current gear position may be output in real time on the preview interface.

[0071] In this embodiment, after the motion level of the target object is determined, the shooting parameters of the second camera can be adjusted in the following manner:

[0072] Assume that the following calculation formula is configured:

[0073] Exposure = exposure time * gain

[0074] Among them, after determining the reasonable required exposure according to the effect presented by the target object in the picture captured by the second camera, the above calculation formula can be used to reasonably allocate the required exposure to the exposure time and gain according to the currently detected motion gear.

[0075] Exemplarily, the allocation can be based on the principle of optimal signal-to-noise ratio, that is, it is allocated to the exposure time first. When the exposure time reaches an upper limit (the upper limit of the exposure time depends on the frame rate and module characteristics), it continues to be allocated to the gain until the current required exposure is reached.

[0076] For example, when the target object's motion data is at a low level, the above-mentioned optimal signal-to-noise ratio principle can be reused; when the target object's motion data is at a medium level, a 2-fold motion exposure ratio is used, the exposure time is reduced to 1 / 2 of the original, and the gain is multiplied by 2; when the target object's motion data is at a high level, a 4-fold motion exposure ratio is used, the exposure time is reduced to 1 / 4 of the original, and the gain is multiplied by 4. Among them, the medium and high-level motion exposure ratios can be adjusted according to actual measurements, specifically with the goal of reducing motion smear and improving the signal-to-noise ratio to maximize the comprehensive benefits.

[0077] For example, according to the effect of the target object in the picture captured by the second camera, after determining that the reasonable required exposure is 100, assuming that the target object's motion gear is detected to be low, the exposure time is 50 (assuming 50 is the upper limit value) and the gain is 2. If the target object's motion gear is detected to be medium, the exposure time needs to be reduced to 1 / 2 of the original, that is, the exposure time is adjusted to 25, and the gain is multiplied by 2, that is, the gain is adjusted to 4. Similarly, if the target object's motion gear is detected to be high, the exposure time is adjusted to 12.5 and the gain is adjusted to 8.

[0078] In an embodiment of the present application, the second camera is kept turned on and the motion level of the target object is detected by a motion detection algorithm, and then the exposure time and exposure amount of the second camera are adjusted accordingly. When the target object is at a high motion level, the exposure time is reduced to avoid the smear phenomenon. When the target object is at a low or medium motion level, the exposure time is increased to improve the signal-to-noise ratio of the image, making the image clearer. The shooting parameters of the second camera are adjusted under different motion states to achieve better shooting effects, thereby providing better shooting parameters for the subsequent first camera and further improving the quality of the captured image.

[0079] In addition, since the first camera needs to shoot and display a preview screen (i.e., capture environmental information and display the first shooting preview screen in the shooting preview interface), and also needs to capture the target object to form a captured image, the background workflow of the first camera and the second camera is described in detail below through some embodiments.

[0080] In some embodiments, when the target object has not entered the field of view of the first camera, the target object will not appear in the first shooting preview screen. The first camera captures the image within the field of view according to the second shooting parameters to form the first shooting preview screen.

[0081] The second shooting parameter may be obtained by adjusting the shooting parameter of the first camera itself according to the captured image.

[0082] In other embodiments, the first camera may be a dual-stream image sensor, and the dual-stream image sensor may enter a pre-set working mode: outputting two frames of images, a long exposure and a short exposure, at the same time. When the target object enters the field of view of the first camera and is captured by the first camera, the first camera may enter the working mode. In addition, the first camera may also directly enter the working mode when it is turned on.

[0083] Among them, for this working mode, after the target object enters the field of view of the first camera, the first shooting preview screen will be displayed in the shooting preview interface (at this time, the user can see the target object in the shooting preview interface). If the user clicks to capture at this time, in the related technology, the background of the electronic device will capture frames forward to ensure the zero-delay effect. However, since the short-exposure frame does not directly refer to the shooting parameters of the second camera, but automatically adjusts the exposure, it is easy to have insufficient frames adjusted according to the face information (directly capture the face when it just enters), resulting in the final captured image The brightness is not appropriate, for example, the face is dark in a backlit environment.

[0084] In this embodiment, the long exposure frame is used as the first shooting preview screen, which is displayed in the shooting preview interface for the user to preview, and the short exposure frame is used as the captured image (that is, when the user triggers the first control in the shooting preview interface to control the first camera to take a photo, the captured image is used as the short exposure frame).

[0085] Among them, since the long exposure frame is displayed in the shooting preview interface for users to preview, in order to ensure the preview effect, the short exposure frame may no longer be displayed in the shooting preview interface. For example, when the user controls the electronic device to take a snapshot and the electronic device generates a snapshot image of the short exposure frame, the snapshot image of the short exposure frame will be directly stored in the photo album of the electronic device for the user to review later.

[0086] In some embodiments, when the first camera outputs a long exposure frame and a short exposure frame at the same time, the shooting parameters used for the long exposure frame and the short exposure frame are different. Specifically, when the first camera captures the target object, the third shooting parameter of the first camera is determined according to the display state of the target object in the first shooting preview screen; the screen captured by the first camera according to the third shooting parameter is updated and displayed on the first shooting preview screen, so that the user can view the movement of the target object in the shooting preview interface in real time. In addition, if the user sees the target object in the shooting preview interface and triggers the capture, the first camera uses the first shooting parameter adjusted by the original second camera to capture the short exposure frame.

[0087] For example, continue to refer to the above Figure 1 , taking the target object as a person as an example, Figure 1In the rightmost figure, the person enters the field of view of the first camera and is captured by the first camera, forming a long exposure frame displayed in the shooting preview interface. Assuming that the user takes a snapshot at this time, the shooting parameters of the short exposure frame of the first camera will follow the first shooting parameters of the second camera (for example, the exposure of the short exposure frame will follow the exposure of the second camera, where, assuming that the photosensitivity of the first camera module is c1, the photosensitivity of the second camera module is c2, and the exposure is e2, then the exposure of the short exposure frame of the first camera is e1 = c2 * e2 / c1), so that the brightness of the face in the short exposure frame can be guaranteed to be close to the brightness of the face in the image frame captured by the second camera, which is equivalent to the first camera adjusting the exposure effect of multiple frames by exposing one frame when shooting a short exposure frame, thereby improving the image quality when capturing.

[0088] In addition, since the long exposure frame captured by the first camera at the same time is used for user preview, its shooting parameters can be adjusted according to the normal shooting parameter adjustment process. The shooting parameter adjustment process of the long exposure frame is different from the shooting parameter adjustment process of the short exposure frame. The long exposure frame shooting parameter adjustment process may require the use of multiple long exposure frames to adjust the appropriate shooting parameters, that is, to obtain the third shooting parameters mentioned above.

[0089] Furthermore, in some implementations, the exposure time in the first shooting parameter used for the short exposure frame may be shorter than the exposure time in the third shooting parameter used for the long exposure frame.

[0090] In addition, in some embodiments, when the shooting parameters of the long exposure frame are adjusted to be close to the short exposure frame (that is, when the third shooting parameter is close to the first shooting parameter), the preview face brightness adjustment is completed. At this time, the strategy of quickly adjusting the face exposure can be exited, so that the short exposure frame output by the first camera no longer follows the shooting parameter adjustment of the second camera (that is, the short exposure frame of the first camera no longer uses the first shooting parameter adjusted in advance by the second camera image).

[0091] In addition, when the short exposure frame follows the first shooting parameter, the exposure time of the short exposure frame will be allocated according to the motion detection result of the target object in the second camera, instead of using the exposure time of the first camera. This is mainly because users usually capture the moment when a person enters the screen, and motion detection is a multi-frame algorithm. In the above scenario, the motion detection result of the target object by the first camera will be inaccurate because the person has just entered the field of view of the first camera, and the motion detection result of the second camera is better.

[0092] For example, Figure 6 A schematic diagram of the camera background workflow provided in the embodiment of the present application is shown in FIG. Figure 6 As shown, it includes the following steps:

[0093] Step S610: The first camera and the second camera detect in real time whether there is a person in the field of view.

[0094] Step S620: When the second camera detects a person, the second camera enters a quick-adjust exposure strategy.

[0095] Step S630: The second camera adjusts the exposure.

[0096] Step S640: the first camera detects a person, the short exposure frame follows the exposure of the second camera, and the long exposure frame continues to use the normally adjusted exposure parameters.

[0097] Step S650: The exposure of the long exposure frame is adjusted to be close to that of the short exposure frame, and the quick-adjustment exposure strategy is exited.

[0098] In this embodiment, in the non-snapshot mode, the second camera is usually used to assist the first camera in imaging (for example, the first camera combines the image captured by the second camera to determine the image depth information). When entering the snapshot mode, the field of view of the second camera is larger than that of the first camera, and the second camera detects the person first. At this time, the second camera enters the fast-adjustment exposure strategy to adjust a first shooting parameter suitable for the person as quickly as possible (for example, adjust the exposure so that the brightness of the face does not appear too dark or too bright), so that the first camera can capture a short-exposure frame.

[0099] When a person appears in the field of view of the first camera, the first camera will adjust the third shooting parameter to form a long exposure frame as a preview image. After continuously adjusting the third shooting parameter, the third shooting parameter will eventually approach the first shooting parameter, and the fast exposure strategy will be exited at this time.

[0100] In an embodiment of the present application, when the target object has not yet entered the field of view of the first camera, the first camera captures the environmental information within the field of view, and adjusts the shooting parameters (i.e., the second shooting parameters) normally, and then displays the first shooting preview screen on the shooting preview interface for the user to preview. When the target object enters the field of view of the first camera, in order to improve the preview effect, the first camera first uses the third shooting parameters to form a long exposure frame, and sends it to the shooting preview interface for display. The user can trigger the capture according to the long exposure frame displayed in the shooting preview interface. At this time, the first camera uses the second shooting parameters adjusted in advance by the second camera to form a short exposure frame as a captured image. In this way, while obtaining high-quality captured images, the user can also get a better experience. During the entire capture process, the user only needs to open the camera application and trigger the first control to capture when the target object appears on the interface.

[0101] In addition, since the user will not execute the snapshot action until he sees the target object appear in the shooting preview interface, there is a reaction time in this process (i.e., the time interval refers to the first moment when the target object appears in the shooting preview interface, to the second moment when the user triggers the first control to form the first input and the electronic device executes the snapshot). It can be understood that this reaction time causes imaging delay. To this end, in some embodiments, the first camera can be controlled to cache the raw data of N frames of continuous images in real time, and these N frames of continuous images are mainly short exposure frames. In this way, when the user clicks to take a photo to capture, the raw data of the frame at the moment the user wants to capture is selected from these N frames, and a captured image is generated to avoid imaging delay, so as to finally obtain an image of the target object with zero shutter delay effect. Wherein N is a positive integer.

[0102] For example, taking the example of a user wanting to capture the image of the moment a basketball is shot, the user immediately clicks to take a photo when he sees the basketball being shot, but in fact, at the moment of clicking, the basketball has already flown a short distance (for example, 30 cm away from the hand). The above-mentioned N continuous image frames refer to the frame 30 cm away from the hand and the previous N-1 frames (for example, 20 cm away from the hand, 10 cm away from the hand, just out of the hand...), and then by counting the time difference (for example, 100 milliseconds) between the moment the user wants the basketball to be shot and the moment the user actually clicks to take a photo, it can be determined based on the time difference which of the N continuous image frames is the image frame of the moment the user really wants to capture.

[0103] In this embodiment, when the first camera captures the image using the first shooting parameter, N short-exposure frames are formed. The first camera can cache the latest N short-exposure frames in real time. For example, when the user triggers the first control at time T1 to form the first input, the electronic device performs the capture and obtains a short-exposure frame at time T1, then the first camera can actually cache N short-exposure frames from time T0 to time T1.

[0104] Among them, the time T0 may be the time when the target object just enters the field of view of the first camera, and the short exposure frame at the time T0 is formed by the first camera shooting according to the first shooting parameter. Exemplarily, the time T0 may also be determined in combination with the number of short exposure frames that the first camera can cache in real time. For example, the first camera can cache a maximum of X short exposure frames, and the time interval between the two short exposure frames is Y milliseconds, then T0 = T1-X*Y.

[0105] Among them, a frame that meets the preset conditions can be selected from N short-exposure frames according to the frame selection strategy as the target image. For example, the user sets a preset condition according to his own needs (assuming that the target object is a person, the preset condition can refer to: moderate brightness of the face, no ghosting, and the portrait is centered), and then performs photo generation processing on the target image, and finally outputs the target object image.

[0106] In the embodiment of the present application, the latest N short exposure frames are cached in real time by the first camera, which can not only solve the delay problem and achieve a zero shutter delay effect, but also the user can choose from the N short exposure frames to determine the final appropriate target object image, thereby increasing the user's selectivity.

[0107] The operation process of the electronic device is described in detail below through some embodiments. Figure 7 The interface display flow chart of the image shooting process provided in the embodiment of the present application takes the electronic device as a mobile phone and the target object as a person as an example. Figure 7 As shown, it includes the following steps:

[0108] Step S710: In response to the camera application being activated, entering the portrait photography mode.

[0109] Step S720: presenting a portrait mode preview interface.

[0110] Step S730: When the character enters the shooting preview screen, a first input is received.

[0111] Step S740: taking a snapshot according to the first input and generating a result graph.

[0112] In this embodiment, the user opens the camera application in the mobile phone, and the mobile phone displays the corresponding camera interface. Figure 3 ,exist Figure 3 There is a fill icon in the lower left corner, which users can click to enter "portrait mode".

[0113] In the "Portrait Mode", as the person enters the preview screen in the shooting preview interface, refer to Figure 1 , the camera background will perform the following operations:

[0114] (1) Both the first camera and the second camera are started, and detect in real time whether there is a human subject in the picture. The second camera has a larger field of view (for example, when the first camera is a wide-angle module, the secondary camera is an ultra-wide-angle module). The exposure adjustment strategy is configured as follows: only the long-exposure frame of the first camera is used for automatic face exposure and exposure calculation, and the short-exposure frame of the first camera is used for follow-up exposure, that is, the exposure of the second camera is used.

[0115] (2) The second camera detects the human subject, such as Figure 1 In the middle figure, the second camera enters the strategy of quickly adjusting the face exposure. The second camera will first perform automatic face exposure and start to adjust its own exposure. Since the content within the field of view of the first camera does not change, the exposure of the first camera does not change at this time.

[0116] At the same time, the second camera also keeps the motion detection algorithm on, and calculates the motion level of the person in real time. Reasonable allocation of exposure time and gain according to the motion level can better balance the benefits of reducing motion smear and improving signal-to-noise ratio. Among them, the motion detection algorithm is: detect the position change of the person's subject between frames, and define high, medium and low levels of motion according to the degree of position change of the person's subject between frames. The situation where the person is stationary can be classified as low. In addition, the current gear is output in real time during the preview process.

[0117] For the exposure adjustment of the second camera: the current exposure is reasonably allocated to exposure time and gain according to the currently detected motion level. It is assumed that the initial method is ① exposure allocation is based on the principle of optimal signal-to-noise ratio, with exposure time being the priority. When the exposure time reaches the upper limit, the gain is then increased, and finally the currently required exposure is reached. For example, it is assumed that the currently required exposure is:

[0118] B=T*a

[0119] In the above formula, B is the currently required exposure, T is the exposure time, and a is the gain. When the value of B is fixed, the initial method ① is to adjust T first until T reaches the upper limit. If T*a is still less than B at this time, the gain will continue to increase until the currently required exposure is finally reached.

[0120] In this embodiment, at a low motion level, the initial multiplexing mode is ①; at a medium motion level, a 2-fold motion exposure ratio is used, the exposure time is reduced to 1 / 2 of the original, and the gain is multiplied by 2; at a high motion level, a 4-fold motion exposure ratio is used, the exposure time is reduced to 1 / 4 of the original, and the gain is multiplied by 4. The medium and high motion exposure ratios can be adjusted according to actual measurements, with the goal of reducing motion smear and improving the signal-to-noise ratio to maximize the comprehensive benefits.

[0121] (3) The first camera detects the human subject, such as Figure 1 In the figure on the right, the exposure of the short-exposure frame of the first camera will follow the exposure of the second camera, so that the face brightness of the short-exposure frame can be close to the face brightness in the image frame of the second camera. This is equivalent to adjusting the exposure result of the second camera adjusting multiple frames when exposing one frame. The long-exposure frame is used for preview, and its exposure is adjusted according to the normal automatic exposure adjustment strategy.

[0122] In step S730, after seeing the person enter the screen, the user can click the photo button (ie, the first control).

[0123] For step S740, there is an interval between when the human eye sees the image to be captured and when the photo is taken. In order to ensure what you see is what you get, that is, the effect of zero shutter delay, the short exposure frame will cache the latest N frames in real time, and select the frame (reference frame) that best meets the user's needs according to the frame selection strategy for photo generation processing.

[0124] In the embodiment of the present application, it is possible to obtain a photo with zero shutter delay, appropriate picture brightness and appropriate motion smear when capturing a person entering the field of view of the first camera. Through the larger field of view of the second camera, the shooting parameters are adjusted in advance according to the degree of human face captured by the second camera. When the main body of the person enters the field of view of the first camera, the adjusted first shooting parameters are used to quickly adjust the shooting parameters of the short exposure frame of the first camera. At the same time, the motion detection results of the second camera are used to guide the allocation of the exposure time of the short exposure frame of the first camera so that the motion smear of the person is appropriate.

[0125] It should be noted that the shooting method provided in the embodiment of the present application can be executed by a shooting device or a processing module in the shooting device for executing the shooting method. In the embodiment of the present application, the shooting device provided in the embodiment of the present application is described by taking the shooting method executed by the shooting device as an example.

[0126] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0127] Figure 8 This is a schematic diagram of the structure of the shooting device provided in the embodiment of the present application. Figure 8 As shown, the photographing device 800 includes a display module 810 and an image photographing module 830 .

[0128] The display module 810 is used to display a shooting preview interface, wherein the shooting preview interface includes a first shooting preview picture captured by the first camera.

[0129] The image capturing module 820 is used to capture an image of a target object using a first camera according to a first capturing parameter.

[0130] The first shooting parameter is generated based on the shooting parameter of the second camera when the first camera has not captured the target object and the second camera has captured the target object.

[0131] In the embodiment of the present application, by utilizing the second camera to preferentially capture the target object and adjust the shooting parameters in advance, when the target object is captured by the first camera and appears in the preview interface, the user controls the first camera to shoot, so that the first camera can reference the shooting parameters adjusted by the second camera to shoot, thereby obtaining a snapshot with appropriate picture brightness and appropriate motion smear.

[0132] In some possible implementations of the embodiments of the present application, the field of view of the first camera is smaller than the field of view of the second camera, and the first shooting parameter includes at least one of exposure time and exposure amount.

[0133] In some possible implementations of the embodiments of the present application, the shooting device also includes a first shooting parameter adjustment module, which is used to: when the target object enters the field of view of the second camera, detect the position of the target object in each frame image taken by the second camera; determine the motion data of the target object according to the position of the target object in each frame image; and determine the first shooting parameter based on the motion data.

[0134] In some possible implementations of the embodiments of the present application, a display module is further included, which is used to use the picture captured by the first camera according to the second shooting parameter as the first shooting preview picture.

[0135] In some possible implementations of the embodiments of the present application, a display update module is also included, which is used to determine a third shooting parameter of the first camera according to the display status of the target object in the first shooting preview screen when the first camera captures the target object; and update the first shooting preview screen with the picture captured by the first camera according to the third shooting parameter.

[0136] In some possible implementations of the embodiments of the present application, the first shooting parameter includes an exposure time, and the exposure time in the first shooting parameter is shorter than the exposure time in the third shooting parameter.

[0137] In some possible implementations of the embodiments of the present application, the image capture module 920 is specifically used to: when a target object appears in a first shooting preview screen, receive a first input to a first control in the shooting preview interface; in response to the first input, obtain an image of the target object by capturing it through a first camera according to first shooting parameters.

[0138] In the embodiment of the present application, it is possible to obtain a photo with zero shutter delay, appropriate picture brightness and appropriate motion smear when capturing a person entering the field of view of the first camera. Through the larger field of view of the second camera, the shooting parameters are adjusted in advance according to the degree of human face captured by the second camera. When the main body of the person enters the field of view of the first camera, the adjusted first shooting parameters are used to quickly adjust the shooting parameters of the short exposure frame of the first camera. At the same time, the motion detection results of the second camera are used to guide the allocation of the exposure time of the short exposure frame of the first camera so that the motion smear of the person is appropriate.

[0139] The shooting device in the embodiment of the present application can be a device, or a component in an electronic device, such as an integrated circuit or a chip. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.

[0140] The electronic device in the embodiment of the present application may be a terminal with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0141] The device provided in the embodiment of the present application can be used to execute the method in the above embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0142] Fig. 9 A schematic diagram of a framework of an electronic device provided in an embodiment of the present application, such as Fig. 9 As shown, the electronic device 900 includes a processor 901 and a memory 902. The memory 902 stores programs or instructions that can be executed on the processor 901. When the program or instructions are executed by the processor 901, the various steps of the above-mentioned shooting method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0143] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile terminals and non-mobile terminals.

[0144] Fig.10 The hardware structure diagram of the electronic device provided in the embodiment of the present application is shown in FIG. Fig.10 As shown, the electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.

[0145] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.10 The structure of the electronic device 1000 shown in the figure does not constitute a limitation on the electronic device 1000. The electronic device 1000 may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0146] The display unit 1006 is used to display a shooting preview interface. The shooting preview interface includes a first shooting preview image captured by the first camera;

[0147] The processor 1010 is configured to obtain a target object image by photographing with a first camera according to a first photographing parameter, wherein the first photographing parameter is generated based on a photographing parameter of a second camera when the first camera has not captured the target object and the second camera has captured the target object.

[0148] In the embodiment of the present application, by utilizing the second camera to preferentially capture the target object and adjust the shooting parameters in advance, when the target object is captured by the first camera and appears in the preview interface, the user controls the first camera to shoot, so that the first camera can reference the shooting parameters adjusted by the second camera to shoot, thereby obtaining a snapshot with appropriate picture brightness and appropriate motion smear.

[0149] In some possible implementations of the embodiments of the present application, the field of view of the first camera is smaller than the field of view of the second camera, and the first shooting parameter includes at least one of exposure time and exposure amount.

[0150] In some possible implementations of the embodiments of the present application, the processor 1010 is specifically configured to:

[0151] When the target object enters the field of view of the second camera, detecting the position of the target object in each frame of the image captured by the second camera;

[0152] Determine the motion data of the target object according to the position of the target object in each frame of the image;

[0153] Based on the motion data, a first shooting parameter is determined.

[0154] In some possible implementations of the embodiments of the present application, the display unit 1006 is specifically used to: use the picture captured by the first camera according to the second shooting parameter as the first shooting preview picture.

[0155] In some possible implementations of the embodiments of the present application, the processor 1010 is specifically configured to: when the first camera captures the target object, determine a third shooting parameter of the first camera according to a display state of the target object in the first shooting preview screen;

[0156] The display unit 1006 is specifically used to update and display the first shooting preview picture based on the picture captured by the first camera according to the third shooting parameter.

[0157] In some possible implementations of the embodiments of the present application, the first shooting parameter includes an exposure time, and the exposure time in the first shooting parameter is shorter than the exposure time in the third shooting parameter.

[0158] In some possible implementations of the embodiments of the present application, a user input unit 1007 is further included, which is used to receive a first input to a first control in the shooting preview interface when the target object appears in the first shooting preview screen. Correspondingly, the processor 1010 is specifically used to: in response to the first input, obtain an image of the target object by shooting with the first camera according to the first shooting parameter.

[0159] In the embodiment of the present application, it is possible to obtain a photo with zero shutter delay, appropriate picture brightness and appropriate motion smear when capturing a person entering the field of view of the first camera. Through the larger field of view of the second camera, the shooting parameters are adjusted in advance according to the degree of human face captured by the second camera. When the main body of the person enters the field of view of the first camera, the adjusted first shooting parameters are used to quickly adjust the shooting parameters of the short exposure frame of the first camera. At the same time, the motion detection results of the second camera are used to guide the allocation of the exposure time of the short exposure frame of the first camera so that the motion smear of the person is appropriate.

[0160] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0161] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0162] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0163] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned shooting method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0164] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0165] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0166] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0167] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned shooting method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0168] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0169] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0170] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A shooting method, characterized in that: Applied to an electronic device, the electronic device includes a first camera and a second camera, and the method includes: Displaying a shooting preview interface, wherein the shooting preview interface includes a first shooting preview picture captured by the first camera; Obtaining an image of the target object by photographing with the first camera according to first photographing parameters; The first shooting parameter is generated based on the shooting parameter of the second camera when the first camera has not captured the target object and the second camera has captured the target object.

2. The method according to claim 1, characterized in that The field of view of the first camera is smaller than that of the second camera, and the first shooting parameter includes at least one of exposure time and exposure amount.

3. The method according to claim 1, characterized in that: Also includes: When the target object enters the field of view of the second camera, detecting a position of the target object in each frame of image captured by the second camera; Determining motion data of the target object according to the position of the target object in each frame of image; Based on the motion data, the first shooting parameter is determined.

4. The method according to claim 1, characterized in that Also includes: The picture captured by the first camera according to the second shooting parameter is used as the first shooting preview picture.

5. The method according to claim 1, characterized in that Also includes: When the first camera captures the target object, determining a third shooting parameter of the first camera according to a display state of the target object in the first shooting preview screen; The first camera captures the picture according to the third shooting parameter, and updates and displays the first shooting preview picture.

6. The method according to claim 5, characterized in that The first shooting parameter includes an exposure time, and the exposure time in the first shooting parameter is shorter than the exposure time in the third shooting parameter.

7. The method according to any one of claims 1 to 6, characterized in that The step of obtaining the target object image by photographing the first camera according to the first photographing parameter includes: When a target object appears in the first shooting preview screen, receiving a first input to a first control in the shooting preview interface; In response to the first input, the target object image is captured by the first camera according to the first shooting parameters.

8. A photographing device, characterized in that: include: A display module, used to display a shooting preview interface, wherein the shooting preview interface includes a first shooting preview picture captured by the first camera; An image capturing module, configured to capture an image of a target object using the first camera according to first capturing parameters; The first shooting parameter is generated based on the shooting parameter of the second camera when the first camera has not captured the target object and the second camera has captured the target object.

9. The device according to claim 8, characterized in that It also includes a display update module, which is used to: When the first camera captures the target object, determining a third shooting parameter of the first camera according to a display state of the target object in the first shooting preview screen; The first camera captures the picture according to the third shooting parameter, and updates and displays the first shooting preview picture.

10. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 7 are implemented.

11. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images