Processing method and electronic equipment

Abstract

The invention discloses a processing method and electronic equipment, and the method comprises the steps: collecting a preview image which is the expression of a real scene corresponding to the collection range of an image collection device; displaying the preview image; determining a target object, wherein the target object corresponds to a target object in a real scene expressed by the preview image; obtaining a shot image in response to a shooting parameter, the shot image including the target object, and the shot image being used for storage for viewing; wherein the shooting parameter is determined based on the movement speed of the target object.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a processing method and electronic equipment. Background Art

[0002] In motion shooting scenes, such as shooting a moving ball or a flying bird, the user may operate slowly, resulting in failure to capture the moving object in time. Summary of the invention

[0003] In view of this, the present application provides a processing method and an electronic device as follows:

[0004] A processing method, comprising:

[0005] Capturing a preview image, wherein the preview image is an expression of a real scene corresponding to a capture range of the image capture device;

[0006] displaying the preview image;

[0007] Determining a target object, the target object corresponding to a target object in a real scene expressed by the preview image;

[0008] obtaining a captured image in response to a capture parameter, the captured image including an expression of the target object, the captured image being used for storage for viewing;

[0009] Wherein, the shooting parameters are determined based on the moving speed of the target object.

[0010] In the above method, preferably, the higher the moving speed of the target object, the higher the frame rate in the shooting parameters.

[0011] The above method, preferably, obtains the captured image in response to the shooting parameters, including:

[0012] Obtaining a first captured image based on a first capturing parameter;

[0013] obtaining a second captured image based on the second capturing parameter;

[0014] The first captured image and the second captured image are used to express the movement process of the target object in the real scene;

[0015] The difference between the first shooting parameter and the second shooting parameter is used to represent the difference in the moving speed of the target object.

[0016] The above method, preferably, before obtaining the captured image in response to the shooting parameters, further comprises:

[0017] Determine the shooting parameters.

[0018] In the above method, preferably, determining the shooting parameters includes:

[0019] Obtaining the brightness change of each pixel in the real scene corresponding to the acquisition range;

[0020] Obtaining the moving speed of the target object according to the brightness change;

[0021] The shooting parameters are determined according to the movement speed.

[0022] In the above method, preferably, the movement speed is the current speed of the target object at the current position;

[0023] Alternatively, the movement speed is a predicted speed of the target object on a predicted trajectory, and the predicted trajectory is determined based on a current speed, a current acceleration, and a current position of the target object.

[0024] The above method, preferably, obtains the captured image in response to the shooting parameters, including:

[0025] Monitoring whether there is a moving object within the acquisition range;

[0026] When there is a moving object within the acquisition range, obtaining the moving speed of the target object;

[0027] Based on the moving speed of the target object, obtaining shooting parameters;

[0028] According to the shooting parameters, a shot image is obtained.

[0029] A processing method, comprising:

[0030] Capturing a preview image, wherein the preview image is an expression of a real scene corresponding to a capture range of the image capture device;

[0031] displaying the preview image;

[0032] Determining a target object, the target object corresponding to a target object in a real scene expressed by the preview image;

[0033] obtaining a captured image in response to a capture parameter, the captured image including an expression of the target object, the captured image being used for storage for viewing;

[0034] The target object moves at different speeds at the first moment and the second moment, respectively, so that the shooting parameters used by the captured image corresponding to the first moment and the captured image corresponding to the second moment are different.

[0035] An electronic device, comprising:

[0036] A first image acquisition device, used to acquire a preview image, wherein the preview image is an expression of a real scene corresponding to a capture range of the first image acquisition device;

[0037] a processor, configured to display the preview image; determine a target object, the target object corresponding to a target object in a real scene expressed by the preview image; obtain a captured image by the first image acquisition device in response to a capture parameter, the captured image including an expression of the target object, and the captured image is used to store for viewing;

[0038] Wherein, the shooting parameters are determined based on the moving speed of the target object.

[0039] The above electronic device preferably further includes:

[0040] A second image acquisition device is used to acquire the brightness change of each pixel in the real scene corresponding to the acquisition range, and send the brightness change to the processor;

[0041] The processor is further configured to obtain a moving speed of the target object according to the brightness change, determine the shooting parameters according to the moving speed, and send the shooting parameters to the first image acquisition device. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0043] Figure 1 A flowchart of a processing method provided in an embodiment of the present application;

[0044] Figure 2 This is an example diagram showing a preview image in an embodiment of the present application;

[0045] Figure 3 This is an example diagram of providing a wireframe for selection for the user in an embodiment of the present application;

[0046] Figure 4 This is an example diagram of determining shooting parameters based on motion speed in an embodiment of the present application;

[0047] Figure 5 Another flow chart of a processing method provided in an embodiment of the present application;

[0048] Figure 6 A partial flow chart of a processing method provided in an embodiment of the present application;

[0049] Figure 7 Another partial flow chart of a processing method provided in an embodiment of the present application;

[0050] Figure 8 This is an example diagram of an image captured by a mobile phone applicable to this application;

[0051] Fig. 9 A schematic diagram of another processing method provided in an embodiment of the present application;

[0052] Fig.10 Another example diagram of determining shooting parameters based on motion speed in an embodiment of the present application;

[0053] Fig.11 A schematic diagram of the structure of a processing device provided in an embodiment of the present application;

[0054] Fig.12 A schematic diagram of the structure of another processing device provided in an embodiment of the present application;

[0055] Fig.13 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0056] Fig.14 Another structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0057] Fig.15 This is a flow chart of the product calibration stage in the embodiment of this application;

[0058] Fig.16 This is an example diagram of the coordinate system in the embodiment of the present application;

[0059] Fig.17 This is a flow chart of the user usage phase in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0061] refer to Figure 1As shown, it is a flowchart of an implementation of a processing method provided in an embodiment of the present application, and the method can be applied to electronic devices with image acquisition devices, such as mobile phones, tablet computers and other devices. An image acquisition device can be deployed in an electronic device, and there can be one or more image acquisition devices. For example, the image acquisition device can include an RGB (Red Green Blue) camera and a camera with an event-based vision sensor EVS (Event-Based Vision Sensor), etc. The technical solution in this embodiment is mainly used to improve the reliability of image capture.

[0062] Specifically, the method in this embodiment may include the following steps:

[0063] Step 101: Capture a preview image.

[0064] The preview image is an expression of the real scene corresponding to the acquisition range of the image acquisition device.

[0065] Step 102: Display the preview image.

[0066] For example, Figure 2 As shown in , the mobile phone collects a preview image of the real scene through the RGB camera, and displays the preview image to the user through the mobile phone screen.

[0067] Step 103: Determine a target object, which is a target object in a real scene expressed by the target object and the preview image.

[0068] There may be one or more moving objects in the real scene expressed by the preview image, and accordingly, the preview image contains the object corresponding to each target object. For example, in the real scene of the park, the acquisition range of the RGB camera of the mobile phone is the sports field in the park, and accordingly, the preview image captured by the RGB camera contains the object corresponding to the moving objects such as athletes, footballs, and dogs. Based on this, in the displayed preview image, the object corresponding to one of the target objects is determined as the target object in this embodiment.

[0069] In one implementation, the target object may be: a moving object with the fastest moving speed among all moving objects in the real scene expressed by the preview image;

[0070] In another implementation, the target object may be: a moving object whose corresponding object is closest to the center position of the preview image among all moving objects in the real scene expressed by the preview image;

[0071] In another implementation, the target object may be: among all moving objects in the real scene expressed by the preview image, the moving object whose corresponding object occupies the largest image area in the preview image;

[0072] In another implementation manner, the target object may be: a moving object corresponding to the received selection operation among all moving objects in the real scene expressed by the preview image.

[0073] Specifically, the object corresponding to each moving object is indicated by a wireframe in the preview image, such as Figure 3 As shown in , the user can select the wireframe where the object is located in the preview image to determine the target object corresponding to the target object.

[0074] The wireframe in the preview image can be obtained by:

[0075] First, an event-based visual sensor is used to obtain the brightness change of each pixel in the preview image, such as the processor in the mobile phone receiving the black and white image data output by the EVS; then, the image area where each moving object in the preview image is located is identified based on the pixel value whose brightness change is greater than or equal to the target threshold. The target threshold here is related to the scene type of the real scene expressed by the preview image, such as a football scene or a table tennis scene; finally, the borders of the image area where these moving objects are located are drawn to obtain the wireframe where the object is located.

[0076] It should be noted that if the coordinate systems of the EVS and RGB cameras are different, the data needs to be unified into the same coordinate system, such as the coordinate system of the RGB camera.

[0077] Specifically, if the coordinate systems of the EVS and RGB cameras are different, after obtaining the brightness change, the brightness change of each pixel point in the real scene within the acquisition range output by the EVS can be converted according to the coordinate conversion relationship between the coordinate systems of the EVS and RGB cameras. Then, based on the pixel values ​​whose brightness change is greater than or equal to the target threshold, the image area where each moving object in the preview image is located is identified, and then the borders of the image areas where these moving objects are located are drawn to obtain the wireframe where the object is located.

[0078] Alternatively, if the coordinate systems of the EVS and RGB cameras are different, after identifying the image area where each moving object in the preview image is located, the coordinates of the image area can be transformed according to the coordinate transformation relationship between the coordinate systems of the EVS and RGB cameras, and then the borders of the image area where these moving objects are located can be drawn to obtain the wireframe where the object is located.

[0079] Step 104: Obtaining a captured image in response to a capture parameter, where the capture parameter is determined based on a moving speed of the target object.

[0080] The captured image at least contains an expression of the target object, such as image content corresponding to the target object in the captured image, and the captured image is stored for viewing.

[0081] Specifically, in step 104, the captured image may be obtained in response to the shooting parameters. Furthermore, in step 104, the corresponding captured image may be obtained in response to the shooting parameters and in accordance with the corresponding shooting mode. Based on this, the user does not need to trigger the image acquisition device to start capturing images, and the user does not need to set the shooting mode of the image acquisition device to obtain the corresponding captured image.

[0082] It should be noted that when the image acquisition device is shooting an image, the image acquisition device can shoot the image according to the shooting parameters with the image area corresponding to the target object in the preview image as the focus to obtain the shot image, and store the shot image in the local album. If there are multiple frames of the shot image, these shot images can be stored as a shot video or each frame of the shot image can be stored separately.

[0083] It can be seen from the above technical solution that in a processing method provided by an embodiment of the present application, after the preview image within the acquisition range is acquired and displayed by the image acquisition device, a target object is determined, and the target object corresponds to the target object in the real scene expressed by the preview image. Based on this, a captured image containing the target object is obtained in response to the shooting parameters determined based on the moving speed of the target object, and is stored for viewing. It can be seen that in the present application, during the image preview process, a captured image is obtained based on the moving speed of the target object, and the moving object can be captured without waiting for the user to trigger the image acquisition device, thereby improving the reliability of image capture.

[0084] Based on the above implementation scheme, the shooting parameters may include shooting frame rate and exposure time. Based on this, the higher the moving speed of the target object, the higher the shooting frame rate in the shooting parameters, and correspondingly, the shorter the exposure time in the shooting parameters. In other words, the shooting parameters in this embodiment change with the change of the moving speed of the target object.

[0085] Specifically, the shooting frame rate in the shooting parameters increases as the moving speed of the target object increases, and the exposure time in the shooting parameters decreases as the shooting frame rate increases; or, the shooting frame rate in the shooting parameters decreases as the moving speed of the target object decreases, and the exposure time in the shooting parameters increases as the shooting frame rate decreases.

[0086] Therefore, the shooting frame rate used by the image acquisition device in this embodiment to obtain the captured image changes with the change of the movement speed of the target object. When the movement speed of the target object is high, the image acquisition device uses a higher shooting frame rate to capture the image, so that an image with higher clarity and higher shooting effect can be obtained; and when the movement speed of the target object is low, the image acquisition device uses a lower shooting frame rate to capture the image, so that an image with higher clarity and higher shooting effect can be obtained and the shooting power consumption of the image acquisition device can be reduced.

[0087] In one implementation, when obtaining the captured image in response to the capture parameters, step 104 may be implemented in the following manner:

[0088] A first captured image is obtained based on the first capturing parameter; and a second captured image is obtained based on the second capturing parameter.

[0089] The first captured image and the second captured image are used to express the movement process of the target object in the real scene. The difference between the first shooting parameter and the second shooting parameter is used to characterize the difference in the movement speed of the target object. Accordingly, the clarity of the expression of the target object by the first captured image is the same as the clarity of the expression of the target object by the second captured image, that is, the captured image will not be blurred due to the excessive movement speed of the target object. For example, when the movement speed of the target object is high, the shooting frame rate in the shooting parameters used is also high. In this way, capturing images at a higher shooting frame rate can avoid the situation where the image is blurred due to the excessive movement speed, thereby ensuring the clarity of the image.

[0090] For example, Figure 4 As shown in , in this embodiment, the shooting parameters of the target object during the movement process in the real scene can be obtained according to the movement speed of the target object. As the movement speed of the target object changes, the obtained shooting parameters change accordingly, and then multiple frames of captured images of the target object during the movement process are obtained according to these shooting parameters. Thus, these captured images can express the movement process of the target object, such as the process after a football is kicked or the flight process of a bird after taking off, and the clarity of each frame of the captured image is the same, and there will be no situation where the captured image is blurred due to the excessive speed of the target object.

[0091] In one implementation, before step 104, the method in this embodiment may further include the following processing: Figure 5 As shown in;

[0092] Step 105: Determine shooting parameters.

[0093] That is to say, in this embodiment, after determining the target object, ie, the target object in the real scene, the shooting parameters may be determined based on the moving speed of the target object, and then the captured image may be obtained in response to the shooting parameters.

[0094] Specifically, step 105 can be implemented by the following methods: Figure 6 As shown in:

[0095] Step 601: Obtain the brightness change of each pixel in the real scene corresponding to the acquisition range.

[0096] Specifically, in this embodiment, the EVS can obtain the brightness change of each pixel in the real scene corresponding to the acquisition range, and then, in this embodiment, the brightness change of each pixel in the real scene corresponding to the acquisition range sent by the EVS is received.

[0097] For example, EVS monitors the brightness of each pixel in the real scene corresponding to the acquisition range. If the brightness of each pixel in the real scene corresponding to the acquisition range changes, EVS outputs the brightness change of each pixel in the real scene corresponding to the acquisition range in the form of an event.

[0098] Step 602: Obtain the moving speed of the target object according to the brightness change.

[0099] Specifically, in this embodiment, data accumulation can be performed on the brightness change of each pixel in the real scene corresponding to the acquisition range sent by the EVS. After accumulating data of a specific time length, the movement speed of the target object is calculated based on the accumulated data.

[0100] Step 603: Determine shooting parameters according to the motion speed.

[0101] Specifically, in this embodiment, the shooting frame rate and the corresponding exposure time corresponding to the motion speed may be searched in a preset information table, thereby obtaining the shooting parameters.

[0102] The information table may include the shooting frame rate and the corresponding exposure time corresponding to each motion speed. The information table may perform frame rate calibration based on different motion scenes. Based on this, different motion scenes correspond to different information tables, and each information table includes the shooting frame rate and the corresponding exposure time corresponding to different motion speeds under the corresponding motion scene.

[0103] In one implementation, the target object's motion speed calculated in step 602 is the current speed of the target object at its current position. The current position here can be understood as the current motion position of the target object during its motion in the real scene. Specifically, the current position is the position of the target object at the motion moment corresponding to the brightness change amount sent by the EVS received most recently during its motion. Based on this, in this embodiment, the current speed of the target object at its current position can be obtained in real time as the target object's motion speed, and the shooting parameters can be updated in real time accordingly, so that the image acquisition device can capture images according to the updated shooting parameters. Although it requires more computing power, it can improve the accuracy of the shooting parameters used by the image acquisition device to ensure the shooting effect of the captured image obtained by the image acquisition device, such as high clarity.

[0104] In another implementation, the target object's motion speed calculated in step 602 may be: a predicted speed of the target object on a predicted trajectory, where the predicted trajectory is determined based on the current speed, current acceleration, and current position of the target object. Specifically, the target object's motion speed may be: a predicted speed of the target object at a target position on the predicted trajectory, where the target position is the position of the target object on the predicted trajectory at the moment when the RGB camera captures the image.

[0105] Specifically, in step 602, the current position, current speed and current acceleration of the target object can be first obtained according to the brightness change, and then the motion trajectory of the target object can be predicted according to the current position, current speed and current acceleration to obtain the entire predicted trajectory of the target object during the motion process, and each predicted position in the predicted trajectory corresponds to a predicted speed. For example, in this embodiment, the motion trajectory of the target object can be predicted by a large model based on artificial intelligence AI (Artificial Intelligence). Based on this, in this embodiment, after obtaining the brightness change of each pixel point in the real scene corresponding to the acquisition range, the motion trajectory of the target object and the preset speed at each predicted position can be predicted, so that the predicted speeds at multiple positions can be obtained through one prediction, thereby reducing the consumption of computing power.

[0106] Alternatively, in step 602, the current position, current speed and current acceleration of the target object can be first obtained according to the brightness change amount, and then the motion trajectory of the target object is predicted according to the current position, current speed and current acceleration to obtain the predicted position of the target object at the next moment in the motion process, and the predicted position corresponds to the predicted speed. The next moment here can be the next moment of image capture determined according to the current shooting frame rate of the image acquisition device. For example, in this embodiment, the position and speed of the target object at the next moment can be predicted by a large model based on AI. Based on this, in this embodiment, the predicted speed of the target object at the position at the next moment is predicted in real time, and it is used as the motion speed of the target object, and the shooting parameters used at the next moment are updated in real time accordingly, so that the image acquisition device performs image capture at the next moment according to the updated shooting parameters. Although it requires more computing power, the hysteresis between the shooting parameters and the image capture can be avoided through prediction, and the situation that the prediction of the entire motion trajectory at one time leads to inaccurate prediction can also be avoided, thereby further improving the accuracy of the shooting parameters used by the image acquisition device to ensure the shooting effect of the captured image obtained by the image acquisition device, such as high clarity.

[0107] In one implementation, when obtaining the captured image in response to the capture parameters in step 104, it can be implemented in the following manner: Figure 7 As shown in:

[0108] Step 701: monitor whether there is a moving object in the acquisition range. If there is a moving object in the acquisition range, execute step 702; if there is no moving object in the acquisition range, continue to execute step 701.

[0109] Among them, in this embodiment, EVS can be used to monitor whether there is a moving object in the acquisition range. If data output by EVS, such as the brightness change of each pixel point in the real scene corresponding to the acquisition range, is received, it can be determined that there is a moving object in the acquisition range; otherwise, it can be determined that there is no moving object in the acquisition range.

[0110] It should be noted that there is a moving object within the acquisition range, which may specifically be: the target object within the acquisition range meets the trigger condition. The trigger condition may be: the moving speed of the target object is greater than or equal to the trigger threshold. The trigger threshold may be set as required.

[0111] Step 702: Obtain the moving speed of the target object.

[0112] In step 702, the brightness change of each pixel in the real scene corresponding to the acquisition range output by the EVS can be obtained first, and then the movement speed of the target object can be obtained according to the brightness change. The specific method can refer to the corresponding content in the previous text.

[0113] Step 703: obtaining shooting parameters based on the moving speed of the target object;

[0114] In step 703, the shooting frame rate and the corresponding exposure time corresponding to the motion speed may be searched in a preset information table, thereby obtaining shooting parameters.

[0115] Step 704: Obtain a captured image according to the shooting parameters.

[0116] For example, Figure 8 As shown in the figure, it is an example of an image capture of a moving object in a mobile phone equipped with EVS and RGB cameras:

[0117] First, the user turns on the RGB camera of the mobile phone. After the RGB camera is started, images of the park sports field are captured according to the default frame rate, such as 30fps, and exposure time, such as 1 millisecond, thereby outputting the captured preview image to the mobile phone screen; at the same time, EVS is started, and EVS continuously monitors the park sports field according to the parameters of 1000 frames per second.

[0118] Afterwards, in the park sports field, an athlete kicks a football, and the user selects the football as the target object in the preview image. At this time, when the EVS detects that the football is kicked, that is, at time T0, the EVS outputs black and white image data (that is, the brightness change of each pixel in the park sports field) to the central processing unit CPU (Central Processing Unit) in the mobile phone (it can also be other processors, such as a graphics processing unit GPU (graphics processing unit)). The CPU accumulates black and white image data from T0 until it accumulates to time T1, so that there is enough black and white image data for the CPU to calculate the movement speed of the football at time T1. Starting at T1, a new frame rate and exposure time are obtained by looking up the table, such as a frame rate of 120fps and an exposure time of 0.05 milliseconds. After the new frame rate and exposure time are obtained by looking up the table at time T2, the CPU sends the new frame rate and exposure time to the RGB camera, so that the RGB camera switches to the new frame rate and exposure time. After the switching is completed at time T3, the RGB camera starts to capture images according to the new frame rate and exposure time. Therefore, as the speed of the football increases, the RGB camera captures images according to the increased frame rate;

[0119] Then, as the football moves, the EVS camera accumulates a new batch of black-and-white image data at time T4 and transmits the data to the CPU. The CPU starts to obtain a new frame rate and exposure time by looking up the table at T4, such as a frame rate of 60fps and an exposure time of 0.1 milliseconds. After looking up the table at time T5 to obtain the new frame rate and exposure time, the CPU sends the new frame rate and exposure time to the RGB camera, so that the RGB camera switches to the new frame rate and exposure time. After the switch is completed at time T6, the RGB camera starts to capture images according to the new frame rate and exposure time. Therefore, as the speed of the football decreases, the RGB camera captures images at a reduced frame rate.

[0120] Finally, the user may trigger the RGB camera to end image capture, or, when the EVS stops outputting black-and-white image data to the CPU, the CPU controls the RGB camera to stop image capture.

[0121] It should be noted that there may be a delay time between when the EVS detects that the target object meets the trigger condition and when the processor triggers the RGB camera to capture an image. The delay time can be determined based on the data transmission delay between the EVS and the CPU, the data transmission delay between the processor and the RGB, and the calculation delay of the processor to obtain the movement speed of the target object. In a specific implementation, the operating parameters of the electronic device can be debugged in this embodiment to minimize the delay time.

[0122] refer to Fig. 9 , is a structural diagram of a processing method provided in an embodiment of the present application, which can be applied to electronic devices with image acquisition devices, such as mobile phones, tablet computers and other devices. An image acquisition device can be deployed in an electronic device, and there can be one or more image acquisition devices. For example, the image acquisition device may include an RGB camera and a camera with EVS, etc. The technical solution in this embodiment is mainly used to improve the reliability of image capture.

[0123] Specifically, the method in this embodiment may include the following steps:

[0124] Step 901: Capture a preview image.

[0125] The preview image is an expression of the real scene corresponding to the acquisition range of the image acquisition device.

[0126] Step 902: Display the preview image;

[0127] Step 903: determining a target object, where the target object corresponds to a target object in the real scene expressed by the preview image;

[0128] Step 904: obtaining a captured image in response to the capturing parameters, wherein the captured image includes an expression of the target object, and the captured image is used for storage for viewing;

[0129] The target object moves at different speeds at the first moment and the second moment, respectively, so that the shooting parameters used by the captured image corresponding to the first moment and the captured image corresponding to the second moment are different.

[0130] For example, Fig.10 As shown in , during the movement of the target object, there is a first moment and a second moment. The target object moves to a first position at the first moment, and moves to a second position at the second moment. At the first moment, the image acquisition device obtains a first captured image of the target object according to a first shooting parameter, and at the second moment, the image acquisition device obtains a second captured image of the target object according to a second shooting parameter. Based on this, if the moving speed of the target object at the first moment is different from the moving speed at the second moment, correspondingly, the first shooting parameter and the second shooting parameter are different, that is, as the moving speed of the target object changes, the shooting parameters used by the image acquisition device to capture the image of the target object are different, such as different shooting frame rates and exposure times.

[0131] It can be seen from the above technical solution that in a processing method provided by an embodiment of the present application, after the preview image within the acquisition range is acquired and displayed by the image acquisition device, a target object is determined, and the target object corresponds to the target object in the real scene expressed by the preview image. Based on this, a captured image containing the target object is obtained in response to the shooting parameters determined based on the moving speed of the target object, and is stored for viewing. It can be seen that in the present application, during the image preview process, a captured image is obtained based on the moving speed of the target object, and the moving object can be captured without waiting for the user to trigger the image acquisition device, thereby improving the reliability of image capture.

[0132] refer to Fig.11 , is a schematic diagram of the structure of a processing device provided in an embodiment of the present application, and the device can be deployed in an electronic device having an image acquisition device, such as a mobile phone, a tablet computer and other devices. An image acquisition device can be deployed in an electronic device, and there can be one or more image acquisition devices. For example, the image acquisition device may include an RGB camera and an EVS camera, etc. The technical solution in this embodiment is mainly used to improve the reliability of image capture.

[0133] Specifically, the device in this embodiment may include the following units:

[0134] The preview acquisition unit 1101 is used to acquire a preview image, where the preview image is an expression of a real scene corresponding to the acquisition range of the image acquisition device;

[0135] A preview display unit 1102, configured to display the preview image;

[0136] An object determination unit 1103 is used to determine a target object, where the target object corresponds to a target object in a real scene expressed by the preview image;

[0137] An image capturing unit 1104, configured to obtain a captured image in response to a capturing parameter, wherein the captured image includes an expression of the target object, and the captured image is used to store for viewing;

[0138] Wherein, the shooting parameters are determined based on the moving speed of the target object.

[0139] It can be seen from the above technical solution that in a processing device provided by an embodiment of the present application, after the preview image within the acquisition range is acquired and displayed by the image acquisition device, a target object is determined, and the target object corresponds to the target object in the real scene expressed by the preview image. Based on this, a captured image containing the target object is obtained in response to the shooting parameters determined based on the moving speed of the target object, and is used to store for viewing. It can be seen that in the present application, during the image preview process, the captured image is obtained based on the moving speed of the target object, and the moving object can be captured without waiting for the user to trigger the image acquisition device, thereby improving the reliability of image capture.

[0140] In one implementation, the higher the moving speed of the target object, the higher the frame rate in the shooting parameters.

[0141] In one implementation, obtaining a captured image in response to a capture parameter includes:

[0142] A first captured image is obtained based on a first shooting parameter; a second captured image is obtained based on a second shooting parameter; wherein the first captured image and the second captured image are used to express the movement process of the target object in the real scene; and the difference between the first shooting parameter and the second shooting parameter is used to characterize the difference in the movement speed of the target object.

[0143] In one implementation, before obtaining the captured image in response to the capturing parameters, the image capturing unit 1104 is further configured to: determine the capturing parameters.

[0144] Specifically, when determining shooting parameters, the image capture unit 1104 is specifically used to: obtain the brightness change of each pixel point in the real scene corresponding to the acquisition range; obtain the movement speed of the target object according to the brightness change; and determine the shooting parameters according to the movement speed.

[0145] In one implementation, the movement speed is the current speed of the target object at the current position; or, the movement speed is the predicted speed of the target object on a predicted trajectory, and the predicted trajectory is determined based on the current speed, current acceleration and current position of the target object.

[0146] In one implementation, the image capturing unit 1104 is specifically used to: monitor whether there is a moving object within the acquisition range; when there is a moving object within the acquisition range, obtain the movement speed of the target object; obtain shooting parameters based on the movement speed of the target object; and obtain a captured image according to the shooting parameters.

[0147] It should be noted that the specific implementation method of each unit in this embodiment can refer to the corresponding content in the previous text and will not be described in detail here.

[0148] refer to Fig.12 , is a schematic diagram of the structure of a processing device provided in an embodiment of the present application, and the device can be deployed in an electronic device having an image acquisition device, such as a mobile phone, a tablet computer and other devices. An image acquisition device can be deployed in an electronic device, and there can be one or more image acquisition devices. For example, the image acquisition device may include an RGB camera and an EVS camera, etc. The technical solution in this embodiment is mainly used to improve the reliability of image capture.

[0149] Specifically, the device in this embodiment may include the following units:

[0150] The preview acquisition unit 1201 is used to acquire a preview image, where the preview image is an expression of a real scene corresponding to the acquisition range of the image acquisition device;

[0151] A preview display unit 1202, configured to display the preview image;

[0152] An object determination unit 1203 is used to determine a target object, where the target object corresponds to a target object in a real scene expressed by the preview image;

[0153] An image capturing unit 1204, configured to obtain a captured image in response to a capturing parameter, wherein the captured image includes an expression of the target object, and the captured image is used to store for viewing;

[0154] The target object moves at different speeds at the first moment and the second moment, respectively, so that the shooting parameters used by the captured image corresponding to the first moment and the captured image corresponding to the second moment are different.

[0155] It can be seen from the above technical solution that in a processing device provided by an embodiment of the present application, after the preview image within the acquisition range is acquired and displayed by the image acquisition device, a target object is determined, and the target object corresponds to the target object in the real scene expressed by the preview image. Based on this, a captured image containing the target object is obtained in response to the shooting parameters determined based on the moving speed of the target object, and is used to store for viewing. It can be seen that in the present application, during the image preview process, the captured image is obtained based on the moving speed of the target object, and the moving object can be captured without waiting for the user to trigger the image acquisition device, thereby improving the reliability of image capture.

[0156] refer to Fig.13 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, and the electronic device may be an electronic device with an image acquisition device, such as a mobile phone, a tablet computer, and other devices. An image acquisition device may be deployed in the electronic device, and there may be one or more image acquisition devices. For example, the image acquisition device may include an RGB camera and an EVS camera, etc. The technical solution in this embodiment is mainly used to improve the reliability of image capture.

[0157] Specifically, the electronic device in this embodiment may include the following structure:

[0158] The first image acquisition device 1301 is used to acquire a preview image, where the preview image is an expression of a real scene corresponding to the acquisition range of the first image acquisition device;

[0159] The processor 1302 is used to display the preview image; determine a target object, the target object corresponds to a target object in a real scene expressed by the preview image; obtain a captured image by the first image acquisition device 1301 in response to a capture parameter, the captured image includes an expression of the target object, and the captured image is used to store for viewing;

[0160] Wherein, the shooting parameters are determined based on the moving speed of the target object.

[0161] It can be seen from the above technical solution that in an electronic device provided by an embodiment of the present application, after the preview image within the acquisition range is acquired and displayed by the image acquisition device, a target object is determined, and the target object corresponds to the target object in the real scene expressed by the preview image. Based on this, a captured image containing the target object is obtained in response to a shooting parameter determined based on the moving speed of the target object, and is stored for viewing. It can be seen that in the present application, during the image preview process, a captured image is obtained based on the moving speed of the target object, and the moving object can be captured without waiting for the user to trigger the image acquisition device, thereby improving the reliability of image capture.

[0162] In one implementation, the electronic device in this embodiment further includes the following structure: Fig.14 As shown in:

[0163] The second image acquisition device 1303 is used to acquire the brightness change of each pixel in the real scene corresponding to the acquisition range, and send the brightness change to the processor 1302;

[0164] The processor 1302 is further configured to obtain a moving speed of the target object according to the brightness change, determine the shooting parameters according to the moving speed, and send the shooting parameters to the first image acquisition device 1301 .

[0165] Taking the scene of a football match shot by a mobile phone as an example, the technical solution of this application is illustrated below:

[0166] First, the EVS sensor is used in the mobile phone in conjunction with the RGB camera to perform self-trigger focus capture and shooting of moving objects.

[0167] Among them, the EVS sensor is essentially an event-triggered sensor. The principle is that it will only trigger the output of the moving part of the object information when there is displacement in the shooting picture. Therefore, it has an extremely fast response speed and an extremely short image output delay. It can achieve an output frame rate of 1000fps, and only outputs the displacement difference, so as to accurately capture the real moving subject and accurately locate and track it.

[0168] Based on this, after the coordinate system of the RGB camera and the EVS camera are calibrated in this application, due to the sensitivity of the EVS camera to moving objects and the calculation of the moving position through multiple frames of images, the current acceleration situation can be accurately calculated and the motion trajectory can be predicted. The shutter conditions of the RGB camera can be triggered based on the debugging settings, thereby capturing the best motion moment and posture.

[0169] The advantages of adopting the technical solution of this application are as follows:

[0170] 1. Under the premise that the frame rate of the RGB camera is not improved, the technical solution of the present application can capture and shoot high-speed moving objects more accurately.

[0171] 2. This application can realize accurate automatic capture of the best motion moment through algorithms, without being limited by the reaction time of pressing the shutter and the route of the motion trajectory.

[0172] This application is divided into the product calibration stage and the user use stage. In the product calibration stage, there are the following processing procedures, such as Fig.15 As shown in:

[0173] First, calibrate the coordinate system of the EVS camera and RGB camera in the mobile phone, such as Fig.16 As shown in , the coordinates of the coordinate system a of the EVS camera are represented by Xa, Ya, and Za, the coordinates of the coordinate system b of the RGB camera are represented by Xb, Yb, and Zb, and the coordinates of the coordinate system p of the mobile phone screen are represented by Xp, Yp, and Zp. In the specific implementation, there is a coordinate conversion relationship between the coordinate system b and the coordinate system p, there is a coordinate conversion relationship between the coordinate system a and the coordinate system b, and there is a coordinate conversion relationship between the coordinate system a and the coordinate system p. Among them, the coordinate system p can be the same coordinate system as the coordinate system b.

[0174] Based on this, based on application scenario requirements such as motion scene types, debug the EVS trigger threshold and the delay time for triggering RGB shooting and framing based on the EVS output;

[0175] In addition, an algorithm for calculating the acceleration, speed and motion trajectory of a moving object based on the output of the EVS is pre-set, and the motion speed, ambient brightness and optimal exposure time are calibrated.

[0176] In addition, the present application also supports the user clicking on the tracked moving object, and the processor as the main controller transmits its coordinates to two cameras, namely the RGB camera and the EVS camera, and limits the calculation of the moving object based on the output of the EVS to the selected tracked moving object.

[0177] Based on this, during the user use phase, the following processing is performed: Fig.17 As shown in:

[0178] First, the user can manually select the object to be tracked, i.e., the target object, in the preview screen of the mobile phone camera (i.e., the preview image mentioned above). If no manual selection is made, the shooting is triggered according to the default algorithm. For example, the target object can be selected as the moving object closest to the center of the preview screen according to the default algorithm. For another example, the target object can be selected as the moving object with the fastest moving speed in the preview image according to the default algorithm, etc.;

[0179] Then, the EVS camera detects motion that exceeds the motion threshold (i.e., the trigger threshold) and regards it as valid (i.e., the trigger condition mentioned above). The output of the EVS triggers the CPU (master control) to send a shooting instruction to the RGB camera.

[0180] Afterwards, the EVS camera captures the brightness change of each pixel, and the CPU captures the motion acceleration and motion trajectory, predicts the motion speed and future motion trajectory, and adjusts the appropriate frame rate and exposure time in combination with the ambient brightness, and sends it to the RGB camera in real time;

[0181] Finally, when the moving object is detected to leave the picture or stop moving, or the user stops shooting manually, the user can then find the favorite photo in the entire footage shot by automatic motion capture.

[0182] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0183] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0184] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0185] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A processing method comprising: Capturing a preview image, wherein the preview image is an expression of a real scene corresponding to a capture range of the image capture device; displaying the preview image; Determining a target object, the target object corresponding to a target object in a real scene expressed by the preview image; obtaining a captured image in response to a capture parameter, the captured image including an expression of the target object, the captured image being used for storage for viewing; Wherein, the shooting parameters are determined based on the moving speed of the target object. 2 . The method according to claim 1 , wherein the higher the moving speed of the target object is, the higher the frame rate in the shooting parameters is.

3. The method according to claim 1 or 2, obtaining a captured image in response to a capture parameter, comprising: Obtaining a first captured image based on a first capturing parameter; obtaining a second captured image based on the second capturing parameter; The first captured image and the second captured image are used to express the movement process of the target object in the real scene; The difference between the first shooting parameter and the second shooting parameter is used to represent the difference in the moving speed of the target object.

4. The method according to claim 1, before obtaining the captured image in response to the capturing parameters, further comprising: Determine the shooting parameters.

5. The method according to claim 4, determining the shooting parameters comprises: Obtaining the brightness change of each pixel in the real scene corresponding to the acquisition range; Obtaining the moving speed of the target object according to the brightness change; The shooting parameters are determined according to the movement speed.

6. The method according to claim 5, wherein the movement speed is the current speed of the target object at the current position; Alternatively, the movement speed is a predicted speed of the target object on a predicted trajectory, and the predicted trajectory is determined based on a current speed, a current acceleration, and a current position of the target object.

7. The method according to claim 1 or 2, obtaining a captured image in response to a capture parameter, comprising: Monitoring whether there is a moving object within the acquisition range; When there is a moving object within the acquisition range, obtaining the moving speed of the target object; Based on the moving speed of the target object, obtaining shooting parameters; According to the shooting parameters, a shot image is obtained.

8. A processing method comprising: Capturing a preview image, wherein the preview image is an expression of a real scene corresponding to a capture range of the image capture device; displaying the preview image; Determining a target object, the target object corresponding to a target object in a real scene expressed by the preview image; obtaining a captured image in response to a capture parameter, the captured image including an expression of the target object, the captured image being used for storage for viewing; The target object moves at different speeds at the first moment and the second moment, respectively, so that the shooting parameters used by the captured image corresponding to the first moment and the captured image corresponding to the second moment are different.

9. An electronic device, comprising: A first image acquisition device, used to acquire a preview image, wherein the preview image is an expression of a real scene corresponding to a capture range of the first image acquisition device; A processor, configured to display the preview image; Determine a target object, the target object corresponding to a target object in a real scene expressed by the preview image; obtain a captured image by the first image acquisition device in response to a capture parameter, the captured image including an expression of the target object, and the captured image is used to store for viewing; Wherein, the shooting parameters are determined based on the moving speed of the target object.

10. The electronic device according to claim 9, further comprising: A second image acquisition device is used to acquire the brightness change of each pixel in the real scene corresponding to the acquisition range, and send the brightness change to the processor; The processor is further configured to obtain a moving speed of the target object according to the brightness change, determine the shooting parameters according to the moving speed, and send the shooting parameters to the first image acquisition device.

Images