A shooting terminal and shooting method based on pulse array detection

Abstract

The embodiment of the present application discloses a shooting terminal and shooting method based on pulse array detection. The terminal provided by the embodiment of the present application is provided with a pulse array sensor, which uses a pulse array to detect the current shooting scene. After the shooting parameters are detected, the terminal shoots according to the shooting parameters. In this way, the embodiment of the present application uses a pulse array detection method to shoot, thereby improving the shooting quality.

Description

Technical Field

[0001] The present application relates to the field of sensor imaging, and in particular to a shooting terminal and shooting method based on pulse array detection. Background Art

[0002] With the rapid development of terminals such as mobile phones, PDAs or laptops, more and more terminals can shoot the current shooting scene. When shooting, the terminal needs to set shooting parameters such as exposure time, aperture parameters and / or focal length, and then shoot the current shooting scene presented in the lens module preset by the terminal according to the preset shooting parameters. When shooting, the terminal usually uses an image sensor. The working principle of terminal shooting is: the image sensor of the terminal converts the light intensity in the lens module of the terminal into electric charge, and then converts the electric charge into a digital signal for storage to obtain the captured image.

[0003] When the terminal shoots a shooting scene including a moving object, the captured image will have a quality problem of dynamic blur. This is because the preset shooting parameters cannot meet the shooting requirements of the moving shooting scene, and the dynamic range value of the terminal's image sensor cannot meet the requirements. Specifically, the preset exposure time, that is, the shutter speed value preset by the terminal is lower than the speed of the moving object in the current shooting scene, resulting in the inability to capture the moving object or even if the moving object is captured, the captured image including the moving object is blurred. There may be areas with too bright or too dark light in the current shooting scene, such as a large contrast between light and dark or backlight, and the dynamic range (DynamicRange) of the terminal's image sensor is limited, resulting in overexposure of bright areas and underexposure of dark areas during shooting, causing oversaturation and / or distortion in areas beyond the dynamic range.

[0004] Therefore, how to improve the shooting quality of the terminal, especially to improve the shooting quality of shooting scenes including moving objects, is a problem to be solved urgently. Summary of the invention

[0005] In view of this, an embodiment of the present application provides a shooting terminal based on pulse array detection, which can improve the shooting quality.

[0006] An embodiment of the present application also provides a shooting method of a shooting terminal based on pulse array detection, which can improve the shooting quality.

[0007] In one embodiment of the present application, a shooting terminal based on pulse array detection is provided, the terminal comprising: a lens module 101, a pulse array sensor 102 and a shooting control device 103, wherein:

[0008] The lens module 101 is used to obtain the current shooting scene;

[0009] The pulse array sensor 102 is used to detect the current shooting scene acquired by the lens module 101 by using a pulse array, and send the shooting parameters obtained by the detection to the shooting control device 103, wherein the pulse array sensor 102 is composed of a pixel array 1021 and a readout circuit 1022, the pixel array 1021 is composed of a plurality of pixel units, and the light signal is converted into a pulse signal by each of the pixel units and then outputted through the readout circuit 1022, and the pulse signal outputted by the pixel unit forms a pulse signal sequence on the time axis as the shooting parameter obtained by the detection;

[0010] The shooting control device 103 is used to control the shooting terminal to perform shooting according to the shooting parameters received from the pulse array sensor 102 .

[0011] In the above-mentioned shooting terminal, the shooting control device 103 controls the shooting terminal to shoot including:

[0012] The shooting control device 103 controls the pulse array sensor 102 to shoot the current shooting scene.

[0013] In the above-mentioned shooting terminal, the detection frequency value of the pulse array sensor 102 is higher than the motion speed value of the moving object in the current shooting scene.

[0014] In the above-mentioned shooting terminal, the dynamic range of the pulse array sensor 102 is not lower than the dynamic range of controlling the shooting terminal to perform shooting.

[0015] In the above-mentioned shooting terminal, further,

[0016] The pulse array sensor 102 is further configured to detect the region of interest by using a pulse array after receiving the region of interest in the current shooting scene.

[0017] In the above-mentioned shooting terminal, further,

[0018] The pulse array sensor 102 is further used to determine whether the proportion of the number of pixel units whose pixel values ​​in the region of interest in two adjacent frames detected by the pulse array have changed exceeds a preset proportion threshold, and if so, set the exposure time in the shooting parameters to the exposure time required for shooting a moving object; and / or,

[0019] The pulse array sensor 102 is also used to calculate the time interval for the change of the pulse signal frequency of two adjacent frames when it is determined that the pulse signal frequency of two adjacent frames of the pixel units exceeding a set ratio in the area of ​​interest has changed, and to determine whether the time interval is less than a preset time interval threshold. If so, adjust the aperture parameter in the shooting parameter.

[0020] In the above-mentioned shooting terminal, the pulse array sensor 102 also sets a preset threshold value in its plurality of pixel units, and the preset threshold value is a reference value for converting the photogenerated charge in the pixel unit into a pulse signal.

[0021] In another embodiment of the present application, a photographing method of a photographing terminal based on pulse array detection is provided, the method comprising:

[0022] The pulse array detection is used for the current shooting scene, including: setting a detection frequency and / or setting a dynamic range to detect and obtain shooting parameters, wherein the detection frequency is higher than the motion rate value of the moving object in the current shooting scene, and / or the dynamic range is not lower than the dynamic range used when shooting;

[0023] The current shooting scene is shot according to the shooting parameters.

[0024] In the above shooting method, before the pulse array detection is used for the current shooting scene, the method includes:

[0025] Determine a region of interest in the current shooting scene, and detect the region of interest using a pulse array;

[0026] The detection and acquisition of shooting parameters include:

[0027] Determine whether the proportion of the number of pixel units whose pixel values ​​in the region of interest change in two adjacent frames detected by the pulse array exceeds a preset proportion threshold, and if so, set the exposure time in the shooting parameters to the exposure time required for shooting a moving object; and / or,

[0028] When it is determined that the pulse signal frequency of two adjacent frames of pixel units exceeding a set ratio in the area of ​​interest changes, it is calculated whether the time interval between the changes in the pulse signal frequency of the two adjacent frames is less than a preset time interval threshold. If so, the aperture parameter in the shooting parameters is adjusted.

[0029] In the above-mentioned shooting method, shooting the current shooting scene includes:

[0030] The pulse array sensor of the terminal shoots the current shooting scene;

[0031] Before detecting and / or photographing the current shooting scene, the method further includes:

[0032] A preset threshold value in a plurality of pixel units in a pulse array sensor of the terminal is set, wherein the preset threshold value is a reference value for converting photogenerated charges in the pixel units into pulse signals.

[0033] As can be seen above, the terminal provided in the embodiment of the present application is provided with a pulse array sensor, which uses a pulse array to detect the current shooting scene, and after obtaining the shooting parameters, the terminal shoots according to the shooting parameters. In this way, the embodiment of the present application uses a pulse array detection method to shoot, thereby improving the shooting quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 A schematic diagram of the structure of a shooting terminal based on pulse array detection provided in an embodiment of the present application;

[0035] Figure 2 A schematic diagram of the structure of a pulse array sensor 102 provided in an embodiment of the present application;

[0036] Figure 3 A second schematic diagram of the structure of the pulse array sensor 102 provided in an embodiment of the present application;

[0037] Figure 4 A flow chart of a shooting method of a shooting terminal based on pulse array detection provided in an embodiment of the present application;

[0038] Figure 5 A schematic diagram of selecting an area of ​​interest in a current shooting scene provided in an embodiment of the present application;

[0039] Figure 6 A flowchart of a specific example of a shooting method of a shooting terminal based on pulse array detection provided in an embodiment of the present application;

[0040] Figure 7 A schematic diagram of an electronic device provided according to another embodiment of the present application. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0042] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0043] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0044] It can be seen from the background technology that the shooting quality problems such as motion blur when the terminal is shooting, especially when shooting scenes including moving objects, are mainly caused by the preset exposure time being lower than the speed of the moving object in the current shooting scene, resulting in the light change process being superimposed and "flattened" between multiple frames of images within the exposure time period of the shooting, and the captured image has motion blur; the difference in light intensity in different areas of the current shooting scene exceeds the dynamic range value of the image sensor preset by the terminal, resulting in oversaturation or distortion in the areas of the shooting scene that exceed the dynamic range value.

[0045] In order to overcome the above problems, before the terminal shoots, a certain type of sensor can be set in the terminal to detect the current shooting scene, so as to obtain shooting parameters such as shutter exposure time and automatically set them. For example, a dot matrix photoelectric detector is set in the terminal to detect to obtain shooting parameters, but since the dot matrix photoelectric detector usually uses radar to detect whether there is a moving object in the current shooting scene, the cost is relatively high; at the same time, it is also impossible to divide the current shooting scene into different areas, and give a reference to the light intensity of different shooting scenes in different areas, but to give a reference to the light intensity of the entire shooting scene.

[0046] Furthermore, the dot matrix photoelectric detector set in the terminal has a limited dynamic range value, which cannot meet the needs of detecting the brightness difference of light intensity in different areas in the current shooting scene. When there are areas with too bright light intensity or too dark light intensity in the current shooting scene, it is impossible to detect the light intensity value of the current shooting scene and determine the shooting parameters based on the detected light intensity value.

[0047] Therefore, the terminal provided in the embodiment of the present application is provided with a pulse array sensor, which uses a pulse array to detect the current shooting scene. After the shooting parameters are detected, the terminal shoots according to the shooting parameters. Since the pulse array sensor adopts a pulse array detection method, it records the continuous light intensity information in the current shooting scene in a pulse sequence. It has the function of capturing and recording high-speed motion, and has the function of reconstructing the texture details in the current shooting scene. Therefore, it can accurately obtain whether the current shooting scene includes a moving object, so as to adopt the shooting parameters required for the shooting scene suitable for the moving object to improve the shooting quality. Since the pulse array sensor adopts a pulse array detection method, its dynamic range is not lower than the dynamic range of general photoelectric detectors such as dot matrix photoelectric detectors, and can meet the detection needs of the light and dark difference of light intensity in different areas in the current shooting scene, and then can accurately detect the light intensity value of the current shooting scene, and determine the shooting parameters such as aperture parameters according to the detected light intensity value.

[0048] Furthermore, when the terminal is shooting the current shooting scene, it can also use a pulse array sensor. Compared with other commonly used image sensors for shooting, the pulse array sensor uses a pulse array detection method and has a higher dynamic range. It can meet the shooting needs of the brightness difference of light intensity in different areas of the current shooting scene, thereby improving the shooting quality.

[0049] In this way, the embodiment of the present invention enables the terminal to take pictures using a pulse array detection method, thereby improving the quality of the pictures.

[0050] In an embodiment of the present invention, the pulse array sensor provided in the terminal can be implemented by complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) process. In specific implementation, it can detect the moving object in the region of interest (ROI) in the current shooting scene and output the corresponding exposure time value. Furthermore, it can also detect the light intensity value of the region of interest in the current shooting scene and output the corresponding aperture parameter value. The pulse array sensor in the terminal transmits the detected shooting parameters to the shooting control device of the terminal, which is a shutter or aperture control device. The shooting control device of the terminal controls the terminal to shoot the current shooting scene according to the shooting parameters, so as to shoot a clear and distortion-free shooting scene including moving objects, thereby improving the shooting quality.

[0051] In the embodiment of the present application, in order to solve the problem that the exposure time of shooting is lower than the movement speed of the moving object in the shooting, since the terminal adopts a pulse array sensor, and the detection frequency of the pulse array sensor can be set higher than the movement rate of the moving object in the current shooting scene, for example, the detection frequency is above 1KHz, so as to detect the moving object, so that when the moving object is detected, a shutter speed value that can satisfy the shooting scene including the moving object is obtained, so as to automatically control the shooting. In order to solve the problem that the light intensity difference of the current shooting scene is large, which causes the light intensity of different areas to be too bright or too dark, the embodiment of the present application adopts a pulse array sensor, which has a larger dynamic range value, so that the overly bright or dark areas of the interest area of ​​the current shooting scene are detected. Otherwise, when detecting the high brightness value of the interest area of ​​the current shooting scene, saturation has been reached, and the light intensity value of the interest area of ​​the current shooting scene cannot be detected. The corresponding aperture parameter value is determined according to the detected light intensity value, and the aperture parameter value is used for shooting. Here, the natural scene illumination is from 10 -4 Lux (in dark night) to 10 5 lux (in the case of summer solstice sunlight), spanning 9 orders of magnitude. If you want to cover 9 orders of magnitude at the same time, such as observing the sun and faint starlight in outer space at the same time, the dynamic range value is obtained using the following formula:

[0052]

[0053] For example: the pulse array sensor set in the terminal uses a 1 million Hz pulse array sensor, and its maximum dynamic range value is 20×log1000000=120 (dB). It detects the light intensity value of the area of ​​interest in the current shooting scene, and obtains the corresponding aperture parameter value based on this: when the light intensity represented by the light intensity value is too bright, the aperture parameter is adjusted down; when the light intensity represented by the light intensity value is too dark, the aperture parameter is adjusted up.

[0054] Figure 1 A schematic diagram of a photographing terminal structure based on pulse array detection provided in an embodiment of the present application includes: a lens module 101, a pulse array sensor 102 and a photographing control device 103, wherein:

[0055] The lens module 101 is used to obtain the current shooting scene;

[0056] The pulse array sensor 102 is used to detect the current shooting scene acquired by the lens module 101 using a pulse array, and send the shooting parameters obtained by the detection to the shooting control device 103;

[0057] The shooting control device 103 is used to control the shooting terminal to perform shooting according to the shooting parameters received from the pulse array sensor 102.

[0058] In the above structure, the shooting control device 103 controls the shooting terminal to shoot, including: controlling the pulse array sensor 102 to shoot the current shooting scene. That is, the pulse array sensor 102 has both detection function and shooting function.

[0059] The above-mentioned terminal is a terminal such as a mobile phone, a cell phone, a camera, a PAD or a laptop computer, and there is no restriction here.

[0060] In the above terminal, the shooting control device 103 includes a shutter, or / and an aperture control device, or / and a focal length control device, etc., which are not limited here. There is a communication interface between the pulse array sensor 102 and the shooting control device 103, such as a mobile industry processor interface (MIPI or Mobile Industry Processor Interface), a D-PHY interface or a C-PHY interface, etc., for transmitting shooting parameters.

[0061] In the above terminal, the pulse array sensor 102 is also called a pulse sequence sensor. The pulse array sensor 102 records the continuous light intensity information in the current shooting scene by simulating the imaging method of the retina in primates with the release of high-density pulse sequences, which can capture and record high-speed motion and reconstruct the texture details in the current shooting scene. Therefore, the pulse array sensor 102 can be used to detect the current shooting scene and obtain accurate shooting parameters, which include exposure time, aperture parameters or focal length, etc., which are not limited here.

[0062] In the above terminal, the detection frequency set by the pulse array sensor 102 is higher than the motion rate value of the moving object in the current shooting scene, and the dynamic range of the pulse array sensor 102 is not lower than the dynamic range used when controlling the shooting terminal to shoot.

[0063] In the above structure, the pulse array sensor 102 is composed of a pixel array and a readout circuit. The pixel array is composed of multiple pixel units. The light signal is converted into a pulse signal by each pixel unit and then output through the readout circuit. The pulse signal output by the pixel unit forms a pulse signal sequence on the time axis as the shooting parameter obtained by detection.

[0064] In the above terminal, the pulse array sensor 102 is also used to receive the selection information of the region of interest in the current shooting scene, and then use array detection to detect the region of interest in the current shooting scene. Here, the region of interest can be one or more (for example, the first priority region and the second priority region, and the proportion of each priority region can be preset or specified), and the area of ​​the region of interest is not limited, as long as it is within the current shooting scene. Furthermore, the region of interest can be the entire current shooting scene.

[0065] In the above-mentioned terminal, the pulse array sensor 102 is also used to determine whether the proportion of the number of pixel units whose pixel values ​​in the area of ​​interest between two adjacent frames detected exceeds a preset proportion threshold. If so, the exposure time in the shooting parameters is set to the exposure time required for shooting moving objects.

[0066] Of course, it is also possible to adjust other parameters such as aperture parameters or focal length parameters, etc., based on whether the proportion of the number of pixel units whose pixel values ​​in the region of interest have changed between the two adjacent frames detected exceeds a preset proportion threshold. Specifically, the pulse array sensor 102 is also used to calculate whether the time interval between the changes in the pulse signal frequency of the two adjacent frames of the pixel unit is less than the preset time interval threshold when it is determined that the pulse signal frequency of the two adjacent frames of the pixel unit in the region of interest has changed by more than a set proportion. If so, the aperture parameter in the shooting parameter is adjusted based on the correspondence between the light intensity value preset on the calibration plate and the aperture parameter value. Wherein, adjusting the aperture parameter in the shooting parameter includes: increasing or decreasing the aperture parameter in the shooting parameter to the aperture parameter value corresponding to the calculated light intensity value of the pixel unit.

[0067] In the above terminal, the pulse array sensor 102 shoots the current shooting scene based on the shooting parameters under the control of the shooting control device 103.

[0068] In the above terminal, before photographing or / and detecting the current shooting scene, the pulse array sensor 102 also sets the preset thresholds in its multiple pixel units, that is, the preset thresholds in the multiple pixel units in the pulse array sensor 102 are set, and the preset thresholds are the reference values ​​of the photogenerated charges in the pixel units converted into pulse signals, wherein the reference values ​​of the pulse signals can reflect the light intensity values ​​of the corresponding pixel units. In this way, when the light intensity in the pixel units is strong, the preset threshold can be set to be relatively small, and when the light intensity in the pixel units is weak, the preset threshold can be set to be relatively large, so as to ensure that the pulse array sensor 102 improves the detection or / and shooting quality when performing detection or / and shooting. Of course, the preset thresholds in the pixel units can be the same or different. When they are different, according to the different brightness of each area in the current shooting scene, the preset thresholds of the corresponding pixel units are set differently: the preset thresholds of the pixel units corresponding to the areas with strong light intensity are set to be small, and the preset thresholds of the pixel units corresponding to the areas with weak light intensity are set to be large.

[0069] In the above terminal, the lens module 101 is implemented by the camera of the terminal, and the pulse array sensor 102 can interact with the lens module 101 in parallel or serial mode. When the parallel mode is adopted, a separate camera can be directly set for the pulse array sensor 102 to acquire or / and shoot the current shooting scene; when the serial mode is adopted, the pulse array sensor 102 can be connected to the existing camera of the terminal, and the existing camera of the terminal is used to acquire or / and shoot the current shooting scene.

[0070] Figure 2 This is a schematic diagram of the structure of the pulse array sensor 102 provided in an embodiment of the present application. The pulse array sensor 102 is composed of a pixel array 1021 and a readout circuit 1022. The pixel array 1021 is composed of a plurality of pixel units, wherein each pixel unit includes a photoelectric sensor 102111, a comparator 102112 and a resetter 102113. In a specific implementation, it includes:

[0071] The photoelectric sensor 102111 generates photogenerated charges under illumination conditions. When the charges are judged by the comparator 102112 to reach a preset threshold, the resetter 102113 generates a pulse signal, and resets the photoelectric sensor 102111 to regenerate the charges. When the synchronous readout signal arrives, the resetter 102113 outputs the generated pulse signal. The pulse signals corresponding to the pixel units output by the pulse array sensor 102 are used for detection and / or shooting.

[0072] In each of the above-mentioned pixel units, the light intensity varies with time, and the corresponding photon flow is a non-time-homogeneous Poisson process. The photoelectric sensor 102111 can convert photons into photogenerated carriers carrying electric charge, referred to as charge. The time from when the charge passes through the comparator 102112 to when the accumulated charge value exceeds the preset threshold is called the pulse width of the pulse signal. The shorter the pulse width of the pulse signal, the stronger the light intensity. If the charge does not exceed the preset threshold within the time period of a synchronous readout signal, the output pulse signal is 0, otherwise the output pulse signal is 1. In this way, the pulse signal sequence formed by the pulse signal formed by each pixel unit on the time axis is a digital expression of the photoelectric process of the pixel unit; the pixel unit sequence generated by each pixel unit constitutes a pulse signal sequence array according to the spatial arrangement of the pixel unit, which is a digital expression of the current shooting scene, that is, the incident light of the image plane.

[0073] It can be seen that each pixel unit in the pulse array sensor 102 converts light into a pulse signal, so each pixel unit is independent and does not need to be processed synchronously. Instead, each pixel unit converts the received photon stream into an electron stream. The pixel units are arranged into an array according to the spatial relationship of the pixel units. The pulse signal sequence output by each pixel unit is the digital expression of the incident light mapped to the image plane. Therefore, the pulse array sensor 102 has a high dynamic range value, which ensures the brightness difference of the light intensity in different areas of the current shooting scene.

[0074] Of course, another structure of the pulse array sensor 102 may also be used, such as Figure 3 As shown, Figure 3 The second schematic diagram of the structure of the pulse array sensor 102 provided in the embodiment of the present application specifically includes: the pulse array sensor 102 is composed of a pixel array 1021, a plurality of pixel sub-array readout feedback units 1023 and a readout circuit 1022, wherein the pixel array 1021 is composed of a plurality of pixel sub-arrays 1024, each pixel sub-array 1024 is composed of a plurality of pixel units, wherein each pixel unit includes a photoelectric sensor 102111, and the pixel sub-array readout feedback unit 1023 is connected to at least one pixel sub-array in the pixel array 1021. In a specific implementation, it includes:

[0075] The photosensor 102111 in a pixel unit generates photogenerated charge under illumination conditions and sends it to the corresponding pixel subarray readout feedback unit 1023; after the pixel subarray readout feedback unit 1023 receives the charge of the corresponding pixel unit, when it is determined that the preset threshold is reached, a pulse signal is generated and sent to the photosensor 102111 in the corresponding pixel unit for resetting and regenerating the charge; when the synchronous readout signal arrives, the pixel subarray readout feedback unit 1023 outputs the generated pulse signal of the corresponding pixel unit.

[0076] Here, the number of columns of pixel units in the pixel subarray is less than the number of columns of pixel units in the pixel unit array, and the number of rows of pixel units in the pixel subarray is equal to the number of rows of pixel units in the pixel unit array; or, the number of columns of pixel units in the pixel subarray is less than or equal to the number of columns of pixel units in the pixel unit array, and the number of rows of pixel units in the pixel subarray is less than the number of rows of pixel units in the pixel unit array.

[0077] exist Figure 3 In the structure described above, Figure 2 The comparators and resetters in the multiple pixel units in the structure are separated from the pixel units and implemented in the corresponding pixel subarray readout feedback unit 1023. In this way, by multiplexing the pixel subarray readout feedback unit, the functions for judging and generating signals and reset signals can be multiplexed in multiple pixel units in the same pixel subarray, thereby reducing the circuit area occupied by each pixel unit in the pixel array. Under the premise of determining the number of pixel units, the circuit scale can be reduced to achieve miniaturization of the circuit.

[0078] Figure 4 A flowchart of a shooting method of a shooting terminal based on pulse array detection provided in an embodiment of the present application, wherein a pulse array sensor 102 is set in the terminal, and specific steps of the terminal implementing shooting include:

[0079] Step 401: Use a pulse array to detect the current shooting scene to obtain shooting parameters;

[0080] Step 402: photograph the current shooting scene according to the shooting parameters.

[0081] In the above method, the shooting parameters include: exposure time, aperture parameters and / or focal length and other shooting parameters that need to be set during shooting, which are not limited here.

[0082] In the above method, the shooting of the current shooting scene is actually automatic shooting, which does not require manual settings, such as setting the terminal shutter (exposure time), or / and setting the aperture parameters, or / and setting the focal length, etc.

[0083] In the above method, the terminal may be a terminal such as a mobile phone, a camera, a PAD or a laptop computer. Before implementing the above method, the shooting function of the terminal is turned on to perform the shooting process.

[0084] In the above method, the adopting pulse array detection to the current shooting scene comprises:

[0085] The detection frequency and / or the dynamic range value are set, wherein the detection frequency is higher than the motion rate value of the moving object in the current shooting scene, and the dynamic range is not lower than the dynamic range used when shooting.

[0086] In the above method, before the pulse array detection is used for the current shooting scene, the method includes:

[0087] Determine an area of ​​interest in the current shooting scene, and use array detection to detect the area of ​​interest.

[0088] Here, the terminal determines the region of interest in the current shooting scene according to the received region of interest selection information in the current shooting scene. The terminal can display the current shooting scene in a display module and determine whether there is a region of interest selected therein.

[0089] There can be multiple regions of interest, and the area of ​​the region of interest is not limited, as long as it is within the current shooting scene. Furthermore, the region of interest can be the entire current shooting scene. Figure 5 A schematic diagram of selecting an area of ​​interest in the current shooting scene provided by an embodiment of the present application. As shown in the figure, the area of ​​interest is a first area and a second area displayed in a gray grid in the current shooting scene, and the proportion of the area of ​​interest in the current shooting scene is calculated based on the gray grid area, so as to prepare for subsequent detection by the pulse array sensor. If the area of ​​interest is not set in the current shooting scene, the area of ​​interest can be defaulted to the entire current shooting scene.

[0090] In the above method, the detecting and obtaining the shooting parameters includes:

[0091] Determine whether the proportion of pixel units whose pixel values ​​have changed in the area of ​​interest of the current shooting scene in two adjacent frames detected exceeds a preset proportion threshold; if so, set the exposure time in the shooting parameters to the exposure time required for shooting the moving object.

[0092] Of course, other parameters such as aperture parameters or focal length may also be adjusted based on determining whether the proportion of pixel units whose pixel values ​​in the region of interest in two adjacent frames detected have changed exceeds a preset proportion threshold.

[0093] In the above method, the detecting and obtaining the shooting parameters may further include:

[0094] When it is determined that the pulse signal frequency of two adjacent frames of the pixel units in the region of interest that exceeds the set ratio has changed, calculate whether the time interval between the changes in the pulse signal frequency of two adjacent frames of the pixel units is less than the preset time interval threshold, and if so, adjust the aperture parameter in the shooting parameters based on the correspondence between the light intensity value preset by the calibration plate and the aperture parameter value. Wherein, adjusting the aperture parameter in the shooting parameters includes: increasing or decreasing the aperture parameter in the shooting parameters to the aperture parameter value corresponding to the calculated light intensity value of the pixel unit.

[0095] In the above method, the pulse signal thresholds of different pixel units of the pulse array sensor 102 can be flexibly set, and the pulse signal thresholds of different pixel units can be set to be the same or different.

[0096] In the above method, photographing the current shooting scene includes:

[0097] The pulse array sensor of the terminal shoots the current shooting scene. That is, the detection function and shooting function of the terminal for the current shooting scene can be integrated into the pulse array sensor in the terminal. Of course, shooting the current shooting scene can also be achieved by using a common image sensor, which is not limited here.

[0098] Before photographing or / and detecting the current shooting scene, it also includes: setting preset thresholds in a plurality of pixel units in the pulse array sensor, wherein the preset thresholds are reference values ​​for converting photogenerated charges in the corresponding pixel units into pulse signals, wherein the reference values ​​of the pulse signals reflect the light intensity values ​​of the corresponding pixel units. In this way, when the light intensity in the pixel units is relatively strong, the preset thresholds can be set relatively small, and when the light intensity in the pixel units is relatively weak, the preset thresholds can be set relatively large. Of course, the preset thresholds in each pixel unit can be the same or different. When they are different, the preset thresholds of the corresponding pixel units are set differently according to the different brightness of each area in the current shooting scene: the preset thresholds of the pixel units corresponding to the areas with strong light intensity are set small, and the preset thresholds of the pixel units corresponding to the areas with weak light intensity are set large.

[0099] The following is a specific example to illustrate the embodiments of the present application in detail.

[0100] Figure 6 A flowchart of a specific example of a shooting method of a shooting terminal based on a pulse array sensor provided in an embodiment of the present application, wherein the specific steps include:

[0101] Step 601: A terminal, such as a mobile phone, camera, PAD or laptop computer, starts a shooting function, collects a current shooting scene, and displays it on a display module of the terminal.

[0102] Step 602: The display module of the terminal displays the current shooting scene, and determines whether an area of ​​interest is selected therein, so as to determine the area of ​​interest in the current shooting scene.

[0103] In this step, the region of interest may be one or more (for example, a first priority region and a second priority region, see Figure 5 , you can preset or specify the proportion of each priority area), and the area of ​​the area of ​​interest can be large or small, as long as it is within the current shooting area.

[0104] In this step, the proportion of the region of interest in the current shooting scene can be calculated based on the selected region of interest. If the region of interest is not set in the current shooting scene, the region of interest can be assumed to be the entire current shooting scene.

[0105] Step 603: determine whether there is a moving object in the area of ​​interest in the current shooting scene. If yes, set the shutter parameters to shutter parameters that match the moving speed; otherwise, set the shutter parameters required for a stationary object.

[0106] In this step, the shutter parameter reflects the exposure time in the shooting parameters.

[0107] In this step, the specific judgment process is: calculate the time interval of the change of the pulse signal frequency of the set ratio in the region of interest, and adjust the shutter parameters to the closest conventional shutter parameters based on the time interval, such as 1, 1 / 2, 1 / 4, 1 / 8, 1 / 15, 1 / 30, 1 / 60, 1 / 125, 1 / 250, 1 / 500, 1 / 1000 seconds, etc. Here, the set ratio can be preset, or adjusted in time according to different shooting scenes. In other words, if the pulse signal frequency of two adjacent frames of the pixel units exceeding the set ratio in the region of interest changes, the time interval of the change of the pulse signal frequency of two adjacent frames of these pixel units is calculated, and the shutter parameters are adjusted accordingly.

[0108] The following example illustrates the process of adjusting shutter parameters:

[0109] Assuming that the current shooting scene has a resolution of 200*100=20k pixel values, the current shooting scene can be divided into 200*10 areas in units of 10 pixels, and the area of ​​interest is selected. Assuming that there is a moving object in the current shooting scene, when the pulse array sensor of the terminal detects the time interval when the frequency of the pulse signal of a set proportion in the area of ​​interest changes, the shutter parameter is adjusted to the closest conventional shutter parameter based on the time interval. For example, the time interval is 1.2ms. Since the conventional shutter parameter closer to 1.2ms is 1 / 1000, rather than 1 / 500, the conventional shutter parameter of 1 / 1000 is used to start the automatic shooting process.

[0110] Of course, you can also adjust shooting parameters such as aperture parameters according to whether there is a moving object in the area of ​​interest in the current shooting scene. The following example illustrates the process of adjusting the aperture parameter size:

[0111] The aperture is a shooting control device used to control the amount of light that passes through the lens and enters the photosensitive surface of the terminal. When adjusting the aperture parameters, the size of the aperture will change. The larger the aperture, the more light enters the aperture, and the brighter the shooting will be.

[0112] Since the inverse of the time interval between two pulse signals of the same pixel unit in the pixel array of the pulse array sensor can represent the light intensity value, the shorter the time interval, the stronger the light intensity (that is, the shorter the time required to accumulate a pulse signal). When the pulse array sensor in the terminal detects that the time interval of the pulse signal frequency change of the set proportion in the area of ​​interest is less than the preset time interval threshold, it means that the light intensity in the area of ​​interest is too strong and there is a suspicion of overexposure. At this time, the aperture parameter needs to be reduced. In other words, when the pulse signal frequency of two adjacent frames of the pixel units exceeding the set proportion in the area of ​​interest changes, it is calculated whether the time interval of the pulse signal frequency change of the two adjacent frames of these pixel units is less than the preset time interval threshold. If so, the aperture parameter is adjusted. When adjusting the aperture parameter value specifically, it includes: the amplitude of reducing the aperture parameter value can refer to the setting value of the calibration plate, that is, it is set according to the corresponding relationship between the light intensity value preset on the calibration plate and the aperture parameter value. Assuming that the aperture parameter value range is calibrated from 1lux to 3000lux, the time interval of the pulse signal frequency change corresponding to different light intensity values ​​is calibrated respectively. In a specific implementation, the light intensity value is calculated according to the time interval at which the pulse signal frequency changes, and then the aperture parameter in the shooting parameters is adjusted to the corresponding aperture parameter value according to the correspondence between the light intensity value and the aperture parameter value on the calibration plate.

[0113] Step 604: The terminal shoots the current shooting scene according to the shooting parameters obtained by detection.

[0114] Figure 7 A schematic diagram of an electronic device provided by another embodiment of the present application. Figure 7 As shown, another embodiment of the present application further provides an electronic device, which may include a processor 701, wherein the processor 701 is used to execute the steps of the above-mentioned shooting method of a shooting terminal based on pulse array detection. Figure 7 It can also be seen that the electronic device provided in the above embodiment also includes a non-transitory computer-readable storage medium 702, on which a computer program is stored. When the computer program is executed by the processor 701, the steps of the above-mentioned shooting method of the shooting terminal based on pulse array detection are executed.

[0115] Specifically, the non-transitory computer-readable storage medium 702 can be a general storage medium, such as a mobile disk, a hard disk, FLASH, a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), or a portable compact disk read-only memory (CD-ROM), etc. When the computer program on the non-transitory computer-readable storage medium 702 is executed by the processor 702, it can trigger the processor 701 to execute the above-mentioned various steps of the shooting method of the shooting terminal based on pulse array detection.

[0116] In practical applications, the non-transitory computer-readable storage medium 702 may be included in the device / apparatus / system described in the above embodiment, or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, each step in the above-mentioned shooting method of a shooting terminal based on pulse array detection can be executed.

[0117] Yet another embodiment of the present application provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements the various steps in the above-mentioned shooting method of a shooting terminal based on pulse array detection.

[0118] The flow chart and block diagram in the accompanying drawings of the present application show the possible architecture, function and operation of the system, method and computer program product according to the various embodiments disclosed in the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the above-mentioned module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the box can also occur in the order of the standards in different figures. For example, the boxes represented by two connections can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0119] Those skilled in the art will appreciate that the features described in the various embodiments and / or claims disclosed in this application may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in this application. In particular, without departing from the spirit and teachings of this application, the features described in the various embodiments and / or claims of this application may be combined and / or combined in a variety of ways, and all of these combinations and / or combinations fall within the scope disclosed in this application.

[0120] Specific embodiments are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core ideas of the present application, and is not used to limit the present application. For those skilled in the art, changes can be made in the specific implementation methods and application scopes according to the ideas, spirits and principles of the present application, and any modifications, equivalent substitutions, improvements, etc. made by them should be included in the scope of protection of the present application.

Claims

1. A shooting terminal based on pulse array detection, characterized in that: The terminal comprises: a lens module (101), a pulse array sensor (102) and a shooting control device (103), wherein: The lens module (101) is used to obtain incident light of a current shooting scene; The pulse array sensor (102) is used to detect the incident light of the current shooting scene acquired by the lens module (101) using a pulse array, and send the shooting parameters obtained by the detection to the shooting control device (103), wherein the pulse array sensor (102) is composed of a pixel array (1021) and a readout circuit (1022), the pixel array (1021) is composed of a plurality of pixel units, the pixel units include photoelectric sensors, the photoelectric sensors are used to convert photons into photogenerated carriers carrying electric charges, when the charge value accumulated by the photoelectric sensor exceeds a preset threshold, a pulse signal is output, and photogenerated carriers are regenerated after being reset, the pulse width of the pulse signal is the time required when the accumulated charge value exceeds the preset threshold, the light signal is converted into a pulse signal by each of the pixel units respectively, and then output through the readout circuit (1022), the pulse signals output by the pixel units form a pulse signal sequence on the time axis, which is used as the shooting parameters obtained by the detection; The shooting control device (103) is used to control the shooting terminal to perform shooting according to the shooting parameters received from the pulse array sensor (102).

2. The terminal according to claim 1, characterized in that The shooting control device (103) controls the shooting terminal to shoot, including: The shooting control device (103) controls the pulse array sensor (102) to shoot the current shooting scene.

3. The terminal according to claim 1 or 2, characterized in that: The detection frequency value of the pulse array sensor (102) is higher than the motion speed value of the moving object in the current shooting scene.

4. The terminal according to claim 1 or 2, characterized in that: The dynamic range of the pulse array sensor (102) is not lower than the dynamic range of the photographing terminal when controlling the photographing terminal to perform photographing.

5. The terminal according to claim 1, characterized in that further, The pulse array sensor (102) is also used to detect the region of interest using a pulse array after receiving the region of interest in the current shooting scene.

6. The terminal according to claim 5, characterized in that further, The pulse array sensor (102) is further used to determine whether the proportion of the number of pixel units whose pixel values ​​in the region of interest change in two adjacent frames detected by the pulse array exceeds a preset proportion threshold, and if so, set the exposure time in the shooting parameters to the exposure time required for shooting the moving object; and / or, The pulse array sensor (102) is also used to calculate the time interval for the change in the pulse signal frequency of the two adjacent frames when it is determined that the pulse signal frequency of the two adjacent frames of the pixel units exceeding a set ratio in the region of interest has changed, and to determine whether the time interval is less than a preset time interval threshold, and if so, to adjust the aperture parameter in the shooting parameter.

7. The terminal according to claim 1, characterized in that The pulse array sensor (102) also sets a preset threshold value in a plurality of pixel units, wherein the preset threshold value is a reference value for converting the photogenerated charge in the pixel unit into a pulse signal.

8. A shooting method of a shooting terminal based on pulse array detection, characterized in that: The method comprises: The pulse array detection is used for the current shooting scene, including: setting a detection frequency and / or setting a dynamic range to detect and obtain shooting parameters, wherein the detection frequency is higher than the motion rate value of the moving object in the current shooting scene, and / or the dynamic range is not lower than the dynamic range used when shooting; According to the shooting parameters, shooting the current shooting scene; in, The pulse array is generated by a pulse array sensor. The pulse array sensor (102) is composed of a pixel array (1021) and a readout circuit (1022). The pixel array (1021) is composed of a plurality of pixel units. The pixel units include photoelectric sensors. The photoelectric sensors are used to convert photons into photogenerated carriers carrying electric charges. When the charge value accumulated by the photoelectric sensor exceeds a preset threshold, a pulse signal is output, and photogenerated carriers are regenerated after being reset. The pulse width of the pulse signal depends on the time required for the accumulated charge value to exceed the preset threshold. After the light signal is converted into a pulse signal by each of the pixel units, it is output through the readout circuit (1022). The pulse signals output by the pixel units form a pulse signal sequence on the time axis.

9. The method according to claim 8, characterized in that Before the pulse array detection is used for the current shooting scene, the method includes: Determine a region of interest in the current shooting scene, and detect the region of interest using a pulse array; The detection and acquisition of shooting parameters include: Determine whether the proportion of the number of pixel units whose pixel values ​​in the region of interest change in two adjacent frames detected by the pulse array exceeds a preset proportion threshold, and if so, set the exposure time in the shooting parameters to the exposure time required for shooting a moving object; and / or, When it is determined that the pulse signal frequency of two adjacent frames of pixel units exceeding a set ratio in the area of ​​interest changes, it is calculated whether the time interval between the changes in the pulse signal frequency of the two adjacent frames is less than a preset time interval threshold. If so, the aperture parameter in the shooting parameters is adjusted.

10. The method according to claim 8, characterized in that The photographing the current photographing scene comprises: The pulse array sensor of the terminal shoots the current shooting scene; Before detecting and / or photographing the current shooting scene, the method further includes: A preset threshold value in a plurality of pixel units in a pulse array sensor of the terminal is set, wherein the preset threshold value is a reference value for converting photogenerated charges in the pixel units into pulse signals.

Images