A method and device for shooting a video stream by means of an in-lens shutter

Abstract

The present invention discloses a method and device for realizing video stream shooting through an in-lens shutter. The method includes: after receiving an instruction from a user to start video recording, a processor controls a motor component to operate according to a first periodic signal to drive the in-lens shutter to open and close periodically according to the first periodic signal; and an image sensor collects images through the in-lens shutter at a second periodic signal under the trigger of an image sensor control unit; wherein, the first periodic signal and the second periodic signal are synchronous signals; finally, after receiving an instruction from the user to stop video recording, the processor controls the motor component to stop working and controls the image sensor to stop collecting images. The first periodic signal of the in-lens shutter opening and closing periodically is synchronous with the second periodic signal of the image sensor, realizing the function of shooting a video stream, and avoiding the problem that an object is prone to tilting when shooting a fast-moving object, thereby improving the quality of the video stream shot by the shooting device.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and in particular, to a method and device for capturing a video stream by means of an interlens shutter. Background Art

[0002] Many existing mobile terminals (such as security surveillance cameras) have a shutter structure to control the exposure time. According to their structural characteristics, shutters can be divided into mechanical shutters and electronic shutters. Due to problems such as large driving voltage and complex driving circuits in electronic shutters, mechanical shutters are widely used.

[0003] A mechanical shutter is a shutter structure formed by arranging a set of light-shielding curtain or blades driven by mechanical components in front of the photosensitive element. Specifically, mechanical shutters can be divided into focal plane shutters and interlens shutters. The way a focal plane shutter opens for exposure is a gap from top to bottom. This exposure method determines that the focal plane shutter will produce a tilting phenomenon when photographing a fast-moving object. An interlens shutter is similar to an aperture, and the opening and closing of the shutter are controlled by the contraction and expansion of the blades. The interlens shutter can make the imaging light evenly distributed on the image sensor, and the object basically does not produce a tilting phenomenon. Therefore, the interlens shutter is more suitable for photographing fast-moving objects. However, the current interlens shutter can only capture a single picture and does not implement the function of capturing a video stream. Summary of the Invention

[0004] Embodiments of the present invention provide a method and device for capturing a video stream by means of an interlens shutter to improve the quality of the video stream captured by the capturing device.

[0005] A first aspect of an embodiment of the present invention provides a method for capturing a video stream by means of an interlens shutter. This method includes:

[0006] After receiving an instruction from the user to start recording a video, the processor controls the motor component to operate according to a first periodic signal to drive the interlens shutter to open and close periodically according to the first periodic signal;

[0007] Under the trigger of the image sensor control unit, the image sensor captures images through the interlens shutter with a second periodic signal; wherein, the image sensor control unit is one of the interlens shutter, the motor component or the processor, and the first periodic signal and the second periodic signal are synchronous signals;

[0008] After receiving an instruction from the user to stop recording a video, the processor controls the motor component to stop working and controls the image sensor to stop capturing images.

[0009] In one embodiment, after receiving an instruction from the user to start recording a video, the processor sends a first periodic signal to the motor component and a second periodic signal to the image sensor. After receiving the first periodic signal, the motor component operates according to the first periodic signal, driving the between-lens shutter to open and close periodically according to the first periodic signal; after receiving the second periodic signal, the image sensor acquires images through the between-lens shutter according to the second periodic signal. Thus, the first periodic signal and the second periodic signal are sent by the same processor, which is more conducive to ensuring the synchronization of the first periodic signal and the second periodic signal. As a result, a video stream can be captured through the between-lens shutter, avoiding the problem that objects are prone to tilt when shooting fast-moving objects, thereby improving the quality of the video stream captured by the mobile terminal device.

[0010] In one embodiment, after receiving an instruction from the user to start recording a video, the processor sends a first periodic signal to the motor component. While the motor component drives the between-lens shutter to open and close periodically according to the first periodic signal, the motor component determines a second periodic signal from the acquired first periodic signal and sends the second periodic signal to the image sensor, so that the image sensor acquires images through the between-lens shutter with the second periodic signal. Thus, the synchronization of the first periodic signal and the second periodic signal is ensured, and a video stream can be captured through the between-lens shutter, avoiding the problem that objects are prone to tilt when shooting fast-moving objects, thereby improving the quality of the video stream captured by the shooting device.

[0011] In one embodiment, the between-lens shutter includes a first sensor. The first sensor can acquire the first periodic signal of the opening and closing of the between-lens shutter, determine the second periodic signal from the first periodic signal of the opening and closing of the between-lens shutter, and send the second periodic signal to the image sensor to trigger the image sensor to acquire images through the between-lens shutter with the second periodic signal. At this time, the first periodic signal of the between-lens shutter directly acquired by the first sensor is more accurate, avoiding the error between the periodic signal received by the motor component from the processor and the actual working periodic signal of the motor component when the shooting device starts up. This is conducive to ensuring more precise synchronization of the first periodic signal and the second periodic signal. As a result, a video stream can be captured through the between-lens shutter, avoiding the problem that objects are prone to tilt when shooting fast-moving objects, thereby improving the quality of the video stream captured by the shooting device.

[0012] In one embodiment, the motor component includes a motor drive unit and a motor. The motor component sends a second cycle signal to the image sensor, including: the motor drive unit determines the second cycle signal based on the first cycle signal sent by the processor, and sends the second cycle signal to the image sensor, so that the image sensor acquires an image through an in-lens shutter with the second cycle signal, thereby ensuring the synchronization of the first cycle signal and the second cycle signal, so that a video stream can be captured through the in-lens shutter, avoiding the problem that the object is prone to tilt when shooting a fast-moving object, and thus improving the quality of the video stream captured by the mobile terminal device.

[0013] In one embodiment, the motor component includes a motor drive unit and a motor. The motor includes a second sensor. The motor component sends a second cycle signal to the image sensor, including: the second sensor in the motor acquires the first cycle signal of the motor and sends the first cycle signal of the motor to the motor drive unit. The motor drive unit determines the second cycle signal based on the first cycle signal of the motor and sends the second cycle signal to the image sensor. At this time, the first cycle signal of the motor acquired by the second sensor is more accurate, avoiding the error between the cycle signal sent by the motor drive unit acquired by the motor at the start of the shooting device and the cycle signal of the actual operation of the motor, which is beneficial to ensuring the more precise synchronization of the first cycle signal and the second cycle signal, so that a video stream can be captured through the in-lens shutter, avoiding the problem that the object is prone to tilt when shooting a fast-moving object, and thus improving the quality of the video stream captured by the shooting device.

[0014] The image sensor in this embodiment is a rolling shutter image sensor.

[0015] In the process of the image sensor acquiring an image through the in-lens shutter with the second cycle signal in this embodiment, for any frame captured, the image sensor controls all the accumulated exposure amounts of each row of the image sensor to be cleared at the first moment (the start time of global reset), and controls the in-lens shutter to close at the second moment; wherein, the first moment is not earlier than the time when the last row of the image sensor starts to be exposed, and the second moment is not later than the exposure end time of the first row of the image sensor, thereby ensuring that the exposure times of all rows of the image sensor are the same, so that the ordinary rolling shutter image sensor realizes the function of global exposure and improves the imaging effect of the shooting device.

[0016] The second aspect of the embodiment of the present invention also provides a device for capturing a video stream through an in-lens shutter. The device includes: an in-lens shutter, a motor component, an image sensor, and a processor; wherein,

[0017] The processor is used to respond to the instruction of the user to start recording a video, send a first cycle signal to the motor component; and respond to the instruction of the user to stop recording a video, and control the motor component to stop rotating;

[0018] The motor component is configured to receive the first periodic signal from the processor and operate according to the first periodic signal to drive the between-lens shutter to open and close periodically according to the first periodic signal.

[0019] The image sensor is configured to receive the second periodic signal from the image sensor control unit and acquire an image through the between-lens shutter with the second periodic signal; wherein, the image sensor control unit is one of the between-lens shutter, the motor component or the processor, and the first periodic signal and the second periodic signal are synchronous signals.

[0020] In one embodiment, the processor is further configured to send the second periodic signal to the image sensor to trigger the image sensor to acquire an image through the between-lens shutter with the second periodic signal; or

[0021] The motor component is configured to send the second periodic signal to the image sensor to enable the image sensor to acquire an image through the between-lens shutter with the second periodic signal; or

[0022] The first sensor in the between-lens shutter is configured to obtain the first periodic signal of the opening and closing of the between-lens shutter, determine the second periodic signal from the first periodic signal of the opening and closing of the between-lens shutter, and send the second periodic signal to the image sensor to trigger the image sensor to acquire an image through the between-lens shutter with the second periodic signal.

[0023] In one embodiment, the motor component includes a motor drive unit and a motor; the motor drive unit is configured to obtain the first periodic signal sent by the processor, determine the second periodic signal from the first periodic signal, and send the second periodic signal to the image sensor; or

[0024] The second sensor in the motor is configured to obtain the first periodic signal of the motor and send the first periodic signal of the motor to the motor drive unit; the motor drive unit determines the second periodic signal based on the first periodic signal of the motor and sends the second periodic signal to the image sensor.

[0025] In one embodiment, the image sensor is a rolling shutter image sensor.

[0026] In one embodiment, the image sensor is further configured to:

[0027] Control all the exposure amounts of each row of the image sensor to be cleared at a first moment and control the between-lens shutter to close at a second moment;

[0028] Wherein, the first moment is not earlier than the time when the last row of the image sensor starts to be exposed; the second moment is not later than the time when the exposure of the first row of the image sensor ends.

[0029] The leaf shutter provided by the embodiment of the present invention has the characteristic that the imaging light is evenly distributed on the image sensor, which can ensure uniform exposure of the image sensor, thereby avoiding the problem of object inclination that is prone to occur in the traditional curtain-type mechanical shutter when photographing fast-moving objects, and thus improving the quality of the images captured by the photographing device. And the leaf shutter provided by the embodiment of the present invention is connected to the motor component through a mechanical structure, and the leaf shutter rotates open and close periodically at high speed under the control of the motor component; the image sensor captures images periodically under the trigger of the image sensor control unit; wherein, the opening and closing cycle of the leaf shutter (i.e., the first cycle signal) is synchronized with the exposure acquisition cycle of the image sensor (the second cycle signal), thereby realizing the function of shooting a video stream through the leaf shutter. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0031] Figure 1 It is one of the schematic flowcharts of a method for realizing shooting a video stream through a leaf shutter provided by an embodiment of the present invention;

[0032] Figure 2a It is one of the schematic diagrams of the synchronization relationship between the first cycle signal and the second cycle signal provided by an embodiment of the present invention;

[0033] Figure 2b It is the second schematic diagram of the synchronization relationship between the first cycle signal and the second cycle signal provided by an embodiment of the present invention;

[0034] Figure 2c It is the third schematic diagram of the synchronization relationship between the first cycle signal and the second cycle signal provided by an embodiment of the present invention;

[0035] Figure 3 It is the second schematic flowchart of a method for realizing shooting a video stream through a leaf shutter provided by an embodiment of the present invention;

[0036] Figure 4 It is the third schematic flowchart of a method for realizing shooting a video stream through a leaf shutter provided by an embodiment of the present invention;

[0037] Figure 5The fourth flowchart of a method for realizing video stream shooting through an in - between - lens shutter provided by an embodiment of the present invention;

[0038] Figure 6 The schematic diagram of realizing global exposure by a rolling - shutter image sensor provided by an embodiment of the present invention;

[0039] Figure 7a The first process schematic diagram of acquiring any frame of image provided by an embodiment of the present invention;

[0040] Figure 7b The second process schematic diagram of acquiring any frame of image provided by an embodiment of the present invention;

[0041] Figure 7c The third process schematic diagram of acquiring any frame of image provided by an embodiment of the present invention;

[0042] Figure 8 The exposure acquisition process schematic diagram of a rolling - shutter image sensor provided by an embodiment of the present invention;

[0043] Figure 9a The first structural schematic diagram of a device for realizing video stream shooting through an in - between - lens shutter provided by an embodiment of the present invention;

[0044] Figure 9b The second structural schematic diagram of a device for realizing video stream shooting through an in - between - lens shutter provided by an embodiment of the present invention;

[0045] Figure 9c The third structural schematic diagram of a device for realizing video stream shooting through an in - between - lens shutter provided by an embodiment of the present invention;

[0046] Figure 9d The fourth structural schematic diagram of a device for realizing video stream shooting through an in - between - lens shutter provided by an embodiment of the present invention;

[0047] Figure 9e The fifth structural schematic diagram of a device for realizing video stream shooting through an in - between - lens shutter provided by an embodiment of the present invention. Detailed implementation manners

[0048] Next, the present invention will be further described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of them. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0049] An embodiment of the present invention provides a method and apparatus for shooting a video stream through an inter - lens shutter, which avoids the problem of easy tilting of an object when shooting a fast - moving object, thereby improving the quality of the video stream shot by the mobile terminal device.

[0050] Referring to Figure 1 , an embodiment of the present invention provides a method for shooting a video stream through an inter - lens shutter. This method includes:

[0051] S101. The processor receives an instruction from the user to start recording a video;

[0052] S102. The processor controls the motor component to work according to a first - period signal to drive the inter - lens shutter to open and close periodically according to the first - period signal; and the image sensor, under the trigger of the image - sensor control unit, acquires images through the inter - lens shutter according to a second - period signal. Among them, the image - sensor control unit is one of the inter - lens shutter, the motor component, or the processor, and the first - period signal and the second - period signal are synchronous signals;

[0053] S103. After the processor receives an instruction from the user to stop recording the video, it controls the motor component to stop working and controls the image sensor to stop acquiring images.

[0054] The inter - lens shutter provided by the embodiment of the present invention is composed of a series of thin steel blades. The inter - lens shutter has the characteristic that the imaging light is evenly distributed on the image sensor, which can ensure uniform exposure of the image sensor, thereby avoiding the problem of easy tilting of an object that easily occurs when a traditional curtain - type mechanical shutter shoots a fast - moving object, and thus improving the quality of the image shot by the shooting device. And the inter - lens shutter provided by the embodiment of the present invention is connected to the motor component through a mechanical structure. The inter - lens shutter rotates open and close periodically at a high speed under the control of the motor component; the image sensor acquires images through periodic exposure under the trigger of the image - sensor control unit. Among them, the opening - and - closing period of the inter - lens shutter (i.e., the first - period signal) is synchronized with the exposure - acquisition period of the image sensor (the second - period signal), thereby realizing the function of shooting a video stream through the inter - lens shutter.

[0055] In the embodiment provided by the present invention, the exposure time can be adjusted by controlling the ratio of the opening and closing time of the inter - lens shutter; or the exposure time can be controlled by controlling the size of the maximum opening window of the inter - lens shutter to ensure the synchronization of the first - period signal and the second - period signal.

[0056] Specifically, in the embodiments provided by the present invention, one opening and closing cycle of the leaf shutter is "closed - opened - closed"; one exposure acquisition cycle of the image sensor is "the first row of the image sensor starts exposure acquisition - the exposure acquisition of the last row ends". The opening and closing cycle of the leaf shutter is synchronized with the exposure acquisition cycle of the image sensor, and it is not limited to the start and end times of any cycle of the leaf shutter being exactly the same as the start and end times of any exposure acquisition cycle of the image sensor. The following further explains the "synchronization of the opening and closing cycle (i.e., the first cycle signal) of the leaf shutter and the exposure acquisition cycle (the second cycle signal) of the image sensor" in the embodiments of the present invention:

[0057] Referring to Figures 2a to 2c , in the embodiments of the present invention, one opening and closing cycle of the leaf shutter is S1 - S2, and the exposure acquisition cycle of the image sensor is H1 - H2. Referring to Figure 2a , in the embodiments provided by the present invention, the opening time S1 of the leaf shutter is the same as the time H1 when the first row a of the image sensor starts exposure acquisition, and the closing time S2 of the leaf shutter is the same as the time when the exposure acquisition of the first row a of the image sensor ends; or, referring to Figure 2b , in the embodiments provided by the present invention, the opening time S1 of the leaf shutter is the same as the time when the last row z of the image sensor starts exposure acquisition, and the closing time S2 of the leaf shutter is the same as the time when the exposure acquisition of the first row a of the image sensor ends; or, referring to Figure 2c , in the embodiments provided by the present invention, the opening time S1 of the leaf shutter is at any moment between the start exposure acquisition times of the first row a to the last row z of the image sensor, and the closing time S2 of the leaf shutter is the same as the time when the exposure acquisition of the first row a of the image sensor ends. Therefore, in the embodiments provided by the present invention, as long as it is ensured that within any cycle, the interval between the opening time S1 of the leaf shutter and the start exposure acquisition time of the first row a of the image sensor is a fixed duration, and the interval between the closing time S2 of the leaf shutter and the end exposure acquisition time of the last row z of the image sensor is a fixed duration, it is the synchronization of the opening and closing cycle (i.e., the first cycle signal) of the leaf shutter and the exposure acquisition cycle (the second cycle signal) of the image sensor in the embodiments of the present invention.

[0058] Specifically, Embodiment 1:

[0059] Referring to Figure 3 , the method for realizing video stream shooting through a leaf shutter provided by the embodiments of the present invention includes:

[0060] S201. The processor receives an instruction from the user to start recording a video;

[0061] S202. The processor controls the motor component to operate according to the first periodic signal, so as to drive the between-lens shutter to open and close periodically according to the first periodic signal; meanwhile, the processor sends the second periodic signal to the image sensor to trigger the image sensor to collect images through the between-lens shutter according to the second periodic signal.

[0062] Wherein, the first periodic signal and the second periodic signal are synchronous signals.

[0063] S203. After the processor receives the instruction from the user to stop recording the video, it controls the motor component to stop working and controls the image sensor to stop collecting images.

[0064] Specifically, in the embodiment provided by the present invention, after the processor receives the instruction from the user to start recording the video, it sends the first periodic signal to the motor component and the second periodic signal to the image sensor respectively. After receiving the first periodic signal, the motor component operates according to the first periodic signal to drive the between-lens shutter to open and close periodically according to the first periodic signal; after receiving the second periodic signal, the image sensor collects images through the between-lens shutter according to the second periodic signal. Thus, the first periodic signal and the second periodic signal are sent by the same processor, which is more conducive to ensuring the synchronization of the first periodic signal and the second periodic signal, so that a video stream can be captured through the between-lens shutter, avoiding the problem that the object is prone to tilt when shooting a fast-moving object, thereby improving the quality of the video stream captured by the mobile terminal device.

[0065] Embodiment 2:

[0066] Referring to Figure 4 , the method for realizing video stream capture through the between-lens shutter provided by the embodiment of the present invention includes:

[0067] S301. The processor receives the instruction from the user to start recording the video.

[0068] S302. The processor sends the first periodic signal to the motor component, controls the motor component to operate according to the first periodic signal to drive the between-lens shutter to open and close periodically according to the first periodic signal; the motor component determines the second periodic signal according to the first periodic signal sent by the processor and sends the second periodic signal to the image sensor, so that the image sensor collects images through the between-lens shutter according to the second periodic signal.

[0069] Wherein, the first periodic signal and the second periodic signal are synchronous signals.

[0070] S303. After the processor receives the instruction from the user to stop recording the video, it controls the motor component to stop working and controls the image sensor to stop collecting images.

[0071] Specifically, after receiving an instruction from the user to start recording a video, the processor sends a first cycle signal to the motor component. While the motor component drives the between-lens shutter to open and close periodically according to the first cycle signal, the motor component determines a second cycle signal from the obtained first cycle signal and sends the second cycle signal to the image sensor, so that the image sensor acquires images through the between-lens shutter with the second cycle signal, thereby ensuring the synchronization of the first cycle signal and the second cycle signal. Thus, a video stream can be captured through the between-lens shutter, avoiding the problem that an object is prone to tilting when photographing a fast-moving object, and thereby improving the quality of the video stream captured by the photographing device.

[0072] Embodiment 3:

[0073] Referring to Figure 5 , the method for capturing a video stream through a between-lens shutter provided by the embodiments of the present invention includes:

[0074] S401. The processor receives an instruction from the user to start recording a video;

[0075] S402. The processor controls the motor component to operate according to the first cycle signal to drive the between-lens shutter to open and close periodically according to the first cycle signal; the first sensor in the between-lens shutter acquires the first cycle signal of the opening and closing of the between-lens shutter, determines the second cycle signal from the first cycle signal of the opening and closing of the between-lens shutter, and sends the second cycle signal to the image sensor to trigger the image sensor to acquire images through the between-lens shutter with the second cycle signal;

[0076] Among them, the first cycle signal and the second cycle signal are synchronous signals;

[0077] S403. After the processor receives an instruction from the user to stop recording a video; it controls the motor component to stop working and controls the image sensor to stop acquiring images.

[0078] Specifically, the between-lens shutter includes a first sensor. The first sensor can acquire the first cycle signal of the opening and closing of the between-lens shutter, determine the second cycle signal from the first cycle signal of the opening and closing of the between-lens shutter, and send the second cycle signal to the image sensor to trigger the image sensor to acquire images through the between-lens shutter with the second cycle signal. At this time, the first cycle signal of the between-lens shutter directly acquired by the first sensor is more accurate, avoiding the error between the cycle signal received by the motor component from the processor and the actual working cycle signal of the motor component when the photographing device starts up, which is beneficial to ensuring more precise synchronization of the first cycle signal and the second cycle signal. Thus, a video stream can be captured through the between-lens shutter, avoiding the problem that an object is prone to tilting when photographing a fast-moving object, and thereby improving the quality of the video stream captured by the photographing device.

[0079] The first sensor provided by the embodiment of the present invention is a light interrupter, or it can also be other sensors, as long as it can ensure that the first sensor can obtain the first cycle signal of the opening and closing of the focal-plane shutter in real time and send the first cycle signal to other components. The specific type of sensor is not limited here.

[0080] Further, the motor component provided by the second embodiment of the present invention includes a motor drive unit and a motor. The motor component sends a second cycle signal to the image sensor, including: the motor drive unit determines the second cycle signal according to the first cycle signal sent by the processor and sends the second cycle signal to the image sensor, so that the image sensor can collect images through the focal-plane shutter with the second cycle signal, thereby ensuring the synchronization of the first cycle signal and the second cycle signal, and thus a video stream can be captured through the focal-plane shutter, avoiding the problem that the object is prone to tilt when shooting a fast-moving object, and thus improving the quality of the video stream captured by the mobile terminal device.

[0081] Another motor component provided by the second embodiment of the present invention includes a motor drive unit and a motor. The motor includes a second sensor. The motor component sends a second cycle signal to the image sensor, including: the second sensor in the motor obtains the first cycle signal of the motor and sends the first cycle signal of the motor to the motor drive unit. The motor drive unit determines the second cycle signal based on the first cycle signal of the motor and sends the second cycle signal to the image sensor. At this time, the first cycle signal of the motor obtained by the second sensor is more accurate, avoiding the error between the cycle signal sent by the motor drive unit obtained by the motor at the start of the shooting device and the actual working cycle signal of the motor, which is beneficial to ensuring the more precise synchronization of the first cycle signal and the second cycle signal, and thus a video stream can be captured through the focal-plane shutter, avoiding the problem that the object is prone to tilt when shooting a fast-moving object, and thus improving the quality of the video stream captured by the shooting device.

[0082] In the embodiment provided by the present invention, the motor drive unit controls the motor in a sensor-based or sensorless manner to ensure the constant speed of the motor, thereby ensuring the periodic opening and closing of the focal-plane shutter. The sensor-based method of controlling the motor is, for example, using an encoder as a feedback method to drive the motor, or using a Hall sensor, etc. as a feedback method to drive the motor, and using a PID algorithm to ensure the basic constancy of the motor speed. The sensorless drive method usually adopts the FOC drive method. The motor drive unit can be an ordinary motor drive chip, which is controlled separately by the processor, or it can be a sub-unit with a processor to control the constant speed of the motor, which is not limited here.

[0083] The motor provided by the embodiment of the present invention is a brushless DC motor with a relatively high service life. The motor provided by the embodiment of the present invention can also be an ultrasonic motor, as long as it can drive the focal-plane shutter to open and close periodically according to the first cycle signal. The specific type of motor is not limited here.

[0084] Currently, there are mainly two types of image sensors in the field of image sensors, namely CCD image sensors and CMOS image sensors. Due to the high cost of CCD image sensors, complex drive circuits, and high power consumption, they are basically no longer used. CMOS image sensors are inexpensive and have simple circuits, so they are widely used. Most CMOS image sensors use the rolling shutter exposure method. When shooting moving objects, since the exposure times of different rows are not at the same moment, the image will be distorted, that is, the so-called "jelly effect". To solve this problem, some image sensor manufacturers have invented global exposure CMOS image sensors. The principle is to increase the charge cache unit to ensure that all pixel points are exposed at the same time. Because of the existence of this cache unit, the cost of CMOS image sensors has increased sharply. At the same time, due to the limited area of the semiconductor silicon wafer, the existence of the cache unit will also affect the imaging area of the effective pixels, thus affecting the imaging effect.

[0085] In view of this, the embodiments of the present invention provide a method for achieving global exposure by using a common rolling shutter exposure image sensor without increasing the charge cache unit, so as to improve the imaging effect of the shooting device.

[0086] In the embodiments provided by the present invention, the image sensor is a rolling shutter exposure image sensor that supports the global reset mode. The rolling shutter exposure image sensor that supports the global reset mode can clear all the accumulated exposure amounts of each row of the image sensor in the global reset mode. Refer to Figure 6 , in order to ensure that the exposure times of all rows of the image sensor are the same, in the process of the image sensor collecting images through the between-lens shutter with the second period signal L2, for any frame collected, the image sensor controls all the accumulated exposure amounts of each row of the image sensor to be cleared at the first moment E1 (the start time of global reset), and controls the between-lens shutter to close at the second moment E2; where the first moment E1 is not earlier than the time when the last row z of the image sensor starts to be exposed, and the second moment E2 is not later than the exposure end time of the first row a of the image sensor. Thus, it can be ensured that the exposure times of all rows of the image sensor are the same, so that the common rolling shutter exposure image sensor realizes the function of global exposure and improves the imaging effect of the shooting device.

[0087] Specifically, refer to Figure 7a, in the embodiments provided by the present invention, during the process of the image sensor collecting images through the leaf shutter with the second periodic signal L2, for any frame collected, the opening time S1 of the leaf shutter starts simultaneously with the start working time H1 of the image sensor, and the image sensor starts to expose line by line; when the last line z of the image sensor starts to expose, the image sensor controls all the exposure amounts of each line of the image sensor to be cleared (at this time, the first moment E1 is the time when the last line z of the image sensor starts to expose), and when the exposure of the first line a (the first line of the image sensor to start exposing) of the image sensor ends, the leaf shutter closes (at this time, the second moment E2 is the closing time S2 of the leaf shutter), thus completing the collection of one frame of image. Although the image sensor is still working after the leaf shutter closes, the leaf shutter has closed and there is no exposure amount, so it can ensure that the exposure time of all lines of the image sensor is the same (that is, from the first moment E1 to the second moment E2), thereby improving the imaging effect of the shooting device.

[0088] Referring to Figure 7b , in another embodiment provided by the present invention, during the process of the image sensor collecting images through the leaf shutter with the second periodic signal L2, for any frame collected, the image sensor starts to work (the start working time of the image sensor is H1), and when the image sensor exposes line by line until the last line z starts to expose, the leaf shutter opens (the opening time of the leaf shutter is S1), and when the exposure of the first line a (the first line of the image sensor to start exposing) of the image sensor ends, the leaf shutter closes (at this time, the second moment E2 is the closing time S2 of the leaf shutter), thus completing the collection of one frame of image. Although the image sensor is still working after the leaf shutter closes, the leaf shutter has closed and there is no exposure amount. Since there is no exposure amount before the leaf shutter opens, during the process of collecting any of the above frames, the start time of the global reset of the rolling shutter image sensor can be any moment before the last line z of the image sensor starts to expose, so it can ensure that the exposure time of all lines of the image sensor is the same (that is, from the opening time S1 of the leaf shutter to the closing time S2 of the leaf shutter), thereby improving the imaging effect of the shooting device.

[0089] In addition, since the leaf shutter only opens when the last line of the image sensor starts to expose, and the exposure amount of the image sensor is zero before the leaf shutter opens, at this time, the rolling shutter image sensor can also be a rolling shutter image sensor that does not support the global reset mode, as long as it is ensured that the leaf shutter opens simultaneously when the last line of the image sensor starts to expose, and the leaf shutter closes simultaneously when the exposure of the first line a of the image sensor ends, it can ensure that the exposure time of all lines of the image sensor is the same, thereby improving the imaging effect of the shooting device. Moreover, the rolling shutter image sensor that does not support the global reset mode reduces the manufacturing cost and the driving circuit is simpler.

[0090] Referring to Figure 7c , in another embodiment provided by the present invention, since the image sensor is a rolling shutter image sensor, to improve the efficiency of image acquisition, when the exposure of the first row a of the image sensor ends, the next image acquisition cycle can be started. During the process of the image sensor acquiring an image through the focal-plane shutter with the second cycle signal L2, for any frame acquired, the image sensor starts to work (the start working time of the image sensor is H1). When the image sensor exposes line by line until the last row z starts to be exposed, the focal-plane shutter opens (the opening time of the focal-plane shutter is S1). When the exposure of the first row a (the first row exposed by the image sensor) of the image sensor ends, the focal-plane shutter closes, thereby completing the acquisition of one frame of image. In addition, when the exposure of the first row a of the image sensor ends, the next cycle of the image sensor starts, thereby improving the efficiency of image acquisition.

[0091] The first row a or the last row z in the embodiments of the present invention is not limited to one row, and can also be as Figure 8 shown, multiple rows start to be exposed simultaneously. The specific number of rows for synchronous exposure is determined by the different requirements of different shooting devices and is not limited herein.

[0092] Based on the same concept, an embodiment of the present invention provides a device for shooting a video stream through a focal-plane shutter. The device includes a focal-plane shutter, a motor component, an image sensor, and a processor; wherein:

[0093] The processor is configured to respond to a user's instruction to start recording a video, send a first cycle signal to the motor component; and respond to a user's instruction to stop recording a video, and control the motor component to stop rotating;

[0094] The motor component is configured to receive the first cycle signal from the processor and operate according to the first cycle signal to drive the focal-plane shutter to open and close periodically according to the first cycle signal;

[0095] The image sensor is configured to receive a second cycle signal from an image sensor control unit and acquire an image through the focal-plane shutter with the second cycle signal; wherein, the image sensor control unit is one of the focal-plane shutter, the motor component, or the processor, and the first cycle signal and the second cycle signal are synchronous signals.

[0096] Specifically, in the embodiment provided by the present invention, the processor is further configured to send a second cycle signal to the image sensor to trigger the image sensor to acquire an image through the focal-plane shutter with the second cycle signal. Referring to Figure 9a, the steps for implementing video stream shooting through an in-lens shutter provided by the embodiments of the present invention are as follows: After receiving the instruction from the user to start recording a video, the processor 11 issues a first periodic signal to the motor component 12 and a second periodic signal to the image sensor 13 respectively. After receiving the first periodic signal, the motor component 12 operates according to the first periodic signal, driving the in-lens shutter 14 to open and close periodically according to the first periodic signal; after receiving the second periodic signal, the image sensor 13 collects images through the in-lens shutter 14 according to the second periodic signal, and the image sensor 13 returns the collected video information to the processor 11 for processing to generate a video stream, finally completing the shooting of the video stream.

[0097] In another embodiment provided by the present invention, the first sensor in the in-lens shutter is used to obtain the first periodic signal of the opening and closing of the in-lens shutter, determine the second periodic signal from the first periodic signal of the opening and closing of the in-lens shutter, and issue the second periodic signal to the image sensor to trigger the image sensor to collect images through the in-lens shutter with the second periodic signal. Refer to Figure 9b , the steps for implementing video stream shooting through an in-lens shutter provided by the embodiments of the present invention are as follows: After receiving the instruction from the user to start recording a video, the processor 11 issues a first periodic signal to the motor component 12. The motor component 12 drives the in-lens shutter 14 to open and close periodically according to the first periodic signal. The in-lens shutter 14 includes a first sensor 141, and the first sensor 141 can obtain the first periodic signal of the opening and closing of the in-lens shutter 14, determine the second periodic signal from the first periodic signal of the opening and closing of the in-lens shutter 14, and issue the second periodic signal to the image sensor 13 to trigger the image sensor 13 to collect images through the in-lens shutter 14 with the second periodic signal. The image sensor 13 returns the collected video information to the processor 11 for processing to generate a video stream, finally completing the shooting of the video stream.

[0098] In yet another embodiment provided by the present invention, the motor component is further used to issue the second periodic signal to the image sensor to enable the image sensor to collect images through the in-lens shutter with the second periodic signal; Refer to Figure 9c , the steps for implementing video stream shooting through an in-lens shutter provided by the embodiments of the present invention are as follows: After receiving the instruction from the user to start recording a video, the processor 11 issues a first periodic signal to the motor component 12. While the motor component drives the in-lens shutter 14 to open and close periodically according to the first periodic signal, the motor component 12 determines the second periodic signal from the obtained first periodic signal and issues the second periodic signal to the image sensor 13 to enable the image sensor 13 to collect images through the in-lens shutter 14 with the second periodic signal. The image sensor 13 returns the collected video information to the processor 11 for processing to generate a video stream, finally completing the shooting of the video stream.

[0099] Specifically, in the embodiments provided by the present invention, the motor component includes a motor drive unit and a motor 122; the motor drive unit is configured to obtain a first cycle signal sent by a processor, determine a second cycle signal based on the first cycle signal, and send the second cycle signal to an image sensor. Refer to Figure 9d , the steps for implementing video stream shooting through an in-lens shutter provided by the embodiments of the present invention are as follows: after the processor 11 receives an instruction from the user to start recording a video, it sends a first cycle signal to the motor drive unit 121. While the motor drive unit 121 controls the motor 122 to drive the in-lens shutter 14 to open and close periodically according to the first cycle signal, the motor drive unit 121 determines a second cycle signal based on the first cycle signal and sends the second cycle signal to the image sensor 13, so that the image sensor 13 acquires images through the in-lens shutter 14 with the second cycle signal. The image sensor 13 returns the acquired video information to the processor 11 for processing to generate a video stream, and finally completes the shooting of the video stream.

[0100] In another embodiment provided by the present invention, the motor component includes a motor drive unit and a motor. The motor further includes a second sensor, which is configured to obtain a first cycle signal of the motor and send the first cycle signal of the motor to the motor drive unit. The motor drive unit determines a second cycle signal based on the first cycle signal of the motor and sends the second cycle signal to the image sensor. Refer to Figure 9e , the steps for implementing video stream shooting through an in-lens shutter provided by the embodiments of the present invention are as follows: after the processor 11 receives an instruction from the user to start recording a video, it sends a first cycle signal to the motor drive unit 121. While the motor drive unit 121 controls the motor 122 to drive the in-lens shutter 14 to open and close periodically according to the first cycle signal, the second sensor 1220 in the motor 122 obtains the first cycle signal of the motor 122 and sends the first cycle signal of the motor to the motor drive unit 121. The motor drive unit 121 determines a second cycle signal based on the first cycle signal of the motor 122 and sends the second cycle signal to the image sensor 13, so that the image sensor 13 acquires images through the in-lens shutter 14 with the second cycle signal. The image sensor 13 returns the acquired video information to the processor 11 for processing to generate a video stream, and finally completes the shooting of the video stream.

[0101] Optionally, the image sensor is a rolling shutter image sensor.

[0102] Optionally, the image sensor is further configured to:

[0103] At a first moment, control all the exposure amounts of each row of the image sensor to be cleared, and at a second moment, control the in-lens shutter to close;

[0104] Among them, the first moment is not earlier than the time when the last row of the image sensor starts to be exposed; the second moment is not later than the exposure end time of the first row of the image sensor.

[0105] In summary, a method for shooting a video stream by an in-lens shutter provided by an embodiment of the present invention includes: after receiving an instruction from a user to start recording a video, a processor controls a motor component to work according to a first periodic signal to drive the in-lens shutter to open and close periodically according to the first periodic signal; and an image sensor acquires images through the in-lens shutter with a second periodic signal under the trigger of an image sensor control unit; where the image sensor control unit is one of the in-lens shutter, the motor component, or the processor, and the first periodic signal and the second periodic signal are synchronous signals; finally, after receiving an instruction from the user to stop recording the video, the processor controls the motor component to stop working and controls the image sensor to stop acquiring images. Therefore, the embodiment of the present invention synchronizes the first periodic signal of the periodic opening and closing of the in-lens shutter with the second periodic signal of the image sensor, realizes a method for shooting a video stream by an in-lens shutter, avoids the problem that an object is prone to tilt when shooting a fast-moving object, and thus improves the quality of the video stream shot by the mobile terminal device.

[0106] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0107] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate means for realizing the functions specified in Figure 1 one or more flows or multiple flows and / or blocks Figure 1 one or more blocks or multiple blocks.

[0108] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means that implement the functions specified in one or more of the flow Figure 1 -charts or blocks Figure 1 specified in one or more of the blocks or blocks.

[0109] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable apparatus provide steps for implementing the functions specified in one or more of the flow Figure 1 -charts or blocks Figure 1 specified in one or more of the blocks or blocks.

[0110] It is apparent that those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to cover these modifications and variations.

Claims

1. A method for capturing a video stream by means of an between-lens shutter, characterized in that, The method includes: The processor receives an instruction from the user to start recording a video; The processor controls the motor component to operate according to a first periodic signal to drive the between-lens shutter to open and close periodically according to the first periodic signal; and the image sensor collects images through the between-lens shutter with a second periodic signal under the trigger of the image sensor control unit; wherein, the image sensor control unit is one of the between-lens shutter, the motor component or the processor, and the first periodic signal and the second periodic signal are synchronous signals; wherein, if the interval between the opening time of the between-lens shutter and the time when the first row of the image sensor starts exposure collection is a first fixed duration, and the interval between the closing time of the between-lens shutter and the time when the last row of the image sensor ends exposure collection is a second fixed duration, it indicates that the first periodic signal and the second periodic signal are synchronous signals; After the processor receives an instruction from the user to stop recording a video; it controls the motor component to stop working and controls the image sensor to stop collecting images.

2. The method according to claim 1, characterized in that, The image sensor collects images through the between-lens shutter with a second periodic signal under the trigger of the image sensor control unit includes: The processor sends a second periodic signal to the image sensor to trigger the image sensor to collect images through the between-lens shutter with the second periodic signal; or The motor component sends a second periodic signal to the image sensor to enable the image sensor to collect images through the between-lens shutter with the second periodic signal; or The first sensor in the between-lens shutter obtains the first periodic signal of the opening and closing of the between-lens shutter, determines the second periodic signal from the first periodic signal of the opening and closing of the between-lens shutter, and sends the second periodic signal to the image sensor to trigger the image sensor to collect images through the between-lens shutter with the second periodic signal.

3. The method according to claim 2, wherein The motor component includes a motor drive unit and a motor; The motor component sending a second periodic signal to the image sensor includes: The motor drive unit determines the second periodic signal from the first periodic signal sent by the processor and sends the second periodic signal to the image sensor; or The second sensor in the motor obtains the first periodic signal of the motor and sends the first periodic signal of the motor to the motor drive unit; the motor drive unit determines the second periodic signal based on the first periodic signal of the motor and sends the second periodic signal to the image sensor.

4. The method according to any one of claims 1 to 3, characterized in that, The image sensor is a rolling shutter image sensor.

5. The method according to claim 4, wherein The method further includes: During the process of the image sensor collecting images through the between-lens shutter with a second periodic signal, for any frame collected, the image sensor controls all the exposure amounts of each row of the image sensor to be cleared at a first moment and controls the between-lens shutter to close at a second moment; Wherein, the first moment is not earlier than the time when the last row of the image sensor starts exposure; the second moment is not later than the time when the exposure of the first row of the image sensor ends.

6. An apparatus for capturing a video stream by means of an in-lens shutter, characterized in that, Includes: Between-lens shutter, motor component, image sensor and processor; wherein, The processor is configured to respond to a user's instruction to start recording a video and send a first periodic signal to the motor component; and respond to a user's instruction to stop recording a video and control the motor component to stop rotating. The motor component is configured to receive the first periodic signal from the processor and operate according to the first periodic signal to drive the between-lens shutter to open and close periodically according to the first periodic signal. The image sensor is configured to receive a second periodic signal from an image sensor control unit and collect images through the between-lens shutter with the second periodic signal; wherein, the image sensor control unit is one of the between-lens shutter, the motor component or the processor, and the first periodic signal and the second periodic signal are synchronous signals; wherein, if the interval between the opening time of the between-lens shutter and the time when the first row of the image sensor starts exposure collection is a first fixed duration, and the interval between the closing time of the between-lens shutter and the time when the last row of the image sensor ends exposure collection is a second fixed duration, it indicates that the first periodic signal and the second periodic signal are synchronous signals.

7. The device according to claim 6, wherein The processor is further configured to send a second periodic signal to the image sensor to trigger the image sensor to collect images through the between-lens shutter with the second periodic signal. Or The motor component is configured to send a second periodic signal to the image sensor to enable the image sensor to collect images through the between-lens shutter with the second periodic signal. Or The first sensor in the between-lens shutter is configured to obtain the first periodic signal of the opening and closing of the between-lens shutter, determine the second periodic signal from the first periodic signal of the opening and closing of the between-lens shutter, and send the second periodic signal to the image sensor to trigger the image sensor to collect images through the between-lens shutter with the second periodic signal.

8. The device according to claim 7, wherein The motor component includes a motor drive unit and a motor; the motor drive unit is configured to obtain the first periodic signal sent by the processor, determine the second periodic signal from the first periodic signal, and send the second periodic signal to the image sensor. Or The second sensor in the motor is configured to obtain the first periodic signal of the motor and send the first periodic signal of the motor to the motor drive unit. The motor drive unit determines the second periodic signal based on the first periodic signal of the motor and sends the second periodic signal to the image sensor.

9. The device according to any one of claims 6 - 8, characterized in that, The image sensor is a rolling shutter image sensor.

10. The device according to claim 9, characterized in that, The image sensor is further configured to: Control all exposure amounts of each row of the image sensor to be cleared at a first moment and control the between-lens shutter to close at a second moment. Wherein, the first moment is not earlier than the time when the last row of the image sensor starts exposure; the second moment is not later than the exposure end time of the first row of the image sensor.

Images