Image acquisition method, device and electronic equipment

The multispectral pixels and spectral emitters in the image sensor obtain motion information in real time and adjust the motion of the image sensor, solving the jelly effect when shooting moving objects, achieving a clear image and cost reduction effect.

CN115118892BActive Publication Date: 2024-11-19VIVO MOBILE COMM CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210733571.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-24
Publication Date
2024-11-19
Estimated Expiration
2042-06-24

AI Technical Summary

Technical Problem

When shooting moving objects, the line-by-line exposure method in the prior art can easily cause the subject image to be tilted or distorted, which is called the jelly effect, and increasing the exposure speed or converting it to a global exposure method will lead to pixel failure and increase equipment costs.

Method used

The motion information of the subject is obtained through the multispectral pixels and spectral emitters in the image sensor, and the motion of the image sensor is adjusted in real time to ensure that the image sensor is still relative to the subject during exposure, thereby reducing pixel failure and equipment costs.

Benefits of technology

Without increasing the exposure speed, a clear image of a moving object is taken, which reduces the chance of pixel failure and reduces the cost of using electronic devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115118892B_ABST
    Figure CN115118892B_ABST
Patent Text Reader

Abstract

The present application provides an image acquisition method, device and electronic device, which belongs to the field of camera technology. The method includes: when controlling the image sensor to perform exposure, obtaining motion information of the photographed object through the multispectral pixels and spectral emitters in the image sensor; determining compensation information of the image sensor based on the motion information; controlling the movement of the image sensor based on the compensation information so that the image sensor is stationary relative to the photographed object during the exposure process; and outputting a first original image after the exposure is completed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of camera technology, and in particular to an image acquisition method, device and electronic equipment. Background Art

[0002] When a user uses the lens of an electronic device to shoot, the electronic device can expose the image line by line to obtain a clearer picture. However, when the subject is in motion, the line-by-line exposure method will cause the image area where the subject is located to be tilted or distorted, and the shooting result will appear "tilted", "wobbly" or "partially exposed", that is, a jello effect.

[0003] In order to solve the problem of the jello effect, the clarity of shooting moving objects is improved by increasing the speed of the electronic device's line-by-line exposure or changing the line-by-line exposure to global exposure.

[0004] However, adopting the above method will cause pixel failure and increase the use cost of the electronic device. Summary of the invention

[0005] The embodiments of the present invention provide an image acquisition method, an apparatus and an electronic device, so as to achieve the effect of obtaining a normal and clear image when shooting a moving object.

[0006] In a first aspect, an embodiment of the present invention provides an image acquisition method, which is applied to an electronic device, wherein the image acquisition device includes an image sensor and a spectrum emitter, and the image sensor is provided with a multi-spectral pixel. The method includes:

[0007] When controlling the image sensor to perform exposure, acquiring motion information of a photographed object through the multispectral pixels in the image sensor and the spectral emitter;

[0008] determining compensation information for the image sensor based on the motion information;

[0009] controlling the movement of the image sensor based on the compensation information so that the image sensor is stationary relative to the photographed object during exposure;

[0010] After the exposure is completed, the first original image is output.

[0011] In a second aspect, an embodiment of the present invention provides an image acquisition device, the image acquisition device comprising an image sensor and a spectrum emitter, the image sensor being provided with a multi-spectral pixel, the device comprising:

[0012] A motion information acquisition module, used to acquire motion information of a photographed object through multispectral pixels in the image sensor and the spectral emitter when controlling the image sensor to perform exposure;

[0013] a compensation information acquisition module, configured to determine compensation information of the image sensor based on the motion information;

[0014] An image sensor moving module, used for controlling the movement of the image sensor based on the compensation information, so that the image sensor is stationary relative to the photographed object during the exposure process;

[0015] The first original image output module is used to output the first original image after the exposure is completed.

[0016] In a third aspect, an embodiment of the present invention further provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the image processing method of the first aspect are implemented.

[0017] In a fourth aspect, an embodiment of the present invention further provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the image processing method of the first aspect are implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0020] In an embodiment of the present application, motion information of the photographed object is obtained through multi-spectral pixels and spectral emitters in the image sensor; compensation information of the image sensor is determined based on the motion information; when controlling the image sensor for exposure, the image sensor is controlled to move based on the compensation information so that the image sensor is stationary relative to the photographed object during the exposure process; after the exposure is completed, the first original image is output. During the exposure process, the motion information of the photographed object is obtained in real time to adjust the movement of the camera module in real time, so that when exposing each pixel row, the camera module has completed the displacement compensation movement, so that the image sensor is stationary relative to the photographed object. In this way, when photographing a moving photographed object, a clear image of the moving object can be captured without increasing the exposure speed, which reduces the probability of pixel failure, and for the exposure method that does not increase the exposure speed, it also reduces the use cost of the electronic device.

[0021] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a schematic diagram of imaging under a jello effect provided by an embodiment of the present invention;

[0023] Figure 2 is a flowchart of an image acquisition method provided by an embodiment of the present invention;

[0024] Figure 3 is a schematic diagram of the structure of an optical image stabilization lens module provided by an embodiment of the present invention;

[0025] Figure 4 It is a schematic diagram of the structure of a micro-pan-tilt lens module provided by an embodiment of the present invention;

[0026] Figure 5 is a flowchart of another image acquisition method provided by an embodiment of the present invention;

[0027] Figure 6 is a schematic diagram of a spectrum curve provided by an embodiment of the present invention;

[0028] Figure 7 is a circuit diagram of a color pixel imaging process provided by an embodiment of the present invention;

[0029] Figure 8 is a multi-spectral pixel distribution diagram provided by an embodiment of the present invention;

[0030] Fig. 9It is another multi-spectral pixel distribution diagram provided by an embodiment of the present invention;

[0031] Fig.10 is a block diagram of an image acquisition device provided by an embodiment of the present invention;

[0032] Fig.11 An electronic device provided by an embodiment of the present invention;

[0033] Fig.12 It is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention.

[0034] Description of reference numerals:

[0035] 11-image sensor; 12-lens; 13-driving frame; 21-lens module; 22-magnetic power frame; 23-image sensor. DETAILED DESCRIPTION

[0036] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0037] The following is an explanation of some concepts and / or terms involved in the solutions provided in the embodiments of the present application.

[0038] Image sensor is the core of the camera and the most critical technology in the camera. There are two types of sensors: one is the widely used CCD (Charge-coupled Device) element; the other is the CMOS device (Complementary Metal-Oxide-Semiconductor). Compared with traditional cameras, traditional cameras use "film" as the carrier of their information recording, while the "film" of digital cameras is its imaging photosensitive element. The photosensitive element is the "film" of digital cameras that does not need to be replaced and is integrated with the camera.

[0039] Currently, the mainstream device used is CMOS, which mainly uses semiconductors made of two elements, silicon and germanium, so that semiconductors with N (negative charge) and P (positive charge) levels coexist on CMOS. The current generated by the two complementary effects can be recorded and interpreted into images by the processing chip.

[0040] CMOS camera module is the mainstream camera module used in mobile phones at present, mainly composed of lens, voice coil motor, infrared filter, image sensor, digital signal processor and soft board. The working process of CMOS is that the voice coil motor drives the lens to reach the accurate focus position, the external light passes through the lens, is filtered by the infrared filter, and shines on the photosensitive diode of the image sensor. The photosensitive diode converts the perceived light signal into an electrical signal, which is formed into a digital signal matrix (i.e. image) through the amplification circuit and analog-to-digital conversion circuit, and then is compressed and stored after digital signal processing.

[0041] The jelly effect refers to the deformation and color changes that occur like jelly in production and life. The formation of jelly is determined by the characteristics of the camera itself. Most cameras using CMOS sensors use a rolling shutter, which is achieved by exposing the image sensor line by line. At the beginning of exposure, the image sensor scans and exposes line by line until all pixels are exposed. If all actions are completed in a very short time, it generally will not affect the shooting. However, if the object being photographed moves at a high speed or vibrates rapidly relative to the camera. When shooting with a rolling shutter, the line-by-line scanning speed is not fast enough, and the shooting results may appear "tilted", "wobbly" or "partially exposed". This phenomenon that occurs when shooting with a rolling shutter is defined as the jelly effect. Reference Figure 1 , Figure 1 The figure is a schematic diagram of imaging under the jelly effect. When scanning the first row of pixels, the image corresponding to a row of pixels is captured normally. When scanning the second row of pixels, the object moves to the left, causing the image obtained by scanning the second row of pixels to actually shift. As a result, the image of the object obtained after the line-by-line scanning is a tilted image. This shooting situation is called the jelly effect.

[0042] Figure 2 : is a flowchart of steps of an image processing method provided by an embodiment of the present invention, which is applied to an image acquisition device, wherein the image acquisition device includes an image sensor and a spectral emitter, and the image sensor is provided with a multi-spectral pixel. The method may include:

[0043] Step 101: when controlling the image sensor to perform exposure, obtaining motion information of a photographed object through the multispectral pixels in the image sensor and the spectral emitter.

[0044] In an embodiment of the present invention, the image sensor uses a row-by-row exposure method to perform imaging, and the photosensitive units sense light in sequence from the first row, the second row, the third row... until all rows of the entire photosensitive unit from top to bottom are exposed.

[0045] A multispectral pixel is a pixel that only receives light within the target spectral range (i.e., light of a specific spectrum) and filters light outside the target spectral range. Multispectral pixels can be used to obtain the reflectivity of the target object for different bands of spectrum. At the same time, the motion information of the object can be obtained by receiving the time difference of the spectral signal.

[0046] Furthermore, the spectrum transmitter is an electronic component that can transmit spectra of different wavelengths. The spectrum it transmits can be reflected by the target moving object, and the image sensor can receive the reflected spectrum. The movement distance of the target moving object can be calculated by using the spectrum transmitter to transmit the spectrum. Specifically, after the spectrum transmitter transmits the spectrum, the spectrum is reflected by the target moving object and reaches the image sensor. At this time, the propagation time of the spectrum can be obtained according to the time of the reflected spectrum captured by the image sensor and the time of the spectrum transmitter transmitting the spectrum. Based on the known speed of light, the movement distance and movement direction of the target moving object can be obtained by the time difference between the transmitted spectrum and the received spectrum.

[0047] Through the cooperation of the spectral emitter and the multi-spectral pixel, the motion information of the photographed object can be obtained in real time, so as to adjust the position of the image sensor in real time according to the motion information.

[0048] Step 102: Determine compensation information of the image sensor based on the motion information.

[0049] In the embodiment of the present invention, after obtaining the motion information in step 101, the moving distance and moving direction of the image sensor can be obtained according to the moving distance and moving direction included in the motion information. The moving distance and moving direction of the image sensor are the compensation information of the image sensor. As the photographed object moves in real time, the image sensor moves in real time according to the compensation information to compensate for the movement of the photographed object. For example, if the motion information of the photographed object is moving 3mm in the direction away from the image sensor, the compensation information obtained is moving 3mm in the same direction as the moving object, so that after the movement, the camera module and the target moving object remain relatively still.

[0050] When calculating the compensation information of the image sensor, the exposure time of the pixel row can be further referred to. If the exposure time of each pixel row is 3 ms, the movement speed of the target moving object can be obtained through the moving distance and time period obtained above. For example, if the calculated movement speed is 1 mm / ms, it can be obtained that the distance moved by the target moving object in the time period of pixel row exposure is 3 mm. When obtaining the compensation information of the image sensor, the displacement of the photographed object during exposure can be further referred to, and the displacement generated in the exposure time period is added to the displacement generated by reading the exposure data, and the result is used as the compensation information of the image sensor to make the displacement adjustment of the image sensor more accurate.

[0051] Furthermore, the camera module including the above image sensor can be applied to an optical image stabilization lens or a pan / tilt image stabilization lens module, see Figure 3 , Figure 4 ,in, Figure 3 Schematic diagram of an optical image stabilization lens module structure. Figure 4 The figure is a schematic diagram of the structure of a micro-pan-tilt anti-shake lens module. Figure 3 The optical image stabilization lens module is provided with a gyroscope, which can monitor the tiny movement of the electronic device itself. If the gyroscope detects that the electronic device has moved, the movement signal is transmitted to the image signal processing component, and the image signal processing component can calculate the amount of compensation that the lens needs to make for the displacement of the electronic device. Finally, the electromagnetic force driving frame 13 drives the lens 12 to move relative to the image sensor 11 in a direction opposite to the displacement direction of the electronic device to compensate for the displacement caused by the shaking of the electronic device itself, thereby keeping the optical path stable and effectively overcoming the image blur problem caused by the vibration of the mobile phone.

[0052] The micro-gimbal module consists of a limit mechanism, a double ball suspension, a lens, a voice coil motor, a double S-shaped FPC (Flexible Printed Circuit) cable, a magnetic power frame, a module carrier, and a protective cover. The CMOS and lens group are encapsulated in the double ball suspension and then installed on the magnetic power frame. The two pairs of balls cooperate with the cross bracket to allow the micro-gimbal to complete flexible "double-axis rotation" on the X-axis and Y-axis, thereby achieving "three-dimensional anti-shake". Figure 4 When the electronic device is displaced, the camera module 21 in the magnetic power frame 22 rotates to compensate for the jitter displacement of the electronic device itself. At this time, the image sensor 23 can move in the magnetic power frame 22 at the same time as the camera module 21 to ensure the stability of the optical path. The micro-gimbal module structure scheme can realize the movement of the entire camera module, while the optical image stabilization lens structure module only moves the lens, which will cause the loss of part of the picture. Therefore, the micro-gimbal module scheme has a better imaging effect, and the anti-shake range area can reach 3.2 times that of the optical image stabilization lens structure module, and the anti-shake stability is stronger.

[0053] Therefore, if the electronic device itself has jitter displacement, then when calculating the compensation information of the image sensor, the displacement of the electronic device caused by the jitter can be further integrated. For example, due to the jitter of the electronic device itself, the lens or the entire lens module needs to move 1mm in the direction of the photographed object, and after obtaining the motion information of the moving object, it is obtained that the lens or the entire lens module needs to move 3mm in the direction of the photographed object. Then, the two displacement adjustments are superimposed to obtain that the lens or the entire lens module needs to move 4mm in the direction of the photographed object. By comprehensively considering the displacement of the target moving object and the displacement of the electronic device itself, the displacement amount that the lens or the entire lens module needs to move can be judged more accurately to obtain a higher quality image. The embodiment of the present invention does not limit which lens module structure is used.

[0054] Step 103: Control the movement of the image sensor based on the compensation information so that the image sensor is stationary relative to the photographed object during the exposure process.

[0055] In an embodiment of the present invention, after the exposure of the first pixel row is completed and the image sensor moves to the corresponding position, the exposure operation of the second pixel row is started. At this time, since the image sensor remains relatively still with the photographic object after the movement, the position of the photographic object corresponding to the image sensor does not change when the second pixel is exposed. At this time, the image data corresponding to the photographic object obtained by exposing the second pixel row will not have a tilt problem. After the second exposure operation is completed, the motion information of the target moving object continues to be obtained, and the image sensor is moved before the exposure of the next pixel row is started to ensure that the image sensor remains relatively still with respect to the photographic object when the next pixel row is imaged. In this way, each pixel row is exposed in turn, so that when each pixel row is exposed, the camera module remains relatively still with respect to the target moving object. After the exposure is completed, a clear image of the photographic object can be finally obtained.

[0056] Step 104: After the exposure is completed, the first original image is output.

[0057] In the embodiment of the present invention, under the real-time adjustment of the image sensor, after all pixel rows have completed exposure, a first original image in which the photographed object in the picture is clear can be output.

[0058] In summary, the embodiment of the present application provides an image acquisition method, which obtains motion information of the photographed object through the multispectral pixels and spectral emitters in the image sensor when controlling the image sensor for exposure; determines compensation information of the image sensor based on the motion information; controls the movement of the image sensor based on the compensation information, so that the image sensor is stationary relative to the photographed object during the exposure process; and outputs the first original image after the exposure is completed. During the exposure process, the motion information of the photographed object is obtained in real time to adjust the movement of the camera module in real time, so that when exposing each pixel row, the camera module has completed the displacement compensation movement, so that the image sensor is stationary relative to the photographed object. In this way, when shooting a moving object, a clear image of the moving object can be captured without increasing the exposure speed, which reduces the probability of pixel failure, and for the exposure method that does not increase the exposure speed, it also reduces the use cost of the electronic device.

[0059] Figure 5 is a flowchart of another image acquisition method provided by an embodiment of the present invention. Figure 5 As shown, the method may include:

[0060] Step 201: When controlling the image sensor to perform exposure, motion information of a photographed object is acquired through the multispectral pixels in the image sensor and the spectrum emitter, wherein the motion information includes a motion direction and a motion speed.

[0061] This step may specifically refer to the above step 101, which will not be described in detail here.

[0062] Step 202: Determine the moving distance and moving direction of the image sensor according to the moving direction, moving speed and reading time.

[0063] In the embodiment of the present invention, the reading time is the time for reading the pixel row after the pixel row exposure is completed. By calculating the motion information of the photographed object during the reading pixel row time, the image sensor can be adjusted accordingly according to the obtained motion information. If the propagation speed of the spectrum is c, and the time difference between the first moment when the spectrum emitter emits the spectrum (the start time of the reading time) and the second moment when the image sensor captures the spectrum is t1, then the distance d1 between the photographed object and the camera module is ct1 / 2, and the obtained distance d1 is the current distance between the photographed object and the image sensor. According to the speed of the spectrum c, that is, the speed of light, and the time difference t1, the current distance between the photographed object and the image sensor can be obtained. At the third moment (the end time of the reading time), the spectrum emitter emits the spectrum, and at the fourth moment, the image sensor captures the spectrum reflected by the photographed object. According to the same calculation method as above, the distance d2 between the image sensor and the photographed object is calculated to the end time of the reading time. By comparing the distance d1 with the distance d2, the motion direction of the photographed object can be obtained, and according to the change of the two distances and the time difference between the two emitted spectra (reading time), the motion speed of the photographed object can be obtained. According to the obtained motion information of the photographed object, the moving distance and moving direction of the image sensor can be obtained. For example, if the photographed object moves 3mm away from the image sensor during the reading time, the compensation information of the image sensor is: the moving direction is the same as the photographed object, and the moving distance is 3mm. According to the obtained motion information of the photographed object, the compensation information of the image sensor can be obtained accordingly, so that the image sensor can be moved according to the compensation information to solve the jello effect.

[0064] Step 203: Control the movement of the image sensor based on the compensation information so that the image sensor is stationary relative to the photographed object during the exposure process.

[0065] This step may specifically refer to the above step 103, which will not be described in detail here.

[0066] Step 204: After the exposure is completed, the first original image is output.

[0067] This step may specifically refer to the above step 104, which will not be described in detail here.

[0068] Optionally, the method may further include:

[0069] Step 205: In response to the shooting operation, a second original image captured by the image sensor is acquired;

[0070] In an embodiment of the present invention, when shooting an image, a background image of the environment in which the subject is located can be obtained. Since the image sensor will move accordingly with the movement of the subject when shooting the subject, a clear image of the subject can be captured at this time. However, due to the movement of the image sensor, the background in which the subject is located is actually deformed or unclear. Therefore, a second original image with a clear background can be collected to ensure that an image with a clear background in which the subject is located is collected.

[0071] Step 206: perform image fusion on the first original image and the second original image to obtain a target image; wherein the clarity of the background image in the second original image meets a preset condition.

[0072] In an embodiment of the present invention, the motion information of the photographed object is obtained through multi-spectral pixels and spectral emitters, and the corresponding mobile image sensor can be used to capture a first original image with a clear photographed object. When the image sensor does not move, a second original image with a clear background is obtained. At this time, the image area corresponding to the photographed object in the first original image and the background image area in the second original image can be taken for fusion calculation, and a clear image including the photographed object and the background of the photographed object can be obtained, which solves the image quality problem caused by the jello effect, and the final image can be further saved or previewed. As for the fusion method of the two images, the image of the photographed object can be obtained by extracting the contour line of the photographed object, and the tilted photographed object in the second original image can be eliminated in the same way, and then the two obtained are fused to obtain the final image, or the features in the image can be extracted by feature extraction, and then fused. The embodiment of the present invention is not limited here.

[0073] Optionally, the image sensor includes at least one multispectral pixel group, each of the multispectral pixel groups includes at least two adjacently arranged multispectral pixels; and each multispectral pixel in the multispectral pixel group corresponds to a different spectral band.

[0074] In an embodiment of the present invention, multispectral pixels are arranged in the image sensor in the form of a multispectral pixel group, and each multispectral pixel corresponds to a different spectral band. For example, if there are two multispectral pixels, one of the multispectral pixels can be set to allow the spectrum of the 10-500nm band to pass through, and the other multispectral pixel can be set to allow the spectrum of the 501-800nm ​​band to pass through, so that spectral signals of different wavelengths can be received by different multispectral pixels, and the spectral signal reflected by the photographed object can be received by the multispectral pixel group and the corresponding reflectivity can be obtained respectively.

[0075] Furthermore, the number of multispectral pixels included in the multispectral pixel group can also be 4, 6, 9, etc. When the number of multispectral pixels included in the multispectral pixel group is still 4, each multispectral pixel can set the spectral range of the band allowed to pass to be smaller, such as being set to: 10-200nm, 200-400nm, 400-600nm and 600-800nm ​​respectively. As the number of multispectral pixels increases, the range of the spectral band received by each multispectral pixel becomes smaller, making the division of the spectral signal received by the multispectral pixel group more accurate, and the spectral signal with the best reflectivity of the photographed object is also more accurate. When the number of multispectral pixels is other, the division method is similar, and the division can be performed according to actual conditions, and the embodiments of the present application are not limited here.

[0076] Optionally, the range of the spectral band emitted by the spectral emitter includes the spectral band corresponding to each of the multi-spectral pixels in the multi-spectral pixel group. Before step 201, the following may also be included:

[0077] Step 207: Control the spectrum transmitter to transmit emission spectrum signals of different wavelength bands.

[0078] In an embodiment of the present invention, the spectrum emitter can emit spectrum signals of different bands. By controlling the spectrum emitter to emit spectrum signals of different bands, the reflectivity of the photographed object to the emission spectrum signals of different bands can be obtained, thereby obtaining the optimal reflectivity of the photographed object.

[0079] Step 208: Obtain the reflectivity of the photographed object to the emission spectrum signals of different wavelength bands through the multi-spectral pixels.

[0080] In an embodiment of the present invention, the multispectral pixel can detect the spectrum reflected by the photographed object, and by detecting the reflectivity of the reflected spectrum, the reflectivity of the multispectral pixel to spectra of different bands can be obtained, and finally the spectrum of the target band with the highest reflectivity of the target moving object can be obtained.

[0081] The multispectral pixel can generate a spectral reflectance curve for the reflectance of the object to the emission spectrum, and the spectral reflectance curve can represent the reflectance of the object to spectral signals in different bands. Figure 6 , Figure 6 shows a reflectivity curve of a photographed object for different spectrum bands, Figure 6 The horizontal axis represents the length of the band, and the vertical axis represents the magnitude of the reflectivity. Figure 6 It can be seen that the reflectivity values ​​of the photographed object for different bands of spectra, and based on the judgment of the reflectivity values, the band of the spectrum with the highest reflectivity can be determined.

[0082] Furthermore, the multi-spectral pixel can obtain the reflectivity curve of the photographed object by detecting the emissivity of the photographed object to the spectrum emitted by the spectrum emitter. Similarly, the reflectivity curve of the photographed object can also be obtained by measuring the reflectivity of the spectrum of different bands in the natural light reflected by the photographed object. Specifically, when the natural light is weak, the spectrum emitter can emit spectrum signals of different bands to obtain the reflectivity curve of the photographed object. By first obtaining the reflectivity curve, the spectrum signal of the band with the best reflectivity of the photographed object can be accurately obtained, so as to prevent the situation where the photographed object is made of special materials, such as glass, with low reflectivity and difficult to capture the reflected spectrum, and further ensure the accuracy of the distance calculation.

[0083] In the embodiment of the present invention, step 208 may specifically include:

[0084] Sub-step 2081, obtaining the reflection signal value received by each multi-spectral pixel in the multi-spectral pixel group;

[0085] In an embodiment of the present invention, the spectral signal received by the multi-spectral pixel is converted into an electrical signal for processing during processing. After analog-to-digital conversion and other processes, a signal value representing the intensity of the spectral signal can be obtained. By comparing the signal values, the intensity of the spectral signal received by the multi-spectral pixel can be obtained.

[0086] Sub-step 2082: determining the reflectivity of the photographed object to spectral signals of different wavelength bands based on the emission spectral signal and the reflection signal value.

[0087] In an embodiment of the present invention, the emission spectrum signal emitted by the spectrum emitter has a corresponding signal value that can characterize the magnitude of its signal strength. According to the magnitude of the reflection signal value and the magnitude of the signal value of the emission spectrum signal emitted by the spectrum emitter, the magnitude of the reflectivity of the photographed object to different spectra can be determined, and the spectral band with a large reflectivity can be used as the target band.

[0088] Step 209: determine a target band based on the reflectivity; wherein the reflectivity corresponding to the target band is the largest.

[0089] In the embodiment of the present invention, reference Figure 6 It can be seen that the reflectivity of the band around 600nm is the highest. At this time, the spectrum corresponding to the band with the highest reflectivity of the object can be used as the target band of the spectrum emitted by the spectrum transmitter. For example, the target band can be a spectral band with a length of about 600nm to increase the probability of collecting the reflected spectrum.

[0090] Optionally, the photosensitive layer of the image sensor further includes: color pixels; and the ratio of the multi-spectral pixels to the color pixels is greater than or equal to 3% and less than or equal to 50%.

[0091] In an embodiment of the present invention, the image sensor may include conventional color pixels and multispectral pixels. The color pixels are used to generate an image of the photographed object, and the multispectral pixels are used to obtain motion information of the moving object in real time. The multispectral pixel group can be evenly distributed in the color pixels so that motion information can be obtained in real time for the motion trajectory in the entire image sensor area.

[0092] refer to Figure 7 , Figure 7 The color pixel imaging circuit diagram is shown. Specifically, the color pixel structure can be a PPD (Pinned Photodiode Pixel) pixel structure. The PPD pixel includes a photosensitive area of ​​PD1, i.e., a photosensitive diode, and four transistors: a reset transistor RST, a floating switch TX1, a row selector SET, and a signal amplifier SF, also known as a 4T pixel structure. The working method is as follows:

[0093] 1. Exposure, RST and TX1 are turned on at the same time to clear PD1. Exposure begins after RST and TX1 are disconnected. The electron-hole pairs generated by light irradiation will separate due to the existence of the PD1 electric field. The electrons move to the n region and the holes move to the p region.

[0094] 2. Reset: At the end of exposure, activate RST to reset the readout area to a high level.

[0095] 3. Reset level reading: After reset is completed, the reset level is read out, which includes the offset frequency noise of the MOS (mostet, field effect transistor), low-frequency noise and capacitor noise introduced by reset, and the read signal is stored in the first capacitor.

[0096] 4. Charge transfer, activate TX, and completely transfer the charge from the photosensitive area to the FD1 area for reading.

[0097] 5. Signal level readout, read the voltage signal of FD1 to the second capacitor. The signal here includes: the signal generated by photoelectric conversion, offset frequency noise, low frequency noise and capacitor noise introduced by reset.

[0098] 6. Signal output: The signal stored in the two capacitors is subtracted and amplified, and then converted to digital form to output the signal.

[0099] It should be noted that the ratio of multispectral pixels to color pixels should be within a preset range. If the ratio of multispectral pixels is too small, or there are no multispectral pixels in the area corresponding to the object in the image sensor, the motion information of the object in this area will not be captured. If the ratio of multispectral pixels is too large, even exceeding the number of color pixels, it may result in too few color pixels that can be used to capture images, resulting in less light received, so that the generated image is not clear enough. Therefore, the ratio of multispectral pixels to color pixels can be set to be greater than or equal to 3% and less than or equal to 50% to ensure that both rich color information and motion information can be captured, and finally a clear image is obtained. The number of multispectral pixels is not limited in the embodiments of the present invention.

[0100] Optionally, the photosensitive layer includes: a plurality of rectangular multi-spectral pixel arrays, each of which is composed of a plurality of the multi-spectral pixels; when the color pixels in the photosensitive layer are distributed in a four-Bayer array, the rectangular multi-spectral pixel array is located at a diagonal position of a rectangular local area in the photosensitive layer.

[0101] In the embodiment of the present invention, reference Figure 8 , Figure 8 When the color pixels of the photosensitive layer are arranged in a four-Bayer arrangement, multispectral pixels are distributed in the image sensor. Figure 3 In the figure, R, G, and B are conventional color pixels, and P represents multispectral pixels. Multispectral pixels can be distributed in the image sensor in the form of a two-by-two array in a group of four. In a rectangular local area of ​​an image sensor, multispectral pixels can be distributed at two diagonal positions of the area. Correspondingly, in other local areas of the image sensor, multispectral pixels can be distributed in the same distribution mode to ensure that multispectral pixels can accurately and real-time collect motion information of the photographed object. The embodiment of the present invention does not limit the specific number and distribution rules of multispectral pixels.

[0102] Optionally, the photosensitive layer includes: a plurality of rectangular multi-spectral pixel arrays, wherein the rectangular multi-spectral pixel array is composed of a plurality of the multi-spectral pixels; when the color pixels in the photosensitive layer are distributed in a Bayer array, the rectangular multi-spectral pixel array is located at four positions symmetrical to each other in a rectangular local area in the photosensitive layer.

[0103] In the embodiment of the present invention, reference Fig. 9 , Fig. 9 When the color pixels of the photosensitive layer are arranged in Bayer arrangement, multispectral pixels are distributed in the image sensor. Fig. 9R, G, and B are conventional color pixels, and P represents multispectral pixels. Multispectral pixels can be distributed in the image sensor in the form of a group of four and a two-by-two array. In a rectangular local area of ​​an image sensor, multispectral pixels can be distributed in four mutually symmetrical positions in the area. Correspondingly, in other local areas of the image sensor, multispectral pixels can be distributed in the same distribution manner. The embodiment of the present invention does not limit the number and distribution rules of multispectral pixels.

[0104] In summary, the embodiment of the present invention provides an image acquisition method, when controlling the image sensor to perform exposure, the motion information of the photographed object is obtained through the multispectral pixels and spectral emitters in the image sensor; the compensation information of the image sensor is determined based on the motion information; the movement of the image sensor is controlled based on the compensation information, so that the image sensor is stationary relative to the photographed object during the exposure process; after the exposure is completed, the first original image is output. During the exposure process, the motion information of the photographed object is obtained in real time, and the movement of the camera module is adjusted in real time, so that when exposing each pixel row, the camera module has completed the displacement compensation movement, so that the image sensor is stationary relative to the photographed object. In this way, when shooting a moving object, a clear image of the moving object can be captured without increasing the exposure speed, which reduces the probability of pixel failure, and for the exposure method that does not increase the exposure speed, it also reduces the use cost of the electronic device.

[0105] The image acquisition method provided in the embodiment of the present application can be executed by an image acquisition device. In the embodiment of the present application, the image acquisition device provided in the embodiment of the present application is described by taking the method of executing the image acquisition method by the image acquisition device as an example.

[0106] Fig.10 is a block diagram of an image acquisition device provided by an embodiment of the present invention, the device is applied to an electronic device, the photosensitive layer of the image sensor of the electronic device includes multispectral pixels, and the multispectral pixels are used to obtain motion information of a moving object, such as Fig.10 As shown, the device 30 comprises:

[0107] A motion information acquisition module 301 is used to acquire motion information of a photographed object through multispectral pixels in the image sensor and the spectral emitter;

[0108] A compensation information acquisition module 302, configured to determine compensation information of the image sensor based on the motion information;

[0109] An image sensor moving module 303 is used to control the movement of the image sensor based on the compensation information when controlling the image sensor to perform exposure, so that the image sensor is stationary relative to the photographed object during the exposure process;

[0110] The first original image output module 304 is used to output the first original image after the exposure is completed.

[0111] Optionally, the motion information includes a motion direction and a motion speed, and the compensation information acquisition module 302 includes:

[0112] A compensation information calculation submodule, used to determine the moving distance and moving direction of the image sensor according to the moving direction, moving speed and reading time;

[0113] Optionally, the device 30 comprises:

[0114] The second original image output module is used to obtain a second original image captured by the image sensor in response to a shooting operation.

[0115] A fusion module is used to perform image fusion on the first original image and the second original image to obtain a target image; wherein the clarity of the background image in the second original image meets a preset condition.

[0116] Optionally, the image sensor in the device 30 includes at least one multispectral pixel group, each of the multispectral pixel groups includes at least two adjacently arranged multispectral pixels; and each multispectral pixel in the multispectral pixel group corresponds to a different spectral band.

[0117] Optionally, the range of the spectral band emitted by the spectral emitter includes the spectral band corresponding to each of the multi-spectral pixels in the multi-spectral pixel group, and the device 30 further includes:

[0118] A spectrum signal transmitting module, used to control the spectrum transmitter to transmit spectrum signals of different wavelength bands;

[0119] A reflectivity acquisition module, used for acquiring the reflectivity of the photographed object to the emission spectrum signals of different wavebands through the multispectral pixels;

[0120] A target band determination module determines a target band based on the reflectivity; wherein the reflectivity corresponding to the target band is the largest.

[0121] Optionally, the reflectivity acquisition module includes:

[0122] A reflection signal value acquisition submodule, used to acquire the reflection signal value received by each of the multi-spectral pixels in the multi-spectral pixel group;

[0123] The reflectivity determination submodule is used to determine the reflectivity of the photographed object to spectral signals of different wavelength bands based on the emission spectral signal and the reflection signal value.

[0124] Optionally, in the device 30, the image sensor further includes: color pixels, and the ratio of the multi-spectral pixels to the color pixels is greater than or equal to 3% and less than or equal to 50%.

[0125] In summary, an embodiment of the present invention provides an image acquisition device, which, when controlling the image sensor for exposure, obtains motion information of a photographed object through multispectral pixels and spectral emitters in the image sensor; determines compensation information of the image sensor based on the motion information; controls the movement of the image sensor based on the compensation information, so that the image sensor is stationary relative to the photographed object during the exposure process; and outputs a first original image after the exposure is completed. During the exposure process, by obtaining the motion information of the photographed object in real time, the movement of the camera module is adjusted in real time, so that when exposing each pixel row, the camera module has completed the displacement compensation movement, so that the image sensor is stationary relative to the photographed object. In this way, when photographing a moving photographed object, a clear image of the moving object can be captured without increasing the exposure speed, thereby reducing the probability of pixel failure, and for the exposure method that does not increase the exposure speed, the use cost of the electronic device is also reduced.

[0126] The image acquisition device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0127] The image acquisition device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0128] The image acquisition device provided in the embodiment of the present application can achieve Figures 1 to 9 The various processes implemented in the method embodiment achieve the same technical effect and will not be described again here to avoid repetition.

[0129] Alternatively, if Fig.11 As shown, an embodiment of the present application further provides an electronic device 400, including a processor 401 and a memory 402, wherein the memory 402 stores programs or instructions that can be executed on the processor 401, and when the program or instructions are executed by the processor 401, the various steps of the above-mentioned image processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0130] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0131] Fig.12 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0132] The electronic device 400 includes but is not limited to components such as a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.

[0133] Those skilled in the art will appreciate that the electronic device 400 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0134] The processor 1010 is configured to obtain motion information of the photographed object through the multispectral pixels in the image sensor and the spectral emitter;

[0135] determining compensation information for the image sensor based on the motion information;

[0136] When controlling the image sensor to perform exposure, controlling the movement of the image sensor based on the compensation information so that the image sensor is stationary relative to the photographed object during the exposure process;

[0137] After the exposure is completed, the first original image is output.

[0138] Optionally, the motion information includes a motion direction and a motion speed, and the processor 1010 is further configured to determine a moving distance and a moving direction of the image sensor according to the motion direction, the motion speed, and the reading time.

[0139] Optionally, the processor 1010 is used to obtain a second original image captured by the image sensor in response to a shooting operation; perform image fusion on the first original image and the second original image to obtain a target image; wherein the clarity of the background image in the second original image meets a preset condition.

[0140] Optionally, the image sensor includes at least one multispectral pixel group, each of the multispectral pixel groups includes at least two adjacently arranged multispectral pixels; and each multispectral pixel in the multispectral pixel group corresponds to a different spectral band.

[0141] Optionally, the range of spectral bands emitted by the spectral emitter includes the spectral bands corresponding to each of the multispectral pixels in the multispectral pixel group, and the processor 1010 is further used to control the spectral emitter to emit emission spectral signals of different bands; obtain the reflectivity of the photographed object to the emission spectral signals of different bands through the multispectral pixels; determine the target band based on the reflectivity; wherein the reflectivity corresponding to the target band is the largest.

[0142] Optionally, the processor 1010 is further configured to obtain a reflection signal value received by each of the multispectral pixels in the multispectral pixel group; and determine a reflectivity of the photographed object to spectral signals of different wavelength bands based on the emission spectral signal and the reflection signal value.

[0143] Optionally, the image sensor further includes: color pixels, and the ratio of the multi-spectral pixels to the color pixels is greater than or equal to 3% and less than or equal to 50%.

[0144] The above method is executed by the processor 1010. During the exposure process, the motion information of the photographed object is obtained in real time to adjust the movement of the camera module in real time. When exposing each pixel row, the camera module has completed the displacement compensation movement, so that the image sensor is stationary relative to the photographed object. In this way, when photographing a moving object, a clear image of the moving object can be captured without increasing the exposure speed, thereby reducing the probability of pixel failure. In addition, for exposure methods that do not increase the exposure speed, the use cost of the electronic device is also reduced.

[0145] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0146] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0147] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0148] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned image acquisition method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0149] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0150] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0151] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0152] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image acquisition method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0153] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0154] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0155] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image acquisition method, applied to an image acquisition device, wherein the image acquisition device comprises an image sensor and a spectrum emitter, wherein the image sensor is provided with multi-spectral pixels, and the method include: When controlling the image sensor to perform exposure, acquiring motion information of a photographed object through the multispectral pixels in the image sensor and the spectral emitter; determining compensation information for the image sensor based on the motion information; Controlling the movement of the image sensor based on the compensation information so that the image sensor is stationary relative to the subject during exposure; After the exposure is completed, the first original image is output; The motion information includes a motion direction and a motion speed, and determining compensation information of the image sensor based on the motion information includes: Determining a moving distance and a moving direction of the image sensor according to the moving direction, the moving speed and the reading time; The reading time is the time for reading the pixel row after the exposure of the pixel row is completed; The image sensor performs imaging in a line-by-line exposure manner.

2. The image acquisition method according to claim 1, It is characterized in that The method further comprises: In response to a shooting operation, acquiring a second original image captured by the image sensor; Performing image fusion on the first original image and the second original image to obtain a target image; Wherein, the clarity of the background image in the second original image meets a preset condition.

3. The image acquisition method according to claim 1, It is characterized in that The image sensor includes at least one multispectral pixel group, each of which includes at least two adjacently arranged multispectral pixels; and each multispectral pixel in the multispectral pixel group corresponds to a different spectral band.

4. The image acquisition method according to claim 3, It is characterized in that The range of the spectral band emitted by the spectral emitter includes the spectral band corresponding to each of the multispectral pixels in the multispectral pixel group. Before acquiring the motion information of the photographed object through the multispectral pixels in the image sensor and the spectral emitter, the method further includes: Controlling the spectrum transmitter to transmit emission spectrum signals of different wavebands; Acquiring the reflectivity of the photographed object to the emission spectrum signals of different wavelength bands through the multispectral pixels; determining a target band based on the reflectivity; Among them, the reflectivity corresponding to the target band is the largest.

5. The image acquisition method according to claim 4, It is characterized in that The obtaining, by means of the multispectral pixel, the reflectivity of the photographed object to the spectral signals of different wavelength bands comprises: Acquire a reflection signal value received by each of the multispectral pixels in the multispectral pixel group; The reflectivity of the photographed object to spectral signals of different wavelength bands is determined based on the emission spectral signal and the reflection signal value.

6. The image acquisition method according to claim 1, It is characterized in that The image sensor further includes: color pixels, and the ratio of the multi-spectral pixels to the color pixels is greater than or equal to 3% and less than or equal to 50%.

7. An image acquisition device, It is characterized in that The image acquisition device comprises an image sensor and a spectrum emitter, wherein the image sensor is provided with multi-spectral pixels, and the device comprises: A motion information acquisition module, used to acquire motion information of a photographed object through multispectral pixels in the image sensor and the spectral emitter when controlling the image sensor to perform exposure; A compensation information acquisition module, used to determine compensation information of the image sensor based on the motion information; An image sensor moving module, used for controlling the movement of the image sensor based on the compensation information, so that the image sensor is stationary relative to the photographed object during the exposure process; A first original image output module, used for outputting a first original image after the exposure is completed; The motion information includes motion direction and motion speed, and the compensation information acquisition module includes: A compensation information calculation submodule, used to determine the moving distance and moving direction of the image sensor according to the moving direction, moving speed and reading time; The reading time is the time for reading the pixel row after the exposure of the pixel row is completed; The image sensor performs imaging in a line-by-line exposure manner.

8. An electronic device, It is characterized in that The method comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the image acquisition method according to any one of claims 1 to 6 are implemented.