Image sensor, camera module, electronic device, image acquisition method and medium
By adopting the mixed arrangement technology of multi-photosensitive layer and Y filter in the image sensor, the problem of insufficient photosensitive performance of RGB Bayer arrangement sensor in dark light environments is solved, the photosensitive performance and brightness of the image sensor are improved, and the noise is reduced , enhances the authenticity and details of the image.
Patent Information
- Application Number
- CN202111443484.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-30
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-11-30
AI Technical Summary
The existing RGB Bayer arrangement sensors lack photosensitive performance in dark light environments, resulting in noise problems, and the pixel size becomes smaller when the resolution is improved, affecting the image brightness.
The multi-photosensitive layer pixel unit arranged in stacks is mixed with the photosensitive layer pixel unit with the Y filter, and the color data reference is provided using high photosensitive characteristics, reducing gain, and improving the photosensitive performance and resolution of the image sensor.
It is achieved to improve the photosensitive performance and brightness of the image sensor, reduce noise, and enhance the authenticity and richness of the image without increasing the pixel size.
Smart Images

Figure CN114125237B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of image processing technology, and specifically relates to an image sensor, a camera module, an electronic device, an image acquisition method and a storage medium. Background Art
[0002] With the rapid development of terminal technology, more and more terminals have shooting functions, and most of the cameras use RGB Bayer arrangement sensors. Each pixel of the RGB sensor is composed of a microlens, a color filter, a photodiode, etc. Pixels with three different color filters are placed on the spatial plane. One pixel presents one color information and can only sense the intensity of one of the red, green, and blue light signals. Because each pixel can only capture one color, if normal colors are to be presented, four pixels RGGB must be completed together, and then "demosaicing" is performed to form a color pixel.
[0003] However, due to the size of the terminal, the size of the sensor is also small and the area of the sensor is limited. Increasing the resolution will cause the pixel size to become smaller, which will affect the photosensitivity. Especially in dark environments, high gain is required to ensure image brightness, but high gain will cause noise problems. Summary of the invention
[0004] The embodiments of the present application provide an image sensor, a camera module, an electronic device, an image acquisition method and a storage medium, which can improve the photosensitivity of the image transmission sensor without increasing the pixel size, thereby improving the image resolution and brightness.
[0005] In a first aspect, an embodiment of the present application provides an image sensor, comprising: a pixel array, the pixel array comprising a first pixel unit and a second pixel unit; the first pixel unit comprises at least two first photosensitive layers stacked together, each of the first photosensitive layers being provided with a photosensitive diode; the second pixel unit comprises a second photosensitive layer and a filter, the second photosensitive layer being provided with a photosensitive diode, and the filter being used to filter out blue band signals.
[0006] In a second aspect, an embodiment of the present application provides a camera module, comprising the image sensor described in the first aspect.
[0007] In a third aspect, an embodiment of the present application provides an electronic device, comprising the camera module described in the second aspect.
[0008] In a fourth aspect, an embodiment of the present application provides an image acquisition method, which is applied to the electronic device described in the third aspect, and the method includes: controlling a first pixel unit in an image sensor to acquire a first file, and controlling a second pixel unit in the image sensor to acquire a second file, wherein the first file includes more color types than the second file; controlling a signal processor in the image sensor to fuse the first file and the second file to obtain a target file.
[0009] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a controller and the image sensor described in the first aspect; the controller is used to control a first pixel unit in an image transmitter to obtain a first file, and to control a second pixel unit in the image transmitter to obtain a second file, wherein the first file includes more types of colors than the second file; and to control a signal processor in the image sensor to fuse the first file and the second file to obtain a target file.
[0010] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the fourth aspect are implemented.
[0011] In a seventh aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the computer program or instruction is executed by a processor, the steps of the method described in the fourth aspect are implemented.
[0012] In an eighth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the fourth aspect.
[0013] In a ninth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the fourth aspect.
[0014] In the image sensor provided in the embodiment of the present application, by mixing the first pixel unit with more realistic colors and the second pixel unit with a Y filter, on the one hand, the high photosensitivity of the second pixel unit can be effectively utilized to provide a color data reference for the first pixel unit, so as to reduce the use of gain and achieve more realistic colors and richer details; on the other hand, it can also increase the resolution of the image sensor while avoiding the pixel array from being too large, thereby improving the adaptability of the image sensor. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 This is one of the cross-sectional structural schematic diagrams of the pixel array provided in the embodiment of the present application.
[0016] Figure 2a This is one of the structural schematic diagrams of the pixel array provided in the embodiment of the present application.
[0017] Figure 2b This is the second structural schematic diagram of the pixel array provided in the embodiment of the present application.
[0018] Figure 3 This is the second schematic diagram of the cross-sectional structure of the pixel array provided in the embodiment of the present application.
[0019] Figure 4a It is a structural schematic diagram of an image processing circuit corresponding to the first pixel unit provided in an embodiment of the present application.
[0020] Figure 4b It is a structural schematic diagram of an image processing circuit corresponding to the second pixel unit provided in an embodiment of the present application.
[0021] Figure 5 Schematic diagram of the control of the image sensor provided in the embodiment of the present application.
[0022] Figure 6 It is a flowchart of the image acquisition method provided in an embodiment of the present application.
[0023] Figure 7 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application.
[0024] Figure 8 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0025] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0026] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here. In addition, the "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally represents that the objects associated with each other are in an "or" relationship.
[0027] In the following, in combination with the accompanying drawings, an image sensor, a camera module, an electronic device, an image acquisition method and a storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.
[0028] The present application embodiment provides an image sensor, which may include at least a pixel array. Figure 1 As shown, the pixel array 10 includes a first pixel unit 11 and a second pixel unit 12 .
[0029] The first pixel unit 11 includes at least two first photosensitive layers stacked in a stacked manner, and each of the first photosensitive layers is provided with a photosensitive diode. The stacked arrangement of the first pixel unit 11 utilizes the characteristic that different wavelengths of visible light have different penetrating powers, thereby obtaining light intensities of at least two wavelengths and ensuring more realistic and sharp colors while also reducing the size of the first pixel unit 11.
[0030] Of course, depending on the image acquisition scenario, the first pixel unit 11 may have multiple first photosensitive layers, and different first photosensitive layers may be used to collect signals of different wavelength bands, which is not limited in this embodiment.
[0031] The second pixel unit 12 includes a second photosensitive layer 122 and a filter 121 (also referred to as a Y filter (Yellow)), wherein a photosensitive diode is provided in the second photosensitive layer 122, and the filter 121 is used to filter out the blue band signal. That is, the second pixel unit 12 is used to collect other color band signals except the blue band signal, such as the red band signal, the green band signal, etc. The second pixel unit 12 is used in the present application to utilize its stronger photosensitivity and to capture more signals in a dark light environment, that is, the second pixel unit 12 can provide more signals.
[0032] It can be understood that the photosensitive diodes arranged in the first photosensitive layer and the second photosensitive layer 122 are semiconductors mainly made of two elements, silicon and germanium, on which semiconductors with N poles and P poles coexist. The current generated by their complementary effect can be recorded and interpreted by the processor. Therefore, the photodiode will generate electric charges when exposed to light, and convert light into electrical signals to achieve image acquisition.
[0033] Based on this, in the image sensor provided in this embodiment, by mixing the first pixel unit with more realistic colors with the second pixel unit with a Y filter, on the one hand, the high photosensitivity of the second pixel unit 12 can be effectively utilized to provide a color data reference for the first pixel unit 11, so as to reduce the use of gain and achieve more realistic colors and richer details; on the other hand, it is also possible to increase the resolution of the image sensor while avoiding the pixel array 10 from being too large, thereby improving the adaptability of the image sensor.
[0034] Of course, the number and arrangement of the first pixel units 11 and the second pixel units 12 in the pixel array 10 can be designed according to actual needs. For example, please refer to Figure 2a , the first pixel unit 111 and the second pixel unit 12 can be arranged at an interval.
[0035] For another example, see Figure 2b The first pixel unit group A and the second pixel unit group B may be arranged at intervals, wherein the first pixel unit group A includes a plurality of the first pixel units 11, and the second pixel unit group B may include a plurality of the second pixel units 12.
[0036] In addition, the proportion of the second pixel unit in the pixel array may be 1 / 2 to 2 / 3. Figure 2a , Figure 2b , the second pixel unit 12 accounts for 1 / 2 of the pixel array, and correspondingly, the first pixel unit 11 accounts for 1 / 2 of the pixel array, which is not limited in this embodiment.
[0037] Based on this, in a possible implementation, Figure 3 As shown, the first pixel unit 11 may include three first photosensitive layers, and the three first photosensitive layers are used to collect blue (B) band signals, green (G) band signals and red (R) band signals in sequence. Figure 3 The first photosensitive layer 111, the first photosensitive layer 112, and the first photosensitive layer 113 shown in the figure, that is, the first photosensitive layer 111 is used to collect blue band signals, the first photosensitive layer 112 is used to collect green band signals, and the first photosensitive layer 113 is used to collect red band signals. Therefore, on the one hand, each of the first pixel units 11 can simultaneously obtain the light intensity of the three wavelengths of red, green, and blue, and more realistic colors can be obtained without color interpolation, and less interpolation calculation can also greatly reduce power consumption; on the other hand, the three-layer stacked structure does not need to be interpolated by an algorithm, so it can also reduce false colors and have better resolution.
[0038] Correspondingly, considering that the first photosensitive layer for collecting green band signals and red band signals is located at the bottom layer of the stacked structure (such as the first photosensitive layer 112 and the first photosensitive layer 113), the second pixel unit 12 may include a second photosensitive layer for collecting green band signals and a second photosensitive layer 122 for collecting red band signals, that is, the second pixel unit 12 includes two second photosensitive layers 122. In this case, compared with the first pixel unit 11, the second pixel unit 12 can obtain more light signals in a dark light environment, reduce the use of gain, and thus make up for the insufficient RG signal in the first pixel unit 11.
[0039] In addition, in addition to the two second photosensitive layers 122 mentioned above, depending on the application scenario of the image sensor, the second pixel unit 12 may also only include a second photosensitive layer 122 for collecting green band signals to obtain more light signals in a dark light environment, reduce the use of gain, and thus make up for the insufficient G signal in the first pixel unit 11, or only include a second photosensitive layer 122 for collecting red band signals to obtain more light signals in a dark light environment, reduce the use of gain, and thus make up for the insufficient R signal in the first pixel unit 11. The present application does not impose any restrictions on this.
[0040] Based on this, it can be understood that the three-layer stacking setting adopted in the present embodiment can enable a first pixel unit 11 to obtain three color information without interpolation, and the second pixel unit 12 is next to the first pixel unit 11, so that the second pixel unit 12 can simultaneously collect RG wavelength signals, so that the photosensitivity is better, especially in dark light environments, the use of gain can be reduced to provide more reference signals for the first pixel unit 11.
[0041] In addition, the total thickness of the three photosensitive layers in the first pixel unit 11 can be 4μm to 6μm, such as 4μm, 4.5μm, 5μm, 6μm, etc., thereby ensuring the brightness and resolution of the acquired image while making the thickness of the first pixel unit 11 lower, thereby ensuring the size of the image sensor is smaller.
[0042] Optionally, each of the first photosensitive layers may be made of, but not limited to, silicon material.
[0043] In one implementation, please refer again to Figure 3For the image sensor, each of the first pixel units 11 included therein includes a microlens 13, and each of the second pixel units 12 includes a microlens 13. Therefore, through the design of the microlens, the incidence rate of light in the image sensor can be improved, thereby improving the light intensity collected by the first pixel unit 11 and the second pixel unit 12, thereby ensuring the file quality of subsequently collected files (such as images, videos, etc.).
[0044] In one implementation, the image sensor may further include a signal processing circuit 14 for processing the collected signal. It is understood that there may be multiple signal processing circuits 14, and the multiple signal processing circuits correspond to the first pixel unit 11 and the second pixel unit 12 one by one. Figure 4a and Figure 4b , which are schematic diagrams of the structure of the signal processing circuit 14 corresponding to the first pixel unit 11 , and schematic diagrams of the structure of the signal processing circuit 14 corresponding to the second pixel unit 12 .
[0045] Considering that the signal processing circuit 14 corresponding to the first pixel unit 11 and the signal processing circuit 14 corresponding to the second pixel unit 12 have similar working principles, the signal processing circuit 14 corresponding to the first pixel unit 11 is taken as an example for description below.
[0046] The signal processing circuit 14 includes a gate switch (Switch, which may also be called a switch selector), and the gate switch is respectively connected to each photodiode (such as Figure 4a It can be understood that "PD-B", "PD-G" and "PD-R" are photosensitive diodes in the first photosensitive layer for collecting blue band signals, photosensitive diodes in the first photosensitive layer for collecting green band signals, and photosensitive diodes in the first photosensitive layer for collecting red band signals, respectively.
[0047] Optionally, see Figure 4a The signal processing circuit 14 may further include a reset transistor RST, a floating switch TG, a row selector SET, a signal amplifier SF and a floating diffusion FD.
[0048] The source of the floating switch TG is connected to the input end of the gate switch, wherein the gate switch is used to transmit the electrical signal from the first pixel unit 11 to the floating switch TG.
[0049] The drain of the floating switch TG is connected to the source of the reset transistor RST and the gate of the signal amplifier SF respectively. The drain of the reset transistor RST is connected to the power supply voltage VDD. The reset transistor RST can control the floating diffusion FD to reset.
[0050] The drain of the signal amplifier SF is connected to the power supply voltage VDD, and the source of the signal amplifier SF is connected to the drain of the row selector SET; the source of the row selector SET is connected to the signal output terminal Vout, and the signal amplifier SF can read out the electrical signal transmitted via the floating switch TG.
[0051] The floating diffusion FD is connected to the gate of the signal amplifier SF. The floating diffusion FD has parasitic capacitance and can store pixel signals. The capacity of the parasitic capacitance in the floating diffusion FD affects the readout level when the floating switch TG interprets the electrical signal.
[0052] In addition, in one implementation, please refer to Figure 5 The image sensor further includes a reset row selector 15, an analog-to-digital converter (ADC) 16, a signal processor 17 and a plurality of column amplifiers 18; the reset row selector 15 is respectively connected to the control lines arranged horizontally in the pixel array 10; one end of each column amplifier 18 is respectively connected to the signal output line arranged vertically in the pixel array 10, and the output end is connected to the input end of the analog-to-digital converter 16; the output end of the analog-to-digital converter 16 is connected to the signal processor 17 to output digital pixel values to the signal processor 17 for processing, such as fusing the file collected by the first pixel unit with the file collected by the second pixel unit to obtain a high-resolution, high-brightness file.
[0053] Based on the image sensor provided in the above embodiment, the embodiment of the present application further provides a camera module, the camera module comprising: a circuit board, the image sensor is electrically connected to the circuit board; a lens, the lens is arranged on a side of the image sensor away from the circuit board. The lens can be one or more, which is not limited here.
[0054] It can be understood that since the image sensor in the camera module provided in this embodiment has the same or corresponding technical features as those of the image sensor in the aforementioned embodiments, they will not be described again here to avoid repetition.
[0055] Furthermore, an embodiment of the present application also provides an electronic device, the electronic device at least comprising the camera module. It is understandable that since the camera module in the electronic device provided in this embodiment has the same or corresponding technical features as the camera module in the aforementioned embodiment, in order to avoid repetition, it will not be described here.
[0056] Furthermore, based on the electronic device given above, this embodiment also provides an image acquisition method applied to the electronic device. Figure 6 As shown, it is a flow chart of an image acquisition method provided in an embodiment of the present application. The image acquisition method can be specifically executed by software and / or hardware installed in the electronic device, and the method includes the following steps.
[0057] S610, controlling the first pixel unit 11 in the image sensor in the camera module to obtain a first file, and controlling the second pixel unit 12 in the image sensor to obtain a second file.
[0058] The first file includes more color types than the second file. For example, the first file may be an RGB file including a blue signal (B), a red signal (R), and a green signal (G), and the second file may be an RG file including a red signal and a green signal; for another example, the first file may be an RGB file including a blue signal, a red signal, and a green signal, and the second file may be an R file including a red signal, or a G file including a green signal, etc., without limitation.
[0059] S610: Control a signal processor in the image sensor to fuse the first file and the second file to obtain a target file.
[0060] Among them, according to different requirements, the signal processor can fuse the first file and the second file in different ways. For example, when the first file is an RGB file and the second file is an RG file, the RG color information (i.e., red signal information and green signal information) included in the RG file is extracted; the RG color information is fused with the RG color information included in the first file to obtain the target file.
[0061] For another example, when the first file is an RGB file and the second file is an RG file, the B color information (ie, blue signal information) included in the RGB file is extracted; the B color information is merged with the RG color information included in the first file to obtain a target file.
[0062] That is to say, in this embodiment, the color information included in the second file can be supplemented by the first file to achieve fusion processing to obtain the target file, or the color information included in the first file can be supplemented by the second file to achieve fusion processing to obtain the target file, and there is no limitation here.
[0063] Exemplarily, based on the description of the aforementioned image acquisition method, assuming that the first pixel unit includes three first photosensitive layers stacked in sequence, that is, the first pixel unit can capture a normal RGB color image, and the second pixel unit includes two second photosensitive layers, that is, the second pixel unit can capture a RG color image, then, the image acquisition process provided in the present application can be as follows.
[0064] (1) Turn on the camera module (such as a camera) in the electronic device.
[0065] (2) Control the first pixel unit 11 and the second pixel unit 12 in the image sensor in the camera module to sense light at the same time, wherein the first pixel unit 11 outputs a normal RGB color image, and the second pixel unit 12 outputs an RG image with a red signal and a green signal.
[0066] (3) Control the signal processor to fuse the RGB color image and the RG image to obtain a target image.
[0067] (4) After performing image signal processing (ISP), white balance processing, gamma processing, etc. on the target image, a final image is output and displayed and / or stored in the electronic device.
[0068] In this embodiment, by extracting the color information of the first file collected by the first pixel unit and the color information of the second file collected by the second pixel unit and fusing them, the image brightness can be effectively increased, the gain used can be reduced, and the image quality can be improved.
[0069] Furthermore, the present application also provides an electronic device, which includes a controller and an image sensor; the controller is used to control a first pixel unit in an image transmitter to obtain a first file, and to control a second pixel unit in the image transmitter to obtain a second file, wherein the first file includes more types of colors than the second file; and to control a signal processor in the image sensor to merge the first file and the second file to obtain a target file.
[0070] Optionally, the controller merges the first file and the second file to obtain a target file, comprising: when the first file is an RGB file and the second file is an RG file, extracting RG color information included in the RG file; and merging the RG color information with the RG color information included in the first file to obtain the target file.
[0071] It can be understood that the implementation process of the electronic device provided in this embodiment can refer to the relevant description in the aforementioned image acquisition method embodiment, and achieve the same or corresponding technical effects. To avoid repetition, it will not be described here.
[0072] It should be noted that the electronic device provided in the present application may be a terminal or other device other than a terminal. For example, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It may also be a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiments of the present application are not specifically limited.
[0073] The electronic device provided in the embodiment of the present application can implement each process implemented by the method embodiment of the figure, and will not be described again here to avoid repetition.
[0074] Alternatively, if Figure 7 As shown, an embodiment of the present application further provides an electronic device 700, including a processor 701 and a memory 702, wherein the memory 702 stores programs or instructions that can be executed on the processor 701, and when the program or instructions are executed by the processor 701, the various steps of the above-mentioned image acquisition method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.
[0075] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0076] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0077] The electronic device 800 includes but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, a camera module and other components.
[0078] In this embodiment, the camera module includes an image sensor, which includes: a pixel array, the pixel array includes a first pixel unit and a second pixel unit; the first pixel unit includes at least two first photosensitive layers stacked together, and each of the first photosensitive layers is provided with a photosensitive diode; the second pixel unit includes a second photosensitive layer and a filter, the second photosensitive layer is provided with a photosensitive diode, and the filter is used to filter out blue band signals.
[0079] Optionally, the first pixel unit includes three first photosensitive layers, and the three first photosensitive layers are used to collect a blue band signal, a green band signal, and a red band signal in sequence.
[0080] Optionally, the total thickness of the three photosensitive layers of the first pixel unit is 4 μm to 6 μm.
[0081] Optionally, the first pixel unit and the second pixel unit are arranged at intervals;
[0082] Alternatively, the first pixel unit group and the second pixel unit group are arranged alternately, the first pixel unit group includes a plurality of the first pixel units, and the second pixel unit group includes a plurality of the second pixel units.
[0083] Optionally, the second pixel units account for 1 / 2 to 2 / 3 of the pixel array.
[0084] Optionally, each of the first pixel units includes a microlens, and each of the second pixel units includes a microlens.
[0085] Optionally, the image sensor further includes a signal processing circuit, the signal processing circuit includes a gate switch, and the gate switch is respectively connected to each photosensitive diode in the first pixel unit.
[0086] Optionally, the signal processing circuit further includes a reset transistor, a floating switch, a row selector, a signal amplifier and a floating diffuser;
[0087] The source of the floating switch is connected to the input end of the gate switch, and the drain of the floating switch is respectively connected to the source of the reset transistor and the gate of the signal amplifier;
[0088] The drain of the reset transistor is connected to the power supply voltage;
[0089] The drain of the signal amplifier is connected to a power supply voltage, and the source of the signal amplifier is connected to the drain of the row selector;
[0090] The source of the row selector is connected to the signal output terminal;
[0091] The floating diffusion is connected to a gate of the signal amplifier.
[0092] Optionally, the image sensor further comprises a reset row selector, an analog-to-digital converter, a signal processor, and a plurality of column amplifiers;
[0093] The reset row selectors are respectively connected to the control lines arranged laterally in the pixel array;
[0094] One end of each of the column amplifiers is respectively connected to a corresponding signal output line arranged vertically in the pixel array, and an output end is connected to an input end of the analog-to-digital converter;
[0095] The output end of the analog-to-digital converter is connected to the signal processor.
[0096] Those skilled in the art will appreciate that the electronic device 800 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 810 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0097] Among them, the processor 810 is used to control the first pixel unit in the image processor to obtain a first file, and to control the second pixel unit in the image processor to obtain a second file, wherein the first file includes more color types than the second file; and to control the signal processor in the image sensor to fuse the first file and the second file to obtain a target file.
[0098] Optionally, the processor 810 is used to merge the first file and the second file to obtain a target file, comprising: when the first file is an RGB file and the second file is an RG file, extracting RG color information included in the RG file; and merging the RG color information with the RG color information included in the first file to obtain the target file.
[0099] In this embodiment, by extracting the color information of the first file collected by the first pixel unit and the color information of the second file collected by the second pixel unit and fusing them, the image brightness can be effectively increased, the gain used can be reduced, and the image quality can be improved.
[0100] It should be understood that in the embodiment of the present application, the input unit 804 may include a graphics processor (Graphics Processing Unit, GPU) 8041 and a microphone 8042, and the graphics processor 8041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 807 includes a touch panel 8071 and at least one of other input devices 8072. The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0101] The memory 809 can be used to store software programs and various data. The memory 809 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 809 may include a volatile memory or a non-volatile memory, or the memory 809 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 809 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0102] The processor 810 may include one or more processing units; optionally, the processor 810 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 810.
[0103] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned image acquisition method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0104] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0105] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0106] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0107] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image acquisition method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0108] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0109] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0110] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An image sensor, characterized in that: include: A pixel array, the pixel array comprising a first pixel unit and a second pixel unit; The first pixel unit includes at least two first photosensitive layers stacked together, each of the first photosensitive layers being provided with a photosensitive diode; The second pixel unit includes a second photosensitive layer and a filter, wherein the second photosensitive layer is provided with a photosensitive diode, and the filter is used to filter out a blue band signal; the second photosensitive layer is used to collect at least one of a green band signal and a red band signal to compensate for the deficiency of the green band signal and / or the red band signal in the first pixel; The first pixel unit includes three first photosensitive layers, and the three first photosensitive layers are stacked and sequentially used to collect a blue band signal, a green band signal, and a red band signal from top to bottom; The image sensor further includes a signal processing circuit, wherein the signal processing circuit includes a gate switch, and the gate switch is respectively connected to each photosensitive diode in the first pixel unit; The signal processing circuit also includes a reset transistor, a floating switch, a row selector, a signal amplifier and a floating diffuser; The source of the floating switch is connected to the input end of the gate switch, and the drain of the floating switch is respectively connected to the source of the reset transistor and the gate of the signal amplifier; The drain of the reset transistor is connected to the power supply voltage; The drain of the signal amplifier is connected to a power supply voltage, and the source of the signal amplifier is connected to the drain of the row selector; The source of the row selector is connected to the signal output terminal; The floating diffusion is connected to the gate of the signal amplifier; The image sensor also includes a reset row selector, an analog-to-digital converter, a signal processor, and a plurality of column amplifiers; The reset row selectors are respectively connected to the control lines arranged laterally in the pixel array; One end of each of the column amplifiers is respectively connected to a corresponding signal output line arranged vertically in the pixel array, and an output end is connected to an input end of the analog-to-digital converter; The output end of the analog-to-digital converter is connected to the signal processor.
2. The image sensor according to claim 1, characterized in that The total thickness of the three photosensitive layers of the first pixel unit is 4 μm to 6 μm.
3. The image sensor according to claim 1, characterized in that The first pixel unit and the second pixel unit are arranged at intervals; or, The first pixel unit group and the second pixel unit group are arranged alternately, the first pixel unit group includes a plurality of the first pixel units, and the second pixel unit group includes a plurality of the second pixel units.
4. The image sensor according to any one of claims 1 to 3, characterized in that: The second pixel unit accounts for 1 / 2 to 2 / 3 of the pixel array.
5. The image sensor according to any one of claims 1 to 3, characterized in that: Each of the first pixel units includes a microlens, and each of the second pixel units includes a microlens.
6. A camera module, characterized in that: The image sensor comprises any one of claims 1 to 5.
7. The camera module according to claim 6, characterized in that: The camera module also includes: A circuit board, the image sensor being electrically connected to the circuit board; A lens is arranged on a side of the image sensor away from the circuit board.
8. An electronic device, characterized in that: Comprising the camera module described in claim 6 or 7.
9. An image acquisition method, characterized in that: Applied to the electronic device described in claim 8, the method comprises: Controlling a first pixel unit in an image sensor to acquire a first file, and controlling a second pixel unit in the image sensor to acquire a second file, wherein the first file includes more color types than the second file; The signal processor in the image sensor is controlled to fuse the first file and the second file to obtain a target file.
10. The method according to claim 9, characterized in that The step of fusing the first file with the second file to obtain a target file includes: When the first file is an RGB file and the second file is an RG file, extracting RG color information included in the RG file; The RG color information is merged with the RG color information included in the first file to obtain a target file.
11. The method according to claim 9 or 10, characterized in that The target file includes at least one of the following: an image file and a video file.
12. An electronic device, characterized in that: comprising a controller and an image sensor as claimed in any one of claims 1 to 5; The controller is used to control a first pixel unit in the image transmitter to obtain a first file, and to control a second pixel unit in the image transmitter to obtain a second file, wherein the first file includes more color types than the second file; and The signal processor in the image sensor is controlled to fuse the first file and the second file to obtain a target file.
13. The electronic device according to claim 12, characterized in that: The controller merges the first file and the second file to obtain a target file, comprising: When the first file is an RGB file and the second file is an RG file, extracting RG color information included in the RG file; and The RG color information is merged with the RG color information included in the first file to obtain a target file.
14. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 9 to 11 are implemented.
15. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 9 to 11 are implemented.
Citation Information
Patent Citations
Self-powered CMOS (Complementary Metal-Oxide-Semiconductor Transistor) image sensor
CN102623476A
Image sensor, imaging device, mobile terminal and imaging method
CN105578078A
Image pickup device and electronic apparatus
CN107706202A
Photographing device, electronic equipment and image obtaining method
CN108769635A
Image processing method and device, electronic equipment and storage medium
CN110874829A
