An image sensor, a camera module and an electronic device
By designing closely spaced pentagonal and triangular sub-pixel units in the image sensor, the problems of color cast and distortion in photos during the shooting process are solved, achieving high-quality HDR synthesis and multi-frame noise reduction, and improving the resolution and light sensitivity of the image sensor.
Patent Information
- Application Number
- CN202210444220.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-25
- Publication Date
- 2026-02-17
- Estimated Expiration
- 2042-04-25
AI Technical Summary
Due to hardware and software limitations, existing technologies often result in color casts, distortions, and poor realism in photos, especially in HDR mode and multi-frame noise reduction, where issues such as image edge misalignment and motion blur can easily occur.
It adopts a pixel array design in an image sensor, including at least two pentagonal first pixel units. Each pixel unit contains a first sub-pixel and a second sub-pixel. The first sub-pixel is pentagonal and the second sub-pixel is triangular. By closely arranging them, it can achieve HDR synthesis and multi-frame noise reduction functions, thereby improving pixel density and light sensitivity.
It effectively avoids image misalignment and ghosting, improves the resolution and light sensitivity of the image sensor, expands the dynamic range, and enhances image quality.
Smart Images

Figure CN114827502B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of image processing technology, specifically relating to an image sensor, camera module, and electronic device. Background Technology
[0002] HDR stands for High Dynamic Range. Compared to ordinary images, HDR images offer a wider dynamic range and more image detail, closely resembling what the human eye sees. Achieving HDR on a mobile phone camera involves taking several photos with different exposures and then automatically combining them into a single image using an algorithm. Multi-frame noise reduction, on the other hand, involves the phone calculating and filtering the quantity and location of noise across multiple frames when shooting night scenes or low-light environments. Noisy areas are replaced with noise-free frames. Through repeated weighting and replacement, a near-noise-free image is obtained. The final image is actually a composite of multiple frames.
[0003] However, due to the significant differences in exposure between frames captured in HDR mode, exposure fusion algorithms are complex, and multi-frame alignment is difficult, easily leading to problems such as image edge misalignment and image distortion. This can also cause motion blur, especially with moving objects or objects moving in dark scenes. Furthermore, multi-frame noise reduction, which follows a similar process to HDR, suffers from the same issues. Therefore, due to limitations in both hardware and software, existing technologies inevitably result in color casts and distortions in photographs, leading to a lack of realism. Summary of the Invention
[0004] The purpose of this application is to provide an image sensor, camera module, and electronic device that can solve the problem that, due to limitations in the shooting hardware and software during the shooting process, the photos taken in the prior art suffer from color cast and distortion, resulting in poor realism.
[0005] In a first aspect, embodiments of this application provide an image sensor, which includes:
[0006] A pixel array comprising at least two first pixel units, each first pixel unit being pentagonal, each first pixel unit comprising a first sub-pixel and a second sub-pixel, the first sub-pixel being pentagonal and the second sub-pixel being triangular.
[0007] Secondly, embodiments of this application provide a camera module that includes an image sensor as described in the first aspect.
[0008] Thirdly, embodiments of this application provide an electronic device that includes a camera module as described in the second aspect.
[0009] In this embodiment, the pixel array in the image sensor includes at least two pentagonal first pixel units. Each pixel unit includes a first sub-pixel and a second sub-pixel. The first sub-pixel is pentagonal, and the second sub-pixel is triangular. As a result, the sub-pixels are closely arranged, resulting in a high pixel density. During a single exposure, the first and second sub-pixels in the pixel unit can output multiple light-sensitive values, thereby obtaining multiple images with different or the same exposure values. This enables HDR synthesis and multi-frame noise reduction, effectively avoiding image misalignment, ghosting, and other phenomena. At the same time, it can improve the resolution and light sensitivity of the image sensor, expand the dynamic range, and improve the imaging quality. Attached Figure Description
[0010] Figure 1 One of the schematic diagrams of the first pixel unit provided in the embodiments of this application;
[0011] Figure 2 One of the schematic diagrams of a pixel array provided in an embodiment of this application;
[0012] Figure 3 A second schematic diagram of the first pixel unit provided in an embodiment of this application;
[0013] Figure 4 A second schematic diagram of a pixel array provided in an embodiment of this application;
[0014] Figure 5 A third schematic diagram of the first pixel unit provided in an embodiment of this application;
[0015] Figure 6 The third schematic diagram of the pixel array provided in the embodiments of this application;
[0016] Figure 7 Fourth schematic diagram of the first pixel unit provided in the embodiments of this application;
[0017] Figure 8 Fourth schematic diagram of a pixel array provided in an embodiment of this application;
[0018] Figure 9 This is one of the schematic diagrams of the red, green, and blue bands provided in the embodiments of this application;
[0019] Figure 10 A schematic diagram illustrating the division of six sub-bands using red, green, and blue colors as provided in an embodiment of this application;
[0020] Figure 11 A schematic diagram illustrating the division of the visible light band into 11 sub-bands for an embodiment of this application;
[0021] Figure 12This is one of the schematic diagrams of the pixel circuit structure provided in the embodiments of this application;
[0022] Figure 13 This is a second schematic diagram of the pixel circuit structure provided in the embodiments of this application;
[0023] Figure 14 An exploded view of the camera module provided in the embodiments of this application;
[0024] Figure 15 This is a schematic diagram of the camera module provided in an embodiment of this application. Detailed Implementation
[0025] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0026] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0027] To facilitate understanding, the relevant technologies of the embodiments of this application will be explained first.
[0028] The camera sensor is the core of a camera and its most critical technology. There are two types of sensors: the widely used CCD (Charge-coupled Device) element and the CMOS (Complementary Metal-Oxide Semiconductor) device. Compared to traditional cameras, which use film as their information recording medium, digital cameras use film as their image sensor, and this sensor is integrated into the camera.
[0029] Currently, CMOS devices are widely used. Like CCD elements, they are semiconductors used in digital cameras to record changes in light. CMOS mainly utilizes semiconductors made of silicon and germanium, allowing N-type (positively charged) and P-type (positively charged) semiconductors to coexist on the CMOS. The current generated by these two complementary effects can be recorded and interpreted by the processing chip as an image.
[0030] The camera lens is the most important component of a camera, and its quality directly affects the image quality. Lenses can be divided into two main categories: zoom lenses and prime lenses. Zoom lenses have variable focal lengths and angles of view, meaning they can be zoomed in and out; while prime lenses have fixed focal lengths, meaning they only have one focal length or one angle of view.
[0031] The CMOS camera module is the mainstream camera module used in mobile phones. It mainly consists of a lens, a voice coil motor, an infrared filter, an image sensor (CMOS), a digital signal processor (DSP), and a flexible printed circuit (FPC).
[0032] The general workflow of a CCM is as follows: the voice coil motor drives the lens to reach the accurate focusing position, external light passes through the lens, is filtered by the infrared filter, and illuminates the photodiode (pixel) of the image sensor. The photodiode converts the sensed light signal into an electrical signal, which is then amplified and converted into a digital signal matrix (i.e., an image) by an amplification circuit and an analog-to-digital converter. The image is then processed by a digital signal processor, compressed, and stored.
[0033] The following description, in conjunction with the accompanying drawings, details an image sensor, camera module, and electronic device provided in this application through specific embodiments and application scenarios.
[0034] One embodiment of this application provides an image sensor, which includes a pixel array comprising at least two first pixel units. Optionally, the at least two first pixel units can be arranged in a preset manner, such as a row and column arrangement, to form the pixel array. The first pixel unit is pentagonal, and the first pixel unit includes a first sub-pixel and a second sub-pixel. The first sub-pixel is pentagonal, and the second sub-pixel is triangular. That is, the first sub-pixel and the second sub-pixel included in the first pixel unit are combined into one, together forming the pentagonal first pixel unit.
[0035] Therefore, in this embodiment of the application, the pixel array in the image sensor includes at least two pentagonal first pixel units, each pixel unit including a first sub-pixel and a second sub-pixel, wherein the first sub-pixel is pentagonal and the second sub-pixel is triangular. Thus, the sub-pixels are arranged closely, resulting in a high pixel density. During a single exposure, the first and second sub-pixels in the pixel unit can output multiple light-sensitive values, thereby obtaining multiple images with different or the same exposure values. This enables HDR synthesis and multi-frame noise reduction, effectively avoiding image misalignment, ghosting, and other phenomena. At the same time, it can improve the resolution and light sensitivity of the image sensor, expand the dynamic range, and improve the imaging quality.
[0036] In some embodiments of this application, the first pixel unit includes six first sub-pixels and five second sub-pixels. The five sides of one first sub-pixel overlap with one side of each of the other five first sub-pixels, meaning the five first sub-pixels surround one first sub-pixel. The triangular second sub-pixels can be positioned between two adjacent first sub-pixels among the outer five first sub-pixels. This pixel arrangement allows a pixel unit to include multiple sub-pixels, and these sub-pixels are arranged closely and reasonably, thereby increasing pixel density and ultimately improving the light sensitivity of the image sensor.
[0037] In some embodiments of this application, the first pixel unit is further shaped as a regular pentagon, and the first sub-pixel is also shaped as a regular pentagon. Thus, the sub-pixels in the first pixel unit are arranged neatly, and the pixel array formed by the first pixel units is also neatly arranged and compactly structured, thereby increasing the pixel density of the image sensor and consequently improving its light sensitivity.
[0038] In other embodiments of this application, the pentagonal first sub-pixel located at the center of the first pixel unit is any one of a white sub-pixel, a green sub-pixel, and an infrared sub-pixel, while the remaining five pentagonal first sub-pixels include at least two types of red sub-pixels, green sub-pixels, blue sub-pixels, cyan sub-pixels, magenta sub-pixels, and yellow sub-pixels. Optionally, since red, green, and blue are the three primary colors, and cyan, magenta, and yellow are the three primary colors complementary to red, green, and blue, red, green, and blue sub-pixels are usually selected simultaneously, while cyan, magenta, and yellow sub-pixels are selected simultaneously.
[0039] The above scenarios will be described in detail below.
[0040] In some embodiments of this application, the first sub-pixel located at the center of the first pixel unit is a green sub-pixel, while the remaining five first sub-pixels include red and blue sub-pixels. The specific number of red and blue sub-pixels can be set according to actual needs. This pixel arrangement enhances the color capture capability of the image sensor. Furthermore, if there are at least two red and two blue sub-pixels, both can be added together, facilitating the design of the data reading circuit and enabling the acquisition of different exposure values.
[0041] In some embodiments of this application, when the first sub-pixel located at the center of the first pixel unit is a green sub-pixel, among the remaining five first sub-pixels, three are red sub-pixels and two are blue sub-pixels. Both red and blue sub-pixels can be added together, and the number of red sub-pixels exceeds the number of blue sub-pixels, thus taking into account the energy differences of different color bands and achieving better photosensitivity. In this pixel arrangement, three sub-pixels of the same color (i.e., red) can be read during a single exposure. Since the three sub-pixels of the same color have the same area, by sequentially connecting the photodiodes corresponding to the three sub-pixels of the same color to the capacitor used for reading photosensitivity data in the pixel circuit, the electrons from the photodiodes corresponding to the three sub-pixels of the same color sequentially enter the capacitor used for reading photosensitivity data. This ultimately yields a 1:2:3 photosensitivity value, i.e., 1:2:3 original image data. This expands the dynamic range of the image. Furthermore, the photosensitivity data of the three sub-pixels of the same color can be read through a single capacitor, thus facilitating the design of the pixel circuit.
[0042] Optionally, the second sub-pixel of the first pixel unit is a PD pixel for phase detection autofocus. PD stands for phase detection, and PD autofocus achieves focusing through phase detection. A PD pixel may include a left (L) pixel and a right (R) pixel. By using the pixel values of the L and R pixels in the PD pixel, the phase difference of the focusing area can be calculated, thereby achieving phase detection autofocus. Therefore, the solution in this embodiment can improve the focusing capability of the image sensor.
[0043] Optionally, the second sub-pixel is a PD pixel and a white sub-pixel, which can significantly improve the light sensitivity of the image sensor.
[0044] Please refer to Figure 1 and Figure 2 , Figure 1 This is one of the schematic diagrams of the first pixel unit provided in the embodiments of this application. Figure 2 This is one of the schematic diagrams of a pixel array provided in an embodiment of this application. For example... Figure 1As shown, the first pixel unit 10 includes a pentagonal green sub-pixel G, three pentagonal red sub-pixels R, and two pentagonal blue sub-pixels B. The green sub-pixel G is located at the center of the first pixel unit, and the five sides of the green sub-pixel G coincide with one side of each of the other five pentagonal first sub-pixels. Figure 2 As shown, multiple first pixel units 10 are arranged in an array, and the first pixel units 10 are closely attached to each other to form a pixel array 1.
[0045] like Figure 1 or Figure 2 As shown, in some embodiments, the first pixel unit 10 further includes five triangular second sub-pixels 11, which are located between two adjacent first sub-pixels on the periphery. The second sub-pixels 11 may be PD pixels and are white sub-pixels.
[0046] In some other embodiments of this application, the first sub-pixel located at the center of the first pixel unit is a white sub-pixel or an infrared sub-pixel, and the remaining five first sub-pixels include a red sub-pixel, a green sub-pixel, and a blue sub-pixel. The specific number of red, green, and blue sub-pixels can be set according to actual needs. Since the first pixel unit includes a white sub-pixel, the light sensitivity of the image sensor can be significantly improved.
[0047] In some embodiments of this application, when the first sub-pixel located at the center of the first pixel unit is a white sub-pixel, among the remaining five first sub-pixels, two are red sub-pixels, one is a green sub-pixel, and two are blue sub-pixels. Then, the red and blue sub-pixels can be added together. Under this pixel arrangement, three sub-pixels of the same color (i.e., red) can be read in one exposure. Since the areas of the two sub-pixels of the same color are the same, by connecting the photodiodes corresponding to the two sub-pixels of the same color to the capacitor used to read the photosensitive data in the pixel circuit in sequence, the electrons of the photodiodes corresponding to the two sub-pixels of the same color enter the capacitor used to read the photosensitive data in sequence. Finally, a photosensitive value of 1:2 can be obtained, that is, 1:2 original image data can be obtained. This can expand the dynamic range of the image. Furthermore, the photosensitive data of the two sub-pixels of the same color can be read by one capacitor, which can facilitate the design of the pixel circuit.
[0048] Optionally, the second sub-pixel included in the first pixel unit is a PD pixel used for phase detection autofocus. The specific principle of the PD pixel is described in the above embodiment and will not be repeated here. Therefore, the solution in this embodiment can improve the focusing capability of the image sensor.
[0049] Optionally, the second sub-pixel is a PD pixel and a white sub-pixel, which can significantly improve the light sensitivity of the image sensor.
[0050] Please refer to Figure 3 and Figure 4 , Figure 3 The second schematic diagram of the first pixel unit provided in the embodiments of this application. Figure 4 This is a second schematic diagram of a pixel array provided in an embodiment of this application. Figure 3 As shown, the first pixel unit 10 includes a pentagonal white sub-pixel W, a pentagonal green sub-pixel G, two pentagonal red sub-pixels R, and two pentagonal blue sub-pixels B. The pentagonal white sub-pixel W is located at the center of the first pixel unit 10, and the five sides of the white sub-pixel W coincide with one side of each of the other five pentagonal first sub-pixels. Figure 4 As shown, multiple first pixel units 10 are arranged in an array, and the first pixel units 10 are closely attached to each other to form a pixel array 1.
[0051] like Figure 3 or Figure 4 As shown, in some embodiments, the first pixel unit 10 further includes five triangular second sub-pixels 11, which are located between two adjacent first sub-pixels on the periphery. The second sub-pixels 11 may be PD pixels and are white sub-pixels.
[0052] In some other embodiments of this application, the first sub-pixel located at the center of the first pixel unit is a white sub-pixel or an infrared sub-pixel, and the remaining five first sub-pixels include a red sub-pixel, a green sub-pixel, a blue sub-pixel, a magenta sub-pixel, and a yellow sub-pixel, i.e., one each of the following: When the first pixel unit includes a white sub-pixel, the light sensitivity of the image sensor can be significantly improved; when the first pixel unit includes an infrared sub-pixel, the light sensitivity of the image sensor in dark environments can be improved. Furthermore, since the magenta and yellow sub-pixels are complementary colors of red, green, and blue, and have higher light sensitivity than red, green, and blue, in this pixel arrangement, magenta and yellow can cross-reference with the color information of red, green, and blue to improve the color reproduction accuracy of the image sensor.
[0053] Optionally, the second sub-pixel included in the first pixel unit is a PD pixel used for phase detection autofocus. The specific principle of the PD pixel is described in the above embodiment and will not be repeated here. Therefore, the solution in this embodiment can improve the focusing capability of the image sensor.
[0054] Optionally, the second sub-pixel is a PD pixel and a white sub-pixel, which can significantly improve the light sensitivity of the image sensor.
[0055] Please refer to Figure 5 and Figure 6 , Figure 5 This is the third schematic diagram of the first pixel unit provided in the embodiments of this application. Figure 6 This is the third schematic diagram of a pixel array provided in an embodiment of this application. Figure 5 As shown, the first pixel unit 10 includes a pentagonal first sub-pixel located at the center, a pentagonal green sub-pixel G, a pentagonal red sub-pixel R, a pentagonal blue sub-pixel B, a pentagonal magenta sub-pixel M, and a pentagonal yellow sub-pixel Y. The pentagonal first sub-pixel located at the center of the first pixel unit 10 is either a white sub-pixel W or an infrared sub-pixel IR, and the five sides of the white sub-pixel W or the infrared sub-pixel IR coincide with one side of each of the other five pentagonal first sub-pixels. Figure 6 As shown, multiple first pixel units 10 are arranged in an array, and the first pixel units 10 are closely attached to each other to form a pixel array 1.
[0056] like Figure 5 or Figure 6 As shown, in some embodiments, the first pixel unit 10 further includes five triangular second sub-pixels 11, which are located between two adjacent first sub-pixels on the periphery. The second sub-pixels 11 may be PD pixels and are white sub-pixels.
[0057] Please refer to Figure 7 and Figure 8 , Figure 7 This is the fourth schematic diagram of the first pixel unit provided in the embodiments of this application. Figure 8 This is the fourth schematic diagram of a pixel array provided in an embodiment of this application. Figure 7 and Figure 8As shown, in some embodiments of this application, the first pixel unit 10 includes six pentagonal first sub-pixels 12 and five triangular second sub-pixels 11, for a total of 11 sub-pixels. Specifically, the five sides of the pentagonal first sub-pixel 12 located at the center of the first pixel unit coincide with one side of each of the other five pentagonal first sub-pixels 12. The triangular second sub-pixels 11 are located between two adjacent pentagonal first sub-pixels 12 on the periphery, meaning that two sides of the triangular second sub-pixel 11 coincide with one side of each of the two adjacent pentagonal first sub-pixels 12. For example, the visible light band is divided into 11 sub-bands, and each first sub-pixel 12 and each second sub-pixel 12 in the first pixel unit is used to sense light corresponding to one sub-band, i.e., there is a one-to-one correspondence between sub-pixels and sub-bands. For example, larger sub-pixels can be used to sense light in sub-bands with weaker light energy, while smaller sub-pixels can be used to sense light in sub-bands with stronger light energy. In this embodiment, the pixel arrangement described above can effectively enhance the multispectral light sensitivity of the image sensor, better reproduce colors, and improve the accuracy of algorithms such as white balance and automatic exposure. It is understood that the total number of first and second sub-pixels in the first pixel unit is the same as the number of sub-bands, and each sub-pixel (including the first and second sub-pixels) corresponds to a different photosensitive sub-band. The number of sub-pixels contained in the first pixel unit can be determined according to actual needs.
[0058] Optionally, the visible light band can be specifically 400–780 nm.
[0059] Please refer to Figures 9 to 11 , Figure 9 This is one of the schematic diagrams of the red, green, and blue bands provided in the embodiments of this application. Figure 10 This is a schematic diagram illustrating the division of six sub-bands using red, green, and blue colors, as provided in an embodiment of this application. Figure 11 This is a schematic diagram illustrating the division of the visible light band into 11 sub-bands, as provided in an embodiment of this application. Figure 9 As shown, an image visible to the normal human eye consists of three spectral data: R, G, and B. Within the visible light spectrum, this includes the red, green, and blue light bands. Furthermore, the R spectrum can be further subdivided into two or more sub-spectrums, and the B and G spectra are similarly subdivided; for example... Figure 10 As shown, the red, green, and blue light bands are each subdivided into two smaller bands. Further, as... Figure 11 As shown, the visible light band can be divided into 11 sub-bands, so that each first sub-pixel and each second sub-pixel in the first pixel unit are sensitive to light in one sub-band.
[0060] The pixel circuit structure used to read the data of the photodiode corresponding to the sub-pixel is described below.
[0061] Please refer to Figure 12 , Figure 12 This is one of the schematic diagrams of a pixel circuit structure provided in an embodiment of this application. For example... Figure 12 As shown, this pixel circuit structure is called a PPD (Pinned Photodiode) pixel structure. A PPD pixel includes a photosensitive area (PD1), i.e., a photodiode, and four transistors (a reset transistor RST, a floating switch TX1, a row selector SET, and a signal amplifier SF), hence it is also called a 4T pixel structure. The PPD allows for the introduction of Correlated Double Sample (CDS) circuitry, eliminating kTC noise introduced by the reset, 1 / f noise introduced by the MOSFET, and offset noise. The operation of this pixel circuit structure is as follows:
[0062] 1. Exposure. Reset transistor RST and floating switch TX1 are turned on simultaneously to clear photodiode PD1. Then, they are disconnected to begin exposure. Electron-hole pairs generated by light irradiation will separate due to the presence of the electric field of photodiode PD1, with electrons moving to the n-region and holes moving to the p-region.
[0063] 2. Reset. At the end of the exposure, activate the reset transistor RST to reset capacitor FD1 to a high level.
[0064] 3. Reset Level Readout. After the reset is completed, the reset level of capacitor FD1 is read out, which includes the offset noise of the MOSFET, 1 / f noise, and kTC noise introduced by the reset. The readout signal is stored in the first capacitor.
[0065] 4. Charge Transfer. Activating the floating switch TX1 completely transfers the charge from the photosensitive area to the capacitor FD1 for readout. This mechanism is similar to charge transfer in a CCD.
[0066] 5. Signal Level Readout. Next, the voltage signal of capacitor FD1 is read out to capacitor FD2. This voltage signal includes: the signal generated by photoelectric conversion, the offset generated by the operational amplifier, 1 / f noise, and kTC noise introduced by reset.
[0067] 6. Signal Output. The signals stored in capacitors FD1 and FD2 are subtracted (if CDS is used, the main noise in the pixel can be eliminated), and the resulting signal is amplified by analog and then sampled by ADC to output a digital signal.
[0068] Figure 12In this circuit, transistor DCG1 acts as a parallel control switch for capacitors FD1 and FD2. Assuming the capacitance ratio of capacitors FD1 and FD2 is set to 1:4, when data is stored in photodiodes of two sub-pixels of the same color (e.g., red), transistor DCG1 can be controlled to read out electrons from the photodiodes at 1 or 4 times the voltage. Thus, two images with an exposure ratio of 1:4 can be obtained in a single exposure, thereby expanding the dynamic range.
[0069] Please refer to Figure 13 , Figure 13 This is a second schematic diagram of the pixel circuit structure provided in an embodiment of this application. Figure 13 As shown, with Figure 12 The difference lies in the capacitor used for data reading: FD1. The pixel circuit structure includes three photodiodes: PD1, PD2, and PD3. When reading three sub-pixels of the same color and area, the floating switch TX1 is first opened to read data from PD1 via capacitor FD1. Then, floating switches TX2 and TX3 are opened sequentially, allowing electrons from PD2 and PD3 to enter capacitor FD1. Since the three sub-pixels have the same area, three original image data sets in a 1:2:3 ratio can be obtained with a single exposure, thus expanding the dynamic range. Furthermore, this lateral addition layout allows for easy design of the corresponding readout circuit.
[0070] In summary, in the embodiments of this application, the pixel array in the image sensor includes at least two pentagonal first pixel units, each pixel unit including a first sub-pixel and a second sub-pixel, wherein the first sub-pixel is pentagonal and the second sub-pixel is triangular. Thus, the sub-pixels are closely arranged, resulting in a high pixel density. During a single exposure, the first and second sub-pixels in the pixel unit can output multiple light-sensitive values, thereby obtaining multiple images with different or the same exposure values. This enables HDR synthesis and multi-frame noise reduction, effectively avoiding image misalignment, ghosting, and other phenomena. At the same time, it can improve the resolution and light sensitivity of the image sensor, expand the dynamic range, and improve the imaging quality.
[0071] This application also provides a camera module, which includes the image sensor described in the above embodiments and can achieve the same technical effect. To avoid repetition, the image sensor will not be described again here.
[0072] Please refer to Figure 14 and Figure 15 , Figure 14 This is an exploded view of the camera module provided in the embodiments of this application. Figure 15This is a schematic diagram of the camera module provided in an embodiment of this application. Figure 14 and Figure 15 As shown, the camera module 200 in this embodiment includes a protective film 201, a lens 202, a voice coil motor 203, a mounting bracket 204, a filter 205, an image sensor 206, a flexible circuit board 207, and a connector 208. The protective film 201 is used to protect the lens 202, etc. The lens 202 is used for focusing and light gathering. The lens 202 is wrapped and fixed by the voice coil motor 203. The upper and lower ends of the voice coil motor 203 are hinged to the spring. When the lens 202 is focusing, the voice coil motor 203 is energized to generate an electromagnetic force. This electromagnetic force is balanced with the elastic force of the spring. The position of the voice coil motor 203 can be controlled by the magnitude of the energized current, thereby moving the voice coil motor 203 and the lens 202 to a suitable focusing position to achieve automatic focusing. The mounting bracket 204 is used to fix components such as the voice coil motor 203; the filter 205 is placed between the lens 202 and the image sensor 206 to filter the light passing through the lens 202, preventing the image sensor from producing false colors / ripples, thereby improving its effective resolution and color reproduction; the image sensor 206 is used for light sensing and converts light signals into electrical signals; the image sensor 206 is connected to the flexible circuit board 207, the flexible circuit board 207 is connected to the connector 208, and then further connected to components such as the processor on the motherboard to realize the transmission of light-sensing data.
[0073] The working principle of the camera module in this application embodiment is as follows:
[0074] Step 101: Move the lens 202 to the appropriate focus position using the voice coil motor 203;
[0075] Step 102: The image sensor 206 senses light and converts the light signal into an electrical signal;
[0076] Step 103: The image sensor 206 transmits electrical signals to the processor via the flexible circuit board 207, etc. The image signal is processed and compressed to generate an image, which can then be saved or previewed.
[0077] In this embodiment, the pixel array in the image sensor includes at least two pentagonal first pixel units. Each pixel unit includes a first sub-pixel and a second sub-pixel. The first sub-pixel is pentagonal, and the second sub-pixel is triangular. As a result, the sub-pixels are closely arranged, resulting in a high pixel density. During a single exposure, the first and second sub-pixels in the pixel unit can output multiple light-sensitive values, thereby obtaining multiple images with different or the same exposure values. This enables HDR synthesis and multi-frame noise reduction, effectively avoiding image misalignment, ghosting, and other phenomena. At the same time, it can improve the resolution and light sensitivity of the image sensor, expand the dynamic range, and improve the imaging quality.
[0078] This application also provides an electronic device, which includes the camera module described in the above embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0079] The electronic device in this application embodiment can be a terminal, or it can be any other device besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, handheld computer, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a personal computer (PC), television (TV), ATM, or self-service machine, etc. The embodiments of this application do not specifically limit it.
[0080] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0081] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. An image sensor, characterized by, Comprising: a pixel array comprising at least two first pixel units, the first pixel units being pentagonal, the first pixel units comprising first sub-pixels and second sub-pixels, the first sub-pixels being pentagonal, the second sub-pixels being triangular; the first pixel units comprising six first sub-pixels and five second sub-pixels, five edges of a first sub-pixel located at the center of the first pixel unit respectively coincide with an edge of the remaining five first sub-pixels located at the periphery of the first sub-pixel at the center of the first pixel unit, the second sub-pixels being arranged between adjacent two of the remaining five first sub-pixels at the periphery; the first sub-pixel located at the center of the first pixel unit being any one of a white sub-pixel, a green sub-pixel, and an infrared sub-pixel, the remaining five first sub-pixels comprising at least two of a red sub-pixel, a green sub-pixel, a blue sub-pixel, a cyan sub-pixel, a magenta sub-pixel, and a yellow sub-pixel; the second sub-pixels comprising PD pixels for phase focusing; the second sub-pixels comprising white sub-pixels.
2. The image sensor of claim 1, wherein, in a case where the first sub-pixel located at the center of the first pixel unit is a green sub-pixel, the remaining five first sub-pixels comprising a red sub-pixel and a blue sub-pixel.
3. The image sensor of claim 2, wherein, of the remaining five first sub-pixels, three first sub-pixels are red sub-pixels, and two first sub-pixels are blue sub-pixels.
4. The image sensor of claim 1, wherein, in a case where the first sub-pixel located at the center of the first pixel unit is a white sub-pixel or an infrared sub-pixel, the remaining five first sub-pixels comprising a red sub-pixel, a green sub-pixel, and a blue sub-pixel, or the remaining five first sub-pixels comprising a red sub-pixel, a green sub-pixel, a blue sub-pixel, a magenta sub-pixel, and a yellow sub-pixel.
5. The image sensor of claim 4, wherein, in a case where the first sub-pixel located at the center of the first pixel unit is a white sub-pixel, of the remaining five first sub-pixels excluding the white sub-pixel, two first sub-pixels are red sub-pixels, one first sub-pixel is a green sub-pixel, and two first sub-pixels are blue sub-pixels.
6. The image sensor of claim 1, wherein, a corresponding photosensitive sub-band of each first sub-pixel is different, a corresponding photosensitive sub-band of each second sub-pixel is different, and the photosensitive sub-band of the first sub-pixel is different from that of the second sub-pixel.
7. The image sensor of claim 1, wherein, the first pixel units are regular pentagons, and the first sub-pixels are regular pentagons.
8. An image capture module, comprising: An image sensor as claimed in any one of claims 1-7.
9. An electronic device, comprising: A camera module as claimed in claim 8.
Citation Information
Patent Citations
Pixel structure, display panel and mask group
CN111969018A
Image sensor, camera module and electronic equipment
CN112822466A
Image sensor, camera module and electronic equipment
CN114205497A