Image sensor, camera module and electronic device

Abstract

The application discloses an image sensor, a camera module, an electronic device and an image processing method, and belongs to the technical field of image processing. The image sensor comprises a plurality of pixel units, and each pixel unit comprises: a photosensitive layer located at the lower layer of the pixel unit, which is used for collecting a light signal and converting the light signal into an electric signal; and a light filtering layer located at the upper layer of the pixel unit, wherein the light filtering layer comprises a light filtering area and a storage area, the light filtering area is a light-transmitting material, and the projection of the light filtering area on the optical axis direction at least partially overlaps with the photosensitive layer; the storage area is a light-blocking material, the storage area is used for storing electric particles with colors, the electric particles can move between the storage area and the light filtering area, and the light filtering area is used for allowing light with the same color as the color of the electric particles in the light filtering area to pass through and enter the photosensitive layer at the lower layer.

Description

Technical Field

[0001] This application belongs to the field of image processing technology, specifically relating to an image sensor, camera module, and electronic device. Background Technology

[0002] Traditional complementary metal-oxide-semiconductor (CMOS) image sensors mainly consist of an upper filter and a photosensitive layer located below the filter, used to collect different colors of light. Natural light is composed of RGB colors, which become monochromatic light after passing through the filter, and the monochromatic light is received by the photosensitive layer below.

[0003] A pixel unit typically includes four identical photosensitive sensors and four filter units that filter the corresponding colors of light, R, B, Gr, and Gb, in order to realize a pixel. A single photosensitive sensor can only receive light of one color, resulting in low utilization. Summary of the Invention

[0004] The purpose of this application is to provide an image sensor, camera module, electronic device, and image processing method that can solve the problem of low utilization of photosensitive sensors in the pixel structure of existing image sensors.

[0005] In a first aspect, embodiments of this application provide an image sensor including multiple pixel units. Each pixel unit includes: a photosensitive layer located below the pixel unit for collecting light signals and converting them into electrical signals; and a filter layer located above the pixel unit, the filter layer including a filter region and a storage region. The filter region is made of a light-transmitting material and at least partially overlaps with the projection of the photosensitive layer in the optical axis direction. The storage region is made of an opaque material and is used for colored electric particles. The electric particles can move between the storage region and the filter region. The filter region is used to allow light of the same color as the electric particles in the filter region to pass through and enter the lower photosensitive layer.

[0006] Secondly, embodiments of this application provide a camera module, including the image sensor as described in the first aspect.

[0007] Thirdly, embodiments of this application provide an electronic device including a camera module as described in the second aspect.

[0008] Fourthly, embodiments of this application provide an image processing method applied to an image processing apparatus including the image sensor described in the first aspect, comprising:

[0009] When electric particles of the first color are contained in each filter region 203 of the plurality of pixel units, the light signal of the first color transmitted from the corresponding filter region 203 is collected by each photosensitive layer of the plurality of pixel units and converted into an electrical signal of the first color.

[0010] Drive the first color electric particles from the filter region 203 to the storage region, and control the electric particles with the second color stored in the storage region to move to the filter region 203;

[0011] The light signal of the second color transmitted through the corresponding filter area 203 is collected by each photosensitive layer and converted into an electrical signal of the second color.

[0012] The first color and the second color are different colors.

[0013] In this application embodiment, the image sensor described above enables a single photosensitive sensor to collect light of different colors in a time-division manner, thereby realizing the acquisition of image light information. With a fixed photosensitive sensor area, more photosensitive sensors can be placed within the same image sensor area, and a single photosensitive sensor can realize one pixel, thus enabling a greater number of pixels to be realized within the same image sensor area.

[0014] If the number of pixels does not need to be increased, the photosensitive sensor can be made larger within the same image sensor area, thereby improving image quality. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the pixel unit structure of the image sensor according to an embodiment of this application.

[0016] Figure 2 This is a schematic diagram of the overall architecture of the pixel unit of the image sensor according to an embodiment of this application.

[0017] Figure 3 This is a schematic diagram of the light signal acquisition of a pixel unit of an image sensor according to an embodiment of this application.

[0018] Figure 4 This is a flowchart of the image processing method according to an embodiment of this application. Detailed Implementation

[0019] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0020] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0021] The image sensor, camera module, electronic device, and image processing method provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0022] This application provides a pixel structure, including: a photosensitive layer located below the pixel unit for collecting light signals and converting them into electrical signals; and a filter layer located above the pixel unit, the filter layer including a filter region and a storage region, the filter region being a light-transmitting material and at least partially overlapping with the projection of the photosensitive layer in the optical axis direction, the storage region being an opaque material, the storage region being used for colored electric particles, the electric particles being movable between the storage region and the filter region, and the filter region being used to allow light of the same color as the electric particles in the filter region to pass through and enter the lower photosensitive layer.

[0023] In the embodiments of this application, a pixel unit includes a photosensitive sensor and a corresponding filter area. By moving charged particles of different colors within the filter area, a pixel unit can collect light of different colors, and subsequent processing can obtain the pixel values ​​of each color corresponding to a pixel.

[0024] like Figure 1 As shown, the pixel unit includes a filter layer 22 and a photosensitive layer 24, which are stacked in order from top to bottom, and the projections of the filter layer 22 and the photosensitive layer 24 in the optical axis direction at least partially overlap.

[0025] The filter layer 22, located above the pixel unit, includes a filter area made of a light-transmitting material and a storage area made of an opaque material. The storage area is used to store colored electric particles, such as red, green, and / or blue electric particles. Electric particles of the target color can move to the filter area within the storage area.

[0026] The light-transmitting properties of the filter area allow light of the same color as the target color electric particles that move to the filter area to pass through and enter the lower photosensitive layer 24. The photosensitive layer 24 collects the light signal of the target color and converts it into an electrical signal. The target color is the color of the aforementioned electric particles, which can be red, green, or blue. When red electric particles in the storage area move to the filter area, the filter area allows red light to pass through; when green electric particles in the storage area move to the filter area, the filter area allows green light to pass through; and when blue electric particles in the storage area move to the filter area, the filter area allows blue light to pass through.

[0027] Optionally, the image sensor further includes a driving unit for driving the electric particles to move between the storage region and the filtering region.

[0028] Optionally, the driving unit includes: a first control electrode disposed in the storage region; and a second control electrode disposed in the filter region; wherein the first control electrode is used to drive the electric particles to move from the storage region to the filter region, and the second control electrode is used to drive the electric particles to move from the filter region to the storage region.

[0029] Electric particles are particles that carry positive or negative charges. Appropriate control electrodes can be set in the storage area and the filtering area respectively. Based on the principle that like charges repel and unlike charges attract, the red, green, or blue electric particles stored in the storage area can be moved to the filtering area to filter the corresponding color of light.

[0030] Optionally, the storage region includes a first sub-storage region 201 for storing red particles, a second sub-storage region 202 for storing green particles, and a third sub-storage region 204 for storing blue particles; the first sub-storage region 201, the second sub-storage region 202, and the third sub-storage region 204 are distributed around the periphery of the filter region. Figure 1 As shown, the filter layer 22 is divided into four regions, including a filter region 203 and three storage regions 201, 202, and 203.

[0031] Unlike the prior art where a pixel unit's filter layer includes four filter units that are used to filter different colors of light, namely red, green, and blue, in this embodiment, a pixel unit can filter different colors of light through a filter region 203.

[0032] refer to Figure 2 ,in Figure 2 The left side is a three-dimensional schematic diagram of the entire pixel unit, and the right side is a planar schematic diagram of the filter layer 22 on the upper layer of the pixel unit.

[0033] The filtering area is made of a light-transmitting material, allowing light of the same color as the electric particles located within it to pass through. The storage area is made of an opaque material, and each of the three storage areas is used to store electric particles of red, green, and blue colors respectively. Light of the same color as the electric particles located within the storage area cannot pass through.

[0034] Optionally, the storage area includes a first sub-storage area 201 for storing red electric particles, a second sub-storage area 202 for storing green electric particles, and a third sub-storage area 204 for storing blue electric particles; the first sub-storage area 201, the second sub-storage area 202, and the third sub-storage area 204 are distributed around the periphery of the filter area.

[0035] refer to Figure 1 and Figure 2 The planar diagram on the right shows that the filter layer 22 includes a filter region 203 and three storage regions 201, 202, and 203. The first sub-storage region 201, the second sub-storage region 202, and the third sub-storage region 204 are distributed around the filter region 204. The first sub-storage region 201 is adjacent to the second sub-storage region 202 and the third sub-storage region 204 by one edge, and the filter region 203 is adjacent to the second sub-storage region 202 and the third sub-storage region 204 by one edge.

[0036] As described above, the first sub-storage area 201, the second sub-storage area 202, and the third sub-storage area 204 are used to store red, green, and blue electric particles, respectively. There is no restriction on which color of electric particles each storage area can store, as long as the three types of electric particles with different colors are located in different storage areas. That is, each storage area can only store electric particles of the same color.

[0037] As the name suggests, electric particles are charged particles. Electric particles can be positively or negatively charged. Of course, electric particles of the same color stored in each of the three storage areas must simultaneously carry the same polarity. In the embodiments of this application, colored electric particles can, for example, exist in the form of capsules.

[0038] Since the electric particles themselves carry color, when they enter the light-filtering area of ​​a transparent material, the transparent light-filtering area displays the color corresponding to the electric particles.

[0039] Figure 2 In the embodiment, the four regions of the filter layer 22 are rectangular, but this application is not limited to this specific embodiment. To improve the utilization rate of pixel units, the four regions of the filter layer 22 can be guaranteed to have four sides, and the sides of two adjacent regions can be completely aligned.

[0040] Optionally, the first sub-storage area 201, the second sub-storage area 202, the filter area 203, and the third sub-storage area 204 are all rectangles, or the first sub-storage area 201, the second sub-storage area 202, the filter area 203, and the third sub-storage area 204 are all rhombuses.

[0041] Whether it is the electric particles stored in the first sub-storage area 201, the second sub-storage area 202, or the third sub-storage area 204, or the electric particles moved to the filter area 203, the number and size of the electric particles are the same, and the size and number of electric particles in different areas can be adjusted according to actual needs.

[0042] In this embodiment, each colored electric particle originally stored in the first sub-storage area 201, the second sub-storage area 202, and the third sub-storage area 204 needs to be moved sequentially to the filter area 203, so that the filter area 203 transmits light of the same color as the colored electric particles it contains into the lower photosensitive layer.

[0043] The movement of electric particles can be achieved by setting electrodes in each region. Optionally, the first control electrode includes: a first electrode 101 and a second electrode 102 set in the first sub-storage region 201; a third electrode 103 and a fourth electrode 104 set in the second sub-storage region 202; and a seventh electrode 107 and an eighth electrode 108 set in the third sub-storage region 204. The second control electrode includes: a fifth electrode 105 and a sixth electrode 106 set in the filter region 203. The first electrode 101 is opposite to the fourth electrode 104, the second electrode 102 is opposite to the seventh electrode 107, the third electrode 103 is opposite to the sixth electrode 106, and the fifth electrode 105 is opposite to the eighth electrode 108. The polarities of the opposite electrodes are opposite when energized.

[0044] The following is combined with Figure 2 The electrode layout of each region included in the filter layer, and the principle of electric particles moving between different regions through the corresponding electrodes are described. In the illustrated embodiment, each region is illustrated as a rectangle. The first sub-storage region 201, the second sub-storage region 202, the filter region 203, and the third sub-storage region 204 are all rectangles with four sides.

[0045] The first sub-storage area 201 is provided with a first electrode 101 and a second electrode 102, which are respectively located at the corresponding positions of two sides of the outer periphery of the first sub-storage area 201. That is, the two sides where the first electrode 101 and the second electrode 102 are located are the sides where the first sub-storage area 201 is not adjacent to the adjacent second sub-storage area 202 and third sub-storage area 204.

[0046] The second sub-storage area 202 is provided with a third electrode 103 and a fourth electrode 104, which are respectively located at the corresponding positions of two sides of the outer periphery of the second sub-storage area 202. That is, the two sides where the third electrode 103 and the fourth electrode 104 are located are the sides where the second sub-storage area 202 is not adjacent to the adjacent first sub-storage area 201 and filter area 203.

[0047] The filter region 203 is provided with a fifth electrode 105 and a sixth electrode 106, which are respectively located at the corresponding positions of two sides of the outer periphery of the filter region 203. That is, the two sides where the fifth electrode 105 and the sixth electrode 106 are located are the sides where the filter region 203 is not adjacent to the adjacent second sub-storage region 202 and third sub-storage region 204.

[0048] The third sub-storage area 204 is provided with a seventh electrode 107 and an eighth electrode 108, which are respectively located at the corresponding positions of the two sides of the outer periphery of the third sub-storage area 204. That is, the two sides where the seventh electrode 107 and the eighth electrode 108 are located are the sides of the third sub-storage area 204 that are not adjacent to the first sub-storage area 201 and the filter area 203.

[0049] Correspondingly, the first electrode 101 of the first sub-storage region 201 is opposite to the fourth electrode 104 of the second sub-storage region 202, the second electrode 102 of the first sub-storage region 201 is opposite to the seventh electrode 107 of the third sub-storage region 204, the third electrode 103 of the second sub-storage region 202 is opposite to the sixth electrode 106 of the filter region 203, and the fifth electrode 105 of the filter region 203 is opposite to the eighth electrode 108 of the third sub-storage region 204. Furthermore, the polarities of the two opposing electrodes are opposite when energized.

[0050] As mentioned above, the electric particles contained in each region are charged. Therefore, when positive and negative charges are applied to two electrodes set opposite each other in the two regions, the electric particles in one region can be driven to the other region by the principle that like charges attract and unlike charges repel each other when moving in an electric field.

[0051] Initially, only three storage regions contain colored electric particles, while the filter region contains no electric particles. For the four regions, the polarity of each relative electrode needs to be set so that the electric particles can move in a clockwise direction, from the second sub-storage region 202 to the filter region 203, from the filter region 203 to the third sub-storage region 204, from the third sub-storage region 204 to the first sub-storage region 201, and from the first sub-storage region 201 to the second sub-storage region 202.

[0052] Alternatively, the polarity of each relative electrode needs to be set so that the movement of electric particles can be in a counterclockwise direction, from the fourth sub-storage region 204 to the filter region 203, from the filter region 203 to the second sub-storage region 202, from the second sub-storage region 202 to the first sub-storage region 201, and from the first sub-storage region 201 to the third sub-storage region 203.

[0053] The polarity setting of the relative electrodes in each region is related to the polarity of the charged particles and the direction of their movement.

[0054] Taking a positively charged particle that can move clockwise between regions as an example, if the positively charged particle is driven to move from the second sub-storage region 202 to the filter region 203, then after being energized, the polarity of the third electrode 103 of the second sub-storage region 202 will be positive, the same as the polarity of the particle, while the polarity of the sixth electrode 106 of the filter region 203 will be negative, the opposite of the polarity of the particle. Therefore, a positively charged particle of a certain color currently stored in the second sub-storage region 202 can be quickly moved from the second sub-storage region 202 to the filter region 203.

[0055] Similarly, when positively charged particles are moved from the filter region 203 to the third sub-storage region 204, the polarity of the fifth electrode 105 in the filter region 203 becomes positive, the same as the polarity of the particles, while the polarity of the eighth electrode 108 in the third sub-storage region 204 becomes negative, the opposite of the polarity of the particles. Thus, positively charged particles of a certain color currently stored in the filter region 203 can be quickly moved from the filter region 203 to the third sub-storage region 204. After moving to the third sub-storage region 204, the fifth electrode 105 and the eighth electrode 108 are de-energized.

[0056] When a positively charged particle is driven to move from the third sub-storage region 204 to the first sub-storage region 201, the polarity of the seventh electrode 107 of the third sub-storage region 204 after energization is positive, which is the same as the polarity of the charged particle, while the polarity of the second electrode 102 of the first sub-storage region 201 is negative, which is opposite to the polarity of the charged particle.

[0057] After moving to the corresponding area, the electric particles that have moved to the target area can be kept in that area by de-energizing the electrodes.

[0058] As mentioned above, the filtering region allows light of the same color as the electric particles in the filtering region to pass through and enter the underlying photosensitive layer. Within a certain time period, electric particles of a certain color are driven to move to the filtering region so that the photosensitive layer can collect the light signal of the corresponding color and convert it into an electrical signal.

[0059] By distinguishing three time periods, red, green, and blue electric particles can be moved sequentially to the filter area. The corresponding red, green, and blue light can pass through the filter layer and enter the same photosensitive layer below, whose projections in the optical axis direction at least partially overlap. The light is then collected and processed separately.

[0060] The following example illustrates how, in the current state, filter area 203 contains a red ink capsule. To switch between blue and green ink capsules sequentially, the following steps are required:

[0061] 1. When the fifth electrode 105 and the eighth electrode 108 are energized, the red ink capsule in the filter area 203 is controlled to enter the third sub-storage area 204, and the fifth electrode 105 and the eighth electrode 108 are de-energized.

[0062] 2. When the third electrode 103 and the sixth electrode 106 are energized, the blue ink capsule in the second sub-storage area 202 is controlled to enter the filter area 203. At this time, the filter area 203 can only transmit blue light. When the third electrode 103 and the sixth electrode 106 are de-energized, the photosensitive layer below the filter area 203 can collect blue light.

[0063] 3. When the first electrode 101 and the fourth electrode 104 are energized, the green ink capsule is controlled to enter the second sub-storage area 202, and the first electrode 101 and the fourth electrode 104 are de-energized.

[0064] 4. When the second electrode 102 and the seventh electrode 107 are energized, the red ink capsule is controlled to enter the first sub-storage area 201, and the second electrode 102 and the seventh electrode 107 are de-energized.

[0065] The color switching of the photosensitive layer was completed in step 2. Steps 3 and 4 prepare for the next color switch, which occurs between blue and green. Repeating steps 1-4 completes the color switching. If it's necessary to collect more energy of a particular color, simply keep the control electrode powered off for a longer period.

[0066] In the diagram, electrodes 101 to 108 are multiple control electrodes on the filter layer. By periodically applying voltage to these electrodes, electric particles of different colors are periodically driven to move within the first sub-storage region 201, the second sub-storage region 202, the filter region 203, and the third sub-storage region 204. This causes the transparent filter region 203 to be filled with colored electric particles, allowing light of the same color as the electric particles to pass through. For example, if the filter region 203 is filled with red electric particles, then the filter region 203 can only allow red light to pass through.

[0067] In one embodiment, optionally, the photosensitive layer includes a photosensitive element and a conversion circuit. The photosensitive element is located below the filtering region and is used to collect light signals transmitted through the filtering region. The conversion circuit is connected to the photosensitive element and is used to convert the light signals collected by the photosensitive element into corresponding electrical signals. The area of ​​the photosensitive element is greater than or equal to the area of ​​the filtering region.

[0068] like Figure 2 As shown, the photosensitive layer 24 includes a photosensitive element 301 and a conversion circuit 302. The photosensitive element 301 is located directly below the filter region 203, and the conversion circuit 302 is located around the photosensitive element 301. The photosensitive element 301 is, for example, a photosensor.

[0069] In a pixel structure, the area of ​​the photosensitive layer 22 is the same as the area of ​​the filter layer 24, and the area of ​​the filter region 203 is the same as the area of ​​the photosensitive element 301. However, in order to allow more colored light transmitted through the filter region 203 to be captured by the photosensitive element 301, the area of ​​the photosensitive element 301 can be set to be slightly larger than the area of ​​the filter region 203.

[0070] like Figure 3 As shown, when red electric particles 10 move within the filter region 203, during camera capture, RGB natural light first enters the filter region 203 above the pixel unit. The red electric particles 10 then transmit the red light from the filter region 203 and into the photosensitive element 301 of the filter layer below the pixel unit. The photosensitive element 301 collects the incoming red light signal and, through photoelectric conversion by the peripherally connected conversion circuit 302, obtains the corresponding red electrical signal.

[0071] After capturing the red light, the green and blue light can be moved sequentially into the filter area 203 using the same method. Combined with the photosensitive element 301 and the conversion circuit 302, the corresponding green and blue electrical signals can be obtained. Thus, the capture of natural light corresponding to a pixel can be achieved.

[0072] In this embodiment, a single photosensitive sensor in the filter layer can collect different colors of light transmitted through the filter area in a time-division manner to achieve one pixel. Compared to the current CMOS image sensors that require four photosensitive sensors to collect three colors of light to achieve one pixel, the pixel structure of this embodiment can collect different colors of light with a single photosensitive sensor to achieve one pixel, thereby improving the utilization rate of the photosensitive sensor. Furthermore, the area of ​​the photosensitive sensor can be only 1 / 4 of the total area of ​​the four photosensitive sensors included in a single pixel unit in the existing system. This allows for the placement of more photosensitive sensors within the same image sensor area, thus significantly increasing the number of pixels and improving image quality.

[0073] Optionally, in one embodiment, the area of ​​the filter region 203 is the area of ​​the storage region. If the storage region comprises three sub-regions, the area of ​​the filter region 203 is larger than the areas of the first sub-storage region 201, the second sub-storage region 202, and the third sub-storage region 204, respectively.

[0074] In this embodiment, by increasing the area of ​​the filter region 203, more colored light can be transmitted and enter the photosensitive layer below.

[0075] With the image sensor area and pixel count remaining constant—that is, the area of ​​one pixel unit in this embodiment is the same as the area of ​​four photosensitive sensors included in a conventional pixel unit—by increasing the area of ​​the filter region in this application, the area of ​​a single photosensitive sensor in each pixel unit can be correspondingly increased. This results in greater light sensitivity, meaning the photosensitive sensor can collect more colors of light, leading to better image quality. Furthermore, the manufacturing process for a larger photosensitive sensor can be significantly simplified, thus reducing the overall manufacturing difficulty of the image sensor.

[0076] When the area of ​​the filter region is different from that of the other three storage regions, the same number and size of electric particles can be contained in the corresponding region by setting different thicknesses for each region.

[0077] In the case where the storage area includes three sub-regions, optionally, the volumes of the first sub-storage area 201, the second sub-storage area 202, the third sub-storage area 204, and the filter area 203 are the same, each corresponding to accommodate the same number and size of electric particles. Alternatively, the volumes of different sub-storage areas can be set according to the number and size of electric particles accommodated in the first sub-storage area 201.

[0078] Therefore, the area of ​​the three storage areas can be reduced while the area of ​​the filter area can be increased, allowing more color light to pass through the filter area and the photosensitive layer to collect more light, thus improving the image quality.

[0079] In the embodiments of this application, the image sensor of the above embodiments can realize the acquisition of different colors of light by a single photosensitive sensor in a time-division manner, thereby realizing image acquisition. When the area of ​​the photosensitive sensor is fixed, more photosensitive sensors can be placed in the same image sensor area. A single photosensitive sensor can realize one pixel. Therefore, under the same chip manufacturing process, more photosensitive sensors can be placed in the same image sensor area, and a greater number of pixels can be realized.

[0080] If the number of pixels does not need to be increased, the image sensor can be made larger within the same image sensor area to improve image quality.

[0081] Furthermore, if the area and number of pixels of the image sensor remain unchanged, the sensing unit in the individual pixel structure of the image sensor can be made larger, thereby increasing the amount of light sensed and improving the image quality.

[0082] Optionally, this application embodiment also provides a camera module, characterized in that it includes the image sensor described in any of the above embodiments.

[0083] The camera module further includes: a circuit board, the image sensor being electrically connected to the circuit board; and a lens disposed on the side of the image sensor away from the circuit board.

[0084] Optionally, embodiments of this application also provide an electronic device including the camera module described in any of the above embodiments.

[0085] It should be noted that the electronic devices in the embodiments of this application include mobile electronic devices and non-mobile electronic devices.

[0086] Furthermore, this application also provides an image processing method applied to an image processing apparatus including the image sensor described in any of the above embodiments.

[0087] like Figure 4 As shown, it includes:

[0088] Step 102: When electric particles of the first color are contained in each filter area of ​​the plurality of pixel units, the light signal of the first color transmitted from the corresponding filter area is collected by each photosensitive layer of the plurality of pixel units and converted into an electrical signal of the first color.

[0089] Step 104: Drive the first color electric particles from the filter area to the storage area, and control the electric particles with the second color stored in the storage area to move to the filter area 203.

[0090] Step 106: Collect the light signal of the second color transmitted through the corresponding filter area 203 through each photosensitive layer and convert it into an electrical signal of the second color; the first color and the second color are different colors.

[0091] The first color can be one of red, green, and blue, and the second color is also one of red, green, and blue and is different from the first color.

[0092] In practical applications, the colors corresponding to the first and second colors can be preset. For example, it is initially assumed that the electric particles contained in the filter area are red, meaning that during the process of capturing an image, red is first captured through the pixel unit; after time x, after the electric particles move, it is assumed that the electric particles contained in the filter area are blue, meaning that blue is subsequently captured through the pixel unit; after time y, it is assumed that the electric particles contained in the filter area are green, meaning that green is subsequently captured through the pixel unit. Thus, the color light corresponding to each pixel in a captured image is captured. The image processing method provided in this application embodiment is executed by an image processing device, which includes the image sensor of the above embodiments of this application, and the image sensor of this application embodiment includes the pixel structure of any of the above embodiments.

[0093] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described image processing method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0094] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0095] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described image processing method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0096] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0097] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described image processing method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0098] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0099] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0100] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An image sensor, characterized in that, It includes multiple pixel units, wherein the pixel unit includes: The photosensitive layer located below the pixel unit is used to collect light signals and convert them into electrical signals; A filter layer located above the pixel unit includes a filter area and a storage area. The filter area is made of a light-transmitting material and at least partially overlaps with the projection of the photosensitive layer in the optical axis direction. The storage area is made of an opaque material and is used to store three types of electric particles with different colors. The electric particles can move between the storage area and the filter area. The filter area is used to allow light of the same color as the electric particles in the filter area to pass through and enter the lower photosensitive layer. The storage area includes a first sub-storage area, a second sub-storage area, and a third sub-storage area; the first sub-storage area, the second sub-storage area, and the third sub-storage area are distributed around the periphery of the filter area; the first sub-storage area is adjacent to the second sub-storage area and the third sub-storage area by one edge, and the filter area is adjacent to the second sub-storage area and the third sub-storage area by one edge. The image sensor further includes a driving unit for driving the electric particles to move in a clockwise / counterclockwise direction between the second sub-storage area, the first sub-storage area, the third sub-storage area and the filter area, wherein each sub-storage area stores only electric particles of the same color at any given time. The driving unit includes: The first electrode and the second electrode are disposed in the first sub-storage region; The third and fourth electrodes are disposed in the second sub-storage region; The seventh and eighth electrodes are disposed in the third sub-storage region; The fifth and sixth electrodes are disposed in the filter region; The first electrode, the second electrode, the third electrode, the fourth electrode, the fifth electrode, the sixth electrode, the seventh electrode, and the eighth electrode are respectively disposed on the periphery of the corresponding region that is not adjacent to other regions; wherein the first electrode is opposite to the fourth electrode, the second electrode is opposite to the seventh electrode, the third electrode is opposite to the sixth electrode, and the fifth electrode is opposite to the eighth electrode, and the polarities of the opposite electrodes are opposite when energized.

2. The image sensor according to claim 1, characterized in that, The storage area includes a first sub-storage area for storing red electric particles, a second sub-storage area for storing green electric particles, and a third sub-storage area for storing blue electric particles.

3. The image sensor according to claim 1, characterized in that, The area of ​​the filtering region is larger than the area of ​​the storage region.

4. The image sensor according to claim 2, characterized in that, The volumes of the first sub-storage area, the second sub-storage area, the third sub-storage area, and the filter area are the same, each corresponding to the same number and size of electric particles.

5. The image sensor according to any one of claims 1 to 4, characterized in that, The photosensitive layer includes a photosensitive element and a conversion circuit. The photosensitive element is located below the filter area and is used to collect light signals transmitted through the filter area; The conversion circuit is connected to the photosensitive element and is used to convert the light signal collected by the photosensitive element into a corresponding electrical signal. The area of ​​the photosensitive element is greater than or equal to the area of ​​the filter region.

6. A camera module, characterized in that, Including the image sensor as described in any one of claims 1-5.

7. The camera module according to claim 6, characterized in that, The camera module also includes: A circuit board, wherein the image sensor is electrically connected to the circuit board; A lens is disposed on the side of the image sensor away from the circuit board.

8. An electronic device, characterized in that, Includes the camera module as described in claim 6 or 7.

9. An image processing method applied to an image processing apparatus comprising an image sensor as described in any one of claims 1-5, characterized in that, include: When electric particles of the first color are contained in each filter region of the plurality of pixel units, the light signal of the first color transmitted from the corresponding filter region is collected by each photosensitive layer of the plurality of pixel units and converted into an electrical signal of the first color. Drive the first color electric particles from the filter area to the storage area, and control the electric particles with the second color stored in the storage area to move to the filter area; The light signal of the second color transmitted through the corresponding filter area is collected by each photosensitive layer and converted into an electrical signal of the second color. The first color and the second color are different colors.

Images