Image sensor, camera, electronic device, and imaging method
By using a flexible film layer with variable curvature in the image sensor, the driving device is used to change the curvature of the flexible film layer to correct the field curve of the lens, solving the problem of image blur during microscopic shooting and achieving clearer image imaging.
Patent Information
- Application Number
- CN202210666297.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-13
- Publication Date
- 2025-06-17
- Estimated Expiration
- 2042-06-13
AI Technical Summary
The third lens of the existing mobile phone is blurred due to the excessive field curve during microscope shooting.
An image sensor with a flexible film layer with variable curvature is used to change the curvature of the flexible film layer through the driving device to correct the field curve of the lens.
Effectively correct the field curve of the lens during microscope shooting to improve the image imaging clarity.
Smart Images

Figure CN115134495B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of electronic devices, and particularly to an image sensor, a camera, an electronic device, and an imaging method. Background Art
[0002] In the related art, in order to improve the usage frequency of the third lens of a mobile phone, the third lens of some mobile phones can be compatible with dual functions of macro shooting and microscopic shooting. However, the lens design is optimized for the object distance of macro shooting. When the lens is in microscopic shooting, a large field curvature will be generated by the lens, thus bringing about the problem of image blurring. Summary of the Invention
[0003] The present application provides an image sensor, a camera, an electronic device, and an imaging method.
[0004] The image sensor according to the embodiment of the present application includes a pixel array, a light-transmitting flexible film layer, and a driving device. The flexible film layer is stacked with the pixel array; the driving device is disposed on the flexible film layer, and the driving device can change the curvature of the flexible film layer to correct the field curvature of the lens.
[0005] The image sensor according to the embodiment of the present application has a flexible film layer with variable curvature. The image sensor can use the driving device to change the curvature of the flexible film layer, and further can change the curvature of the image sensor; the change in the curvature of the image sensor can correct the field curvature generated by the lens during microscopic shooting, so that the image is clearly imaged.
[0006] The camera according to the embodiment of the present application includes the image sensor and the lens described in the above embodiment, and the lens is used for imaging on the image sensor.
[0007] The camera according to the embodiment of the present application can achieve clear shooting of an object at a microscopic distance through imaging on the image sensor by the lens. The image sensor can correct the field curvature generated by the lens when the distance between the lens and the object distance is at a microscopic distance, so that the image captured by the camera is clearly imaged.
[0008] The electronic device according to the embodiment of the present application includes the camera described in the above embodiment.
[0009] The electronic device according to the embodiment of the present application can achieve microscopic distance shooting and improve the imaging effect of the electronic device under microscopic distance shooting by being provided with a camera.
[0010] The imaging method according to the embodiment of the present application includes:
[0011] Obtain the distance between the image sensor and the lens of the camera. The image sensor includes a pixel array and a light-transmitting flexible film layer, and the flexible film layer is stacked with the pixel array;
[0012] When the distance is greater than a predetermined distance, change the curvature of the flexible film layer to correct the field curvature of the lens.
[0013] The imaging method according to the embodiment of the present application obtains and judges the comparison between the distance between the image sensor and the lens and the predetermined distance, and realizes the change of the curvature of the flexible film layer of the image sensor, so that the field curvature generated by the lens at the microscopic shooting distance of the camera can be corrected, and further the image captured by the camera is clearer.
[0014] The electronic device according to the embodiment of the present application includes a camera and a processor, and the processor is used for the steps of the imaging method described in the above embodiment.
[0015] The electronic device according to the embodiment of the present application can control the camera to improve the imaging effect at different shooting distances by setting a processor capable of implementing the above imaging method.
[0016] Additional aspects and advantages of the present application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present application. Description of the Drawings
[0017] The above and / or additional aspects and advantages of the present application will become apparent and be easily understood from the description of the embodiments in conjunction with the following drawings, wherein:
[0018] Figure 1 is a plan view of an image sensor according to an embodiment of the present application;
[0019] Figure 2 is a plan view of the flexible film layer of the image sensor according to the embodiment of the present application when it is bent;
[0020] Figure 3 is a schematic diagram of the image sensor according to the embodiment of the present application receiving light when the distance between the lens and the object is a microscopic distance;
[0021] Figure 4 is a schematic diagram of a part of the structure of the image sensor according to the embodiment of the present application;
[0022] Figure 5 is a schematic diagram of another part of the structure of the image sensor according to the embodiment of the present application;
[0023] Figure 6 is a plan view of the filter array according to the embodiment of the present application;
[0024] Figure 7 is a plan view of the camera according to the embodiment of the present application when shooting at a macro distance;
[0025] Figure 8 It is a schematic plan view of the camera in the present application embodiment for taking pictures at a microscopic distance;
[0026] Figure 9 It is a schematic structural view of the electronic device in the present application embodiment;
[0027] Figure 10 It is a schematic flow chart of the imaging method in the present application embodiment;
[0028] Figure 11 It is a schematic flow chart of the imaging method in the present application embodiment.
[0029] Description of main element symbols:
[0030] Electronic device 1000;
[0031] Camera 100;
[0032] Image sensor 10, pixel array 11, flexible film layer 12, microlens array 121, driving device 13, piezoelectric device 131, support layer 14, filter array 141, red filter 1411, green filter 1412, blue filter 1413, flexible connector 15, lens 20, light ray 30;
[0033] Processor 200;
[0034] Object 2000. Detailed implementation manners
[0035] The following describes in detail the implementation manners of the present application. Examples of the implementation manners are shown in the drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The implementation manners described below with reference to the drawings are exemplary only for explaining the present application and should not be construed as limiting the present application.
[0036] The following disclosure provides many different implementation manners or examples for implementing different structures of the present application. To simplify the disclosure of the present application, components and settings of specific examples are described below. Of course, they are only examples and are not intended to limit the present application. In addition, the present application may repeat reference numerals and / or reference letters in different examples. Such repetition is for the purpose of simplification and clarity and does not itself indicate the relationship between the various implementation manners and / or settings discussed. In addition, the present application provides examples of various specific processes and materials, but those of ordinary skill in the art may be aware of the application of other processes and / or the use of other materials.
[0037] Please refer to Figure 1 and Figure 2, the image sensor 10 according to the embodiment of the present application includes a pixel array 11, a light-transmitting flexible film layer 12, and a driving device 13. The flexible film layer 12 is stacked with the pixel array 11; the driving device 13 is disposed on the flexible film layer 12, and the driving device 13 can change the curvature of the flexible film layer 12 to correct the field curvature of the lens 20.
[0038] The image sensor 10 according to the embodiment of the present application has a flexible film layer 12 with variable curvature. The image sensor 10 can use the driving device 13 to change the curvature of the flexible film layer 12, and then the curvature of the image sensor 10 can be changed; the change in the curvature of the image sensor 10 can correct the field curvature generated by the lens 20 during micro photography, making the image clear.
[0039] Specifically, the image sensor 10 can be a photosensitive element applied in electronic devices with a photographing function such as mobile phones and digital cameras. The image sensor 10 can convert optical signals into electrical signals. The pixel array 11 can be an area in the image sensor 10 for photosensing and photoelectric conversion. The pixel array 11 can be stacked with the flexible film layer 12 up and down, and the pixel array 11 can be located below the flexible film layer 12. The flexible film layer 12 can be a flexible thin film layer, which can be made of materials such as glass. The thickness of the flexible film layer 12 can be about 5 micrometers.
[0040] The driving device 13 can be a device that drives the flexible film layer 12 to bend and thus changes the curvature of the flexible film layer 12 by means of its own deformation. The driving device 13 can be disposed on the flexible film layer 12. For example, it can be disposed on the surface of the flexible film layer 12 facing away from the pixel array 11.
[0041] It can be further illustrated by Figure 3 When the distance between the lens 20 and the object 2000 plane is the micro distance. For example, when the object distance is 5 mm, the light 30 emitted by the object 2000 passes through the lens 20 and is focused on the image sensor 10. Due to the field curvature generated by the lens 20, part of the light 30 passes through the lens 20 and is focused behind the image sensor 10 where the flexible film layer 12 is not bent, making the image blurred. At this time, the driving device 13 can drive the flexible film layer 12 to bend, thereby changing the curvature of the image sensor 10. After the curvature of the image sensor 10 changes, the light 30 emitted by the object 2000 can be fully focused on the image sensor 10, solving the problem of image blurring and making the image clear.
[0042] Please refer to Figure 1 and Figure 2 , in some embodiments, the driving device 13 includes a piezoelectric device 131. When a voltage is applied to the piezoelectric device 131, the piezoelectric device 131 deforms to drive the flexible film layer 12 to deform.
[0043] In this way, by applying a voltage, the deformation of the piezoelectric device 131 can be controlled relatively quickly, the deformation speed of the flexible film layer 12 can be increased, and thus the correction speed of the field curvature generated by the lens 20 by the image sensor 10 can be increased.
[0044] Specifically, the piezoelectric device 131 can be a piezoelectric actuator. For example, the piezoelectric device 131 can be a piezoelectric thin film, and its own deformation can be achieved through thin-film piezoelectric technology. Exemplarily, when a voltage of 0V is applied to the piezoelectric device 131, the piezoelectric device 131 itself does not change, and the flexible film layer 12 does not deform (as Figure 1 shown); when a voltage of 40V is applied to the piezoelectric device 131, the piezoelectric device 131 itself deforms. When the piezoelectric device 131 deforms, it drives the flexible film layer 12 to deform. Thus, the flexible film layer 12 can be deformed. The deformation of the flexible film layer 12 can be that the middle area of the flexible film layer 12 bulges compared with the undeformed state (as Figure 2 shown).
[0045] Please refer to Figure 1 and Figure 2 , in some embodiments, the piezoelectric device 131 is disposed at the edge position of the flexible film layer 12.
[0046] In this way, the piezoelectric device 131 disposed at the edge of the flexible film layer 12 does not block the light transmittance at the middle position of the flexible film layer 12, so that the amount of light passing through the flexible film layer 12 and contacting the pixel array 11 is normal.
[0047] Specifically, the piezoelectric device 131 can be disposed on the outer edge side of the flexible film layer 12, and the piezoelectric device 131 can be connected to the flexible film layer 12 around the outer edge position of the flexible film layer 12.
[0048] Please refer to Figure 4 , in some embodiments, a microlens array 121 is formed on the flexible film layer 12, and the microlens array 121 is used to condense light onto the pixel array 11.
[0049] In this way, the microlens array 121 is disposed on the flexible film layer 12 to condense light onto the pixel array 11, which can increase the fill factor of the pixel array 11, thereby improving the imaging effect of the image sensor 10.
[0050] Specifically, the microlens array 121 includes a plurality of sub-lenses. The plurality of sub-lenses can be arranged in an array, and the diameters of the plurality of sub-lenses can be nanoscale or millimeter-scale. The microlens array 121 can achieve parallel refractive focusing through the sub-lenses.
[0051] Please refer to Figure 4, in some embodiments, the microlens array 121 is formed on the surface of the flexible film layer 12 facing away from the pixel array 11. Thus, the arrangement of the microlens array 121 can make the optical path direction after focusing face the pixel array 11 for irradiation.
[0052] Specifically, the microlens array 121 can be arranged on one side of the flexible film layer 12 facing away from the pixel array 11, and the convex surface of the sub-lenses on the microlens array 121 can bulge upward away from the flexible film layer 12, so that the microlens array 121 has a light-gathering effect.
[0053] Please refer to Figure 1 and Figure 2 , in some embodiments, the image sensor 10 further includes a support layer 14 and a flexible connector 15. The support layer 14 is arranged on the pixel array 11, and the flexible connector 15 connects the flexible film layer 12 and the support layer 14. The flexible connector 15 deforms as the flexible film layer 12 deforms.
[0054] Thus, the support layer 14 can support the flexible connector 15, and the corresponding deformation of the flexible connector 15 following the deformation of the flexible film layer 12 can realize the corresponding change in the focusing position of the light, so that the image sensor 10 has an automatic focusing ability.
[0055] Specifically, the support layer 14 can be arranged above the pixel array 11. The support layer 14 can be a structural layer made of glass material with a supporting function. One end of the flexible connector 15 can be connected to the support layer 14, and the end facing away from the connection with the support layer 14 can be connected to the flexible film layer 12. The flexible connector 15 can be a polymer formed by a polymer structure and can deform itself as the flexible film layer 12 deforms.
[0056] Please refer to Figure 5 and Figure 6 , in some embodiments, the support layer 14 is formed with a filter array 141. The filter array 141 includes a red filter 1411, a green filter 1412, and a blue filter 1413.
[0057] Thus, the filter array 141 formed on the support layer 14 can filter the color of the light entering the pixel array 11. Since the pixel array 11 cannot distinguish the color of the light, setting the filter array 141 can help the pixel array 11 distinguish the color of the light.
[0058] Specifically, the filter array 141 can be understood as an array for filtering the wavelengths of light of different colors. The filter array 141 can perform channel filtering on the light entering the pixel array 11. It can be understood that the filter array 141 is equivalent to modulating the incident signal, and the commonly used modulation mode is the Bayer array. The filter array 141 may include a red filter 1411, a green filter 1412, and a blue filter 1413. As Figure 6 shown, when the filter array 141 adopts the Bayer array, it consists of three channels: R, G, and B. R can represent the red filter 1411, G can represent the green filter 1412, and B can represent the blue filter 1413. The densities of the three channels of R, G, and B can be 1 / 4, 1 / 2, and 1 / 4 respectively; after the light is modulated by the filter array 141, it can be incident on the pixel array 11 for photoelectric conversion and analog-to-digital conversion.
[0059] Please refer to Figure 7 and Figure 8 , the camera 100 of the embodiment of the present application includes the image sensor 10 and the lens 20 of the above embodiment, and the lens 20 is used to form an image on the image sensor 10.
[0060] The camera 100 of the embodiment of the present application can achieve clear shooting of an object 2000 at a microscopic distance by forming an image on the image sensor 10 through the lens 20. The image sensor 10 can correct the field curvature generated by the lens 20 when the lens 20 and the object distance are at a microscopic distance, so that the image captured by the camera 100 is clearly imaged.
[0061] Specifically, the camera 100 can be a camera 100 with multiple shooting functions such as macro and microscopic shooting. The lens 20 can be an optical element composed of glass lenses. The lens 20 can be disposed above the image sensor 10, and the lens 20 can collect the scene image to be captured by the camera 100 and transmit it to the image sensor 10 for imaging.
[0062] Please refer to Figure 7 and Figure 8 , in some embodiments, the lens 20 can move along the optical axis of the lens 20 relative to the image sensor 10 to change the shooting mode of the camera 100.
[0063] In this way, by moving the lens 20 relative to the image sensor 10, the adjustment of the shooting mode of the camera 100 at different object distances can be realized. Therefore, after adjustment, the camera 100 can improve the shooting effect in different modes.
[0064] Specifically, the lens 20 is disposed above the image sensor 10, and the lens 20 can be directly opposite to the image sensor 10. The lens 20 can be connected with a power device such as a motor, and the power device can be used to drive the lens 20 to move along the optical axis direction. The optical axis direction can be the central axis direction of the lens 20 for receiving light.
[0065] Exemplarily, as Figure 7 shown, the distance from the object 2000 to be photographed to the upper surface of the lens 20 is L1, and L1 can be a macro distance. For example, when the distance L1 between the lens 20 and the object 2000 to be photographed is 30 mm, it can be regarded as a macro distance. As Figure 8 shown, when the camera 100 needs to switch the shooting mode to the microscopic mode or the distance L2 from the object 2000 to be photographed to the upper surface of the lens 20 is less than the macro distance L1, for example, when the distance L2 between the lens 20 and the object 2000 to be photographed is a microscopic distance of 5 mm, the lens 20 can move in the direction away from the image sensor 10 along the optical axis relative to the image sensor 10 under the drive of the motor. For example, the moving distance of the lens 20 can be 840 microns. And at this time, the field curvature of the outer field of view of the lens 20 is relatively large, and the field curvature of the edge field of view can be close to 30 μm.
[0066] Please refer to Figure 3 , the image sensor 10 will correspondingly change the curvature so that the image obtained by the lens 20 forms a clear image on the image sensor 10.
[0067] Please refer to Figure 9 , the electronic device 1000 of the embodiment of the present application includes the camera 100 of the above embodiment.
[0068] The electronic device 1000 of the embodiment of the present application can achieve microscopic distance shooting and improve the imaging effect of the electronic device 100 under microscopic distance shooting by being provided with the camera 100.
[0069] Specifically, the electronic device 1000 can be a terminal device with a photographing function. For example, the electronic device 1000 can include a smart phone, a tablet, a computer, a digital camera or other terminal devices with a photographing function. The camera 100 can be disposed on the electronic device 1000 to implement the photographing function of the electronic device 1000. For example, the rear camera of a mobile phone, the camera of a digital camera, etc.
[0070] Please refer to Figure 10 and combine with Figure 7 and Figure 8 , the imaging method of the embodiment of the present application includes:
[0071] S10: Obtain the distance between the image sensor 10 and the lens 20 of the camera 100. The image sensor 10 includes a pixel array 11 and a light-transmitting flexible film layer 12, and the flexible film layer 12 is stacked with the pixel array 11;
[0072] S20: When the distance is greater than a predetermined distance, change the curvature of the flexible film layer 12 to correct the field curvature of the lens 20.
[0073] The imaging method according to the embodiment of the present application obtains and judges the comparison between the distance between the image sensor 10 and the lens 20 and the predetermined distance, realizes the change of the curvature of the flexible film layer 12 of the image sensor 10, so that the field curvature generated by the lens 20 of the camera 100 at the microscopic shooting distance can be corrected, and further makes the image captured by the camera 100 clearer.
[0074] Specifically, to implement the imaging method, step S10 can be taken first. Through the cooperation of software and hardware in the camera 100, the distance between the image sensor 10 and the lens 20 can be obtained. Then, step S20 can be adopted. Since the predetermined distance value can be preset in the software design, it can be judged that the camera 100 is in the microscopic shooting scenario by judging that the distance is greater than the predetermined distance. Therefore, after judging that the distance is greater than the predetermined distance, the flexible film layer 12 in the image sensor 10 can be driven by the driving device 13 to change the curvature, so that the field curvature of the lens 20 at the microscopic shooting distance can be corrected.
[0075] Please refer to Figure 11 and combine with Figure 7 and Figure 8 , in some embodiments, obtaining the distance between the image sensor 10 and the lens 20 of the camera 100 (step S10) includes:
[0076] S11: Read the working value of the motor, and the motor is used to drive the lens 20 to move along the optical axis of the lens 20;
[0077] S12: Based on the positional relationship between the working value and the position of the lens 20, confirm the distance according to the working value.
[0078] In this way, the imaging method can analyze and obtain the distance data between the image sensor 10 and the lens 20 by using the relationship formed by the motor driving the lens 20.
[0079] Specifically, to implement step S10 of the imaging method, step S11 can be taken first to read the working value of the motor. It can be understood that the motor is used to drive the lens 20 to move along the optical axis of the lens 20. For the convenience of obtaining the value, by finding the actual corresponding relationship between the focusing distance of the lens 20 corresponding to the moving process of the motor and the working value, and then the corresponding relationship can be pre-burned in the read-only memory of the module during the design process of the camera 100 module. Therefore, the working value can be directly read during the moving process of the motor.
[0080] Then, step S12 can be taken. Different working values can correspond to different distances between the lens 20 and the image sensor 10. Therefore, based on the working value, the distance between the lens 20 and the image sensor 10 can be obtained accordingly.
[0081] In summary, the implementation process of the imaging method can be specifically described by the following example:
[0082] When the lens 20 is in the macro shooting state with respect to the object 2000, the working value can be 100. When the lens 20 is in the microscopic state with respect to the object 2000, the working value can be 900. The data of both can be burned into the read-only memory of the module during the production of the camera 100. The predetermined value can be the value when the camera 100 is close to the microscopic state. For example, the predetermined value is 800. During the process of the motor driving the lens 20 to move for focusing, the change of the working value can be read in real time. When the working value is greater than the predetermined value, the curvature of the flexible film layer 12 can be changed to correct the field curvature of the lens 20, and then clear imaging of the camera 100 can be achieved.
[0083] Please refer to Figure 9 , the electronic device 1000 of the embodiment of the present application includes a camera 100 and a processor 200. The processor 200 is used for the steps of the imaging method of the above embodiment.
[0084] The electronic device 1000 of the embodiment of the present application can improve the imaging effect at different shooting distances by setting a processor 200 capable of implementing the above imaging method to control the camera 100.
[0085] Specifically, the processor 200 can be arranged inside the electronic device 1000. The processor 200 can be connected to the module inside the camera 100. The processor 200 can be used to control the camera 100 to cooperate with the electronic device 1000 to realize functions such as switching different shooting distances and adjusting the imaging effect.
[0086] The processor 200 can be a central processing unit (CPU), or can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
[0087] In the description of this specification, the descriptions with reference to the terms "one embodiment", "certain embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiments or examples. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples.
[0088] Although the embodiments of the present application have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present application, and the scope of the present application is defined by the claims and their equivalents.
Claims
1. An image sensor, characterized in that, Comprising: A pixel array; A light-transmitting flexible film layer, the flexible film layer being stacked with the pixel array. The image sensor further includes a support layer and a flexible connector. The support layer is disposed on the pixel array, and the flexible connector connects the flexible film layer and the support layer. The flexible connector deforms as the flexible film layer deforms; A driving device, the driving device being disposed on the flexible film layer. The driving device is capable of changing the curvature of the flexible film layer to correct the field curvature of the lens.
2. The image sensor according to claim 1, characterized in that, The driving device includes a piezoelectric device. When a voltage is applied to the piezoelectric device, the piezoelectric device deforms to drive the flexible film layer to deform.
3. The image sensor according to claim 2, characterized in that, The piezoelectric device is disposed at an edge position of the flexible film layer.
4. The image sensor according to claim 1, characterized in that, A microlens array is formed on the flexible film layer, and the microlens array is used for condensing light toward the pixel array.
5. The image sensor according to claim 4, characterized in that, The microlens array is formed on a surface of the flexible film layer facing away from the pixel array.
6. The image sensor according to claim 1, characterized in that, The support layer is formed with a filter array, and the filter array includes a red filter, a green filter, and a blue filter.
7. A camera, characterized in that, Comprising: The image sensor according to any one of claims 1-6; A lens, the lens being used for imaging on the image sensor.
8. The camera according to claim 7, characterized in that, The lens is capable of moving along the optical axis of the lens relative to the image sensor to change the shooting mode of the camera.
9. An electronic device, characterized in that, Including the camera according to claim 7 or 8.
10. An imaging method for a camera, characterized in that, The imaging method includes: Obtaining a distance between the image sensor and the lens of the camera. The image sensor includes a pixel array and a light-transmitting flexible film layer, the flexible film layer being stacked with the pixel array. The image sensor further includes a support layer and a flexible connector. The support layer is disposed on the pixel array, and the flexible connector connects the flexible film layer and the support layer. The flexible connector deforms as the flexible film layer deforms; When the distance is greater than a predetermined distance, changing the curvature of the flexible film layer to correct the field curvature of the lens.
11. The imaging method according to claim 10, characterized in that, The obtaining the distance between the image sensor and the lens of the camera includes: Reading an operating value of a motor, the motor being used for driving the lens to move along the optical axis of the lens; Based on the relationship between the operating value and the position of the lens, confirming the distance according to the operating value.
12. An electronic device, characterized in that, The electronic device includes a camera and a processor, and the processor is used for implementing the steps of the imaging method according to claim 10 or 11.
Citation Information
Patent Citations
Optical method capable of achieving normal imaging and microscopic and telescopic function
CN102087413A
Camera module with liquid lens and image surface correction method thereof
CN111323902A
Depth image imaging system and method
CN111866387A
Camera module and electronic equipment
CN214675328U