Image sensor, camera, camera module, equipment and image processing method
By setting the pixel unit sizes in different directions in the image sensor to optimize the shape of the image sensor and lens, the problem of increasing the size of the camera module is solved, the camera module volume reduction and cost reduction are achieved, and the shooting effect of electronic devices is improved.
Patent Information
- Application Number
- CN202410131032.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-30
- Publication Date
- 2025-08-01
AI Technical Summary
As the number of cameras increases, the size of the camera module increases, affecting the shooting effect of electronic devices with space-constrained.
By setting the pixel units in different directions in the image sensor to reduce the volume of the image sensor and the camera, and adopting non-square pixel units and lens shapes, the size ratio of the image sensor and lens are optimized.
It reduces the size and cost of the camera module, reduces the space limitations on electronic devices, and improves the shooting effect.
Smart Images

Figure CN120416634A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field of image acquisition, and particularly to an image sensor, a camera, a camera module, a device, and an image processing method. Background Art
[0002] Currently, with the improvement of users' shooting requirements, a plurality of cameras with different functions are provided in a camera module to make the captured images clearer in different environments. However, with the increase in the number of cameras, the volume of the camera module gradually increases, which affects the shooting effect in electronic devices with limited space. Summary of the Invention
[0003] To overcome the problems existing in the related art, the present disclosure provides an image sensor, a camera, a camera module, a device, and an image processing method.
[0004] According to a first aspect of an embodiment of the present disclosure, an image sensor is provided, and the image sensor includes:
[0005] A pixel array, the pixel array including a plurality of pixel units arranged in an array along a first direction and a second direction, and a first dimension of each pixel unit in the first direction being different from a second dimension in the second direction.
[0006] In some embodiments of the present disclosure, the shape of the pixel unit is rectangular, elliptical, or kidney-shaped.
[0007] In some embodiments of the present disclosure, the shape of the image sensor is rectangular; the length of the image sensor is in the first direction, and the width of the image sensor is in the second direction.
[0008] In some embodiments of the present disclosure, a ratio of the first dimension to the second dimension is a first preset value; a ratio of a third dimension of the image sensor in the first direction to a fourth dimension in the second direction is a second preset value;
[0009] wherein, a ratio of the second preset value to the first preset value is 4:3.
[0010] In some embodiments of the present disclosure, the first preset value is 2:1; the second preset value is 4:1.5.
[0011] In some embodiments of the present disclosure, the image sensor further includes:
[0012] A filter, along a light-receiving direction of the image sensor, the filter and the pixel array are sequentially arranged.
[0013] According to a second aspect of the embodiments of the present disclosure, a camera is provided. The camera includes a lens and the image sensor as described above. Along the light-receiving direction of the image sensor, the lens and the image sensor are arranged in sequence.
[0014] In some embodiments of the present disclosure, a fifth dimension of the lens in the first direction is different from a sixth dimension in the second direction.
[0015] In some embodiments of the present disclosure, the shape of the lens is rectangular, oval, or kidney-shaped.
[0016] According to a third aspect of the embodiments of the present disclosure, a camera module is provided. The camera module includes the camera as described above.
[0017] In some embodiments of the present disclosure, the number of the cameras is multiple;
[0018] For each of the cameras, the first dimension of each pixel unit of the image sensor is greater than the second dimension; or,
[0019] For some of the cameras, the first dimension of each pixel unit of the image sensor is greater than the second dimension, and for the other part of the cameras, the first dimension of each pixel unit of the image sensor is less than the second dimension.
[0020] In some embodiments of the present disclosure, for each of the cameras, the fifth dimension of the lens is greater than the sixth dimension; or,
[0021] For some of the cameras, the fifth dimension of the lens is greater than the sixth dimension, and for the other part of the cameras, the fifth dimension of the lens is less than the sixth dimension.
[0022] According to a fourth aspect of the embodiments of the present disclosure, an electronic device is provided. The electronic device includes the camera module as described above.
[0023] According to a fifth aspect of the embodiments of the present disclosure, an image processing method is provided for the electronic device as described above. The image processing method includes:
[0024] Obtaining a raw image collected by the image sensor;
[0025] Processing the raw image to obtain a target image.
[0026] In some embodiments of the present disclosure, the processing the raw image to obtain a target image includes:
[0027] Determining the pixel value of each pixel unit in the raw image;
[0028] Generate a target image based on the pixel values of the pixel units, where the pixel value of each pixel point in the target image is the pixel value of the corresponding pixel unit;
[0029] Among them, the shape of each pixel point is a square, and each pixel unit in the image sensor corresponds one-to-one with each pixel point in the target image.
[0030] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects:
[0031] The image sensor in the camera module includes a pixel array, and the pixel array includes a plurality of pixel units arranged in an array. The sizes of each pixel unit in the first direction and the second direction are different. Since the sizes of each pixel unit in the first direction and the second direction are different, when the size of the pixel unit in one direction decreases, the size of the image sensor including each pixel unit decreases in that direction. Since the size of the image sensor decreases, the volume of the camera including the image sensor decreases, thereby reducing the volume and cost of the camera module. At the same time, since the volume of the camera module decreases, the space limitation on the electronic device is reduced, thereby improving the shooting effect of the electronic device.
[0032] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] The drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.
[0034] Figure 1 is a schematic structural diagram of an image sensor;
[0035] Figure 2-1 is a schematic structural diagram of an image sensor shown according to an exemplary embodiment;
[0036] Figure 2-2 is a schematic structural diagram of an image sensor shown according to another exemplary embodiment;
[0037] Figure 3 is a schematic structural diagram of an image sensor shown according to another exemplary embodiment;
[0038] Figure 4 is a schematic structural diagram of a camera shown according to an exemplary embodiment;
[0039] Figure 5-1 is a schematic structural diagram of a lens shown according to an exemplary embodiment;
[0040] Figure 5-2 is a schematic structural diagram of a lens shown according to another exemplary embodiment;
[0041] Figure 5-3 is a schematic structural diagram of a lens shown according to another exemplary embodiment;
[0042] Figure 6 is a schematic flowchart of an image processing method shown according to an exemplary embodiment;
[0043] Figure 7 is a schematic flowchart of an image processing method shown according to another exemplary embodiment;
[0044] Figure 8-1 is a schematic diagram of an original image shown according to an exemplary embodiment;
[0045] Figure 8-2 is a schematic diagram of a target image shown according to an exemplary embodiment;
[0046] Figure 9 is a block diagram of an electronic device shown according to an exemplary embodiment.
[0047] In the figure:
[0048] 1 - image sensor; 2 - lens; 10 - pixel array; 11 - pixel unit; 20 - filter; 400 - electronic device; 402 - processing component; 404 - memory; 406 - power supply component; 408 - multimedia component; 410 - audio component; 412 - input / output interface; 414 - sensor component; 416 - communication component; 420 - processor. Detailed Description of the Invention
[0049] Here, exemplary embodiments will be described in detail, and examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more of the associated listed items.
[0050] Currently, with the development of shooting technology and the improvement of users' shooting requirements, a plurality of cameras with different functions are provided in the camera module to make the captured images clearer in different environments. For example, the camera module may include a main camera, a telephoto lens, a wide-angle lens, a macro lens, and / or a depth-of-field lens, etc. The camera includes a lens and an image sensor. As Figure 1As shown, the image sensor 1 includes a plurality of pixel units 11 arranged in an array in the first direction and the second direction. Each pixel unit 11 has the same size in the first direction and the second direction. That is, the shape of each pixel unit 11 is square. The aspect ratio of the image sensor 1 is 4:3, and the shape of the lens is circular. However, as the number of cameras increases, the volume of the camera module gradually increases, which affects the shooting effect in electronic devices with limited space.
[0051] To solve the above technical problems, the present disclosure provides an image sensor. By setting the sizes of the pixel units in the image sensor in the first direction and the second direction to be different (the shapes of the pixel units are non-square), while the number of pixel units remains unchanged, the size of the image sensor in the first direction or the second direction is reduced (the aspect ratio of the image sensor is not 4:3). Since the size of the image sensor is reduced, the volume of the camera including the image sensor is reduced, thereby reducing the volume and cost of the camera module. At the same time, since the volume of the camera module is reduced, the occupancy of the space of the electronic device is reduced, thereby improving the shooting effect of the electronic device.
[0052] An embodiment of the present disclosure provides an image sensor, as Figure 2-1 and Figure 2-2 shown, the image sensor 1 includes a pixel array 10. The pixel array 10 includes a plurality of pixel units 11 arranged in an array in the first direction and the second direction. The first size of each pixel unit 11 in the first direction is different from the second size in the second direction.
[0053] In this embodiment, the image sensor in the camera module includes a pixel array. The pixel array includes a plurality of pixel units arranged in an array. The sizes of each pixel unit in the first direction and the second direction are different. Since the sizes of each pixel unit in the first direction and the second direction are different, the size of the pixel unit in one direction is reduced, and the size of the image sensor including each pixel unit in this direction is reduced. Since the size of the image sensor is reduced, the volume of the camera including the image sensor is reduced, thereby reducing the volume and cost of the camera module. At the same time, since the volume of the camera module is reduced, the space limitation on the electronic device is reduced, thereby improving the shooting effect of the electronic device.
[0054] Exemplarily, as Figure 2-1 shown, when the first size of each pixel unit 11 is greater than the second size, the third size of the image sensor 1 in the first direction is greater than the fourth size in the second direction. Compared with the image sensor in Figure 1 , the second size of the pixel unit 11 in the second direction is reduced, and the fourth size of the image sensor 1 in the second direction is reduced. As Figure 2-2As shown, when the first dimension of each pixel unit 11 is smaller than the second dimension, the third dimension of the image sensor 1 in the first direction may be greater than the fourth dimension in the second direction, may be smaller than the fourth dimension in the second direction, or may be equal to the fourth dimension in the second direction. Compared with the image sensor in Figure 1 the first dimension of the pixel unit 11 in the first direction is reduced, and the third dimension of the image sensor 1 in the first direction is reduced.
[0055] In one embodiment, the shape of the pixel unit 11 is rectangular.
[0056] In this embodiment, by setting the shape of the pixel unit to be rectangular, the size of the image sensor can be reduced only by changing the length or width of the rectangle, thereby reducing the complexity of the structure of the image sensor. Moreover, since the shape of the pixel unit is rectangular, each pixel unit is evenly illuminated and can receive light to the greatest extent, thereby improving the imaging quality of the image sensor.
[0057] It can be understood that the shape of the pixel unit 11 can be a polygon including a rectangle, or can also be a polygon including a trapezoid, a triangle, etc.
[0058] In one embodiment, the shape of the pixel unit 11 is oval.
[0059] In this embodiment, by setting the shape of the pixel unit to be oval, the space occupied by the pixel unit is reduced, thereby reducing the cost of the image sensor. Moreover, since the shape of the pixel unit is oval, each pixel unit is evenly illuminated, thereby improving the imaging quality of the image sensor.
[0060] In one embodiment, the shape of the pixel unit 11 is kidney-shaped.
[0061] In this embodiment, by setting the shape of the pixel unit to be kidney-shaped, the space occupied by the pixel unit is reduced, thereby reducing the cost of the image sensor. Moreover, since the shape of the pixel unit is kidney-shaped, each pixel unit is evenly illuminated, thereby improving the imaging quality of the image sensor.
[0062] Exemplarily, when the shape of the pixel unit 11 is oval or kidney-shaped, the first dimension and the second dimension can be the major axis length and the minor axis length of the pixel unit 11.
[0063] It can be understood that the shape of the pixel unit 11 can be a conic section including an oval and a kidney-shaped, or can also be other closed conic sections.
[0064] Exemplarily, the shape of the pixel unit 11 refers to the shape of the pixel unit 11 in a plane perpendicular to the thickness direction of the pixel unit 11.
[0065] In one embodiment, the shape of the image sensor 1 is rectangular. The length of the image sensor 1 is in the first direction, and the width is in the second direction.
[0066] In this embodiment, since the directions in which the length and width of the image sensor are located are the directions in which the pixel units are arranged, the number of pixel units is the largest when the size of the image sensor is fixed, thereby improving the imaging quality of the image sensor.
[0067] Exemplarily, the shape of the image sensor 1 refers to the shape of the image sensor 1 in the plane perpendicular to the thickness direction of the image sensor 1.
[0068] In one embodiment, the ratio of the first dimension to the second dimension is a first preset value. The ratio of the third dimension of the image sensor 1 in the first direction to the fourth dimension in the second direction is a second preset value. Among them, the ratio of the second preset value to the first preset value is 4:3.
[0069] In this embodiment, the ratio of the first dimension to the second dimension is a first preset value, and the size of the pixel unit in the second direction or the first direction is reduced in proportion to the first preset value. Since the aspect ratio of the image sensor is 4:3 when the pixel unit is square, after the size of the pixel unit in one direction is reduced in proportion to the first preset value, the size of the image sensor in that direction is reduced in the same proportion. That is, the ratio of the second preset value to the first preset value is 4:3. By reducing the sizes of the image sensor and the pixel unit in the same direction in the same proportion, the number of pixel units can remain unchanged, thereby improving the imaging quality of the image sensor.
[0070] Exemplarily, the first preset value is greater than 1, and the second preset value is greater than 4:3.
[0071] In one embodiment, the first preset value is 2:1, and the second preset value is 4:1.5.
[0072] In this embodiment, by setting the first preset value to 2:1 and the second preset value to 4:1.5, the width of the image sensor is reduced by half while keeping the number of pixel units unchanged, thereby reducing the size of the image sensor and improving the imaging quality of the image sensor. At the same time, since the width of the image sensor is reduced by half, it is convenient to adjust the original image collected by the image sensor, thereby reducing the complexity of image processing.
[0073] Exemplarily, the first preset value is less than 1, and the second preset value is less than 4:3.
[0074] In one embodiment, the first preset value is 1:2, and the second preset value is 2:3.
[0075] In this embodiment, by setting the first preset value to 1:2 and the second preset value to 2:3, while keeping the number of pixel units unchanged, the length of the image sensor is reduced by half, thereby reducing the size of the image sensor and improving the imaging quality of the image sensor. At the same time, since the length of the image sensor is reduced by half, it is convenient to adjust the original image collected by the image sensor, thereby reducing the complexity of image processing.
[0076] In one embodiment, as Figure 3 shown, the image sensor 1 further includes a filter 20. Along the light-receiving direction of the image sensor 1, the filter 20 and the pixel array 10 are arranged in sequence.
[0077] In this embodiment, by disposing the filter on the pixel array, light is transmitted to the pixel array through the filter so that each pixel unit corresponds to one color to filter out other colors, thereby improving the imaging quality of the image sensor.
[0078] Exemplarily, under the action of the filter 20, some pixel units 11 have the same color and some pixel units 11 have different colors.
[0079] An embodiment of the present disclosure provides a camera, as Figure 4 shown, the camera includes a lens 2 and the image sensor 1 as described above. Along the light-receiving direction of the image sensor 1, the lens 2 and the image sensor 1 are arranged in sequence.
[0080] In this embodiment, by disposing the lens and the image sensor at intervals, light is transmitted to the image sensor through the lens to converge the light on the image sensor, thereby improving the imaging quality of the image sensor.
[0081] In one embodiment, the fifth dimension of the lens 2 in the first direction is different from the sixth dimension in the second direction.
[0082] In this embodiment, since the size of the image sensor in the first direction or the second direction is reduced, the size of the lens can be reduced as the size of the image sensor is reduced without affecting the imaging quality of the image sensor, thereby reducing the volume of the camera.
[0083] In one embodiment, as Figure 5-1 shown, the shape of the lens 2 is rectangular.
[0084] In this embodiment, by setting the shape of the lens to be rectangular, the shape of the lens is the same as the shape of the image sensor and can converge light onto the image sensor without affecting the imaging quality of the image sensor, thereby reducing the volume of the camera.
[0085] It can be understood that the shape of the lens 2 can be a polygon including a rectangle, or can also be a polygon including a trapezoid, a triangle, etc.
[0086] In one embodiment, as Figure 5-2 shown, the shape of the lens 2 is oval.
[0087] In this embodiment, by setting the shape of the lens to be oval, the size of the lens can be reduced only by changing the fifth dimension or the sixth dimension of the lens, thereby reducing the complexity of the lens structure. Moreover, since the size of the oval lens is small, the cost of the lens is reduced without affecting the imaging quality of the image sensor.
[0088] In one embodiment, as Figure 5-3 shown, the shape of the lens 2 is kidney-shaped.
[0089] In this embodiment, by setting the shape of the lens to be kidney-shaped, the size of the lens can be reduced only by changing the fifth dimension or the sixth dimension of the lens, thereby reducing the complexity of the lens structure. Moreover, since the size of the kidney-shaped lens is small, the cost of the lens is reduced without affecting the imaging quality of the image sensor.
[0090] It can be understood that the shape of the lens 2 can be other closed conic curves in addition to conic curves including oval and kidney-shaped. Figures 5-1 to 5-3 is the shape of the projection of the lens 2 onto the plane where the image sensor 1 is located.
[0091] Exemplarily, the shape of the lens 2 refers to the shape of the lens 2 in a plane perpendicular to the thickness direction of the lens 2.
[0092] Exemplarily, since the shape of the lens 2 is non-circular, compared with the image sensor 1 with a circular lens 2 and the pixel unit 11 having a square shape, the volume of the camera can be significantly reduced.
[0093] The embodiments of the present disclosure provide a camera module, and the camera module includes the camera as described above.
[0094] In this embodiment, since the volume of the camera is reduced due to the reduction of the image sensor size, and the camera module includes one or more cameras with reduced volume, the volume and cost of the camera module are reduced. At the same time, since the volume of the camera module is reduced, the space limitation on the electronic device is reduced, thereby improving the shooting effect of the electronic device.
[0095] In one embodiment, the number of cameras is multiple. The first dimension of each pixel unit 11 of the image sensor 1 in each camera is greater than the second dimension.
[0096] In this embodiment, since the first size of each pixel unit of the image sensor in each camera is greater than the second size, the size of the camera module in the second direction is reduced without changing the arrangement of the cameras, thereby reducing the volume of the camera module.
[0097] In one embodiment, the fifth size of the lens 2 in each camera is greater than the sixth size.
[0098] In this embodiment, since the first size of each pixel unit of the image sensor in each camera is greater than the second size, and the fifth size of the lens that cooperates with each image sensor is greater than the sixth size so that light can reliably irradiate the image sensor and the size of the lens is reduced, the volume of the camera module is reduced and the imaging quality of the camera module is improved.
[0099] In one embodiment, the number of cameras is multiple. The first size of each pixel unit 11 of the image sensor 1 in a part of the cameras is greater than the second size, and the first size of each pixel unit 11 of the image sensor 1 in another part of the cameras is less than the second size.
[0100] In this embodiment, since the first size of some image sensors is greater than the second size and the first size of some image sensors is less than the second size, changing the arrangement of the cameras when the volume of the cameras is reduced can further reduce the volume of the camera module.
[0101] In one embodiment, the fifth size of the lens 2 in a part of the cameras is greater than the sixth size, and the fifth size of the lens 2 in another part of the cameras is less than the sixth size. Among them, the lens 2 with the fifth size greater than the sixth size and the image sensor 1 including the pixel unit 11 with the first size greater than the second size are located in one camera. The lens 2 with the fifth size less than the sixth size and the image sensor 1 including the pixel unit 11 with the first size less than the second size are located in one camera.
[0102] In this embodiment, since the first size of some image sensors is greater than the second size and the first size of some image sensors is less than the second size, and the fifth size of some lenses that cooperate with each image sensor is greater than the sixth size and the fifth size of some lenses is less than the sixth size so that light can reliably irradiate the image sensor and the size of the lens is reduced, the volume of the camera module is reduced and the imaging quality of the camera module is improved. At the same time, since the fifth size of some lenses is greater than the sixth size and the fifth size of some lenses is less than the sixth size, changing the arrangement of the cameras when the volume of the cameras is reduced can further reduce the volume of the camera module.
[0103] Exemplarily, the camera module may further include a camera in which the first dimension of each pixel unit 11 of the image sensor 1 is equal to the second dimension and the fifth dimension of the lens 2 is equal to the sixth dimension.
[0104] An embodiment of the present disclosure provides an electronic device, and the electronic device includes the camera module as described above.
[0105] In this embodiment, since the volume of the camera module is reduced, the space occupied by the camera module in the electronic device is reduced, thereby improving the shooting effect of the electronic device.
[0106] An embodiment of the present disclosure provides an image processing method, and this image processing method can be applied to the above-mentioned electronic device, for example Figure 6 as shown, the method includes:
[0107] S100. Obtain the original image collected by the image sensor.
[0108] S200. Process the original image to obtain a target image.
[0109] Wherein, the first dimension of each pixel unit in the image sensor in the first direction is different from the second dimension in the second direction.
[0110] In this embodiment, since the first dimension of each pixel unit in the image sensor in the first direction is different from the second dimension in the second direction, if the original image collected by the image sensor is directly used, the original image will be deformed. By processing the original image collected by the image sensor, the deformed original image is restored to obtain a target image, which improves the imaging quality of the image sensor while reducing the volume of the camera module.
[0111] In one embodiment, as Figure 7 shown, the processing of the original image in step S200 to obtain a target image is determined in the following manner:
[0112] S210. Determine the pixel value of each pixel unit in the original image.
[0113] S220. Generate a target image based on the pixel values of the pixel units, and the pixel value of each pixel point in the target image is the pixel value of the corresponding pixel unit.
[0114] Wherein, the shape of each pixel point is a square, and each pixel unit in the image sensor corresponds to each pixel point in the target image one by one.
[0115] In this embodiment, the pixel value of each pixel unit in the original image is determined to obtain the information of the original image collected by the image sensor. Based on the pixel values of the pixel units, the deformed original image is adjusted along the direction in which the size of the pixel unit decreases to generate a target image. Since the shapes of the pixel points in the target image are all squares, corresponding one by one to the pixel units, and the pixel values are the pixel values of the corresponding pixel units, the target image can reflect the information of the original image collected by the image sensor and restore the deformed original image in the first direction or the second direction, thereby improving the imaging quality of the image sensor.
[0116] Exemplarily, the one-to-one correspondence between each pixel unit in the image sensor and each pixel point in the target image may mean that the number and arrangement of the pixel units in the image sensor are the same as the number and arrangement of the pixel points in the target image.
[0117] Exemplarily, taking the ratio of the first size to the second size of each pixel unit as 2:1 and the aspect ratio of the image sensor as 4:1.5 as an example, the original image collected by the image sensor and the generated target image are described. As Figure 8-1 shown, after obtaining the original image collected by the image sensor in step S100, the size of the original image in the second direction is compressed by half (the aspect ratio of the target image is 4:1.5). As Figure 8-2 shown, after generating the target image based on the pixel values of the pixel units in step S220, the size of the target image in the second direction is restored (the aspect ratio of the target image is 4:3).
[0118] Exemplarily, the side length of the pixel point may be the larger size of the first size and the second size. When the first size is greater than the second size, the side length of the pixel point may be the first size. When the first size is less than the second size, the side length of the pixel point may be the second size.
[0119] Exemplarily, generating the target image based on the pixel values of the pixel units in step S220 may be to set the pixel values of the pixel points in the blank image to the pixel values of the corresponding pixel units in the blank image to generate the target image. Among them, the shapes of the pixel points in the blank image are all squares, and each pixel unit in the image sensor corresponds one by one to the pixel points in the blank image. That is, the number and arrangement of the pixel units in the image sensor are the same as the number and arrangement of the pixel points in the blank image.
[0120] In an exemplary embodiment, the electronic device is, for example, a mobile phone, a laptop computer, a tablet computer, and a wearable device, etc.
[0121] Refer to Figure 9As shown, the electronic device 400 may include one or more of the following components: a processing component 402, a memory 404, a power component 406, a multimedia component 408, an audio component 410, an input / output (I / O) interface 412, a sensor component 414, and a communication component 416.
[0122] The processing component 402 generally controls the overall operation of the electronic device 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.
[0123] The memory 404 is configured to store various types of data to support the operation of the electronic device 400. Examples of these data include instructions for any application or method operating on the electronic device 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 may be implemented by any type of volatile or non-volatile storage terminal or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disks, or optical disks.
[0124] The power component 406 provides power to various components of the electronic device 400. The power component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 400.
[0125] The multimedia component 408 includes a screen that provides an output interface between the electronic device 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operations. In some embodiments, the multimedia component 408 includes a front camera module and / or a rear camera module, and the front camera module and / or the rear camera module can be the camera module as described above. When the electronic device 400 is in an operation mode, such as a shooting mode or a video mode, the front camera module and / or the rear camera module can receive external multimedia data. Each of the front camera module and the rear camera module can be a fixed optical lens system or have a focal length and optical zoom capabilities.
[0126] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 400 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 404 or transmitted via the communication component 416. In some embodiments, the audio component 410 further includes a speaker for outputting audio signals.
[0127] The I / O interface 412 provides an interface between the processing component 402 and a peripheral interface module, and the peripheral interface module can be a keyboard, a click wheel, buttons, etc. These buttons can include but are not limited to: a home button, a volume button, a power button, and a lock button.
[0128] The sensor assembly 414 includes one or more sensors for providing a status assessment of various aspects of the electronic device 400. For example, the sensor assembly 414 can detect the on / off state of the electronic device 400, the relative positioning of components, such as the display and keypad of the electronic device 400. The sensor assembly 414 can also detect a change in the position of the electronic device 400 or a component of the electronic device 400, the presence or absence of user contact with the electronic device 400, the orientation or acceleration / deceleration of the electronic device 400, and the temperature change of the electronic device 400. The sensor assembly 414 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 414 can also include a light sensor, such as an image sensor like CMOS or CCD as described above, for use in imaging applications. In some embodiments, the sensor assembly 414 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0129] The communication component 416 is configured to facilitate communication between the electronic device 400 and other terminals in a wired or wireless manner. The electronic device 400 can access a wireless network based on communication standards, such as WiFi, 2G, 3G, 4G, 5G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0130] In an exemplary embodiment, the electronic device 400 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing terminals (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above-described methods.
[0131] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as the memory 404 including instructions, and the above instructions can be executed by the processor 420 of the electronic device 400 to complete the above methods. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage terminal, etc. When the instructions in the storage medium are executed by the processor of the terminal, the terminal can execute the methods shown in the above embodiments.
[0132] Other embodiments of the present disclosure will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the claims.
[0133] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.
Claims
1. An image sensor, characterized in that, The image sensor includes: A pixel array, which includes a plurality of pixel units arranged in an array along a first direction and a second direction, and a first dimension of each pixel unit in the first direction is different from a second dimension in the second direction.
2. The image sensor according to claim 1, wherein The shape of the pixel unit is rectangular, oval or kidney-shaped.
3. The image sensor according to claim 1, wherein The shape of the image sensor is rectangular; the length of the image sensor is in the first direction, and the width of the image sensor is in the second direction.
4. The image sensor according to claim 3, wherein The ratio of the first dimension to the second dimension is a first preset value; the ratio of a third dimension of the image sensor in the first direction to a fourth dimension in the second direction is a second preset value; Wherein, the ratio of the second preset value to the first preset value is 4:
3.
5. The image sensor according to claim 4, wherein The first preset value is 2:1; the second preset value is 4:1.
5.
6. The image sensor according to any one of claims 1 to 5, characterized in that, The image sensor further includes: A filter, along the light-receiving direction of the image sensor, the filter and the pixel array are arranged in sequence.
7. A camera, characterized in that, The camera includes a lens and the image sensor according to any one of claims 1 to 6. Along the light-receiving direction of the image sensor, the lens and the image sensor are arranged in sequence.
8. The camera according to claim 7, wherein, A fifth dimension of the lens in the first direction is different from a sixth dimension in the second direction.
9. The camera according to claim 8, characterized in that, The shape of the lens is rectangular, oval or kidney-shaped.
10. A camera module, characterized in that, The camera module includes the camera according to any one of claims 7 to 9.
11. The camera module according to claim 10, wherein, The number of the cameras is multiple; The first dimension of each pixel unit of the image sensor in each camera is greater than the second dimension; or, The first dimension of each pixel unit of the image sensor in a part of the cameras is greater than the second dimension, and the first dimension of each pixel unit of the image sensor in another part of the cameras is less than the second dimension.
12. The camera module according to claim 11, wherein The fifth dimension of the lens in each camera is greater than the sixth dimension; or, The fifth dimension of the lens in a part of the cameras is greater than the sixth dimension, and the fifth dimension of the lens in another part of the cameras is less than the sixth dimension.
13. An electronic device, characterized in that, The electronic device includes the camera module according to any one of claims 10 to 12.
14. An image processing method for an electronic device as described in claim 13, characterized in that, The image processing method includes: Obtaining an original image collected by the image sensor; Processing the original image to obtain a target image.
15. The image processing method according to claim 14, characterized in that, The processing the original image to obtain a target image includes: Determining the pixel value of each pixel unit in the original image; Generating a target image based on the pixel values of the pixel units, and the pixel value of each pixel point in the target image is the pixel value of the corresponding pixel unit; Wherein, the shape of each pixel point is square, and each pixel unit in the image sensor corresponds to each pixel point in the target image one by one.