A camera module, terminal device and imaging method

Abstract

A camera module, terminal device, and imaging method are disclosed, applicable to fields such as autonomous driving, assisted driving, and security monitoring. The camera module includes a first optical lens assembly, a beam splitter assembly, and a first and second image sensing assembly with the same photosensitive area. The resolution of the first image sensing assembly is greater than that of the second image sensing assembly. The first optical lens assembly receives light from a target object. The beam splitter assembly splits the light propagating through the first optical lens assembly into a first ray and a second ray, propagating the first ray to the first image sensing assembly and the second ray to the second image sensing assembly. By using two image sensing assemblies with the same photosensitive area but different resolutions, the dynamic range of the camera module can be improved. This method can be applied to vehicle-to-everything (V2X) communication, LTE-V (Long Term Evolution) for vehicle-to-vehicle communication, and vehicle-to-vehicle (V2V) communication.

Description

Technical Field

[0001] This application relates to the field of camera module technology, and in particular to a camera module, terminal device and imaging method. Background Technology

[0002] With the development of technology, various devices are integrating more and more functions, such as camera functionality. Users have increasingly higher demands for camera functionality; for example, they need to obtain higher quality images. The following explanation uses a vehicle-mounted camera as an example.

[0003] In-vehicle cameras are playing an increasingly important role in assisted driving and autonomous driving. Images captured by in-vehicle cameras can reflect the environment around the vehicle, thus providing necessary information for safe driving. Dynamic range is a crucial functional parameter for in-vehicle cameras. Dynamic range refers to the range of brightness values ​​encompassed by the brightest and darkest objects within the same frame captured by the camera, allowing for normal detail. Therefore, obtaining high-quality images with a wide dynamic range is a pressing technical challenge for in-vehicle cameras.

[0004] Currently, most solutions improve the dynamic range of images by optimizing the pixels included in the sensors of automotive cameras, such as optimizing pixel exposure time. However, since pixel optimization is limited, the improvement in the dynamic range of the camera module is also relatively limited. Summary of the Invention

[0005] This application provides a camera module, a terminal device, and an imaging method to improve the dynamic range of the camera module.

[0006] In a first aspect, this application provides a camera module, which may include a first optical lens assembly, a beam splitter assembly, a first image sensing assembly, and a second image sensing assembly. The first image sensing assembly and the second image sensing assembly have the same photosensitive area, and the resolution of the first image sensing assembly is greater than the resolution of the second image sensing assembly. The first optical lens assembly is used to receive light from a target object; the beam splitter assembly is used to split the light propagated through the first optical lens assembly to obtain a first ray and a second ray, and propagates the first ray to the first image sensing assembly and the second ray to the second image sensing assembly.

[0007] Based on the above scheme, since sensitivity and resolution are inversely related when the photosensitive area of ​​the image sensing component is fixed, the sensitivity of the first image sensing component is lower than that of the second image sensing component. In other words, the first image sensing component has higher resolution and lower sensitivity to light, making it less prone to overexposure in bright light and capable of identifying high-brightness light, thus suitable for imaging bright targets; the second image sensing component has lower resolution and higher sensitivity to light, capable of identifying low-brightness light, thus suitable for imaging dim targets. In this way, the camera module can image both dim and bright targets, thereby helping to improve the dynamic range of the camera module.

[0008] In one possible implementation, the camera module may further include a first polarizer located between the beam splitter and the first image sensing component.

[0009] The first polarizer allows light rays parallel to the polarization direction of the first light ray to pass through, which further reduces the intensity of the first light ray incident on the first image sensing component. This further reduces the overexposure of the first image sensing component to bright light, thereby helping to further improve the dynamic range of the camera module.

[0010] Further, optionally, the polarization direction of the first polarizer is perpendicular to the main polarization direction of the glare propagating through the first optical lens assembly.

[0011] By introducing a first polarizer into the optical path of the high-resolution first image sensing component and designing the polarization direction of the first polarizer to be perpendicular to the main polarization direction of the received glare, the glare entering the high-resolution first image sensing component can be eliminated or reduced, thereby enabling the camera module to obtain glare-free and high dynamic range images.

[0012] In one possible implementation, the ratio of the intensity of the first ray to the intensity of the second ray is less than 1. This helps to further reduce the intensity of the first ray entering the high-resolution first image sensing component and can increase the intensity of the second ray entering the low-resolution second image sensing component, thereby helping to further improve the dynamic range of the camera module.

[0013] In one possible implementation, a first image sensing component is used to perform photoelectric conversion on the received first light to obtain information of a first image; a second image sensing component is used to perform photoelectric conversion on the received second light to obtain information of a second image; the information of the first image and the information of the second image are used to form an image of the target object.

[0014] Furthermore, optionally, the camera module also includes a first processing component, which can receive information from a first image from a first image sensing component and information from a second image from a second image sensing component, and generate an image of the target object based on the information from the first image and the information from the second image.

[0015] Specifically, the first processing component is used to upsample the information of the second image to obtain the information of the third image, the resolution of the third image corresponding to the information of the third image is the same as the resolution of the first image corresponding to the information of the first image; and to fuse the information of the first image and the information of the third image to obtain the image of the target object.

[0016] By fusing the information from the first image and the second image using the first processing component described above, the resulting image of the target object has high quality.

[0017] Secondly, this application provides a terminal device, which can be any of the camera modules described in the first aspect or in the first aspect.

[0018] For example, the terminal device may be a smartphone, vehicle, smart home device, smart manufacturing equipment, robot, drone, surveying equipment or smart transportation equipment.

[0019] Thirdly, this application provides an imaging method applicable to a camera module. The camera module may include a first image sensing component and a second image sensing component. The first and second image sensing components have the same photosensitive area, and the resolution of the first image sensing component is greater than that of the second image sensing component. The method includes receiving light from a target object; splitting the light from the target object to obtain a first ray and a second ray; propagating the first ray to the first image sensing component and the second ray to the second image sensing component.

[0020] In one possible implementation, the camera module also includes a first polarizer located between the beam splitter and the first image sensing component.

[0021] In one possible implementation, the polarization direction of the first polarizer is perpendicular to the main polarization direction of the glare propagating through the first optical lens assembly.

[0022] In one possible implementation, the ratio of the intensity of the first ray to that of the second ray is less than 1.

[0023] In one possible implementation, the first light ray is photoelectrically converted to obtain information of the first image; the second light ray is photoelectrically converted to obtain information of the second image; and an image of the target object is generated based on the information of the first image and the information of the second image.

[0024] Further, optionally, the information of the second image can be upsampled to obtain the information of the third image, and the information of the first image and the information of the third image can be fused to obtain an image of the target object, wherein the resolution of the third image corresponding to the information of the third image is the same as that of the first image corresponding to the information of the first image.

[0025] In one possible implementation, the camera module to which the third aspect can be applied can be any of the camera modules described in the first aspect above.

[0026] The technical effects that can be achieved by either the second or third aspect mentioned above can be referred to the description of the beneficial effects in the first aspect mentioned above, and will not be repeated here.

[0027] Fourthly, this application provides a camera module, including a second optical lens assembly, a third optical lens assembly, a first image sensing assembly, and a second image sensing assembly. The first image sensing assembly and the second image sensing assembly have the same photosensitive area, and the resolution of the first image sensing assembly is greater than the resolution of the second image sensing assembly. The second optical lens assembly is used to receive light from a target object and transmit a third light to the first image sensing assembly. The third optical lens assembly is used to receive light from the target object and transmit a fourth light to the second image sensing assembly.

[0028] Based on this scheme, the camera module can achieve dual-channel imaging through the second and third optical lens assemblies. The second optical lens assembly can transmit a third light ray from the target object to the first image sensor assembly, and the third optical lens assembly can transmit a fourth light ray from the target object to the second image sensor assembly. Since sensitivity and resolution are inversely related when the photosensitive area of ​​the image sensor assembly is fixed, the sensitivity of the first image sensor assembly is lower than that of the second image sensor assembly. In other words, the first image sensor assembly has higher resolution and lower sensitivity to light, making it less prone to overexposure in bright light and capable of recognizing high-brightness light, thus suitable for imaging bright targets. The second image sensor assembly has lower resolution and higher sensitivity to light, capable of recognizing low-brightness light, thus suitable for imaging dim targets. In this way, the camera module can image both dim and bright targets, thereby helping to improve the dynamic range of the camera module.

[0029] In one possible implementation, the camera module further includes a second polarizer located between the second optical lens assembly and the first image sensing assembly.

[0030] The second polarizer allows light rays parallel to the polarization direction of the second polarizer to pass through, further reducing the intensity of the third light rays incident on the first image sensing component. This further reduces the overexposure of the first image sensing component to bright light, thereby helping to further improve the dynamic range of the camera module.

[0031] Further, optionally, the polarization direction of the second polarizer is perpendicular to the main polarization direction of the glare propagating through the second optical lens assembly.

[0032] By introducing a second polarizer into the optical path of the high-resolution first image sensing component, and designing the polarization direction of the second polarizer to be perpendicular to the main polarization direction of the received glare, the glare entering the high-resolution first image sensing component can be eliminated or reduced, thereby enabling the camera module to obtain glare-free and high dynamic range images.

[0033] In one possible implementation, the aperture number of the second optical lens assembly is greater than that of the third optical lens assembly.

[0034] The light transmittance (i.e., light intensity) of different channels can be controlled by the aperture of the corresponding optical lens assembly. By setting the aperture number of the second optical lens assembly to be greater than that of the third optical lens assembly, the intensity of the third light entering the high-resolution first image sensor assembly can be compared with the intensity of the fourth light entering the low-resolution second image sensor assembly. In other words, the second optical lens assembly with a large aperture is used in conjunction with the high-resolution first image sensor assembly, and the third optical lens assembly with a small aperture is used in conjunction with the low-resolution second image sensor assembly, thereby helping to further improve the dynamic range of the camera module.

[0035] In one possible implementation, the second optical lens assembly and the third optical lens assembly have the same focal length. This allows the third light ray passing through the second optical lens assembly and the fourth light ray passing through the third optical lens assembly to converge on the same plane, thereby enabling the first image sensing assembly and the second image sensing assembly to be mounted on the same substrate, which helps simplify the assembly of the camera module.

[0036] In one possible implementation, a first image sensing component is used to perform photoelectric conversion on the received third light ray to obtain information of a fourth image; a second image sensing component is used to perform photoelectric conversion on the received fourth light ray to obtain information of a fifth image; wherein the information of the fourth image and the information of the fifth image are used to form an image of the target object.

[0037] Furthermore, optionally, the camera module also includes a second processing component for receiving information from a fourth image from a first image sensing component and information from a fifth image from a second image sensing component, and obtaining an image of the target object based on the information from the fourth image and the information from the fifth image.

[0038] Specifically, the second processing component is used to upsample the information of the fifth image to obtain the information of the sixth image. The resolution of the sixth image corresponding to the information of the sixth image is the same as the resolution of the fourth image corresponding to the information of the fourth image. The information of the fourth image and the information of the sixth image are fused to obtain the image of the target object.

[0039] Fifthly, this application provides a terminal device that can use any of the camera modules described in the fourth aspect above.

[0040] For example, the terminal device may be a smartphone, vehicle, smart home device, smart manufacturing equipment, robot, drone, surveying equipment or smart transportation equipment.

[0041] Sixthly, this application provides an imaging method applicable to a camera module, which may include a first image sensing component and a second image sensing component. The first and second image sensing components have the same photosensitive area, and the resolution of the first image sensing component is greater than that of the second image sensing component. The method includes receiving light from a target object, propagating a third ray of light to the first image sensing component, and propagating a fourth ray of light to the second image sensing component.

[0042] In one possible implementation, the camera module further includes a second polarizer located between the second optical lens assembly and the first image sensing assembly.

[0043] Further, optionally, the polarization direction of the second polarizer is perpendicular to the main polarization direction of the glare propagating through the second optical lens assembly.

[0044] In one possible implementation, the aperture number of the second optical lens assembly is greater than that of the third optical lens assembly.

[0045] In one possible implementation, the second optical lens assembly has the same focal length as the third optical lens assembly.

[0046] In one possible implementation, the received third ray can be photoelectrically converted to obtain information of a fourth image; the received fourth ray can be photoelectrically converted to obtain information of a fifth image; and based on the information of the fourth image and the information of the fifth image, an image of the target object can be obtained.

[0047] Specifically, the information of the fifth image is upsampled to obtain the information of the sixth image. The information of the fourth image and the information of the sixth image are then fused to obtain the image of the target object. The resolution of the sixth image corresponding to the information of the sixth image is the same as the resolution of the fourth image corresponding to the information of the fourth image.

[0048] In one possible implementation, the camera module used in the sixth aspect can be any of the camera modules described in the fourth aspect or any of the fourth aspects.

[0049] The technical effects that can be achieved by either the fifth or sixth aspect mentioned above can be referred to the description of the beneficial effects in the fourth aspect mentioned above, and will not be repeated here.

[0050] In a seventh aspect, this application provides a computer-readable storage medium storing a computer program or instructions that, when executed by a camera module, cause the camera module to perform the method in the third aspect or any possible implementation thereof, or cause the camera module to perform the method in the sixth aspect or any possible implementation thereof. Attached Figure Description

[0051] Figure 1a This application provides a schematic diagram illustrating the relationship between pixel size and resolution.

[0052] Figure 1b Another schematic diagram illustrating the relationship between pixel size and resolution provided in this application;

[0053] Figure 1c A schematic diagram illustrating the polarization state of natural light provided in this application;

[0054] Figure 1d A schematic diagram of the polarization state of linearly polarized light provided in this application;

[0055] Figure 1e A schematic diagram of another polarization state of linearly polarized light provided in this application;

[0056] Figure 1f A schematic diagram of the polarization state of partially polarized light provided in this application;

[0057] Figure 1g A schematic diagram illustrating the principle of image fusion provided in this application;

[0058] Figure 2 A schematic diagram illustrating the principle of anti-glare polarizer provided in this application;

[0059] Figure 3a This application provides a schematic diagram illustrating a possible application scenario for a camera module.

[0060] Figure 3b A schematic diagram illustrating another possible application scenario for the camera module provided in this application;

[0061] Figure 4 This application provides a schematic diagram of the structure of a camera module;

[0062] Figure 5a This application provides a schematic diagram of the structure of a first optical lens assembly;

[0063] Figure 5b A schematic diagram of another first optical lens assembly provided in this application;

[0064] Figure 6 This application provides a schematic diagram of the beam splitting principle of a beam splitting component;

[0065] Figure 7 A schematic diagram illustrating the relationship between a first image sensing component and a second image sensing component provided in this application;

[0066] Figure 8 A schematic diagram illustrating the process of fusing a first image and a second image provided in this application;

[0067] Figure 9 This is a schematic diagram of another camera module provided in this application;

[0068] Figure 10 This is a structural schematic diagram of another camera module provided in this application;

[0069] Figure 11 This is a structural schematic diagram of another camera module provided in this application;

[0070] Figure 12 A schematic diagram of the structure of a terminal device provided in this application;

[0071] Figure 13 A schematic diagram of the method flow for an imaging method provided in this application;

[0072] Figure 14 A schematic diagram of the method flow for another imaging method provided in this application. Detailed Implementation

[0073] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0074] The following provides explanations for some of the terms used in this application. It should be noted that these explanations are for the convenience of those skilled in the art and do not constitute a limitation on the scope of protection claimed in this application.

[0075] I. Glare

[0076] Glare refers to visual conditions caused by unsuitable brightness distribution within the field of vision, resulting in extreme brightness contrast in space or time, leading to visual discomfort and reduced object visibility. It produces a bright sensation within the field of vision that the human eye cannot adapt to, potentially causing aversion, discomfort, or even loss of vision. Glare occurs when there is excessively high brightness in a localized area of ​​the field of vision or when there are large changes in brightness along a path. For example, when a car is driving on a road, the road surface after rain acts as a good mirror; strong light sources (such as sunlight) reflected off this surface and entering the vehicle's camera will produce strong glare. Similarly, on a hot road surface, due to the temperature gradient, the refractive index decreases closer to the road surface, causing light rays to bend when incident at an angle. In this case, the road surface is equivalent to a good mirror, and strong light sources reflected off this surface and entering the vehicle's camera will produce glare.

[0077] II. Dynamic Range

[0078] Dynamic range is an important parameter of a camera module. It refers to the range of brightness values ​​encompassed by the brightest and darkest objects within the same frame captured by the camera module, allowing for normal display of details. The larger the dynamic range, the better both overly bright and overly dark objects can be displayed correctly in the same frame.

[0079] III. Upsampling

[0080] Upsampling, also known as image upsampling or image interpolation, primarily aims to enlarge images to obtain higher resolution images.

[0081] Upsampling principle: Image magnification typically employs interpolation methods, which involve inserting new elements between pixels in the original image using a suitable interpolation algorithm. The interpolation algorithm can be traditional interpolation, edge-based image interpolation, or region-based image interpolation, etc., and this application does not limit its application to any particular algorithm.

[0082] IV. Pixels

[0083] A pixel can refer to the smallest unit that makes up the imaging area of ​​an image sensor. The size of a pixel refers to its physical dimensions, that is, the distance between the centers of adjacent pixels.

[0084] V. Resolution

[0085] Resolution refers to the number of the largest number of pixels (i.e., photosensitive units) available for imaging on an image sensor. It is usually measured as the product of the number of horizontal pixels and the number of vertical pixels, i.e., resolution = number of horizontal pixels × number of vertical pixels.

[0086] It should be noted that, for the same photosensitive area (or the same target surface), resolution and pixel size are inversely related. (Reference) Figure 1a and Figure 1b The relationship between pixel size and resolution under the same photosensitive area. Figure 1a The pixel size is 'a', and the resolution is 4×4. Figure 1b The pixel size is a / 2, and the resolution is 8×8. (By...) Figure 1a and Figure 1b It can be determined that the smaller the pixel size, the higher the resolution; the larger the pixel size, the lower the resolution.

[0087] VI. Minimum Illumination

[0088] Minimum illumination refers to the sensitivity of an image sensor to ambient light, or the darkest light required for an image sensor to form a normal image.

[0089] 7. Aperture

[0090] The aperture controls the amount of light entering an optical lens; in other words, it determines the amount of light entering the lens. The size of the aperture is usually expressed in F-numbers, denoted as F / , also known as the f-number. A large aperture lens has a small F-number, meaning a small f-number; a small aperture lens has a large F-number, meaning a large f-number.

[0091] With the shutter speed constant, a smaller F-number means a larger aperture, allowing more light in and resulting in a brighter image; a larger F-number means a smaller aperture, allowing less light in and resulting in a darker image.

[0092] 8. Polarizing Film

[0093] A polarizer, also known as a light polarizer, is a type of optical filter. Polarizers are used to absorb or reflect light with one polarization direction while transmitting light with another orthogonally polarized direction. The transmittance of light is directly related to its polarization state. Polarizers are generally classified into absorptive polarizers and reflective polarizers (RP). Absorptive polarizers strongly absorb one of the orthogonally polarized components of incident linearly polarized light, while absorbing the other component weakly. Reflective polarizers can transmit linearly polarized light in a certain direction and reflect light with a polarization direction perpendicular to the transmitted direction. Absorptive polarizers can be, for example, dichroic polarizers, while reflective polarizers can be, for example, birefringence-based polarizing beam splitters.

[0094] For natural light (see also) Figure 1c After incident on the polarizer, the outgoing light becomes linearly polarized, and its energy becomes 50% of the incident light's energy. For linearly polarized light (see [reference needed]),... Figure 1d or Figure 1eAfter the incident light is incident on the polarizer, the outgoing light remains linearly polarized, but its energy becomes I0 × cosθ^2, where I0 represents the energy of the incident linearly polarized light, and θ represents the angle between the polarization direction of the incident linearly polarized light and the polarization direction of the polarizer. For partially polarized light (see [reference needed]),... Figure 1f After being incident on the polarizer, the outgoing light becomes linearly polarized, and the energy of the outgoing light decreases, exhibiting a periodic change with the polarization angle.

[0095] IX. Polarization Direction

[0096] The polarization direction is also called the polarization direction or the polarization initiation direction. This is because there is a certain characteristic direction in the polarizer, called the polarization direction. The polarizer only allows light parallel to the polarization direction to pass through, while absorbing or reflecting light perpendicular to that direction.

[0097] 10. Image Fusion

[0098] Image fusion is an image processing technique that involves processing image data of the same target collected from multiple sources through image processing and specific algorithms to extract the most useful information from each source and ultimately synthesize a high-quality image (e.g., in terms of brightness, sharpness, and color). The fused image has a higher resolution than the original image.

[0099] Please see Figure 1g This diagram illustrates the principle of image fusion as provided in this application. Since image fusion can utilize the spatiotemporal correlation and information complementarity of two (or more) images, the fused image provides a more comprehensive and clear description of the scene, thus facilitating identification and detection by the detection device. It should be noted that image fusion typically requires ensuring that the images to be fused are properly registered and have consistent pixel widths.

[0100] The preceding text has introduced some of the terms used in this application. The following section describes the technical features involved in this application. It should be noted that these explanations are for the convenience of those skilled in the art and do not constitute a limitation on the scope of protection claimed in this application.

[0101] like Figure 2The diagram shown illustrates the principle of an anti-glare polarizer provided in this application. When the incident angle θ is a Brewster angle, the reflected light is linearly polarized, and the transmitted light is approximately natural light. When the incident angle θ is a non-Brewster angle, both the reflected and transmitted light are partially polarized. Here, Brewster angle = arctan(n2 / n1), where n1 represents the refractive index of the medium containing the incident light, and n2 represents the refractive index of the medium containing the refracted light. According to the Fresnel reflection principle, glare reflected from the road surface is either partially polarized or linearly polarized. The glare can be reduced or eliminated by adjusting the polarization direction of the polarizer. It should be understood that when the glare is partially polarized, the angle between the principal polarization direction (or polarization major axis) of the glare and the road surface is definite.

[0102] Based on the above, the following outlines possible application scenarios for the camera module in this application. For example, the camera module can be installed on a vehicle (e.g., an autonomous vehicle, a smart car, an electric vehicle, a digital car, etc.) as an in-vehicle camera. Figure 3a Vehicle-mounted cameras can acquire measurement information such as the distance to surrounding objects in real time or periodically, providing necessary information for lane correction, distance maintenance, reversing, and other operations. Because vehicle-mounted cameras can: a) target recognition and classification, such as lane line recognition, traffic light recognition, and traffic sign recognition; b) freespace detection, such as defining the safe boundaries (drivable areas) for vehicle travel, mainly defining vehicles, ordinary road edges, curb edges, boundaries without visible obstacles, and unknown boundaries; c) detection of laterally moving targets, such as detecting and tracking pedestrians and vehicles crossing intersections; d) localization and map creation, such as localization and map creation based on simultaneous localization and mapping (SLAM) technology. Therefore, vehicle-mounted cameras have been widely used in fields such as autonomous driving, automatic driving, assisted driving, intelligent driving, connected vehicles, security monitoring, and surveying. It should be understood that camera modules can be integrated with advanced driver assistance systems (ADAS).

[0103] It should be noted that the above application scenarios are merely examples. The camera module provided in this application can also be applied in a variety of other scenarios, and is not limited to those listed above. For example, the camera module can also be applied to terminal devices or components installed in terminal devices. Terminal devices can be, for example, smartphones, smart home devices, smart manufacturing equipment, robots, drones, or smart transportation equipment (such as automated guided vehicles (AGVs) or unmanned transport vehicles). Furthermore, the camera module can also be mounted on drones as an airborne camera. Additionally, the camera module can be mounted on roadside traffic equipment (such as roadside units (RSUs)) as a roadside traffic camera, as seen in [reference needed]. Figure 3b This enables intelligent vehicle-road cooperation.

[0104] Dynamic range is a crucial functional parameter for camera modules. Currently, the dynamic range of camera modules is only 80-120 dB, while the dynamic range of targets in nature can reach 180 dB. Therefore, the dynamic range of camera modules needs further improvement. Currently, the main approach to improving the dynamic range of camera modules is by optimizing the number of pixels in the image sensor. However, since pixel optimization has its limitations, the improvement in the dynamic range of the camera module is also relatively limited. Therefore, obtaining high-quality images with a wide dynamic range is a critical technical problem that camera modules urgently need to solve.

[0105] In view of this, this application provides a camera module that can obtain a wider dynamic range.

[0106] Based on the above, the following is in conjunction with the appendix. Figure 4 To be continued Figure 11 This paper provides a detailed description of the camera module proposed in this application.

[0107] Example 1

[0108] like Figure 4 The diagram shown is a structural schematic of a camera module provided in this application. The camera module may include a first optical lens assembly 401, a beam splitter 402, a first image sensor assembly 403, and a second image sensor assembly 404. The first image sensor assembly 403 and the second image sensor assembly 404 have the same photosensitive area, and the resolution of the first image sensor assembly 403 is greater than the resolution of the second image sensor assembly 404. The first optical lens assembly 401 is used to receive light from a target object. The beam splitter 402 is used to split the light propagated through the first optical lens assembly 401 to obtain a first ray and a second ray, and propagates the first ray to the first image sensor assembly 403 and the second ray to the second image sensor assembly 404.

[0109] Based on this camera module, since sensitivity and resolution are inversely related when the photosensitive area of ​​the image sensing component is fixed, the sensitivity of the first image sensing component is lower than that of the second image sensing component. In other words, the first image sensing component has higher resolution and lower sensitivity to light, making it less prone to overexposure in bright light and capable of identifying high-brightness light, thus suitable for imaging bright targets. The second image sensing component has lower resolution and higher sensitivity to light, capable of identifying low-brightness light, thus suitable for imaging dim targets. In this way, the camera module can image both dim and bright targets, thereby improving the dynamic range of the camera module.

[0110] It should be understood that this camera module is equivalent to the second image sensing component sacrificing some image resolution in exchange for increased sensitivity, thereby improving the dynamic range of the camera module.

[0111] In one possible implementation, the information carried by the light propagating through the first optical lens assembly is the same as the information carried by the light entering the first optical lens assembly (i.e., the light from the target object).

[0112] It should be noted that the target object includes, but is not limited to, a single object. For example, when photographing a person, the target object includes both the person and the surrounding scenery; that is, the surrounding scenery is also part of the target object. Alternatively, it can be understood that any object within the field of view of the first optical lens assembly can be considered a target object.

[0113] The following is about Figure 4 Each functional component and structure shown is described in detail to provide an exemplary implementation scheme. For ease of explanation, the first optical lens assembly, beam splitting assembly, first image sensing assembly, and second image sensing assembly are not labeled in the following text.

[0114] I. First Optical Lens Assembly

[0115] In one possible implementation, the first optical lens assembly can receive light from the target object and, by changing the propagation direction of the light from the target object, direct the light into the camera module as much as possible. Furthermore, optionally, the first optical lens assembly can also propagate glare (such as glare reflected from the road surface) into the camera module.

[0116] In one possible implementation, the first optical lens assembly may consist of at least one optical lens. As an example, Figure 5aA schematic diagram of a first optical lens assembly is provided. This first optical lens assembly, for example, includes seven optical lenses. Light from the target object can be propagated into the camera module as much as possible through this first optical lens assembly. Furthermore, external glare can also be propagated into the camera module through this first optical lens assembly.

[0117] As yet another example, Figure 5b A schematic diagram of another first optical lens assembly is provided. This first optical lens assembly may include six optical lenses.

[0118] It should be understood that the above Figure 5a The structure of the first optical lens assembly shown in 5b is merely an example; the first optical lens assembly in this application may have a structure that is more advanced than... Figure 5a More or fewer optical lenses can also have a higher effect than Figure 5b More or fewer optical lenses. The optical lenses may be any of the following: convex lenses (such as biconvex lenses, plano-convex lenses, or convex-concave lenses) or concave lenses (such as biconcave lenses, plano-concave lenses, or concave-convex lenses), or a combination of convex and concave lenses. This application does not limit the specific type of optical lens.

[0119] In one possible implementation, to suppress temperature drift, at least one optical lens in the first optical lens assembly is made of glass.

[0120] Furthermore, optionally, in order to minimize the height of the camera module, the optical lenses in the first optical lens assembly are positioned in the height direction of the camera module (see above). Figure 5a Cutting can be done on it.

[0121] II. Spectrometer

[0122] In one possible implementation, a beam splitter can be used to split (e.g., split in two) the light propagating from the first optical lens assembly to obtain a first ray and a second ray. Exemplarily, the beam splitter can divide the light propagating from the first optical lens assembly by intensity (or energy or amplitude) to obtain a first ray and a second ray. It should be understood that the first ray and the second ray carry the same information; the information carried by the first ray is the same as that carried by the light propagating from the first optical lens assembly, and the information carried by the second ray is also the same as that carried by the light propagating from the first optical lens assembly. The sum of the intensities of the first ray and the second ray is equal to or approximately equal to the intensity of the light propagating from the first optical lens assembly.

[0123] Further, optionally, the ratio of the intensities of the first ray and the second ray can be less than 1. For example, the ratio of the intensities of the first ray and the second ray can be 2:8; another example is a ratio of 1:9; yet another example is a ratio of 4:6. This can also be understood as the intensity of the first ray received by the first image sensing component being less than the intensity of the second ray received by the second image sensing component. Thus, the intensity of the first ray received by the high-resolution, low-sensitivity first image sensing component is less than the intensity of the second ray received by the low-resolution, high-sensitivity second image sensing component, which helps to further improve the dynamic range of the camera module. It should be understood that the ratio of the intensities of the first ray and the second ray can also be equal to 1 or greater than 1.

[0124] It should be noted that the ratio of the intensity of the first ray and the second ray can be designed according to actual needs, and this application does not limit it.

[0125] In one possible implementation, the beam-splitting component can be, for example, a beam splitter (BS) or a beam-splitting plate. A beam splitter is formed by depositing one or more thin films (i.e., beam-splitting films) on the surface of a prism, while a beam-splitting plate is formed by depositing one or more thin films (i.e., beam-splitting films) on one surface of a glass plate. Both beam splitters and beam-splitting plates utilize the difference in transmittance and reflectance of the thin film to split the light propagating from the first optical lens assembly.

[0126] like Figure 6 The diagram shown illustrates the beam-splitting principle of a beam-splitting component provided in this application. This beam-splitting prism can split the light rays propagating from the first optical lens assembly into two, resulting in a first ray and a second ray. Alternatively, it can be understood that after passing through the beam-splitting component, a portion of the light rays propagating from the first optical lens assembly is transmitted (the first ray) to the first image sensing component, while the other portion is reflected (the second ray) to the second image sensing component. Exemplarily, the intensity ratio of the first ray and the second ray can be determined by the reflectivity and transmittance of the coated beam-splitting film.

[0127] III. First Image Sensing Component and Second Image Sensing Component

[0128] In one possible implementation, the first image sensing component can perform photoelectric conversion on the received first light to obtain information of the first image; the second image sensing component can perform photoelectric conversion on the second light to obtain information of the second image.

[0129] Here, the first image sensing component and the second image sensing component employ a non-identical architecture. Specifically, the first image sensing component and the second image sensing component have the same photosensitive area, but the resolution of the first image sensing component is greater than that of the second image sensing component. Further, optionally, the first image sensing component includes a first pixel, and the second image sensing component includes a second pixel, with the size of the first pixel being smaller than the size of the second pixel. It should be understood that the larger the pixel size, the higher the sensitivity of the image sensing component; the smaller the pixel size, the lower the sensitivity of the image sensing component. Therefore, the sensitivity of the first image sensing component to light is lower than that of the second image sensing component to light.

[0130] like Figure 7 The diagram shown illustrates the relationship between a first image sensing component and a second image sensing component provided in this application. Figure 7 In the diagram, (a) represents the first image sensing component. Figure 7 In the diagram, (b) represents the second image sensing component. The smallest repeatable unit of both the first and second image sensing components is RGGB, where R represents a pixel for receiving red light, G represents a pixel for receiving green light, and B represents a pixel for receiving blue light. The first and second image sensing components have the same photosensitive area. The size of the first pixel in the first image sensing component is twice the size of the second pixel in the second image sensing component; therefore, the resolution of the first image sensing component is four times that of the second image sensing component. Furthermore, the sensitivity of the first image sensing component is one-quarter that of the second image sensing component. In other words, the first image sensing component has the characteristics of high resolution, small pixels, and low sensitivity, making it suitable for imaging bright targets; the second image sensing component has the characteristics of low resolution, large pixels, and high sensitivity, making it suitable for imaging dim targets.

[0131] It should be noted that, Figure 7 The resolution and minimum repeatable unit of the first and second image sensing components shown are merely examples and do not constitute a limitation on this application. For example, the minimum repeatable unit of the first and second image sensing components could also be RYYB.

[0132] In combination with the above Figure 7 Taking an example where the resolution of the first image sensing component is 8M and the resolution of the second image sensing component is 2M, and taking the intensity ratio of the first light ray to the second light ray as 2:8, Table 1 exemplarily shows the relationship between the improved dynamic range of the camera module based on Embodiment 1 and the dynamic range of a camera module based on the prior art. Table 1: Relationship between the improved dynamic range of the camera module based on Embodiment 1 and the dynamic range of a camera module based on the prior art.

[0133]

[0134] It should be noted that the field of view of the first optical lens assembly may include both bright and dim targets; both are collectively referred to as target objects. As shown in Table 1 above, based on existing camera modules, the image sensor receives Eh energy of incident light from a bright target and E1 energy of incident light from a dim target, with a dynamic range of -10log(Eh / E1). Based on the camera module of Embodiment 1, since the intensity ratio of the first ray to the second ray after beam splitting is 2:8, the energy of the incident light from the bright target received by the first image sensing component is 0.2 × Eh. Thus, the intensity of the first ray incident on the first image sensing component is reduced by 0.2 times, thereby improving the overexposure prevention capability of the first image sensing component for bright targets by 2 times. The second image sensing component receives 0.8 × Eh of incident light from a dim target. Furthermore, the size of the second pixel in the second image sensing component is 1 / 4 the size of the first pixel in the first image sensing component. Therefore, the sensitivity of the second image sensing component is 4 times that of the first image sensing component. Thus, the low-light capability of the second image sensing component for dim targets is improved by 4 × 0.8 = 3.2 times. Therefore, the dynamic range of the camera module can be improved by -10log(Eh / Eh) = 10log16. This further demonstrates that the dynamic range of the camera module based on Embodiment 1 is effectively improved. It should be understood that the second image sensing component receives 0.8 × Eh of incident light from a bright target, which may result in overexposure, while the first image sensing component receives 0.2 × Eh of incident light from a dim target, which may result in underexposure. High dynamic range can be achieved through the fusion of image information by the first processing component, as detailed in subsequent descriptions, which will not be repeated here.

[0135] In one possible implementation, the first image sensing component can be a complementary metal-oxide-semiconductor (CMOS) phototransistor, a charge-coupled device (CCD), a photon detector (PD), or a high-speed photodiode. The CMOS phototransistor is a device or chip that converts optical signals into electrical signals based on CMOS technology. The second image sensing component can also be a complementary metal-oxide-semiconductor (CMOS) phototransistor, a charge-coupled device (CCD), a photon detector (PD), or a high-speed photodiode.

[0136] It should be noted that the type of the first image sensing component can be the same as that of the second image sensing component. For example, both the first and second image sensing components can be CMOS phototransistors. Alternatively, the type of the first image sensing component can be different from that of the second image sensing component. For example, the first image sensing component is a CMOS phototransistor, and the second image sensing component is a CCD.

[0137] In one possible implementation, the first image sensing component can be a first image sensor, and the second image sensing component can be a second image sensor. For example, the resolution range of the first image sensor can be [8 megapixels, 48 ​​megapixels], and the resolution range of the second image sensor can be [8 megapixels, 48 ​​megapixels], requiring that the resolution of the first image sensor is greater than the resolution of the second image sensor. For example, the resolution of the first image sensor is 12 megapixels, 20 megapixels, or 48 megapixels, and the resolution of the second image sensor can be 8 megapixels. Of course, the resolution of the first image sensor can also be greater than 48 megapixels, for example, it can also be 52 megapixels, 60 megapixels, 72 megapixels, etc.; the resolution of the second image sensor can also be greater than 8 megapixels. It should be understood that any combination that satisfies the requirement that the resolution of the first image sensing component is greater than the resolution of the second image sensing component is acceptable.

[0138] The camera module in this embodiment may further include a first polarizer. Further, optionally, the camera module may also include a first processing component. The first polarizer and the first processing component will be described below.

[0139] IV. First Polarizing Plate

[0140] In one possible implementation, the first polarizer may be located between the beam-splitting component and the first image-sensing component (see below). Figure 9 A first polarizer allows light rays whose polarization state is parallel to the polarization direction of the first polarizer to pass through, and the first light rays passing through the first polarizer converge onto the first image sensing component. This further reduces the intensity of the first light rays incident on the first image sensing component, thereby further reducing overexposure of the first image sensing component to bright light, and thus helping to further improve the dynamic range of the camera module. It should be noted that the first light rays passing through the first polarizer are a portion of the first light rays incident on the first polarizer (i.e., the portion of the first light rays parallel to the polarization direction of the first polarizer).

[0141] Further, optionally, the polarization direction of the first polarizer is perpendicular to the main polarization direction of the glare propagating through the first optical lens assembly. By introducing a first polarizer into the optical path of the high-resolution first image sensing assembly and designing the polarization direction of the first polarizer to be perpendicular to the main polarization direction of the received glare, the glare entering the high-resolution first image sensing assembly can be eliminated or reduced (the specific principle can be combined with the polarization state of the glare and the aforementioned...). Figure 2 (as described above), thus obtaining anti-glare and high dynamic range images.

[0142] In combination with the above Figure 7 Taking an example where the resolution of the first image sensing component is 8M and the resolution of the second image sensing component is 2M, and taking an intensity ratio of 2:8 for the first light ray to the second light ray, the relationship between the dynamic range of the camera module based on Embodiment 1 and the dynamic range of the camera module based on the prior art can be seen in Table 2 below when the camera module also includes a first polarizer.

[0143] Table 2 shows the improved dynamic range of the camera module based on Embodiment 1 and the dynamic range of the camera module based on existing technology.

[0144]

[0145] When the camera module also includes a first polarizer, based on Table 2 above, similar to the analysis in Table 1 above, the first image sensing component improves the overexposure prevention capability of bright targets by 10 times, the low-light capability of the second image sensing component improves the low-light capability of dim targets by 3.2 times, and the dynamic range of the camera module is 10log32.

[0146] In one possible implementation, the improvement in the dynamic range of the camera module is related to the ratio of the intensities of the first ray and the second ray. When the camera module also includes a first polarizer, the relationship between the ratio η of the intensities of the first ray to the second ray and the improvement in dynamic range is shown in Table 3.

[0147] Table 3. Relationship between the ratio η of the intensity of the first ray to the second ray and the improvement in dynamic range.

[0148] η 1:9 2:8 3:7 4:6 5:5 Dynamic range improvement (times) 20×3.6＝72 10×3.2＝32 6.7×2.8＝18.7 5×2.4＝12 4×2＝8 Increase in dynamic range (dB) 18.5 15 12.7 10.7 9

[0149] It should be understood that the relationship between the increase in dynamic range (dB) and the increase in dynamic range (times) satisfies: increase in dynamic range (dB) = -10log(increase in dynamic range (times)).

[0150] When the camera module includes a first polarizer, the first polarizer can not only eliminate or reduce glare, but also soften the first light received by the first image sensing component.

[0151] V. First Processing Component

[0152] In one possible implementation, the first processing component may receive information from a first image sensing component and information from a second image sensing component, and generate an image of the target object based on the information from the first and second images. Specifically, the first processing component may upsample the information from the second image (see the foregoing description) to obtain information from a third image, the resolution of which is the same as the resolution of the first image corresponding to the information from the first image; the information from the first image and the information from the third image are then fused to obtain an image of the target object, as described in [reference needed]. Figure 8 By fusing information from the first image and the second image, the resulting image of the target object has high quality.

[0153] Furthermore, optionally, the first processing component can also perform denoising, enhancement, segmentation and blurring on the fused target image to enrich the user experience.

[0154] In one possible implementation, the first processing component may be, for example, an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP), a digital signal processor (DSP), etc.

[0155] Alternatively, the first processing component can be a central processing unit (CPU), or other general-purpose processors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. A general-purpose processor can be a microprocessor or any conventional processor.

[0156] Alternatively, the first processing component may be a combination of any one of a CPU, ASIC, FPGA, other programmable logic devices, transistor logic devices, and any one of an application processor, graphics processor, image signal processor, or digital signal processor.

[0157] It should be noted that the camera module in one of the above embodiments may further include an infrared (IR) filter, which may be located between the beam splitter and the first image sensing component, and / or between the beam splitter and the second image sensing component. The IR filter can be used to block or absorb infrared radiation to prevent damage to the image sensing component; moreover, the IR filter can be configured to have no effect on the focal length of the first optical lens assembly. Exemplarily, the material of the IR filter may be glass or a glass-like resin, such as blue glass.

[0158] Based on the above, and considering the specific hardware structure, a specific implementation of the camera module in Embodiment 1 is presented below. This is to facilitate a further understanding of the structure of the camera module and the image formation process of the target object.

[0159] like Figure 9 The diagram shown illustrates the structure of another camera module provided in this application. This camera module may include a first optical lens assembly, a beam splitter assembly, a first image sensing assembly, a second image sensing assembly, a first polarizer located between the beam splitter assembly and the first image sensing assembly, and a first processing assembly. The first optical lens assembly comprises the aforementioned... Figure 5a For example, the beam-splitting component uses a beam-splitting prism as an example, and the first image sensing component uses the above-mentioned... Figure 7 Taking (a) as an example, the second image sensing component uses the above-mentioned... Figure 7 Take (b) as an example.

[0160] For possible implementations of the first optical lens assembly, beam splitter assembly, first image sensor assembly, second image sensor assembly, first polarizer, and first processing assembly, please refer to the aforementioned descriptions, which will not be repeated here.

[0161] based on Figure 9 The camera module shown has light from the target object passing through a first optical lens assembly and then to a beam splitter assembly. The beam splitter separates the light into a first ray and a second ray. The first ray travels to a first image sensor assembly, and the second ray travels to a second image sensor assembly. The first image sensor assembly converts the first ray into a first electrical signal (i.e., information of the first image), and the second image sensor assembly converts the second ray into a second electrical signal (i.e., information of the second image). The first electrical signal can then be converted into a first digital image signal by an analog-to-digital converter (A / D), and the second electrical signal can also be converted into a second digital image signal by the A / D converter. Both the first and second digital image signals are transmitted to an ISP for processing (e.g., fusion) to obtain an image of the target object in a specific format. Optionally, the ISP can then transmit the image of the target object to a display screen for display.

[0162] Example 2

[0163] like Figure 10 The diagram shown is a structural schematic of another camera module provided in this application. The camera module may include a second optical lens assembly 1001, a third optical lens assembly 1002, a first image sensing assembly 1003, and a second image sensing assembly 1004. The first image sensing assembly 1003 and the second image sensing assembly 1004 have the same photosensitive area, and the resolution of the first image sensing assembly 1003 is greater than the resolution of the second image sensing assembly 1004. The second optical lens assembly 1001 is used to receive light from a target object and transmit a third ray of light to the first image sensing assembly 1003. The third optical lens assembly 1002 is used to receive light from a target object and transmit a fourth ray of light to the second image sensing assembly 1004.

[0164] Based on the aforementioned camera module, through the second and third optical lens assemblies, the camera module can achieve dual-channel imaging. The second optical lens assembly can transmit a third light ray from the target object to the first image sensor assembly, and the third optical lens assembly can transmit a fourth light ray from the target object to the second image sensor assembly. Since sensitivity and resolution are inversely related when the photosensitive area of ​​the image sensor assembly is fixed, the sensitivity of the first image sensor assembly is lower than that of the second image sensor assembly. In other words, the first image sensor assembly has higher resolution and lower sensitivity to light, making it less prone to overexposure in bright light and capable of recognizing high-brightness light, thus suitable for imaging bright targets. The second image sensor assembly has lower resolution and higher sensitivity to light, capable of recognizing low-brightness light, thus suitable for imaging dim targets. In this way, the camera module can image both dim and bright targets, thereby helping to improve the dynamic range of the camera module.

[0165] Here, the third ray carries the same information as the ray from the target object, and the fourth ray carries the same information as the ray from the target object. For example, the third ray is part or all of the ray from the target object, and the fourth ray is also part or all of the ray from the target object.

[0166] It should be noted that in this second embodiment, the first optical lens assembly and the second optical lens assembly are relatively close. Therefore, the field of view of the second optical lens assembly is the same as that of the third optical lens assembly, or the parallax is negligible. In other words, the light rays received by the second optical lens assembly from the target object are the same as those received by the third optical lens assembly from the target object, or the difference is negligible.

[0167] The following is about Figure 10 Each functional component and structure shown is described in detail to provide an exemplary implementation scheme. For ease of explanation, the second optical lens assembly, third optical lens assembly, first image sensing assembly, and second image sensing assembly are not labeled in the following text.

[0168] VI. Second and Third Optical Lens Assemblies

[0169] In one possible implementation, the second optical lens assembly can receive light from the target object and propagate a third ray to the first image sensing assembly by changing the propagation direction of the light from the target object; the third optical lens assembly can receive light from the target object and propagate a fourth ray to the second image sensing assembly by changing the propagation direction of the light from the target object.

[0170] Furthermore, optionally, both the second and third optical lens assemblies may also propagate glare (such as glare reflected from the road surface) into the camera module.

[0171] In one possible implementation, the aperture number (F-number) of the second optical lens assembly is greater than that of the third optical lens assembly. This can also be understood as the intensity of the third ray of light, after propagation through the second optical lens assembly, is less than the intensity of the fourth ray propagating through the third optical lens assembly. In other words, the intensity of the third ray is less than the intensity of the fourth ray. It should be understood that a smaller aperture number allows more light to pass through, which is beneficial for imaging in low light conditions; a larger aperture number allows less light to pass through, which is beneficial for imaging in bright light conditions.

[0172] In one possible implementation, the intensity ratio of the third ray to the fourth ray can be changed by varying the aperture numbers of the second and third optical lens components. For example, the intensity ratio could be 2:8; another example is 1:9; yet another is 4:6. This can also be understood as the intensity of the third ray received by the first image sensing component being less than the intensity of the fourth ray received by the second image sensing component.

[0173] In one possible implementation, both the second and third optical lens assemblies can be fixed-aperture optical lens assemblies, wherein the second optical lens assembly is a small-aperture optical lens assembly and the third optical lens assembly is a large-aperture optical lens assembly.

[0174] In another possible implementation, both the second and third optical lens assemblies are adjustable aperture optical lens assemblies, with the aperture number of the second optical lens assembly being greater than that of the third optical lens assembly.

[0175] Through the second and third optical lens assemblies, the camera module can achieve dual-channel imaging. The amount of light transmitted through different channels can be controlled by the aperture of the corresponding optical lens assembly. The second optical lens assembly with a large aperture number is paired with a high-resolution first image sensor assembly, while the third optical lens assembly with a small aperture number is paired with a low-resolution second image sensor assembly, thereby helping to improve the dynamic range of the camera module.

[0176] Furthermore, optionally, the second optical lens assembly and the third optical lens assembly have the same focal length. This allows the third light ray passing through the second optical lens assembly and the fourth light ray passing through the third optical lens assembly to converge on the same plane, thereby enabling the first image sensing assembly and the second image sensing assembly to be disposed on the same substrate (see below). Figure 11This simplifies the assembly of the camera module. Therefore, the camera module of Embodiment 2 can be applied to fixed-focus imaging scenarios.

[0177] In one possible implementation, the second optical lens assembly and the third optical lens assembly have the same image plane circle, so that the effective areas for imaging by the first image sensing assembly and the second image sensing assembly are consistent.

[0178] It should be noted that the structures of the second and third optical lens assemblies are described in the aforementioned description of the first optical lens assembly, and will not be repeated here. Furthermore, the structures of the second and third optical lens assemblies may be the same or different; this application does not impose any limitations on this.

[0179] Furthermore, optionally, in order to minimize the height of the camera module, the optical lenses in the second and / or third optical lens assemblies may be cut in the height direction of the camera module.

[0180] VII. First Image Sensing Component and Second Image Sensing Component

[0181] In one possible implementation, a first image sensing component is used to perform photoelectric conversion on the received third light ray to obtain information of a fourth image; a second image sensing component is used to perform photoelectric conversion on the received fourth light ray to obtain information of a fifth image; wherein the information of the fourth image and the information of the fifth image are used to form an image of the target object.

[0182] For details regarding the first and second image sensing components, please refer to the aforementioned descriptions; they will not be repeated here. Specifically, the first ray can be replaced with a third ray, the second ray with a fourth ray, the information of the first image can be replaced with the information of the fourth image, the information of the second image can be replaced with the information of the fifth image, and the information of the third image can be replaced with the information of the sixth image, and so on.

[0183] The camera module in this second embodiment may further include a second polarizer. Further, optionally, the camera module may also include a second processing component. The second polarizer and the second processing component will be described below.

[0184] 8. Second polarizer

[0185] The second polarizer is located between the second optical lens assembly and the first image sensing assembly (see below). Figure 11The second polarizer allows light rays in the third ray that are parallel to the polarization direction of the second polarizer to pass through, and the third ray rays passing through the second polarizer converge onto the first image sensing component. Alternatively, the second polarizer allows only the portion of the third ray rays parallel to the polarization direction of the second polarizer to pass through, while the remaining portion is filtered out. This further reduces the intensity of the third ray rays incident on the first image sensing component, thereby further reducing overexposure of bright light by the first image sensing component, and thus helping to further improve the dynamic range of the camera module. It should be noted that the third ray rays passing through the second polarizer are only a portion of the third ray rays incident on the second polarizer (i.e., the portion of the third ray rays parallel to the polarization direction of the second polarizer).

[0186] Furthermore, optionally, the polarization direction of the second polarizer is perpendicular to the main polarization direction of the glare propagating through the second optical lens assembly. By introducing the second polarizer into the optical path of the high-resolution first image sensing assembly and designing the polarization direction of the second polarizer to be perpendicular to the main polarization direction of the received glare, the glare entering the high-resolution first image sensing assembly can be eliminated or reduced (the specific principle can be combined with the polarization state of the glare and the aforementioned...). Figure 2 (as described above), thus obtaining anti-glare and high dynamic range images.

[0187] In combination with the above Figure 7 Taking an example where the resolution of the first image sensing component is 8M and the resolution of the second image sensing component is 2M, and taking the intensity ratio of the first light ray to the second light ray as 2:8, Table 4 exemplarily shows the relationship between the dynamic range of the camera module based on Embodiment 2 and the dynamic range of camera modules based on the prior art.

[0188] Table 4 shows the dynamic range relationship between the camera module based on Embodiment 2 and the camera module based on existing technology.

[0189]

[0190] When the camera module also includes a second polarizer, based on Table 4 above and similar to the analysis in Table 1 above, the first image sensing component improves the overexposure prevention capability of bright targets by 2 times, the low-light capability of the second image sensing component improves the low-light capability of dim targets by 4 times, and the dynamic range of the camera module is 10log8.

[0191] Furthermore, optionally, the relationship between the intensity ratio of the third ray to the fourth ray and the improvement in dynamic range can be found in Table 3 above, and will not be repeated here.

[0192] IX. Second Processing Component

[0193] In one possible implementation, the second processing component can receive information from a fourth image from a first image sensing component and information from a fifth image from the second image sensing component, and obtain an image of the target object based on the information from the fourth and fifth images. Specifically, the second processing component is used to upsample the information from the fifth image to obtain information from a sixth image, the resolution of which is the same as the resolution of which is the resolution of which is the resolution of the fourth image; the information from the fourth image and the information from the sixth image are then fused to obtain an image of the target object.

[0194] For possible examples of the second processing component, please refer to the introduction of the first processing component; they will not be repeated here.

[0195] It should be noted that the camera module in Embodiment 2 may further include an infrared (IR) filter, which may be located between the second optical lens assembly and the first image sensing assembly, and / or between the third optical lens assembly and the second image sensing assembly. For a description of the IR filter, please refer to the foregoing related descriptions; it will not be repeated here.

[0196] Based on the above, and considering the specific hardware structure, a specific implementation of the camera module in Embodiment 2 is given below. This is to facilitate a further understanding of the structure of the camera module and the image formation process of the target object.

[0197] like Figure 11 The diagram shown is a structural schematic of another camera module provided in this application. This camera module may include a second optical lens assembly, a third optical lens assembly, a first image sensing assembly, a second image sensing assembly, a second polarizer located between the second optical lens assembly and the first image sensing assembly, and a second processing assembly. The first image sensing assembly comprises the aforementioned... Figure 7 Taking (a) as an example, the second image sensing component uses the above-mentioned... Figure 7 Take (b) as an example. In this example, the second and third optical lens assemblies can be represented by a single lens, and the specific structure can be found in the description of the first optical lens assembly above.

[0198] For possible implementations of the second optical lens assembly, the third optical lens assembly, the first image sensing assembly, the second image sensing assembly, the second polarizer, and the second processing assembly, please refer to the foregoing descriptions, which will not be repeated here.

[0199] based on Figure 11The camera module shown has the following configuration: light from the target object passes through a second optical lens assembly to obtain a third light ray, which is then propagated to a first image sensing assembly. Light from the target object passes through the third optical lens assembly to obtain a fourth light ray, which is propagated to a second polarizer and then to the second image sensing assembly. The first image sensing assembly converts the third light ray into a fourth electrical signal (i.e., information of the fourth image). The second image sensing assembly converts the fourth light ray into a fifth electrical signal (information of the fifth image). The fourth electrical signal can be further converted into a third digital image signal via an A / D converter, and the fifth electrical signal can be further converted into a fourth digital image signal via an A / D converter. Both the third and fourth digital image signals are transmitted to an ISP for processing (e.g., fusion) to obtain an image of the target object in a specific format. Optionally, the ISP can then transmit the image of the target object to a display screen for display.

[0200] Based on the structure and functional principles of the camera module described above, this application can also provide a terminal device. This terminal device may include the camera module in Embodiment 1 or the camera module in Embodiment 2. Further, optionally, the terminal device may also include a memory and a processor, the memory for storing programs or instructions; the processor for calling the programs or instructions to control the camera module to acquire images of the target object. It is understood that the terminal device may also include other devices, such as wireless communication devices, touchscreens, and displays.

[0201] like Figure 12 The diagram shown is a structural schematic of a terminal device provided in this application. The terminal device 1200 may include a processor 1201, a memory 1202, a camera module 1203, and a display screen 1204, etc. It should be understood that... Figure 12 The hardware structure shown is merely an example. The terminal devices to which this application applies may have more than [specific hardware configurations]. Figure 12 The terminal device shown may have more or fewer components, may combine two or more components, or may have different component configurations. Figure 12 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0202] The processor 1201 may include one or more processing units. For example, the processor 1201 may include an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP), a controller, a digital signal processor (DSP), etc. Different processing units may be independent devices or integrated into one or more processors 1201.

[0203] The memory 1202 may be in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disk, portable hard disk, CD-ROM, or any other form of storage medium known in the art. An exemplary memory 1202 is coupled to a processor 1201, enabling the processor 1201 to read information from and write information to the memory 1202. Of course, the memory 1202 may also be a component of the processor 1201. Alternatively, the processor 1201 and the memory 1202 may exist as discrete components in the terminal device.

[0204] The camera module 1203 can be used to capture moving and still images. In some embodiments, the terminal device may include one or N camera modules 1203, where N is a positive integer. A description of the camera module 1203 can be found in the foregoing embodiments and will not be repeated here.

[0205] When camera module 1203 is used as an in-vehicle camera module, based on its functions, it can be divided into driving assistance camera modules, parking assistance camera modules, and in-vehicle driver monitoring camera modules. Driving assistance camera modules are used for driving recording, lane departure warning, door opening warning, blind spot monitoring, and traffic sign recognition. Driving assistance camera modules include intelligent forward-looking (e.g., monocular / binocular / tricular) cameras, which can be used for dynamic object detection (vehicles, pedestrians), static object detection (traffic lights, traffic signs, lane lines, etc.), and navigable space delineation; side-view assistance (e.g., wide-angle) cameras, used to monitor dynamic targets in the blind spot of the rearview mirror during driving; and night vision assistance (e.g., night vision cameras), used to better detect target objects at night or in other low-light conditions. Parking assistance camera modules can be used for reversing images / 360° surround view, and 360° surround view (e.g., wide-angle / fisheye), mainly used for low-speed, close-range perception, forming a seamless 360° panoramic overhead view of the vehicle's surroundings. In-vehicle driver monitoring camera modules primarily provide one or more layers of early warning for dangerous situations such as driver fatigue, distraction, and improper driving. Based on their installation location within the terminal device, in-vehicle camera modules can be categorized into front-view camera modules, side-view camera modules, rear-view camera modules, and built-in camera modules.

[0206] The display screen 1204 can be used to display images, videos, etc. The display screen 1204 may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device may include one or Q displays 1204, where Q is a positive integer greater than 1. For example, the terminal device may implement display functions through a GPU, the display screen 1204, and a processor 1201.

[0207] For example, the terminal device may be a vehicle, smartphone, smart home device, smart manufacturing equipment, robot, drone or smart transportation equipment (such as AGV or unmanned transport vehicle, etc.).

[0208] Based on the above content and the same concept, this application provides an imaging method. Please refer to [link / reference]. Figure 13 This imaging method can be applied to any of the camera modules shown in Embodiment 1 above. It can also be understood that this imaging method can be implemented based on any of the camera modules shown in Embodiment 1 above.

[0209] like Figure 13 As shown, the imaging method includes the following steps:

[0210] Step 1301: Receive light from the target object.

[0211] This step 1301 can be implemented by the first optical lens assembly, which may be referred to in the above description of the first optical lens assembly receiving light from the target object, and will not be repeated here.

[0212] Step 1302: Spectrum the light rays from the target object to obtain a first ray and a second ray, and propagate the first ray to the first image sensing component and the second ray to the second image sensing component.

[0213] Here, the ratio of the intensity of the first ray to that of the second ray is less than 1.

[0214] Step 1302 can be implemented by a beam splitter, and possible implementation methods can be found in the aforementioned descriptions, which will not be repeated here.

[0215] In one possible implementation, the first light ray undergoes photoelectric conversion to obtain information of a first image; the second light ray undergoes photoelectric conversion to obtain information of a second image; and an image of the target object is generated based on the information of the first and second images. Further, optionally, the information of the second image can be upsampled to obtain information of a third image; the information of the first image and the information of the third image are then fused to obtain an image of the target object, wherein the resolution of the third image corresponding to the information of the third image is the same as that of the first image corresponding to the information of the first image. This process can be implemented by a first processing component; possible implementations can be found in the aforementioned description of the first processing component, and will not be repeated here.

[0216] Based on the above content and the same concept, this application provides an imaging method. Please refer to [link / reference]. Figure 14 This imaging method can be applied to any of the camera modules shown in Embodiment 2 above. It can also be understood that this imaging method can be implemented based on any of the camera modules shown in Embodiment 2 above.

[0217] like Figure 14 As shown, the imaging method includes the following steps:

[0218] Step 1401: Receive light from the target object.

[0219] Step 1402: A third ray is propagated to the first image sensing component, and a fourth ray is propagated to the second image sensing component.

[0220] Both steps 1401 and 1402 can be implemented by the second optical lens assembly and the third optical lens assembly. For possible implementation methods, please refer to the above description of the second optical lens assembly and the third optical lens assembly, which will not be repeated here.

[0221] In one possible implementation, the received third light ray can be photoelectrically converted to obtain information of a fourth image; the received fourth light ray can also be photoelectrically converted to obtain information of a fifth image; and an image of the target object can be obtained based on the information of the fourth and fifth images. Specifically, the information of the fifth image is upsampled to obtain information of a sixth image; the information of the fourth and sixth images is then fused to obtain an image of the target object, wherein the resolution of the sixth image corresponding to the information of the sixth image is the same as the resolution of the fourth image corresponding to the information of the fourth image. This process can be implemented by a second processing component; possible implementations can be found in the aforementioned description of the second processing component, and will not be repeated here.

[0222] It should be noted that the above imaging methods can be applied to vehicle-to-everything (V2X), long term evolution-vehicle (LTE-V) communication, and vehicle-to-everything (V2V) communication.

[0223] In the embodiments of this application, some steps can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, portable hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can reside in an ASIC. Additionally, the ASIC can reside in a network device or a terminal device. Alternatively, the processor and storage medium can exist as discrete components.

[0224] In the various embodiments of this application, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of different embodiments are consistent and can be referenced by each other. The technical features of different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0225] In this application, "vertical" does not refer to absolute verticality and a certain degree of error is permissible. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. In the textual description of this application, the character " / " generally indicates that the preceding and following related objects are in an "or" relationship. In the formulas of this application, the character " / " indicates that the preceding and following related objects are in a "division" relationship. Additionally, in this application, the term "exemplarily" is used to indicate an example, illustration, or explanation. Any embodiment or design scheme described as an "example" in this application should not be construed as superior or more advantageous than other embodiments or design schemes. Alternatively, it can be understood that the use of the term "example" is intended to present concepts in a specific manner and does not constitute a limitation on this application.

[0226] It is understood that the various numerical designations used in this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application. The order of the process numbers described above does not imply the order of execution; the execution order of each process should be determined by its function and inherent logic. Terms such as "first," "second," and similar expressions are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, such as including a series of steps or units. A method, system, product, or device is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or devices.

[0227] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made therein without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely illustrative examples of the solutions defined by the appended claims and are to be considered as covering any and all modifications, variations, combinations, or equivalents within the scope of this application.

[0228] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of the invention. Therefore, if these modifications and variations of the embodiments of this application fall within the scope of the claims of this application and their equivalents, this application also intends to include these modifications and variations.

Claims

1. A camera module, characterized in that, The device includes a first optical lens assembly, a beam splitter assembly, a first image sensing assembly, and a second image sensing assembly, and a first polarizer located between the beam splitter assembly and the first image sensing assembly. The polarization direction of the first polarizer is perpendicular to the main polarization direction of the glare propagating through the first optical lens assembly. The first image sensing assembly and the second image sensing assembly have the same photosensitive area, the resolution of the first image sensing assembly is greater than the resolution of the second image sensing assembly, and the sensitivity of the first image sensing assembly is less than the sensitivity of the second image sensing assembly. The first optical lens assembly is used to receive light from the target object; The beam splitter is used to split the light propagating through the first optical lens assembly to obtain a first ray and a second ray; the sum of the intensities of the first ray and the second ray is equal to or approximately equal to the intensity of the light propagating from the first optical lens assembly, and the ratio of the intensities of the first ray to the second ray is less than 1; the ratio of the intensities of the first ray to the second ray is determined by the reflectivity and transmittance of the beam splitter film coated on the beam splitter. The beam splitter is also used to propagate the first light to the first image sensing component and the second light to the second image sensing component.

2. The camera module as described in claim 1, characterized in that, The first image sensing component is used to perform photoelectric conversion on the received first light to obtain information of the first image; The second image sensing component is used to perform photoelectric conversion on the received second light to obtain information of the second image; The information from the first image and the information from the second image are used to form an image of the target object.

3. The camera module as described in any one of claims 1 to 2, characterized in that, The camera module further includes a first processing component for: Receive information about the first image from the first image sensing component and receive information about the second image from the second image sensing component; An image of the target object is generated based on the information from the first image and the information from the second image.

4. The camera module as described in claim 3, characterized in that, The first processing component is configured to: The information of the second image is upsampled to obtain the information of the third image, and the resolution of the third image corresponding to the information of the first image is the same as the resolution of the first image corresponding to the information of the first image. By fusing the information from the first image with the information from the third image, an image of the target object is obtained.

5. A terminal device, characterized in that, Includes the camera module as described in any one of claims 1 to 4.

6. The terminal device as described in claim 5, characterized in that, The terminal device includes any one of the following: Smartphones, vehicles, smart home devices, smart manufacturing equipment, robots, drones, surveying equipment, or smart transportation equipment.

7. An imaging method, characterized in that, The method is applied to a camera module, which includes a first image sensing component and a second image sensing component, and a first polarizer located between a beam splitter and the first image sensing component. The polarization direction of the first polarizer is perpendicular to the main polarization direction of the glare propagating through the first optical lens component. The first image sensing component and the second image sensing component have the same photosensitive area, the resolution of the first image sensing component is greater than the resolution of the second image sensing component, and the sensitivity of the first image sensing component is less than the sensitivity of the second image sensing component. Receives light from the target object; The light rays from the target object are split to obtain a first ray and a second ray; the sum of the intensities of the first ray and the second ray is equal to or approximately equal to the intensity of the light rays propagated from the optical lens assembly, and the ratio of the intensities of the first ray to the second ray is less than 1; the ratio of the intensities of the first ray to the second ray is determined by the reflectivity and transmittance of the beam-splitting film coated on the beam-splitting assembly. The first light is propagated to the first image sensing component, and the second light is propagated to the second image sensing component.

8. The method as described in claim 7, characterized in that, The method further includes: The first light beam is converted into photoelectric value to obtain information of the first image. The second light beam is photoelectrically converted to obtain information from the second image. An image of the target object is generated based on the information from the first image and the information from the second image.

9. The method as described in claim 8, characterized in that, The step of generating an image of the target object based on information from the first image and information from the second image includes: The information of the second image is upsampled to obtain the information of the third image, and the resolution of the third image corresponding to the information of the first image is the same as the resolution of the first image corresponding to the information of the first image. By fusing the information from the first image with the information from the third image, an image of the target object is obtained.

Images