Camera and image data adjusting method
By integrating the spectrometer module and processor in the camera, and adjusting the image data using spectral information, the problem that existing cameras cannot effectively record all bands of image light, achieving a more realistic and accurate image recording effect.
Patent Information
- Application Number
- CN202311129998.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-31
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2043-08-31
AI Technical Summary
The existing cameras cannot effectively record all bands of image light, resulting in distortion of the recorded image color information.
Design a camera that includes a light guidance module, an image sensing module, a spectrometer module and a processor. The light guidance module divides the image light into the first light and the second light, the image sensing module processes the first light, the spectrometer module acquires the spectral information of the second light, and the processor adjusts the image data based on the spectral information.
By acquiring the spectral information of the image light, the camera can adjust the image data more accurately, so that the image data is more realistic and accurate, and the recorded color information is closer to the actual image light.
Smart Images

Figure CN119545132A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to a camera and an image data adjustment method using the camera. Background Art
[0002] Existing cameras generally use image sensors to receive and record the intensity of light in the bands corresponding to the three colors of red, green, and blue (RGB) in the image light, thereby recording images / pictures. However, the RGB light intensity information recorded by the image sensor usually cannot cover all the bands of the real image light, which will cause the color information of the recorded image / picture to be distorted. An existing solution is to use an algorithm to adjust the RGB light intensity information recorded by the image / image sensor to compensate for the image / picture, but the algorithm still cannot restore the real image light. Summary of the invention
[0003] On one hand, the present application provides a camera, comprising:
[0004] A light guiding module, used for receiving external image light and splitting the image light into a first light and a second light;
[0005] An image sensing module, configured to receive the first light and convert the first light into image data;
[0006] a spectrometer module, configured to receive the second light and obtain spectrum information of the second light; and
[0007] A processor is electrically connected to the image sensing module and the spectrometer module, and is used to adjust the image data according to the spectral information.
[0008] The image data includes a plurality of pixel data, each of the pixel data includes light intensity information of three primary color lights, and the processor is used to adjust the light intensity information corresponding to each of the primary color lights in the pixel data according to the spectrum information.
[0009] The camera provided in the embodiment of the present application can obtain the spectrum information of the image light while the image sensing module obtains the image data by setting the spectrometer module, thereby obtaining the real color information of the image light. By setting the processor, the image data obtained by the image sensing module can be optimized according to the spectrum information, thereby making the image data more real and accurate.
[0010] In one embodiment, the spectrometer module includes a superlens and a spectrometer sensor, the superlens is used to disperse the second light, the spectrometer sensor is used to receive the dispersed second light, and the superlens includes a substrate and a plurality of nanostructures arranged on the substrate.
[0011] In one embodiment, the spectrometer module further comprises a slit, and the slit is arranged between the light guiding module and the super lens, and is used to converge the second light.
[0012] In one embodiment, the metalens transmits the dispersed second light to the spectrometer sensor.
[0013] In one embodiment, the metalens reflects the dispersed second light to the spectrometer sensor.
[0014] In one embodiment, the light guiding module includes a lens module and a beam splitting module, the lens module is used to receive the image light, and the beam splitting module is used to transmit and emit the first light and to reflect and emit the second light.
[0015] In one embodiment, the light guiding module includes a reflection module, a lens module and a beam splitting module, the reflection module is used to reflect the image light to the lens module, the beam splitting module is used to reflect and emit the first light, and is used to transmit and emit the second light.
[0016] In one embodiment, the light guiding module includes a reflection module, a lens module and a beam splitting module, the beam splitting module is used to reflect the first light toward the lens module and to transmit the second light; the reflection module is used to reflect the first light.
[0017] On the other hand, the present application provides an image data adjustment method, which is applied to the above-mentioned camera, comprising:
[0018] Calculating the light intensity ratio of the three primary colors of light in the spectral information;
[0019] According to the light intensity ratio of the three primary color lights in the spectrum information, the light intensity of each primary color light in each pixel data is adjusted.
[0020] In one embodiment, the image data adjustment method further includes:
[0021] Acquire the types and quantities of primary color lights included in a display module for displaying the image data;
[0022] Calculating the light intensity ratios of the multiple primary color lights corresponding to the display module in the spectrum information according to the types and quantities of the primary color lights included in the display module;
[0023] According to the light intensity ratio of the three primary colors in the image data and the light intensity ratio of the multiple primary colors in the corresponding display module in the spectrum information, the image data is adjusted to include the light intensity data of the multiple primary colors of the corresponding display module. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 This is a schematic diagram of the structure of the camera in Example 1 of the present application.
[0025] Figure 2 Schematic diagram of the placement of the spectrometer sensor in one embodiment of the present application.
[0026] Figure 3 This is a schematic diagram of the placement of a spectrometer sensor in another embodiment of the present application.
[0027] Figure 4 This is a schematic diagram of the placement of spectrometer sensors in other embodiments of the present application.
[0028] Figure 5 This is a schematic diagram of the placement of spectrometer sensors in other embodiments of the present application.
[0029] Figure 6 This is a working principle diagram of a processor in one embodiment of the present application.
[0030] Figure 7 This is a schematic diagram of the structure of the camera in the second embodiment of the present application.
[0031] Figure 8 This is a schematic diagram of the structure of the camera in Example 3 of the present application.
[0032] Fig. 9 This is a flowchart of the image data adjustment method in Embodiment 4 of the present application.
[0033] Main component symbols
[0034] Camera 100, 200, 300
[0035] Light guide modules 110, 210, 310
[0036] Lens module 111, 211, 311
[0037] Beam splitting modules 113, 213, 313
[0038] Reflection modules 215, 315
[0039] Image sensing modules 130, 230, 330
[0040] Spectrometer modules 150, 250, 350
[0041] Slit 151, 251, 351
[0042] Super Lens 153, 253, 353
[0043] Substrate 153a
[0044] Nanostructure 153b
[0045] Spectrometer sensor 155, 255, 355
[0046] Processor 170, 270, 370
[0047] Image Light L0
[0048] First Light L1
[0049] Second Light L2
[0050] First direction X
[0051] Second direction Y
[0052] The third direction Z
[0053] Steps S1 and S2
[0054] The following specific implementation methods will further illustrate the present application in conjunction with the above-mentioned drawings. DETAILED DESCRIPTION
[0055] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.
[0056] Unless otherwise defined, all technical and scientific terms used in this application have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.
[0057] In order to further explain the technical means and effects adopted by the present application to achieve the intended purpose, the present application is described in detail below in conjunction with the accompanying drawings and preferred implementation methods.
[0058] Embodiment 1
[0059] The first embodiment of the present application provides a camera. Figure 1The camera 100 includes a light guiding module 110, an image sensing module 130, a spectrometer module 150 and a processor 170. The light guiding module 110 is used to receive external image light L0, and split the image light L0 into a first light L1 and a second light L2. The image sensing module 130 is used to receive the first light L1 and convert the first light L1 into image data. The spectrometer module 150 is used to receive the second light L2 and obtain spectral information of the second light L2. The processor 170 is electrically connected to the image sensing module 130 and the spectrometer module 150, and is used to adjust the image data according to the spectral information. Among them, the image data includes a plurality of pixel data, each pixel data includes light intensity information of three primary color lights, and the processor 170 is used to adjust the light intensity information corresponding to each primary color light in the pixel data according to the spectral information.
[0060] The light guiding module 110 includes a lens module 111 and a beam splitting module 113. The lens module 111 is used to receive the image light L0, and the beam splitting module 113 is used to transmit and emit the first light L1, and to reflect and emit the second light L2. Specifically, the lens module 111 is a lens or a lens group, which is used to converge the image light L0 so as to obtain image data. The beam splitting module 113 is a semi-transmissive and semi-reflective beam splitting optical element, which is used to transmit a part of the image light L0 and reflect another part of the image light L0, so as to split the image light L0 into the first light L1 and the second light L2, and guide the first light L1 to the image sensing module 130, and guide the second light L2 to the spectrometer module 150, respectively. Among them, the first light L1 and the second light L2 include the same color information, that is, the first light L1 and the second light L2 split by the beam splitting module 113 both retain the color information of the image light L0.
[0061] In this embodiment, the semi-transparent and semi-reflective beam splitting module 113 is a beam splitting prism composed of two right-angle prisms, the oblique surfaces of the two right-angle prisms are attached to each other, and a semi-transparent and semi-reflective film is arranged on the oblique surface of one of the right-angle prisms. When the image light L0 is incident on the semi-transparent and semi-reflective film, a part of the image light L0 passes through the semi-transparent and semi-reflective film, and the other part of the image light L0 is reflected by the semi-transparent and semi-reflective film, thereby splitting into a first light L1 and a second light L2. In another embodiment, the semi-transparent and semi-reflective beam splitting module 113 can also be a flat beam splitter (not shown), that is, a semi-transparent and semi-reflective film is arranged on the surface of a plate-shaped transparent substrate, so as to split the image light L0.
[0062] The beam splitting module 113 can also be other types of beam splitting optical elements, which are not limited in the present application. As long as the image light L0 can be split into the first light L1 and the second light L2 with the same color information, it is within the scope of the present application.
[0063] The image sensor module 130 may be a photoelectric conversion element such as a Charged Coupled Device (CCD) or a Complementary Metal-Oxide Semiconductor (CMOS). The image sensor 130 may be divided into a plurality of pixel regions, each of which is used to record light intensity information of a group of RGB primary color lights, so as to be recorded in the pixel data as the color information corresponding to the pixel region, and the pixel data of the plurality of pixel regions are combined together to form image data recording the image light L0.
[0064] The spectrometer module 150 includes a slit 151, a super lens 153, and a spectrometer sensor 155. The slit 151 is disposed between the light guide module 110 and the super lens 153, and is used to converge the second light L2. The super lens 153 is used to disperse the second light L2, so that the second light L2 emits multiple monochromatic lights with different wavelengths, and the emission angles of different monochromatic lights are arranged according to the size of the wavelength. The spectrometer sensor 155 is used to receive the dispersed second light L2, and record the color and light intensity of each monochromatic light, thereby recording the spectrum information of the second light L2.
[0065] The slit 151 is used to constrain the second light L2 input to the spectrometer sensor 155. That is, the slit 151 is used to control the beam cross-sectional size of the second light L2 incident on the super lens 153, thereby controlling the cross-sectional size of the light spot incident on the spectrometer sensor 155 after dispersion. Specifically, the smaller the size of the slit 151, the smaller the beam cross-sectional size of the second light L2 incident on the superlens 153, and the smaller the beam cross-sectional size of the dispersed second light L2 emitted from the superlens. At this time, even if the spectrometer sensor 155 is closer to the superlens 153, it can still obtain more accurate spectral information, but the smaller beam cross-sectional size also requires higher placement accuracy of the spectrometer sensor 155; when the size of the slit 151 increases, the size of the second light L2 incident on the superlens 153 increases, and the beam cross-sectional size of the dispersed second light L2 emitted from the superlens 153 increases. At this time, the spectrometer sensor 155 needs to be away from the superlens 153 to avoid the overlap of multiple light spots of the dispersed second light L2 on the spectrometer sensor 155, thereby increasing the overall volume of the spectrometer module 150, but the larger beam cross-sectional size reduces the placement accuracy of the spectrometer sensor 155, that is, reduces the difficulty of assembly.
[0066] The superlens 153 includes a transparent substrate 153a and a plurality of nanostructures 153b disposed on the substrate 153a. The nanostructure 153b is specifically a columnar structure with a size ranging from tens of nanometers to hundreds of nanometers. The plurality of nanostructures 153b are arranged in an array on the substrate 153a, thereby achieving a dispersion effect on the second light L2. The embodiment of the present application is beneficial to reducing the number of elements for dispersing the second light L2 by setting the superlens 153 as a dispersion element for the second light L2, which is beneficial to reducing the volume of the spectrometer module 150 and improving space utilization. The structural design of the superlens 153 to achieve dispersion has been implemented in the prior art and will not be repeated herein.
[0067] In this embodiment, the superlens 153 transmits the dispersed second light L2 to the spectrometer sensor 155. In other embodiments, the superlens 153 may also reflect the dispersed second light L2 to the spectrometer sensor 155, and the present application does not limit this. The superlens 153 may be set to transmit or reflect according to the actual optical path design and the need to improve space utilization. As long as the superlens 153 can disperse the second light L2, it is within the scope of the present application.
[0068] The spectrometer sensor 155 may be a one-dimensional linear photoelectric sensor, or a two-dimensional narrow-width photoelectric sensor or an array photoelectric sensor, which is not limited in the present application.
[0069] Please also read Figure 2 and Figure 3 In this embodiment, the placement position of the spectrometer sensor 155 can be determined according to the dispersion direction of the second light L2. Specifically, the divergent second light L2 emitted from the superlens 153 can be arranged along the second direction Y parallel to the superlens 153, or can be arranged along the first direction X perpendicular to the superlens 153. According to the arrangement direction of the divergent second light L2, the placement position of the spectrometer sensor 155 needs to be set accordingly. Taking the case where the spectrometer sensor 155 is placed perpendicular to the third direction Z as an example, when the divergent second light L2 is arranged along the first direction X or the second direction Y, the spectrometer sensor 155 also needs to adjust its position accordingly to receive the divergent multiple beams of second light L2.
[0070] Please also read Figure 4 and Figure 5In other embodiments, the spectrometer sensor 155 may also be placed perpendicular to the first direction X. Specifically, the placement position of the spectrometer sensor 155 is determined by the deflection direction of the second light L2. When the second light L2 is emitted along the first direction X, the spectrometer sensor 155 may be arranged to be placed perpendicular to the first direction X. The placement direction of the spectrometer sensor 155 is also related to the dispersion direction of the second light L2. When the diverged second light L2 is arranged along the third direction Z or along the second direction Y, the spectrometer sensor 155 also needs to adjust its position accordingly to receive the diverged multiple beams of second light L2.
[0071] The operating wavelengths of the image sensing module 130 and the spectrometer module 150 may be in the same range or in different ranges, depending on the specific usage requirements.
[0072] In this embodiment, the processor 170 may be a central processing unit or other integrated circuit, which is not limited in this application. The processor 170 may be integrated with the image sensing module 130 on the same circuit board, or integrated with the spectrometer sensor 155 on the same circuit board, or may be independent of the image sensing module 130 and the spectrometer sensor 155.
[0073] See also Figure 6 , the processor 170 is used to receive the image data collected by the image sensing module 130 and the spectral information obtained by the spectrometer module 150, and adjust the image data according to the spectral information. Specifically, the image light L0 usually includes light of multiple wavelengths, and the light intensity of each wavelength is different, so that different colors of light are formed in combination. The image data collected by the image sensing module 130 only includes the light intensity of the primary color light of three bands, so the light intensity information of the light of other bands cannot be collected by the image sensing module 130. The spectral information includes the light intensity information of the light of multiple bands, so it restores the color information of the image light L0 more than the image data. According to the spectral information, the light intensity of the three primary colors in the image data can be adjusted accordingly, so that the color recorded in the image data is closer to the actual image light L0. That is, the spectral information can be split into data containing only the three primary colors, so that the information of the light of other bands is decomposed into the three primary colors, and the ratio between the light intensities of the three primary colors after the split is used as a reference to adjust the ratio between the light intensities of the three primary colors in the image data.
[0074] In this embodiment, the image sensing module 130 can also work alone as a common camera, and the spectrometer module 150 can also be used alone as a spectrometer. The present application does not limit the specific usage of the camera 100.
[0075] The camera 100 provided in the embodiment of the present application, by setting the camera 100 to include both the image sensing module 130 and the spectrometer module 150, can obtain the spectral information of the image light L0 through the spectrometer module 150, thereby adjusting the image data obtained by the image sensing module 130, so that the image data can better restore the true color of the image light L0, thereby improving the image recording effect. By setting the spectrometer module 150 to include the super lens 153, it is helpful to reduce the number of dispersion elements, thereby reducing the volume and improving the space utilization of the camera 100. By setting the image sensing module 130 and the spectrometer module 150 to work separately, it is helpful to improve the application scenarios of the camera 100.
[0076] Embodiment 2
[0077] See also Figure 7 , Embodiment 2 of the present application provides a camera 200, which includes a light guiding module 210, an image sensing module 230, a spectrometer module 250 and a processor 270. The light guiding module 210 is used to receive external image light L0, and split the image light L0 into a first light L1 and a second light L2. The image sensing module 230 is used to receive the first light L1, and convert the first light L1 into image data. The spectrometer module 250 is used to receive the second light L2, and obtain spectral information of the second light L2. The processor 270 is electrically connected to the image sensing module 230 and the spectrometer module 250, and is used to adjust the image data according to the spectral information. Among them, the image data includes a plurality of pixel data, each pixel data includes light intensity information of three primary color lights, and the processor 270 is used to adjust the light intensity information corresponding to each primary color light in the pixel data according to the spectral information.
[0078] The difference from the first embodiment is that in this embodiment, the light guiding module 210 includes a lens module 211, a beam splitting module 213 and a reflection module 215. The reflection module 215 is used to receive the image light L0 and reflect the image light L0 to the lens module 211, the lens module 211 is used to receive the image light L0 and emit the image light L0 to the beam splitting module 213, and the beam splitting module 213 is used to reflect the first light L1 and transmit the second light L2. That is, the reflection module 215, the lens module 211 and the beam splitting module 213 are arranged in sequence.
[0079] The reflection module 215 may include one of a prism and a plane mirror. Specifically, the reflection module 215 may be a right-angle prism, which reflects the image light L0 to the lens module 211 through the total reflection principle of the inclined surface, or may reflect the image light L0 by coating a layer of reflective film on the inclined surface. The reflection module 215 may also be a plane reflector, which directly reflects the image light L0 to the lens module 211, and the present application does not limit this.
[0080] The beam splitting module 213 may include one of a prism and a flat beam splitter. Specifically, the beam splitting module 213 may be a right-angle prism, which splits the image light L0 into a first light L1 and a second light L2 by setting a semi-transmissive and semi-reflective film on the inclined surface. The image sensing module 230 is arranged on a right-angle surface of the right-angle prism, and is used to receive the reflected first light L1. The spectrometer module 250 is arranged on the inclined surface of the right-angle prism, and is used to receive the transmitted second light L2. Among them, the slit 251 is arranged on the inclined surface of the right-angle prism, and the super lens 253 is arranged on the optical path of the second light L2, and is spaced from the slit 251. The super lens 253 is used to reflect the second light to the spectrometer sensor 255. In other embodiments, the beam splitting module 213 may also be a beam splitting prism composed of two right-angle prisms, or a flat beam splitter. The super lens 253 may also transmit the second light L2. This application does not impose any limitation on this, and the specific structures of the beam splitting module 213 and the spectrometer module 250 can be set according to specific needs.
[0081] The camera 200 provided in the second embodiment of the present application can change the positions of the image sensing module 230 and the spectrometer module 250 accordingly by setting the relative positions between the lens module 211, the beam splitting module 213 and the reflection module 215 in the light guiding module 210, thereby achieving adjustment of the structure of the camera 200, which is beneficial to improving space utilization.
[0082] Embodiment 3
[0083] See also Figure 8 , Embodiment 3 of the present application provides a camera 300, which includes a light guiding module 310, an image sensing module 330, a spectrometer module 350 and a processor 370. The light guiding module 310 is used to receive external image light L0, and split the image light L0 into a first light L1 and a second light L2. The image sensing module 330 is used to receive the first light L1, and convert the first light L1 into image data. The spectrometer module 350 is used to receive the second light L2, and obtain spectral information of the second light L2. The processor 370 is electrically connected to the image sensing module 330 and the spectrometer module 350, and is used to adjust the image data according to the spectral information. Among them, the image data includes a plurality of pixel data, each pixel data includes light intensity information of three primary color lights, and the processor 370 is used to adjust the light intensity information corresponding to each primary color light in the pixel data according to the spectral information.
[0084] The difference from the second embodiment is that in this embodiment, the light guiding module 310 includes a lens module 311, a beam splitting module 313 and a reflection module 315. The beam splitting module 313 is used to receive the image light L0, and reflect the first light L1 to the lens module 311, and transmit the second light L2 to the spectrometer module 350. The lens module 311 is used to receive and emit the first light L1, and the reflection module 315 is used to receive the first light L1 emitted by the lens module 311, and reflect the first light L1 to the image sensing module 330. That is, the beam splitting module 313, the lens module 311 and the reflection module 315 are arranged in sequence.
[0085] Specifically, the beam splitting module 313 may include one of a prism and a flat beam splitter. For example, the beam splitting module 313 is a right-angle prism, and the inclined surface of the right-angle prism is coated with a semi-transmissive and semi-reflective film, which can split the image light L0 into the first light L1 and the second light L2. The spectrometer module 350 is arranged on one side of the inclined surface of the right-angle prism, and is used to receive the transmitted second light L2. Among them, the slit 351 is arranged on the inclined surface of the right-angle prism, and the super lens 353 is arranged on the optical path of the second light L2, and is arranged at a distance from the slit 351. The super lens 353 is used to reflect the second light to the spectrometer sensor 355. In other embodiments, the beam splitting module 313 can also be a beam splitting prism composed of two right-angle prisms, or a flat beam splitter. The super lens 353 can also transmit and emit the second light L2. This application is not limited to this, and the specific structure of the beam splitting module 313 and the spectrometer module 350 can be set according to specific needs.
[0086] The reflection module 315 is arranged on the side of the lens module 311 from which the first light L1 is emitted, and is used to reflect the first light L1 to the image sensing module 330. The reflection module 315 includes one of a prism and a plane mirror. Specifically, the reflection module 315 can be a right-angle prism, which reflects the first light L1 incident on the inclined surface to the image sensing module 330 through the principle of total reflection, or can reflect the first light L1 by coating a layer of reflective film on the inclined surface. The reflection module 315 can also be a plane reflector, which directly reflects the first light L1 to the image sensing module 330, and the present application does not limit this.
[0087] The camera 300 provided in the third embodiment of the present application can change the positions of the image sensing module 330 and the spectrometer module 350 accordingly by setting the relative positions between the lens module 311, the beam splitting module 313 and the reflection module 315 in the light guiding module 310, thereby achieving adjustment of the structure of the camera 300, which is beneficial to improving space utilization.
[0088] Embodiment 4
[0089] Embodiment 4 of the present application provides an image data adjustment method, which can be applied to any camera in Embodiments 1 to 3. Fig. 9 , which includes:
[0090] Step S1: Calculate the light intensity ratio of the three primary colors in the spectrum information;
[0091] Step S2: adjusting the light intensity of each primary color light in each pixel data according to the light intensity ratio of the three primary color lights in the spectrum information.
[0092] Specifically, the camera simultaneously obtains image data and spectral information for recording the image light L0. The image data includes a plurality of pixel data, each pixel data is used to record the color and brightness of a part of the image light L0, and the plurality of pixel data are combined together to form a recorded image. Each pixel data includes the light intensity information of three primary colors, and the three primary colors are mixed together to form the color of a pixel. The spectral information records the spectral information of the image light L0 as a whole, that is, the light intensity of the light of different bands included in the image light L0 as a whole. Among them, the image data can only record the light intensity of the three primary colors, but cannot record the light intensity of other bands. Therefore, in step S1, the spectral information can be split into three primary colors, and the light intensity ratio of the three primary colors is obtained, so as to obtain the light intensity ratio of the three primary colors in the image light L0, and in step S2, according to the light intensity ratio of the three primary colors in the spectral information, the light intensity of each primary color in each pixel data is adjusted, so as to adjust the image data so that the image data is closer to the image light L0.
[0093] In this embodiment, the image data adjustment method further includes:
[0094] Step S21: obtaining the types and quantities of primary color lights included in the display module for displaying image data;
[0095] Step S22: calculating the light intensity ratios of the multiple primary color lights corresponding to the display module in the spectrum information according to the types and quantities of the primary color lights included in the display module;
[0096] Step S23: adjusting the image data to include the light intensities of the multiple primary colors of the corresponding display module according to the light intensities of the three primary colors of the image data and the light intensities ratios of the multiple primary colors of the corresponding display module in the spectrum information.
[0097] Specifically, current image sensing modules usually record the light intensity data of the three primary colors of RGB, thereby recording the color of each pixel. However, in addition to the common display based on the three primary colors of RGB, current displays also include display modules based on other types and quantities of primary colors, such as RGBY pixels including yellow light, or RGBW pixels including white light, etc. Usually, when displaying, the image data is directly converted into the data of the primary colors of the corresponding display module, but there is still a situation where the recorded information is distorted. In step S22, the light intensity ratios of the multiple primary colors of the corresponding display module can be obtained according to the spectral information, and in step S23, the image data is combined with the spectral information to adjust the original light intensity of the three primary colors of RGB in the image data, and generate light intensity data of other primary colors. For example, when the display module is an RGBY pixel display, the light intensity ratio of red light, green light, blue light and yellow light in the image light L0 can be obtained through spectral information, and the light intensity of red light, green light and blue light in the image data can be adjusted accordingly, and the data of yellow light can be generated again, thereby obtaining image data including the light intensity information of the four primary colors of RGBY.
[0098] In this embodiment, step S1 and step S2 may be performed first to adjust the image data, and then when the image needs to be displayed, step S21, step S22 and step S23 may be performed. In other embodiments, step S21 may be performed first, and it may be determined whether the display module includes only three primary colors of RGB. If yes, step S1 and step S2 may be performed; if no, step S22 and step S23 may be performed. Step S1 and step S2 may also be performed separately, or step S21, step S22 and step S23 may be performed separately. This application does not limit this.
[0099] The image data adjustment method provided in the embodiment of the present application obtains the light intensity ratio of the primary color light in the spectral information and then adjusts the image data accordingly, which is beneficial for making the color information recorded in the image data closer to the image light L0, so that the image data can better restore the true color of the image light L0, thereby improving the image recording effect.
[0100] Those skilled in the art should recognize that the above embodiments are only used to illustrate the present application and are not intended to be limiting of the present application. As long as they are within the spirit and scope of the present application, appropriate changes and modifications to the above embodiments are within the scope of protection claimed in the present application.
Claims
1. A camera, characterized in that: include: A light guiding module, used for receiving external image light and splitting the image light into a first light and a second light; An image sensing module, configured to receive the first light and convert the first light into image data; A spectrometer module, used for receiving the second light and obtaining spectrum information of the second light; as well as a processor, electrically connected to the image sensing module and the spectrometer module, and configured to adjust the image data according to the spectral information; The image data includes a plurality of pixel data, each of the pixel data includes light intensity information of three primary color lights, and the processor is used to adjust the light intensity information corresponding to each of the primary color lights in the pixel data according to the spectrum information.
2. The camera according to claim 1, characterized in that The spectrometer module includes a superlens and a spectrometer sensor. The superlens is used to disperse the second light. The spectrometer sensor is used to receive the dispersed second light. The superlens includes a substrate and a plurality of nanostructures arranged on the substrate.
3. The camera according to claim 2, characterized in that The spectrometer module also includes a slit, which is arranged between the light guiding module and the super lens and is used to converge the second light.
4. The camera according to claim 2, characterized in that The superlens transmits the dispersed second light to the spectrometer sensor.
5. The camera according to claim 2, characterized in that The superlens reflects the dispersed second light and emits it to the spectrometer sensor.
6. The camera according to claim 1, wherein: The light guiding module includes a lens module and a beam splitting module. The lens module is used to receive the image light, and the beam splitting module is used to transmit and emit the first light and to reflect and emit the second light.
7. The camera according to claim 1, characterized in that The light guiding module includes a reflection module, a lens module and a beam splitting module. The reflection module is used to reflect the image light to the lens module, and the beam splitting module is used to reflect and emit the first light and to transmit and emit the second light.
8. The camera according to claim 1, wherein: The light guiding module includes a reflection module, a lens module and a beam splitting module. The beam splitting module is used to reflect the first light toward the lens module and transmit the second light; the reflection module is used to reflect the first light.
9. An image data adjustment method, applied to a camera as claimed in any one of claims 1 to 8, characterized in that: include: Calculating the light intensity ratio of the three primary colors of light in the spectral information; According to the light intensity ratio of the three primary color lights in the spectrum information, the light intensity of each primary color light in each pixel data is adjusted.
10. The image data adjustment method according to claim 9, wherein: Also includes: Acquire the types and quantities of primary color lights included in a display module for displaying the image data; Calculating the light intensity ratios of the multiple primary color lights corresponding to the display module in the spectrum information according to the types and quantities of the primary color lights included in the display module; According to the light intensity ratio of the three primary colors in the image data and the light intensity ratio of the multiple primary colors in the corresponding display module in the spectrum information, the image data is adjusted to include the light intensity data of the multiple primary colors of the corresponding display module.
Citation Information
Patent Citations
Hyperspectral imaging equipment
CN113125010A
Light source spectrum obtaining method and device
CN114531578A
Imaging spectrometer
TW201144775A
A system and method for color image acquisition
US20160171653A1
Imaging apparatus and capsule endoscope
WO2023116727A1