Optical filters for optical sensor devices

Abstract

The optical sensor device includes an optical sensor having a set of sensor elements, an optical filter including a plurality of regions, and one or more processors. The plurality of regions includes a first set of optical channels comprising optical channels configured to pass light associated with each of the sub-ranges of a first wavelength range, a second set of optical channels comprising optical channels configured to pass light associated with each of the sub-ranges of a second wavelength range, and a third set of optical channels comprising optical channels configured to pass light associated with each of the sub-ranges of a third wavelength range. The one or more processors are configured to obtain sensor data associated with the scene from the optical sensor and determine image information associated with the scene based on the spectral information.

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This patent application claims priority to U.S. patent application Ser. No. 17 / 228,068, filed April 12, 2021, entitled "OPTICAL FILTER FOR AN OPTICAL SENSOR DEVICE," which is expressly incorporated herein by reference. [Background technology]

[0002] An optical sensor device may be utilized to capture information about the light. For example, the optical sensor device may capture information about a set of wavelengths associated with the light. The optical sensor device may include a set of sensor elements (e.g., optical sensors, spectral sensors, and / or image sensors) that capture information. For example, an array of sensor elements may be utilized to capture information related to multiple wavelengths. The sensor element array may be associated with an optical filter. The optical filter may include one or more channels that each pass specific wavelengths to the sensor elements of the sensor element array. Summary of the Invention

[0003] In some embodiments, an optical sensor device comprises: an optical sensor including a set of sensor elements; an optical filter disposed over the optical sensor and including a plurality of regions, the regions including: a first set of optical channels having optical channels configured to pass light associated with each subrange of a first wavelength range to each of a first subset of sensor elements in the set of sensor elements of the optical sensor; a second set of optical channels having optical channels configured to pass light associated with each subrange of a second wavelength range to each of a second subset of sensor elements in the set of sensor elements of the optical sensor; and a third set of optical channels having optical channels configured to pass light associated with each subrange of a third wavelength range to each of a third subset of sensor elements in the set of sensor elements of the optical sensor; and the one or more processors configured to acquire sensor data related to a scene from the optical sensor, determine spectral information related to the scene based on the sensor data, determine image information related to the scene based on the spectral information, and provide image information.

[0004] In some embodiments, an optical sensor device comprises: an optical sensor comprising a set of sensor elements; and an optical filter disposed over the optical sensor and comprising a plurality of regions, the regions including: a first set of optical channels having optical channels configured to pass light associated with each of subranges of a first wavelength range to each of a first subset of sensor elements in the set of sensor elements of the optical sensor; a second set of optical channels having optical channels configured to pass light associated with each of subranges of a second wavelength range to each of a second subset of sensor elements in the set of sensor elements of the optical sensor; and a third set of optical channels having optical channels configured to pass light associated with each of subranges of a third wavelength range to each of a third subset of sensor elements in the set of sensor elements of the optical sensor.

[0005] In some embodiments, the optical filter comprises a plurality of regions, the regions of the plurality of regions of the optical filter including: a first set of optical channels associated with passing light associated with a first wavelength range, wherein each optical channel of the first set of optical channels is configured to pass light associated with a particular sub-range of the first wavelength range; a second set of optical channels associated with passing light associated with a second wavelength range, wherein each optical channel of the second set of optical channels is configured to pass light associated with a particular sub-range of the second wavelength range; and a third set of optical channels associated with passing light associated with a third wavelength range, wherein each optical channel of the third set of optical channels is configured to pass light associated with a particular sub-range of the third wavelength range. [Brief explanation of the drawings]

[0006] [Figure 1A]1 is a diagram of an exemplary embodiment described herein. [Figure 1B] 1 is a diagram of an exemplary embodiment described herein. [Figure 1C] 1 is a diagram of an exemplary embodiment described herein. [Figure 1D] 1 is a diagram of an exemplary embodiment described herein. [Figure 2] 1 is a diagram of the transmission characteristics of a conventional red-green-blue (RGB) optical filter and an optical filter described herein. [Figure 3] FIG. 1 illustrates an example environment in which the systems and / or methods described herein may be implemented. [Figure 4] FIG. 4 is a diagram of example components of one or more devices of FIG. 3. [Figure 5] 1 is a flowchart of an exemplary process involving an optical sensor device. DETAILED DESCRIPTION OF THE INVENTION

[0007] The following detailed description of exemplary embodiments refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. The following description uses a spectrometer as an example. However, the techniques, principles, procedures, and methods described herein can be used with any sensor, including, but not limited to, other optical and spectral sensors.

[0008] A conventional optical sensor device, such as an imaging device, may be configured to determine color information associated with light (e.g., ambient light) of a scene captured by the optical sensor device. Light may enter the optical sensor device and be received by a red-green-blue (RGB) optical filter, such as a Bayer filter, and an optical sensor of the optical sensor device (e.g., the RGB optical filter is disposed on the optical sensor). The RGB optical filter may include a two-dimensional array of optical channels, where any 2×2 portion of the array includes a single optical channel configured to pass red light, a single optical channel configured to pass blue light, and two optical channels configured to pass green light (e.g., to mimic the color perception of the human eye). The light that passes through the RGB optical filter is transmitted to the optical sensor, which generates sensor data.

[0009] The processor can process the sensor data using demosaicing techniques to determine color points (e.g., in a color space such as the International Commission on Illumination (CIE) 1931 RGB color space) associated with a 2×2 portion of the array of optical channels. These color points can be used to generate an image (e.g., a digital image) of the scene. For example, when using demosaicing techniques, the processor can process color points associated with a 2×2 portion of the array based on sensor data associated with a single optical channel configured to pass red light, a single optical channel configured to pass blue light, and two optical channels configured to pass green light, which are part of the 2×2 portion. However, these optical channels often pass light associated with wide, overlapping wavelength bands (e.g., as further described herein with reference to FIG. 2 ), which can cause the demosaicing techniques to produce color points that introduce artifacts (e.g., false color artifacts, zippering artifacts, and / or purple fringing artifacts, among other examples) into an image generated from the color points. This reduces the color accuracy of the image and, therefore, distorts the representation of the scene in the image.

[0010] Some embodiments described herein provide an optical sensor device including an optical filter, an optical sensor, and one or more processors. The optical filter may include a plurality of optical channels within a plurality of regions of the optical filter. The regions of the plurality of regions may include a first set of optical channels comprising optical channels configured to pass light associated with each of the subranges of a first wavelength range (e.g., associated with red light), a second set of optical channels comprising optical channels configured to pass light associated with each of the subranges of a second wavelength range (e.g., associated with blue light), and a third set of optical channels comprising optical channels configured to pass light associated with each of the subranges of a third wavelength range (e.g., associated with green light). A first number of optical channels may be included in the first set of optical channels, a second number of optical channels may be included in the second set of optical channels, and a second number of optical channels may be included in the third set of optical channels, where the second number is twice the first number.

[0011] In this manner, a region of the optical filter may include optical channels associated with a first wavelength range (e.g., associated with red light), optical channels associated with a second wavelength range (e.g., associated with blue light), and optical channels associated with a third wavelength range (e.g., associated with green light) in the same (e.g., equal) proportions as a 2×2 fraction of the array of optical channels of a conventional RGB optical filter. Thus, sensor data associated with a region of the optical filter (e.g., generated by an optical sensor based on light associated with a scene passing through the optical channels in the region) may be processed by one or more processors using demosaicing techniques to determine a color point associated with the region.

[0012] Additionally, the optical filters may pass light associated with narrow, non-overlapping wavelength bands associated with one of red light, blue light, and green light, respectively. In this manner, the optical filters provide improved spectral fidelity associated with the imaged scene compared to that of conventional RGB optical filters. This allows the one or more processors to determine a more accurate color point, reducing the likelihood of introducing artifacts into the image generated from the color point. This improves the color accuracy of the image and, therefore, the accuracy of the representation of the scene in the image.

[0013] 1A-1D are schematic diagrams of an exemplary embodiment 100 described herein. As shown in FIG. 1A, the exemplary embodiment 100 includes an optical filter 102 (e.g., a thin-film optical interference filter) and an optical sensor 104. The optical filter 102 and the optical sensor 104 may be associated with an optical sensor device, which is described in more detail elsewhere herein.

[0014] 1A, the optical filter 102 may include multiple optical channels 106. The multiple optical channels 106 may be arranged in a one-dimensional or two-dimensional array on the surface of the optical filter 102. For example, as shown in FIG. 1A, the multiple optical channels 106 may be arranged in a two-dimensional array (e.g., each row of the array includes eight optical channels 106 and each column includes eight optical channels 106). The multiple optical channels 106 may each pass light associated with a different wavelength range, as described further herein.

[0015] 1A, the optical sensor 104 may include a plurality of sensor elements 108. The plurality of sensor elements 108 may be arranged in a one-dimensional or two-dimensional array on the surface of the optical sensor 104. In some implementations, the arrangement of the plurality of sensor elements 108 on the surface of the optical sensor 104 may correspond to the arrangement of the plurality of optical channels 106 on the surface of the optical filter 102, as the optical channels 106 may be configured to pass light associated with a particular wavelength range to one or more sensor elements 108. For example, as shown in FIG. 1A, the plurality of optical channels 106 and the plurality of sensor elements 108 may each be arranged in a corresponding two-dimensional array (e.g., an 8×8 array).

[0016] The sensor elements 108 may be configured to acquire information about light incident on the sensor elements 108 (e.g., after passing through the optical channel 106). For example, the sensor elements 108 may provide an indication of the intensity of the light incident on the sensor elements 108 (e.g., active / inactive or a more granular indication of intensity). The optical sensor 104 may be configured to collect the information acquired by one or more sensor elements 108 to generate sensor data.

[0017] 1A, the optical filter 102 may be disposed over the optical sensor 104 (e.g., such that the array of optical channels 106 is aligned with the array of sensor elements 108). The optical filter 102 may be disposed directly over the optical sensor 104 or may be separated from the optical sensor 104 by a free space gap.

[0018] 1B-1C, multiple optical channels 106 may be included in multiple regions 110 (shown in FIGS. 1B-1C by black square outlines) of optical filter 102. For example, optical filter 102 may be divided into multiple regions 110, with each region 110 including the same number of optical channels 106 (e.g., 16 optical channels 106 as shown in FIGS. 1B-1C).

[0019] Each of the regions 110 of the plurality of regions 110 may include multiple sets of optical channels 114 associated with passing light associated with a respective wavelength range. For example, a region 110 may include a first set of optical channels 114-1 associated with passing light associated with a first wavelength range (e.g., including optical channels 106 having a dot pattern, as shown in FIGS. 1B-1C), a second set of optical channels 114-2 associated with passing light associated with a second wavelength range (e.g., including optical channels 106 having a diamond pattern, as shown in FIGS. 1B-1C), and / or a third set of optical channels 114-3 associated with passing light associated with a third wavelength range (e.g., including optical channels 106 having a diagonal line pattern, as shown in FIGS. 1B-1C).

[0020] In some implementations, the first wavelength range may be associated with red light, the second wavelength range may be associated with blue light, and the third wavelength range may be associated with green light. That is, the first wavelength range, the second wavelength range, and the third wavelength range may be associated with wavelength ranges associated with conventional red-green-blue (RGB) optical filters. For example, the first wavelength range may be approximately 600-700 nanometers (e.g., greater than or equal to 600 nanometers and less than 700 nanometers), the second wavelength range may be approximately 400-500 nanometers (e.g., greater than or equal to 400 nanometers and less than 500 nanometers), and the third wavelength range may be approximately 500-600 nanometers (e.g., greater than or equal to 500 nanometers and less than 600 nanometers). Other implementations are also contemplated. For example, the wavelength ranges of the first wavelength, the second wavelength range, and / or the third wavelength range may be associated with ultraviolet light (e.g., approximately 100-400 nanometers) and / or near-infrared light (e.g., approximately 700-1000 nanometers), among other examples.

[0021] In some embodiments, each optical channel 106 in the first set of optical channels 114-1 may be configured to pass light associated with a particular subrange of the first wavelength range (e.g., to a set of sensor elements 108 associated with the optical channel 106). For example, as shown in FIGS. 1B-1C, each optical channel 106 in the first set of optical channels 114-1 (e.g., having a dot pattern) is depicted as having a different amount of shading to indicate that each optical channel 106 is configured to pass light associated with a different subrange of the first wavelength range (e.g., a different subrange of red light). Thus, the composition of an optical channel 106 in the first set of optical channels 114-1 may differ from the composition of each of the other optical channels 106 in the first set of optical channels 114-1. For example, each optical channel 106 in the first set of optical channels 114-1 may comprise a set of thin film layers comprising a different number of thin film layers, a different arrangement of the thin film layers, and / or a different thickness of the thin film layers, among other examples.

[0022] In some implementations, each optical channel 106 of the second set of optical channels 114-2 may be configured to pass light associated with a particular subrange of the second wavelength range (e.g., to a set of sensor elements 108 associated with the optical channel 106). For example, as shown in FIGS. 1B-1C, each optical channel 106 of the second set of optical channels 114-2 (e.g., having a diamond pattern) is depicted as having a different amount of shading to indicate that each optical channel 106 is configured to pass light associated with a different subrange of the second wavelength range (e.g., a different subrange of blue light). Accordingly, the composition of the optical channels 106 of the set of second optical channels 114-2 may differ from the composition of each of the other optical channels 106 of the second set of optical channels 114-2. For example, each optical channel 106 of the second set of optical channels 114-2 may include a set of thin film layers with a different number of thin film layers, a different arrangement of the thin film layers, and / or a different thickness of the thin film layers, among other examples.

[0023] In some implementations, each optical channel 106 in the third set of optical channels 114-3 may be configured to pass light associated with a particular subrange of the third wavelength range (e.g., to a set of sensor elements 108 associated with the optical channel 106). For example, as shown in FIGS. 1B-1C, each optical channel 106 in the third set of optical channels 114-3 (e.g., those having a diagonal line pattern) is depicted as having a different amount of shading to indicate that each optical channel 106 is configured to pass light associated with a different subrange of the third wavelength range (e.g., a different subrange of green light). Thus, the composition of the optical channels 106 in the third set of optical channels 114-3 may differ from the composition of each of the other optical channels 106 in the third set of optical channels 114-3. For example, each optical channel 106 in the third set of optical channels 114-3 may include a set of thin film layers with a different number of thin film layers, a different arrangement of the thin film layers, and / or a different thickness of the thin film layers, among other examples.

[0024] In some implementations, the number of optical channels 106 included in the first optical channel set 114-1 may be the same (e.g., equal) as the number of optical channels 106 included in the second optical channel set 114-2. Additionally or alternatively, the number of optical channels 106 included in the third optical channel set 114-1 may be the sum of the number of optical channels 106 included in the first optical channel set 114-1 and the number of optical channels 106 included in the second optical channel set 114-2. In other words, a first number of optical channels 106 may be included in the first optical channel set 114-1, a first number of optical channels 106 may be included in the second optical channel set 114-2, and a second number of optical channels 106 may be included in the third optical channel set 114-3, where the second number is twice the first number. For example, as shown in FIG. 1B, the first set of optical channels 114-1 may include four optical channels 106, the second set of optical channels 114-2 may include four optical channels 106, and the third set of optical channels 114-3 may include eight optical channels 106.

[0025] In this manner, the region 110 of the optical filter 102 may include the same (e.g., equal) ratio of optical channels 106 associated with a first wavelength range (e.g., associated with red light), optical channels 106 associated with a second wavelength range (e.g., associated with blue light), and optical channels 106 associated with a third wavelength range (e.g., associated with green light) as that of a conventional RGB optical filter. Accordingly, sensor data associated with the region 110 of the optical filter 102 (e.g., generated by the optical sensor 104) may be processed using demosaicing techniques (e.g., as described herein in connection with FIG. 1D ).

[0026] 1B-1C, a region 110 of the plurality of regions 110 may include a plurality of sub-regions 112 (shown as dashed boxes in FIGS. 1B-1C). In some implementations, a first set of optical channels 114-1 may be included in a first sub-region 112 of the region 110, a second set of optical channels 114-2 may be included in a second sub-region 112 of the region 110, a portion of a third set of optical channels 114-3 may be included in a third sub-region 112 of the region 110, and another portion of the third set of optical channels 114-3 may be included in a fourth sub-region 112 of the region 110. For example, as shown in FIG. 1B , a first set of optical channels 114-1 may be included in the upper left sub-region 112 of region 110, a second set of optical channels 114-2 may be included in the lower right sub-region 112 of region 110, a portion of a third set of optical channels 114-3 may be included in the upper right sub-region 112 of region 110, and another portion of the third set of optical channels 114-3 may be included in the lower left sub-region 112 of region 110.

[0027] In some embodiments, a first number of optical channels 106 (e.g., at least one optical channel 106) of a first set of optical channels 114-1 may be within a sub-region 112, a first number of optical channels 106 (e.g., at least one optical channel 106) of a second set of optical channels 114-2 may be within a sub-region 112, and a second number of optical channels 106 (e.g., at least two optical channels 106) of a third set of optical channels 114-2 may be within a sub-region 112, where the second number may be twice the first number. 1C , the top-left subregion 112 of region 110 may include one optical channel 106-1 of a first set of optical channels 114-1, one optical channel 106-2 of a second set of optical channels 114-2, and two optical channels 106-3-a and 106-3-b of a third set of optical channels 114-3. In this manner, a subregion 112 of optical filter 102 may include the same (e.g., equal) ratio of optical channels 106 associated with a first wavelength range (e.g., associated with red light), optical channels 106 associated with a second wavelength range (e.g., associated with blue light), and optical channels 106 associated with a third wavelength range (e.g., associated with green light) as the region 110 in which subregion 112 is included.

[0028] As shown in FIG. 1D , a light beam 116 associated with a scene 118 (e.g., a scene to be imaged) may originate from the scene 118. The light beam 116 may pass through the optical filter 102 and enter a particular optical channel 106. The particular optical channel 106 may be included in a particular set of optical channels 114 that is associated with passing light associated with a particular wavelength range. Thus, the particular optical channel 106 may pass a particular light beam 116 associated with a particular subrange of the particular wavelength range (e.g., that the particular optical channel 106 is configured to pass) to a particular sensor element 108 of the optical sensor 104 (e.g., a sensor element 108 configured to receive light from the particular optical channel 106). In this manner, the multiple sensor elements 108 may capture data associated with light associated with subranges of the first wavelength range, the second wavelength range, and / or the third wavelength range.

[0029] 1D , the optical sensor 104 may be associated with one or more processors 120 and may provide sensor data to the one or more processors 120, as indicated by reference numeral 122. The sensor data may indicate information related to light originating from the scene 118 and passing through the optical channel 106 of the optical filter 102 to reach the plurality of sensor elements 108, such as an indication of the intensity of light received by the plurality of sensor elements 108.

[0030] 1D by reference numeral 124, the one or more processors 120 may process the sensor data to determine spectral information associated with the scene 118. For example, the one or more processors 120 may identify, based on the sensor data, a particular sensor element 108 of the optical sensor 104 that received the light beam 116. The one or more processors 120 may determine, based on configuration information associated with the optical filter 102 (e.g., stored in a data structure accessible by the one or more processors 120), that a particular sensor element 108 is associated with a particular optical channel 106 of the optical filter 102 (e.g., the particular sensor element 108 is configured to receive the light beam passing through the particular optical channel 106), and may identify the particular optical channel 106 as having received and passed the light beam 116 to the particular sensor element 108. Further, the one or more processors 120 may determine, based on the configuration information, that a particular optical channel 106 is configured to pass a light beam associated with a particular subrange of a particular wavelength range, and therefore, that the light beam 116 is associated with a particular subrange of a particular wavelength range. In this manner, the one or more processors may determine spectral values ​​indicative of the amount of light associated with different subranges of different wavelength ranges received by the multiple optical channels 106 and passed to the multiple sensor elements 108.

[0031] As further indicated by reference numeral 126 in FIG. 1D , one or more processors 120 may process the spectral information to determine image information associated with the scene 118. In some implementations, the one or more processors 120 may process the spectral information using digital image processing techniques, such as demosaicing techniques, to determine the image information. The image information may indicate at least one color point (e.g., in a color space such as the Commission Internationale de l'Eclairage (CIE) 1931 RGB color space) associated with the region 110 of the optical filter 102 (e.g., associated with light originating from the scene 118 and passing through the optical channels 106 within the region 110). Additionally or alternatively, the image information may indicate at least one color point associated with a sub-region 112 of the region 110 of the optical filter 102 (e.g., associated with light originating from the scene 118 and passing through the optical channels 106 within the sub-region 112 of the region 110).

[0032] In one example, the one or more processors 120 may generate a first portion of spectral information associated with a first set of optical channels 114-1 within the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a first set of sensor elements 108 associated with the first set of optical channels 114-1), a second portion of spectral information associated with a second set of optical channels 114-2 within the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a second set of sensor elements 108 associated with the second set of optical channels 114-2), and The optical filter 102 may determine a third portion of spectral information associated with a portion of the third set of optical channels 114-3 within the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a third set of sensor elements 108 associated with the portion of the third set of optical channels 114-3) and / or a fourth portion of another portion of the third set of optical channels 114-3 within the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a fourth set of sensor elements 108 associated with the other portion of the third set of optical channels 114-3). The one or more processors 120 may process a first portion of the spectral information to determine a first spectral value (e.g., the average value of each spectral value in the first set of optical channels 114-1), may process a second portion of the spectral information to determine a second spectral value (e.g., the average value of each spectral value in the second set of optical channels 114-2), may process a third portion of the spectral information to determine a third spectral value (e.g., the average value of each spectral value in a portion of the third set of optical channels 114-3), and may process a fourth portion of the spectral information to determine a fourth spectral value (e.g., the average value of each spectral value in the other portion of the third set of optical channels 114-3).

[0033] In this manner, the one or more processors may determine a spectral value (e.g., a first spectral value) associated with a first wavelength range (e.g., associated with red light), a spectral value (e.g., a second spectral value) associated with a second wavelength range (e.g., associated with blue light), and two spectral values ​​(e.g., a third spectral value and a fourth spectral value) associated with a third wavelength range (e.g., associated with green light). Thus, the one or more processors 120 may use demosaicing techniques to process the first spectral value, the second spectral value, the third spectral value, and the fourth spectral value, the color points associated with the region 110 of the optical filter 102.

[0034] In a further example, the one or more processors 120 may generate a first portion of spectral information associated with a subset of the first set of optical channels 114-1 within the sub-region 112 of the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a first set of sensor elements 108 associated with the subset of the first set of optical channels 114-1), a second portion of spectral information associated with a subset of the second set of optical channels 114-2 within the sub-region 112 of the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a second set of sensor elements 108 associated with the subset of the second set of optical channels 114-2), and A third portion of spectral information associated with a first subset of the third set of optical channels 114-3 of the subregion 112 of the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a third set of sensor elements 108 associated with the first subset of the third set of optical channels 114-3) and / or a fourth portion of spectral information associated with a second subset of the third set of optical channels 114-3 of the subregion 112 of the region 110 of the optical filter 102 (e.g., spectral information based on sensor data generated by a fourth set of sensor elements 108 associated with the second subset of the third set of optical channels 114-3) may be determined. The one or more processors 120 may process a first portion of the spectral information to determine a first spectral value (e.g., an average value of each of the spectral values ​​of the subset of the first set of optical channels 114-1), a second portion of the spectral information to determine a second spectral value (e.g., an average value of each of the spectral values ​​of the subset of the second set of optical channels 114-2), a third portion of the spectral information to determine a third spectral value (e.g., an average value of each of the spectral values ​​of the first subset of the third set of optical channels 114-3), and a fourth portion of the spectral information to determine a fourth spectral value (e.g., an average value of each of the spectral values ​​of the second subset of the third set of optical channels 114-3).

[0035] In this manner, the one or more processors 120 may determine a spectral value (e.g., a first spectral value) associated with a first wavelength range (e.g., associated with red light), a spectral value (e.g., a second spectral value) associated with a second wavelength range (e.g., associated with blue light), and two spectral values ​​(e.g., a third spectral value and a fourth spectral value) associated with a third wavelength range (e.g., associated with green light). Thus, the one or more processors 120 may use demosaicing techniques to process the first spectral value, the second spectral value, the third spectral value, and the fourth spectral value, color points associated with the subregions 112 of the region 110 of the optical filter 102.

[0036] In some implementations, one or more processors 120 may provide image information. For example, one or more processors 120 may generate an image based on the image information and cause the image information to be displayed on a display (e.g., associated with an optical sensor device). As another example, one or more processors may transmit the image information to another device, such as a user device, to cause the other device to generate an image and display the image on a display of the other device.

[0037] As noted above, Figures 1A-1D are presented as examples. Other examples may differ from those described with respect to Figures 1A-1D.

[0038] 2 is a diagram 200 of the transmission characteristics of a conventional RGB optical filter and an optical filter described herein (e.g., optical filter 102). As described above, a conventional RGB optical filter includes three optical channels in a regular pattern: a first optical channel configured to pass light associated with red light, a second optical channel configured to pass light associated with blue light, and a third optical channel configured to pass light associated with green light. Thus, as indicated by reference numerals 202-1 through 202-3 in FIG. 2, a conventional RGB optical filter may pass light associated with widely overlapping wavelength bands associated with red light, blue light, and / or green light.

[0039] In contrast, the optical filter 102 may include multiple optical channels 106, each configured to pass light associated with a subrange of the wavelength range. For example, the region 110 of the optical filter 102 may include a first set of optical channels 114-1 configured to pass red light, a second set of optical channels 114-2 configured to pass blue light, and a third set of optical channels 114-3 configured to pass green light. Thus, as further illustrated by reference numerals 204-1 through 204-16 in FIG. 2 , the optical filter 102 may pass light associated with narrow, non-overlapping wavelength bands associated with one of red light, blue light, and green light, respectively. In this manner, the optical filter 102 may provide improved spectral fidelity associated with an imaged scene compared to conventional RGB optical filters, which may enable a more accurate color point to be determined, thereby enabling a more color-accurate image of the scene to be generated.

[0040] As noted above, Figure 2 is presented as an example. Other examples may differ from those described with respect to Figure 2.

[0041] FIG. 3 is a diagram of an example environment 300 in which the systems and / or methods described herein may be implemented. As shown in FIG. 3, environment 300 may include an optical sensor device 310, which may include one or more processors 320 (e.g., corresponding to one or more processors 120 described herein in connection with FIG. 1D ) and an optical sensor 330 (e.g., corresponding to optical sensor 104 described herein in connection with FIGS. 1A-1D ). Environment 300 may also include user devices 340 and a network 350. The devices in environment 300 may be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections.

[0042] The optical sensor device 310 may include an optical device capable of storing, processing, and / or routing spectral and / or image information related to a scene. For example, the optical sensor device 310 may include a spectroscopic device that performs spectroscopy, such as a spectroscopic optical sensor device (e.g., a binary multispectral optical sensor device that performs vibrational spectroscopy, such as a near-infrared (NIR) spectrometer, a mid-infrared spectrometer (mid-IR), a Raman spectrometer, and / or the like). In some embodiments, the optical sensor device 310 may be incorporated into a user device 340, such as a wearable spectrometer and / or the like. In some embodiments, the optical sensor device 310 may receive information from and / or transmit information to another device in the environment 300, such as the user device 340.

[0043] In some implementations, the optical sensor device 310 may comprise a spectroscopic imaging camera. A spectroscopic imaging camera is a device capable of capturing an image of a scene. The spectroscopic imaging camera (or a processor 320 associated with the spectroscopic imaging camera) may have the ability to determine the spectral content or changes in spectral content at different points within the image of the scene, such as at any point within the image of the scene.

[0044] In some implementations, the optical sensor device 310 may comprise a spectroscopic imaging camera capable of performing hyperspectral imaging. For example, the optical sensor device 310 may include an optical filter (e.g., the optical filter 102 described herein in connection with FIGS. 1A-1D). In some implementations, the optical filter may be disposed above the optical sensor 330.

[0045] The optical sensor device 310 may include one or more processors 320, which are described in more detail in connection with FIG.

[0046] The optical sensor device 310 may include an optical sensor 330. The optical sensor 330 includes a device capable of sensing light. For example, the optical sensor 330 may include an image sensor, a multispectral sensor, a spectral sensor, and / or the like. In some implementations, the optical sensor 330 may include a silicon (Si)-based sensor, an indium gallium arsenide (InGaAs)-based sensor, a lead sulfide (PbS)-based sensor, or a germanium (Ge)-based sensor, and may utilize one or more sensor technologies such as complementary metal-oxide-semiconductor (CMOS) technology or charge-coupled device (CCD) technology, among other examples. In some implementations, the optical sensor 330 may include a front-side illumination (FSI) sensor, a back-side illumination (BSI) sensor, and / or the like. In some implementations, the optical sensor 330 may be included in a camera of the optical sensor device 310 and / or the user device 340.

[0047] User device 340 includes one or more devices capable of receiving, generating, storing, processing, and / or providing spectral and / or image information related to a scene. For example, user device 340 may include a communication and / or computing device such as a mobile phone (e.g., a smartphone, a wireless phone, and / or the like), a computer (e.g., a laptop computer, a tablet computer, a handheld computer, and / or the like), a gaming device, a wearable communication device (e.g., a smart watch, a smart glasses, and / or the like), or a similar type of device. In some implementations, user device 340 may receive information from and / or transmit information to other equipment in environment 300, such as optical sensor device 310.

[0048] Network 350 may include one or more wired and / or wireless networks. For example, network 350 may include a cellular network (e.g., a long-term evolution (LTE) network, a code division multiple access (CDMA) network, a 3G network, a 4G network, a 5G network, another type of next generation network, and / or the like), a public land mobile network (PLMN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a telephone network (e.g., a public switched telephone network (PSTN)), a private network, an ad hoc network, an intranet, the Internet, a fiber-optic-based network, a cloud computing network, and / or the like, and / or combinations thereof, or other types of networks.

[0049] The number and arrangement of devices and networks shown in FIG. 3 are provided as an example. In practice, there may be additional, fewer, different, or differently arranged devices and / or networks than those shown in FIG. 3. Furthermore, two or more of the devices shown in FIG. 3 may be implemented within a single device, or a single device shown in FIG. 3 may be implemented as multiple distributed devices. For example, while optical sensor device 310 and user device 340 are described as separate devices, optical sensor device 310 and user device 340 may be implemented as a single device. Additionally, or alternatively, a set of devices (e.g., one or more devices) in environment 300 may perform one or more functions described as being performed by another set of devices in environment 300.

[0050] 4 is a diagram of example components of device 400. Device 400 may correspond to optical sensor device 310 and / or user device 340. In some implementations, optical sensor device 310 and / or user device 340 may include one or more of device 400 and / or one or more components of device 400. As shown in FIG. 4, device 400 may include a bus 410, a processor 420, a memory 430, a storage component 440, an input component 450, an output component 460, and a communication component 470.

[0051] Bus 410 includes components that allow communication between multiple components of device 400. Processor 420 is implemented in hardware, firmware, and / or a combination of hardware and software. Processor 420 may be a central processing unit (CPU), graphics processing unit (GPU), accelerated processing unit (APU), microprocessor, microcontroller, digital signal processor (DSP), field programmable gate array (FPGA), application specific integrated circuit (ASIC), or other type of processing component. In some implementations, processor 420 includes one or more processors capable of being programmed to perform functions. Memory 430 includes random access memory (RAM), read-only memory (ROM), and / or another type of dynamic or static storage device (e.g., flash memory, magnetic memory, and / or optical memory) that stores information and / or instructions for use by processor 420.

[0052] Storage component 440 stores information and / or software related to the operation and use of device 400. For example, storage component 440 may include hard disks (e.g., magnetic, optical, and / or magneto-optical disks), solid state drives (SSDs), compact discs (CDs), digital versatile discs (DVDs), floppy disks, cartridges, magnetic tape, and / or other types of non-transitory computer-readable media along with corresponding drives.

[0053] Input components 450 include components that allow device 400 to receive information, such as via user input (e.g., a touchscreen display, a keyboard, a keypad, a mouse, buttons, switches, and / or a microphone). Additionally or alternatively, input components 450 may include components for determining position (e.g., a global positioning system (GPS) component) and / or sensors (e.g., an accelerometer, a gyroscope, an actuator, another type of position or environmental sensor, and / or the like). Output components 460 include components that provide output information from device 400 (e.g., via a display, a speaker, a haptic feedback component, an audio or visual indicator, and / or the like).

[0054] Communications component 470 includes transceiver-like components (e.g., a transceiver, a separate receiver, a separate transmitter, and / or the like) that enable device 400 to communicate with other devices, such as via a wired connection, a wireless connection, or a combination of wired and wireless connections. Communications component 470 may allow device 400 to receive information from and / or provide information to other devices. For example, communications component 470 may include an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, a radio frequency (RF) interface, a universal serial bus (USB) interface, a Wi-Fi interface, a cellular network interface, and / or the like.

[0055] Device 400 may perform one or more of the processes described herein. Device 400 may perform these processes based on processor 420 executing software instructions stored on a non-transitory computer-readable medium, such as memory 430 and / or storage component 440. As used herein, the term "computer-readable medium" refers to a non-transitory memory device. A memory device may include memory space within a single physical storage device or memory space spanning multiple physical storage devices.

[0056] Software instructions may be loaded into memory 430 and / or storage component 440 from another computer-readable medium or from another device via communication component 470. When executed, the software instructions stored in memory 430 and / or storage component 440 may cause processor 420 to perform one or more operations described herein. Additionally, or alternatively, hardware circuitry may be used in place of or in combination with software instructions to perform one or more operations described herein. Thus, the implementations described herein are not limited to any specific combination of hardware circuitry and software.

[0057] The number and arrangement of components shown in Figure 4 are provided as an example. In practice, device 400 may include additional, fewer, different, or different arrangements of components than those shown in Figure 4. Additionally or alternatively, a set of components (e.g., one or more components) of device 400 may perform one or more functions described as being performed by another set of components of device 400.

[0058] FIG. 5 is a flowchart of an example process 500 involving an optical sensor device (e.g., optical sensor device 310). In some implementations, one or more process blocks in FIG. 5 may be performed by one or more processors of the optical sensor device (e.g., one or more processors 120 or one or more processors 320). In some implementations, one or more process blocks in FIG. 5 may be performed by another device or group of devices separate from or including one or more processors, such as a user device (e.g., user device 340). Additionally or alternatively, one or more process blocks in FIG. 5 may be performed by one or more components of device 400, such as processor 420, memory 430, storage component 440, input component 450, output component 460, and / or communication component 470.

[0059] 5, process 500 may include acquiring sensor data associated with a scene (block 510). For example, one or more processors may acquire sensor data associated with the scene as described above.

[0060] 5, process 500 may include determining spectral information associated with the scene based on the sensor data (block 520). For example, the one or more processors may determine spectral information associated with the scene based on the sensor data, as described above.

[0061] 5, process 500 determines image information associated with the scene based on the spectral information (block 530). For example, one or more processors can determine image information associated with the scene based on the spectral information as described above. In some embodiments, the image information indicates at least one color point associated with a region of an optical filter in the optical sensor device.

[0062] In some embodiments, determining the image information includes processing a first portion of the spectral information associated with the first set of optical channels to determine a first spectral value associated with the first wavelength range; processing a second portion of the spectral information associated with the second set of optical channels to determine a second spectral value associated with the second wavelength range; processing a third portion of the spectral information associated with a portion of the third set of optical channels to determine a third spectral value associated with the third wavelength range; and processing a fourth portion of the spectral information associated with another portion of the third set of optical channels to determine a fourth spectral value associated with the third wavelength range; and determining a color point associated with the region of the optical filter using a demosaicing technique and based on the first spectral value, the second spectral value, the third spectral value, and the fourth spectral value.

[0063] In some embodiments, determining the image information includes identifying at least one in a first set of optical channels associated with a sub-region of the region of the optical filter, at least one in a second set of optical channels associated with the sub-region, and at least two in a third set of optical channels associated with the sub-region; processing a first portion of the spectral information associated with at least one in the first set of optical channels to determine a first spectral value associated with a first wavelength range; and processing a second portion of the spectral information associated with at least one in the second set of optical channels to determine a second spectral value associated with a second wavelength range. processing a second portion of the spectral information; processing the third portion of the spectral information associated with at least two portions of the third set of optical channels to determine a third spectral value associated with a third wavelength range; processing a fourth portion of the spectral information associated with another portion of the at least two portions of the third set of optical channels to determine a fourth spectral value associated with the third wavelength range; and determining a color point associated with a subregion of the optical filter using a demosaicing technique and based on the first spectral value, the second spectral value, the third spectral value, and the fourth spectral value.

[0064] 5, process 500 may include providing image information (block 540). For example, one or more processors may provide the image information as described above. In some implementations, providing the image information includes generating an image based on the image information and displaying the image information on a display associated with the optical sensor device.

[0065] Process 500 may include additional embodiments, such as any single embodiment or any combination of embodiments described in connection with one or more other processes described elsewhere herein.

[0066] Although Figure 5 illustrates example blocks of process 500, in some implementations, process 500 may include additional, fewer, different, or differently arranged blocks than those depicted in Figure 5. Additionally or alternatively, two or more of the blocks of process 500 may be performed in parallel.

[0067] The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the embodiments to the precise form disclosed. Modifications and variations may be made in light of the above disclosure or may be acquired from practice of the embodiments.

[0068] As used herein, the term "component" is intended to be broadly interpreted as hardware, firmware, or a combination of hardware and software. It will be apparent that the systems and / or methods described herein may be implemented in different forms of hardware, firmware, and / or combinations of hardware and software. The actual specific control hardware or software code used to implement these systems and / or methods is not limiting of the implementation. As such, the operation and behavior of the systems and / or methods are described herein without reference to specific software code—it is understood that both software and hardware can be used to implement the systems and / or methods based on the description herein.

[0069] Although particular combinations of features are recited in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of various embodiments. Indeed, many of these features may be combined in ways not specifically recited in the claims and / or disclosed in the specification. While each dependent claim listed below may directly depend on only one claim, the disclosure of various embodiments includes each dependent claim in combination with all other claims in the claim set. As used herein, the phrase "at least one" of a list of items refers to any combination of those items, including single members. By way of example, "at least one of a, b, or c" is intended to cover a, b, c, ab, ac, bc, and abc, as well as any combination with multiples of the same item.

[0070] No element, act, or instruction used herein should be construed as critical or essential unless explicitly described as such. Also, as used herein, the articles "a" and "an" are intended to include one or more items and may be used interchangeably with "one or more." Furthermore, as used herein, the article "the" is intended to include one or more items referenced in connection with the article "the" and may be used interchangeably with "the one or more." Furthermore, as used herein, the term "set" is intended to include one or more items (e.g., related items, unrelated items, or a combination of related and unrelated items) and may be used interchangeably with "one or more." Where only one item is intended, "only one" or similar language is used. Also, as used herein, the terms "has," "have," "having," or like terms are intended to be open-ended terms. Furthermore, the phrase "based on" is intended to mean "based, at least in part, on," unless expressly stated otherwise. Also, as used herein, the term "or," when used in a series, is intended to be inclusive and can be used interchangeably with "and / or" unless expressly otherwise (e.g., when used in combination with "either" or "only one of").

Claims

1. 1. An optical sensor device, comprising: an optical sensor comprising a set of sensor elements; an optical filter disposed over the optical sensor and including a plurality of regions, wherein the plurality of regions includes: a first optical channel set having optical channels configured to pass light associated with each subrange of a first wavelength range to each of a first subset of sensor elements in the set of sensor elements of the optical sensor; a second optical channel set having optical channels configured to pass light associated with each subrange of a second wavelength range to each of a second subset of sensor elements in the set of sensor elements of the optical sensor; and a third optical channel set having optical channels configured to pass light associated with each subrange of a third wavelength range to each of a third subset of sensor elements in the set of sensor elements of the optical sensor; Including, the first optical channel set includes a first optical channel, a second optical channel, and a third optical channel; the first optical channel adjacent to the second optical channel and the third optical channel; and one or more processors; acquiring sensor data relating to a scene from the optical sensor; determining spectral information associated with the scene based on the sensor data; determining image information associated with the scene based on the spectral information; and providing said image information; the one or more processors configured to Equipped with an optical sensor device, wherein each of the subranges of the first wavelength range does not overlap with each other, each of the subranges of the second wavelength range does not overlap with each other, and each of the subranges of the third wavelength range does not overlap with each other.

2. 10. The optical sensor device of claim 1, the first wavelength range is associated with red light; the second wavelength range is associated with blue light, and the third wavelength range is associated with green light; Optical sensor device.

3. 10. The optical sensor device of claim 1, the number of optical channels in the first optical channel set is equal to the number of optical channels in the second optical channel set; and the number of optical channels included in the third optical channel set is equal to the sum of the number of optical channels included in the first optical channel set and the number of optical channels included in the second optical channel set; Optical sensor device.

4. 10. The optical sensor device of claim 1, the first set of optical channels is in a first sub-region of the region; the second set of optical channels is in a second sub-region of the region; a portion of the third set of optical channels is within a third sub-region of the region; and another portion of the third set of optical channels is in a fourth sub-region of the region; Optical sensor device.

5. 10. The optical sensor device of claim 1, wherein the region comprises a plurality of sub-regions; at least one optical channel in the first set of optical channels is within each of the plurality of sub-regions; at least one optical channel in the second set of optical channels is within each of the plurality of sub-regions; and at least two optical channels in the third set of optical channels are within each of the plurality of sub-regions; Optical sensor device.

6. 2. The optical sensor device of claim 1, wherein the region is a subregion, an optical channel in the first set of optical channels; an optical channel in the second set of optical channels; and two optical channels in the third optical channel set; an optical sensor device having the sub-regions,

7. 2. The optical sensor device of claim 1, wherein the image information indicates at least one color point associated with the region of the optical filter.

8. 10. The optical sensor device of claim 1, wherein the one or more processors, in determining the image information, processing a first portion of the spectral information associated with the first set of optical channels to determine a first spectral value associated with the first wavelength range; processing a second portion of the spectral information associated with the second set of optical channels to determine second spectral values ​​associated with the second wavelength range; processing a third portion of the spectral information associated with a portion of the third set of optical channels to determine third spectral values ​​associated with the third wavelength range; processing a fourth portion of the spectral information associated with another portion of the third set of optical channels to determine fourth spectral values ​​associated with the third wavelength range; and determining a color point associated with the region of the optical filter using a demosaicing technique and based on the first spectral value, the second spectral value, the third spectral value, and the fourth spectral value; An optical sensor device configured to:

9. 10. The optical sensor device of claim 1, wherein the one or more processors, in determining the image information, identifying at least one of the first set of optical channels associated with a sub-region of the region of the optical filter, at least one of the second set of optical channels associated with the sub-region, and at least two of the third set of optical channels associated with the sub-region; processing a first portion of the spectral information associated with the at least one in the first set of optical channels to determine a first spectral value associated with the first wavelength range; processing a second portion of the spectral information associated with the at least one in the second set of optical channels to determine a second spectral value associated with the second wavelength range; processing a third portion of the spectral information associated with the at least two portions in the third set of optical channels to determine a third spectral value associated with the third wavelength range; processing a fourth portion of the spectral information associated with at least the two other portions in the third set of optical channels to determine a fourth spectral value associated with the third wavelength range; and determining a color point associated with the sub-region of the optical filter using a demosaicing technique and based on the first spectral value, the second spectral value, the third spectral value, and the fourth spectral value; An optical sensor device configured to:

10. 10. The optical sensor device of claim 1, wherein the one or more processors, in providing the image information, generating an image based on the image information; and causing a display of said image information on a display associated with said optical sensor device; An optical sensor device configured to:

11. 1. An optical sensor device, comprising: an optical sensor comprising a set of sensor elements; and an optical filter disposed over the optical sensor and including a plurality of regions, wherein the plurality of regions includes: a first optical channel set having optical channels configured to pass light associated with each of the sub-ranges of a first wavelength range to each of a first subset of sensor elements in the set of sensor elements of the optical sensor; a second optical channel set having optical channels configured to pass light associated with each of the subranges of the second wavelength range to each of a second subset of sensor elements in the set of sensor elements of the optical sensor; and a third optical channel set having optical channels configured to pass light associated with each of the subranges of a third wavelength range to each of a third subset of the set of sensor elements of the optical sensor; Including, the first optical channel set includes a first optical channel, a second optical channel, and a third optical channel; the first optical channel is adjacent to the second optical channel and the third optical channel; and Equipped with an optical sensor device, wherein each of the subranges of the first wavelength range does not overlap with each other, each of the subranges of the second wavelength range does not overlap with each other, and each of the subranges of the third wavelength range does not overlap with each other.

12. 12. The optical sensor device of claim 11, the first wavelength range is about 600 to 700 nanometers; the second wavelength range is about 400 to 500 nanometers; and The third wavelength range is from about 500 nanometers to 600 nanometers. Optical sensor device.

13. 12. The optical sensor device of claim 11, the first set of optical channels is in a first sub-region of the region; the second set of optical channels is in a second sub-region of the region; a portion of the third set of optical channels is within a third sub-region of the region; and another portion of the third set of optical channels is in a fourth sub-region of the region; Optical sensor device.

14. 12. The optical sensor device of claim 11, wherein the sub-regions of the region are: a first number of optical channels in the first set of optical channels; a first number of optical channels in the second set of optical channels; and a second number of optical channels in the third set of optical channels; wherein the second number is twice the first number. Optical sensor device.

15. In an optical filter having a plurality of regions, The regions of the plurality of regions of the optical filter are: a first set of optical channels associated with passing light associated with a first wavelength range; each optical channel of the first set of optical channels is configured to pass light associated with a particular subrange of the first wavelength range; the first optical channel set includes a first optical channel, a second optical channel, and a third optical channel; the first optical channel is adjacent to the second optical channel and the third optical channel; the first set of optical channels; and a second set of optical channels associated with passing light associated with a second wavelength range, each optical channel of the second set of optical channels is configured to pass light associated with a particular subrange of the second wavelength range; the second set of optical channels; and a third set of optical channels associated with passing light associated with a third wavelength range, each optical channel of the third set of optical channels is configured to pass light associated with a particular subrange of the third wavelength range; a third set of optical channels; and Including, an optical filter, wherein each of the subranges of the first wavelength range does not overlap with each other, each of the subranges of the second wavelength range does not overlap with each other, and each of the subranges of the third wavelength range does not overlap with each other.

16. 16. The optical filter according to claim 15, the number of optical channels in the first optical channel set is equal to the number of optical channels in the second optical channel set; and the number of optical channels included in the third optical channel set is equal to the sum of the number of optical channels included in the first optical channel set and the number of optical channels included in the second optical channel set; Optical filters.

17. 16. The optical filter according to claim 15, the first wavelength range is associated with red light; the second wavelength range is associated with blue light; and the third wavelength range is associated with green light; Optical filters.

18. 16. The optical filter according to claim 15, the first set of optical channels is in a first sub-region of the region; the second set of optical channels is in a second sub-region of the region; a portion of the third set of optical channels is within a third sub-region of the region; and another portion of the third set of optical channels is in a fourth sub-region of the region; Optical filters.

19. 16. The optical filter of claim 15, wherein the region comprises a plurality of subregions; at least one optical channel in the first set of optical channels is within each of the plurality of sub-regions; at least one optical channel in the second set of optical channels is within each of the plurality of sub-regions; and at least two optical channels in the third set of optical channels are within each of the plurality of sub-regions; Optical filters.

20. 16. The optical filter of claim 15, wherein the region comprises: an optical channel in the first set of optical channels; an optical channel in the second set of optical channels; and two optical channels in the third optical channel set; An optical filter comprising a subregion including:

Images