Optical sensor devices

Abstract

This disclosure relates to optical sensor devices. An optical sensor device may include: an optical sensor comprising a set of sensor elements; an optical filter comprising one or more channels, each of the channels being configured to allow light associated with a specific wavelength to pass to a subset of the sensor elements in the set of sensor elements of the optical sensor; a phase mask configured to distribute a plurality of beams of light associated with an object in an encoded pattern on the input surface of the optical filter; and one or more processors. One or more processors may be configured to acquire sensor data associated with the object from the optical sensor and determine spectral information associated with the object based on the sensor data. One or more processors may determine spatial information associated with the object based on the sensor data and information associated with the encoded pattern.

Description

[0001] Related applications

[0002] This application claims priority to U.S. Provisional Patent Application No. 62 / 969,436, filed February 3, 2020, entitled “IMAGING DEVICE”, and U.S. Provisional Patent Application No. 62 / 969,428, filed February 3, 2020, entitled “INTEGRATED HYPERSPECTRALIMAGING OPTICAL COMPONENT”, the contents of which are incorporated herein by reference in their entirety. Technical Field

[0004] This application relates to optical sensor devices.

[0005] background

[0006] Optical sensor devices can be used to capture information involving light. For example, an optical sensor device can capture information involving a set of wavelengths associated with light. An optical sensor device may include a set of sensor elements (e.g., optical sensors, spectral sensors, and / or image sensors) that capture information. For example, an array of sensor elements can be used to capture information related to multiple wavelengths. The array of sensor elements may be associated with an optical filter. The optical filter may include one or more channels that respectively deliver a specific wavelength to the sensor elements in the array of sensor elements.

[0007] Overview

[0008] In some implementations, an optical sensor device includes: an optical sensor comprising a set of sensor elements; an optical filter having angle-dependent wavelength characteristics, comprising one or more channels, each of the channels being configured to allow light to propagate to a subset of the sensor elements of the set of sensor elements of the optical sensor based on the incident angle of light associated with a specific wavelength on the channel; a phase mask configured to distribute a plurality of beams of light associated with an object in a coded pattern on the input surface of the optical filter; and one or more processors configured to: acquire sensor data associated with the object from the optical sensor; determine spectral information associated with the object based on the sensor data; determine spatial information associated with the object based on the sensor data and information associated with the coded pattern; and perform one or more actions based on the spectral information and the spatial information.

[0009] In some implementations, a non-transitory computer-readable medium storing instructions includes one or more instructions that, when executed by one or more processors of an optical sensor device, cause the processor to: obtain sensor data from an optical sensor of the optical sensor device associated with multiple light beams that are patterned on the input surface of an optical filter of the optical sensor device via a phase mask of the optical sensor device; identify a receiving light beam in one or more channels of the optical filter based on the sensor data and allow the light beam to pass through a channel; determine the angle of incidence of the light beam on the channel based on information associated with the pattern and the identified channel; determine the wavelength range associated with the light beam based on the angle of incidence of the light beam and angular offset information associated with the channel; and provide information for identifying the wavelength range associated with the light beam.

[0010] In some implementations, a method includes: obtaining sensor data associated with multiple light beams distributed in a pattern on the input surface of an optical filter of an optical filter via an optical sensor device and from an optical sensor device; identifying, via the optical sensor device and based on the sensor data, a channel through which the light beams are received and pass; identifying, via the optical sensor device and based on the sensor data, a sensor element of the optical sensor that receives the light beams; determining, via the optical sensor device and based on the sensor data, the angle of incidence of the light beams on the channel; determining, via the optical sensor device and based on information associated with the pattern and identifying the channel and sensor element; determining, via the optical sensor device and based on the angle of incidence of the light beams and angular offset information associated with the channel; and providing, via the optical sensor device, information identifying the wavelength range associated with the light beams. Attached Figure Description

[0012] Figure 1A-1B This is a diagram of the example implementation described in this article.

[0013] Figure 2 This is a diagram of the combined optical elements described in this article.

[0014] Figure 3 This is a diagram of an example environment in which the systems and / or methods described in this paper can be implemented.

[0015] Figure 4 yes Figure 2 A diagram of an example component of one or more devices.

[0016] Figure 5-7 This is a flowchart of an example process related to optical sensor devices.

[0017] Detailed description

[0018] The following detailed description of the example implementation is with reference to the accompanying drawings. The same reference numerals in different drawings may identify the same or similar elements. The following description uses a spectrometer as an example. However, the techniques, principles, processes, and methods described herein can be used with any sensor, including but not limited to other optical and spectral sensors.

[0019] Conventional optical sensor devices (e.g., spectrometers) can be configured to determine spectral information associated with light (e.g., ambient light) captured by the optical sensor device. Light can enter the optical sensor device and be received by its optical filters and optical sensors (e.g., where the optical filters are arranged on the optical sensors). The optical filters can include a set of optical channels designed to allow light in different wavelength ranges to reach a set of sensor elements of the optical sensor. This allows the optical sensor to determine spectral information associated with light involving different wavelength ranges. However, the optical sensor can only determine spectral information associated with the individual wavelength ranges associated with each set of optical channels. Furthermore, conventional optical devices cannot determine spatial information associated with light (e.g., the location or placement of objects associated with the origin of the light).

[0020] Some implementations described herein provide optical sensor devices including a phase mask, an optical filter, an optical sensor, and one or more processors. The phase mask can be configured to distribute multiple beams of light associated with an object in a coded pattern on the input surface of the optical filter. The optical mask can include one or more channels, each configured to have an "angular offset" such that each channel is designed to allow light to pass through multiple different wavelength ranges based on the angle of incidence of light on the channel. For example, when a beam is incident on the channel within a first angle of incidence range, the channel allows the beam associated with a first wavelength range to pass through; when a beam is incident on the channel within a second angle of incidence range, the channel allows the beam associated with a second wavelength range to pass through, and so on.

[0021] In some implementations, one or more processors can acquire sensor data associated with multiple light beams from an optical sensor, and can identify, based on the sensor data, the channels through which the light beams are received and passed in one or more channels of an optical filter, and / or the sensor elements of the optical sensor that receive the light beams. One or more processors can determine the angle of incidence of the light beam on a channel based on information associated with an encoded pattern (e.g., information associated with decoding the encoded pattern) and information identifying the channels and / or sensor elements. One or more processors can determine the wavelength range associated with the light beam based on the angle of incidence of the light beam on the channel and angular offset information associated with the channel. In this way, one or more processors can be able to identify multiple wavelength ranges associated with light beams passing through channels of an optical filter and received by the sensor elements of an optical sensor. Therefore, compared to conventional optical sensor devices, this one or more processors improve the ability of the optical sensor device to determine accurate spectral information associated with light entering the optical sensor device. Furthermore, compared to conventional optical sensor devices, this one or more processors improve the accuracy of spectral information over a wider set of wavelengths.

[0022] In some implementations, the one or more processors can determine the incident angle of the additional beam on an additional channel of the optical filter in a manner similar to that described above. The one or more processors can then determine the distance of the object from the optical device (e.g., from the phase mask, optical filter, or optical sensor of the optical device) based on the incident angle of the beam on the channel and the incident angle of the additional beam on the additional channel. In this way, the one or more processors enable the optical sensor device to determine spatial information that would be impossible to determine using conventional optical sensor devices utilizing a single optical filter and a single optical sensor.

[0023] In some implementations, a phase mask can be disposed on a first surface of a substrate, and an optical filter can be disposed on a second surface (e.g., an opposing surface) of the substrate to form a combined optical element. The substrate can have a specific thickness such that the phase mask spans the input surface of the optical filter (e.g., a threshold percentage across the input surface of the optical filter, such as 95%, 98%, 99%, or 99.5%) to encode a patterned distribution of multiple beams. The combined optical element can be disposed on an optical sensor to form an optical sensor device. In this way, a combined optical element can be used instead of a single phase mask and a single optical filter formed on the respective substrates. Therefore, the substrate of the combined optical element can have a thickness less than the combined thickness of the substrate of the single phase mask and the substrate of the single optical filter. This allows the optical sensor device to have a smaller form factor (e.g., a thickness on the order of millimeters) when using a combined optical element compared to using a single phase mask and a single optical filter.

[0024] Figure 1A and Figure 1B This is a diagram summarizing the example implementation 100 described in this article. (See diagram below.) Figure 1A As shown, example implementation 100 includes a phase mask 102, an optical filter 104, and an optical sensor 106. The phase mask 102, optical filter 104, and optical sensor 106 can be associated with optical sensor devices described in more detail elsewhere in this document.

[0025] As in Figure 1A As further shown, the phase mask 102 may include one or more mask elements 108. Each of the one or more mask elements 108 may be transparent or opaque (e.g., reflective, absorptive, and / or the like) and arranged in a pattern (e.g., an uneven pattern). For example, as... Figure 1A As shown, the transparent mask element 108 is shown as a white square, and the opaque mask element 108 is shown as a black square, and the transparent and opaque mask elements 108 are arranged in a grid pattern. The phase mask 102 can be configured to distribute multiple beams passing through the phase mask 102 in a coded pattern on the input surface of the optical filter 104. In some implementations, the phase mask 102 can be a coded aperture or another element of the coded pattern that generates the beams, such as a Fresnel zone plate, an optimized random pattern array, a uniform redundancy array, a hexagonal uniform redundancy array, or a modified uniform redundancy array, and other examples.

[0026] The coded pattern can indicate the origin plane of multiple beams passing through phase mask 102 (e.g., its alignment with the plane described herein). Figure 1BThe object 114 described is associated with the associated angular direction information. In some implementations, one or more mask elements 108 may be arranged in a pattern associated with an algorithm (e.g., a computational coding algorithm) to allow the phase mask 102 to pass through multiple beams and distribute the multiple beams on the input surface of the optical filter 104 in a coded pattern.

[0027] like Figure 1A As further shown, the optical filter 104 may include one or more channels 110 that respectively transmit light in different wavelength ranges to the sensor element 112 of the optical sensor 106. For example, as Figure 1A As shown, a first channel 110 (e.g., indicated by no shading and no pattern) allows light associated with a first wavelength range to be transmitted to a first set of sensor elements 112 of the optical sensor 106 (e.g., comprising one or more sensor elements 112), a second channel 110 (e.g., indicated by gray shading) allows light associated with a second wavelength range to be transmitted to a second set of sensor elements 112 of the optical sensor 106, a third channel 110 (e.g., indicated by a diamond pattern) allows light associated with a third wavelength range to be transmitted to a third set of sensor elements 112 of the optical sensor 106, and so on. In some implementations, the optical filter 104 may have angle-dependent wavelength characteristics. For example, channel 110 can be configured to have an "angle offset" such that when light is incident on channel 110 within a first angle of incidence range, channel 110 allows light associated with a first wavelength range to pass through; when light is incident on channel 110 within a second angle of incidence range, channel 110 allows light associated with a second wavelength range to pass through; when light is incident on channel 110 within a third angle of incidence range, channel 110 allows light associated with a third wavelength range to pass through, and so on. Channel 110 can be configured to allow light associated with a shorter wavelength to pass through when light is incident on channel 110 at a larger angle of incidence.

[0028] In some implementations, the optical filter 104 may include an optical interference filter. The optical interference filter may have angle-dependent wavelength characteristics, which can be expressed by the following equation: Where λ θ Let λ0 represent the peak wavelength at the incident angle θ, λ0 represent the peak wavelength at the incident angle 0°, and n0 represent the refractive index of the incident medium. eThe effective refractive index of the optical interference filter is represented, and θ is the incident angle of the beam. Additionally or optionally, the optical filter 104 may include, for example, a spectral filter, a multispectral filter, a bandpass filter, a blocking filter, a long-wave pass filter, a short-wave pass filter, a dichroic filter, a linear variable filter (LVF), a circular variable filter (CVF), a Fabry-Perot filter (e.g., a Fabry-Perot cavity filter), a Bayer filter, a plasma filter, a photonic crystal filter, a nanostructure and / or metamaterial filter, an absorptive filter (e.g., including other examples such as organic dyes, polymers, and / or glass), and so on.

[0029] As in Figure 1A As further shown, the optical sensor 106 may include one or more sensor elements 112 (e.g., an array of sensor elements, also referred to herein as a sensor array), each sensor element being configured to acquire information. For example, sensor element 112 may provide an indication of the intensity of light incident on sensor element 112 (e.g., active / inactive or a finer-grained indication of intensity). The optical sensor 106 may be configured to collect information acquired by one or more sensor elements 112 to generate sensor data.

[0030] Go to Figure 1B An optical sensor device associated with phase mask 102, optical filter 104, and optical sensor 106 can be configured to capture information related to object 114. In some implementations, one or more light beams may originate from object point 116 of object 114 (e.g., emitted from or reflected from object point 116) and can be received by the optical sensor device. For example, as... Figure 1BAs shown, beams 118 and 120 can originate from object point 116 and both can pass through phase mask 102 and optical filter 104, and both can be received by optical sensor 106. Phase mask 102 can distribute beams 118 and 120 in a coded pattern on the input surface of optical filter 104. Therefore, phase mask 102 can cause beam 118 to be incident on the input surface of optical filter 104 at an incident angle of 122, and beam 120 to be incident on the input surface of optical filter 104 at an incident angle of 124. Beam 118 can be received by channel 110-1 of optical filter 104, and channel 110-1 can transmit beam 118 (e.g., when beam 118 is associated with a wavelength through which channel 110-1 is configured to pass) to the corresponding sensor element 112 of optical sensor 106 (e.g., a sensor element 112 configured to receive beams passing through channel 110-1). The beam 120 can be received by the channel 110-2 of the optical filter 104, and the channel 110-2 can transmit the beam 120 (e.g., when the beam 120 is associated with the wavelength through which the channel 110-2 is configured to pass) to the corresponding sensor element 112 of the optical sensor 106 (e.g., a sensor element 112 configured to receive the beam passing through the channel 110-2).

[0031] As in Figure 1B As further shown, the optical sensor device may be associated with one or more processors 126 and may provide sensor data, as indicated by reference numeral 128, to one or more processors 126. The sensor data may indicate information related to a light beam originating from object 114 and / or object point 116, such as an indication of the intensity of the light beam received by one or more sensor elements 112.

[0032] As in Figure 1BAs further illustrated by reference numeral 130, one or more processors 126 can process sensor data to determine spectral information associated with object 114 and / or object point 116. For example, one or more processors 126 can identify a specific sensor element 112 of the optical sensor 106 receiving a beam of light based on the sensor data. One or more processors 126 can determine, based on information associated with the optical filter 104 (e.g., information stored in a data structure accessible to one or more processors 126), that a specific sensor element 112 is associated with a specific channel 110 of the optical filter 104 (e.g., the specific sensor element 112 is configured to receive a beam of light passing through the specific channel 110), and can identify the specific channel 110 as having received a beam of light and allowing the beam to pass to the specific sensor element 112. Thus, one or more processors 126 can determine that the beam of light is associated with the wavelength range through which the specific channel 110 is configured to pass.

[0033] In some implementations, one or more processors 126 may determine the angle of incidence of the beam on a particular channel 110 based on information associated with the coded pattern (e.g., information stored in the same data structure described above or in a different data structure accessible to one or more processors 126). The information associated with the coded pattern may include information for determining the angle of incidence of a particular beam on a particular channel 110. For example, the information associated with the coded pattern may identify at least one algorithm, such as a computational coding algorithm that causes the phase mask 102 to distribute multiple beams onto the input surface of the optical filter 104 in the coded pattern, and / or other examples such as algorithms for reconstructing an image from the coded pattern. One or more processors 126 may use at least one algorithm to process the information identifying a particular channel 110 to determine the angle of incidence of the beam on the particular channel 110. Additionally or alternatively, one or more processors 126 may use at least one algorithm to process the information identifying a particular channel 110 and a particular sensor element 112 to determine the angle of incidence of the beam on the particular channel 110. Because the information identifying a specific channel 110 and a specific sensor element 112 can indicate a specific location on which the light beam is incident on the specific channel 110, the determination of the incident angle of the light beam by one or more processors 126 can be more accurate and / or more precise when using the information identifying the specific channel 110 and the specific sensor element 112 compared to using the information identifying the specific channel 110.

[0034] In some implementations, one or more processors 126 may determine the wavelength range associated with the light beam based on the incident angle of the light beam on a specific channel 110 and angular offset information associated with the specific channel 110 (e.g., information stored in one or more data structures described above or in different data structures accessible to one or more processors 126). For example, the angular offset information associated with the specific channel 110 may indicate a first wavelength range of the light beam received and passed through the specific channel 110 and incident on the specific channel at an angle satisfying (e.g., less than or equal to) a first incident angle threshold; a second wavelength range of the light beam received and passed through the specific channel 110 and incident on the specific channel 110 at an angle not satisfying (e.g., greater than) the first incident angle threshold and / or satisfying (e.g., less than or equal to) a second incident angle threshold; a third wavelength range of the light beam received and passed through the specific channel 110 and incident on the specific channel 110 at an angle not satisfying (e.g., greater than) the second incident angle threshold and / or satisfying (e.g., less than or equal to) a third incident angle threshold, and so on. Therefore, one or more processors 126 can determine that the beam is associated with a first wavelength range when the incident angle of the beam meets a first incident angle threshold, the beam is associated with a second wavelength range when the incident angle of the beam does not meet the first incident angle threshold and / or meets a second incident angle threshold, and / or the beam is associated with a third wavelength range when the incident angle of the beam does not meet the second incident angle threshold and / or meets a third incident angle threshold, and so on, and other examples.

[0035] As in Figure 1B As shown by reference numeral 132, one or more processors 126 can process sensor data to determine spatial information associated with object 114 and / or object point 116. For example, one or more processors 126 can identify, based on sensor data, a first sensor element 112 of optical sensor 106 that receives a first light beam (e.g., the first light beam originates at object point 116) and a second sensor element 112 of optical sensor 106 that receives a second light beam (e.g., the second light beam originates at object point 116). One or more processors 126 can determine, based on information associated with optical filter 104, that the first sensor element 112 is associated with a first channel 110 of optical filter 104 and that the second sensor element 112 is associated with a second channel 110 of optical filter 104. Thus, one or more processors 126 can identify the first channel 110 as having received the first light beam and transmitted it to the first sensor element 112, and the second channel 110 as having received the second light beam and transmitted it to the second sensor element 112.

[0036] In some implementations, one or more processors 126 may determine the angle of incidence of the first beam on the first channel 110 and the angle of incidence of the second beam on the second channel 110 based on information associated with (e.g., as described above) an encoded pattern (e.g., in a manner similar to that described above). For example, one or more processors 126 may use at least one algorithm identified by information associated with the encoded pattern to process information identifying the first channel 110 and / or information identifying the first sensor element 112 to determine the angle of incidence of the first beam on the first channel 110. One or more processors 126 may also use at least one algorithm to process information identifying the second channel 110 and / or use at least one algorithm to identify the second sensor element 112 to determine the angle of incidence of the second beam on the second channel 110.

[0037] In some implementations, one or more processors 126 may determine the distance of object point 116 from phase mask 102, optical filter 104, and / or optical sensor 106 based on the incident angle of the first beam on the first channel 110 and the incident angle of the second beam on the second channel 110. For example, one or more processors 126 may use computer vision techniques (such as triangulation techniques, stereo vision techniques, and / or the like) to determine the distance to object point 116 based on information indicating the position of the first channel 110 and the incident angle of the first beam on the first channel 110, and information indicating the position of the second channel 110 and the incident angle of the second beam on the second channel 110.

[0038] In some implementations, one or more processors 126 may provide spectral information (e.g., spectral information identifying wavelength ranges associated with one or more light beams) and / or spatial information (e.g., spatial information identifying the distance of object point 116 from phase mask 102, optical filter 104, and / or optical sensor 106) to another device, such as a user device. For example, one or more processors 126 may send spectral and / or spatial information to the user device to cause the user device to display the spectral and / or spatial information on a display of the user device. As another example, one or more processors 126 may send spectral and / or spatial information to the user device to cause the user device to determine one or more characteristics of object 114 (e.g., material composition of object 114, temperature of object 114, position of object 114, trajectory of object 114, and / or the like).

[0039] In this way, compared to conventional optical sensor devices, the optical sensor device associated with phase mask 102, optical filter 104, optical sensor 106, and one or more processors 126 can determine more accurate spectral information associated with the light entering the optical sensor device. Furthermore, compared to conventional optical sensor devices, the optical sensor device provides greater spectral accuracy over a wider range of wavelengths. Moreover, the optical sensor device is able to determine spatial information about objects associated with the light entering the optical sensor device, which is impossible using conventional optical sensor devices.

[0040] As mentioned above, Figure 1A and Figure 1B This is provided only as one or more examples. Other examples may differ from those provided. Figure 1A and Figure 1B The example described.

[0041] Figure 2 This is a diagram of the combined optical element 200 described in this article. (See diagram below.) Figure 2 As shown, a phase mask 102 and an optical filter 104 can be arranged on a substrate 202 to form a combined optical element 200. The phase mask 102 can be formed on surface 204 of the substrate 202, while the optical filter 104 can be formed on surface 206 of the substrate 202. Therefore, the substrate 202 can have a thickness d, which is also the distance between the phase mask 102 and the optical filter 104. The thickness d can be configured such that the phase mask 102 spans the input surface of the optical filter 104 (e.g., spans a threshold percentage of the input surface of the optical filter 104, such as 95%, 98%, 99%, or 99.5% of the input surface of the optical filter 104) to (e.g., as mentioned above regarding...). Figure 1A and Figure 1B The coded pattern is distributed across multiple beams. In some implementations, the combined optical element 200 can be arranged on the optical sensor 106 (e.g., instead of arranging a separate phase mask 102 and a separate optical filter on the optical sensor 106).

[0042] In this way, the combined optical element 200 can be included in the optical sensor device disclosed herein, replacing the individual phase mask 102 and individual optical filter 104 formed on the respective substrates. Therefore, the substrate of the combined optical element 200 can have a thickness d smaller than the total thickness of the substrates of the individual phase mask 102 and the individual optical filter 104. This allows the optical sensor device to have a smaller form factor when using the combined optical element 200 compared to using the individual phase mask 102 and individual optical filter 104.

[0043] Figure 3This is a diagram of an example environment 300 in which the systems and / or methods described in this paper can be implemented. (See diagram 300 for example environments 300.) Figure 3 As shown, environment 300 may include optical sensor device 310, which may include one or more processors 320 (e.g., the one or more processors 320 correspond to those mentioned herein). Figure 1A and Figure 1B The described one or more processors 126) and optical sensor 330 (e.g., the optical sensor 330 corresponds to the one described herein in relation to...) Figure 1A and Figure 1B The optical sensor 106 is described. Environment 300 may also include user equipment 340 and network 350. Devices in environment 300 can be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections.

[0044] Optical sensor device 310 may include optical devices capable of storing, processing, and / or routing spectral and / or spatial information associated with an object. For example, optical sensor device 310 may include a spectrometer device performing spectroscopy, such as a spectral optical sensor device (e.g., a binary multispectral optical sensor device performing vibrational spectroscopy (e.g., near-infrared (NIR) spectrometer), mid-infrared spectroscopy (mid-IR), Raman spectroscopy, and / or the like). For example, optical sensor device 310 may perform health parameter monitoring and determination, pulse propagation time determination, biometric authentication determination, activity detection determination, etc. In this case, optical sensor device 310 may utilize the same wavelength, different wavelengths, combinations of the same wavelength and different wavelengths, etc., for such determinations. In some implementations, optical sensor device 310 may be integrated into user device 340 (e.g., a wearable spectrometer). In some implementations, optical sensor device 310 may receive information from and / or transmit information to another device (e.g., user device 340) in environment 300.

[0045] In some implementations, the optical sensor device 310 may include a spectral imaging camera. A spectral imaging camera is a device capable of capturing images of a scene. The spectral imaging camera (or the processor 320 associated with it) may be able to determine the spectral content or variations in spectral content at different points in the image of the scene (e.g., any point in the image of the scene).

[0046] In some implementations, the optical sensor device 310 may include a spectral imaging camera capable of performing hyperspectral imaging. For example, the optical sensor device 310 may include an optical filter (e.g., as described herein regarding...). Figure 1A and Figure 1BThe optical filter 104 is described. In some implementations, the optical filter may be arranged on the optical sensor 330. In some implementations, the optical sensor device 310 may include a phase mask (e.g., as described herein). Figure 1A and Figure 1B The phase mask 102 is described. For example, the phase mask can be configured to encode a patterned light distribution as light travels across the input surface of an optical filter on its way to the optical sensor 330. Each point in an image captured by the optical sensor device 310 can be encoded with spatial spectral information by the phase mask. In some implementations, a combined optical element including a photomask and an optical filter on opposite sides of the substrate (e.g., as described herein) is used. Figure 2 The combined optical element 200 described can be arranged on the optical sensor 330 (e.g., instead of a separate phase mask and a separate optical filter).

[0047] Optical sensor device 310 may include information about Figure 3 A more detailed description of one or more processors 320.

[0048] Optical sensor device 310 may include optical sensor 330. Optical sensor 330 includes a device capable of sensing light. For example, optical sensor 330 may include an image sensor, a multispectral sensor, a spectral sensor, etc. In some implementations, optical sensor 330 may include a charge-coupled device (CCD) sensor, a complementary metal-oxide-semiconductor (CMOS) sensor, etc. In some implementations, optical sensor 330 may include a front-illuminated (FSI) sensor, a back-illuminated (BSI) sensor, etc. In some implementations, optical sensor 330 may be included in the camera of optical sensor device 310 and / or user equipment 340.

[0049] User equipment 340 includes one or more devices capable of receiving, generating, storing, processing, and / or providing spectral and / or spatial information associated with an object. For example, user equipment 340 may include communication and / or computing devices, such as mobile phones (e.g., smartphones, cordless phones, etc.), computers (e.g., laptops, tablets, handheld computers, etc.), gaming devices, wearable communication devices (e.g., smartwatches, smart glasses, etc.), or similar types of devices. In some implementations, user equipment 340 may receive information from and / or transmit information to another device (e.g., optical sensor device 310) in environment 300.

[0050] Network 350 includes one or more wired and / or wireless networks. For example, network 350 may include cellular networks (e.g., Long Term Evolution (LTE) networks, Code Division Multiple Access (CDMA) networks, 3G networks, 4G networks, 5G networks, other types of next-generation networks, etc.), Public Land Mobile Networks (PLMNs), Local Area Networks (LANs), Wide Area Networks (WANs), Metropolitan Area Networks (MANs), telephone networks (e.g., Public Switched Telephone Networks (PSTN)), private networks, self-organizing networks, intranets, the Internet, fiber-optic-based networks, cloud computing networks, etc., and / or combinations of these or other types of networks.

[0051] Figure 3 The number and arrangement of devices and networks shown are provided as an example. In reality, there could be more. Figure 3 The additional equipment and / or network, fewer equipment and / or network, different equipment and / or network, or differently arranged equipment and / or network compared to the equipment and / or network shown. Furthermore, Figure 3 The two or more devices shown can be implemented within a single device, or Figure 3 The single device shown can be implemented as multiple distributed devices. For example, although the optical sensor device 310 and the user device 340 are described as separate devices, they can be implemented as a single device. Additionally or alternatively, a group of devices in environment 300 (e.g., one or more devices) can perform one or more functions described as being performed by another group of devices in environment 300.

[0052] Figure 4 This is a diagram of example components of device 400. Device 400 may correspond to optical sensor device 310 and / or user equipment 340. In some implementations, optical sensor device 310 and / or user equipment 340 may include one or more devices 400 and / or one or more components of device 400. Figure 4 As shown, device 400 may include bus 410, processor 420, memory 430, storage unit 440, input unit 450, output unit 460 and communication unit 470.

[0053] Bus 410 includes components that allow communication between multiple components of device 400. Processor 420 is implemented in hardware, firmware, and / or a combination of hardware and software. Processor 420 is a central processing unit (CPU), graphics processing unit (GPU), accelerated processing unit (APU), microprocessor, microcontroller, digital signal processor (DSP), field-programmable gate array (FPGA), application-specific integrated circuit (ASIC), or other type of processing unit. In some implementations, processor 420 includes one or more processors that can be programmed to perform functions. Memory 430 includes random access memory (RAM), read-only memory (ROM), and / or other types of dynamic or static storage devices (e.g., flash memory, magnetic storage, and / or optical storage) that store information and / or instructions used by processor 420.

[0054] Storage component 440 stores information and / or software related to the operation and use of device 400. For example, storage component 440 may include hard disks (e.g., magnetic disks, optical disks, and / or magneto-optical disks), solid-state drives (SSDs), compact discs (CDs), digital versatile discs (DVDs), floppy disks, cassette tapes, magnetic tapes, and / or other types of non-transitory computer-readable media along with corresponding drives.

[0055] Input component 450 includes components that allow device 400 to receive information, such as through user input (e.g., touchscreen display, keyboard, keypad, mouse, buttons, switches, and / or microphone). Additionally or optionally, input component 450 may include components for determining location (e.g., a Global Positioning System (GPS) component) and / or sensors (e.g., an accelerometer, gyroscope, actuator, other types of position or environmental sensors, etc.). Output component 460 includes components that provide output information from device 400 (e.g., via a display, speaker, haptic feedback component, audio or visual indicator, etc.).

[0056] Communication component 470 includes transceiver-like components (e.g., transceiver, separate receiver, separate transmitter, etc.) that enable device 400 to communicate with other devices, for example, via a wired connection, a wireless connection, or a combination of wired and wireless connections. Communication component 470 may allow device 400 to receive information from and / or provide information to another device. For example, communication component 470 may include an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, a radio frequency (RF) interface, a universal serial bus (USB) interface, a Wi-Fi interface, a cellular network interface, and so on.

[0057] Device 400 can perform one or more of the processes described herein. Device 400 can perform these processes based on software instructions stored by a non-transitory computer-readable medium (e.g., memory 430 and / or storage unit 440) executed by processor 420. As used herein, the term "computer-readable medium" refers to a non-transitory memory device. A memory device includes memory space within a single physical storage device or memory space distributed across multiple physical storage devices.

[0058] Software instructions may be read from another computer-readable medium or from another device via communication component 470 into memory 430 and / or storage component 440. When executed, the software instructions stored in memory 430 and / or storage component 440 may cause processor 420 to perform one or more processes described herein. Additionally or alternatively, hardware circuitry may be used in place of or in combination with the software instructions to perform one or more processes described herein. Therefore, the implementations described herein are not limited to any particular combination of hardware circuitry and software.

[0059] Figure 4 The number and arrangement of components shown are provided as an example. In practice, device 400 may include components with... Figure 4 The components shown are additional, fewer, different, or differently arranged components compared to those components. Additionally or optionally, a group of components of device 400 (e.g., one or more components) may perform one or more functions described as being performed by another group of components of device 400.

[0060] Figure 5 This is a flowchart of an example process 500 associated with an optical sensor device (e.g., optical sensor device 310). In some implementations, Figure 5 One or more process blocks can be executed by one or more processors of the optical sensor device (e.g., one or more processors 126 or one or more processors 320). In some implementations, Figure 5 One or more process blocks may be executed by another device or group of devices (e.g., user equipment (e.g., user equipment 340)) that is separate from or includes one or more processors. Additionally or optionally, Figure 5 One or more process blocks may be executed by one or more components of device 400 (e.g., processor 420, memory 430, storage component 440, input component 450, output component 460 and / or communication component 470).

[0061] In some implementations, in addition to one or more processors, the optical sensor device may further include: an optical sensor comprising a set of sensor elements; an optical filter having angle-dependent wavelength characteristics, comprising one or more channels, each of the channels being configured to allow light to propagate to a subset of the sensor elements in the set of sensor elements of the optical sensor based on the incident angle of light associated with a specific wavelength on the channel; and a phase mask configured to distribute a plurality of beams associated with an object in a coded pattern on the input surface of the optical filter. In some implementations, the phase mask is disposed on a first surface of a substrate, and the optical filter is disposed on a second surface of the substrate to form a combined optical element, wherein the combined optical element is disposed on the optical sensor. Additionally or alternatively, the thickness of the substrate is configured such that the phase mask spans the input surface of the optical filter to distribute the plurality of beams in a coded pattern.

[0062] like Figure 5 As shown, process 500 may include obtaining sensor data associated with an object from an optical sensor (block 510). For example, as described above, one or more processors may obtain sensor data associated with an object from an optical sensor.

[0063] As in Figure 5 As further shown, process 500 may include determining spectral information associated with an object based on sensor data (block 520). For example, as described above, one or more processors may determine spectral information associated with an object based on sensor data.

[0064] As in Figure 5 As further shown, process 500 may include determining spatial information associated with an object based on sensor data (block 530). For example, as described above, one or more processors may determine spatial information associated with an object based on sensor data. In some implementations, one or more processors may determine spatial information based on sensor data and information associated with an coded pattern.

[0065] As in Figure 5 As further shown, process 500 may include performing one or more actions based on spectral information and spatial information (block 540). For example, as described above, one or more processors may perform one or more actions based on spectral information and spatial information.

[0066] Process 500 may include additional implementations, such as any single implementation or any combination of implementations described below and / or in conjunction with one or more other process descriptions elsewhere herein.

[0067] In a first implementation, for a beam among a plurality of beams distributed in a coded pattern by a phase mask, the information associated with the coded pattern includes information for determining the angle of incidence of the beam on a particular channel when the beam is incident on a particular channel of one or more channels of an optical filter.

[0068] In the second implementation, determining the spatial information includes: identifying a first channel in one or more channels of an optical filter that receives a first beam associated with a point on the object and through which the first beam passes, based on sensor data; identifying a second channel in one or more channels of an optical filter that receives a second beam associated with a point on the object and through which the second beam passes, based on sensor data; determining the angle of incidence of the first beam on the first channel based on information associated with and identifying the first channel using an coded pattern; determining the angle of incidence of the second beam on the second channel based on information associated with and identifying the second channel using an coded pattern; and determining the distance from the point on the object to the optical sensor device based on the angles of incidence of the first beam and the second beam.

[0069] In the third implementation, determining the spatial information includes: identifying, based on sensor data, a first channel in one or more channels of an optical filter that receives and allows the first beam of light associated with a point on the object to pass through, and a first sensor element in a first subset of sensor elements of an optical sensor corresponding to the first channel that receives the first beam of light; identifying, based on sensor data, a second channel in one or more channels of an optical filter that receives and allows the second beam of light associated with a point on the object to pass through, and a second sensor element in a second subset of sensor elements of an optical sensor corresponding to the second channel that receives the second beam of light; determining the angle of incidence of the first beam of light on the first channel based on information associated with and identifying the first channel and the first sensor element using an coded pattern; determining the angle of incidence of the second beam of light on the second channel based on information associated with and identifying the second channel and the second sensor element using an coded pattern; and determining the distance from the point on the object to the optical sensor device based on the angle of incidence of the first beam and the second beam.

[0070] In the fourth implementation, determining the spectral information includes: identifying a specific channel in one or more channels of an optical filter that receives a beam of light associated with a point on the object and through which the beam passes, based on sensor data; determining the angle of incidence of the beam on the specific channel based on information associated with the coded pattern and identifying the specific channel; and determining the wavelength range associated with the beam based on the angle of incidence of the beam and angular offset information associated with the specific channel.

[0071] In the fifth implementation, the angular offset information associated with a specific channel indicates a first wavelength range of a light beam received by the specific channel, passing through the specific channel, and incident on the specific channel at an angle that meets the incident angle threshold, and a second wavelength range of a light beam received by the specific channel, passing through the specific channel, and incident on the specific channel at an angle that does not meet the incident angle threshold.

[0072] In the sixth implementation, determining the spectral information includes: identifying, based on sensor data, a specific channel in one or more channels of an optical filter that receives a beam of light associated with a point on the object and through which the beam passes, and a specific sensor element in a specific subset of sensor elements of an optical sensor corresponding to the specific channel that receives the beam; determining the angle of incidence of the beam on the specific channel based on information associated with and identifying the specific channel and the specific sensor element; and determining the wavelength range associated with the beam based on the angle of incidence of the beam and the angular offset information associated with the specific channel.

[0073] In the seventh implementation, performing one or more actions includes prompting the display of spectral and spatial information on the display of another device.

[0074] although Figure 5 An example block of process 500 is shown, but in some implementations, process 500 may include... Figure 5 Compared to the blocks depicted in the diagram, there may be additional blocks, fewer blocks, different blocks, or blocks arranged differently. Additionally or optionally, two or more blocks of process 500 may be executed in parallel.

[0075] Figure 6 This is a flowchart of an example process 600 associated with an optical sensor device (e.g., optical sensor device 310). In some implementations, Figure 6 One or more process blocks can be executed by one or more processors of the optical sensor device (e.g., one or more processors 126 or one or more processors 320). In some implementations, Figure 6 One or more process blocks may be executed by another device or group of devices (e.g., a user (e.g., user device 340)) that is separate from or includes one or more processors. Additionally or optionally, Figure 6 One or more process blocks may be executed by one or more components of device 400 (e.g., processor 420, memory 430, storage component 440, input component 450, output component 460 and / or communication component 470).

[0076] like Figure 6As shown, process 600 may include obtaining sensor data (block 610) from the optical sensor of the optical sensor device associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device. For example, as described above, one or more processors may obtain sensor data associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device.

[0077] As in Figure 6 As further shown, process 600 may include a channel (block 620) for identifying a received light beam in one or more channels of an optical filter and allowing the light beam to pass through, based on sensor data. For example, as described above, one or more processors may identify a channel for identifying a received light beam in one or more channels of an optical filter and allowing the light beam to pass through, based on sensor data.

[0078] As in Figure 6 As further shown, process 600 may include determining the angle of incidence of the light beam on the channel based on information associated with the coded pattern and identifying the channel (block 630). For example, as described above, one or more processors may determine the angle of incidence of the light beam on the channel based on information associated with the coded pattern and identifying the channel.

[0079] As in Figure 6 As further shown, process 600 may include determining the wavelength range associated with the beam based on the incident angle of the beam and angular offset information associated with the channel (block 640). For example, as described above, one or more processors may determine the wavelength range associated with the beam based on the incident angle of the beam and angular offset information associated with the channel.

[0080] As in Figure 6 As further shown, process 600 may include providing information identifying the wavelength range associated with the light beam (block 650). For example, as described above, one or more processors may provide information identifying the wavelength range associated with the light beam.

[0081] Process 600 may include additional implementations, such as any single implementation or any combination of implementations described below and / or in conjunction with one or more other process descriptions elsewhere herein.

[0082] In a first implementation, providing information to identify the wavelength range associated with the light beam includes sending the information to another device to enable the other device to determine one or more characteristics of an object associated with the light beam.

[0083] In the second implementation, the light beam is associated with a point on the object, and process 600 includes: identifying an additional channel in one or more channels of an optical filter that receives and passes the additional light beam associated with the point on the object, based on sensor data; determining the incident angle of the additional light beam on the additional channel based on information associated with an coded pattern and identifying the additional channel; determining the distance of the point on the object from the optical sensor device based on the incident angle of the light beam and the incident angle of the additional light beam; and providing information on identifying the distance of the point on the object from the optical sensor device.

[0084] In the third implementation, determining the incident angle of the light beam on the channel includes: identifying an algorithm for reconstructing an image from the coded pattern based on information associated with the coded pattern, and using the algorithm and based on the information of the identified channel to determine the incident angle of the light beam.

[0085] In the fourth implementation, the angular offset information associated with the channel indicates a first wavelength range of a light beam received by the channel, passing through the channel, and incident on the channel at an angle that meets the incident angle threshold, and a second wavelength range of a light beam received by the channel, passing through the channel, and incident on the channel at an angle that does not meet the incident angle threshold.

[0086] although Figure 6 An example block of process 600 is shown, but in some implementations, process 600 may include... Figure 6 Compared to the blocks depicted in the diagram, there may be additional blocks, fewer blocks, different blocks, or blocks arranged differently. Additionally or optionally, two or more blocks of process 600 may be executed in parallel.

[0087] Figure 7 This is a flowchart of an example process 700 associated with an optical sensor device (e.g., optical sensor device 310). In some implementations, Figure 7 One or more process blocks can be executed by an optical sensor device. In some implementations, Figure 7 One or more process blocks may be executed by another device or group of devices (e.g., user equipment (e.g., user equipment 340)) that is separate from or includes one or more processors. Additionally or optionally, Figure 7 One or more process blocks may be executed by one or more components of device 400 (e.g., processor 420, memory 430, storage component 440, input component 450, output component 460 and / or communication component 470).

[0088] like Figure 7As shown, process 700 may include obtaining sensor data (block 710) from the optical sensor of the optical sensor device associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device. For example, as described above, the optical sensor device may obtain sensor data associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device.

[0089] As in Figure 7 As further shown, process 700 may include (block 720) a channel (one or more channels of an optical filter) for receiving a light beam and allowing the light beam to pass through, based on sensor data. For example, as described above, an optical sensor device may identify a channel (one or more channels of an optical filter) for receiving a light beam and allowing the light beam to pass through, based on sensor data.

[0090] As in Figure 7 As further shown, process 700 may include a sensor element (block 730) of an optical sensor that receives a light beam, based on sensor data. For example, as described above, an optical sensor device may identify the sensor element of an optical sensor that receives a light beam based on sensor data.

[0091] As in Figure 7 As further shown, process 700 may include determining the angle of incidence of the light beam on the channel based on information associated with and identifying the channel and sensor elements (block 740). For example, as described above, an optical sensor device may determine the angle of incidence of the light beam on the channel based on information associated with and identifying the channel and sensor elements.

[0092] As in Figure 7 As further shown, process 700 may include determining the wavelength range associated with the light beam based on the incident angle of the light beam and angular offset information associated with the channel (block 750). For example, as described above, an optical sensor device may determine the wavelength range associated with the light beam based on the incident angle of the light beam and angular offset information associated with the channel.

[0093] As in Figure 7 As further shown, process 700 may include providing information to identify the wavelength range associated with the light beam (block 760). For example, as described above, an optical sensor device may provide information to identify the wavelength range associated with the light beam.

[0094] Process 700 may include additional implementations, such as any single implementation or any combination of implementations described below and / or in conjunction with one or more other process descriptions elsewhere herein.

[0095] In the first implementation, the light beam is associated with a point on the object, and process 700 further includes: identifying an additional channel in one or more channels of an optical filter that receives and passes through an additional light beam associated with the point on the object, based on sensor data; identifying an additional sensor element of an optical sensor that receives the additional light beam, based on sensor data; determining the incident angle of the additional light beam on the additional channel based on information associated with and identifying the additional channel and the additional sensor element, based on information associated with an coded pattern; determining the distance of the point on the object from the optical sensor device based on the incident angle of the light beam and the incident angle of the additional light beam; and providing information on identifying the distance of the point on the object from the optical sensor device.

[0096] In the second implementation, providing information about the distance between the point of the object being identified and the optical sensor device includes sending the information about the distance between the point of the object being identified and the optical sensor device to another device so that the other device can determine one or more characteristics of the object.

[0097] In the third implementation, determining the incident angle of the beam on the channel includes identifying the incident angle range of the beam based on information associated with the coded pattern and identifying the channel, and determining the incident angle of the beam based on the incident angle range of the beam and information identifying the sensor element.

[0098] In the fourth implementation, the angular offset information associated with the channel indicates a first wavelength range of a light beam received by the channel, passing through the channel, and incident on the channel at an angle that meets the incident angle threshold, and a second wavelength range of a light beam received by the channel, passing through the channel, and incident on the channel at an angle that does not meet the incident angle threshold.

[0099] although Figure 7 An example block of process 700 is shown, but in some implementations, process 700 may include... Figure 7 Compared to the blocks depicted in the diagram, there may be additional blocks, fewer blocks, different blocks, or blocks arranged differently. Additionally or optionally, two or more blocks of process 700 may be executed in parallel.

[0100] The foregoing disclosure provides illustrations and descriptions, but is not intended to be exhaustive or to limit the implementations to the precise forms disclosed. Modifications and variations are possible based on the foregoing disclosure, or may be derived from practice of the implementations.

[0101] As used herein, the term "component" is defined to be broadly interpreted as hardware, firmware, and / or a combination of hardware and software. It will be apparent that the systems and / or methods described herein can be implemented in various forms of hardware, firmware, or combinations of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods does not limit the manner of implementation. Therefore, while the operation and behavior of systems and / or methods are described herein without reference to specific software code, it should be understood that software and hardware can be used to implement systems and / or methods based on those described herein.

[0102] As used in this article, depending on the context, a threshold can refer to a value that is greater than the threshold, greater than or equal to the threshold, less than the threshold, less than or equal to the threshold, equal to the threshold, not equal to the threshold, etc.

[0103] Even if specific combinations of features are listed in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of various implementations. In fact, many of these features can be combined in ways not specifically listed in the claims and / or disclosed in the specification. Although each appended dependent claim may be directly subordinated to only one claim, the disclosure of various implementations includes each dependent claim in combination with each other claim in the group of claims. As used herein, a phrase referring to “at least one” in a list of items means any combination of those items, including a single member. As an example, “at least one of a, b, or c” is intended to cover a, b, c, ab, ac, bc, and abc, as well as any combination with multiple identical items.

[0104] No element, action, or instruction used herein should be construed as essential or necessary unless explicitly described herein. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and may be used interchangeably with “one or more.” Furthermore, as used herein, the article “the” is intended to include one or more items associated with the article “the” and may be used interchangeably with “the one or more.” Furthermore, as used herein, the term “set” is intended to include one or more items (e.g., related items, unrelated items, a combination of related and unrelated items) and may be used interchangeably with “one or more.” Where only one item is intended to be described, the phrase “only one” or similar language is used. Furthermore, as used herein, the terms “has,” “have,” “having,” etc., are specified as open-ended terms. Furthermore, the phrase “based on” is intended to mean “at least partially based on,” unless explicitly stated otherwise. Furthermore, as used herein, the term “or” is intended to be inclusive when used in series and may be used interchangeably with “and / or” unless otherwise expressly stated (e.g., in combination with “any” or “only one of them”).

[0105] This disclosure also relates to the following:

[0106] Project 1). An optical sensor device, comprising:

[0107] An optical sensor, comprising a set of sensor elements;

[0108] An optical filter having angle-dependent wavelength characteristics, the optical filter comprising one or more channels.

[0109] Each of the one or more channels is configured to allow light to be delivered to a subset of the sensor elements in the set of sensor elements of the optical sensor based on the incident angle of light on the channel associated with a specific wavelength;

[0110] A phase mask configured to distribute a plurality of beams associated with an object in a coded pattern on the input surface of the optical filter; and

[0111] One or more processors, wherein the one or more processors are configured to:

[0112] Sensor data associated with the object is obtained from the optical sensor;

[0113] The spectral information associated with the object is determined based on the sensor data;

[0114] Based on the sensor data and information associated with the coded pattern, determine the relationship with...

[0115] The spatial information associated with the object; and

[0116] One or more actions are performed based on the spectral information and the spatial information.

[0117] Project 2). The optical sensor device according to Project 1), wherein the phase mask is disposed on a first surface of a substrate and the optical filter is disposed on a second surface of the substrate to form a combined optical element.

[0118] The combined optical elements are arranged on the optical sensor.

[0119] Project 3). An optical sensor device according to Project 2), wherein the thickness of the substrate is configured such that the phase mask distributes the plurality of light beams in the coded pattern across the input surface of the optical filter.

[0120] Project 4). The optical sensor device according to Project 1), wherein, for a beam among the plurality of beams distributed by the phase mask in the coded pattern, the information associated with the coded pattern includes:

[0121] Information used to determine the angle of incidence of the light beam on a specific channel when the light beam is incident on a specific channel of one or more channels of the optical filter.

[0122] Project 5). The optical sensor device according to Project 1), wherein the one or more processors are configured to, when determining the spatial information:

[0123] Based on the sensor data, a first channel of one or more channels of the optical filter is identified, the first channel receiving a first beam of light associated with a point of the object and allowing the first beam of light to pass through;

[0124] Based on the sensor data, a second channel of one or more channels of the optical filter is identified, the second channel receiving a second beam of light associated with a point of the object and allowing the second beam of light to pass through;

[0125] The angle of incidence of the first beam on the first channel is determined based on information associated with the coded pattern and identifying the first channel.

[0126] The incident angle of the second beam on the second channel is determined based on information associated with the encoded pattern and identifying the second channel; and

[0127] The distance from the object to the optical sensor device is determined based on the incident angles of the first beam and the second beam.

[0128] Project 6). The optical sensor device according to Project 1), wherein the one or more processors are configured to, when determining the spatial information:

[0129] Based on the sensor data, identify the first channel in one or more channels of the optical filter that receives a first beam of light associated with a point of the object and through which the first beam of light passes, and the first sensor element in a first subset of the sensor elements of the optical sensor corresponding to the first channel that receives the first beam of light;

[0130] Based on the sensor data, identify the second channel in one or more channels of the optical filter that receives and passes through a second beam of light associated with a point of the object, and the second sensor element in a second subset of the sensor elements of the optical sensor corresponding to the second channel that receives the second beam of light;

[0131] The angle of incidence of the first beam on the first channel is determined based on information associated with and identifying the first channel and the first sensor element;

[0132] The incident angle of the second beam on the second channel is determined based on information associated with and identifying the second channel and the second sensor element; and

[0133] The distance between the point of the object and the optical sensor device is determined based on the incident angles of the first beam and the second beam.

[0134] Project 7). The optical sensor device according to Project 1), wherein the one or more processors are configured to, when determining the spectral information:

[0135] Based on the sensor data, identify the specific channel in one or more channels of the optical filter that receives the light beam associated with the point of the object and allows the light beam associated with the point of the object to pass through;

[0136] The incident angle of the light beam on the specific channel is determined based on information associated with the coded pattern and identifying the specific channel; and

[0137] The wavelength range associated with the beam is determined based on the incident angle of the beam and the angular offset information associated with the specific channel.

[0138] Item 8). The optical sensor device according to Item 7), wherein the angular offset information associated with the particular channel indicates:

[0139] The first wavelength range of a light beam received by the specific channel, passing through the specific channel, and incident on the specific channel at an angle satisfying the incident angle threshold; and

[0140] The second wavelength range of a light beam received by the specific channel, passing through the specific channel, and incident on the specific channel at an angle that does not meet the incident angle threshold.

[0141] Project 9). The optical sensor device according to Project 1), wherein the one or more processors are configured to, when determining the spectral information:

[0142] Based on the sensor data, identify the specific channel in one or more channels of the optical filter that receives the light beam associated with the point of the object and allows the light beam associated with the point of the object to pass through, and the specific sensor element in a specific subset of the sensor elements of the optical sensor corresponding to the specific channel that receives the light beam;

[0143] The incident angle of the light beam on the specific channel is determined based on information associated with and identifying the specific channel and the specific sensor element; and

[0144] The wavelength range associated with the beam is determined based on the incident angle of the beam and the angular offset information associated with the specific channel.

[0145] Item 10). The optical sensor device according to Item 1), wherein the one or more processors are configured to, when performing the one or more actions:

[0146] The spectral information and the spatial information are displayed on the screen of another device.

[0147] Item 11). A non-transitory computer-readable medium storing instructions, the instructions comprising:

[0148] One or more instructions, which, when executed by one or more processors of the optical sensor device, cause the one or more processors to:

[0149] Sensor data is obtained from the optical sensor of the optical sensor device and associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through the phase mask of the optical sensor device.

[0150] Based on the sensor data, identify the channel through which the received light beam passes in one or more channels of the optical filter;

[0151] The angle of incidence of the light beam on the channel is determined based on information associated with the coded pattern and identifying the channel;

[0152] The wavelength range associated with the beam is determined based on the incident angle of the beam and the angular offset information associated with the channel; and

[0153] Information is provided to identify the wavelength range associated with the light beam.

[0154] Item 12). A non-transitory computer-readable medium according to Item 11), wherein the one or more instructions that cause the optical sensor device to provide information identifying the wavelength range associated with the light beam cause the optical sensor device to:

[0155] Information identifying the wavelength range associated with the light beam is sent to another device so that the other device can determine one or more characteristics of an object associated with the light beam.

[0156] Project 13). A non-transitory computer-readable medium according to Project 11), wherein the light beam is associated with a point of an object, and

[0157] Wherein, the one or more instructions, when executed by the one or more processors, also cause the optical sensor device to:

[0158] Based on the sensor data, identify the additional channel in one or more channels of the optical filter that receives an additional beam of light associated with a point of the object and allows the additional beam of light to pass through;

[0159] The incident angle of the additional beam on the additional channel is determined based on information associated with the coded pattern and identifying the additional channel;

[0160] The distance from the object to the optical sensor device is determined based on the incident angle of the beam and the incident angle of the additional beam; and

[0161] Information is provided regarding the distance between the point identifying the object and the optical sensor device.

[0162] Item 14). A non-transitory computer-readable medium according to Item 11), wherein the one or more instructions that cause the optical sensor device to determine the angle of incidence of the light beam on the channel cause the optical sensor device to:

[0163] An algorithm for reconstructing an image from the coded pattern is identified based on information associated with the coded pattern; and

[0164] The algorithm is used to determine the incident angle of the beam based on the information identifying the channel.

[0165] Item 15). A non-transitory computer-readable medium according to Item 11), wherein the angular offset information associated with the channel indicates:

[0166] The first wavelength range of a light beam received by the channel, passing through the channel, and incident on the channel at an angle satisfying an incident angle threshold; and

[0167] The second wavelength range of the light beam received by the channel, passing through the channel, and incident on the channel at an angle that does not meet the incident angle threshold.

[0168] Project 16). A method comprising:

[0169] Sensor data associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through the phase mask of the optical sensor device is obtained from the optical sensor device and from the optical sensor of the optical sensor device.

[0170] The optical sensor device, based on the sensor data, identifies the channel through which the received light beam passes in one or more channels of the optical filter;

[0171] The optical sensor device is used to identify the sensor element of the optical sensor that receives the light beam based on the sensor data.

[0172] The incident angle of the light beam on the channel is determined by the optical sensor device and based on information associated with the coded pattern and identifying the channel and the sensor element;

[0173] The wavelength range associated with the light beam is determined using the optical sensor device and based on the incident angle of the light beam and the angular offset information associated with the channel; and

[0174] The optical sensor device provides information to identify the wavelength range associated with the light beam.

[0175] Item 17). The method according to Item 16), wherein the beam is associated with a point of the object, wherein the method further includes:

[0176] Based on the sensor data, identify the additional channel in one or more channels of the optical filter that receives an additional beam of light associated with a point of the object and allows the additional beam of light to pass through;

[0177] Based on the sensor data, identify the additional sensor element of the optical sensor that receives the additional light beam;

[0178] The incident angle of the additional beam on the additional channel is determined based on information associated with and identifying the additional channel and the additional sensor element;

[0179] The distance from the object to the optical sensor device is determined based on the incident angle of the beam and the incident angle of the additional beam; and

[0180] Information is provided regarding the distance between the point identifying the object and the optical sensor device.

[0181] Project 18). According to the method of Project 17), wherein providing information on the distance between the point identifying the object and the optical sensor device includes:

[0182] Information about the distance between the point identifying the object and the optical sensor device is sent to another device so that the other device can determine one or more characteristics of the object.

[0183] Item 19). The method according to Item 16), wherein determining the incident angle of the light beam in the channel includes:

[0184] The incident angle range of the light beam is identified based on information associated with the coded pattern and information identifying the channel; and

[0185] The incident angle of the light beam is determined based on the incident angle range of the light beam and the information used to identify the sensor element.

[0186] Item 20). The method according to Item 16), wherein the angular offset information associated with the channel indicates:

[0187] The first wavelength range of a light beam received by the channel, passing through the channel, and incident on the channel at an angle satisfying an incident angle threshold; and

[0188] The second wavelength range of the light beam received by the channel, passing through the channel, and incident on the channel at an angle that does not meet the incident angle threshold.

Claims

1. An optical sensor device, comprising: an optical sensor comprising a set of sensor elements; an optical filter having an angle-dependent wavelength characteristic, the optical filter comprising one or more channels, wherein each of the one or more channels is configured to pass light associated with a particular wavelength to a subset of sensor elements of the set of sensor elements of the optical sensor based on an angle of incidence of the light on the channel; a phase mask configured to distribute a plurality of light beams associated with an object in an encoded pattern on an input surface of the optical filter; and one or more processors configured to: obtain, from the optical sensor, sensor data associated with the object; determine, based on the sensor data, spectral information associated with the object; determine, based on the sensor data and information associated with the encoded pattern, spatial information associated with the object; and perform one or more actions based on the spectral information and the spatial information.

2. The optical sensor device according to claim 1, wherein, the phase mask is arranged on a first surface of a substrate and the optical filter is arranged on a second surface of the substrate to form a combined optical element, wherein the combined optical element is arranged on the optical sensor.

3. The optical sensor device of claim 2, wherein, a thickness of the substrate is configured to cause the phase mask to distribute the plurality of light beams in the encoded pattern across an input surface of the optical filter.

4. The optical sensor device of claim 1, wherein, for a light beam of the plurality of light beams distributed by the phase mask in the encoded pattern, the information associated with the encoded pattern comprises: information for determining an angle of incidence of the light beam on a particular channel of the one or more channels of the optical filter when the light beam is incident on the particular channel.

5. The optical sensor device of claim 1, wherein, the one or more processors are configured to, when determining the spatial information: identify, based on the sensor data, a first channel of the one or more channels of the optical filter that receives and passes a first light beam associated with a point of the object; identify, based on the sensor data, a second channel of the one or more channels of the optical filter that receives and passes a second light beam associated with the point of the object; determine, based on the information associated with the encoded pattern and identifying the first channel, an angle of incidence of the first light beam on the first channel; determine, based on the information associated with the encoded pattern and identifying the second channel, an angle of incidence of the second light beam on the second channel; and determine, based on the angle of incidence of the first light beam and the angle of incidence of the second light beam, a distance of the point of the object from the optical sensor device. the one or more processors are configured to, when determining the spatial information:

6. The optical sensor device of claim 1, wherein, ​ identifying, based on the sensor data, a first channel of the one or more channels of the optical filter that receives and passes a first light beam associated with a point of the object and a first subset of sensor elements of the optical sensor corresponding to the first channel that receive the first light beam; identifying, based on the sensor data, a second channel of the one or more channels of the optical filter that receives and passes a second light beam associated with a point of the object and a second subset of sensor elements of the optical sensor corresponding to the second channel that receive the second light beam; determining, based on information associated with the coded pattern and identifying the first channel and the first sensor elements, an angle of incidence of the first light beam on the first channel; determining, based on information associated with the coded pattern and identifying the second channel and the second sensor elements, an angle of incidence of the second light beam on the second channel; and determining, based on the angle of incidence of the first light beam and the angle of incidence of the second light beam, a distance of the point of the object from the optical sensor device.

7. The optical sensor device of claim 1, wherein, the one or more processors are configured to, when determining the spectral information: identifying, based on the sensor data, a particular channel of the one or more channels of the optical filter that receives and passes a light beam associated with a point of the object; determining, based on information associated with the coded pattern and identifying the particular channel, an angle of incidence of the light beam on the particular channel; and determining, based on the angle of incidence of the light beam and angle offset information associated with the particular channel, a wavelength range associated with the light beam.

8. The optical sensor device according to claim 7, wherein, the angle offset information associated with the particular channel indicates: a first wavelength range of light beams received by the particular channel and passed through the particular channel and incident on the particular channel at angles that satisfy an angle of incidence threshold; and a second wavelength range of light beams received by the particular channel and passed through the particular channel and incident on the particular channel at angles that do not satisfy the angle of incidence threshold.

9. The optical sensor device of claim 1, wherein, the one or more processors are configured to, when determining the spectral information: identifying, based on the sensor data, a particular channel of the one or more channels of the optical filter that receives and passes a light beam associated with a point of the object and a particular subset of sensor elements of the optical sensor corresponding to the particular channel that receive the light beam; determining, based on information associated with the coded pattern and identifying the particular channel and the particular sensor elements, an angle of incidence of the light beam on the particular channel; and determining, based on the angle of incidence of the light beam and angle offset information associated with the particular channel, a wavelength range associated with the light beam.

10. The optical sensor device of claim 1, wherein, the one or more processors are configured to, when performing the one or more actions: causing display of the spectral information and the spatial information on a display of another device.

11. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of an optical sensor device, cause the one or more processors to: obtain, from an optical sensor of the optical sensor device, sensor data associated with a plurality of light beams distributed over an input surface of an optical filter of the optical sensor device by a phase mask of the optical sensor device with an encoded pattern; identify, based on the sensor data, a channel of the one or more channels of the optical filter that receives and passes a light beam; determine, based on information associated with the encoded pattern and identifying the channel, an angle of incidence of the light beam over the channel; determine, based on the angle of incidence of the light beam and angular offset information associated with the channel, a wavelength range associated with the light beam; and provide information identifying the wavelength range associated with the light beam. The one or more instructions that cause the optical sensor device to provide information identifying the wavelength range associated with the light beam cause the optical sensor device to:

12. The non-transitory computer-readable medium of claim 11, wherein, send the information identifying the wavelength range associated with the light beam to another device to cause the other device to determine one or more characteristics of an object associated with the light beam. the light beam is associated with a point of an object, and 13. The non-transitory computer-readable medium of claim 11, wherein, wherein the one or more instructions, when executed by the one or more processors, further cause the optical sensor device to: identify, based on the sensor data, an additional channel of the one or more channels of the optical filter that receives and passes an additional light beam associated with the point of the object; determine, based on information associated with the encoded pattern and identifying the additional channel, an angle of incidence of the additional light beam over the additional channel; determine, based on the angle of incidence of the light beam and the angle of incidence of the additional light beam, a distance of the point of the object from the optical sensor device; and provide information identifying the distance of the point of the object from the optical sensor device. The one or more instructions that cause the optical sensor device to determine the angle of incidence of the light beam over the channel cause the optical sensor device to:

14. The non-transitory computer-readable medium of claim 11, wherein, identify, based on information associated with the encoded pattern, an algorithm for reconstructing an image from the encoded pattern; and determine the angle of incidence of the light beam using the algorithm and based on information identifying the channel. the angular offset information associated with the channel indicates:

15. The non-transitory computer-readable medium of claim 11, wherein, a first wavelength range of light beams received by and passed through the channel and incident on the channel at angles that satisfy an angle of incidence threshold; and a second wavelength range of light beams received by and passed through the channel and incident on the channel at angles that do not satisfy the angle of incidence threshold.

16. A method for determining a wavelength range associated with a light beam, comprising: ​ obtaining, by an optical sensor device and from an optical sensor of the optical sensor device, sensor data associated with a plurality of light beams distributed across an input surface of an optical filter of the optical sensor device by a phase mask of the optical sensor device to encode a pattern; identifying, by the optical sensor device and based on the sensor data, a channel of the one or more channels of the optical filter that receives and passes the light beams; identifying, by the optical sensor device and based on the sensor data, a sensor element of the optical sensor that receives the light beams; determining, by the optical sensor device and based on information associated with the encoded pattern and identifying the channel and the sensor element, an angle of incidence of the light beams on the channel; determining, by the optical sensor device and based on the angle of incidence of the light beams and angle offset information associated with the channel, a wavelength range associated with the light beams; and providing, by the optical sensor device, information identifying the wavelength range associated with the light beams. The light beams are associated with a point of an object, wherein the method further comprises:

17. The method of claim 16, wherein, identifying, based on the sensor data, an additional channel of the one or more channels of the optical filter that receives and passes an additional light beam associated with the point of the object; identifying, based on the sensor data, an additional sensor element of the optical sensor that receives the additional light beam; determining, based on information associated with the encoded pattern and identifying the additional channel and the additional sensor element, an angle of incidence of the additional light beam on the additional channel; determining, based on the angle of incidence of the light beams and the angle of incidence of the additional light beam, a distance of the point of the object from the optical sensor device; and providing information identifying the distance of the point of the object from the optical sensor device. Providing information identifying the distance of the point of the object from the optical sensor device comprises:

18. The method of claim 17, wherein, sending information identifying the distance of the point of the object from the optical sensor device to another device to cause the other device to determine one or more characteristics of the object. Determining the angle of incidence of the light beams on the channel comprises:

19. The method of claim 16, wherein, identifying, based on information associated with the encoded pattern and information identifying the channel, an angle of incidence range of the light beams; and determining, based on the angle of incidence range of the light beams and information identifying the sensor element, the angle of incidence of the light beams. The angle offset information associated with the channel indicates:

20. The method of claim 16, wherein, a first wavelength range of light beams received by and passed through the channel and incident on the channel at angles that satisfy an angle of incidence threshold; and a second wavelength range of light beams received by and passed through the channel and incident on the channel at angles that do not satisfy the angle of incidence threshold.

21. An optical sensor device comprising: an optical filter having an angle-dependent wavelength characteristic, the optical filter comprising one or more channels, ​ ​ wherein the one or more channels comprise channels configured to pass light associated with one or more particular wavelengths to one or more sensor elements based on an angle of incidence of the light on the channels; and a phase mask configured to distribute a plurality of light beams associated with an object in an encoded pattern on an input surface of the optical filter.

22. The optical sensor device of claim 21, wherein, The one or more particular wavelengths comprise wavelengths in a plurality of different wavelength ranges.

23. The optical sensor device of claim 21, wherein, The phase mask is arranged on a first surface of a substrate and the optical filter is arranged on a second surface of the substrate to form a combined optical element.

24. The optical sensor device of claim 23, wherein, The combined optical element is arranged on the one or more sensor elements.

25. The optical sensor device of claim 23, wherein, A thickness of the substrate is configured to cause the phase mask to distribute the plurality of light beams in the encoded pattern across the input surface of the optical filter.

26. The optical sensor device of claim 21, wherein, The phase mask comprises one or more transparent mask elements and one or more opaque mask elements.

27. The optical sensor device of claim 21, wherein, The phase mask comprises a plurality of mask elements arranged in a grid pattern.

28. The optical sensor device of claim 21, wherein, The encoded pattern is capable of indicating angular direction information associated with an origin plane associated with the object.

29. The optical sensor device of claim 21, further comprising: an optical sensor comprising an array of sensor elements, the array of sensor elements comprising the one or more sensor elements.

30. The optical sensor device of claim 21, wherein, The one or more sensor elements comprise sensor elements configured to provide an indication of an intensity of light incident on the sensor elements.

31. A combined optical element, comprising: a substrate; a phase mask arranged on a first surface of the substrate; and an optical filter arranged on a second surface of the substrate, wherein the optical filter comprises channels configured to pass light to one or more sensor elements based on an angle of incidence of the light on the channels, and wherein the phase mask is configured to distribute a plurality of light beams in an encoded pattern across an input surface of the optical filter.

32. The combination optical element of claim 31, wherein, The substrate comprises a thickness, the thickness being a distance between the phase mask and the optical filter.

33. The combination optical element of claim 32, wherein, The thickness is configured to cause the phase mask to distribute the plurality of light beams in the encoded pattern.

34. The combination optical element of claim 31, wherein, The phase mask is configured to distribute the plurality of light beams in the encoded pattern across 95% of an input surface of the optical filter when distributing the plurality of light beams.

35. The combination optical element of claim 31, wherein, The combined optical element is arranged on an optical sensor comprising the one or more sensor elements.

36. An optical sensor device, comprising: an optical filter comprising channels configured to pass light associated with a particular wavelength range when the light is incident on the channels in a particular range of angles of incidence; and a phase mask configured to distribute a plurality of light beams in an encoded pattern on an input surface of the optical filter.

37. The optical sensor device of claim 36, wherein, The channels are further configured to pass different light associated with a different wavelength range when the different light is incident on the channels in a different range of angles of incidence.

38. The optical sensor device of claim 36, wherein the channel is configured to pass light associated with the particular wavelength range to the first set of sensor elements, and wherein the optical filter further comprises a different channel configured to pass a different light associated with a different wavelength range to a second set of sensor elements.

39. The optical sensor device of claim 36, wherein, the phase mask comprises one or more transparent mask elements and one or more opaque mask elements.

40. The optical sensor device of claim 36, wherein, the phase mask comprises a plurality of mask elements arranged in a grid pattern.

41. A combined optical element comprising: a substrate; a phase mask arranged on a first surface of the substrate; and an optical filter arranged on a second surface of the substrate, a thickness of the substrate is a distance between the phase mask and the optical filter, and the thickness of the substrate is configured to cause the phase mask to distribute one or more light beams across an input surface of the optical filter in an encoded pattern.

42. The combination optical element of claim 41, wherein, the optical filter is an optical interference filter.

43. The combination optical element of claim 41, wherein, the optical filter comprises a spectral filter or a multi-spectral filter.

44. The combination optical element of claim 41, wherein, the first surface and the second surface are on opposite sides of the substrate.

45. The combination optical element of claim 41, wherein, the one or more light beams comprise a plurality of light beams.

46. The combination optical element of claim 41, wherein, across the input surface of the optical filter is across more than 95% of the input surface of the optical filter.

47. The combination optical element of claim 41, wherein, the thickness of the substrate is less than a total thickness of a substrate of a single phase mask and a substrate of a single optical filter.

48. An optical sensor device comprising: a combined optical element comprising: a substrate, a phase mask arranged on a first surface of the substrate, and an optical filter arranged on a second surface of the substrate; and one or more other components, wherein a thickness of the substrate is configured to cause the phase mask to distribute one or more light beams across an input surface of the optical filter in an encoded pattern.

49. The optical sensor device of claim 48, wherein, the one or more other components comprise an optical sensor, and wherein the combined optical element is arranged on the optical sensor.

50. The optical sensor device of claim 48, wherein, the one or more other components comprise one or more of: one or more processors, a spectrometer device configured to perform spectroscopy, or a spectral imaging camera.

51. The optical sensor device of claim 48, wherein the device is a user device, wherein the user device comprises an optical sensor device, and wherein the optical sensor device comprises the combined optical element and the one or more other components.

52. The optical sensor device of claim 51, wherein, the user device is a wearable spectrometer.

53. The optical sensor device of claim 48, wherein, a thickness of the substrate is a distance between the phase mask and the optical filter.

54. The optical sensor device of claim 48, wherein, the thickness of the substrate is configured to cause the phase mask to distribute a plurality of light beams across more than 95% of an input surface of the optical filter in an encoded pattern.

55. An element comprising: a substrate; a phase mask arranged on a first surface of the substrate; and an optical filter arranged on a second surface of the substrate, wherein a thickness of the substrate is configured to distribute one or more light beams across an input surface of the optical filter with the phase mask encoding a pattern.

56. The element of claim 55, wherein, The thickness of the substrate is a distance between the phase mask and the optical filter.

57. The element of claim 55, wherein, The optical filter is an interference filter.

58. The element of claim 55, wherein, The second surface of the substrate is an opposite surface of the substrate relative to the first surface of the substrate.

59. The element of claim 55, wherein, The thickness of the substrate is less than a total thickness of a substrate of a single phase mask and a substrate of a single optical filter.

Images