Optical sensor device
By combining optical sensors, optical filters, and phase masks with processor selection technology, the complexity of optical measurement and imaging in small shape factor devices has been solved, achieving functional simplification and device reduction.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- VIAVI SOLUTIONS INC(US)
- Filing Date
- 2021-02-03
- Publication Date
- 2026-04-14
AI Technical Summary
Existing optical sensor devices are highly complex in design, assembly, and maintenance, and are difficult to integrate into user devices with small form factor, especially mobile phone devices, making it impossible to simultaneously achieve optical measurement and imaging functions.
By employing a combination of optical sensors, optical filters, and phase masks, beams are distributed through encoded patterns. Combined with processor-selected imaging or spectral processing techniques, output data is generated to achieve optical measurement or imaging functions.
It reduces the complexity of device design, assembly, and maintenance, allowing optical sensor devices to be incorporated into devices with small form factor, providing a single solution for optical measurement and imaging functions.
Smart Images

Figure CN113206932B_ABST
Abstract
Description
[0001] Related applications
[0002] This application claims priority to U.S. Provisional Patent Application No. 62 / 969,578, filed on February 3, 2020, entitled “OPTICAL SENSOR UTILIZING SPECTRAL FILTER,” the contents of which are incorporated herein by reference in their entirety. Technical Field
[0003] This application relates to optical sensor devices. background
[0004] Optical sensor devices can be used to capture information involving light. For example, an optical sensor device can capture information involving a set of wavelengths associated with light. An optical sensor device may include a set of sensor elements (e.g., optical sensors, spectral sensors, and / or image sensors) that capture information. For example, an array of sensor elements can be used to capture information related to multiple wavelengths. The array of sensor elements may be associated with an optical filter. The optical filter may include one or more channels that respectively deliver a specific wavelength to the sensor elements in the array of sensor elements. Summary of the Invention
[0005] In some implementations, the optical sensor device includes: an optical sensor comprising a set of sensor elements; an optical filter comprising one or more channels; a phase mask configured to distribute multiple beams of light associated with an object in a coded pattern on the input surface of the optical filter; and one or more processors configured to: acquire sensor data associated with the object from the optical sensor; determine the distance of the object from the optical sensor device; select a processing technique based on the distance to process the sensor data, wherein the processing technique is an imaging processing technique or a spectral processing technique; process the sensor data using the selected processing technique to generate output data; and perform one or more actions based on the output data.
[0006] In some implementations, the one or more processors are configured to, when determining the distance of the object from the optical sensor device,: obtain proximity data from a proximity sensor associated with the optical sensor device; and determine the distance based on the proximity data.
[0007] In some implementations, the optical filter has angle-dependent wavelength characteristics, wherein the one or more processors are configured to, when determining the distance of the object from the optical sensor device, process the sensor data based on information associated with the coded pattern to identify the corresponding incident angle of a group of beams among the plurality of beams associated with a point of the object on the optical filter; and determine the distance of the object from the optical sensor device based on identifying the corresponding incident angle of the group of beams on the optical filter.
[0008] In some implementations, for a beam distributed in the coded pattern through the phase mask among the plurality of beams, the information associated with the coded pattern includes: information for determining the angle of incidence of the beam on a particular channel when the beam is incident on a particular channel among the one or more channels of the optical filter.
[0009] In some implementations, the one or more processors are configured to, when the processing technique is selected to process the sensor data,: determine whether the distance meets a distance threshold; and select the imaging processing technique based on determining that the distance meets the distance threshold; or select the spectral processing technique based on determining that the distance does not meet the distance threshold.
[0010] In some implementations, the selected processing technique is the imaging processing technique, wherein the one or more processors are configured to, when processing the sensor data to generate the output data: identify an algorithm for reconstructing an image from the coded pattern based on information associated with the coded pattern; and use the algorithm to process the sensor data to generate the output data, wherein the output data includes an image of the object.
[0011] In some implementations, the selected processing technique is the spectral processing technique, and the output data indicates: the classification of the object; the material composition of the object; or the health-related measurement results of the object.
[0012] In some implementations, the one or more processors are configured to, when performing the one or more actions, cause the output data to be displayed on a display of another device.
[0013] In some implementations, a non-transitory computer-readable medium storing instructions includes one or more instructions that, when executed by one or more processors of an optical sensor device, cause the processor to: obtain sensor data from an optical sensor of the optical sensor device associated with a plurality of light beams that are patterned on the input surface of an optical filter of the optical sensor device via a phase mask of the optical sensor device; determine the distance of an object associated with the plurality of light beams from the optical sensor device; select one of a plurality of processing techniques based on the distance to process the sensor data; process the sensor data using the selected processing technique to generate output data; and provide the output data.
[0014] In some implementations, the multiple processing techniques include far-field processing, mid-field processing, and near-field processing. The one or more instructions that cause the optical sensor device to select one of the multiple processing techniques to process the sensor data cause the optical sensor device to: select the far-field processing technique when the distance meets a first distance threshold; select the mid-field processing technique when the distance does not meet the first distance threshold but meets a second distance threshold; or select the near-field processing technique when the distance does not meet the second distance threshold.
[0015] In some implementations, the selected processing technique is a far-field processing technique, wherein one or more instructions that cause the optical sensor device to process the sensor data to generate the output data cause the optical sensor device to: use the far-field processing technique to process the sensor data to generate an image of the object.
[0016] In some implementations, the selected processing technique is a field processing technique, wherein one or more instructions that cause the optical sensor device to process the sensor data to generate the output data cause the optical sensor device to: use the field processing technique to process the sensor data to determine at least one of the following: the classification of the object; or the material composition of the object.
[0017] In some implementations, the selected processing technique is a near-field processing technique, wherein one or more instructions that cause the optical sensor device to process the sensor data to generate the output data cause the optical sensor device to: use the near-field processing technique to process the sensor data to determine health-related measurements of the object.
[0018] In some implementations, the one or more instructions that cause the optical sensor device to provide the output data cause the optical sensor device to: send the output data to another device so that the other device determines one or more characteristics of the object.
[0019] In some implementations, a method for acquiring and processing sensor data includes acquiring sensor data associated with multiple light beams that are patterned on the input surface of an optical filter of an optical sensor device via an optical sensor device and from an optical sensor device; selecting one of a variety of processing techniques via the optical sensor device to process the sensor data, wherein the processing technique is an imaging processing technique or a spectral processing technique; processing the sensor data via the optical sensor device and using the selected processing technique to generate output data; and providing the output data via the optical sensor device.
[0020] In some implementations, selecting the processing technique includes: causing a display associated with the optical sensor device to display a message instructing a user of the optical sensor device to select the imaging processing technique or the spectral processing technique; receiving input data instructing the user's selection after prompting the display of the message; and selecting the imaging processing technique or the spectral processing technique based on the input data.
[0021] In some implementations, selecting the processing technique includes: determining the distance of an object associated with the plurality of light beams from the optical sensor device; and automatically selecting the imaging processing technique or the spectral processing technique based on the distance.
[0022] In some implementations, the selected processing technique is the imaging processing technique, and the output data is an image of an object associated with the plurality of beams.
[0023] In some implementations, the selected processing technique is the spectral processing technique, and the output data indicates: the classification of the object associated with the plurality of beams; the material composition of the object; or the health-related measurement results of the object.
[0024] In some implementations, providing the output data includes sending the output data to another device so that the other device displays the output data on the display of the other device. Attached Figure Description
[0025] Figure 1A-1B This is a diagram illustrating the example implementation described in this article.
[0026] Figure 2This is a diagram of an example environment in which the systems and / or methods described in this paper can be implemented.
[0027] Figure 3 yes Figure 2 A diagram of an example component of one or more devices.
[0028] Figure 4-6 This is a flowchart of an example process related to optical sensor devices. Detailed Implementation
[0029] The following detailed description of the example implementation is with reference to the accompanying drawings. The same reference numerals in different drawings may identify the same or similar elements. The following description uses a spectrometer as an example. However, the techniques, principles, processes, and methods described herein can be used with any sensor, including but not limited to other optical and spectral sensors.
[0030] Conventional optical sensor devices can be used to determine spectral information associated with an object and / or to determine health-related measurements of the object. For example, a conventional optical sensor device can capture light associated with an object to determine health-related measurements or health parameters of the object (e.g., a human body), such as heart rate, blood pressure, or respiratory rate, among other examples. Furthermore, conventional computational imaging devices are lensless devices that can be used to generate images of objects associated with light captured by the conventional computational imaging device. For example, a conventional computational imaging device may include a phase mask of light associated with the object across an optical sensor distribution and can process pattern information associated with the light captured by the optical sensor to generate an image of the object.
[0031] Therefore, devices configured to selectively acquire optical measurements or images of objects associated with them (e.g., handheld or portable devices, non-portable devices, etc.) require the integration of conventional optical sensor devices and conventional computational imaging devices. This increases the complexity associated with designing, assembling, and / or maintaining devices that include these two different conventional devices. Furthermore, the combined coverage area of these two different conventional devices hinders their integration into user devices that require a smaller form factor (e.g., mobile phone devices).
[0032] Some implementations described herein provide an optical sensor device including an optical sensor, an optical filter, a phase mask, and one or more processors. The phase mask is configured to distribute multiple beams of light associated with an object in a coded pattern on the input surface of the optical filter. One or more processors can be configured to acquire sensor data associated with the object from the optical sensor and can determine the distance of the object from the optical sensor device. Based on this distance, one or more processors can select a processing technique from a variety of processing techniques to process the sensor data. The various processing techniques can include imaging processing techniques (e.g., computational imaging processing techniques for generating an image of the object) or spectral processing techniques (e.g., for determining the object's classification, material composition, health-related measurements of the object, etc.). One or more processors can use the selected processing technique to process the sensor data to generate output data, and can provide the output data (e.g., for display on a screen of a user device).
[0033] In this way, the optical sensor device described herein can provide the same functionality as conventional optical sensor devices and conventional computational imaging devices, but uses only one device compared to using two different devices. This reduces the complexity associated with designing, assembling, and / or maintaining devices (e.g., handheld or portable devices, non-portable devices, etc.) that incorporate the optical sensor device and are configured to selectively provide optical measurements of an object or an image of the object. Furthermore, the optical sensor device, as a single device, has a smaller coverage area than a combined coverage area of a conventional optical sensor device and a conventional computational imaging device. This allows the optical device to be incorporated into user devices requiring small form factors (e.g., mobile phone devices), which might be impossible to package in combination with a conventional optical sensor device and a conventional computational imaging device.
[0034] Figure 1A - Figure 1B This is a diagram summarizing the example implementation 100 described in this article. (See diagram below.) Figure 1A As shown, example implementation 100 includes a phase mask 102, an optical filter 104, an optical sensor 106, and / or a light source 108. The phase mask 102, optical filter 104, optical sensor 106, and / or light source 108 may be associated with optical sensor devices described in more detail elsewhere in this document.
[0035] As in Figure 1A As further shown, the phase mask 102 may include one or more mask elements 110. Each of the one or more mask elements 110 may be transparent or opaque (e.g., reflective, absorptive, and / or the like) and arranged in a pattern (e.g., an uneven pattern). For example, as... Figure 1AAs shown, the transparent mask element 110 is shown as a white square, and the opaque mask element 110 is shown as a black square, and the transparent and opaque mask elements 110 are arranged in a grid pattern. In some implementations, the transparent mask element 110 may accordingly include one or more diffusion elements to diffuse light passing through the phase mask 102 via the transparent mask element 110. The phase mask 102 may be configured to distribute multiple beams passing through the phase mask 102 in a coded pattern on the input surface of the optical filter 104. In some implementations, the phase mask 102 may be a coded aperture or another element of the coded pattern that generates the beams, such as a Fresnel zone plate, an optimized random pattern array, a uniform redundancy array, a hexagonal uniform redundancy array, or a modified uniform redundancy array, and other examples.
[0036] The coded pattern can indicate angular direction information associated with the origin plane of the multiple beams passing through the phase mask 102 (e.g., which is associated with object 116 described herein). In some implementations, one or more mask elements 110 can be arranged in a pattern associated with an algorithm (e.g., a computational coding algorithm) to allow the phase mask 102 to pass through the multiple beams and distribute the multiple beams onto the input surface of the optical filter 104 in a coded pattern.
[0037] like Figure 1A As further shown, the optical filter 104 may include one or more channels 112 that respectively transmit light in different wavelength ranges to the sensor element 114 of the optical sensor 106. For example, as Figure 1AAs shown, a first channel 112 (e.g., indicated by no shading and no pattern) allows light associated with a first wavelength range to be transmitted to a first set of sensor elements 114 of the optical sensor 106 (e.g., comprising one or more sensor elements 114), a second channel 112 (e.g., indicated by gray shading) allows light associated with a second wavelength range to be transmitted to a second set of sensor elements 114 of the optical sensor 106, a third channel 112 (e.g., indicated by a diamond pattern) allows light associated with a third wavelength range to be transmitted to a third set of sensor elements 114 of the optical sensor 106, and so on. In some implementations, the optical filter 104 may have angle-dependent wavelength characteristics. For example, channel 112 can be configured to have an "angle offset" such that when light is incident on channel 112 within a first angle of incidence, channel 112 allows light associated with a first wavelength range to pass through; when light is incident on channel 112 within a second angle of incidence, channel 112 allows light associated with a second wavelength range to pass through; when light is incident on channel 112 within a third angle of incidence, channel 112 allows light associated with a third wavelength range to pass through, and so on. Channel 112 can be configured to allow light associated with a shorter wavelength to pass through when light is incident on channel 112 at a larger angle of incidence.
[0038] In some implementations, the optical filter 104 may include an optical interference filter. The optical interference filter may have angle-dependent wavelength characteristics, and these characteristics can be expressed by equations... The formal representation, where λ θ Let λ0 represent the peak wavelength at the incident angle θ, λ0 represent the peak wavelength at the incident angle 0°, and n0 represent the refractive index of the incident medium. e The effective refractive index of the optical interference filter is represented, and θ is the incident angle of the beam. Additionally or optionally, the optical filter 104 may include, for example, a spectral filter, a multispectral filter, a bandpass filter, a blocking filter, a long-wave pass filter, a short-wave pass filter, a dichroic filter, a linear variable filter (LVF), a circular variable filter (CVF), a Fabry-Perot filter (e.g., a Fabry-Perot cavity filter), a Bayer filter, a plasma filter, a photonic crystal filter, a nanostructure and / or metamaterial filter, an absorptive filter (e.g., including other examples such as organic dyes, polymers, and / or glass), and so on.
[0039] As in Figure 1AAs further shown, the optical sensor 106 may include one or more sensor elements 114 (e.g., an array of sensor elements, also referred to herein as a sensor array), each sensor element being configured to acquire information. For example, sensor element 114 may provide an indication of the intensity of light incident on sensor element 114 (e.g., active / inactive or a finer-grained indication of intensity). The optical sensor 106 may be configured to collect information acquired by one or more sensor elements 114 to generate sensor data.
[0040] Light source 108 may include a device capable of generating light (e.g., for illuminating object 116 described herein). For example, light source 108 may include a light-emitting diode (LED), such as a phosphor LED. In some implementations, light source 108 may include multiple LEDs. In this case, a first LED among the multiple LEDs may be associated with a different spectral range than a second LED among the multiple LEDs. This allows the use of multiple LEDs to address a narrow spectral range, rather than using a single LED to address a wide spectral range. In some implementations, light source 108 may include a single modulated LED or multiple modulated LEDs. When light source 108 includes one or more modulated LEDs, an optical sensor device may modulate the power supply of light source 108. Using modulated LEDs allows the LEDs to be driven to higher power than continuous-wave LEDs. Furthermore, modulation can improve the signal-to-noise ratio properties of sensing performed using light from modulated LEDs.
[0041] Go to Figure 1B An optical sensor device associated with phase mask 102, optical filter 104, optical sensor 106, and / or light source 108 can be configured to capture information related to object 116. Object 116 can be in the "far field," "mid field," or "near field" of the optical sensor device. For example, as Figure 1B As shown, when object 116 is at a distance from an optical sensor device (e.g., from phase mask 102, optical filter 104, or optical sensor 106) such that the distance satisfies (e.g., greater than or equal to) a far-field distance threshold (e.g., 5 mm), object 116 may be in the far field. When the distance satisfies (e.g., greater than or equal to) a mid-field distance threshold (e.g., 1 mm) and does not satisfy the far-field distance threshold (e.g., the distance is greater than or equal to 1 mm but less than 5 mm), object 116 may be in the mid-field. When the distance does not satisfy the mid-field distance threshold (e.g., the distance is less than 1 mm), object 116 may be in the near field.
[0042] In some implementations, light from light source 108 and / or ambient light can illuminate object 116. One or more light beams (e.g., beams of light reflected from object point 118) associated with object point 118 of object 116 can be received by an optical sensor device. For example, as Figure 1B As shown, beams 120, 122, and 124 can originate from object point 118. Beam 120 can be blocked by the opaque mask element 110 of phase mask 102. Beams 122 and 124 can each pass through phase mask 102 via their respective transparent mask elements 110. (As shown in...) Figure 1B As further shown, beams 122 and 124 can be diffused by corresponding transparent mask elements 110 as they pass through phase mask 102. Thus, phase mask 102 can distribute beams 122 and 124 in a coded pattern on the input surface of optical filter 104 (e.g., where the corresponding sub-beams of beams 122 and 124 are distributed across the input surface of optical filter 104).
[0043] In some implementations, channel 112 of optical filter 104 can receive a beam or a sub-beam of a beam, but may not transmit the beam or sub-beam to optical sensor 106. For example, as Figure 1B As shown, channel 112 of optical filter 104 can receive one or more sub-beams of beam 122, but may not transmit one or more sub-beams to optical sensor 106 because one or more sub-beams are not associated with one or more wavelength ranges through which channel 112 is configured. In some implementations, channel 112 of optical filter 104 can receive the beam or sub-beams of the beam and can transmit the beam or sub-beams to the corresponding sensor element 114 of optical sensor 106. For example, as Figure 1B As shown, the channel 112 of the optical filter 104 can receive one or more sub-beams of the beam 124, and can transmit one or more sub-beams to one or more corresponding sensor elements 114 of the optical sensor 106 because one or more sub-beams are associated with one or more wavelength ranges through which the channel 112 is configured to pass.
[0044] As in Figure 1B As further shown, the optical sensor device may be associated with one or more processors 126 and may provide sensor data, as indicated by reference numeral 128, to one or more processors 126. The sensor data may indicate information related to a light beam originating from object 116 and / or object point 118, such as an indication of the intensity of the light beam (and / or sub-beams of the light beam) received by one or more sensor elements 114.
[0045] As in Figure 1B As further illustrated by reference numeral 130, one or more processors 126 can determine the distance of object 116 from an optical sensor device (e.g., from phase mask 102, optical filter 104, or optical sensor 106). For example, one or more processors 126 can cause a proximity sensor (e.g., a time-of-flight sensor) associated with the optical sensor device to collect proximity data relating to object 116. The proximity sensor can collect proximity data (e.g., indicating the distance from the proximity sensor to object 116) and can provide the proximity data to one or more processors 126. One or more processors 126 can (e.g., using an algorithm) process the proximity data to determine the distance of object 116 from the optical sensor device.
[0046] As another example, one or more processors 126 may identify, based on sensor data, a first sensor element 114 of optical sensor 106 that receives a first light beam (e.g., originating from object point 118) and a second sensor element 114 of optical sensor 106 that receives a second light beam (e.g., originating from object point 118). One or more processors 126 may determine, based on information associated with optical filter 104 (e.g., indicating a correspondence between channel 112 of optical filter 104 and sensor element 114 of optical sensor 106), that a first channel 112 receives the first light beam and transmits the first light beam to the first sensor element 114, and a second channel 112 that receives the second light beam and transmits the second light beam to the second sensor element 114.
[0047] One or more processors 126 may determine the angle of incidence of the first beam on the first channel 112 and the angle of incidence of the second beam on the second channel 112 based on information associated with the coded pattern. The information associated with the coded pattern may include information for determining the angle of incidence of a particular beam on a particular channel 112 of the optical filter 104. For example, the information associated with the coded pattern may identify at least one algorithm, such as a computational coding algorithm that causes the phase mask 102 to distribute the beams in the coded pattern on the input surface of the optical filter 104, and / or other examples such as algorithms for reconstructing an image from the coded pattern. Therefore, one or more processors 126 may use at least one algorithm identified by the information associated with the coded pattern to process information identifying the first channel 112 and / or the first sensor element 114 and the second channel 112 and / or the second sensor element 114 to determine the angle of incidence of the first beam on the first channel 112 and the second beam on the second channel 112.
[0048] In some implementations, one or more processors 126 can determine the distance of object point 118 from optical sensor devices (e.g., distance from phase mask 102, optical filter 104, optical sensor 106) based on the incident angle of the first beam on the first channel 112 and the incident angle of the second beam on the second channel 112. For example, one or more processors 126 can use computer vision techniques (e.g., triangulation, stereo vision, etc.) to determine the distance to object point 118 based on information indicating the position of the first channel 112 and the incident angle of the first beam on the first channel 112, and information indicating the position of the second channel 112 and the incident angle of the second beam on the second channel 112.
[0049] As in Figure 1B As further illustrated by reference numeral 132, one or more processors 126 may select a processing technique to process the sensor data. For example, one or more processors 126 may select an imaging processing technique or a spectral processing technique. For example, one or more processors 126 may determine whether the distance of object 116 from an optical sensor device (e.g., from phase mask 102, optical filter 104, or optical sensor 106) meets (e.g., is greater than or equal to) a far-field distance threshold (e.g., 5 mm), and may select an imaging processing technique based on determining that the distance meets the far-field distance threshold. One or more processors 126 may select a spectral technique based on determining that the distance does not meet the far-field distance threshold. For example, one or more processors 126 may determine whether the distance meets (e.g., is greater than or equal to) a mid-field distance threshold after determining that the distance does not meet the far-field distance threshold, and may select a first spectral processing technique (e.g., a spectral processing technique optimized to determine spectral information associated with an object in the mid-field range) based on determining that the distance meets the mid-field distance threshold. When one or more processors 126 determine that the distance does not meet the mid-field distance threshold, one or more processors 126 may select a second spectral processing technique (e.g., a spectral processing technique optimized to determine spectral information associated with an object in the near-field range).
[0050] In another example, one or more processors 126 may enable another device (e.g., user equipment) associated with the optical sensor device (e.g., as described in this article regarding...). Figure 2The described display shows a message. This message may instruct a user of the optical sensor device and / or another device to select a processing technique to process the sensor data. For example, the message may instruct the user to select an image processing technique or a spectral processing technique. The user may interact with the user interface of another device to provide input data indicating the user's selection (e.g., selection of an image processing technique or a spectral processing technique). The other device may provide input data to one or more processors 126. Upon receiving the input data, one or more processors may select a processing technique to process the sensor data based on the input data (e.g., selecting the processing technique indicated by the input data).
[0051] As in Figure 1B As further illustrated by reference numeral 134, one or more processors 126 may use a selected processing technique to process sensor data to generate output data. For example, when the selected processing technique is an imaging processing technique, one or more processors 126 may identify an algorithm for reconstructing an image from an coded pattern and may use that algorithm to process sensor data to generate an image of object 116. As another example, when the selected processing technique is a spectral processing technique, one or more processors 126 may identify an algorithm for analyzing spectral data and may use that algorithm to process sensor data to generate spectral information relating to object 116. In some implementations, when using spectral processing techniques, one or more processors 126 may identify the classification of object 116 (e.g., classifying food as fresh or spoiled when object 116 is food), the material composition of object 116 (e.g., identifying one or more materials constituting an object when object 116 is an object), or health-related measurements of object 116 (e.g., identifying pulse, blood pressure, glucose levels, hydration levels, etc. associated with object 116 when object 116 is biological tissue (e.g., biological tissue of a finger).
[0052] In some implementations, one or more processors 126 may provide output data to another device, such as a user device. For example, one or more processors 126 may send output data to the user device to cause the user device to display the output data on its display. As another example, one or more processors 126 may send output data to the user device to cause the user device to determine one or more characteristics of the object 116 (e.g., the classification of the object 116, the material composition of the object 116, health-related measurements of the object 116, etc.).
[0053] As mentioned above, Figure 1A and Figure 1B One or more examples are provided. Other examples may differ from those provided. Figure 1A and Figure 1B The example described.
[0054] Figure 2 This is a diagram of an example environment 200 in which the systems and / or methods described in this paper can be implemented. (See diagram 200 for example environments 200.) Figure 2 As shown, environment 200 may include optical sensor device 210, which may include one or more processors 220 (e.g., the one or more processors 220 correspond to those mentioned herein). Figure 1A and Figure 1B The described one or more processors 126) and optical sensor 230 (e.g., the optical sensor 230 corresponds to the one described herein in relation to...) Figure 1A and Figure 1B The optical sensor 106 is described. Environment 200 may also include user equipment 240 and network 250. Devices in environment 200 can be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections.
[0055] Optical sensor device 210 may include optical devices capable of storing, processing, and / or routing image and / or spectral information associated with an object. For example, optical sensor device 210 may include a computational camera device (e.g., using a computational encoding algorithm) that captures an image of the object. As another example, optical sensor device 210 may include a spectrometer device performing spectroscopy, such as a spectral optical sensor device (e.g., a binary multispectral optical sensor device that performs vibrational spectroscopy (e.g., near-infrared (NIR) spectrometer), mid-infrared spectroscopy (mid-IR), Raman spectroscopy, and / or the like). In another example, optical sensor device 210 may perform health parameter monitoring and determination, pulse propagation time determination, biometric authentication determination, activity detection determination, etc. In this case, optical sensor device 210 may utilize the same wavelength, different wavelengths, combinations of the same wavelength and different wavelengths, etc., for such determinations. In some implementations, optical sensor device 210 may be incorporated into user device 240 (e.g., a wearable spectrometer, etc.). In some implementations, the optical sensor device 210 may receive information from another device (e.g., user equipment 240) in the environment 200 and / or transmit information to another device (e.g., user equipment 240).
[0056] In some implementations, the optical sensor device 210 may include a spectral imaging camera. A spectral imaging camera is a device capable of capturing images of a scene. The spectral imaging camera (or the processor 220 associated with it) may be able to determine the spectral content or variations in spectral content at different points in the image of the scene (e.g., any point in the image of the scene).
[0057] In some implementations, the optical sensor device 210 may include a spectral imaging camera capable of performing hyperspectral imaging. For example, the optical sensor device 210 may include optical filters (e.g., as described herein regarding...). Figure 1A and Figure 1B The optical filter 104 is described. In some implementations, the optical filter may be arranged on the optical sensor 230. In some implementations, the optical sensor device 210 may include a phase mask (e.g., as described herein). Figure 1A and Figure 1B The phase mask 102 is described. For example, the phase mask can be configured to encode a patterned light distribution as light travels across the input surface of the optical filter on its way to the optical sensor 230. Each point in the image captured by the optical sensor device 210 can be encoded with spatial spectral information by the phase mask.
[0058] Optical sensor device 210 may include information about Figure 3 One or more processors 220 described in more detail.
[0059] Optical sensor device 210 may include optical sensor 230. Optical sensor 230 includes a device capable of sensing light. For example, optical sensor 230 may include an image sensor, a multispectral sensor, a spectral sensor, and so on. In some implementations, optical sensor 230 may include a silicon (Si)-based sensor, an indium gallium arsenide (InGaAs)-based sensor, a lead sulfide (PbS)-based sensor, or a germanium (Ge)-based sensor, and may utilize one or more sensor technologies, such as complementary metal-oxide-semiconductor (CMOS) technology or charge-coupled device (CCD) technology, and so on. In some implementations, optical sensor 230 may include a front-illuminated (FSI) sensor, a back-illuminated (BSI) sensor, and so on. In some implementations, optical sensor 230 may be included in the camera of optical sensor device 210 and / or user equipment 240.
[0060] User equipment 240 includes one or more devices capable of receiving, generating, storing, processing, and / or providing imaging and / or spectral information associated with an object. For example, user equipment 240 may include communication and / or computing devices, such as mobile phones (e.g., smartphones, cordless phones, etc.), computers (e.g., laptops, tablets, handheld computers, etc.), gaming devices, wearable communication devices (e.g., smartwatches, smart glasses, etc.), or similar types of devices. In some implementations, user equipment 240 may receive information from and / or transmit information to another device (e.g., optical sensor device 210) in environment 200.
[0061] Network 250 includes one or more wired and / or wireless networks. For example, network 250 may include cellular networks (e.g., Long Term Evolution (LTE) networks, Code Division Multiple Access (CDMA) networks, 2G networks, 4G networks, 5G networks, other types of next-generation networks, etc.), Public Land Mobile Networks (PLMNs), Local Area Networks (LANs), Wide Area Networks (WANs), Metropolitan Area Networks (MANs), telephone networks (e.g., Public Switched Telephone Networks (PSTN)), private networks, self-organizing networks, intranets, the Internet, fiber-optic networks, cloud computing networks, etc., and / or combinations of these or other types of networks.
[0062] Figure 2 The number and arrangement of devices and networks shown are provided as an example. In reality, there could be more. Figure 2 The additional equipment and / or network, fewer equipment and / or network, different equipment and / or network, or differently arranged equipment and / or network compared to the equipment and / or network shown. Furthermore, Figure 2 The two or more devices shown can be implemented within a single device, or Figure 2 The single device shown can be implemented as multiple distributed devices. For example, although optical sensor device 210 and user device 240 are described as separate devices, they can be implemented as a single device. Additionally or alternatively, a group of devices in environment 200 (e.g., one or more devices) can perform one or more functions described as being performed by another group of devices in environment 200.
[0063] Figure 3 This is a diagram of example components of device 300, which may correspond to optical sensor device 210 and / or user equipment 240. In some implementations, optical sensor device 210 and / or user equipment 240 may include one or more devices 300 and / or one or more components of device 300. Figure 3 As shown, device 300 may include bus 310, processor 320, memory 330, storage unit 340, input unit 350, output unit 360 and communication unit 370.
[0064] Bus 310 includes components that allow communication between multiple components of device 300. Processor 320 is a central processing unit, graphics processing unit, microprocessor, controller, microcontroller, digital signal processor, field-programmable gate array, application-specific integrated circuit, and / or other types of processing components. Processor 320 is implemented in hardware, firmware, and / or a combination of hardware and software. In some implementations, processor 320 includes one or more processors that can be programmed to perform functions. Memory 330 includes random access memory, read-only memory, and / or other types of memory (e.g., flash memory, magnetic storage, and / or optical storage).
[0065] Storage component 340 stores information and / or software related to the operation of device 300. For example, storage component 340 may include a hard disk drive, disk drive, optical disk drive, solid-state drive, compact disk, digital multifunction disk, and / or other types of non-transitory computer-readable media. Input component 350 enables device 300 to receive input, such as user input and / or sensed input. For example, input component 350 may include a touchscreen, keyboard, keypad, mouse, buttons, microphone, switch, sensor, GPS component, accelerometer, gyroscope, and / or actuator. Output component 360 includes components that enable device 300 to provide output, for example, via a display, speaker, and / or one or more light-emitting diodes. Communication component 370 enables device 300 to communicate with other devices, for example, via a wired connection or wireless connection. For example, communication component 370 may include a receiver, transmitter, transceiver, modem, network interface card, and / or antenna.
[0066] Device 300 can perform one or more processes described herein. For example, a non-transitory computer-readable medium (e.g., memory 330 and / or storage unit 340) can store a set of instructions (e.g., one or more instructions, code, software code, and / or program code) for execution by processor 320. Processor 320 can execute this set of instructions to perform one or more processes described herein. In some implementations, execution of this set of instructions by one or more processors 320 causes one or more processors 320 and / or device 300 to perform one or more processes described herein. In some implementations, hard-wired circuitry can be used in place of or in combination with instructions to perform one or more processes described herein. Therefore, the implementations described herein are not limited to any particular combination of hardware circuitry and software.
[0067] Figure 3 The number and arrangement of components shown are provided as an example. Device 300 may include components with... Figure 3The components shown are additional, fewer, different, or differently arranged components compared to those components. Additionally or alternatively, a group of components of device 300 (e.g., one or more components) may perform one or more functions described as being performed by another group of components of device 300.
[0068] Figure 4 This is a flowchart of an example process 400 associated with an optical sensor device (e.g., optical sensor device 210). In some implementations, Figure 4 One or more process blocks can be executed by one or more processors of the optical sensor device (e.g., one or more processors 126 or one or more processors 220). In some implementations, Figure 4 One or more process blocks may be executed by another device or group of devices (e.g., user equipment (e.g., user equipment 240)) that is separate from or includes one or more processors. Additionally or optionally, Figure 4 One or more process blocks may be executed by one or more components of device 300 (e.g., processor 320, memory 330, storage component 340, input component 350, output component 360 and / or communication component 370).
[0069] In some implementations, in addition to one or more processors, the optical sensor device may also include: an optical sensor comprising a set of sensor elements; an optical filter comprising one or more channels; and a phase mask configured to distribute multiple beams associated with an object in a coded pattern on the input surface of the optical filter.
[0070] like Figure 4 As shown, process 400 may include obtaining sensor data associated with an object from an optical sensor (block 410). For example, as described above, one or more processors may obtain sensor data associated with an object from an optical sensor.
[0071] As in Figure 4 As further shown, process 400 may include determining the distance of the object from the optical sensor device (block 420). For example, as described above, one or more processors may determine the distance of the object from the optical sensor device.
[0072] As in Figure 4 As further shown, process 400 may include selecting a processing technique for processing sensor data based on distance, wherein the processing technique is an imaging processing technique or a spectral processing technique (block 430). For example, as described above, one or more processors may select a processing technique for processing sensor data based on distance. In some implementations, the processing technique is an imaging processing technique or a spectral processing technique.
[0073] As in Figure 4 As further shown, process 400 may include processing sensor data using a selected processing technique to generate output data (block 440). For example, as described above, one or more processors may use the selected processing technique to process sensor data to generate output data.
[0074] As in Figure 4 As further shown, process 400 may include performing one or more actions based on output data (block 450). For example, as described above, one or more processors may perform one or more actions based on output data.
[0075] Process 400 may include additional implementations, such as any single implementation or any combination of implementations described below and / or with respect to one or more other processes described elsewhere in this document.
[0076] In the first implementation, determining the distance between the object and the optical sensor device includes obtaining proximity data from a proximity sensor associated with the optical sensor device and determining the distance based on the proximity data.
[0077] In the second implementation, the optical filter has angle-dependent wavelength characteristics, and determining the distance of the object from the optical sensor device includes processing sensor data based on information associated with an coded pattern to identify the corresponding incident angles on the optical filter of a set of beams associated with a point of the object among a plurality of beams, and determining the distance of the object from the optical sensor device based on identifying the corresponding incident angles on the optical filter of the set of beams.
[0078] In the third implementation, for a beam distributed in a coded pattern by a phase mask among multiple beams, the information associated with the coded pattern includes information for determining the incident angle of the beam on a particular channel when the beam is incident on a particular channel of one or more channels of an optical filter.
[0079] In the fourth implementation, selecting a processing technique to process the sensor data includes determining whether the distance meets a distance threshold, and selecting an imaging processing technique based on determining that the distance meets the distance threshold, or selecting a spectral processing technique based on determining that the distance does not meet the distance threshold.
[0080] In the fifth implementation, the selected processing technique is an imaging processing technique, and processing sensor data to generate output data includes identifying an algorithm for reconstructing an image from the coded pattern based on information associated with the coded pattern, and using the algorithm to process sensor data to generate output data, wherein the output data includes an image of the object.
[0081] In the sixth implementation, the selected processing technique is spectral processing, and the output data indicates the object's classification, material composition, or health-related measurement results.
[0082] In the seventh implementation, performing one or more actions includes causing the output data to be displayed on the display of another device.
[0083] although Figure 4 An example block of process 400 is shown, but in some implementations, it is different from... Figure 4 Compared to the blocks depicted, process 400 may include additional blocks, fewer blocks, different blocks, or blocks arranged differently. Additionally or optionally, two or more blocks of process 400 may be executed in parallel.
[0084] Figure 5 This is a flowchart of an example process 500 associated with an optical sensor device (e.g., optical sensor device 210). In some implementations, Figure 5 One or more process blocks can be executed by one or more processors of the optical sensor device (e.g., one or more processors 126 or one or more processors 220). In some implementations, Figure 5 One or more process blocks may be executed by another device or group of devices (e.g., user equipment (e.g., user equipment 240)) that is separate from or includes one or more processors. Additionally or optionally, Figure 5 One or more process blocks may be executed by one or more components of device 300 (e.g., processor 320, memory 330, storage component 340, input component 350, output component 360 and / or communication component 370).
[0085] like Figure 5 As shown, process 500 may include obtaining sensor data (block 510) from the optical sensor of the optical sensor device associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device. For example, as described above, one or more processors may obtain sensor data associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device.
[0086] As in Figure 5 As further shown, process 500 may include determining the distance of an object associated with a plurality of beams from the optical sensor device (block 520). For example, as described above, one or more processors may determine the distance of an object associated with a plurality of beams from the optical sensor device.
[0087] As in Figure 5 As further shown, process 500 may include selecting one of a variety of processing techniques based on distance to process the sensor data (block 530). For example, as described above, one or more processors may select one of a variety of processing techniques based on distance to process the sensor data.
[0088] As in Figure 5 As further shown, process 500 may include processing sensor data using a selected processing technique to generate output data (block 540). For example, as described above, one or more processors may use the selected processing technique to process sensor data to generate output data.
[0089] As in Figure 5 As further shown, process 500 may include providing output data (block 550). For example, as described above, one or more processors may provide output data.
[0090] Process 500 may include additional implementations, such as any single implementation or any combination of implementations described below and / or in conjunction with one or more other process descriptions elsewhere herein.
[0091] In the first implementation, the multiple processing techniques include far-field processing, mid-field processing, and near-field processing. Selecting a processing technique from the multiple processing techniques to process sensor data includes selecting far-field processing when the distance meets a first distance threshold, selecting mid-field processing when the distance does not meet the first distance threshold but meets a second distance threshold, or selecting near-field processing when the distance does not meet the second distance threshold.
[0092] In the second implementation, the selected processing technique is a far-field processing technique, and processing sensor data to generate output data includes using far-field processing techniques to process sensor data to generate an image of the object.
[0093] In the third implementation, the selected processing technique is a mid-field processing technique, and processing sensor data to generate output data includes using the mid-field processing technique to process the sensor data to determine one of the following: the classification of the object or the material composition of the object.
[0094] In the fourth implementation, the selected processing technique is near-field processing, and processing sensor data to generate output data includes using near-field processing to process sensor data to determine health-related measurements of the object.
[0095] In the fifth implementation, providing output data includes sending the output data to another device to enable the other device to determine one or more characteristics of the object.
[0096] although Figure 5 An example block of process 500 is shown, but in some implementations, process 500 may include... Figure 5 Compared to the blocks depicted in the diagram, there may be additional blocks, fewer blocks, different blocks, or blocks arranged differently. Additionally or optionally, two or more blocks of process 500 may be executed in parallel.
[0097] Figure 6 This is a flowchart of an example process 600 associated with an optical sensor device. In some implementations, Figure 6 One or more process blocks may be executed by an optical sensor device (e.g., optical sensor device 210). In some implementations, Figure 6 One or more process blocks may be executed by another device or a group of devices (e.g., user equipment (e.g., user equipment 240)) that is separate from or includes the optical sensor device. Additionally or optionally, Figure 6 One or more process blocks may be executed by one or more components of device 300 (e.g., processor 320, memory 330, storage component 340, input component 350, output component 360 and / or communication component 370).
[0098] like Figure 6 As shown, process 600 may include obtaining sensor data (block 610) from the optical sensor of the optical sensor device associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device. For example, as described above, the optical sensor device may obtain sensor data associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through a phase mask of the optical sensor device.
[0099] As in Figure 6 As further shown, process 600 may include selecting one of a variety of processing techniques to process sensor data, wherein the processing technique is an imaging processing technique or a spectral processing technique (block 620). For example, as described above, the optical sensor device may select one of a variety of processing techniques to process sensor data. In some implementations, the processing technique is an imaging processing technique or a spectral processing technique.
[0100] As in Figure 6As further shown, process 600 may include processing sensor data using a selected processing technique to generate output data (block 630). For example, as described above, an optical sensor device may use a selected processing technique to process sensor data to generate output data.
[0101] As in Figure 6 As further shown, process 600 may include providing output data (block 640). For example, as described above, an optical sensor device may provide output data.
[0102] Process 600 may include additional implementations, such as any single implementation or any combination of implementations described below and / or with respect to one or more other processes described elsewhere in this document.
[0103] In the first implementation, the selection processing technique includes causing a display associated with the optical sensor device to display a message instructing the user of the optical sensor device to select an imaging processing technique or a spectral processing technique, receiving input data instructing the user to select the technique after prompting the display of the message, and selecting the imaging processing technique or the spectral processing technique based on the input data.
[0104] In the second implementation, the selection of processing techniques includes determining the distance of an object associated with multiple light beams from the optical sensor device, and automatically selecting an imaging processing technique or a spectral processing technique based on that distance.
[0105] In the third implementation, the selected processing technique is an imaging processing technique, and the output data is an image of an object associated with multiple beams.
[0106] In the fourth implementation, the selected processing technique is spectral processing, and the output data indicates the classification of objects associated with multiple beams, the material composition of the objects, or the health-related measurements of the objects.
[0107] In the fifth implementation, providing output data includes sending the output data to another device so that the other device displays the output data on the display of the other device.
[0108] although Figure 6 An example block of process 600 is shown, but in some implementations, process 600 may include... Figure 6 Compared to the blocks depicted in the diagram, there may be additional blocks, fewer blocks, different blocks, or blocks arranged differently. Additionally or optionally, two or more blocks of process 600 may be executed in parallel.
[0109] The foregoing disclosure provides illustrations and descriptions, but is not intended to be exhaustive or to limit the implementations to the precise forms disclosed. Modifications and variations are possible based on the foregoing disclosure, or may be derived from practice of the implementations.
[0110] As used herein, the term "component" is defined to be broadly interpreted as hardware, firmware, and / or a combination of hardware and software. It will be apparent that the systems and / or methods described herein can be implemented in various forms of hardware, firmware, or combinations of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods does not limit the manner of implementation. Therefore, while the operation and behavior of systems and / or methods are described herein without reference to specific software code, it should be understood that software and hardware can be used to implement systems and / or methods based on those described herein.
[0111] As used in this article, depending on the context, satisfying the threshold can refer to a value that is greater than the threshold, greater than or equal to the threshold, less than the threshold, less than or equal to the threshold, equal to the threshold, not equal to the threshold, etc.
[0112] Even if specific combinations of features are listed in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of various implementations. In fact, many of these features can be combined in ways not specifically listed in the claims and / or disclosed in the specification. Although each appended dependent claim may be directly subordinated to only one claim, the disclosure of various implementations includes each dependent claim in combination with each other claim in the group of claims. As used herein, a phrase referring to “at least one” in a list of items means any combination of those items, including a single member. As an example, “at least one of a, b, or c” is intended to cover a, b, c, ab, ac, bc, and abc, as well as any combination with multiple identical items.
[0113] No element, action, or instruction used herein should be construed as essential or necessary unless explicitly described herein. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and may be used interchangeably with “one or more.” Furthermore, as used herein, the article “the” is intended to include one or more items associated with the article “the” and may be used interchangeably with “the one or more.” Furthermore, as used herein, the term “set” is intended to include one or more items (e.g., related items, unrelated items, a combination of related and unrelated items) and may be used interchangeably with “one or more.” Where only one item is intended to be described, the phrase “only one” or similar language is used. Furthermore, as used herein, the terms “has,” “have,” “having,” etc., are specified as open-ended terms. Furthermore, the phrase “based on” is intended to mean “at least partially based on,” unless explicitly stated otherwise. Furthermore, as used herein, the term “or” is intended to be inclusive when used in series and may be used interchangeably with “and / or” unless otherwise expressly stated (e.g., in combination with “any” or “only one of them”).
Claims
1. An optical sensor device, comprising: An optical sensor, comprising a set of sensor elements; An optical filter, the optical filter comprising one or more channels; A phase mask, configured to distribute multiple beams associated with an object in an encoded pattern on the input surface of the optical filter; as well as One or more processors, wherein the one or more processors are configured to: Sensor data associated with the object is obtained from the optical sensor; Determine the distance between the object and the optical sensor device; The processing technique for processing the sensor data is selected based on the distance. The processing technology mentioned above is one of the following technologies: Imaging processing techniques, said imaging processing techniques being used to generate an image of at least a portion of the object, wherein the object is a human body, or Spectral processing technology; The sensor data is processed using the selected processing technology to generate output data; and One or more actions are performed based on the output data.
2. The optical sensor device according to claim 1, wherein, The one or more processors are configured to, when determining the distance of the object from the optical sensor device: Proximity data is obtained from a proximity sensor associated with the optical sensor device; as well as The distance is determined based on the proximity data.
3. The optical sensor device according to claim 1, wherein, The optical filter has angle-dependent wavelength characteristics, and Wherein, the one or more processors are configured to, when determining the distance of the object from the optical sensor device: The sensor data is processed based on information associated with the coded pattern to identify the corresponding incident angle of a set of beams associated with a point of the object in the plurality of beams on the optical filter; and The distance between the object and the optical sensor device is determined based on the identification of the corresponding incident angle of the set of light beams on the optical filter.
4. The optical sensor device according to claim 3, wherein, For one of the plurality of beams distributed in the coded pattern through the phase mask, the information associated with the coded pattern includes: Information used to determine the angle of incidence of the light beam on a specific channel when the light beam is incident on a specific channel of one or more channels of the optical filter.
5. The optical sensor device according to claim 1, wherein, The one or more processors are configured to, when the processing technology is selected to process the sensor data: Determine whether the distance meets the distance threshold; as well as The imaging processing technique is selected based on determining that the distance satisfies the distance threshold; or The spectral processing technique is selected based on the determination that the distance does not meet the distance threshold.
6. The optical sensor device according to claim 1, wherein, The selected processing technique is the imaging processing technique, and Wherein, the one or more processors are configured to, when processing the sensor data to generate the output data: Based on information associated with the coded pattern, an algorithm for reconstructing an image from the coded pattern is identified; and The algorithm is used to process the sensor data to generate the output data. The output data includes the image of at least a portion of the object.
7. The optical sensor device according to claim 1, wherein, The selected processing technique is the spectral processing technique, and the output data indicates: The classification of the objects; The material composition of the object; or The health-related measurement results of the subject.
8. The optical sensor device according to claim 1, wherein, The one or more processors are configured to, when performing the one or more actions: This causes the output data to be displayed on the screen of another device.
9. A non-transitory computer-readable medium storing instructions, the instructions comprising: One or more instructions, which, when executed by one or more processors of the optical sensor device, cause the one or more processors to: Sensor data is obtained from the optical sensor of the optical sensor device and associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through the phase mask of the optical sensor device. Determine the distance of the object associated with the plurality of light beams from the optical sensor device; Based on the distance, a processing technique from a variety of processing techniques is selected to process the sensor data. The processing technology mentioned above is one of the following technologies: Imaging processing techniques, said imaging processing techniques being used to generate an image of at least a portion of the object, wherein the object is a human body, or Spectral processing technology; The sensor data is processed using the selected processing technology to generate output data; and Provide the output data.
10. The non-transitory computer-readable medium according to claim 9, wherein, The various processing technologies include far-field processing technology, mid-field processing technology, and near-field processing technology. The one or more instructions that cause the optical sensor device to select one of the multiple processing techniques to process the sensor data enable the optical sensor device to: The far-field processing technology is selected when the distance meets the first distance threshold. When the distance does not meet the first distance threshold but meets the second distance threshold, the mid-field processing technology is selected; or The near-field processing technique is selected when the distance does not meet the second distance threshold.
11. The non-transitory computer-readable medium according to claim 9, wherein, The selected processing technology is far-field processing technology. Wherein, the far-field processing technology is the imaging processing technology, and The one or more instructions that cause the optical sensor device to process the sensor data to generate the output data cause the optical sensor device to: The far-field processing technique is used to process the sensor data to generate the image of at least a portion of the object.
12. The non-transitory computer-readable medium according to claim 9, wherein, The selected processing technology is mid-range processing technology. Wherein, the mid-field processing technology is the spectral processing technology, and The one or more instructions that cause the optical sensor device to process the sensor data to generate the output data cause the optical sensor device to: The aforementioned mid-field processing technique is used to process the sensor data to determine at least one of the following: The classification of the object; or The material composition of the object.
13. The non-transitory computer-readable medium according to claim 9, wherein, The selected processing technology is near-field processing technology. The near-field processing technology is the spectral processing technology, and The one or more instructions that cause the optical sensor device to process the sensor data to generate the output data cause the optical sensor device to: The near-field processing technique is used to process the sensor data to determine the health-related measurements of the object.
14. The non-transitory computer-readable medium according to claim 9, wherein, The one or more instructions that cause the optical sensor device to provide the output data cause the optical sensor device to: The output data is sent to another device so that the other device can determine one or more characteristics of the object.
15. A method for processing sensor data, comprising: Sensor data associated with multiple light beams that are patterned and distributed on the input surface of the optical filter of the optical sensor device through the phase mask of the optical sensor device is obtained from the optical sensor device and from the optical sensor of the optical sensor device. The optical sensor device selects a processing technique from a variety of processing techniques to process the sensor data. The processing technology mentioned above is one of the following technologies: Imaging processing technology, said imaging processing technology being used to generate an image of at least a part of a human body, or Spectral processing technology; The sensor data is processed using the optical sensor device and a selected processing technique to generate output data; and The output data is provided by the optical sensor device.
16. The method according to claim 15, wherein, The selected processing technology includes: The display associated with the optical sensor device displays a message instructing the user of the optical sensor device to select the imaging processing technology or the spectral processing technology; After prompting the display of the message, receive input data indicating the user's selection; and Based on the input data, the imaging processing technique or the spectral processing technique is selected.
17. The method according to claim 15, wherein, The selected processing technology includes: Determine the distance between the human body and the optical sensor device; and Based on the distance, the imaging processing technique or the spectral processing technique is automatically selected.
18. The method according to claim 15, wherein, The selected processing technique is the imaging processing technique, and the output data is the image of the at least part of the human body.
19. The method according to claim 15, wherein, The selected processing technique is the spectral processing technique, and the output data indicates: The classification of the human body; The material composition of the human body; or The results of health-related measurements of the human body.
20. The method of claim 15, wherein, The output data provided includes: The output data is sent to another device so that the other device displays the output data on the display of the other device.
21. An optical sensor device, comprising: A phase mask, the phase mask being configured to distribute multiple beams in an coded pattern; as well as One or more processors, wherein the one or more processors are configured to: Based on information associated with the coded pattern, a first incident angle of the first beam among the plurality of beams is determined; Based on the information associated with the coded pattern, a second incident angle of the second beam among the plurality of beams is determined; Based on the first incident angle and the second incident angle, determine the distance from the object point to the optical sensor device; and Sensor data is processed based on the distance.
22. The optical sensor device according to claim 21, wherein, The phase mask includes multiple mask elements. The plurality of mask elements includes one or more transparent mask elements, and The one or more transparent mask elements include one or more diffusion elements configured to diffuse multiple light beams passing through the phase mask via the one or more transparent mask elements.
23. The optical sensor device according to claim 21, further comprising: An optical sensor, which is used to generate the sensor data; as well as An optical filter, comprising multiple channels, The plurality of channels includes channels configured to perform the following operations: Receive a beam from the plurality of beams or a sub-beam of the beam from the plurality of beams, and The light beam or the sub-beam is transmitted to the corresponding sensor element of the optical sensor.
24. The optical sensor device according to claim 23, wherein, The beam or the sub-beam is associated with one or more wavelength ranges that the channel is configured to pass through.
25. The optical sensor device according to claim 23, wherein, The channel is also configured not to pass through one or more other sub-beams.
26. The optical sensor device according to claim 21, further comprising: An optical sensor, which is used to generate the sensor data; as well as The one or more processors are further configured to: Receive sensor data from the optical sensor.
27. The optical sensor device according to claim 21, wherein, The distance is the distance between the object point and the phase mask.
28. The optical sensor device according to claim 21, further comprising: An optical filter, comprising a first channel and a second channel, Wherein, the first incident angle is the incident angle of the first beam on the first channel, and Wherein, the second incident angle is the incident angle of the second beam on the second channel.
29. The optical sensor device according to claim 28, wherein, To determine the distance, the one or more processors are configured to: The distance is determined based on the first position of the first channel, the first incident angle, the second position of the second channel, and the second incident angle.
30. A method for processing sensor data, comprising: The first incident angle of the first beam among a plurality of beams is determined by an optical sensor device and based on information associated with a coded pattern. The second incident angle of the second beam among the plurality of beams is determined by the optical sensor device and based on the information associated with the coded pattern; The distance from the object point to the optical sensor device is determined using the optical sensor device and based on the first incident angle and the second incident angle; as well as The optical sensor device processes sensor data based on the distance.
31. The method of claim 30, further comprising: The optical sensor of the optical sensor device generates the sensor data.
32. The method of claim 31, further comprising: Receive a beam from the plurality of beams or a sub-beam of the beam from the plurality of beams; as well as The light beam or the sub-beam is transmitted to the corresponding sensor element of the optical sensor.
33. The method of claim 30, further comprising: Receive sensor data from the optical sensor.
34. The method according to claim 30, wherein, The distance is the distance between the object point and the phase mask of the optical sensor device.
35. The method according to claim 30, wherein, Determining the distance includes: The distance is determined based on the first position of the first channel of the optical filter, the first incident angle, the second position of the second channel of the optical filter, and the second incident angle.
36. A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising: One or more instructions, which, when executed by one or more processors of the optical sensor device, cause the optical sensor device to: Determine the first incident angle of the first beam among multiple beams; Determine the second incident angle of the second beam among the plurality of beams; Based on the first incident angle and the second incident angle, determine the distance from the object point to the optical sensor device; and Sensor data is processed based on the distance.
37. The non-transitory computer-readable medium according to claim 36, wherein, The one or more instructions also cause the optical sensor device to: The optical sensor of the optical sensor device is used to generate the sensor data.
38. The non-transitory computer-readable medium according to claim 37, wherein, The one or more instructions also cause the optical sensor device to: Receive a beam from the plurality of beams or a sub-beam of the beam from the plurality of beams; and The light beam or the sub-beam is transmitted to the corresponding sensor element of the optical sensor.
39. The non-transitory computer-readable medium according to claim 36, wherein, The one or more instructions also cause the optical sensor device to: Receive sensor data from the optical sensor.
40. The non-transitory computer-readable medium according to claim 36, wherein, The distance is the distance between the object point and the phase mask of the optical sensor device.
Citation Information
Patent Citations
Optical Spectroscopy with Overlapping Images
US20060274308A1
Methods and systems for processing an image
WO2018214067A1