Sensor device and method of using same

Abstract

To provide a multispectral sensor device and a method.SOLUTION: In an example process for region-of-interest (ROI) windowing for a multispectral measurement by a multispectral sensor device, a time-dependent measurement executes the steps of: determining that the time-dependent measurement is to be performed using data collected by one or more channels of a plurality of channels; causing the data to be collected by a proper subset of channels, of the plurality of channels, the proper subset of channels including the one or more channels; and determining the time-dependent measurement based on the data.SELECTED DRAWING: Figure 4

Description

[Background technology]

[0001] Multispectral sensor devices may be utilized to capture information. A vector sensor device can obtain information about a set of electromagnetic fields in a frequency band. The spectral sensor device includes a sensor element (e.g., an optical sensor, a spectral sensor) that acquires information. For example, the present invention may include a collection of sensors (e.g., a sensor array, a sensor for measuring a current, a temperature, a power, a voltage, a current ... A particular sensor element of the array of sensor elements may have a particular associated with a filter that limits the frequency band that is directed toward a given sensor element. The filters can be used to selectively filter the spectrum that they transmit to a particular sensor element. It can be associated with a particular band corresponding to the width of the range. Summary of the Invention

[0002] In some possible embodiments, the multispectral sensor device may include: and one or more processors for performing time-dependent measurements. determining that the time-dependent measurement should be performed on one of a plurality of channels; steps to be performed using the data collected by the above channels; Data is collected on an appropriate subset of channels among multiple channels. a step of selecting a suitable subset of channels, the suitable subset including one or more channels; and determining a time-dependent measure based on the data. sa.

[0003] In some possible embodiments, the method may include the steps of: determining that a measurement should be taken by the device, the measurement being performed by a multispectral sensor; The data collected by one or more of the multiple channels of the device is used The measurements should be performed in a time-dependent manner, with steps and multi-steps. The spectral sensor device detects an appropriate portion of the channels among the plurality of channels. Collecting data by sub-assembly, the appropriate sub-assembly for the channel being selected. The set includes one or more channels, and Determining a measurement based on the data.

[0004] In some possible embodiments, the non-transitory computer readable medium may include one or more of the following: The multispectral sensor device may store instructions for execution by one or more processors. Once generated, the one or more processors are instructed to determine whether a first measurement and a second measurement should be taken. The first measurement is performed on one of a plurality of channels of a multispectral sensor device. using first data collected by one or more first channels of and a second measurement is acquired by a second set of one or more of the plurality of channels. The first measurement should be made using second data collected from the first measurement, and the first measurement should be made using a higher degree of accuracy than the second measurement. The step and the channel number of multiple channels associated with a gradual time dependency collecting first data by a suitable subset of the channels, the appropriate subset of channels includes one or more of a first group of channels; The multispectral sensor device includes a step of collecting data of two channels. and activating all channels of the second channel to collect second data. determining a first measurement based on the first data; and determining a second measurement based on the data. [Brief description of the drawings]

[0005] [Figure 1A] FIG. 1 is a schematic diagram of an exemplary embodiment described herein. [Figure 1B] FIG. 1 is a schematic diagram of an exemplary embodiment described herein. [Figure 1C] FIG. 1 is a schematic diagram of an exemplary embodiment described herein. [Figure 1D] FIG. 1 is a schematic diagram of an exemplary embodiment described herein. [Diagram 2] 1 is a schematic diagram of an example environment in which the systems and / or methods described herein may be implemented. [Diagram 3] 3 is a schematic diagram of example components of one or more of the devices of FIG. 2. [Figure 4] 1 is a flow diagram of an example process for region-of-interest (ROI) processing for time-dependent measurements. [Diagram 5] 13 is a flow diagram for another exemplary process for ROI processing for time-dependent measurements. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] The following detailed description of the exemplary embodiments refers to the accompanying drawings, in which: The same reference numbers in the figures may identify the same or similar elements.

[0007] Time-dependent light, such as for health monitoring applications (e.g., heart rate, blood pressure, etc.) The frame rate used for the optical measurements is often between 250 and 500 samples per second (sps). Multi-spec imaging utilizes multiple pixel areas of a single image sensor. In a volume sensor, a high readout speed for the full sensor can be achieved in the imaging system. This may be limited by the maximum data rate that can be achieved by the readout architecture of the image sensor. This may be an architecture problem or a system bus problem. High resolution and high speed sensors require complex circuitry, increasing the cost and size of the device. Looking for a sensor that offers good size, cost, bit depth, and responsiveness? Full resolution Achieving 250 sps in a large space can be difficult. Size and cost are design considerations. In space-constrained consumer electronics applications, where high frame rates are required for high resolution and This can be difficult to achieve with a bit depth.

[0008] The embodiments described herein provide a method for detecting a particular region of interest (ROI) from a sensor image. By processing only the image, high resolution and high bit rate can be achieved without exceeding the data transfer rate of the imaging system. maintains high frame rates and can handle specific time-sensitive ) spectral channel measurements at high frame rates (e.g. full ROI resolution and / or For example, time-dependent measurements can be obtained for a particular health condition, e.g. It can be used to process time-dependent parameters such as phase parameters. Spectral sensors are slower for measurements that require a full spectrum channel set. Any rate that can be operated at and / or does not exceed the data bus speed of the spectrometer. The data parameter mixing mode can be operated at an intermediate frame rate. The processing can be done by the camera sensor (for charge-coupled device (CCD) based devices). by partial scanning (for complementary metal oxide semiconductor (CMOS) based devices) or This can be done by windowing (for example). Regarding the ROI, partial scanning or windowing is used to perform ROI processing. This allows the data bus speed of the multispectral sensor to be exceeded without exceeding the The time dimension of the time-dependent measurement is maintained, thereby improving the accuracy of the measurement. Some embodiments described herein may be implemented on a multispectral sensor chip (e.g., This can be done before passing the data to the controller, thus reducing latency. Also, the accuracy of the measurement over time is improved.

[0009] 1A-1D are schematic diagrams of an exemplary embodiment 100 described herein. As shown in FIG. 1A, the exemplary embodiment 100 is a microcomputer using a CMOS device or a CCD. A multispectral sensor device such as a multispectral sensor device (e.g., the multispectral sensor device shown in FIG. 2) In some embodiments, the present invention may be implemented using a transducer sensor device 220. 2, such as the controller 210. obtain.

[0010] As shown in FIG. 1, the multispectral sensor device may include a sensor array 105. As shown, the sensor array 105 may include channels 110-1 through 110-64. For example, the sensor array may be configured to obtain information about a plurality of corresponding frequency bands. Additionally or alternatively, the sensor array may include a plurality of sensor elements arranged in a single a plurality of sensor elements configured to obtain information associated with a frequency band; The sensor elements may correspond to the channels 110.

[0011] As shown in FIG. 1B and indicated by reference numeral 120, a multispectral The sensor device may perform measurements based on the area 115. For information on how to perform the measurements, see FIG. As shown by reference numeral 125, The spectral sensor device uses channels 10, 11, 18, and 19 of a sensor array 105. Measurement 1 may be performed by using a multispectral sensor. The multispectral sensor device is a multispectral sensor device that detects all channels of the multispectral sensor device. Measurement 2 can be performed using four channels, where four channels are used in measurement 1, These may be collectively referred to as pixel regions or ROIs. As shown, in measurement 2, the sensor array 10 In some embodiments, all five channels of the sensor array 105 are used in measurement 2. Fewer than all channels may be used.

[0012] In the context of the exemplary embodiment 100, it is assumed that measurement 1 is a time-dependent measurement, and measurement Assume that measurement 2 is not a time-dependent measurement. is a measurement that has associated threshold frame rates and threshold data rates, and is used for accuracy purposes. It can refer to measurements that require precise time measurement and / or other similar measurements. Non-time-sensitive measurements are those that are not related to a threshold frame rate or data rate. Measurements that are not attached, measurements that do not require precise timing, and / or other similar In some embodiments, the time-dependent measurements may be summed up as multispectral. A specific frame rate and and / or resolution. If the data rate of the bus is exceeded, Data may be queued, thereby compromising the time dimension of the data. This may reduce the accuracy of some time-dependent measurements.

[0013] As shown in FIG. 1C and indicated by reference numeral 130, a multispectral The sensor device can determine that measurement 1 is a time-dependent measurement. The multispectral sensor device is connected to the channel associated with measurement 1 (diagonal hatch Collect data only on channels 10, 11, 18, and 19 as indicated in the diagram. In some embodiments, the multispectral sensor device may include an ROI filter, as described below. In some embodiments, the data can be collected using a multispectral sensor. The sensor device performs a partial scan of the sensor array 105, as will be described in more detail below. Data can be collected by using

[0014] In some embodiments, such as when the multispectral sensor device comprises a CCD-based device, The spectral sensor device uses partial scanning of the sensor array 105. For example, to do a partial scan, you can do the following: A large (e.g. continuous) vertical shift is performed on the readout register to avoid unwanted or is not necessary (e.g., associated with channels other than channels 10, 11, 18, and 19) To discard the unwanted or unnecessary charge that is stored in the pixel. Since it is not necessary to read out a complete row, the vertical transfer can be performed much faster. This increases the frame rate because more The ROI scan for measurement 1 is accomplished because fewer rows are output by the sensor. Once this is done, the sensor array 105 can be operated normally and pixels from the appropriate row can be output. (This will be described in detail in FIG. 1D below.)

[0015] In some embodiments, such as when the multispectral sensor device includes a CMOS-based device, Multispectral sensor devices can collect data using ROI windowing. For example, for some CMOS sensor architectures, vertical and horizontal windowing This can result in a corresponding increase in frame rate in some embodiments. This is because the pixel signals are The signal is then sent through a bank of column amplifiers, then to the column A / D converters, and finally The data is then digitized into a high-speed multiplexer and sent off chip. The integration of parallel A / D converters in a CMOS chip allows for high frame rates. A high pixel clock with

[0016] In some embodiments, the windowing for the CMOS sensor may be performed using a single window. can extend beyond 1 to multiple windows, allowing you to select the correct row and column of interest This can be done by appropriate addressing. This means that multispectral sensor devices can be used to capture useful data without exceeding the data rate of the bus. In this way, the sensor output bandwidth utilization rate for multispectral information can be improved. The sensor device can improve measurement frequency and accuracy for time-dependent measurements.

[0017] As shown in FIG. 1D and indicated by reference numeral 135, in some embodiments Now, the multispectral sensor device can determine that measurement 2 is not time dependent. The multispectral sensor device then collects data using the full sensor array 105. Measurement 2 can be determined based on the collected data. The spectral sensor device can collect data for each channel of the sensor array 105. In some embodiments, the multispectral sensor device includes channels 10, 11, 18, and / or data can be collected for the remaining channels other than 19. This may have been used to collect unnecessary data from modules 10, 11, 18, and / or 19. In some embodiments, the multispectral sensor device includes a sensor array. It is possible to collect data at full resolution on all 105 channels, and time-independent More accurate decisions regarding dependent measurements can be made.

[0018] Examples of the operations described in connection with FIGS. 1A-1D include heart rate, blood pressure, SpO2, blood glucose Bio-monitoring for the purpose of measuring blood pressure, hydration, and / or other health parameters Consider a 64-channel multispectral sensor as the device. The sensor is a monolithic multi-layered pixelated sensor (such as a typical silicon CMOS image sensor). The spectrum is obtained by integrating the spectral filters. Heart rate, blood pressure, SpO2, etc. For cardiopulmonary parameters, time-dependent spectral signals at a small number of wavelengths were used Time-dependent measurements at all times (e.g., greater than 250 sps) may be required. By utilizing a spectral ROI windowing technique, a small number of wavelengths can be accommodated. at a rate that satisfies the timing requirements for sampling data in a particular channel. Once the time-dependent measurements are completed, the multi-stage The spectrum sensor is capable of performing a full sensor readout (e.g., for all 64 channels). This captures the remaining channels of data within a full read. This information can then be used to monitor other spectrum health parameters such as blood sugar and hydration. parameters that are time-independent but have high-resolution spectral content. This may be necessary.

[0019] In this way, the multispectral ROI windowing method is useful for high-resolution, high-bit-rate image processing. This method achieves high depth and high frame rate, which would be too expensive and expensive to build. This would have required a complex architecture that would have imposed a considerable burden on the system and its size. For example, the stacking of wafers required to integrate specialized readout circuits into each pixel Other approaches, such as creating dedicated circuits to perform the stochastic sampling and ultra-high speed data collection, are cost-effective and cost-effective. and may not be suitable for achieving high manufacturability. Without an ROI methodology to discard the extra data, a useful signal would be calculated and returned to the user. This requires a large amount of data to be processed before the measurement can be performed, which impairs the time-dependence of the measurement. become.

[0020] The exemplary embodiment 100 is described in the context of a two-dimensional sensor array. The embodiments described herein may also be applied to three-dimensional sensor arrays. For example, The ROI for such a sensor array is one-dimensional (e.g., a single channel or several lines for several channels), two-dimensional (e.g. lines for several channels) layer), or three-dimensional (e.g., two or more layers for one or more channels) It is possible.

[0021] As noted above, FIGS. 1A-1D are presented as examples only. Other examples are possible. 1A-1D。 The configuration may differ from that described in connection with FIGS. 1A-1D.

[0022] FIG. 2 is a diagram of an example environment 200 in which the systems and / or components described herein may be implemented. As shown in FIG. 2, the environment 200 includes a control device 210, The environment 200 may include a multi-spectral sensor device 220, and a network 230. The devices may be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections. do.

[0023] The controller 210 stores, processes, and / or transmits information related to multispectral sensing. The control device 210 may include one or more devices capable of routing. For example, the control device 210 may include a server, a computer, computers, wearable devices, cloud computing devices, and / or other similar In some embodiments, the controller 210 may include a particular multispectral sensor. In some embodiments, the control device 21 may be associated with the sensor device 220. A multispectral sensor device 220 may be associated with multiple multispectral sensor devices 220. In some embodiments, the control device 210 detects an environment 10, such as a multispectral sensor device 220. Receive information from and / or send information to other devices residing within It is possible.

[0024] The multispectral sensor device 220 is directed at the multispectral sensor device 220. This includes devices that can make measurements on light that is reflected by the light, such as multispectral sensor devices. 220 may include an image sensor, a multispectral sensor, and / or the like. These are used to detect light directed at the multispectral sensor device 220. The multispectral sensor device 220 may be implemented using, for example, CMOS or CCD technology. It may utilize one or more sensor technologies, such as multi-sensor technology, multi-sensor technology, and / or the like. The vector sensor device 220 may include multiple sensor elements (e.g., An array of sensors (hereinafter referred to as a sensor array) each configured to acquire information The sensor element corresponds to a certain channel, such as channel 115 in FIG. It is possible to respond.

[0025] Network 230 may include one or more wired and / or wireless networks. For example, The network 230 may include: a cellular network (e.g., an LTE network); network, CDMA network, 3G network, 4G network, 5G network network, other types of next generation networks, etc.), Public Land Mobile Networks (PLMN , public land mobile network), LAN, WAN, metropolitan area network (MAN, me tropolitan area network), telephone network (Public Switched Telephone Network (PTSN) ephone Network), Private Network, Ad-hoc Network, Intranet, Internet Internet, optical fiber networks, cloud computing networks, and / or any combination of these or other types of networks.

[0026] The number and arrangement of devices and networks shown in FIG. 2 are presented as an example. 2, there may be additional devices and / or networks, or fewer devices. and / or networks, or different devices and / or networks, or There may be devices and / or networks arranged in different ways. Two or more of the devices shown in FIG. 2 may be implemented in a single device, and the single device shown in FIG. Additionally or alternatively, the devices of the environment 200 may be distributed among multiple devices. A set (e.g., one or more devices) may be configured to perform actions that are performed by another set of devices in the environment 200. The present invention may provide one or more of the functions described above.

[0027] FIG. 3 is a diagram of example components of an apparatus 300. The apparatus 300 includes a control It may correspond to the device 210 and / or the multispectral sensor device 220. In the embodiment, the control device 210 and / or the multispectral sensor device 220 may include one or more 300 and / or one or more components of the device 300. The device 300 includes a bus 310, a processor 320, a memory 330, and a storage component 3 40, an input component 350, an output component 360, and a communication interface 370.

[0028] Bus 310 connects the components of device 300 together to enable communication between the components. The processor 320 may be hardware, firmware, or a combination of hardware and software. The processor 320 may take the following forms: Processing Unit (CPU), Graphics Processing Unit (GPU), Accelerated Processing Unit (APU), Micro A microprocessor, microcontroller, FPGA, ASIC, or other type of processing In some embodiments, the processor 320 may be programmed to perform certain functions. The memory 330 includes one or more processors that can be randomly accessed. RAM, ROM, and / or processor 320. Another type of dynamic or static storage device (e.g., For example, flash memory, magnetic memory, and / or optical memory.

[0029] The storage component 340 stores information and / or software related to the operation and use of the device 300. For example, the storage component 340 may include: hard disk (e.g., magnetic disk, optical disk, magneto-optical disk, and / or SSD) ), CDs, DVDs, floppy disks, cartridges, magnetic tapes, and and / or another type of non-transitory computer-readable medium, along with a corresponding drive.

[0030] An input component 350 is a component that allows the device 300 to receive information, for example via user input. Includes components that can enable keyboard, keypad, mouse, buttons, switches, and / or microphone). Alternatively, the input component 350 may include a sensor for sensing information. may include (e.g., GPS components, accelerometers, gyroscopes, and / or Output component 360 is a controller that provides output information from device 300. components (e.g., a display, a speaker, and / or one or more LEDs) .

[0031] The communication interface 370 is a transceiver that allows the device 300 to communicate with other devices. component (e.g., transceiver and / or separate receiver and transmitter) This includes, for example, via a wired connection, a wireless connection, or a combination of wired and wireless connections. Communications interface 370 allows device 300 to receive information from another device. and / or provide information to another device. For example, The communication interface 370 may include the following: an Ethernet interface; Interface, Optical Interface, Coaxial Interface, Infrared Interface, Radio Frequency ( RF interface, Universal Serial Bus (USB) interface, Wi-Fi i (registered trademark) interface, cellular network interface, etc.

[0032] The device 300 may perform one or more of the processes described herein. 330 and / or the storage component 340. These operations may be performed by processor 320 executing software instructions provided in the Computer readable media is defined herein as a non-transitory memory device. A memory device may include memory locations within a single physical storage device or multiple physical A memory area distributed across a multi-layer storage device.

[0033] The software instructions may be received from another computer readable medium or through the communication interface 370. into the memory 330 and / or storage component 340 from another device via During execution, the memory 330 and / or the storage component 340 may The software instructions stored in the processor 320 cause the processor 320 to perform the operations described herein. Additionally or alternatively, instead of or in lieu of software instructions, In addition, hardwired circuitry may be used to perform the processes described herein. Thus, the embodiments described herein may be implemented in terms of hardware circuitry and software. The present invention is not limited to any specific combination of

[0034] The number and arrangement of components shown in FIG. 3 are provided as an example. 300 has additional components, fewer components compared to that shown in Figure 3. may include components, different components, or components arranged differently. Additionally or alternatively, a set of components of the device 300 (e.g., one or more components A component is one or more functions performed by a set of separate components of the device 300. Able to perform Noh.

[0035] FIG. 4 shows an exemplary process for ROI windowing for multispectral measurements. 400. In some embodiments, one or more of the processing blocks in FIG. , may be done by the multispectral sensor device 220. In some embodiments, FIG. One or more of the processing blocks may be different from another device or the multispectral sensor device 220. This may be done by another device or by a device that includes the multispectral sensor device 220. (e.g., controller 210).

[0036] As shown in FIG. 4, process 400 includes determining that a time-dependent measurement should be performed. Thus, time-dependent measurements are collected by one or more of the multiple channels. The method may include a step to be performed using the acquired data (S410). For example, The multispectral sensor device 220 may include (e.g., a processor 320 and / or other It may be decided that time-dependent measurements should be performed (using a method that uses a time-dependent using data collected by one or more channels of a sensor array (e.g., In some embodiments, the time-dependent measurement may be performed within a ROI associated with the time-dependent measurement. The measurement determination may be performed by the multispectral sensor device 220 (e.g., based on feedback). In some embodiments, the measurement may be made automatically (based on some setting). (e.g., a particular measurement requires 250 sps).

[0037] As further shown in FIG. 4, the process 400 may include: causing data to be collected by a suitable subset of all channels, The appropriate subset of includes one or more channels (S420). For example, the multispectral sensor device 220 may (e.g., using the processor 320) A suitable subset of the channels (e.g., more than all channels) The data can be collected by using fewer channels. The relevant subset may include one or more channels in the ROI. The multispectral sensor device 220 may employ an ROI windowing technique or partial scanning. Data collection can be accomplished using techniques detailed elsewhere herein. There are.

[0038] As further shown in FIG. 4, a process 400 determines a time-dependent measurement based on the data. For example, the multispectral sensor device 220 may include a step (S430). For example, the processor 320 may be used to determine a time-dependent measurement based on the data. In this way, the data bus transfer of the multispectral sensor device 220 for time-dependent measurements is In some embodiments, the multi-spectral sensor device 220 may include a The data can be provided to a device (eg, controller 210) where the data can be determined.

[0039] The process 400 may be implemented, for example, in any single embodiment or as described below and / or elsewhere herein. Additional embodiments may be included, such as combinations of the described embodiments.

[0040] In some embodiments, the appropriate subset of channels may include one or more channels. In some embodiments, the appropriate subset of channels includes only Each row contains one or more rows, and each row contains one or more channels. In an embodiment, the multispectral sensor device 220 collects signals through one or more channels. In some embodiments, the multispectral sensor may discard data other than the data that is detected. The device 220 determines the appropriate portion for the channel based on the time dependence of the time-dependent measurement. In some embodiments, the time-dependent measurements can be performed in a first The multispectral sensor device 220 is a first data. It can be determined that two measurements should be taken, the second being less stringent than the first. The time dependence can be correlated with the first channel by all channels of multiple channels. A second data set can be collected, and at least a portion of the second data can be used to make a second measurement. In some embodiments, the multispectral sensor device 220 may perform a first A number of iterations of the measurement and the second measurement may be performed, the first measurement being In some embodiments, the first measurement may be taken more frequently than the second measurement. In some embodiments, the first measurement is determined with less latency than the second measurement. is more frequent.

[0041] In some embodiments, the sensor array is a charge-coupled device (CCD) or a complementary metal oxide In some embodiments, the time-dependent measurement includes at least one semiconductor (CMOS) device. is made for biological or medical values.

[0042] In some embodiments, the multi-spectral sensor device 220 comprises a CMOS device. The spectral sensor device 220 performs vertical and horizontal windowing to collect data. In some embodiments, the signal may be collected only by these channels. , the multispectral sensor device 220 includes a CCD. 0's can be collected by making one or more successive vertical shifts into the readout register. In some embodiments, data other than the data that should be included in one or more rows may be discarded. These specific data are not associated with one or more channels and are not used in determining measurements. and the specific data is dropped.

[0043] Although FIG. 4 presents example blocks for process 400, in some embodiments, process 4 00 has additional blocks, fewer blocks, different blocks compared to that shown in FIG. Additionally or alternatively, process 400 may include blocks arranged differently. Two or more blocks of the above can be performed in parallel.

[0044] FIG. 5 illustrates another exemplary ROI windowing for multispectral measurements. 5 is a flow diagram of a process 500. In some embodiments, one or more blocks of FIG. This can be done by a multi-spectral sensor device 220. In some embodiments, one of FIG. One or more blocks may be connected to another device or to a multispectral sensor device 220. This can be done by a group of devices including the multispectral sensor device 220 (e.g., a control device 210).

[0045] As shown in FIG. 5, a process 500 includes a step of determining that a first measurement and a second measurement should be taken. a step of measuring the time dependence of a first measurement relative to a stronger time dependence than a second measurement; For example, the multispectral sensor device 220 may include a step of: , determining (e.g., using processor 320) that a first measurement and a second measurement should be taken. The first measurement is associated with a stronger time dependence than the second measurement. In some embodiments, the first measurement may be performed at a higher data rate, frame rate, or the like than the second measurement. The frame rate and / or resolution may be associated with the image.

[0046] As shown in FIG. 5, a process 500 may include: collecting first data by a suitable subset of the channels, The appropriate subset may include one or more first channels (S520 For example, the multispectral sensor device 220 may (e.g., using the processor 320 (c) extracting first data from a suitable subset of channels of the plurality of channels; The appropriate subset of channels can be collected by one or more first The ROIs may include ROIs corresponding to the channels.

[0047] As further shown in FIG. 5, the process 500 includes the step of collecting second data. , the multispectral sensor device 220 activates all of the multiple channels. and causing the second data to be collected (S530). For example, the multispectral sensor device 220 may (e.g., using the processor 320 ) the second data can be collected. All channels of the channel can be activated to collect second data. .

[0048] As further shown in FIG. 5, the process 500 includes determining a first measurement based on the first data. For example, the multispectral sensor device 220 may include a step of: determining a first measurement based on the first data (e.g., using processor 320); In some embodiments, the multispectral sensor device 220 may determine the first measurement. The first data may be provided to another device (eg, controller 210) for determination.

[0049] As further shown in FIG. 5, the process 500 may include determining a second measurement based on the second data. For example, the multispectral sensor device 220 may include a step of: determining a second measurement based on the second data (e.g., using processor 320); In some embodiments, the multispectral sensor device 220 can determine the second measurement. The second data can be provided to another device (eg, controller 210) for determination.

[0050] The process 500 may be implemented, for example, in any single embodiment or as described below and / or elsewhere herein. Additional embodiments may be included, such as combinations of the described embodiments.

[0051] In some embodiments, the multispectral sensor device 220 may include a first measurement and a second measurement. Multiple iterations of the measurement can be performed, with the first measurement being performed more frequently than the second. In some embodiments, the first measurement may have less latency than the second measurement. In some embodiments, the multispectral sensor device is a CCD or Includes MOS devices.

[0052] Although FIG. 5 presents example blocks for process 500, in some embodiments, process 500 has additional blocks, fewer blocks, different blocks, etc., compared to that shown in FIG. Additionally or alternatively, process 5 may include a lock, a block, or a differently arranged block. Two or more blocks of 00 can be done in parallel.

[0053] In this way, the multispectral ROI windowing method is useful for high-resolution, high-bit-rate image processing. This method achieves high depth and high frame rate, which would be too expensive and expensive to build. This would have required a complex architecture that would have imposed a considerable burden on the system and its size. For example, the stacking of wafers required to integrate specialized readout circuits into each pixel Other approaches, such as creating dedicated circuits to perform the stochastic sampling and ultra-high speed data collection, are cost-effective and cost-effective. and may not be suitable for achieving high manufacturability. Without an ROI methodology to discard the extra data, a useful signal would be calculated and returned to the user. This requires a large amount of data to be processed before the measurement can be performed, which impairs the time-dependence of the measurement. become.

[0054] The above disclosure provides illustration and description, but is not exhaustive. It is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. These may be made in light of the above disclosure or may be acquired from practice of the embodiments. Cut.

[0055] As used herein, the term component refers to hardware, firmware, and and / or a combination of hardware and software. It is intended.

[0056] Some embodiments described herein relate to thresholds. Satisfying a threshold means a value that is greater than the threshold, a value that exceeds the threshold, a value that is higher than the threshold, A value equal to or greater than the threshold, a value less than the threshold, a value less than the threshold, a value lower than the threshold, a value equal to or less than the threshold, It refers to a value equal to a threshold value.

[0057] The systems and / or methods described herein may be implemented in hardware, firmware, or other It can be implemented in various forms as a combination of hardware and software. It is apparent that the present invention relates to a method and apparatus for implementing the present invention. The actual specialized control hardware or software code is not intended to limit the scope of the invention. Therefore, no description of the system and / or software may be provided without specific reference to software code. or the operation and behavior of the method have been described, and software may be developed based on the description in this specification. It is understood that the invention can be implemented in a variety of ways, including by using conventional techniques and hardware. Please note that

[0058] Although particular combinations of features are claimed and / or disclosed in the specification, these The combinations are not intended to limit the disclosure of possible embodiments. Many of these features may be used in methods and / or disclosed in the specification that are not specifically recited in the claims. Each dependent claim may be combined in any manner not expressly permitted herein. Although the invention may be directly dependent only on the claims, the disclosure of possible embodiments is incorporated into each dependent claim. This includes combinations of the claim with any other claim falling within the scope of the claim.

[0059] No element, act or instruction used herein is intended to be critical or essential unless expressly stated to the contrary. In addition, the articles "a" and "an" as used herein are intended to mean one "one or more" refers to one or more items and can be used interchangeably with "one or more." Additionally, as used herein, the term "set" refers to one or more items (e.g., related items). related items, unrelated items, or a combination of related and unrelated items) can be used interchangeably with "one or more." Only one item is intended In this case, the term "one" or similar language is used. Terms such as "has," "have," "having," etc. are intended to be open-ended terms. In addition, unless otherwise noted, the phrase "based on" means "at least in part on "based on" [Explanation of symbols]

[0060] 100 Exemplary Embodiments 200 Example Environment 210 Control device 220 Multispectral Sensor Device 230 Network 300 equipment 310 Bus 320 Processor 330 Memory 340 Memory Components 350 Input Components 360 Output Component 370 Communication Interface

Claims

1. A multispectral sensor device, comprising: at least one sensor array comprising a plurality of sensor elements; At least one processor, collecting first data from a first subset of the sensor elements in the plurality of sensor elements; collecting second data from a second subset of the sensor elements in the plurality of sensor elements; performing multiple repetitions of a first measurement and a second measurement, the first measurement being based on the first data and the second measurement being based on the second data; A processor that performs A multispectral sensor device comprising:

2. A multispectral sensor device as described in claim 1, wherein the first measurement is performed more frequently than the second measurement.

3. A multispectral sensor device as described in claim 1, wherein the first measurement is associated with one or more data rates, frame rates, or resolutions that are higher than the second measurement.

4. A multispectral sensor device as described in claim 1, wherein the second subset of sensor elements includes the remaining sensor elements of the first subset of sensor elements in the plurality of sensor elements.

5. A multispectral sensor device as described in claim 1, wherein the second subset of sensor elements includes all sensor elements of the plurality of sensor elements.

6. In the multispectral sensor device of claim 1, in order to perform multiple repetitions of the first measurement and the second measurement, The at least one processor determining that the first measurement is to be performed; determining that the second measurement is to be performed; obtaining the first measurement based on the first data; obtaining the second measurement based on the second data; Multispectral sensor device.

7. The multispectral sensor device of claim 1, wherein the first measurement is associated with a frame rate of 250 to 500 samples per second.

8. The multispectral sensor device of claim 1, wherein the first subset of sensor elements includes two or more sensor elements from multiple rows of the sensor array.

9. A multispectral sensor device as described in claim 8, wherein the at least one processor further discards data other than the first data collected from the two or more sensor elements.

10. The multispectral sensor device of claim 1, wherein the at least one sensor array includes at least one of a charge coupled device or a complementary metal oxide semiconductor device.

11. The multispectral sensor device of claim 1, wherein the first measurement includes a measurement of a cardiopulmonary function parameter.

12. A multispectral sensor device as described in claim 11, wherein the measurement of the cardiopulmonary function parameter requires a time-dependent measurement of time-dependent spectral signals at a small number of wavelengths.

13. The multispectral sensor device of claim 12, wherein a first subset of the sensor elements corresponds to the small number of wavelengths.

14. The multispectral sensor device of claim 11, wherein the second measurement includes a spectral health parameter different from the measurement of the cardiopulmonary function parameter.

15. A biometric monitoring device for measuring a health status parameter, comprising: A device, comprising: collecting first data from a first subset of sensor elements in a plurality of sensor elements; collecting second data from a second subset of the sensor elements in the plurality of sensor elements; performing multiple repetitions of a first measurement and a second measurement, the first measurement being based on the first data and the second measurement being based on the second data; A biometric monitoring device comprising a device for performing the above.

16. In the biological monitoring device according to claim 15, the device is a multispectral sensor apparatus including at least one sensor array; the at least one sensor array includes the plurality of sensor elements; Biometric monitoring device.

17. The biomedical monitoring device of claim 15, wherein the first measurement includes a measurement of a cardiopulmonary function parameter requiring a time-dependent measurement of a time-dependent spectral signal at a small number of wavelengths.

18. The biological monitoring device of claim 17, wherein a first subset of the sensor elements corresponds to the small number of wavelengths.

19. A method comprising: collecting, by a device, first data from a first subset of sensor elements in a plurality of sensor elements; collecting, by the device, second data from a second subset of the sensor elements in the plurality of sensor elements; performing, by the device, multiple repetitions of a first measurement and a second measurement, the first measurement being based on the first data and the second measurement being based on the second data; The method includes:

20. The method of claim 19, wherein the first measurement is determined with less latency than the second measurement.

Images