Biological monitoring device, method, and non-temporary computer-readable medium
ROI processing and windowing techniques enhance multispectral sensor performance by allowing high-resolution, high-bit-depth, and high-frame-rate measurements within data transfer speed limits, addressing the constraints of existing multispectral sensors.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- VIAVI SOLUTIONS INC(US)
- Filing Date
- 2025-04-02
- Publication Date
- 2026-06-25
AI Technical Summary
Existing multispectral sensors face challenges in achieving high resolution, high bit depth, and high frame rate without exceeding data transfer speed limitations, particularly in spatially constrained consumer electronics applications.
The implementation of Region of Interest (ROI) processing and windowing techniques in multispectral sensors, such as partial scanning or windowing, allows for time-dependent spectral channel measurements at high frame rates without exceeding data bus speed, maintaining accuracy by discarding unnecessary data.
This approach enables high-resolution, high-bit-depth, and high-frame-rate measurements, improving measurement accuracy and reducing latency by optimizing data processing within the constraints of data transfer speeds.
Smart Images

Figure 0007880459000001 
Figure 0007880459000002 
Figure 0007880459000003
Abstract
Description
Background Art
[0001] Information can be captured by utilizing a multispectral sensor device. For example, the multispe ctral sensor device can obtain information regarding a set of electromagnetic fields in a certain frequency band. The multispe ctral sensor device can include a set of sensor elements (e.g., optical sensors, spectral sensors, and / or image sensors) for obtaining information. For example, by utilizing an array of sensor elements, information regarding multiple frequencies can be obtained. A specific sensor element of the sensor element array can be associated with a filter that restricts the frequency band directed towards the specific sensor element. The filter can be associated with a specific band corresponding to the width of the spectral range that the filter transmits towards the specific sensor element.
Summary of the Invention
[0002] In some possible embodiments, the multispectral sensor device can include: a sensor array having a plurality of channels and one or more processors, the step of determining that time-dependent measurements should be performed, where the time-dependent measurements should be performed using data collected by one or more of the plurality of channels, the step of collecting data by an appropriate subset of the plurality of channels, where the appropriate subset of channels includes one or more channels, and the step of determining the time-dependent measurements based on the data. A processor that performs the steps of collecting data by an appropriate subset of the plurality of channels, where the appropriate subset of channels includes one or more channels, and determining the time-dependent measurements based on the data.
[0003] In some possible embodiments, the method can include the following steps: a multispectral sensor The step of deciding that the measurement should be performed by the instrument, and the measurement is performed by multispectral sensor Data collected by one or more channels of the device's multiple channels is used It is said that the measurements should be carried out in steps and multi-steps, and the measurements are associated with time dependence. A spectral sensor device provides appropriate information for one of the multiple channels. A step in which data is collected by sub-sets, and the appropriate part of the channel The set includes one or more channels, and is performed by a multispectral sensor device. A step in determining measurements based on data.
[0004] In some possible embodiments, non-temporary computer-readable media include one or more of the following: Instructions can be stored: Executed by one or more processors of a multispectral sensor device. When this is done, one or more processors will decide to perform the first measurement and the second measurement. Step, where the first measurement is performed using multiple channels of a multispectral sensor device. This should be done using first data collected by one or more first channels. The second measurement is performed by a second group of one or more channels from among multiple channels. It is stipulated that the second set of collected data should be used, and the first measurement should be higher than the second measurement. Steps and channels among multiple channels are associated with a degree of time dependence. A step of collecting first data by an appropriate subset of the character, A suitable subset of channels is a step containing one or more first channel groups, and the Step 2 involves collecting data, wherein the multispectral sensor device has multiple channels. The system is configured to activate all channels of the channel and collect second data. The steps include: a step of determining a first measurement based on the first data, and a second step of determining a first measurement based on the first data. An instruction to perform the step of determining a second measurement based on the data. [Brief explanation of the drawing]
[0005] [Figure 1A] This is a schematic diagram of an exemplary embodiment described herein. [Figure 1B] This is a schematic diagram of an exemplary embodiment described herein. [Figure 1C] This is a schematic diagram of an exemplary embodiment described herein. [Figure 1D] This is a schematic diagram of an exemplary embodiment described herein. [Figure 2] This is a schematic diagram of an exemplary environment in which the system and / or method described herein may be implemented. [Figure 3] This is a schematic diagram of one or more exemplary components of the device shown in Figure 2. [Figure 4] This is a flowchart illustrating an exemplary process for processing regions of interest (ROIs) for time-dependent measurement. [Figure 5] This is a flowchart illustrating another exemplary process for ROI processing for time-dependent measurement. [Modes for carrying out the invention]
[0006] For a detailed description of exemplary embodiments, see the attached drawings. The same reference numeral can identify the same or similar elements.
[0007] Time-dependent light for health monitoring applications (e.g., heart rate, blood pressure, etc.) The frame rate used for scientific measurements is sometimes 250-500 samples per second (sps, samp). made per second). A multi-spectroscopic sensor that utilizes multiple pixel regions of a single image sensor In a multi-spectral sensor, the high readout speed for the full sensor can be limited by the maximum data transfer speed achievable in the imaging system. This can be due to issues with the readout architecture of the image sensor or issues with the system bus. High-resolution, high-speed sensors with a high bit depth require complex circuitry, increasing the cost and size of the device. It can be difficult to achieve 250 sps at full resolution when seeking a sensor with good size, cost, bit depth, and responsiveness. In spatially constrained consumer electronics applications where size and cost are design considerations, it can be difficult to achieve a high frame rate at high resolution and high bit depth.
[0008] The embodiments described herein can maintain high resolution, high bit depth, and high frame rate without exceeding the data transfer speed of the imaging system by processing the view of a specific region of interest (ROI) from the sensor image. For example, specific time-dependent spectral channel measurements can be obtained at a high frame rate (e.g., at full ROI resolution and / or bit depth). For example, time-dependent measurements can be used to process time-dependent parameters such as specific health state parameters. A full-spectrum sensor can operate at a lower rate for measurements that require a full set of spectral channels and / or at an intermediate frame rate for any data parameter mixing mode that does not exceed the data bus speed of the spectrometer. ROI processing The principle can be achieved by the camera's sensor, (related to charge-coupled device (CCD) systems) (Regarding) partial scanning, or (in relation to complementary metal-oxide-semiconductor (CMOS) systems) (This can be done by windowing.) Time-dependent or frequently performed measurements Regarding this, by performing ROI processing using partial scanning or windowing, This allows us to avoid exceeding the data bus speed of the lutisometric sensor, and thus The time dimension of time-dependent measurements is maintained, thereby improving the accuracy of the measurements. Furthermore, Some embodiments described herein are on a multispectral sensor chip (for example, This can be done (before passing the data to the control device), which reduces latency. Furthermore, the accuracy of the measurement is improved.
[0009] Figures 1A to 1D are schematic diagrams of exemplary embodiment 100 as described herein. As shown in Figure 1A, the exemplary embodiment 100 uses a CMOS device or a CCD. Multispectral sensor devices such as multispectral sensor devices (for example, the multispectral sensor shown in Figure 2) This can be done by a cuctor sensor device (220). In some embodiments, as in embodiment 100 The specific operation is performed by another device in the environment 200 of Figure 2, such as the control device 210. obtain.
[0010] As shown in Figure 1, the multispectral sensor device may include a sensor array 105. As such, the sensor array 105 may include channels 110-1 to 110-64. For example, a sensor array is configured to acquire information about multiple corresponding frequency bands. It may include multiple sensor elements. Additionally or alternatively, the sensor array may be a single Includes multiple sensor elements configured to acquire information associated with a frequency band. The sensor element can correspond to channel 110.
[0011] As shown in Figure 1B and indicated by reference numeral 120, multispect The sensor device can perform measurements based on region 115. For details on how the measurements are performed, see Figure 1. This will be explained in more detail later in relation to C~1D. As indicated by reference numeral 125, The tispectral sensor device uses channels 10, 11, 18, and 19 of the sensor array 105. Measurement 1 can be performed by using it. Furthermore, as shown, a multispectral sensor The device, the multispectral sensor device, all channels of the multispectral sensor device Measurement 2 can be performed using this method. Here, four channels are used in Measurement 1, These can be collectively referred to as pixel regions or ROIs. As shown in the figure, in measurement 2, the sensor array 10 All 5 channels are used. In some embodiments, in measurement 2, the sensor array 105 It may be possible to use fewer channels than the total number of channels.
[0012] In relation to the exemplary embodiment 100, we assume that measurement 1 is a time-dependent measurement, and Assume that constant 2 is not a time-dependent measurement. Here, we consider time-dependent measurements and This is for measurements where a threshold frame rate or threshold data rate is associated, or for accuracy. This can mean measurements that require precise timing, and / or other similar measurements. Non-time-sensitive measurements are those that are not related to threshold frame rates or data rates. Measurements that are not attached, measurements that do not require precise timing, and / or other similar measurements This can mean a measurement. In some embodiments, time-dependent measurements, when totaled, can be multispectral. Certain frame rates and / or it can be associated with the resolution. If the bus data rate is exceeded, Data is queued, which can cause a loss of the data's time dimension. Therefore, the accuracy of some time-dependent measurements may be reduced.
[0013] As shown in Figure 1C and indicated by reference numeral 130, multispect The sensor device can determine that measurement 1 is a time-dependent measurement. Furthermore, as shown below, The multispectral sensor device has a channel associated with measurement 1 (diagonal hatch). Collect data only for channels 10, 11, 18, and 19 (indicated by the 'ng'). This is possible. In some embodiments, the multispectral sensor device is used as described later in ROI Data can be collected using a winding. In some embodiments, multispectral sensors are used. The sensor device performs partial scanning of the sensor array 105, as will be described in detail later. By using it, data can be collected.
[0014] In some embodiments, such as when the multispectral sensor device includes a CCD system, The spectral sensor device uses partial scanning of the sensor array 105. Data can be collected. For example, to perform a partial scan, the following can be done: several Perform a (for example, continuous) vertical shift on the read register, if unwanted or This is unnecessary (for example, associated with channels other than channels 10, 11, 18, and 19). Discarding unwanted or unnecessary charges. Outputting each pixel in a row. Therefore, it is not necessary to perform a vertical transfer faster than reading the entire row. This allows for an increase in the frame rate. This is because for each frame, This is because fewer lines are output by the sensor. ROI scanning for measurement 1 is achieved. If so, the sensor array 105 can be operated normally, and pixels can be output from the appropriate row. (This will be explained in detail in Figure 1D below.)
[0015] For example, in some embodiments, such as when a multispectral sensor device includes a CMOS system device Multispectral sensor devices can collect data using ROI windowing. For example, with regard to some CMOS sensor architectures, vertical and horizontal windowing It can achieve both of the above. This allows for, in some embodiments, a corresponding increase in frame rate. Larger is possible because the following happens: the pixel signals are parallel. It is transmitted through the column amplifier bank, then proceeds to the column A / D converter, and finally Later, the digitized data is sent to the high-speed multiplexer and then out of the chip. To achieve high frame rates through the integration of parallel A / D converters in CMOS chips. This could enable higher pixel clock speeds.
[0016] In some embodiments, windowing with respect to the CMOS sensor is performed in a single window. It can be expanded to multiple windows, and the correct row and column of interest can be selected. This can be achieved by proper addressing. Multiple windows or ROIs Therefore, the multispectral sensor device is useful without exceeding the bus data rate. This can improve the utilization rate of the sensor output bandwidth for information. In this way, multispect The time sensor device can improve the measurement frequency and accuracy with respect to time-dependent measurements.
[0017] As shown in Figure 1D and indicated by reference numeral 135, some embodiments Therefore, the multispectral sensor device can determine that measurement 2 is not time-dependent. Then, the multispectral sensor device uses the full sensor array 105 to collect data It can collect data, and based on the collected data, measurement 2 can be determined. For example, multi-s The vector sensor device can collect data for each channel of the sensor array 105. In some embodiments, the multispectral sensor device has channels 10, 11, 18, And / or data can be collected for the remaining channels other than channel 19, It was likely used to collect unnecessary data from Ru 10, 11, 18, and / or 19. Resources can be saved. In some embodiments, the multispectral sensor device is a sensor array It is possible to collect data at full resolution for all channels of I-105, and time-independent This allows for more accurate decisions regarding dependent measurements.
[0018] Examples of actions explained in relation to Figures 1A-1D include heart rate, blood pressure, SpO2, and blood glucose. Biometric monitoring for the purpose of measuring values, hydration, and / or other health status parameters. Please consider the case of a 64-channel multispectral sensor as a device, The sensor is a monolithic multi-pixel sensor (such as a typical silicon CMOS image sensor) on top of a pixelated sensor. Obtained by integrating a tispectral filter. Heart rate, blood pressure, and SpO2, etc. Regarding the cardiopulmonary function parameters, time-dependent spectral signals at a small number of wavelengths are used. Time-dependent measurements (e.g., those performed at over 250 sps) may be required. By utilizing the tetraspectral ROI windowing technique, it is possible to address a small number of wavelengths. The data in a specific channel is sampled at a speed that satisfies the temporal requirements for sampling. It can be determined and the necessary measurements can be calculated. Once the time-dependent measurements are completed, multis The vector sensor performs full sensor readout (for example, for all 64 channels). This allows capturing the remaining channels of data within a full readout. This information is used to assess other spectral health conditions such as blood glucose levels and hydration. The lamellae can be determined, and these are time-independent but high-resolution spectral content. This may be necessary.
[0019] In this way, the multispectral ROI windowing technique achieves high resolution and high bit depth. This method achieves depth of field and high frame rate, and any other method would be costly in terms of equipment costs. A complex architecture would have been required, which would have placed a considerable burden on the system in terms of size. For example, wafer stacking is done to integrate specialized readout circuits into each pixel. Other methods, such as creating dedicated circuits for King or ultra-high-speed data acquisition, are low-cost. Furthermore, it may not be suitable for achieving high levels of manufacturability. Also, it may not be useful for further processing. Without an ROI method for discarding the extra data, it is not feasible to calculate useful signals and return them to the user. This requires processing a large amount of data beforehand, which impairs the time dependence of the measurement. It will become.
[0020] Exemplary embodiment 100 is described in relation to a two-dimensional sensor array. However, The embodiments described in the specification may also be applied to three-dimensional sensor arrays. For example, ROI for such sensor arrays is one-dimensional (e.g., single channel or several channels). (lines about the channel), 2D (for example, lines about several channels) (ear), or three-dimensional (for example, two or more layers for one or more channels) It is possible.
[0021] As mentioned above, Figures 1A to 1D are merely examples. Other examples are also possible. This may differ from what was explained in relation to Figures 1A-1D.
[0022] Figure 2 is a diagram of an exemplary environment 200, and the system and / Alternatively, the method can be implemented in the environment. As shown in Figure 2, the environment 200 is controlled by the control device 210, This may include a lutispectral sensor device 220 and a network 230. Various aspects of the environment 200 The devices may be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections. ru.
[0023] The control device 210 stores, processes, and / or stores information related to multispectral sensing. It includes one or more devices that can route. For example, the control unit 210 is a server, Computers, wearable devices, cloud computing devices, and / or other similar devices This may include certain multispectral sensors. In some embodiments, the control device 210 may have a specific multispectral sensor. It can be associated with the sensor device 220. In some embodiments, the control device 21 0 can be associated with multiple multispectral sensor devices 220. In this embodiment, the control device 210 controls the environment 10 such as the multispectral sensor device 220. Receiving information from and / or transmitting information to other devices located within 0. It is possible.
[0024] The multispectral sensor device 220 is directed towards the multispectral sensor device 220. Includes a device capable of performing measurements on light. For example, a multispectral sensor device. 220 may include image sensors, multispectral sensors, and / or other similar devices. These sensors detect light directed towards the multispectral sensor device 220. Measurements can be taken. The multispectral sensor device 220 uses, for example, CMOS technology or CCD technology. It may utilize one or more sensor technologies, such as techniques and / or other similar technologies. The sensor device 220 may include multiple sensor elements (for example, the sensor elements may include Regarding the array, hereinafter referred to as the sensor array, each is configured to acquire information. The sensor element is connected to some channel, such as channel 115 in Figure 1A. I can accommodate that.
[0025] Network 230 includes one or more wired and / or wireless networks. For example, Network 230 may include: cellular networks (e.g., LTE networks) Network, CDMA network, 3G network, 4G network, 5G network (e.g., other types of next-generation networks), public terrestrial mobile networks (PLMN) public land mobile network (LAN), LAN, WAN, urban-scale network (MAN, me tropolitan area network), telephone network (Public Switched Telephone Network (PTSN) ephone Network)), private network, ad hoc network, intranet, i Internet, fiber optic network, cloud computing network, Other similar things, and / or combinations thereof or other types of networks.
[0026] The number and arrangement of devices and networks shown in Figure 2 are presented as examples. In actual operation... So, in relation to Figure 2, are there additional devices and / or networks, or fewer devices? and / or there may be a network, or different devices and / or networks, or There may be devices and / or networks arranged in different ways. Furthermore, Figure 2 Two or more devices shown can be implemented within a single device, and the single device shown in Figure 2 is It may be implemented in a distributed manner across multiple devices. Additionally or alternatively, devices in environment 200 A set (for example, one or more devices) is made by another set of devices in environment 200. It may provide one or more of the functions described.
[0027] Figure 3 is a diagram of exemplary components of the apparatus 300. The apparatus 300 controls Applicable to device 210 and / or multispectral sensor device 220. Some embodiments Then, the control device 210 and / or the multispectral sensor device 220 are one or more devices 300 and / or one or more components of the apparatus 300 may be included, as shown in Figure 3. The device 300 includes a bus 310, a processor 320, memory 330, and a storage component 3 40, input component 350, output component 360, and communication interface It may include 370.
[0028] Bus 310 enables communication between components of device 300. Includes. Processor 320 is hardware, firmware, or hardware and software It is implemented using a combination of software. The processor 320 can take the following forms: central Processing unit (CPU), graphics processing unit (GPU), accelerator processing unit (APU), My Cross processor, microcontroller, FPGA, ASIC, or other type of processing unit Components. In some embodiments, the processor 320 programmes to perform a certain function. Includes one or more processors that can be RAMed. 330 memory is random access RAM, read-only memory (ROM), and / or processor 320 For that purpose, another type of dynamic or static memory device to store information and / or instructions (e.g.) This includes flash memory, magnetic memory, and / or optical memory.
[0029] The memory component 340 stores information and / or data related to the operation and use of the device 300. It stores software. For example, storage component 340 may include: Disks (e.g., magnetic disks, optical disks, magneto-optical disks, and / or SSDs) ), CDs, DVDs, floppy disks (registered trademark), cartridges, magnetic tapes, and / or another type of non-temporary computer-readable medium, plus a corresponding drive.
[0030] The input component 350 allows the device 300 to receive information, for example, via user input. Includes components that can enable this (e.g., touchscreen display, keyboard (Keyboard, keypad, mouse, buttons, switches, and / or microphone). Additional Alternatively, the input component 350 may be a sensor for sensing information. This may include (for example, GPS components, accelerometers, gyroscopes, and / or (Cutter). Output component 360 provides output information from device 300. Includes components (e.g., display, speaker, and / or one or more LEDs) .
[0031] The communication interface 370 is a transceiver that allows the device 300 to communicate with other devices. Transceiver components (e.g., transceivers and / or separate receivers and transmitters) This includes, for example, via wired connection, wireless connection, or a combination of wired and wireless connection. Communication can take place. The communication interface 370 allows device 300 to receive information from another device. This can enable the provision of information to another device. For example, The communication interface 370 may include: Ethernet® interface Face, optical interface, coaxial interface, infrared interface, radio frequency ( RF interface, Universal Serial Bus (USB) interface, Wi-Fi i(registered trademark) interface, cellular network interface, etc.
[0032] Apparatus 300 may perform one or more of the processes described herein. Apparatus 300 may perform, Stored in non-temporary computer-readable media such as 330 and / or storage component 340. These processes can be carried out by the processor 320, which executes the specified software instructions. A computer-readable medium is defined herein as a non-temporary memory device. Memory devices include: memory areas within a single physical storage device or multiple physical storage devices. Memory areas distributed across multiple storage devices.
[0033] Software instructions are transmitted from another computer-readable medium or via the communication interface 370. Read from another device into memory 330 and / or storage component 340 via This is possible. During execution, within memory 330 and / or storage component 340 The software instructions stored in cause the processor 320 to perform the processing described herein. This is possible. Additionally or alternatively, software instructions can be used instead of software instructions. Furthermore, the processing described herein can be performed using hardwired circuits. The embodiments described herein relate to hardware circuits and software. It is not limited to any specific combination of these.
[0034] The number and arrangement of components shown in Figure 3 are presented as an example. In actual operation, the equipment... 300, in comparison to that shown in Figure 3, has additional components and fewer components. This may include components, different components, or components arranged in different configurations. Additionally or alternatively, a set of components of the device 300 (for example, one or more components) A component is one or more machines performed by another set of components of the apparatus 300. He can carry on the legacy of Noh theater.
[0035] Figure 4 shows an illustrative treatment for ROI windowing in multispectral measurements. This is a flowchart for 400. In some embodiments, one or more processing blocks in Figure 4 This may be done by a multispectral sensor device 220. In some embodiments, Figure 4 One or more processing blocks of the device are separate from another device or multispectral sensor device 220. This is done by another group of devices or by a group of devices including a multispectral sensor device 220. obtain (for example, control device 210).
[0036] As shown in Figure 4, process 400 is a step in which it is decided that time-dependent measurement should be performed. Time-dependent measurements are collected by one or more channels out of multiple channels. This may include steps that should be performed using the data provided (S410). For example, The multispectral sensor device 220 includes (for example, a processor 320 and / or other similar components). It can be decided that time-dependent measurements should be performed using (a method that does not involve time-dependent measurement). This uses data collected by one or more channels of the sensor array (for example, This may be done within the ROI associated with time-dependent measurements. In some embodiments, The measurement decision is made by the multispectral sensor device 220 (for example, by feedback). (Based on) it can be done automatically. In some embodiments, the measurement is subject to some setting. It is possible to do so (for example, a specific measurement may require 250 sps).
[0037] As further shown in Figure 4, the process 400 processes one of the multiple channels. A step of collecting data by an appropriate subset of the channels, with respect to A suitable subset of may include steps containing one or more channels (S420). Example For example, the multispectral sensor device 220 can (for example, using the processor 320) An appropriate subset of channels from a number of channels (for example, all channels) Data can be collected using fewer channels. A suitable subset may include one or more channels in the ROI. In some embodiments, The multispectral sensor device 220 uses ROI windowing techniques or partial scanning. Data collection can be performed using the method described in detail elsewhere in this specification. Yes, they are.
[0038] As further shown in Figure 4, process 400 determines time-dependent measurements based on the data. The step may include (S430). For example, the multispectral sensor device 220 is (e.g. For example, using processor 320, time-dependent measurements can be determined based on the data. In relation to time-dependent measurements, the data bus transfer of the multispectral sensor device 220 The rate is not exceeded. In some embodiments, the multispectral sensor device 220 is a different Data can be provided to a device (for example, a control device 210), where the data can be determined.
[0039] Process 400 may be performed, for example, in any single embodiment or elsewhere in this specification as described below and / or elsewhere. This may include additional embodiments such as combinations of the embodiments described.
[0040] In some embodiments, a suitable subset of channels is one or more channels It includes only that. In some embodiments, a suitable subset of channels is the sensor. It contains one or more rows, and each of the one or more rows contains one or more channels. Some actual In this configuration, the multispectral sensor device 220 collects data through one or more channels. Data other than the selected data can be discarded. In some embodiments, a multispectral sensor The device 220 determines the appropriate part of the channel based on the time dependence of the time-dependent measurement. Data collection can be performed on a sub-set. In some embodiments, time-dependent measurements are performed on the first This is a measurement, and the data is the first data. The multispectral sensor device 220 is the It can be determined that two measurements should be performed, and the second measurement is less stringent than the first measurement. It can be associated with time dependence, and all channels of multiple channels are related to the time dependence. It is possible to collect two sets of data, and use at least a portion of the second set of data to perform a second measurement. This can be done. In some embodiments, the multispectral sensor device 220 is the first The first measurement and the second measurement can be repeated multiple times, and the first measurement is the second measurement It can be performed more frequently than the first measurement. In some embodiments, the first measurement is performed more frequently than the second measurement. This is determined with minimal latency. In some embodiments, the first measurement is determined by the second measurement. It is done more frequently than that.
[0041] In some embodiments, the sensor array is a charge-coupled device (CCD) or a complementary metal oxide film. Includes at least one semiconductor (CMOS) device. In some embodiments, time-dependent measurement This is done for values related to living organisms or medical values.
[0042] In some embodiments, the multispectral sensor device 220 includes a CMOS device. The tispectral sensor device 220 performs vertical and horizontal windowing to obtain one data point. It is possible to collect data using only the channels mentioned above. In some embodiments, data can be collected using only the channels mentioned above. The multispectral sensor device 220 includes a CCD. 0 means that one or more consecutive vertical shifts can be made to the read register and collected. Data other than the required data can be discarded. In some embodiments, one or more rows These specific data are not associated with one or more channels, and when determining the measurement... And certain data will be dropped.
[0043] Figure 4 shows an illustrative block for process 400, however, in some embodiments, process 4 00 represents additional blocks, fewer blocks, and different blocks compared to those shown in Figure 4. It may include blocks arranged differently. Additionally or alternatively, process 400 Two or more blocks can be performed in parallel.
[0044] Figure 5 shows another illustrative example of ROI windowing for multispectral measurements. This is a flowchart of process 500. In some embodiments, one or more blocks in Figure 5 This can be done by a multispectral sensor device 220. In some embodiments, Figure 5 1 One or more blocks are separate from another device or multispectral sensor device 220 or This can be done by a group of devices including a multispectral sensor device 220 (for example, a control device) 210).
[0045] As shown in Figure 5, process 500 determines that the first measurement and the second measurement should be performed. It is a step, and the first measurement is associated with a stronger time dependence than the second measurement. The step may include (S510). For example, the multispectral sensor device 220 , (for example, using processor 320) it is decided that the first measurement and the second measurement should be performed. It is possible. The first measurement is associated with a stronger time dependence than the second measurement. Yes, it is possible. In some embodiments, the first measurement has a higher data rate than the second measurement. It can be associated with frame rate and / or resolution.
[0046] As shown in Figure 5, the process 500 performs the appropriate operation for one of the multiple channels. This is a step in which the first data is collected by a specific subset, and regarding the channels A suitable subset of may include steps containing one or more first channels (S520) ). For example, the multispectral sensor device 220 uses (for example, a processor 320) (The first data is obtained by an appropriate subset of channels among multiple channels) It is possible to collect data. A suitable subset of channels is one or more first This may include ROI corresponding to the channel.
[0047] As further shown in Figure 5, the process 500 is a step of collecting second data. The multispectral sensor device 220 activates all channels of multiple channels. This may include a step (S530) configured to collect second data. For example, the multispectral sensor device 220 uses (for example, a processor 320) ) Second data can be collected. The multispectral sensor device 220 has multiple All channels of this channel can be activated to collect second data. .
[0048] As further shown in Figure 5, process 500 determines the first measurement based on the first data. This may include the step (S540). For example, the multispectral sensor device 220 is ( For example, determining a first measurement based on first data (using processor 320) This is possible. In some embodiments, the multispectral sensor device 220 determines the first measurement. For this purpose, the first data can be provided to another device (for example, the control device 210).
[0049] As further shown in Figure 5, process 500 determines a second measurement based on the second data. This may include the step (S550). For example, the multispectral sensor device 220 is ( For example, determining a second measurement based on second data (using processor 320). This is possible. In some embodiments, the multispectral sensor device 220 determines the second measurement. For this purpose, second data can be provided to another device (for example, the control device 210).
[0050] Process 500 may be performed, for example, in any single embodiment or elsewhere in this specification as described below and / or elsewhere. This may include additional embodiments such as combinations of the embodiments described.
[0051] In some embodiments, the multispectral sensor device 220 performs a first measurement and a second measurement The condition can be repeated multiple times, and the first measurement is performed more frequently than the second measurement. This is possible. In some embodiments, the first measurement has less latency than the second measurement. This is determined in conjunction with the following. In some embodiments, the multispectral sensor device is a CCD or C Includes MOS devices.
[0052] Figure 5 shows an illustrative block for process 500, however, in some embodiments, the process 500 is shown in comparison to the one illustrated in Figure 5, with additional blocks, fewer blocks, and different blocks. This may include locks or blocks arranged differently. Additionally or alternatively, process 5 Two or more blocks of 00 can be performed in parallel.
[0053] In this way, the multispectral ROI windowing technique achieves high resolution and high bit depth. This method achieves depth of field and high frame rate, and any other method would be costly in terms of equipment costs. A complex architecture would have been required, which would have placed a considerable burden on the system in terms of size. For example, wafer stacking is done to integrate specialized readout circuits into each pixel. Other methods, such as creating dedicated circuits for King or ultra-high-speed data acquisition, are low-cost. Furthermore, it may not be suitable for achieving high levels of manufacturability. Also, it may not be useful for further processing. Without an ROI method for discarding the extra data, it is not feasible to calculate useful signals and return them to the user. This requires processing a large amount of data beforehand, which impairs the time dependence of the measurement. It will become.
[0054] The above disclosures are for illustrative purposes and explanation, but are not exhaustive. The embodiments are not intended to be strictly limited to the disclosed forms. Modifications and Variations This can be done in light of the above disclosure, or obtained from the implementation of the embodiments. Cut.
[0055] In this specification, the term "component" refers to hardware, firmware, and It is broadly understood to refer to a combination of hardware and software. It is intended.
[0056] Some embodiments described herein relate to thresholds. To satisfy a threshold means a value greater than the threshold, a value exceeding the threshold, or a value higher than the threshold. Values above the threshold, values below the threshold, values less than the threshold, values lower than the threshold, values below the threshold, This refers to a value equal to a threshold, etc.
[0057] The systems and / or methods described herein are hardware, firmware, etc. A. Or, it can be implemented in various forms as a combination of hardware and software. It is clear that these systems and / or methods are used to implement Actual specialized control hardware or software code does not limit the embodiments. No. Therefore, without mentioning specific software code, the system and / Alternatively, the operation and behavior of the method have been described, and based on the description herein, the software And it is understood that the hardware can be designed and the system and / or method can be implemented. Please note that this is the case.
[0058] Special combinations of features are described in the claims and / or disclosed in the specification, but these The combination is not intended to limit the disclosure of possible embodiments. In fact, this Many of these features are methods not specifically described in the claims and / or disclosed in the specification. They can be combined in ways that are not described. Each of the dependent claims described below is one While the claims may be directly dependent on each other, the disclosure of possible embodiments may be directly dependent on each of the claims. This includes the combination of the requested term and all other claims within the scope of the claims.
[0059] Unless otherwise expressly stated, any elements, actions, or instructions used herein are not important or essential. It should not be interpreted as such. Furthermore, the articles "a" and "an" used in this specification are 1 It shall contain one or more items and can be used interchangeably with "one or more items". Furthermore, as used herein, the term “set” refers to one or more items (e.g., related items). This includes items, unrelated items, combinations of related and unrelated items, etc. It can be used interchangeably with "one or more". Only one item is intended. In such cases, the term "one" or similar word is used. Also, as used herein, Terms such as "has, have, having" are considered open terms. Furthermore, the phrase "based on" implies, unless otherwise specified, "at least partially..." This should be interpreted as meaning "based on". [Explanation of Symbols]
[0060] 100 Exemplary Embodiments 200 Exemplary Environments 210 Control device 220 Multispectral Sensor Device 230 Networks 300 equipment 310 Bus 320 processors 330 memory 340 memory components 350 Input Components 360 Output Components 370 communication interface
Claims
1. A biological monitoring device for measuring health status parameters, It comprises a sensor array and one or more processors, The aforementioned sensor array comprises a plurality of sensor elements, The one or more processors mentioned above are: We decided to perform a cardiopulmonary function parameter measurement that requires a time-dependent measurement of a time-dependent spectral signal at a single wavelength. From an appropriate subset of the sensor elements in the plurality of sensor elements of the sensor array, first data corresponding to one wavelength of the cardiopulmonary function parameter measurement is collected. We decided to perform other spectral health parameter measurements. A second set of data is collected from another subset of sensor elements, which is the remaining sensor elements of a suitable subset of the aforementioned sensor elements. Based on the first data, the results of the cardiopulmonary function parameter measurement are obtained. A biological monitoring device that obtains the results of measuring other spectral health status parameters based on the second data.
2. A biological monitoring device according to claim 1, wherein a suitable subset of the sensor elements includes only one or more sensor elements, or only one or more rows of sensor elements including the one or more sensor elements.
3. A biological monitoring device according to claim 2, wherein the one or more processors discard data other than the first data collected from an appropriate subset of the sensor elements.
4. In the biological monitoring device according to claim 1, the one or more processors perform multiple repetitions of the measurement of the cardiopulmonary function parameter and the measurement of the other spectral health status parameter, A biological monitoring device in which the measurement of the cardiopulmonary function parameters is performed more frequently than the measurement of other spectral health status parameters.
5. A biological monitoring device according to claim 1, wherein the sensor array includes at least one charge-coupled element or complementary metal-oxide-semiconductor device.
6. A biological monitoring device that measures health status parameters determines whether to perform a cardiopulmonary function parameter measurement that requires a time-dependent measurement of a time-dependent spectral signal at one wavelength, The biological monitoring device collects first data corresponding to one wavelength of the cardiopulmonary function parameter measurement from an appropriate subset of sensor elements in a plurality of sensor elements of a sensor array, The steps include determining whether to perform other spectral health status parameter measurements using the aforementioned biological monitoring device, The biological monitoring device collects second data from other subsets of sensor elements, which are the remaining sensor elements of an appropriate subset of the sensor elements. The steps include obtaining the results of the cardiopulmonary function parameter measurement based on the first data using the biological monitoring device, The steps include: obtaining the results of the measurement of other spectral health parameters based on the second data using the biological monitoring device; Methods that include...
7. In the method according to claim 6, if the biological monitoring device includes a complementary metal oxide semiconductor device, the step of collecting the first data includes performing vertical and horizontal windowing so that the first data is collected only by a suitable subset of the sensor elements, If the biological monitoring device includes a charge-coupled element, the step of collecting the first data includes performing one or more consecutive vertical shifts on a read register and discarding data other than the first data to be collected.
8. A method according to claim 6, wherein the measurement of the cardiopulmonary function parameter is determined with less latency than the measurement of the other spectral health status parameter.
9. The method according to claim 6, wherein the measurement of the cardiopulmonary function parameter and the measurement of the other spectral health status parameter are repeated multiple times, A method wherein the measurement of the cardiopulmonary function parameters is performed more frequently than the measurement of other spectral health status parameters.
10. A non-temporary computer-readable medium on which instructions are stored, wherein the instructions include one or more instructions that, when executed by one or more processors of a biological monitoring device, cause the one or more processors to perform the method according to any one of claims 6 to 9.
Citation Information
Patent Citations
Imaging system
JP2009044680A
Digital camera
JP2012044519A
Imaging apparatus
JP2013236298A
Imaging device, imaging system, method for controlling imaging device, program, and storage medium
JP2015079162A
Interview system, server system, server device, information terminal, interview method, information processing method and program
JP2016126587A