Apparatus and method for estimating biological information

Abstract

Disclosed are an apparatus and a method for estimating biological information. The apparatus for estimating biological information includes a display including a plurality of unit pixels, each of the plurality of unit pixels including a light source configured to emit light having different wavelengths and a detector configured to detect the light having different wavelengths. The apparatus further includes a processor configured to determine a source pixel among the plurality of unit pixels configured to emit light onto an object, determine a detector pixel among the plurality of unit pixels configured to detect light scattered or reflected from the object, control the determined source pixel and the determined detector pixel to obtain a spectrum based on the light having a plurality of wavelengths detected by the detector pixel, and estimate biological information based on the obtained spectrum.

Description

[0001] This application is based on and claims priority to Korean Patent Application No. 10-2021-0010078, filed on January 25, 2021, with the Korean Intellectual Property Office, the entire disclosure of which is incorporated herein by reference. Technical Field

[0002] The disclosure relates to devices and methods for estimating biological information, and more specifically, to techniques for non-invasively estimating antioxidant levels. Background Technology

[0003] Reactive oxygen species (ROS) act as biological defense mechanisms (such as white blood cells) protecting the body from infection. However, excessive production of ROS in the body is known to lead to various tissue diseases. Common factors that generate ROS include stress, alcohol, peroxides, and drugs. ROS generated by these factors can cause cranial nerve diseases, circulatory system diseases, cancer, digestive tract diseases, liver disease, arteriosclerosis, kidney disease, diabetes, and aging.

[0004] Our bodies have a series of antioxidant defense systems to prevent oxygen toxicity. For these systems to function properly, sufficient antioxidants (such as vitamin E, vitamin C, carotenoids, flavonoids, etc.) are consumed, and as many antioxidant-rich foods as possible are eaten for effective antioxidant activity. Therefore, a device for easily determining the amount of antioxidants in the body may be needed. Summary of the Invention

[0005] According to one aspect of the disclosure, an apparatus for estimating biological information is provided, the apparatus including a display comprising a plurality of unit pixels, each of the plurality of unit pixels including a light source and a detector, the light source being configured to emit light having different wavelengths, and the detector being configured to detect light having different wavelengths. The apparatus further includes a processor configured to: determine a source pixel among the plurality of unit pixels configured to emit light onto an object; determine a detector pixel among the plurality of unit pixels configured to detect light scattered or reflected from the object; control the determined source pixel and the determined detector pixel to obtain a spectrum based on light having multiple wavelengths detected by the detector pixel; and estimate biological information based on the obtained spectrum.

[0006] The light source can include red, green and blue light sources.

[0007] The detector may include any one or both of a photodiode and a complementary metal-oxide-semiconductor (CMOS) image sensor.

[0008] The light source and detector can be placed on the same surface of the pixel circuit board.

[0009] The light source and detector can be patterned on the same surface of the pixel circuit board.

[0010] A partition wall used to block light can be placed between the light source and the detector.

[0011] The light source can be disposed on the first surface of the pixel circuit board, and the detector can be disposed on the second surface of the pixel circuit board, the second surface being opposite to the first surface.

[0012] The processor can also be configured to determine source pixels and detector pixels at different locations among the plurality of unit pixels.

[0013] The processor can also be configured to determine the source pixel and detector pixel based on any one or any combination of the object's contact location, the type of bio-information, the optical path, and the allowable range of signal-to-noise ratio (SNR) values.

[0014] The processor can also be configured to perform color modulation of the light source for a given source pixel based on the type of bio-information.

[0015] The processor can also be configured to perform color modulation of the light source for a given source pixel, to include a wavelength range of 470 nm to 510 nm.

[0016] The processor can also be configured to: extract the light intensity for each wavelength in different wavelengths based on the full width at half maximum (FWHM) characteristics of the light source emitting light at each wavelength; and obtain the spectrum based on the light intensity extracted for each wavelength in different wavelengths.

[0017] Bioinformation may include any one or any combination of skin carotenoids, blood carotenoids, glucose, urea, lactate, triglycerides, total protein, cholesterol, and ethanol.

[0018] According to one aspect of the disclosure, a method for estimating biometric information is provided, the method comprising: determining, based on contact between an object and a display comprising a plurality of unit pixels, a source pixel and a detector pixel among the plurality of unit pixels, each of the plurality of unit pixels comprising a light source emitting light of a different wavelength and a detector detecting light of a different wavelength; and controlling the determined source pixel to emit light onto the object. The method further comprises: controlling the determined detector pixel to detect light scattered or reflected from the object, obtaining a spectrum based on the light of the multiple wavelengths detected by the detector pixel, and estimating biometric information based on the obtained spectrum.

[0019] The light source can include red, green and blue light sources.

[0020] The light source and detector can be placed on the same surface of the pixel circuit board.

[0021] The light source and detector can be patterned on the same surface of the pixel circuit board.

[0022] A partition wall used to block light can be placed between the light source and the detector.

[0023] The light source can be disposed on the first surface of the pixel circuit board, wherein the detector is disposed on the second surface of the pixel circuit board, the second surface being opposite to the first surface.

[0024] The steps of determining source pixels and detector pixels may include: determining source pixels and detector pixels at different locations among the plurality of unit pixels.

[0025] The steps for determining source and detector pixels may include determining source and detector pixels based on any one or any combination of the object’s contact location, the type of biological information, the optical path, and the allowable range of signal-to-noise ratio (SNR) values.

[0026] The steps of controlling a determined source pixel may include: performing color modulation of the light source for the determined source pixel based on the type of biological information.

[0027] The steps of controlling the determined source pixel may include: performing color modulation of the light source of the determined source pixel to include a wavelength range of 470 nm to 510 nm.

[0028] The steps for obtaining a spectrum may include: extracting the light intensity for each wavelength at different wavelengths based on the full width at half maximum (FWHM) characteristics of the light source emitting light at each wavelength; and obtaining a spectrum based on the light intensity extracted for each wavelength at different wavelengths.

[0029] According to one aspect of the disclosure, an apparatus for estimating biological information is provided. The apparatus includes a display comprising a plurality of unit pixels, each of the plurality of unit pixels including a light source and at least one detector. The light source is configured to emit light of different wavelengths, and the at least one detector is configured to detect light of different wavelengths. The apparatus further includes a processor configured to: detect a contact position of an object on the display; determine a partial region of the display based on the detected contact position; determine a source pixel among the plurality of unit pixels configured to emit light onto the object based on the determined partial region; determine a detector pixel among the plurality of unit pixels configured to detect light scattered or reflected from the object based on the determined partial region; control the determined source pixel and the determined detector pixel to obtain a spectrum based on light of multiple wavelengths detected by the detector pixel; and estimate biological information based on the obtained spectrum. Attached Figure Description

[0030] The above and other aspects, features, and advantages of the disclosed embodiments will become clear from the following description taken in conjunction with the accompanying drawings.

[0031] Figure 1 This is a block diagram of a device for estimating biological information according to an embodiment.

[0032] Figure 2A , Figure 2B and Figure 2C This is a diagram illustrating an example of a display according to an embodiment.

[0033] Figure 3A and Figure 3B This is a diagram illustrating an example of driving a unit pixel and generating a spectrum according to an embodiment.

[0034] Figure 4 This is a diagram illustrating another example of a display according to an embodiment.

[0035] Figure 5 This is a block diagram of a device for estimating biological information according to another embodiment.

[0036] Figure 6 This is a flowchart of a method for estimating biological information according to an embodiment.

[0037] Figure 7 and Figure 8 This is a diagram illustrating an example of a wearable device having a device for estimating biological information according to an embodiment. Detailed Implementation

[0038] Details of the embodiments are included in the following detailed description and accompanying drawings. The advantages and features of the exemplary embodiments, as well as the methods for implementing the embodiments, will become clearer from the following detailed description of the embodiments with reference to the accompanying drawings. Throughout the drawings and detailed description, the same reference numerals will be understood to denote the same elements, features, and structures, unless otherwise described.

[0039] It will be understood that although the terms first, second, etc., may be used herein to describe various elements, these elements may not be limited by these terms. These terms are used only to distinguish one element from another. Unless expressly stated otherwise, any reference to the singular may include the plural. Furthermore, unless expressly stated to the contrary, expressions such as “comprising” or “including” will be understood to imply inclusion of the stated elements but not exclusion of any other elements. Additionally, terms such as “unit” or “module” may be understood as a unit that performs at least one function or operation and can be implemented as hardware, software, or a combination thereof.

[0040] In the following, embodiments of devices and methods for estimating biological information will be described in detail with reference to the accompanying drawings. The embodiments of the devices for estimating biological information described below can be installed in smartphones, tablet PCs, wearable devices, desktop computers, laptop computers, and medical devices in medical facilities, etc.

[0041] Figure 1 This is a block diagram of a device for estimating biological information according to an embodiment.

[0042] Reference Figure 1 The device 100 for estimating biological information includes a display 110 and a processor 120.

[0043] The display 110 may include a plurality of unit pixels capable of displaying images and / or measuring optical signals. In this case, the unit pixels may be organic light-emitting diode (OLED) based pixels that emit light themselves without having a separate backlight. For example, each unit pixel may include a light source emitting red, green, and blue light and may display an image having one or a combination of multiple colors, or may emit light onto an object to measure optical signals.

[0044] In addition, each unit pixel may include one or more detectors for detecting light. The detector can detect light and convert the detected light signal into an electrical signal and output the signal. The detector may be a photodiode, but is not limited to it, and may be a phototransistor (PTr) or an image sensor (e.g., a complementary metal-oxide-semiconductor (CMOS) image sensor).

[0045] Furthermore, the display 110 may include a window (e.g., a glass substrate) for allowing external light or light input from a light source per unit pixel to pass through. In this case, the window may be formed as a smooth, flat surface, a curved surface, etc., so that an object (e.g., a finger) can come into contact with it.

[0046] When an object comes into contact with the window of display 110, processor 120 can control the light source and detector of a unit pixel. For example, processor 120 can determine one or more source pixels and one or more detector pixels among a plurality of unit pixels, and can measure light signals from the object by controlling the light source of the determined source pixels and the detector of the detector pixels. By taking into account at least one of the following: the contact position of the object, the type of biological information to be estimated, the optical path defined for estimating the biological information, the allowable range of signal-to-noise ratio (SNR) values, processor 120 can determine source pixels and detector pixels at different locations.

[0047] By modulating various colors, the processor 120 can drive the light source of the source pixel to emit light of a predetermined wavelength. In this case, the color modulation pattern can be predefined by considering the type of biological information, the measurement location of the object, etc. In this case, the color modulation pattern can be defined to include a wavelength range according to the type of biological information. For example, in the case of detecting the antioxidant index, the color modulation pattern can be defined to include a wavelength range of at least 470 nm to 510 nm.

[0048] Processor 120 can drive the multi-wavelength light sources of the source pixels sequentially or simultaneously. For example, processor 120 can drive the light sources of the source pixels in order from short wavelength to long wavelength (or vice versa) or in a predefined driving order (such as random order). In this case, when multiple source pixels are selected, processor 120 can drive multiple source pixels simultaneously, sequentially, or in a predetermined mode. Information such as the driving order of the source pixels, the power intensity and duration of the light sources can be predefined.

[0049] Processor 120 can receive signals output from detectors of detector pixels and can estimate biological information based on the received signals. Processor 120 can generate a spectrum based on the intensity of light at each wavelength detected by the detectors of the detector pixels. For example, if multiple wavelengths of light are detected by multiple detector pixels, processor 120 can generate a spectrum for each detector pixel. In this case, processor 120 can extract the light intensity of each wavelength based on the full width at half maximum (FWHM) characteristics of the light source emitting light within each wavelength range detected by the detector pixels, and can generate a spectrum for all wavelengths based on the extracted light intensity of each wavelength. However, the example embodiment is not limited thereto.

[0050] Furthermore, the processor 120 can extract features from the generated spectrum and estimate biological information by using the extracted features and a predefined estimation model. In this case, biological information may include, for example, skin carotenoids and blood carotenoids associated with antioxidant levels. However, biological information is not limited to this and may include at least one of glucose, urea, lactate, triglycerides, total protein, cholesterol, and ethanol.

[0051] Furthermore, the processor 120 can perform user authentication using signals detected by the detector pixels. For example, the processor 120 can detect a user's fingerprint information by analyzing the detected signals, and can perform user authentication using the detected fingerprint information. Additionally, the processor 120 can continue to estimate the biometric information of the authenticated user.

[0052] Figure 2A , Figure 2B and Figure 2C This is a diagram illustrating an example of a display according to an embodiment.

[0053] Figure 2A This is a diagram illustrating an example of the arrangement of unit pixels on a display. (See reference...) Figure 2A The multiple unit pixels of the display 110 can be arranged in a rectangular array 200. However, the arrangement is not limited to this and can be circular, rectangular, pentagonal, etc., and can vary depending on the size and shape of the display. Figure 2A As shown, each unit pixel may include a red R light source, a green G light source, a blue B light source, and a detector PD. Although Figure 2A It shows 29 units of pixels, but the number is not limited to this.

[0054] Figure 2B and Figure 2C It is a diagram illustrating the arrangement of the light source and detector for each unit pixel of the display 110.

[0055] According to the embodiments, such as Figure 2B As shown, each unit pixel of the display 110 may have a multi-wavelength light source R, G, and B and a detector PD disposed on the same surface. For example, the multi-wavelength light source R, G, and B and the detector PD may be disposed on the top surface of the pixel circuit board 212. In this case, the multi-wavelength light source R, G, and B and the detector PD may be patterned on the same surface of the pixel circuit board 212. In this case, the multi-wavelength light sources R, G, and B may be arranged in the order of red R, green G, and blue B, starting from the detector PD, but the arrangement order is not particularly limited to this.

[0056] As shown here, when the object OBJ comes into contact with the window 211 of the display 110, a multi-wavelength light source R, G, and B can be driven using a multi-tone scheme under the control of the processor 120 to emit light of multiple wavelengths onto the object OBJ, and the light scattered or reflected from the object OBJ can be detected by the detector PD. In this case, in order to prevent the light emitted by the light source R, G, and B from directly incident on the detector PD, a partition wall 213 for blocking light can be provided between the light source R, G, and B and the detector PD.

[0057] In another example, such as Figure 2C As shown, multi-wavelength light sources R, G, and B, as well as detectors PD, can be arranged in multiple layers. Figure 2CAs shown, multi-wavelength light sources R, G, and B can be disposed on the upper end of pixel circuit board 212 or on the first surface of pixel circuit board 212. In this case, the multi-wavelength light sources R, G, and B can be patterned on the upper end of pixel circuit board 212. Furthermore, detectors PD can be disposed on the lower end of pixel circuit board 212 or on the second surface of pixel circuit board 212. Detectors PD can be disposed on the lower surface of pixel circuit board 212, while being in contact with or spaced apart from each other. In this case, pixel circuit board 212 can have a light-transmitting area, allowing light scattered or reflected from an object to pass through window 211 and be directed to detector PD.

[0058] Figure 3A and Figure 3B This is a diagram illustrating an example of driving a unit pixel and generating a spectrum according to an embodiment.

[0059] Reference Figure 3A Once an object comes into contact with the display to request estimation of biometric information, the processor 120 can identify one or more source pixels 2, 15, 21, and 26 in the unit pixel array 200, and one or more detector pixels 5, 10, 13, and 28 for measuring signals from the object. By combining the light from the identified source pixels 2, 15, 21, and 26 located at various distances with the signals from the identified detector pixels 5, 10, 13, and 28, the processor 120 can measure signals at various locations and / or depths of the object, thereby improving the accuracy of the estimated biometric information.

[0060] Furthermore, the processor 120 can set a partial region in the unit pixel array 200 for measuring light signals, and can measure the light signals in the set partial region. For example, when an object comes into contact with a window of the display 110, the processor 120 can detect the contact position of the object (e.g., the center point of a fingerprint), and can set a partial region for determining the source pixel and detector pixel based on the detected contact position of the object. In another example, the partial region for measuring light signals can be preset. In this case, the processor 120 can display identification marks or the like indicating the partial region on the display 110. In this case, the position, size, etc., of the preset region can be changed by the user.

[0061] Figure 3BThe diagram illustrates spectra generated based on signals d1, d2, d3, d4, and d5 across five wavelength ranges, which are detected by detector pixels after being emitted by a source pixel through color modulation of light corresponding to the five wavelength ranges. By combining the operations of the determined source pixel and the determined detector pixel, the processor 120 can obtain multiple spectra. When multiple spectra are obtained as described above, the processor 120 can exclude invalid spectra by verifying their validity, etc. In this case, validity can be verified by calculating the similarity between each of the obtained multiple spectra and a reference spectrum, and by determining the spectra with a calculated similarity exceeding a predetermined threshold as valid spectra. However, the method for verifying validity is not limited to this.

[0062] In this context, the processor 120 can calculate similarity using various similarity calculation algorithms, such as Euclidean distance, Manhattan distance, cosine distance, Mahalanobis distance, Jaccard coefficient, extended Jaccard coefficient, Pearson's correlation coefficient, Spearman's correlation coefficient, etc.

[0063] Processor 120 can extract features from the acquired spectrum for estimating biological information, and can estimate the biological information by using an estimation model that defines the correlation between the extracted features and the biological information. In this case, the estimation model can be defined by linear or nonlinear equations, but is not limited to them.

[0064] For example, processor 120 can extract features by combining the intensity of a signal detected in a reference wavelength range with the intensity of a signal detected in another wavelength range. In this case, the reference wavelength range can be set differently depending on the type of biological information, etc. For example, in the case of estimating carotenoids, processor 120 can... Figure 3B The wavelength range of approximately 470 nm to 510 nm is determined as the reference wavelength range, and a combination (e.g., difference or ratio) of the intensity of signal d3 detected within the reference wavelength range and the intensity of signals detected in adjacent wavelength ranges (e.g., d2 and / or d4) can be extracted as a feature for estimating carotenoids. However, these are just examples.

[0065] Figure 4 This is a diagram illustrating another example of a display according to an embodiment.

[0066] Reference Figure 4The display 110 may include an image sensor (CIS) and multiple light sources (LS).

[0067] Light sources may include light-emitting diodes (LEDs), laser diodes (LDs), phosphors, etc. Multiple light sources can be configured to emit light of different wavelengths (e.g., infrared wavelengths, red wavelengths, green wavelengths, blue wavelengths, white wavelengths, etc.). In this case, such as... Figure 4 As shown, each of the multiple light sources can emit light of different wavelengths λ1 to λ3, or multiple light sources can be included for each wavelength, and the multiple light sources can be arranged at relative positions. The image sensor can be a complementary metal-oxide-semiconductor (CMOS) image sensor. Figure 4 As shown, multiple light sources can be arranged around the image sensor. The light sources can be arranged in straight lines, circles, ellipses, polygons, etc., without any particular restrictions.

[0068] By using time-division of all the multiple light sources, the processor 120 can sequentially drive all the multiple light sources in predefined directions (such as clockwise, counterclockwise, zigzag, etc.). Optionally, the processor 120 can sequentially drive all the multiple light sources in order from short wavelength to long wavelength (or vice versa). Furthermore, the processor 120 can select some of the multiple light sources based on the measurement position or measurement depth of the object, and can drive the selected light sources sequentially in a predetermined direction or in a predetermined wavelength order. By combining multiple light sources, the processor 120 can measure optical signals at various depths of the object.

[0069] Processor 120 can calculate the absorbance of each pixel based on pixel data detected by an image sensor after driving multiple light sources (e.g., based on the intensity of light received by each pixel of the image sensor), and can estimate biological information based on the absorbance of each pixel. For example, processor 120 can estimate biological information by using an estimation model that defines the correlation between absorbance and biological information. In this case, processor 120 can obtain absorbance within an appropriate wavelength range according to the type of biological information, and can estimate biological information by using absorbance within that wavelength range.

[0070] Figure 5 This is a block diagram of a device for estimating biological information according to another embodiment.

[0071] Reference Figure 5 The device 500 for estimating biological information may include a display 110, a processor 120, a storage device 510, a communication interface 520, and a sound output interface 530. The display 110 and processor 120 have been described in detail above; therefore, the following description will focus on non-overlapping functions.

[0072] The display 110 can output an interface, for example, to support various functions of the device 500 for estimating biological information, and can display data (such as estimated biological information values ​​processed by the processor 120) through the interface. Furthermore, by visually displaying contact locations where the user may need to place an object, the display 110 can guide the user at those locations.

[0073] Furthermore, the display 110 may include touch circuitry for detecting touch and / or sensor circuitry (e.g., a pressure sensor) for measuring the intensity of the force caused by the touch. The display 110 can detect the user's touch input via the touch circuitry and can send the user's request to the processor 120. Additionally, when an object contacts a window of the display 110 and applies force to it, the contact pressure can be measured via a pressure sensor or the like of the display 110.

[0074] The processor 120 may be electrically connected to the display 110 and may appropriately control the unit pixels of the display 110 to output image data (e.g., guidance information for estimating biological information, results of biological information estimation, or other image data) and / or measure light signals.

[0075] For example, processor 120 can measure light signals or output image data using unit pixels of the entire area of ​​display 110. Alternatively, by dividing display 110 into a first area for measuring light signals and a second area for outputting image data, processor 120 can measure light signals using unit pixels of the first area and simultaneously output image data using light sources using all unit pixels of the second area.

[0076] Storage device 510 may store data related to the estimation of biological information. For example, the data may include user characteristic information (such as the user's age, gender, health status, etc.), color modulation patterns, light source driving conditions, and / or estimation models. In addition, the data may include other data processed or generated by display 110 and / or processor 120, applications or algorithms used to estimate biological information and / or perform other functions, or input data and / or output data regarding relevant instructions.

[0077] Storage device 510 may include at least one of the following storage media: flash memory, hard disk memory, multimedia card micro memory, card memory (e.g., SD memory, XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk and optical disk, etc., but not limited thereto.

[0078] Communication interface 520 can communicate with external devices using various wired and wireless communication modules. Communication interface 520 can receive data from external devices for estimating biological information and can send data processed and / or generated by display 110 or processor 120 to external devices. In this case, the external device may include an information processing device (such as a smartphone, tablet PC, desktop computer, laptop computer, etc.). Examples of wired and wireless communication modules in this case may include: Bluetooth communication, Bluetooth Low Energy (BLE) communication, Near Field Communication (NFC), WLAN communication, Zigbee communication, Infrared Data Association (IrDA) communication, Wi-Fi Direct (WFD) communication, Ultra Wideband (UWB) communication, Ant+ communication, Wi-Fi communication, Radio Frequency Identification (RFID) communication, 3G, 4G, and 5G communication, etc. However, this is an example and not intended to be limiting.

[0079] The audio output interface 530 can output an audio signal to an external location. The audio output interface 530 may include a speaker and / or a receiver. For example, the processor 120 can convert estimated bioinformation results and / or guidance information regarding contact location or contact pressure into an audio signal, and the audio output interface 530 can output the audio signal.

[0080] In addition, the device 500 for estimating biometric information may also include an input device. The input device may receive instructions to be used by the processor 120 or similar components of the device 500 for estimating biometric information and / or data from the user. The input device may include a microphone, mouse, keyboard, and / or digital pen (e.g., a stylus).

[0081] Figure 6 This is a flowchart of a method for estimating biological information according to an embodiment.

[0082] Figure 6 The method is an example of a method for estimating biological information performed by the devices 100 and 500 for estimating biological information according to the above embodiments. The embodiments have been described in detail above, so they will be briefly described below to avoid redundancy.

[0083] In operation 610, once the object comes into contact with the display, the device for estimating biometric information can determine the source pixel and detector pixel among multiple unit pixels of the display. In this case, the device for estimating biometric information can determine the source pixel and detector pixel at different locations. By considering the object's contact location, the type of biometric information, etc., the device for estimating biometric information can determine the source pixel and detector pixel by combining source pixels and detector pixels at various distances.

[0084] In operation 620, the device for estimating biological information can drive a multi-wavelength light source of the source pixel to emit light of multiple wavelengths onto the object. In operation 630, the device for estimating biological information can detect light scattered or reflected from the object by a detector of the detector pixel. The multi-wavelength light source may include a red light source, a green light source, and a blue light source. By modulating various colors, the device for estimating biological information can drive the light source sequentially or simultaneously to include an appropriate wavelength range for estimating biological information.

[0085] In operation 640, the device for estimating biological information may obtain a spectrum based on light detected by detector pixels. In operation 650, the device for estimating biological information may estimate biological information based on the obtained spectrum. In this case, when multiple spectra are obtained, the device for estimating biological information may determine the valid spectrum by verifying the validity of the spectra. Furthermore, the device for estimating biological information may extract features from the spectrum and may estimate biological information by applying an estimation model. In this case, the device for estimating biological information may extract features by a combination (such as difference or ratio) between a signal of a first wavelength and a signal of a second wavelength used as a reference.

[0086] Figure 7 and Figure 8 This is a diagram illustrating an example of an electronic device having a means for estimating biological information according to an embodiment.

[0087] Reference Figure 7 The electronic device can be implemented as a wristwatch-type wearable device 700. Here, the wristwatch-type wearable device 700 is an example, and its shape is not particularly limited, as long as the wearable device can be worn on the human body. The wristwatch-type wearable device 700 may include a main body MB and a strap ST. The main body MB can have various shapes (e.g., circular, square, etc.), and the strap ST can be made of a flexible material to wrap around the user's wrist, allowing the main body MB to be worn on the wrist. A display DP is disposed on the front surface of the main body MB, and a manipulator BT for receiving user commands can be disposed on the side surface of the main body MB. In this case, the display DP can be an OLED-based display.

[0088] Reference Figure 8 The electronic device can be implemented as a mobile device 800, such as a smartphone. A display DP can be disposed on the front surface of the main body MB of the mobile device 800, and various modules for processing user commands can be disposed on the front, rear, and / or side surfaces of the main body MB. In this case, the display DP can be an OLED-based display.

[0089] However, electronic devices are not limited to Figure 7 and Figure 8The wearable device 700 or mobile device 800 shown herein, and examples of electronic devices may include information processing devices (such as laptop computers with displays) or Internet of Things (IoT) devices (such as home appliances including refrigerators, televisions, etc.).

[0090] Reference Figure 7 and Figure 8 The main MB may include a processor, memory, sound output device, sensor module, haptic module, camera module, power management module, battery, communication module, etc. Some components can be omitted from the electronic device, and other components can be added.

[0091] At least some of the functions of devices 100 and 500 for estimating biological information can be implemented as a single integrated circuit in the sensor module of electronic devices 700 and 800, or can be distributed in different components. For example, the functions of the aforementioned display 110 and processor 120 of devices 100 and 500 for estimating biological information can be included in the display DP and processor of wearable device 700, respectively.

[0092] Multiple unit pixels capable of measuring light signals from an object can be arranged throughout the entire area UP of the display DP. However, the display DP is not limited to this, and the unit pixels used to measure light signals can be arranged in a portion of the display DP, specifically an area MP. Each unit pixel may include a light source emitting light of red, green, and blue wavelengths, and a detector for detecting the light signal.

[0093] Once a request for estimating biological information is received via touch input from the display DP or via the manipulator BT, and when an object comes into contact with the display DP, the processor can identify the source pixel and detector pixel among multiple unit pixels. Various spectra can be obtained by driving the source and detector pixels by combining them at various distances. By color modulation of the multi-wavelength light source at the source pixel according to the type of biological information, the processor can measure light signals within a wavelength range.

[0094] In this scenario, the processor can detect the contact position of an object by sequentially driving all unit pixels, and can also measure the light signal based on the detected contact position using unit pixels of a partial area (e.g., MP). Optionally, to bring the object into contact with a partial area (e.g., MP) of the display DP, the processor can output guidance information in the remaining area of ​​the display DP. In this case, the processor can extract the user's fingerprint information based on the light signal detected in the partial area MP, and can perform user authentication by using the extracted fingerprint information.

[0095] Data generated and / or processed by electronic devices 700 and 800 may be stored in memory, and the data stored in memory may be used by the processor or other components of electronic devices 700 and 800.

[0096] Data generated and / or processed by the processor or other components of electronic devices 700 and 800 can be converted into sound signals for output via a sound output device, and can be output via a tactile module as mechanical stimulation (e.g., vibration, motion, etc.) or electrical stimulation that can be recognized by a user through touch or motion.

[0097] The communication module enables electronic devices 700 and 800 to communicate with other devices (e.g., mobile devices, smartphones, laptops, etc.) located in a network environment. Data generated and / or processed by the processors or other components of electronic devices 700 and 800 can be sent to other devices via the communication module, and data used for estimating biological information, etc., can be received from other devices and stored in their memory.

[0098] The example embodiment can be implemented as computer-readable code written on a computer-readable recording medium. The computer-readable recording medium can be any type of recording device that stores data in a computer-readable manner.

[0099] Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage devices, and carrier waves (e.g., data transmission over the Internet). Computer-readable recording media can be distributed across multiple computer systems connected to a network, allowing computer-readable code to be written to and executed from them in a distributed manner. Those skilled in the art to which the example embodiments pertain can readily derive functional programs, code, and code segments for implementing the example embodiments.

[0100] The inventive concept has been described herein with reference to embodiments. However, it will be apparent to those skilled in the art that various changes and modifications can be made without altering the technical idea and features. Therefore, it is clear that the above embodiments are illustrative in all respects and are not intended to limit the inventive concept.

Claims

1. A device for estimating biological information, the device comprising: A display includes a plurality of unit pixels, each of the plurality of unit pixels including a light source and a detector, the light source being configured to emit light having different wavelengths, and the detector being configured to detect light having different wavelengths; and The processor is configured as follows: Determine the source pixel among the plurality of unit pixels that is configured to emit light onto the object; Identify the detector pixel among the plurality of unit pixels that is configured to detect light scattered or reflected from the object; The source pixel and the detector pixel are controlled to obtain a spectrum based on light with multiple wavelengths detected by the detector pixel; and Biological information is estimated based on the obtained spectral data. The processor is configured as follows: Detect the contact position of the object when it comes into contact with the display; A portion of the area is set based on the contact position of the detected object; Source pixels and detector pixels are determined based on a partial region. The processor is also configured to perform color modulation of the light source for a given source pixel based on the type of biometric information. The processor is also configured to perform color modulation of the light source for a given source pixel, to include a wavelength range of 470nm to 510nm. The processor is also configured as follows: The intensity of light at each wavelength is extracted based on the full width at half maximum (FWHM) of the light source emitting light at each wavelength. The spectrum is obtained based on the light intensity extracted for each wavelength in different wavelength ranges.

2. The device according to claim 1, wherein, The light sources include red, green, and blue light sources.

3. The device according to claim 1, wherein, The detector includes one or both of a photodiode and a complementary metal-oxide-semiconductor image sensor.

4. The device according to claim 1, wherein, The light source and detector are set on the same surface of the pixel circuit board.

5. The device according to claim 4, wherein, The light source and detector are patterned on the same surface of the pixel circuit board.

6. The device according to claim 4, wherein, A partition wall used to block light is placed between the light source and the detector.

7. The device according to claim 1, wherein, The light source is disposed on the first surface of the pixel circuit board, and the detector is disposed on the second surface of the pixel circuit board, the second surface being opposite to the first surface.

8. The device according to claim 1, wherein, Bioinformation includes any one or any combination of skin carotenoids, blood carotenoids, glucose, urea, lactate, triglycerides, total protein, cholesterol, and ethanol.

9. A method for estimating biological information, the method comprising: Based on the contact between the object and a display comprising multiple unit pixels, source pixels and detector pixels are determined among the multiple unit pixels, each of the multiple unit pixels comprising a light source emitting light of different wavelengths and a detector detecting light of different wavelengths. The selected source pixel is controlled to emit light onto the object; Controlled detector pixels detect light scattered or reflected from an object; The spectrum is obtained based on light with multiple wavelengths detected by detector pixels; and Biological information is estimated based on the obtained spectral data. The step of determining the source pixel and detector pixel among the plurality of unit pixels includes: Detect the contact position of the object when it comes into contact with the display; A portion of the area is set based on the contact position of the detected object; Source pixels and detector pixels are determined based on a partial region. The step of controlling the determined source pixel includes: performing color modulation of the light source for the determined source pixel based on the type of biometric information. The step of controlling the determined source pixel includes: performing color modulation of the light source of the determined source pixel to include a wavelength range of 470nm to 510nm. The steps for obtaining the spectrum include: The light intensity for each wavelength is extracted based on the full width at half maximum (FWHM) of the light source emitting light at each wavelength; and The spectrum is obtained based on the light intensity extracted for each wavelength in different wavelength ranges.

10. The method according to claim 9, wherein, The light sources include red, green, and blue light sources.

11. The method according to claim 9, wherein, The light source and detector are set on the same surface of the pixel circuit board.

12. The method according to claim 11, wherein, The light source and detector are patterned on the same surface of the pixel circuit board.

13. The method according to claim 11, wherein, A partition wall used to block light is placed between the light source and the detector.

14. The method according to claim 9, wherein, The light source is disposed on the first surface of the pixel circuit board, and the detector is disposed on the second surface of the pixel circuit board, the second surface being opposite to the first surface.

Images