Display, electronic device having the display, and method for estimating bio-information using the electronic device

Abstract

A display device having a light detection function is disclosed. According to one embodiment, the display device may include a display unit formed of an array of unit pixels including a light source pixel and a detector pixel, a light source driver and a data driver connected to each light source pixel, a control driver including a detector driver connected to each detector pixel, and a control unit that operates the display unit in a first mode, a second mode, or a third mode through the control driver.

Description

Technology Field

[0001] It relates to a display device having a light-sensing function. Furthermore, it relates to an electronic device equipped with said display device and a technology for estimating biometric information from said electronic device. Background Technology

[0002] Generally, devices such as wearables and smart devices include a display unit for displaying images. Recently, in addition to the function of displaying images, these display units include touch screens that recognize touches when a user's hand or a stylus contacts a specific location on the screen. With the recent increase in interest in health, research is being conducted on technologies that non-invasively measure biometric information, such as blood pressure, by equipping such wearables and smart devices with separate optical sensors. However, conventional devices are difficult to miniaturize because they are equipped with a separate display unit for image display and an optical sensor for light detection. The problem to be solved

[0003] A display device having a light-sensing function is presented. Additionally, an electronic device equipped with said display device and a method for estimating biometric information through said electronic device are presented. means of solving the problem

[0004] According to one aspect, the display device may include a display unit formed of an array of unit pixels including a light source pixel and a detector pixel, a light source driver and a data driver connected to each light source pixel, a control driver including a detector driver connected to each detector pixel, and a control unit that operates the display unit in a first mode, a second mode, or a third mode through the control driver.

[0005] At this time, the light source pixel may include one or more LED (light emitting diode) pixels that emit light of one or more wavelengths, and the detector pixel may include a PD (photodiode) pixel that receives light scattered or reflected from an object and converts it into an electrical signal.

[0006] At this time, each LED pixel has a 2-transistor 1-capacitor structure, and the PD pixel can have a 4-transistor or 3-transistor structure.

[0007] When driving data corresponding to the first mode is input, the control unit disables the detector driver and drives each light source of the display unit through the light source driver and the data driver based on the driving data to display an image.

[0008] The driving data may include at least one of the driving order, wavelength, and duration of the light source of the unit pixel array.

[0009] When driving data corresponding to the second mode is input, the control unit activates the detector driver and, based on the driving data, drives the light source and detector of the display unit through the light source driver, data driver, and detector driver to acquire a light signal from the target object.

[0010] At this time, the driving data may include the position, wavelength, and duration of the light source to be driven, and the position of the detector to be driven.

[0011] When driving data corresponding to the third mode is input, the control unit activates the detector driver and, based on the driving data, drives the light source and detector of the display unit through the light source driver, data driver, and detector driver to output an image in the first area of ​​the display unit and acquire a light signal in the second area.

[0012] At this time, the driving data may include the driving order, wavelength, and duration of each light source of the unit pixel array included in the first region, and may include the position, wavelength, duration, and position of the detector to be driven of the light source to be driven in the second region.

[0013] Additionally, the display device may further include a converter that is activated by a control unit when the display unit operates in a second mode or a third mode, and receives an optical signal from a detector of the display unit and converts it into a digital signal.

[0014] The conversion unit includes a multiplexer (Mux) in which the outputs of detectors are integrated and connected for each column of a unit pixel array, and an analog-digital converter (ADC) connected to the Mux, and the inputs of the detectors of the unit pixel array can be integrated for each row and connected to a detector driver.

[0015] The conversion unit includes an analog-digital converter (ADC) connected to the output of each detector of the unit pixel array, and the inputs of the detectors of the unit pixel array can be independently connected to the detector driver.

[0016] The conversion unit includes a plurality of analog-digital converters (ADCs) in which the outputs of detectors are integrated and connected for each column of the unit pixel array, and the inputs of the detectors of the unit pixel array can be integrated for each row and connected to a detector driver.

[0017] The conversion unit includes a plurality of analog-digital converters (ADCs) each connected to the output of each detector of the unit pixel array, and the inputs of the detectors of the unit pixel array can be integrated and connected to a detector driver.

[0018] According to one aspect, the electronic device may include an array of unit pixels including a light source pixel and a detector pixel, a display device operating in a first mode for displaying an image, a second mode for acquiring an optical signal, or a third mode for displaying an image and acquiring an optical signal, and a processor for determining the mode of the display device and controlling the operation of the display device according to the determined mode.

[0019] The processor sets the first mode as the default mode and can switch to the second mode or the third mode when an analysis request from the target is received.

[0020] When the processor receives a request for analysis of an object, it may select either a second mode or a third mode based on at least one of the user's request, the size and performance of the display device.

[0021] When the processor determines the second mode, it can control the display device to operate in the first mode to display guide information for acquiring an optical signal, and after a predetermined time, control the display device to operate in the second mode to acquire an optical signal from the target object.

[0022] When the processor is determined to be in a third mode, it can control the display device to display guide information for acquiring an optical signal or the analysis results of an object in the first area of ​​the display device and to acquire an optical signal in the second area.

[0023] When the processor determines the second mode or the third mode, it can control the display device to acquire a first optical signal from the object, and analyze the contact position of the object based on the acquired first optical signal to control the display device to acquire a second optical signal for the analysis of the object.

[0024] Additionally, the electronic device may further include a fingerprint sensor that acquires fingerprint data of the object when the object comes into contact with the display device.

[0025] The processor can analyze the contact location of an object based on fingerprint data and control the display device to acquire an optical signal or display guide information based on the analysis results.

[0026] The processor can acquire fingerprint feature points based on fingerprint data and determine a light source and a detector to be driven for acquiring the optical signal based on the acquired fingerprint feature points.

[0027] When a light signal is acquired from an object according to the second mode or the third mode, the processor can analyze the object based on the acquired light signal and perform at least one of biometric information estimation, fingerprint authentication, document scanning, and image scanning.

[0028] According to one aspect, the electronic device includes an array of unit pixels including a light source pixel and a detector pixel, and a display device that operates in a first mode for displaying an image, a second mode for acquiring an optical signal, or a third mode for displaying an image and acquiring an optical signal, and when a request for biometric information estimation is received, the display device is controlled to operate in the second mode or the third mode to acquire a first optical signal from an object, and biometric information can be estimated based on the acquired first optical signal.

[0029] The display device can acquire a first light signal by driving one or more pairs of light sources and detectors within a first area in which an object contacts.

[0030] The processor can determine a pair of light sources and detectors within the first region based on a predetermined reference point within the first region.

[0031] A predetermined reference point may include at least one of the fingerprint feature points obtained based on the center point of a first area and fingerprint data resulting from contact with the object.

[0032] The display device can acquire the first light signal while acquiring the plurality of second light signals by driving a plurality of light source and detector pairs within a second region including a first region.

[0033] The processor can correct the first optical signal based on the second optical signal and estimate bio-information based on the corrected first optical signal.

[0034] Additionally, the electronic device may further include a force sensor that measures the contact force when an object contacts and presses against the display device.

[0035] The processor can obtain a contact area based on the magnitude of the amount of light received by the detector pixel when an object contacts the display device, obtain a contact pressure based on the contact force and contact area, and estimate bio-information based on the contact pressure and the light signal.

[0036] Bioinformation may include one or more of blood pressure, vascular age, degree of arteriosclerosis, aortic pressure waveform, vascular elasticity, stress index, fatigue level, skin elasticity, skin age, triglycerides, cholesterol, blood sugar, and antioxidant index. Effects of the invention

[0037] By presenting a display device having a light detection function, there is no need to provide a separate light sensor for acquiring light signals, thereby enabling the miniaturization of electronic devices and allowing various functions, such as estimating biometric information, to be performed using the acquired light signals. Brief explanation of the drawing

[0038] FIG. 1 is a block diagram of a display device according to one embodiment. FIG. 2 illustrates a display structure according to one embodiment. FIGS. 3a to 3c are drawings for explaining various operation modes of a display device. FIGS. 4a to 4d are drawings illustrating various driving methods of a detector. FIGS. 5A and 5B illustrate examples of driving data configured so that the display device operates in a mode of acquiring an optical signal. FIG. 6 is a block diagram of an electronic device according to one embodiment. FIGS. 7A and FIGS. 7B are drawings for explaining the operation method of a display device. FIGS. 8a to 8g are drawings for explaining the acquisition of an optical signal in a display device. FIG. 9 is a block diagram of an electronic device according to another embodiment. Figures 10a to 10c are diagrams illustrating oscillometric-based blood pressure estimation. FIG. 11 is a block diagram of an electronic device according to another embodiment. FIG. 12 is a diagram for explaining the determination of the contact state of an object. FIG. 13 is a block diagram of an electronic device according to another embodiment. FIG. 14 is a flowchart of a bio-information estimation method according to one embodiment. Specific details for implementing the invention

[0039] Specific details of other embodiments are included in the detailed description and drawings. The advantages and features of the described technology and the methods for achieving them will become clear by referring to the embodiments described in detail below together with the drawings. Throughout the specification, the same reference numerals refer to the same components.

[0040] Terms such as "first," "second," etc., may be used to describe various components, but the components should not be limited by these terms. Terms are used solely for the purpose of distinguishing one component from another. A singular expression includes a plural expression unless the context clearly indicates otherwise. Furthermore, when a part is described as "comprising" a component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Additionally, terms such as "...part," "module," etc., as used in the specification refer to a unit that performs at least one function or operation, which may be implemented in hardware or software, or as a combination of hardware and software.

[0041] Hereinafter, embodiments of the display device will be described in detail with reference to the drawings. The display device of the present embodiments has a light sensing function and can be mounted on various electronic devices. The electronic device includes various types of wearable devices such as smartwatches worn on the wrist, smart bands, headphones, and headbands, mobile devices such as smartphones or tablet PCs, desktop PCs, laptop PCs, navigation devices, and televisions, but is not specifically limited to these examples.

[0042] FIG. 1 is a block diagram of a display device according to one embodiment.

[0043] Referring to FIG. 1, the display device (100) includes a display unit (110), a control unit (120), a control driver (130, 140, 150), and a conversion unit (160).

[0044] The display unit (110) includes a display panel that displays an image. The display panel may include a touchscreen that recognizes the touch when a user's hand or a stylus comes into contact with it.

[0045] FIG. 2 illustrates a display structure according to one embodiment.

[0046] Referring to FIG. 2, a display unit (110) of one embodiment may be formed with unit pixels (111) arranged in an array. Each unit pixel (111) may include a light source pixel and a detector pixel.

[0047] The light source pixel of each unit pixel (111) may include, but is not limited to, a light emitting diode (LED), a laser diode (LD), or a phosphor. The light source pixel may include a plurality of LED pixels (IR, Red, Green, Blue) that emit light of different wavelengths as illustrated. However, since the structure is not limited to this, some LED pixels, such as IR LED pixels, may be excluded in the illustrated example. Additionally, it is possible to configure the LED pixels to express white rather than RGB. Each LED pixel (IR, Red, Green, Blue) may be configured to have a general active matrix driving method, and may be composed of, for example, a 2Tr 1C structure, that is, two transistors and one capacitor.

[0048] The detector pixel of each unit pixel (111) may include a photodiode (PD) that detects light and converts the detected light into an electrical signal (hereinafter referred to as "optical signal"). However, it is not limited thereto. As illustrated, the detector pixel of each unit pixel (111) may include one PD pixel (PD). The PD pixel (PD) may have a general CIS (CMOS Image Sensor) configuration, but is not limited thereto and may be configured to have various structures such as a 4-transistor (4Tr) or 3-transistor (3Tr) structure.

[0049] Referring again to FIG. 1, the control unit (120) can control the control driver (130, 140, 150) based on driving data to operate the display unit (110) in any one of a first mode for displaying an image, a second mode for acquiring a light signal from an object, and a third mode for simultaneously performing image display and light signal acquisition.

[0050] The control driver may include a light source driver (130) and a data driver (140) electrically connected to the light source pixel of each unit pixel of the display unit (110), and a detector driver (150) electrically connected to the detector pixel of each unit pixel. In this case, the light source driver (130), the data driver (140), and the detector driver (150) may be composed of a multiplexer (Mux).

[0051] Driving data may be input from a processor of an electronic device that is equipped with a display device (100) or connected to the display device (100) via wired or wireless communication, and may include data related to the driving of the light source and detector of each unit pixel.

[0052] For example, driving data for operating the display unit (110) in a first mode includes image data to be displayed, and may include light source data such as the driving order of each light source of a unit pixel array, driving wavelength, and driving duration. However, it is not limited thereto.

[0053] As another example, driving data for operating the display unit (110) in a second mode may include data regarding one or more light source-detector pairs or a single detector to be driven to acquire a light signal from an object. For example, it may include light source data such as the position of the light source to be driven, the driving wavelength, and the driving duration, and detector data such as the position of the detector to be driven. However, it is not limited thereto.

[0054] As another example, driving data for operating the display unit (110) in a third mode may include light source data such as the driving order, driving wavelength, and duration of each light source of a unit pixel array included in the first area to display image data in the first area of ​​the display unit (110). Here, the first area may not refer only to a single physically continuous area, but may refer to two or more areas separated from each other. Additionally, data regarding one or more light source-detector pairs to be driven to acquire a light signal from an object in the second area of ​​the display unit (110) may be included. For example, it may include light source data such as the position, driving wavelength, and driving duration of the light source to be driven, and detector data such as the position of the detector to be driven. However, it is not limited thereto.

[0055] The conversion unit (160) can be electrically connected to the detector pixel (PD) of the control unit (120) and the display unit (160). The conversion unit (160) is activated / deactivated according to the control of the control unit (120) and can convert the optical signal output from the detector pixel (PD) into a digital signal and transmit it to the processor of the electronic device.

[0056] FIGS. 3a to 3c are drawings for explaining various operation modes of a display device.

[0057] FIG. 3a is a diagram illustrating an example of operation in a first mode. Referring to FIG. 3a, when driving data is input, the control unit (120) determines the operating mode of the display unit (110), and when the first mode is determined, the detector driver (150) that drives the detector and the converter (160) that receives a light signal from the detector can be deactivated. Additionally, driving data can be transmitted to the light source driver (130) and the data driver (140) to drive the light source of the unit pixel array and display an image. At this time, the light source driver (130) outputs a signal to drive each light source to the light source pixel based on the driving data received from the control unit (120), and the data driver (140) outputs image data to each light source pixel based on the driving data so that the image (ID) is displayed.

[0058] FIG. 3b is a diagram illustrating an example of operation in a second mode. Referring to FIG. 3b, when driving data is input, the control unit (120) determines the operating mode of the display unit (110), and when the second mode is determined, it can activate the detector driver (150) that drives the detector and the converter (160) that receives a light signal from the detector. Additionally, it can transmit LED data among the driving data to the light source driver (130) and the data driver (140), and transmit PD data among the driving data to the detector driver (150). The light source driver (130), the data driver (140), and the detector driver (150) can, based on the received driving data, [transmit] the light source (LED) at the corresponding location i ) and detector (PD i It can be driven to detect an optical signal from an object (OBJ). The conversion unit (160) can be configured to detect an optical signal from a detector (PD). i The optical signal detected from the target (OBJ) can be received by ), and the received optical signal can be converted into a digital signal and output to the processor of the electronic device.

[0059] FIG. 3c is a diagram illustrating an example of operation in a third mode. Referring to FIG. 3c, when driving data is input, the control unit (120) determines the operating mode of the display unit (110), and when the third mode is determined, it can activate the detector driver (150) that drives the detector and the converter (160) that receives a light signal from the detector. Additionally, it can transmit LED data among the driving data to the light source driver (130) and the data driver (140), and transmit PD data among the driving data to the detector driver (150). The light source driver (130) and the data driver (140) drive the light source in the first area of ​​the display unit (110) to display an image (ID), and the light source driver (130), the data driver (150), and the detector driver (160) drive the light source (LED) at a predetermined position in the second area of ​​the display unit (110). i ) and detector (PD i It can be driven to detect an optical signal from an object (OBJ). The conversion unit (160) can be configured to detect an optical signal from a detector (PD). i The optical signal detected from the target (OBJ) can be received by ), and the received optical signal can be converted into a digital signal and output to the processor of the electronic device.

[0060] FIGS. 4a to 4d are drawings illustrating various driving methods of detectors. FIGS. 4a to 4d illustrate a unit pixel array including four detectors (PD1, PD2, PD3, PD4) for convenience, but the number is not particularly limited.

[0061] Referring to FIG. 4a, the first driving method may include a converter (160) comprising an analog-digital converter (ADC) (161), and the ADC (161) may be connected to the output of each detector (PD1, PD2, PD3, PD4) of the unit pixel array. Additionally, the inputs of each detector (PD1, PD2, PD3, PD4) of the unit pixel array may be independently connected to a detector driver (150). In this way, the first driving method may be configured so that the optical signal of any one detector selected by the detector driver (150) is output to the ADC (161).

[0062] Referring to FIG. 4b, the second driving method may include a converter (160) comprising one ADC (161) and one Mux (162). The Mux (162) may be connected to each line that integrates detectors for each column. For example, the Mux (162) may be connected to a line that integrates detectors (PD1, PD3) of the first column and a line that integrates detectors (PD2, PD4) of the second column, and may selectively output an optical signal input from each line to the ADC (161). Additionally, the inputs of each detector may be integrated for each row and connected to a detector driver (150). For example, a line that integrates the inputs of detectors (PD1, PD2) of the first row and a line that integrates the inputs of detectors (PD3, PD4) of the second row may each be connected to a detector driver (150). In this way, the second driving method can be configured such that the outputs of any row of detectors selected by the detector driver (150) are simultaneously input to the Mux (162), and the optical signal selected by the Mux (162) is output to the ADC (161).

[0063] Referring to FIG. 4c, the third driving method may include a converter (160) comprising a plurality of ADCs (161a, 161b). The plurality of ADCs (161a, 161b) may be connected by integrating the outputs of the detectors for each column. For example, the ADC (161a) of the first column may be connected to a line integrating the outputs of the detectors (PD1, PD3) of the first column, and the ADC (161b) of the second column may be connected to a line integrating the outputs of the detectors (PD2, PD4) of the second column. Additionally, the inputs of each detector may be integrated by row and connected to a detector driver (150). For example, a line integrating the inputs of the detectors (PD1, PD2) of the first row and a line integrating the inputs of the detectors (PD3, PD4) of the second row may be connected to the detector driver (150). In this way, the third driving method can be configured so that the outputs of a row of detectors selected by the detector driver (150) are simultaneously input to each ADC (161a, 161b).

[0064] Referring to FIG. 4d, the fourth driving method comprises a converter (160) that includes a plurality of ADCs (161a, 161b, 161c, 161d), and each ADC (161a, 161b, 161c, 161d) can be connected to the output of each corresponding detector (PD1, PD2, PD3, PD4). Additionally, the inputs of each detector (PD1, PD2, PD3, PD4) can be integrated into one and connected to a detector driver (150). In this way, the fourth driving method can be configured so that the optical signals of all detectors (PD1, PD2, PD3, PD4) are output simultaneously to the corresponding ADCs (161a, 161b, 161c, 161d). At this time, the detector driver (150) may be omitted.

[0065] However, the driving methods described in FIGS. 4a to 4d are not limited to the driving methods described therein, and may be configured to have variations of each driving method, combinations of two or more driving methods, or various other driving methods not exemplified herein. For example, the third driving method may be modified so that the converter (160) includes only one ADC and the lines integrating the detectors of each column are bundled together and connected to the ADC, and the inputs of the detectors of each column are independently connected to the detector driver (150). That is, the design of the detector driving method can be optimized by adjusting the number of ADCs and the complexity of the lines, etc., considering the purpose of use of the display device, the size of the display device, and the computing performance of the electronic device.

[0066] FIGS. 5a and 5b illustrate examples of driving data configured so that the display device operates in a mode for acquiring an optical signal. However, the following examples are merely for illustrative purposes and should not be interpreted as being limited thereto.

[0067] Referring to FIG. 5a, a display unit having a unit pixel array of 18 rows and 12 columns is illustrated. FIG. 5b illustrates examples of various driving data in a second mode or a third mode for acquiring an optical signal. Driving data 1 is an example of driving data for acquiring a single optical signal using a pair of light sources (LEDs) of unit pixel 30 and detectors (PDs) of unit pixel 114, and can acquire an optical signal having a single optical path.

[0068] Driving data 2 is an example of driving data that acquires multiple light signals by a light source at one location (30) and a pair of detectors at multiple locations (113, 114, 115), and can acquire light signals from multiple light paths while the light source location is fixed.

[0069] Driving data 3 is an example of driving data for acquiring multiple light signals by a pair of light sources at multiple locations (30, 31, 32) and a detector at one location (114), and can acquire light signals from multiple light paths while the detector location is fixed.

[0070] Driving data 4 is an example of driving data for acquiring multiple optical signals by pairs of light sources at multiple locations (1, 2, 3, 4, 5, 6) and detectors at multiple locations (1, 2, 3, 4, 5, 6), and can acquire optical signals of multiple optical paths at various locations.

[0071] Driving data 5 is an example of driving data that combines two or more driving data, such as driving data 1 and driving data 4, and can be used for a wider variety of analysis purposes by alternately driving driving data 1 and driving data 4 in a time-division method at every sampling to acquire multiple optical signals.

[0072] FIG. 6 is a block diagram of an electronic device according to one embodiment. FIG. 7a and FIG. 7b are drawings for explaining the operation method of a display device. FIG. 8a to FIG. 8g are drawings for explaining the acquisition of an optical signal in a display device.

[0073] Referring to FIG. 6, the electronic device (600) includes a display device (610) and a processor (620).

[0074] The display device (610) includes a display unit that operates in a first mode for displaying an image, a second mode for acquiring a light signal, and a third mode for displaying an image and acquiring a light signal, and a control unit that causes the display unit to operate in the first mode, the second mode, or the third mode based on driving data.

[0075] The display unit is formed as an array of unit pixels, and each unit pixel may include a light source pixel and a detector pixel. The light source pixel of each unit pixel may include, for example, a plurality of LED pixels for irradiating light of different wavelengths. Additionally, the detector pixel of each unit pixel may include a PD pixel for detecting a light signal from an object.

[0076] Additionally, the display device (610) may include a control driver that is electrically connected to a display unit and a control unit and drives the display unit according to the control of the control unit to a corresponding mode. The control driver may include a light source driver connected to a light source pixel, a data driver, and a detector driver connected to a detector pixel.

[0077] When driving data corresponding to the first mode is input from the processor (620), the control unit can disable the detector driver and control the light source driver and the data driver. Additionally, when driving data corresponding to the second mode or the third mode is input, the control unit can enable the detector driver and control the light source driver, the data driver, and the detector driver.

[0078] Additionally, the display device (610) may further include a converter that converts an optical signal acquired according to a second mode or a third mode into a digital signal and outputs it to a processor (620). As described above, the converter may include one or more ADCs or one or more Muxes and one or more ADCs.

[0079] Since embodiments of the display device (610) have been described in detail with reference to FIGS. 1 to 5b, they will be omitted below.

[0080] The processor (620) processes various functions of the electronic device (600). For example, the processor (620) can determine the mode of the display device (610) according to a request related to the display device (610). In addition, the operation of the display device (610) can be controlled by generating driving data according to the determined mode and transmitting it to the control unit of the display device (610). Examples of driving data according to each mode have been described above.

[0081] The processor (620) sets the first mode as the default mode and can switch the display device (610) to the second mode or the third mode when a request for analysis of the target is received. Additionally, the processor (620) can automatically switch the display device (610) to the first mode when the acquisition of the optical signal is completed according to the second mode or the third mode.

[0082] The processor (620) can maintain the display device (610) in a first mode and, when various video data is processed in the electronic device (600), generate driving data including various video data and transmit it to the control unit of the display device (610). At this time, the video data processed in the electronic device (600) may include TV content, video / still images generated and / or played in various applications installed in the electronic device (600), and various video data received from an external device connected to the electronic device (600) via wired or wireless communication.

[0083] When the processor (620) receives a request for analysis of an object using an optical signal, it can generate appropriate driving data and switch the mode of the display device (610) to a second mode or a third mode. At this time, the request for analysis of the object may include requests regarding various operations that can be processed using an optical signal, such as biometric information estimation, fingerprint authentication, document scanning, and image scanning.

[0084] For example, the processor (620) may determine the optical signal acquisition mode by considering the user's request, the type of electronic device (600), the type of object analysis request, the size and / or performance of the display device (610), etc. As an example, the user may designate a second mode to acquire the optical signal using the entire area of ​​the display device (610) for more accurate biometric information estimation. Alternatively, the user may designate a third mode to acquire the optical signal in the remaining area while continuing to watch the video currently being viewed in a part of the area.

[0085] As another example, the optical signal acquisition mode of the display device (610) may be predefined according to the type of object analysis request, the size and / or performance of the display device (610), etc., and the processor (620) may determine the optical signal acquisition mode of the display device (610) to a predefined mode when an object analysis request is received. For example, if it is an object analysis request, it may be defined as a third mode, and if the performance of the display device (610) is relatively low or the size is small, it may be defined as a second mode. However, it is not limited thereto.

[0086] When the display device (610) operates in a second mode or a third mode to acquire a light signal from the object, the processor (620) can analyze the object based on the light signal and process the user's request. When the analysis of the object is completed, the processor (620) can generate the analysis result of the object as image data and generate appropriate driving data to display the analysis result image data in the first mode or the third mode, and transmit it to the control unit of the display device (610).

[0087] For example, referring to FIG. 7a, when the processor (620) determines the mode of the display device (610) to a second mode in response to a request to acquire a light signal, it can generate driving data to drive a predetermined light source (LED) and detector (PD) as shown in (1) and transmit it to the control unit of the display device (600). Additionally, when an object contacts the display unit (611) and a light signal is acquired, blood pressure can be estimated using the light signal.

[0088] Meanwhile, the processor (620) can generate driving data to enable the display device (600) to operate in a first mode to generate guide information for acquiring the optical signal, such as contact position, contact state, and contact pressure, and transmit this data to the control unit of the display device (600) before generating driving data for acquiring the optical signal, and after a predetermined time has elapsed, generate driving data to enable the display device (600) to acquire the optical signal in a second mode and transmit this data to the control unit.

[0089] Additionally, the processor (620) can generate driving data to switch the mode of the display device (610) to the first mode and output the blood pressure estimation result to the display unit (611) when the optical signal acquisition or blood pressure estimation is completed as shown in (2).

[0090] Referring to FIG. 7b, when the processor (620) determines the mode of the display device (610) to a third mode, it may output guide information and / or processing results for acquiring a light signal in the first area (D1, D3) of the display unit (611) and generate driving data including information regarding a light source (LED) and a detector (PD) to be driven to acquire a light signal in the second area (D2). As illustrated, the first area (D1, D3) may be divided into two or more areas, and information that visually guides contact pressure may be displayed in one area (D1), and processing results during or after acquiring a light signal in the second area (D2) may be output in the other area (D3). For example, the processor (620) may display text such as "Press harder" to encourage the user to increase contact pressure while acquiring a light signal, and may display an estimated blood pressure value when blood pressure estimation is completed, as illustrated.

[0091] FIGS. 8a to 8g illustrate examples of driving a light source and detector pair when the display device (610) operates in a second mode or a third mode to acquire an optical signal. An area of ​​the display section of the display device (610) consisting of 10 rows and 10 columns is illustrated. At this time, the display section area represents the entire area in the second mode or the optical signal acquisition area in the third mode.

[0092] The display device (610) drives a pair of light sources and detectors based on driving data generated by the processor (620) and can acquire, for example, a first light signal for blood pressure estimation.

[0093] For example, referring to FIG. 8a, a display device (610) can obtain a first light signal from an object (OBJ) by driving a pair of a light source (41) and a detector (77). At this time, the pair of light source (41) and detector (77) to be driven can be predefined.

[0094] As another example, referring to FIG. 8b, the display device (610) can acquire a first light signal by driving a pair of light sources (41) and detectors (77) in a first region (DA1) that the object (OBJ) contacts, and acquire a plurality of second light signals by driving a plurality of pairs of light sources and detectors in a second region (DA2) that includes the first region (DA1). At this time, the first region (DA1) and the second region (DA2) may be pre-set. While the plurality of pairs of light sources and detectors in the second region (DA2) are being driven, the display device (610) can drive the pairs of light sources (41) and detectors (77) in the first region (DA1) continuously and simultaneously for a certain period of time, or drive them sequentially in a time-division manner.

[0095] Multiple pairs of light sources and detectors in the second region (DA2) may be predefined as combinations of light sources and detectors of all unit pixels within the second region (DA2). For example, a light source and detector of the same unit pixel may be combined as a pair, or a light source of a first unit pixel and a detector of a second unit pixel separated by a predetermined distance may be combined as a pair. However, this is not limited thereto, and various unit pixels may be combined.

[0096] Alternatively, a plurality of light source and detector pairs in the second region (DA2) may be predefined as a combination of light sources and detectors of a selected portion of unit pixels within the second region (DA2). For example, the unit pixels to be selected may be predetermined by considering the performance of the electronic device (600), the performance of the display device (610), the purpose of optical signal analysis, and the speed required for optical signal analysis. For example, they may be selected by predefined row spacing such as the first row, third row, fifth row, etc. and / or predefined column spacing such as the first column, third column, fifth column, etc., and may also be selected in other diagonal directions, cross directions, etc. However, they are not limited thereto. As described above, the pairs of light sources and detectors to be driven simultaneously may be combined as light sources and detectors of each unit pixel or as a pair of light sources and detectors of two unit pixels spaced apart from each other.

[0097] The display device (610) can drive all or selected pairs of light sources and detectors within the second area (DA2) in a predefined pattern. At this time, the predefined pattern may be driven sequentially in a row or column direction, driven one or more times simultaneously, or driven in a circular or square shape, and may be driven sequentially and / or simultaneously in a clockwise or counterclockwise direction, or in a shape spreading from the inside out, or in the opposite direction. However, it is not limited thereto.

[0098] Referring to FIG. 8c, the display device (610) can obtain a plurality of first light signals from an object (OBJ) by driving a plurality of light source and detector pairs in a second area (DA2) in various ways, and simultaneously or sequentially driving a single light source (41) and a plurality of detectors (76, 77, 78) in a first area (DA1).

[0099] Referring to FIG. 8d, the display device (610) can obtain one or more first light signals from an object (OBJ) by driving a plurality of light sources and detector pairs in the second area (DA2) in various ways as described above, and simultaneously or sequentially driving a plurality of light sources (40, 41, 42) and one detector (77) in the first area (DA1).

[0100] Referring to FIG. 8e, the display device (610) can obtain a plurality of first light signals from an object (OBJ) by driving a plurality of light sources (40, 41, 42) and a plurality of detectors (76, 77, 78) in a first area (DA1) simultaneously or sequentially while driving a plurality of light sources and detector pairs in a second area (DA2) in various ways as described above.

[0101] Referring to FIGS. 8f and FIGS. 8g, the processor (620) can determine one or more light sources and detectors to be driven based on a predetermined reference point in a first region when a request to acquire an optical signal is received.

[0102] For example, as shown in FIG. 8f, a predetermined reference point of the first area (DA1) may be the center point (AC) of the first area (DA1). A light source (41) and a detector (77) located at a predetermined distance from the center point of the first area (DA1) may be determined as a light source and a detector for acquiring a first light signal. At this time, one or more light sources and detectors may be determined as shown in FIG. 8c to FIG. 8e. The processor (620) may perform calibration to guide the object (OBJ) to come into contact with the display device (610) multiple times, and analyze the contact pattern of the object to determine the optimal size of the first area (DA1) for each user and the optimal distance from the center point (AC) of the first area (DA1) to the light source and detector.

[0103] As another example, as shown in FIG. 8g, the processor (620) may acquire a fingerprint feature point (FP) as a predetermined reference point based on fingerprint data resulting from contact with an object (OBJ), and determine a light source and detector for acquiring a first light signal based on the acquired fingerprint feature point (FP). At this time, the processor (620) may acquire a fingerprint direction (FD) and determine a light source and detector at a predetermined distance from the fingerprint feature point (FP) on the fingerprint direction (FD). At this time, the fingerprint data may be acquired using a fingerprint sensor or a distribution of light received by a display device (610) according to contact with an object, as described later.

[0104] As described above, the processor (620) can process requests such as biometric information estimation, fingerprint authentication, document scanning, and image scanning based on the first optical signal. At this time, when multiple first optical signals are acquired, the processor (620) can process various requests by selecting one of the multiple first optical signals or by combining two or more first optical signals.

[0105] Additionally, the processor (620) can correct the first optical signal based on the second optical signal when a plurality of second optical signals are acquired in the second region together with the first optical signal as described above. For example, referring to FIG. 8b, if the object is in better contact with the unit pixel 76 located to the left of the unit pixel 77 which acquires the first optical signal, the first optical signal of 77 can be corrected based on the second optical signal detected at the unit pixel 76. For example, the first optical signal of 77 can be corrected using various predefined correction formulas, such as a method of averaging the amplitudes of each time point of the optical signals of 76 and 77. Here, only the number 76 is given as an example, but it is not limited thereto, and a plurality of second optical signals with relatively good contact conditions can be selected, and the first optical signal can be corrected based on the selected plurality of second optical signals.

[0106] Alternatively, the processor (620) may evaluate the reliability of the first optical signal based on a plurality of second optical signals. For example, if the feature points extracted from each optical signal, such as the maximum amplitude, gradually increase as they move away from 77, it may be determined that the reliability of the first optical signal is not high, and the mode of the display device (610) may be switched to the first mode or the third mode to guide the re-contact of the object. At this time, the criteria for determining reliability are not limited to those exemplified.

[0107] FIG. 9 is a block diagram of an electronic device according to another embodiment. FIG. 10a to 10c are diagrams for explaining oscillometric-based blood pressure estimation.

[0108] Referring to FIGS. 9 to 10c, a function of estimating bio-information among the various functions of an electronic device (900) analyzing an object through a light signal is described. At this time, the bio-information may include one or more of blood pressure, vascular age, degree of arteriosclerosis, aortic pressure waveform, vascular elasticity, stress index, fatigue level, skin elasticity, skin age, triglycerides, cholesterol, blood sugar, and antioxidant index, but is not limited thereto.

[0109] As illustrated in FIG. 9, according to one embodiment, the electronic device (900) may include a display device (910), a processor (920), and a force sensor (930). The display device (910) and the processor (920) have been described in detail through the aforementioned embodiments.

[0110] When a request for biometric information estimation is received, the processor (920) generates driving data to switch the display device (910) to a second mode or a third mode and transmits it to the display device (910).

[0111] For example, when the processor (920) is determined to be in a second mode, it may first operate in a first mode to generate first driving data and transmit it to the display device (910) to display information guiding the user to acquire an optical signal. At this time, the guidance information may be image data that visually displays the contact position and / or contact pressure of an object (e.g., a finger). Then, after a predetermined time has elapsed after the guidance information is displayed on the display device (910), the display device (910) may operate in a second mode to generate second driving data to acquire an optical signal from the object and transmit it to the display device (910).

[0112] As another example, when the processor (920) determines the third mode, the display device (910) may operate in the third mode to display guide information and / or biometric information estimation results for acquiring an optical signal in the first area and generate driving data to acquire an optical signal in the second area and transmit it to the display device (910).

[0113] Meanwhile, when the processor (920) determines the second mode or the third mode, it first generates first driving data to acquire a first optical signal for determining the contact position of the target and transmits it to the display device (910), and when the first optical signal is acquired, it can analyze the contact position of the target based on the first optical signal. Additionally, the processor (920) can determine a light source and a detector to drive to acquire a second optical signal for estimating bio-information based on the analyzed contact position, and generate second driving data including information regarding the determined light source and detector and transmit it to the display device (910).

[0114] For example, the driving data 4 of FIG. 5b described above can be generated as the first driving data to detect the amount of light resulting from contact with an object in the entire area of ​​the display unit, and the area of ​​unit pixels where the amount of light is greater than or equal to a predetermined threshold can be tracked as the contact location of the object. Additionally, if, as a result of tracking, a rectangular area with the unit pixels (17, 19, 137, 139) of FIG. 5a as vertices is determined as the contact location of the object, the driving data 1 of FIG. 5b can be generated as the second driving data.

[0115] A force sensor (930) may be positioned at the bottom of the display device (910) and can measure the contact force when a user applies force by contacting an object to the display device (910). The user may gradually increase the pressing force while keeping a finger in contact with the display device (910) to change the intensity of the light signal for a predetermined period of time, or gradually decrease the pressing force while applying a force greater than a predetermined threshold.

[0116] When the processor (920) receives the contact force measured from the force sensor (930) and the light signal from the display device (910), it can estimate bio-information based on the contact force and the light signal.

[0117] For example, FIG. 10a illustrates a portion of the amount of light received by the detector pixel of the display device (910) when an object comes into contact with the display device (910) and is gradually pressed. At this time, the amount of light of the detector pixel may be the size of the capacitance. The processor (920) can obtain the contact area where the object comes into contact with the display based on the size of the amount of light of the detector pixel.

[0118] For example, a continuous area where the magnitude of light intensity is greater than or equal to a predetermined threshold (8 in FIG. 10a) can be set as a region of interest (AI), and the contact area can be obtained by multiplying the number of unit pixels within the set region of interest (AI) by the size of each unit pixel. As another example, the contact area can be obtained based on the correlation between the contact area and the statistical values ​​of the magnitude of light intensity of pixels within the region of interest (total sum, average value, median value, maximum value, minimum value, etc.). Generally, when a user gradually increases the pressing force while their finger is in contact with the display, the contact area increases in a certain range, and the magnitude of light intensity of the pixels in the area contacted by the finger increases. Accordingly, a certain correlation between the statistical values ​​of light intensity and the contact area can be predefined as a linear / non-linear function.

[0119] The processor (920) can determine the contact area of ​​a subject by generating optimal first driving data, such as driving data 5 of FIG. 5b, for measuring the contact area, and once the contact area is determined, generate second driving data for obtaining a light signal for estimating bio-information and transmit it to the display device (910).

[0120] However, it is not limited thereto, and the electronic device (900) may further include a contact area sensor mounted on the upper or lower part of the display device (910), and it is also possible to obtain a contact area through the contact area sensor.

[0121] When the contact area is obtained in this manner, the processor (920) can obtain contact pressure based on the obtained contact area and the contact force measured by the force sensor (930). For example, the contact pressure can be obtained by dividing the contact force by the contact area. When the contact pressure is obtained in this manner, the processor (920) can estimate bio-information based on oscillometrics based on the contact pressure and the amplitude of the optical signal.

[0122] For example, FIG. 10b illustrates an optical signal, such as a pulse wave signal, measured by the display device (910) when the user contacts the display device (910) with a finger and gradually increases the contact pressure. As illustrated, when the user gradually increases the pressing force while contacting the display device (910) with a finger, the amplitude of the optical signal also tends to gradually increase over a certain period of time. The processor (920) can extract the peak-to-peak point by subtracting the amplitude value (in3) at the negative (-) point from the amplitude value (in2) at the positive (+) point of the waveform envelope (in1) at each measurement point, and obtain an oscillometric envelope (OW) by plotting the amplitude of the extracted peak-to-peak point at each measurement point based on the contact pressure at the same measurement point, as illustrated in FIG. 10c.

[0123] Referring to FIG. 10c, the processor (920) can obtain features for estimating bio-information, such as blood pressure, from the acquired oscillometric envelope (OW). The processor (720) can obtain features such as the amplitude value (MA) at the maximum peak point, the contact pressure value (MP) at the maximum peak point, and contact pressure values ​​(SP, DP) corresponding to left and right time points corresponding to a preset ratio (e.g., 0.5 to 0.7) relative to the amplitude value (MA) at the maximum peak point. However, it is not limited thereto, and additional features such as the maximum amplitude value, the time corresponding to the maximum amplitude value, the time and amplitude of points related to the forward wave and the reflected wave, and combinations of the acquired values ​​can be obtained through waveform analysis of the optical signal.

[0124] The processor (920) can estimate biometric information by applying a predefined biometric information estimation model when features are extracted. The biometric information estimation model can be defined in the form of various linear or non-linear combined functions without special limitations, such as addition, subtraction, division, multiplication, logarithmic values, and regression equations. For example, Mathematical Equation 1 below illustrates a simple form of linear function.

[0125]

[0126] Here, y represents the estimated value of the bio-information to be obtained, and x represents the extracted feature value. a and b are values ​​obtained in advance through a preprocessing process and may be defined differently depending on the type of bio-information and user characteristics. For example, the processor (920) can independently estimate each blood pressure through the above mathematical formula 1 defined for average blood pressure, diastolic blood pressure, and systolic blood pressure. For example, the average blood pressure, diastolic blood pressure, and systolic blood pressure can be obtained by inputting the extracted feature value (MP), feature value (DP), and feature value (SP) into the respective defined function formulas.

[0127] FIG. 11 is a block diagram of an electronic device according to another embodiment. FIG. 12 is a diagram for explaining the determination of the contact state of an object through fingerprint detection.

[0128] Referring to FIG. 11, an electronic device (1100) according to one embodiment may include a display device (1110), a processor (1120), and a fingerprint sensor (1130). Various functions of the aforementioned electronic devices (600, 900) may be performed in the electronic device (1100) of this embodiment. The electronic device (1100) may further include a force sensor as described in FIG. 9. Since embodiments of the display device (1110) and the processor (1120) have been described previously, the description will focus on non-overlapping functions.

[0129] A fingerprint sensor (1130) may be positioned on the upper or lower part of a display device (1110). The fingerprint sensor (1130) may be an optical or capacitive-based fingerprint sensor. The fingerprint sensor (1130) may acquire fingerprint data when a user contacts an object to acquire a light signal. Here, the fingerprint data does not mean only a fingerprint image of a finger, but may include a contact image of an object other than a finger.

[0130] FIG. 12 illustrates a fingerprint image, wherein (1) shows a state where the fingerprint is in good contact with the center of the display area, and (2) shows a state where the fingerprint is off to one side. For example, when a fingerprint image (FI) is acquired, the processor (1120) acquires a fingerprint feature point (FP) and can generate driving data to drive a light source and a detector within a predetermined range centered on the acquired fingerprint feature point (FP). As another example, when the fingerprint feature point (FP) is off to one side as in (2) of FIG. 12, the processor (1120) can display guide information through the display device (1110) to instruct the user to contact the object again instead of driving the light source and detector near the fingerprint feature point (FP).

[0131] Meanwhile, the fingerprint sensor (1130) may be an ultrasonic-based ultrasonic sensor. The ultrasonic sensor can detect additional information, such as contact load distribution, ultrasonic pulse wave signals and / or blood flow signals, in addition to fingerprint detection when the user's subject comes into contact. The processor (1120) can estimate biometric information using the optical signal obtained through the display device (1110) and the additional information obtained through the ultrasonic sensor.

[0132] FIG. 13 is a block diagram of an electronic device according to another embodiment.

[0133] Referring to FIG. 13, the electronic device (1300) may include a display device (1310), a processor (1320), a storage unit (1330), and a communication unit (1340). Various functions of the aforementioned electronic devices (600, 900, 1100) may be performed in the electronic device (1300) of the present embodiment. Accordingly, the electronic device (1300) may further include the force sensor of FIG. 9 and the fingerprint sensor configuration of FIG. 11.

[0134] The display device (1310) can operate in a first mode or a third mode under the control of the processor (1320) to output various processing results of the processor (1300). For example, the display device (1310) can visually output biometric information estimates and / or guide information. In addition, if the biometric information estimates fall outside the normal range, warning information can be output in various ways, such as highlighting using red color, displaying the normal range together, outputting a voice warning message, or adjusting the vibration intensity.

[0135] Meanwhile, the electronic device (1300) may include non-visual output means such as a speaker module or a haptic module in addition to the display device (1310), and may output in a non-visual manner such as voice, vibration, or touch through the non-visual output means.

[0136] The storage unit (1330) can store the processing results of the processor (1320). Additionally, the storage unit (1330) can store various reference information necessary for the analysis of an object, including biometric information estimation. For example, the reference information may include user characteristic information such as the user's age, gender, and health status. Additionally, the reference information may include various information such as a biometric information estimation model, biometric information estimation criteria, and display device mode switching criteria. However, it is not limited thereto.

[0137] At this time, the storage unit (1330) includes a storage medium such as a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, a magnetic disk, an optical disk, etc., but is not limited thereto.

[0138] The communication unit (1340) can communicate with an external device and transmit and receive various data using wired or wireless communication technology under the control of the processor (1320). For example, the communication unit (1340) can transmit the biometric information estimation results to an external device and receive various reference information required for biometric information estimation from the external device. At this time, the external device may include an information processing device such as a cuff-type blood pressure measuring device, a smartphone, a tablet PC, a desktop PC, and a laptop PC.

[0139] At this time, communication technologies may include Bluetooth communication, BLE (Bluetooth Low Energy) communication, Near Field Communication (NFC), WLAN communication, Zigbee communication, Infrared Data Association (IrDA) communication, WFD (Wi-Fi Direct) communication, UWB (ultra-wideband) communication, Ant+ communication, WIFI communication, RFID (Radio Frequency Identification) communication, 3G communication, 4G communication, and 5G communication, etc. However, they are not limited thereto.

[0140] FIG. 14 is a flowchart of a method for estimating biometric information by an electronic device according to one embodiment. FIG. 14 is an embodiment of a method for estimating biometric information by the electronic device of FIG. 6, FIG. 9, FIG. 11, and FIG. 13. As it has been explained in detail above, it will be described briefly below.

[0141] First, the electronic device may receive a request related to a display device (1410). The request related to the display device may be received from a user or an external device. Hereinafter, for convenience of explanation, requests related to the display device will be described by dividing them into requests for biometric information estimation that acquire an optical signal and other requests for image display.

[0142] Next, the mode of the display device can be determined based on a received request related to the display device (1420). For example, if a request for image display is received in step (1410), the display device can be determined to be the first mode, which is the basic mode. Alternatively, if a request for biometric information estimation is received in step (1410), the mode of the display device can be determined to be either the second mode or the third mode according to a user's request or a preset standard. At this time, the preset standard is set based on the performance and type of the electronic device, the performance and / or type of the display device, etc. For example, if the size of the display device is small, it may be set to the second mode, which acquires only optical signals, and if the size of the display device is relatively large, it may be set to the third mode, which performs image display and optical signal acquisition simultaneously.

[0143] Next, if the first mode is determined in step (1420), the display device is switched to the first mode (1431) and image data can be displayed on the display device (1432).

[0144] If the second mode is determined in step (1420), the display device is switched to the second mode (1441), and the display device can measure an optical signal from the object (1442). At this time, before switching to the second mode, the display device displays guide information for measuring the pulse wave signal while maintaining the first mode, and after a predetermined time, switches to the second mode to measure the optical signal. If the third mode is determined in step (1420), the display device is switched to the third mode (1451), image data including guide information is displayed in a part area of ​​the display device, and an optical signal can be measured in the remaining area of ​​the display device (1452).

[0145] Meanwhile, the step (1442, 1542) of acquiring an optical signal in the second mode or third mode may acquire a first optical signal for estimating bio-information by driving one or more pairs of light sources and detectors within a first region in which the object contacts. At this time, the first optical signal may also be acquired while acquiring a second optical signal by driving a plurality of pairs of light sources and detectors within a second region including the first region.

[0146] Next, bio-information can be estimated based on the first optical signal measured in steps (1442, 1452) (1460). If a plurality of second optical signals are obtained along with the first optical signal in steps (1442, 1452), the first optical signal can be corrected based on the second optical signals, and bio-information can be estimated based on the corrected first optical signal.

[0147] Meanwhile, the present embodiments can be implemented as computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all types of recording devices in which data that can be read by a computer system is stored.

[0148] Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage devices, etc., and also include implementation in the form of a carrier wave (e.g., transmission over the Internet). Furthermore, computer-readable recording media may be distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing these embodiments can be easily inferred by programmers in the art to which the present invention belongs.

[0149] Those skilled in the art to which this disclosure pertains will understand that the disclosed technical concept or essential features may be implemented in other specific forms without altering them. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. Explanation of the symbols

[0150] 100: Display device 110: Display unit 120: Control unit 130: Light source driver 140: Data driver 150: Detector driver 160: Conversion section 600,900,1100,1300: Electronic device 610,910,1110,1310: Display device 620,920,1120,1320: Processors 930: Force sensor 1130: Fingerprint sensor 1330: Storage unit 1340: Communication unit

Claims

Claim 1 A display unit formed by an array of unit pixels including a light source pixel and a detector pixel; a control driver including a light source driver and a data driver connected to each light source pixel, and a detector driver connected to each detector pixel; a control unit that operates the display unit in a first mode, a second mode, or a third mode through the control driver; and a converter unit that is activated by the control unit when the display unit operates in the second mode or the third mode, and receives a light signal from a detector of the display unit and converts it into a digital signal, wherein the converter unit includes an analog-digital converter (ADC) connected to the output of each detector of the unit pixel array, and the inputs of the detectors of the unit pixel array are independently connected to the detector driver. Claim 2 A display device according to claim 1, wherein the light source pixel comprises one or more LED (light emitting diode) pixels that irradiate light of one or more wavelengths, and the detector pixel comprises a PD (photodiode) pixel that receives light scattered or reflected from an object and converts it into an electrical signal. Claim 3 A display device according to paragraph 2, wherein each LED pixel has a 2-transistor 1-capacitor structure, and the PD pixel has a 4-transistor or 3-transistor structure. Claim 4 A display device according to claim 1, wherein the control unit, when driving data corresponding to the first mode is input, disables the detector driver and drives each light source of the display unit through the light source driver and the data driver based on the driving data to display an image. Claim 5 In paragraph 4, the driving data comprises at least one of the driving sequence, wavelength, and duration of the light source of the unit pixel array. Claim 6 A display device according to claim 1, wherein the control unit activates the detector driver when driving data corresponding to the second mode is input, and drives the light source and detector of the display unit through the light source driver, data driver, and detector driver based on the driving data to acquire a light signal from an object. Claim 7 In paragraph 6, the driving data includes the position, wavelength, and duration of the light source to be driven, and the position of the detector to be driven. Claim 8 A display device according to claim 1, wherein the control unit, when driving data corresponding to a third mode is input, activates a detector driver, and drives a light source and a detector of a display unit through a light source driver, a data driver, and a detector driver based on the driving data to output an image in a first area of ​​the display unit and acquire a light signal in a second area. Claim 9 A display device according to claim 8, wherein the driving data includes the driving order, wavelength, and duration of each light source of a unit pixel array included in the first region, and includes the position, wavelength, duration, and position of a detector to be driven in the second region. Claim 10 delete Claim 11 delete Claim 12 delete Claim 13 delete Claim 14 delete Claim 15 An electronic device comprising an array of unit pixels including a light source pixel and a detector pixel, and operating in a first mode for displaying an image, a second mode for acquiring a light signal, or a third mode for displaying an image and acquiring a light signal; a processor for determining the mode of the display device and controlling the operation of the display device according to the determined mode; and a fingerprint sensor for acquiring fingerprint data of an object when the object contacts the display device, wherein the processor analyzes the contact position of the object based on the fingerprint data and controls the display device to acquire a light signal or display guide information based on the analysis result, and wherein the processor acquires fingerprint feature points based on the fingerprint data and determines a light source and a detector to be driven for acquiring the light signal based on the acquired fingerprint feature points. Claim 16 An electronic device according to claim 15, wherein the processor sets the first mode as the default mode and switches to the second mode or the third mode when a request for analysis of an object is received. Claim 17 In paragraph 16, the electronic device wherein the processor selects either a second mode or a third mode based on at least one of a user's request, the size and performance of the display device when a request for analysis of an object is received. Claim 18 An electronic device according to claim 15, wherein, when the processor is determined to be in the second mode, the display device is controlled to operate in the first mode to display guide information for acquiring an optical signal, and after a predetermined time, the display device is controlled to operate in the second mode to acquire an optical signal from an object. Claim 19 In paragraph 15, the above processor is an electronic device that, when determined to be in the third mode, displays guide information for acquiring an optical signal or an analysis result of an object in a first area of ​​a display device and controls the acquisition of an optical signal in a second area. Claim 20 An electronic device according to claim 15, wherein the processor controls a display device to acquire a first optical signal from an object when the second mode or third mode is determined, and controls the display device to acquire a second optical signal for analysis of the object by analyzing the contact position of the object based on the acquired first optical signal. Claim 21 delete Claim 22 delete Claim 23 delete Claim 24 In claim 15, the electronic device wherein, when an optical signal is acquired from an object according to the second mode or third mode, the processor analyzes the object based on the acquired optical signal and performs at least one of biometric information estimation, fingerprint authentication, document scanning, and image scanning. Claim 25 A display device comprising an array of unit pixels including a light source pixel and a detector pixel, and operating in a first mode for displaying an image, a second mode for acquiring an optical signal, or a third mode for displaying an image and acquiring an optical signal; and a processor comprising, when a request for biometric information estimation is received, controlling the display device to operate in the second mode or the third mode to acquire a first optical signal from a target, and estimating biometric information based on the acquired first optical signal, wherein the display device comprises: a display unit formed by an array of unit pixels including a light source pixel and a detector pixel; a control driver comprising a light source driver and a data driver connected to each light source pixel, and a detector driver connected to each detector pixel; and a control unit that operates the display unit in the first mode, the second mode, or the third mode through the control driver. An electronic device comprising a converter that is activated by the control unit when the display unit operates in a second mode or a third mode, and receives an optical signal from a detector of the display unit and converts it into a digital signal, wherein the converter comprises an analog-digital converter (ADC) connected to the output of each detector of the unit pixel array, and the inputs of the detectors of the unit pixel array are independently connected to the detector driver. Claim 26 In paragraph 25, the display device is an electronic device that acquires a first light signal by driving one or more pairs of light sources and detectors within a first area in which an object contacts. Claim 27 In paragraph 26, the processor is an electronic device that determines a pair of light sources and detectors within the first region based on a predetermined reference point within the first region. Claim 28 An electronic device according to claim 27, wherein the predetermined reference point comprises at least one of the fingerprint feature points obtained based on the center point of a first region and fingerprint data resulting from contact with the object. Claim 29 In claim 26, the display device is an electronic device that acquires a first light signal while acquiring a plurality of second light signals by driving a plurality of light source and detector pairs within a second region including the first region. Claim 30 In claim 29, the processor corrects the first optical signal based on the second optical signal and is an electronic device that estimates bio-information based on the corrected first optical signal. Claim 31 An electronic device according to claim 25, further comprising a force sensor that measures the contact force when an object contacts and presses against a display device. Claim 32 In claim 31, the processor is an electronic device that obtains a contact area based on the magnitude of the amount of light received by the detector pixel when an object contacts a display device, obtains a contact pressure based on the contact force and the contact area, and estimates bio-information based on the contact pressure and the light signal. Claim 33 In claim 25, the above bio-information is an electronic device comprising one or more of blood pressure, vascular age, degree of arteriosclerosis, aortic pressure waveform, vascular elasticity, stress index, fatigue level, skin elasticity, skin age, triglycerides, cholesterol, blood sugar, and antioxidant index.

Images