Display device and method of operating the same

Abstract

The invention discloses a display device and a method of operating the same. The display device includes: a display panel including a plurality of pixels; and a panel driver driving the display panel. The pixels include adjacent horizontal pixel groups including first to second pixel rows and adjacent vertical pixel groups including first to second pixel columns. The pixels include an emission pixel including a light emitting element and a light sensing pixel including a photodiode. The panel driver drives the display panel to display a first guide image that guides a user to place a finger on a first sensing area and a second sensing area of the display panel. The light sensing pixel outputs a sensing current that generates a photoplethysmography (PPG) signal by sensing a finger of a user. The first sensing region and the second sensing region are displayed on one of an adjacent horizontal pixel group and an adjacent vertical pixel group.

Description

Technical Field

[0001] Embodiments of the inventive concept relate to a display device. More specifically, embodiments of the inventive concept relate to a display device providing a biomarker and a method of operating the display device. Background Art

[0002] Electronic devices such as smart phones and smart watches that perform biosensing operations (such as fingerprint sensing operations, photoplethysmography (PPG) sensing operations, etc.) are being developed. Generally, an electronic device can perform a biosensing operation by using a sensor separate from a display device. In this case, the size of a display area of the electronic device or the display device may be reduced and the size of a bezel may be increased.

[0003] To address this situation, in-cell optical sensor technology that employs an optical sensor or a photosensing pixel within a display area of a display device has recently been developed. Summary of the Invention

[0004] Some embodiments provide a method of operating a display device to provide a biomarker.

[0005] Some embodiments provide a display device providing a biomarker.

[0006] According to an embodiment, a display device includes: a display panel including a plurality of pixels; and a panel driver driving the display panel. The pixels include an adjacent horizontal pixel group including first to second pixel rows and an adjacent vertical pixel group including first to second pixel columns. The pixels include emission pixels including light-emitting elements and photosensing pixels including photodiodes. The panel driver drives the display panel such that the display panel displays a first guide image that guides a user to place a finger on a first sensing area and a second sensing area of the display panel. The photosensing pixels output sensing currents that generate a photoplethysmography (PPG) signal by sensing the user's finger. The first sensing area and the second sensing area are displayed on one of the adjacent horizontal pixel group and the adjacent vertical pixel group.

[0007] In an embodiment, the first sensing area and the second sensing area are displayed on the adjacent vertical pixel group.

[0008] In an embodiment, the panel driver includes: a gate driver applying gate signals to the display panel through a plurality of gate lines; and a photosensing driver receiving sensing currents from the pixels through a plurality of sensing lines. The gate lines include an adjacent gate line group including first to second gate lines. The sensing lines include an adjacent sensing line group including first to second sensing lines. The adjacent vertical pixel group is connected to the adjacent sensing line group.

[0009] In an embodiment, the light sensing driver receives a sensing current from an adjacent sensing line group connected to an adjacent vertical pixel group.

[0010] In an embodiment, the sensing lines include first to p-th sensing lines, where p is a positive integer. The first to p-th sensing lines are sequentially arranged in the display panel. The adjacent sensing line group includes at least two adjacent sensing lines among the first to p-th sensing lines.

[0011] In an embodiment, the gate lines extend in a first direction, and the sensing lines extend in a second direction different from the first direction.

[0012] In an embodiment, the panel driver drives the display panel such that the display panel displays a second guiding image that guides a user to place a finger on a first sensing area, a second sensing area, a third sensing area, and a fourth sensing area of the display panel. The third sensing area and the fourth sensing area are displayed on an adjacent vertical pixel group.

[0013] In an embodiment, the first sensing area and the second sensing area are displayed on an adjacent horizontal pixel group.

[0014] In an embodiment, the panel driver includes: a gate driver that applies gate signals to the display panel through a plurality of gate lines; and a light sensing driver that receives a sensing current from pixels through a plurality of sensing lines. The gate lines include adjacent gate line groups. The sensing lines include adjacent sensing line groups. The adjacent horizontal pixel groups are connected to the adjacent gate line groups.

[0015] In an embodiment, the light sensing driver receives a sensing current from a sensing line connected to an adjacent horizontal pixel group.

[0016] In an embodiment, the gate lines include first to n-th gate lines, where n is a positive integer. The first to n-th gate lines are sequentially arranged in the display panel. The adjacent gate line group includes at least two adjacent gate lines among the first to n-th gate lines.

[0017] In an embodiment, the gate lines extend in a first direction, and the sensing lines extend in a second direction different from the first direction.

[0018] In an embodiment, the panel driver drives the display panel such that the display panel displays a third guiding image that guides a user to place a finger on a first sensing area, a second sensing area, a third sensing area, and a fourth sensing area of the display panel. The third sensing area and the fourth sensing area are displayed on an adjacent horizontal pixel group.

[0019] In an embodiment, the panel driver drives the display panel in a horizontal mode or a vertical mode. When the panel driver drives the display panel in the horizontal mode, the panel driver converts the display panel from the horizontal mode to the vertical mode in response to receiving an application start signal to display a first guiding image in the vertical mode.

[0020] According to an embodiment, a method of operating a display device includes: displaying a guide image that guides a user to place a first finger and a second finger on a first sensing area and a second sensing area, respectively, where the first sensing area and the second sensing area are displayed on one of an adjacent horizontal pixel group including first to second pixel rows and an adjacent vertical pixel group including first to second pixel columns; when the first finger and the second finger are respectively located on the first sensing area and the second sensing area, generating a PPG signal by performing a photoplethysmogram (PPG) sensing operation; and displaying a biomarker of the user determined based on the PPG signal.

[0021] In an embodiment, the method further includes: when driving the display device in a horizontal mode, converting the mode of the display device from the horizontal mode to a vertical mode in response to receiving an application start signal, and displaying the first sensing area and the second sensing area on the adjacent horizontal pixel group in the vertical mode.

[0022] In an embodiment, the first sensing area and the second sensing area are displayed on an adjacent vertical pixel group.

[0023] In an embodiment, the adjacent vertical pixel group includes at least two adjacent pixel columns among the first to p pixel columns, where p is a positive integer.

[0024] In an embodiment, the first sensing area and the second sensing area are displayed on an adjacent horizontal pixel group.

[0025] In an embodiment, the adjacent horizontal pixel group includes at least two adjacent pixel rows among the first to n pixel rows, where n is a positive integer.

[0026] As described above, in a display device according to an embodiment, the display device can sense a user's finger to generate a biomarker of the user based on a photoplethysmogram (PPG) signal. To generate the PPG signal, a plurality of sensing areas are displayed. The sensing areas are displayed on one of an adjacent horizontal pixel group and an adjacent vertical pixel group. Accordingly, the accuracy of the PPG signal is improved. In addition, the display device can sense the user's finger through the plurality of sensing areas, which further improves the accuracy of the biomarker. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a block diagram of a display device according to an embodiment of the inventive concept.

[0028] Figure 2 ILLUSTRATED BY Figure 1 an example of a photoplethysmogram (PPG) sensing operation performed by the display device.

[0029] Figure 3 ILLUSTRATED IN Figure 1Examples of biomarkers displayed on the display panel.

[0030] Figure 4 is Figure 1 An example of a circuit diagram of an emission pixel and a photosensing pixel in a pixel.

[0031] Figure 5 The figure shows an example of a guide image output by Figure 1 the display device.

[0032] Figure 6 is Figure 5 A block diagram of a display panel, a gate driver, and a photosensing driver that output a guide image.

[0033] Figure 7 The figure shows an example of a guide image output by Figure 1 the display device.

[0034] Figure 8 is Figure 7 A block diagram of a display panel, a gate driver, and a photosensing driver that output a guide image.

[0035] Figure 9A and Figure 9B is Figure 7 A graph of a PPG signal generated from a guide image.

[0036] Figure 10A and Figure 10B respectively show Figure 1 the vertical mode and the horizontal mode of the display device.

[0037] Figure 11 The figure shows Figure 1 the mode conversion of the display device.

[0038] Figure 12 The figure shows an example of a guide image output by Figure 1 the display device.

[0039] Figure 13 The figure shows an example of a guide image output by Figure 1 the display device.

[0040] Figure 14 A flowchart of a method for generating a biomarker.

[0041] Figure 15 A flowchart of a method for generating a biomarker.

[0042] Figure 16 A block diagram of an electronic device according to an embodiment of the inventive concept.

[0043] Figure 17 The figure shows where Figure 16The electronic device is implemented as an example of a smart phone. Detailed Description of the Invention

[0044] Hereinafter, embodiments of the inventive concept will be described in detail with reference to the accompanying drawings.

[0045] Figure 1 is a block diagram of a display device according to an embodiment of the inventive concept. Figure 2 The illustration is by Figure 1 an example of a photoplethysmogram sensing operation performed by the display device. Figure 3 The illustration is of Figure 1 an example of a biomarker displayed on the display panel.

[0046] Referring to Figure 1 , in an embodiment, the display device includes a display panel 100 including a plurality of pixels PX and a panel driver for driving the display panel 100. In an embodiment, the panel driver includes a gate driver 300 connected to the pixels PX through a plurality of gate lines GL, a data driver 500 connected to the pixels PX through a plurality of data lines DL, an emission driver 600 connected to the pixels PX through a plurality of emission lines EL, a light sensing driver 700 connected to the pixels PX through a plurality of sensing lines SL, and a driving controller 200 for controlling the gate driver 300, the data driver 500, the emission driver 600, and the light sensing driver 700.

[0047] The display panel 100 includes gate lines GL, data lines DL, emission lines EL, sensing lines SL, and pixels PX connected to the gate lines GL, data lines DL, emission lines EL, and sensing lines SL. In some embodiments, the display panel 100 is an organic light emitting diode (OLED) display panel or a quantum dot (QD) display panel, but embodiments of the inventive concept are not necessarily limited thereto.

[0048] In an embodiment, the gate lines GL extend in a first direction D1. The sensing lines SL extend in a second direction D2 intersecting the first direction D1.

[0049] In an embodiment, the pixel PX includes an emission pixel EE_PX including a light emitting element EE and a light sensing pixel OPD_PX including a photodiode, which may be an organic photodiode OPD, for example.

[0050] The display device includes a display panel 100, a driving controller 200, a gate driver 300, a gamma reference voltage generator 400, a data driver 500, an emission driver 600, and a light sensing driver 700. In an embodiment, the driving controller 200 and the data driver 500 are implemented as a single integrated circuit.

[0051] The display panel 100 includes a display area on which an image is displayed and a peripheral area adjacent to the display area. In an embodiment, the gate driver 300 is disposed in the peripheral area. In an embodiment, the gate driver 300 is integrated in the peripheral area.

[0052] The display panel 100 includes gate lines GL, data lines DL, emission lines EL, and pixels PX electrically connected to the gate lines GL, the data lines DL, and the emission lines EL. The gate lines GL and the data lines DL extend in directions crossing each other.

[0053] The driving controller 200 receives input image data IMG, an application turn-on signal APPON, and an input control signal CONT from a main processor such as an application processor and / or a graphics processing unit. In an embodiment, the input image data IMG includes red image data, green image data, and blue image data. In an embodiment, the input image data IMG further includes white image data. In an embodiment, the input image data IMG may include magenta image data, yellow image data, and cyan image data. The input control signal CONT includes a main clock signal and a data enable signal. The input control signal CONT further includes a vertical synchronization signal and a horizontal synchronization signal.

[0054] In an embodiment, the input image data IMG for sensing a user's finger includes data of a guide image that guides the user to place a finger on a first sensing area and a second sensing area of the display panel 100. The driving controller 200 outputs a data signal that causes the guide image to be output in response to the application turn-on signal APPON.

[0055] The driving controller 200 generates a first control signal CONT1, a second control signal CONT2, a third control signal CONT3, a fourth control signal CONT4, a fifth control signal CONT5, and a data signal DATA based on the input image data IMG and the input control signal CONT.

[0056] The driving controller 200 generates a first control signal CONT1 for controlling the operation of the gate driver 300 based on the input control signal CONT, and outputs the first control signal CONT1 to the gate driver 300. The first control signal CONT1 includes a vertical start signal and a scan clock signal.

[0057] The driving controller 200 generates a third control signal CONT3 for controlling the operation of the gamma reference voltage generator 400 based on the input control signal CONT, and outputs the third control signal CONT3 to the gamma reference voltage generator 400.

[0058] The driving controller 200 generates a second control signal CONT2 for controlling the operation of the data driver 500 based on the input control signal CONT, and outputs the second control signal CONT2 to the data driver 500. The second control signal CONT2 includes a horizontal start signal and a load signal.

[0059] The driving controller 200 generates a data signal DATA based on the input image data IMG and the input control signal CONT. The driving controller 200 outputs the data signal DATA to the data driver 500.

[0060] The driving controller 200 generates a fourth control signal CONT4 for controlling the operation of the emission driver 600 based on the input control signal CONT. The driving controller 200 outputs the fourth control signal CONT4 to the emission driver 600.

[0061] The driving controller 200 generates a fifth control signal CONT5 based on the input control signal CONT. The driving controller 200 outputs the fifth control signal CONT5 to the photosensing driver 700.

[0062] The gate driver 300 generates a gate signal for driving the gate line GL in response to the first control signal CONT1 received from the driving controller 200. The gate driver 300 outputs the gate signal to the gate line GL.

[0063] The gamma reference voltage generator 400 generates a gamma reference voltage VGREF in response to the third control signal CONT3 received from the driving controller 200. The gamma reference voltage generator 400 provides the gamma reference voltage VGREF to the data driver 500. The gamma reference voltage VGREF has a value corresponding to each of the data signals DATA. The gamma reference voltage generator 400 is provided in the driving controller 200 or in the data driver 500.

[0064] The data driver 500 receives the second control signal CONT2 and the data signal DATA from the driving controller 200, and receives the gamma reference voltage VGREF from the gamma reference voltage generator 400. The data driver 500 converts the data signal DATA into an analog data voltage VDATA using the gamma reference voltage VGREF. The data driver 500 outputs the data voltage VDATA to the data line DL.

[0065] In an embodiment, the data driver 500 is implemented using one or more integrated circuits. In an embodiment, the data driver 500 and the driving controller 200 are implemented as a single integrated circuit, and the single integrated circuit may be referred to as a timing controller embedded data driver (TED).

[0066] The emission driver 600 generates an emission signal for driving the emission line EL in response to a fourth control signal CONT4 received from the driving controller 200. The emission driver 600 outputs the emission signal to the emission line EL.

[0067] In an embodiment of the inventive concept, the emission driver 600 is integrated in the peripheral area of the display panel 100. In an embodiment of the inventive concept, the emission driver 600 is mounted in the peripheral area of the display panel 100.

[0068] Although, for ease of explanation Figure 1 it is shown that the gate driver 300 is disposed on a first side of the display panel 100 and the emission driver 600 is disposed on a second side of the display panel 100, embodiments of the inventive concept are not necessarily limited thereto. In some embodiments, the gate driver 300 and the emission driver 600 are disposed on the first side of the display panel 100. For example, the gate driver 300 and the emission driver 600 are disposed in a peripheral area of the display panel 100 that is on the same side of the display area of the display panel 100. For example, the gate driver 300 and the emission driver 600 are integrally formed with each other.

[0069] In an embodiment, the light sensing driver 700 receives a fifth control signal CONT5 from the driving controller 200. The display panel 100 further includes a sensing line SL, and the pixel PX is further connected to the sensing line SL. The light sensing driver 700 generates a sensing current by sensing the pixel PX via the sensing line SL. In an embodiment, the light sensing driver 700 is implemented with one or more integrated circuits. In an embodiment, the light sensing driver 700 is disposed in the data driver 500 or the driving controller 200.

[0070] In an embodiment, the panel driver performs a photoplethysmogram (PPG) sensing operation using the display panel 100. The PPG sensing operation includes causing the emission pixel EE_PX to emit light and causing the light sensing pixel OPD_PX to sense light reflected from the blood vessel 2100 of the user's finger 2000. For example, when the user's heart contracts and the volume of the blood vessel 2100 increases, the amount of hemoglobin in the blood vessel 2100 increases, the intensity of the light absorbed by the hemoglobin increases, and the light sensing pixel OPD_PX measures reflected light of a relatively low light intensity. Conversely, when the user's heart dilates (or relaxes) and the volume of the blood vessel 2100 decreases, the amount of hemoglobin in the blood vessel 2100 decreases, the intensity of the light absorbed by the hemoglobin decreases, and the light sensing pixel OPD_PX measures reflected light of a relatively high light intensity. The light sensing driver 700 generates a PPG signal PPGD indicating the volume of the blood vessel 2100 based on the light intensity measured by the light sensing pixel OPD_PX. In an embodiment, the pixel PX outputs a sensing current to the light sensing driver 700 to generate the PPG signal PPGD.

[0071] In an embodiment, a biomarker is generated based on a PPG signal PPGD generated by a light sensing driver 700.

[0072] In an embodiment, the display panel 100 displays a guiding image for sensing a user's finger 2000. A PPG signal PPGD corresponding to each of the fingers 2000 is generated, and the accuracy of the biomarker is improved.

[0073] As biomarkers, the display panel 100 displays a user's blood pressure BP, heart rate HR, stress level STL, and cardiovascular health CH. For example, the blood pressure BP is determined by detecting the characteristics of the PPG signal PPGD and performing machine learning on the characteristics of the PPG signal PPGD. The heart rate HR is determined based on the period of the PPG signal PPGD. The stress level STL is determined based on the change in the period of the PPG signal PPGD. The cardiovascular health CH is determined based on the peak time of the PPG signal PPGD or the difference in blood pressure between the left and right fingers. In other embodiments, as biomarkers, the display panel 100 further displays a respiration rate, vascular age (or vascular elasticity), and oxygen saturation. For example, the respiration rate can be determined based on the period of the low-frequency component of the PPG signal PPGD, the vascular age can be determined based on the waveform of the PPG signal PPGD, and the oxygen saturation can be determined by the intensity difference between the green reflected light and the red reflected light.

[0074] Figure 4 is Figure 1 An example of a circuit diagram of an emission pixel EE_PX and a light sensing pixel OPD_PX in a pixel PX of

[0075] Reference Figure 4 FIG., in an embodiment, the emission pixel EE_PX includes: a first transistor T1 that generates a driving current; a second transistor T2 that outputs the data line DL in response to a write signal GW[n], Figure 1A data voltage VDATA; a third transistor T3 that diode - connects the first transistor T1 in response to a compensation signal GC[n]; a fourth transistor T4 that outputs an initialization voltage VINT to the gate electrode of the first transistor T1 in response to an initialization signal GI[n]; a fifth transistor T5 that connects a line of a first power supply voltage ELVDD to the first transistor T1 in response to a transmission signal EM[n]; a sixth transistor T6 that connects the first transistor T1 to a light - emitting element EE in response to a transmission signal EM[n]; a seventh transistor T7 that outputs an anode initialization voltage AINT to the light - emitting element EE in response to a bypass signal GB[n]; an eighth transistor T8 that outputs a bias voltage VOBS to an electrode (e.g., source) of the first transistor T1 in response to a bypass signal GB[n]; a storage capacitor CST connected between the line of the first power supply voltage ELVDD and the gate electrode of the first transistor T1; and a light - emitting element EE that emits light based on a drive current and has a cathode connected to a line of a second power supply voltage ELVSS.

[0076] According to an embodiment, the light - emitting element EE includes at least one of an organic light - emitting diode (OLED), a nano - light - emitting diode (NED), a quantum dot (QD) light - emitting diode, a micro - light - emitting diode, an inorganic light - emitting diode, or any other suitable light - emitting element. In some embodiments, as Figure 4 illustrated, the first transistor T1, the second transistor T2, the fifth transistor T5, the sixth transistor T6, the seventh transistor T7, and the eighth transistor T8 are P - type metal - oxide semiconductor (PMOS) transistors, and the third transistor T3 and the fourth transistor T4 are N - type metal - oxide semiconductor (NMOS) transistors, but the embodiment is not necessarily limited thereto.

[0077] Furthermore, as Figure 4 illustrated, the photosensing pixel OPD_PX includes a ninth transistor T9, a tenth transistor T10, an eleventh transistor T11, and an organic photodiode OPD.

[0078] The ninth transistor T9 generates a sensing current based on the voltage of the anode of the organic photodiode OPD. In some embodiments, the ninth transistor T9 includes a gate electrode connected to the anode of the organic photodiode OPD, a first electrode receiving a reference voltage VREF, and a second electrode.

[0079] The tenth transistor T10 resets the voltage of the anode of the organic photodiode OPD to a reset voltage VRST in response to a global reset signal GR. In some embodiments, the tenth transistor T10 includes a gate electrode receiving the global reset signal GR, a first electrode receiving the reset voltage VRST, and a second electrode connected to the anode of the organic photodiode OPD.

[0080] The eleventh transistor T11 outputs the sensing current generated by the ninth transistor T9 to the sensing line SL in response to the write signal GW[n]. In some embodiments, the eleventh transistor T11 includes a gate electrode that receives the write signal GW[n], a first electrode connected to the second electrode of the ninth transistor T9, and a second electrode connected to the sensing line SL.

[0081] The organic photodiode OPD measures the light intensity. For example, after resetting the voltage of the anode of the organic photodiode OPD to the reset voltage VRST, the voltage of the anode of the organic photodiode OPD can increase by different amounts depending on the light intensity. The sensing current of the ninth transistor T9 is determined according to the voltage of the anode of the organic photodiode OPD, and the light sensing driver 700 generates a PPG signal PPGD corresponding to the sensing current. In some embodiments, the organic photodiode OPD includes an anode connected to the gate electrode of the ninth transistor T9 and a cathode connected to the line of the second power supply voltage ELVSS.

[0082] Although Figure 4 illustrates embodiments of the emission pixel EE_PX and the light sensing pixel OPD_PX, the emission pixel EE_PX and the light sensing pixel OPD_PX of the display device according to the embodiments do not have to be limited to Figure 4 the embodiments, and have other structures in other embodiments.

[0083] Figure 5 An example of the guide image CASE1 output by Figure 1 the display device is illustrated. Figure 6 is a block diagram of the display panel 100, the gate driver 300, and the light sensing driver 700 that output Figure 5 the guide image CASE1.

[0084] Referring to Figure 1 、 Figure 5 and Figure 6 , in an embodiment, the pixel PX includes adjacent vertical pixel groups.

[0085] For example, the adjacent vertical pixel groups can be defined as a plurality of adjacent pixel columns. For example, the pixel columns include the first to the p-th pixel columns, where p is a positive integer. The adjacent vertical pixel groups include the first to the third pixel columns. However, the embodiments of the inventive concept do not have to be limited to this number of pixel columns in the adjacent vertical pixel groups. For example, in some embodiments, the adjacent vertical pixel groups include the first to the fifth pixel columns. In addition, the embodiments of the inventive concept do not have to be limited to this position of the adjacent vertical pixel groups. For example, in some embodiments, the adjacent vertical pixel groups include the (p - 7)-th to the p-th pixel columns.

[0086] In an embodiment, adjacent vertical pixel groups are connected to adjacent sensing line groups. For example, the adjacent sensing line groups may be defined as a plurality of adjacent sensing lines. The sensing lines include first through p-th sensing lines SL[1] through SL[p]. For example, when the adjacent vertical pixel groups include first through third pixel columns, the adjacent sensing line groups include first through third sensing lines. However, embodiments of the inventive concept are not necessarily limited to this number of pixel columns or this position of the pixel columns included in the adjacent vertical pixel groups, such that embodiments of the inventive concept are not necessarily limited to this number of sensing lines in the adjacent sensing line groups or this position of the sensing lines in the adjacent sensing line groups.

[0087] In an embodiment, some pixels in adjacent vertical pixel groups display a first sensing area PT1A and a second sensing area PT2A. For example, the first sensing area PT1A senses a first finger of a user. For example, the second sensing area PT2A senses a different second finger of the user. The light sensing driver 700 receives a sensing current from the adjacent sensing line groups connected to the adjacent vertical pixel groups.

[0088] In an embodiment, the first sensing area PT1A and the second sensing area PT2A are displayed on the adjacent sensing line groups such that adjacently placed (or disposed) sensing lines SL output sensing currents. Accordingly, the accuracy of the sensing current is improved, which improves the accuracy of the PPG signal PPGD. Accordingly, the accuracy of the biomarker can be improved.

[0089] Figure 7 The illustration shows an example of a guidance image CASE2 output by Figure 1 the display device. Figure 8 is a block diagram of a display panel 100, a gate driver 300, and a light sensing driver 700 that output Figure 7 the guidance image CASE2.

[0090] Referring to Figure 1 , Figure 7 and Figure 8 , in an embodiment, a pixel PX includes adjacent horizontal pixel groups.

[0091] For example, the adjacent horizontal pixel groups may be defined as a plurality of adjacent pixel rows. For example, the pixel rows include first through n-th pixel rows, where n is a positive integer. The adjacent horizontal pixel groups include first through third pixel rows. However, embodiments of the inventive concept are not necessarily limited to this number of pixel rows in the adjacent horizontal pixel groups. For example, in some embodiments, the adjacent horizontal pixel groups include first through fifth pixel rows. In addition, embodiments of the inventive concept are not necessarily limited to this position of the adjacent horizontal pixel groups. For example, in some embodiments, the adjacent horizontal pixel groups include (n - 7)-th through n-th pixel rows.

[0092] In an embodiment, adjacent horizontal pixel groups are connected to adjacent gate line groups. For example, the adjacent gate line groups may be defined as multiple adjacent gate lines. The gate lines include first through n-th gate lines GL[1] to GL[n]. For example, when the adjacent horizontal pixel groups include first through third pixel rows, the adjacent gate line groups include first through third gate lines. However, embodiments of the inventive concept are not necessarily limited to this number of pixel rows or this position of the pixel rows in the adjacent horizontal pixel groups, such that embodiments of the inventive concept are not necessarily limited to this number of gate lines or this position of the gate lines in the adjacent gate line groups.

[0093] In an embodiment, some pixels in the adjacent horizontal pixel groups display a first sensing area PT1B and a second sensing area PT2B. For example, the first sensing area PT1B senses a first finger of a user. For example, the second sensing area PT2B senses a different second finger of the user. The optical sensing driver 700 receives a sensing current from a sensing line SL connected to the adjacent horizontal pixel groups.

[0094] In an embodiment, the first sensing area PT1B and the second sensing area PT2B are displayed on the adjacent gate line groups. In an embodiment, the gate signals applied to the gate lines are sequentially output to the first through n-th gate lines GL[1] to GL[n]. Accordingly, the timings of the gate signals applied to the first gate line GL[1] and the n-th gate line GL[n] are different.

[0095] In an embodiment, the first sensing area PT1B and the second sensing area PT2B are displayed on the adjacent gate line groups such that the timings of the gate signals applied to the first sensing area PT1B and the second sensing area PT2B are substantially the same. Accordingly, the influence of the deviation caused by different gate signal timings can be reduced. Accordingly, the accuracy of the sensing current can be improved.

[0096] The accuracy of the sensing current can be improved, which improves the accuracy of the PPG signal PPGD. Accordingly, the accuracy of the biomarker can be improved.

[0097] Figure 9A and Figure 9B is a graph of the PPG signal PPGD generated by the guiding image CASE2 of Figure 7 .

[0098] Refer to Figures 7 to 9B , the X-axis of the first PPG signal graph PT1BG represents time T, and the Y-axis of the first PPG signal graph PT1BG represents the PPG signal PPGD. In addition, the X-axis of the second PPG signal graph PT2BG represents time T, and the Y-axis of the second PPG signal graph PT2BG represents the PPG signal PPGD.

[0099] In an embodiment, the guiding image CASE2 displays a first sensing area PT1B and a second sensing area PT2B on some areas of adjacent horizontal pixel groups. A first PPG signal corresponding to the first sensing area PT1B is generated. A second PPG signal corresponding to the second sensing area PT2B is generated. In addition, the PPG sensing operation is performed by those pixels PX located (or disposed) in the first sensing area PT1B and the second sensing area PT2B. Accordingly, the influence of different gate signal timings of the first PPG signal corresponding to the first finger and the second PPG signal corresponding to the second finger can be reduced. Accordingly, the result of the first PPG signal graph PT1BG and the result of the second PPG signal graph PT2BG are substantially the same.

[0100] Figure 10A and Figure 10B respectively illustrate Figure 1 the vertical mode MODE1 and the horizontal mode MODE2 of the display device.

[0101] Reference Figure 1 、 Figure 10A and Figure 10B In an embodiment, the panel driver drives the display panel 100 in the vertical mode MODE1 or the horizontal mode MODE2.

[0102] For example, when the panel driver drives the display panel 100 in the vertical mode MODE1, the light sensing driver 700 is located at a first position or a second position of the display panel 100. For example, the first position refers to the top of the display panel 100 or the bottom of the display panel 100. For example, the second position refers to the bottom of the display panel 100 or the top of the display panel 100. In addition, when the panel driver drives the display panel 100 in the vertical mode MODE1, the gate driver 300 is located at a third position of the display panel 100. For example, the third position is the side of the display panel 100.

[0103] For example, when the panel driver drives the display panel 100 in the horizontal mode MODE2, the light sensing driver 700 is located at the third position of the display panel 100. In addition, when the panel driver drives the display panel 100 in the horizontal mode MODE2, the gate driver 300 is located at the first position or the second position of the display panel 100.

[0104] Figure 11 Illustrate Figure 1 the mode conversion of the display device.

[0105] Reference Figure 1 、 Figure 8 and Figure 11, in an embodiment, when the panel driver drives the display panel 100 in the horizontal mode MODE2, an application start signal APPON is applied.

[0106] In an embodiment, in response to the application start signal APPON, the panel driver drives the display panel 100 in the vertical mode MODE1 and drives the display panel 100 to display a guiding image CASE2. Accordingly, the display device operates in the vertical mode MODE1 and displays the guiding image CASE2. Accordingly, the first sensing region PT1B and the second sensing region PT2B are displayed on adjacent gate line groups such that the timings of the gate signals applied to the first sensing region PT1B and the second sensing region PT2B are substantially the same. Accordingly, the influence of different gate signal timings is reduced. Accordingly, the accuracy of the sensed current is further improved.

[0107] The accuracy of the sensed current is improved, which improves the accuracy of the PPG signal PPGD. Accordingly, the accuracy of the biomarker is improved.

[0108] Figure 12 An example of the guiding image CASE3 output by the Figure 1 display device is illustrated.

[0109] Referring to Figure 12 , except that the guiding image CASE3 further includes a third sensing region PT3C and a fourth sensing region PT4C, the guiding image CASE3 is substantially the same as the Figure 5 guiding image CASE1 such that the same reference numerals can be used to denote the same elements and the repetitive description of the above elements can be omitted.

[0110] In an embodiment, some pixels in adjacent vertical pixel groups display the third sensing region PT3C and the fourth sensing region PT4C. A third PPG signal corresponding to the user's third finger is generated by the third sensing region PT3C. A fourth PPG signal corresponding to the user's fourth finger is generated by the fourth sensing region PT4C. The first sensing region PT1C, the second sensing region PT2C, the third sensing region PT3C, and the fourth sensing region PT4C are displayed on adjacent sensing line groups. Accordingly, the adjacent sensing lines SL output sensed currents. Accordingly, the accuracy of the sensed current is improved, which improves the accuracy of the PPG signal PPGD. In addition, the number of PPG signals corresponding to fingers (such as the first to fourth fingers) is increased, which further improves the accuracy of the biomarker.

[0111] Figure 13 An example of the guiding image CASE4 output by the Figure 1 display device is illustrated.

[0112] Referring to Figure 13, in an embodiment, except that the guiding image CASE4 further includes a third sensing area PT3D and a fourth sensing area PT4D, the guiding image CASE4 is substantially the same as the guiding image CASE2 of Figure 7 such that the same reference numerals can be used to denote the same elements, and the repetitive description of the above elements can be omitted.

[0113] In an embodiment, some pixels in adjacent horizontal pixel groups display the third sensing area PT3D and the fourth sensing area PT4D. A third PPG signal corresponding to the user's third finger is generated by the third sensing area PT3D. A fourth PPG signal corresponding to the user's fourth finger is generated by the fourth sensing area PT4D. The first sensing area PT1D, the second sensing area PT2D, the third sensing area PT3D, and the fourth sensing area PT4D are displayed on adjacent gate line groups. In an embodiment, the gate signals applied to the gate lines are sequentially output to the first to nth gate lines GL[1] to GL[n]. Accordingly, the timings of the gate signals applied to the first gate line GL[1] and the nth gate line GL[n] are different.

[0114] In an embodiment, the first sensing area PT1D, the second sensing area PT2D, the third sensing area PT3D, and the fourth sensing area PT4D are displayed on adjacent gate line groups such that the timings of the gate signals applied to the first sensing area PT1D, the second sensing area PT2D, the third sensing area PT3D, and the fourth sensing area PT4D are substantially the same. Accordingly, the influence of the deviation caused by different gate signal timings is reduced, which improves the accuracy of the sensed current.

[0115] Accordingly, the accuracy of the sensed current is improved. The accuracy of the sensed current is improved, which improves the accuracy of the PPG signal PPGD. In addition, the number of PPG signals corresponding to fingers (such as the first to fourth fingers) is increased, which further improves the accuracy of the biomarker.

[0116] Figure 14 is a flowchart of a method for generating a biomarker.

[0117] Refer to Figure 14 , the display device for generating a biomarker displays a guiding image that guides the user to place the first finger and the second finger on the first sensing area and the second sensing area respectively, which are displayed on one of the adjacent horizontal pixel groups and the adjacent vertical pixel groups (step S120). When the first finger and the second finger are respectively located on the first sensing area and the second sensing area, the display device generates a PPG signal by performing a PPG sensing operation (step S140). The display device displays the biomarker of the user determined based on the PPG signal (step S160).

[0118] In an embodiment, one of adjacent horizontal pixel groups and adjacent vertical pixel groups displays a first sensing area and a second sensing area. Accordingly, the accuracy of a sensed current is improved. The improvement in the accuracy of the sensed current improves the accuracy of the PPG signal. Accordingly, the accuracy of a biomarker is improved.

[0119] Figure 15 is a flowchart of a method of generating a biomarker.

[0120] Reference Figure 15 , in an embodiment, when a display device for generating a biomarker is driven in a horizontal mode, the display device is switched to a vertical mode, and a first sensing area and a second sensing area are displayed on adjacent horizontal pixel groups (step S220). The display device displays a guide image that guides a user to place a first finger and a second finger on the first sensing area and the second sensing area, respectively, displayed on the adjacent horizontal pixel groups (step S240). When the first finger and the second finger are respectively located on the first sensing area and the second sensing area, the display device generates a PPG signal by performing a PPG sensing operation (step S260). The display device displays a biomarker of the user determined based on the PPG signal (step S280). In an embodiment, instead, the process of switching to the vertical mode and displaying the first sensing area and the second sensing area on adjacent vertical pixel groups (step S220) and the process of displaying the guide image (step S240) may be performed, the guide image guiding the user to place the first finger and the second finger on the first sensing area and the second sensing area, respectively, displayed on the adjacent vertical pixel groups.

[0121] In an embodiment, adjacent horizontal pixel groups display a first sensing area and a second sensing area. Accordingly, the first sensing area and the second sensing area are displayed on adjacent gate line groups such that the timings of gate signals applied to the first sensing area and the second sensing area are substantially the same. Accordingly, the influence of deviation caused by different gate signal timings is reduced, which improves the accuracy of the sensed current.

[0122] Accordingly, the accuracy of the sensed current is improved. The improvement in the accuracy of the sensed current improves the accuracy of the PPG signal. In addition, the accuracy of a biomarker is improved.

[0123] Figure 16 is a block diagram of an electronic device according to an embodiment of the inventive concept. Figure 17 Illustrated therein Figure 16 is an example in which the electronic device is implemented as a smart phone.

[0124] Reference Figure 16 and Figure 17, in an embodiment, the electronic device 1000 includes a processor 1010, a memory device 1020, a storage device 1030, an input / output (I / O) device 1040, a power supply 1050, and a display device 1060. The display device 1060 is Figure 1 the display device. In addition, the electronic device 1000 further includes a plurality of ports for communicating with a video card, a sound card, a memory card, a universal serial bus (USB) device, and other electronic devices, etc.

[0125] In an embodiment, as Figure 17 illustrated in, the electronic device 1000 can be implemented as a smart phone. However, the electronic device 1000 is not limited thereto. For example, the electronic device 1000 can be implemented as a cellular phone, a video phone, a smart board, a smart watch, a tablet PC, an in-vehicle navigation system, a computer monitor, a laptop computer, or a head-mounted display (HMD) device, etc.

[0126] The processor 1010 performs various computing functions or tasks. The processor 1010 can be one of a microprocessor, a central processing unit (CPU), an application processor (AP), etc. The processor 1010 is coupled to other components through at least one of an address bus, a control bus, a data bus, etc. Further, the processor 1010 can be coupled to an expansion bus such as a peripheral component interconnect (PCI) bus.

[0127] The processor 1010 outputs input image data IMG, an application start signal APPON, and an input control signal CONT to Figure 1 the driving controller 200.

[0128] The memory device 1020 stores data for the operation of the electronic device 1000. For example, the memory device 1020 includes at least one non-volatile memory device such as an erasable programmable read-only memory (EPROM) device, an electrically erasable programmable read-only memory (EEPROM) device, a flash memory device, a phase change random access memory (PRAM) device, a resistive random access memory (RRAM) device, a nano floating gate memory (NFGM) device, a polymer random access memory (PoRAM) device, a magnetic random access memory (MRAM) device, a ferroelectric random access memory (FRAM) device, etc. and / or at least one volatile memory device such as a dynamic random access memory (DRAM) device, a static random access memory (SRAM) device, a mobile DRAM device, etc.

[0129] The storage device 1030 includes one or more of a solid state drive (SSD) device, a hard disk drive (HDD) device, a CD-ROM device, etc. The I / O device 1040 includes input devices such as a keyboard, a keypad, a mouse device, a touchpad, a touch screen, etc. and output devices such as a printer, a speaker, etc. In some embodiments, the display device 1060 is included in the I / O device 1040. The power supply 1050 supplies power for the operation of the electronic device 1000. The display device 1060 is coupled to other components via a bus or other communication link.

[0130] According to an embodiment, the display device can be incorporated into a computer, a notebook computer, a mobile phone, a smart phone, a smart board, a PMP, a PDA, an MP3 player, etc.

[0131] The foregoing is an illustration of embodiments of the inventive concept and should not be construed as necessarily limiting thereof. Although several embodiments of the inventive concept have been described, those skilled in the art will readily appreciate that many modifications can be made to the embodiments without substantially departing from the novel teachings and advantages of the inventive concept. Accordingly, all such modifications are intended to be included within the scope of the inventive concept as defined in the claims. Therefore, it should be understood that the foregoing is an illustration of the inventive concept and should not be construed as limited to the specific embodiments disclosed, and that modifications to the disclosed embodiments as well as other embodiments are intended to be included within the scope of the claims. The inventive concept is defined by the claims (including equivalents of the claims).

Claims

1. A display device, comprising: A display panel including a plurality of pixels; as well as A panel driver drives the display panel. The pixels include adjacent horizontal pixel groups including first and second pixel rows and adjacent vertical pixel groups including first and second pixel columns. The pixels include emission pixels including light emitting elements and light sensing pixels including photodiodes. The panel driver drives the display panel so that the display panel displays a first guide image, wherein the first guide image guides a user to place a finger on the first sensing area and the second sensing area of ​​the display panel. The light sensing pixel outputs a sensing current, and the sensing current generates a photoelectric volume pulse wave (PPG) signal by sensing the finger of the user, and The first sensing area and the second sensing area are displayed on one of the adjacent horizontal pixel group and the adjacent vertical pixel group.

2. The display device according to claim 1, wherein: The first sensing region and the second sensing region are displayed on the adjacent vertical pixel groups.

3. The display device according to claim 2, wherein: The panel driver comprises: a gate driver for applying a gate signal to the display panel through a plurality of gate lines; and a light sensing driver receiving the sensing current from the pixel through a plurality of sensing lines, The gate lines include a group of adjacent gate lines including first and second gate lines. The sensing line includes a group of adjacent sensing lines including first to second sensing lines, and Wherein, the adjacent vertical pixel groups are connected to the adjacent sensing line groups.

4. The display device according to claim 3, wherein: The light sensing driver receives the sensing current from the adjacent sensing line group connected to the adjacent vertical pixel group.

5. The display device according to claim 3, wherein: The sensing lines include first to p-th sensing lines, wherein p is a positive integer, Wherein, the first to p-th sensing lines are sequentially arranged in the display panel, and The adjacent sensing line group includes at least two adjacent sensing lines among the first to p-th sensing lines.

6. The display device according to claim 3, wherein: The gate lines extend in a first direction, and the sensing lines extend in a second direction different from the first direction.

7. The display device according to claim 2, wherein: The panel driver drives the display panel so that the display panel displays a second guide image, the second guide image guides the user to place a finger on the first sensing area, the second sensing area, the third sensing area, and the fourth sensing area of ​​the display panel, and The third sensing area and the fourth sensing area are displayed on the adjacent vertical pixel groups.

8. The display device according to claim 1, wherein: The first sensing region and the second sensing region are displayed on the adjacent horizontal pixel groups.

9. The display device according to claim 8, wherein: The panel driver comprises: a gate driver for applying a gate signal to the display panel through a plurality of gate lines; and a light sensing driver receiving the sensing current from the pixel through a plurality of sensing lines, The gate lines include a group of adjacent gate lines including first and second gate lines. The sensing line includes a group of adjacent sensing lines including first to second sensing lines, and Wherein, the adjacent horizontal pixel groups are connected to the adjacent gate line groups.

10. The display device according to claim 9, wherein: The light sensing driver receives the sensing current from the sensing line connected to the adjacent horizontal pixel group.

11. The display device according to claim 9, in, The gate lines include first to nth gate lines, wherein n is a positive integer, Wherein, the first to nth gate lines are sequentially arranged in the display panel, and Wherein, the adjacent gate line group includes at least two adjacent gate lines among the first to nth gate lines.

12. The display device according to claim 9, wherein: The gate lines extend in a first direction, and the sensing lines extend in a second direction different from the first direction.

13. The display device according to claim 8, in, The panel driver drives the display panel so that the display panel displays a third guide image, the third guide image guiding the user to place a finger on the first sensing area, the second sensing area, the third sensing area, and the fourth sensing area of ​​the display panel, and The third sensing area and the fourth sensing area are displayed on the adjacent horizontal pixel groups.

14. The display device according to claim 8, in, The panel driver drives the display panel in a horizontal mode or a vertical mode, and When the panel driver drives the display panel in the horizontal mode, the panel driver converts the display panel from the horizontal mode to the vertical mode in response to receiving an application start signal to display the first guide image in the vertical mode.

15. A method for operating a display device, the method comprising: displaying a guide image, wherein the guide image guides the user to place a first finger and a second finger on a first sensing area and a second sensing area, respectively, wherein the first sensing area and the second sensing area are displayed on one of an adjacent horizontal pixel group including first to second pixel rows and an adjacent vertical pixel group including first to second pixel columns; When the first finger and the second finger are located on the first sensing area and the second sensing area respectively, a PPG signal is generated by performing a photoplethysmography (PPG) sensing operation; as well as A biomarker of the user determined based on the PPG signal is displayed.

Images