Method for providing biomarker by display device and display device

Abstract

The invention relates to a method for providing a biomarker by a display device and the display device. The method of providing a biomarker by a display device includes displaying an initial guide image that guides a user to place a finger in a sensing area of the display device. When the finger is located in the sensing region, a first photoplethysmography (PPG) signal is generated by performing a PPG sensing operation. At least one tilt guide image requesting the user to tilt the finger in at least one direction is displayed. When the finger is tilted in the at least one direction in the sensing area, at least one second PPG signal is generated by performing the PPG sensing operation. And selecting an optimal PPG signal having the highest signal quality from among the first PPG signal and the at least one second PPG signal. The display device displays a biomarker of the user determined based on the optimal PPG signal.

Description

Technical Field

[0001] Embodiments of the inventive concept relate to a method of providing a biomarker by a display device and a display device, and more particularly, to a method of providing a biomarker by a display device and a display device performing the method. Background Art

[0002] Electronic devices (e.g., smart phones, smart watches, etc.) have been developed that perform biometric sensing operations such as fingerprint sensing operations, photoplethysmography (PPG) sensing operations, etc. These devices may perform biometric sensing operations using a sensor separate from a display device. In this case, the size of the display area of ​​the electronic device or the display device may be reduced, and the size of the frame may be increased.

[0003] Attempts have been made to address this problem. For example, embedded light sensor technology has been used that employs optical sensors or light sensing pixels within the display area of ​​a display device. Summary of the invention

[0004] Some embodiments provide a method of providing a biomarker by a display device.

[0005] Some embodiments provide a display device that provides a biomarker.

[0006] According to an embodiment, a method for providing a biomarker by a display device is provided. An initial guide image is displayed to guide a user to place a finger in a sensing area of ​​the display device, a first photoplethysmography (PPG) signal is generated by performing a PPG sensing operation when the finger is located in the sensing area, at least one tilt guide image is displayed to request the user to tilt the finger in at least one direction, at least one second PPG signal is generated by performing the PPG sensing operation when the finger is tilted in the at least one direction in the sensing area, an optimal PPG signal having the highest signal quality is selected from the first PPG signal and the at least one second PPG signal, and a biomarker of the user determined based on the optimal PPG signal is displayed.

[0007] In some embodiments, the display panel of the display device may include light-emitting pixels having light-emitting elements and light-sensing pixels having organic photodiodes, and the PPG sensing operation may be performed so that the light-emitting pixels emit light and the light-sensing pixels sense light reflected from the blood vessels of the finger.

[0008] In some embodiments, in order to display the at least one tilt guide image, a left tilt guide image requesting the user to tilt the finger to the left may be displayed, and a right tilt guide image requesting the user to tilt the finger to the right may be displayed.

[0009] In some embodiments, in order to generate the at least one second PPG signal, when the finger is tilted to the left side, a left-side tilted PPG signal can be generated by performing the PPG sensing operation, and when the finger is tilted to the right side, a right-side tilted PPG signal can be generated by performing the PPG sensing operation.

[0010] In some embodiments, in order to select the optimal PPG signal, the amplitude of the alternating current (AC) component of the first PPG signal, the amplitude of the AC component of the left-side tilted PPG signal, and the amplitude of the AC component of the right-side tilted PPG signal may be compared, and the optimal PPG signal having the largest AC component among the first PPG signal, the left-side tilted PPG signal, and the right-side tilted PPG signal may be selected.

[0011] In some embodiments, in order to display the at least one tilt guide image, an upward tilt guide image requesting to tilt the finger upward may be displayed, and a downward tilt guide image requesting to tilt the finger downward may be displayed.

[0012] In some embodiments, in order to generate the at least one second PPG signal, when the finger is tilted to the left side, a left-tilted PPG signal can be generated by performing the PPG sensing operation, when the finger is tilted to the right side, a right-tilted PPG signal can be generated by performing the PPG sensing operation, when the finger is tilted upward, an upward-tilted PPG signal can be generated by performing the PPG sensing operation, and when the finger is tilted downward, a downward-tilted PPG signal can be generated by performing the PPG sensing operation.

[0013] In some embodiments, in order to select the optimal PPG signal, the amplitude of the AC component of the first PPG signal, the amplitude of the AC component of the left-tilted PPG signal, the amplitude of the AC component of the right-tilted PPG signal, the amplitude of the AC component of the upward-tilted PPG signal, and the amplitude of the AC component of the downward-tilted PPG signal can be compared, and the optimal PPG signal having the largest AC component among the first PPG signal, the left-tilted PPG signal, the right-tilted PPG signal, the upward-tilted PPG signal, and the downward-tilted PPG signal can be selected.

[0014] In some embodiments, at least one movement guide image requesting movement of the finger may be displayed, and when the finger moves, at least one third PPG signal may be generated by performing the PPG sensing operation.

[0015] In some embodiments, in order to display the at least one tilt guide image, a left tilt guide image requesting to tilt the finger to the left may be displayed, and a right tilt guide image requesting to tilt the finger to the right may be displayed. In order to display the at least one movement guide image, an upward movement guide image requesting to move the finger upward may be displayed, and a downward movement guide image requesting to move the finger downward may be displayed.

[0016] In some embodiments, in order to generate the at least one second PPG signal, when the finger is tilted to the left, a left-side tilt PPG signal may be generated by performing the PPG sensing operation, and when the finger is tilted to the right, a right-side tilt PPG signal may be generated by performing the PPG sensing operation. In order to generate the at least one third PPG signal, when the finger is moved upward, an upward moving PPG signal may be generated by performing the PPG sensing operation, and when the finger is moved downward, a downward moving PPG signal may be generated by performing the PPG sensing operation.

[0017] In some embodiments, in order to select the optimal PPG signal, the amplitude of the AC component of the first PPG signal, the amplitude of the AC component of the left-tilted PPG signal, the amplitude of the AC component of the right-tilted PPG signal, the amplitude of the AC component of the upward-moving PPG signal, and the amplitude of the AC component of the downward-moving PPG signal can be compared, and the optimal PPG signal having the largest AC component among the first PPG signal, the left-tilted PPG signal, the right-tilted PPG signal, the upward-moving PPG signal, and the downward-moving PPG signal can be selected.

[0018] In some embodiments, in order to display the biomarker of the user, at least one of the blood pressure, heart rate, stress level, and cardiovascular health of the user determined based on the optimal PPG signal may be displayed.

[0019] In some embodiments, optimal guide image information representing an optimal guide image for the user may be stored, wherein the optimal guide image may be a guide image corresponding to the optimal PPG signal among the initial guide image and the at least one inclined guide image.

[0020] In some embodiments, when the user subsequently requests sensing of the biomarker, the optimal guidance image for the user can be displayed based on the optimal guidance image information, a subsequent PPG signal can be generated by performing the PPG sensing operation, and the biomarker of the user determined based on the subsequent PPG signal can be displayed.

[0021] According to an embodiment, a method of providing a biomarker by a display device is provided. In the method, an initial guide image is displayed to guide a user to place a finger in a sensing area of ​​the display device, an initial PPG signal is generated by performing a PPG sensing operation when the finger is located in the sensing area, a left-side tilt guide image is displayed to request tilting the finger to the left, and when the finger is tilted to the left, a left-side tilt PPG signal is generated by performing the PPG sensing operation, a right-side tilt guide image is displayed to request tilting the finger to the right, and when the finger is tilted to the right, a right-side tilt PPG signal is generated by performing the PPG sensing operation, an upward movement guide image is displayed to request moving the finger upward, and when the finger is moved upward, an upward movement PPG signal is generated by performing the PPG sensing operation, a downward movement guide image is displayed to request moving the finger downward, and when the finger is moved downward, a downward movement PPG signal is generated by performing the PPG sensing operation, an optimal PPG signal having the highest signal quality among the initial PPG signal, the left-side tilt PPG signal, the right-side tilt PPG signal, the upward movement PPG signal, and the downward movement PPG signal is selected, and a biomarker of the user determined based on the optimal PPG signal is displayed.

[0022] In an embodiment, optimal guide image information indicating an optimal guide image for the user may be stored, and the optimal guide image may be a guide image corresponding to the optimal PPG signal among the initial guide image, the left tilted guide image, the right tilted guide image, the upward moving guide image, and the downward moving guide image. When the user subsequently requests sensing of the biomarker, the optimal guide image for the user may be displayed based on the optimal guide image information.

[0023] According to an embodiment, a display device is provided, the display device comprising: a display panel including a plurality of pixel groups; and a panel driver configured to drive the display panel. Each of the plurality of pixel groups comprises a light-emitting pixel having a light-emitting element and a light-sensing pixel having an organic photodiode. The panel driver drives the display panel to display an initial guide image guiding a user to place a finger in a sensing area of ​​the display panel, generates a first PPG signal by performing a PPG sensing operation when the finger is located in the sensing area, drives the display panel to display at least one tilt guide image requesting the user to tilt the finger in at least one direction, generates at least one second PPG signal by performing the PPG sensing operation when the finger is tilted in the at least one direction in the sensing area, selects an optimal PPG signal having the highest signal quality among the first PPG signal and the at least one second PPG signal, and drives the display panel to display a biomarker of the user determined based on the optimal PPG signal.

[0024] In an embodiment, in order to perform the PPG sensing operation, the panel driver may drive the light-emitting pixels of the pixel group located in an adjacent area adjacent to the sensing area to emit light, and may drive the light-sensing pixels of the pixel group located in the sensing area to sense light reflected from the blood vessels of the finger.

[0025] In an embodiment, the panel driver may store optimal guide image information indicating an optimal guide image for the user, and the optimal guide image may be a guide image corresponding to the optimal PPG signal among the initial guide image and the at least one tilted guide image. When the user subsequently requests sensing of the biomarker, the panel driver may display the optimal guide image for the user based on the optimal guide image information.

[0026] As described above, in the method and display device for providing a biomarker according to the embodiment, when a user's finger is located in the sensing area of ​​the display device, a first PPG signal may be generated by performing a PPG sensing operation, at least one second PPG signal may be generated by performing the PPG sensing operation after displaying at least one tilt guide image, an optimal PPG signal having the highest signal quality among the first PPG signal and the at least one second PPG signal may be selected, and the user's biomarker may be determined based on the optimal PPG signal. Therefore, the contact surface between the finger and the sensing area may be optimized for each user, the signal quality of the PPG signal may be improved, and the user's biomarker may be accurately sensed.

[0027] According to one or more embodiments, a method for providing a biomarker by a display device includes: generating a first biosignal based on a sensing operation performed on a user's finger on a display screen; displaying a finger adjustment image in the display screen to guide the user to adjust the position of the finger; generating a second biosignal based on a sensing operation performed on the adjusted position of the finger; selecting the first biosignal or the second biosignal; and displaying a biomarker in the display screen based on the selected first biosignal or the second biosignal.

[0028] Each of the first biosignal and the second biosignal may be a PPG signal. The selecting the first biosignal or the second biosignal may include: determining a signal quality of the first biosignal; determining a signal quality of the second biosignal; comparing the signal quality of the first biosignal and the signal quality of the second biosignal; and selecting the second biosignal based on the comparison. The second biosignal may have a higher signal quality than the first biosignal. The finger adjustment image may guide the user to tilt or move the finger. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Illustrative, non-limiting embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings.

[0030] Figure 1 is a flowchart illustrating a method of providing a biomarker by a display device according to an embodiment.

[0031] Figure 2 is a diagram showing an example of an initial guidance image displayed in a display device.

[0032] Figure 3 is a diagram illustrating an example of a display device that performs a PPG sensing operation.

[0033] Figure 4 : is a diagram showing an example of blood vessel distribution of fingers of multiple users.

[0034] Figure 5A is a diagram showing an example of a left-side inclined guide image displayed in a display device, and Figure 5B is a diagram showing an example of a finger tilted to the left.

[0035] Fig. 6A is a diagram showing an example of a right-side inclined guide image displayed in a display device, and Figure 6B is a diagram showing an example of a finger tilted to the right.

[0036] Fig. 7A is a diagram showing an example of an upward moving guide image displayed in a display device, and Figure 7B is a diagram showing an example of a finger moving upward.

[0037] Fig. 8A is a diagram showing an example of a downward moving guide image displayed in a display device, and Figure 8B is a diagram showing an example of a finger moving downward.

[0038] Fig. 9 : is a diagram for describing an example of selecting an optimal PPG signal from among a plurality of PPG signals.

[0039] Fig.10 is a diagram showing an example of a biomarker displayed on a display device.

[0040] Fig.11 is a diagram showing an example of an image displayed in a display device when a PPG sensing operation is performed.

[0041] Fig.12 is a flowchart illustrating a method of providing a biomarker by a display device according to an embodiment.

[0042] Fig.13A is a diagram showing an example of an upward tilt guide image displayed in a display device, and Fig. 13B is a diagram showing an example of a finger tilted upward.

[0043] Fig.14A is a diagram showing an example of a downward tilt guide image displayed in a display device, and Fig. 14B is a diagram showing an example of a finger tilted downward.

[0044] Fig.15 is a block diagram showing a display device according to an embodiment.

[0045] Fig.16 is a circuit diagram illustrating an example of a light emitting pixel and a light sensing pixel included in a display device according to an embodiment.

[0046] Fig.17 is a diagram showing an example of a sensing region where a light sensing pixel is driven and an adjacent region where a light emitting pixel is driven.

[0047] Fig.18 is a block diagram illustrating an electronic device including a display device according to an embodiment. DETAILED DESCRIPTION

[0048] Hereinafter, embodiments of the inventive concept will be explained in detail with reference to the accompanying drawings.

[0049] Figure 1 is a flowchart illustrating a method for providing a biomarker by a display device according to an embodiment, Figure 2is a diagram showing an example of an initial guidance image displayed in a display device, Figure 3 is a diagram showing an example of a display device that performs a photoplethysmography (PPG) sensing operation, Figure 4 is a diagram showing an example of blood vessel distribution of fingers of multiple users, Figure 5A is a diagram showing an example of a left-side inclined guide image displayed on a display device, Figure 5B is a diagram showing an example of a finger tilted to the left, Fig. 6A is a diagram showing an example of a right-side inclined guide image displayed on a display device, Figure 6B is a diagram showing an example of a finger tilted to the right, Fig. 7A is a diagram showing an example of an upward moving guide image displayed in a display device, Figure 7B is a diagram showing an example of a finger moving upward, Fig. 8A is a diagram showing an example of a downward moving guide image displayed in a display device, Figure 8B is a diagram showing an example of a finger moving downward, Fig. 9 is a diagram for describing an example of selecting an optimal PPG signal from among a plurality of PPG signals, Fig.10 is a diagram showing an example of a biomarker displayed in a display device, and Fig.11 is a diagram showing an example of an image displayed in a display device when a PPG sensing operation is performed.

[0050] Reference Figure 1 and Figure 2 , the method of providing a biomarker by the display device 200 according to an embodiment includes determining whether to sense a first biomarker for a user as an initial operation. When the first biomarker sensing for the user is performed (S100: Yes), the display device 200 may display an initial guidance image 220 (S110). For example, Figure 2 As shown in , the display device 200 may display an initial guide image 220 to guide the user to place a finger in the sensing area 250 of the display screen. In addition, in some embodiments, in order to guide the position of the sensing area 250, such as Figure 2 As shown in , the initial guide image 220 may include an icon or other guide mark such as but not limited to a fingerprint image within the sensing area 250, but is not limited thereto.

[0051] When the user's finger is located in the sensing area 250, the processor of the display device 200 may perform a PPG sensing operation to generate a first PPG signal (S115). Figure 3As shown in , the display panel of the display device 200 may include a light-emitting pixel 222 having a light-emitting element EL and a light-sensing pixel 224 having an organic photodiode OPD. A PPG sensing operation may be performed so that the light-emitting pixel 222 may emit light and the light-sensing pixel 224 may sense light reflected from a blood vessel 350 of a user's finger 300. In another embodiment, the processor of the display device 200 may generate another type of bio-signal, such as a bio-signal different from a PPG signal.

[0052] For example, when the user's heart contracts and the volume of the blood vessel 350 increases, the amount of hemoglobin in the blood vessel 350 may increase, the light intensity absorbed by the hemoglobin may increase, and the light sensing pixel 224 may measure a relatively low light intensity of the reflected light. Conversely, when the user's heart expands (or relaxes) and the volume of the blood vessel 350 decreases, the amount of hemoglobin in the blood vessel 350 may decrease, the light intensity absorbed by the hemoglobin may decrease, and the light sensing pixel 224 may measure a relatively high light intensity of the reflected light. The display device 200 may generate a PPG signal indicating the volume of the blood vessel 350 based on the light intensity measured by the light sensing pixel 224.

[0053] Meanwhile, the distribution of blood vessels 350 in the fingers 300 of a plurality of users may be different from each other. As a result, the first PPG signals among the plurality of users may be different in quality. For example, the first PPG signal generated when the finger 300 has an initial position may have a low signal quality depending on the user. Here, the signal quality of the PPG signal may be determined in a variety of ways. For example, the signal quality of the PPG signal may be determined by a signal quality index (SQI) of the PPG signal, may be determined by a signal-to-noise ratio (SNR) of the PPG signal, and / or may be determined by the amount of an AC component of the PPG signal. For example, as Figure 4 As shown in , in the case where the blood vessels 350a of the finger 300a of the first user are distributed corresponding to the sensing area 250a, the first PPG signal of the first user may have a relatively high signal quality, for example, greater than a predetermined value. For example, the relatively high signal quality may be an SQI greater than a predetermined value, an SNR greater than a predetermined value, or an AC component greater than a predetermined value.

[0054] However, in the case where the blood vessel 350b of the second user's finger 300b is offset to the left relative to the sensing area 250b, or in the case where the blood vessel 350c of the third user's finger 300c is offset downward relative to the sensing area 250c, the first PPG signal of the second user or the first PPG signal of the third user may have a relatively low signal quality, for example, lower than any of the aforementioned predetermined values. In this case, the biomarker determined based on the first PPG signal of the second user or the first PPG signal of the third user may not always prove to be accurate.

[0055] In order to prevent the signal quality of the PPG signal from being deteriorated, which may occur due to the distribution (or positioning) of the blood vessels 350 within the finger 300, the display device 200 according to the embodiment may display at least one tilt guide image requesting the user to tilt his finger 300 in at least one direction (S120), and when the finger 300 is tilted in at least one direction, at least one second PPG signal may be additionally generated by performing a PPG sensing operation (S125).

[0056] In some embodiments, Figure 5A As shown in FIG. 1 , the display device 200 may display a left-side tilt guide image 230 a ( S130 ) requesting the user to tilt his finger 300 to the left in order to introduce the blood vessel 350 into the improved sensing space. Figure 5B 2 is a horizontal view showing an example in which the user tilts the finger 300 to the left. When the user observes the left tilt guide image 230a, as shown in FIG. Figure 5B As shown in , the user may tilt his finger 300 to the left so that the central axis CA of the finger 300 in a horizontal view tilts to the left from the vertical line PL perpendicular to the display device 200. When the finger 300 tilts to the left, the display device 200 may perform a PPG sensing operation again to generate a left tilt PPG signal (S135). Here, the left tilt PPG signal may be a PPG signal generated by the PPG sensing operation after the finger 300 tilts to the left.

[0057] like Figure 5B As shown in FIG. 1 , in the initial position of the finger, most or even all of the blood vessels 350 are not present. Figure 2As a result, the first PPG signal may have a low signal quality. Here, the sensing area 250 may refer to an area of ​​the display panel of the display device 200 in which the light sensing pixels 224 are driven to sense the light reflected from the blood vessels 350 of the finger 300, and the sensing space 260 may refer to a space within the finger 300 that can be sensed by the sensing area 250 of the display device 200. On the other hand, when the blood vessels 350 of the user's finger 300 are offset to the left, most or even all of the blood vessels 350 of the finger 300 may exist within the sensing space 260 to be sensed in the sensing area 250. Therefore, the tilt of the user's finger 300 may generate a left-side tilt PPG signal with a high signal quality.

[0058] In addition, if Fig. 6A As shown in FIG. 1 , the display device 200 may display a right tilt guide image 230 b requesting the finger 300 to tilt to the right ( S140 ). Figure 6B 2 is a horizontal view showing an example in which the user tilts the finger 300 to the right. When the user observes the right tilt guide image 230b, as shown in FIG. Figure 6B As shown in , the user can tilt the finger 300 to the right side so that the central axis CA of the finger 300 in the horizontal view is tilted to the right side from the vertical line PL perpendicular to the display device 200. When the finger 300 is tilted to the right side, the display device 200 can perform the PPG sensing operation again to generate a right tilt PPG signal (S145). Here, the right tilt PPG signal may refer to a PPG signal generated by the PPG sensing operation after the finger 300 is tilted to the right side.

[0059] like Figure 6BAs shown in , when the finger 300 is in the initial position, there is almost no portion of the blood vessels 350 in the sensing space 260. As a result, the first PPG signal may have a low signal quality. However, when the finger 300 is tilted to the right, a larger portion (or even a majority) of the blood vessels 350 of the finger 300 may exist in the sensing space 260. Therefore, the right tilt PPG signal may have a relatively high signal quality. In one embodiment, only one of the left tilt guide image and the right tilt guide image may be displayed, and the accompanying PPG sensing operation may be performed. In another embodiment, both the left tilt guide image and the right tilt guide image may be displayed, and the accompanying PPG sensing operation may be performed. In one embodiment, when a low-quality PPG signal is generated when the finger is in the initial position and the left tilt position, a right tilt sensing operation may be performed to obtain a high-quality PPG signal. In one embodiment, when a low-quality PPG signal is generated when the finger is in the initial position and the left tilt position, a left tilt sensing operation may be performed to obtain a high-quality PPG signal. In one embodiment, both the left tilt sensing operation and the right tilt sensing operation may be always performed. According to one or more embodiments, an upward tilt sensing operation and a downward tilt sensing operation may also be performed in response to a corresponding image tilt image so as to generate a corresponding PPG signal.

[0060] In addition, the display device 200 according to the embodiment may display at least one movement guide image requesting the user to move the finger 300 (S150). When the finger 300 moves, the display device 200 may additionally generate at least one third PPG signal by performing a PPG sensing operation (S155).

[0061] In some embodiments, Fig. 7A As shown in FIG. 1 , the display apparatus 200 may display an upward movement guide image 240 a requesting the user to move his finger 300 upward ( S160 ). Figure 7B 3 is a top view showing an example of a user moving the finger 300 upward. When the user observes the upward movement guide image 240a, as shown in FIG. Figure 7B As shown in , the user may move the finger 300 upward. When the finger 300 moves upward, the display device 200 may perform a PPG sensing operation to generate an upward PPG signal (S165). Here, the upward PPG signal may refer to a PPG signal generated by the PPG sensing operation after the finger 300 moves upward.

[0062] like Figure 7BAs shown in , when the user's finger 300 is in an initial position (e.g., offset in a downward position before moving upward), a portion of the blood vessels 350 may hardly exist within the sensing space 260. As a result, the first PPG signal may have a low signal quality, e.g., below a predetermined value. However, in this case, when the finger 300 moves upward in response to the upward movement guide image 240a, a larger portion (or most of) the blood vessels 350 of the finger 300 may exist within the sensing space 260. Therefore, the upward movement PPG signal may have a high signal quality, e.g., above a predetermined value.

[0063] In addition, if Fig. 8A As shown in FIG. 1 , the display apparatus 200 may display a downward movement guide image 240 b requesting the finger 300 to be moved downward ( S170 ). Figure 8B 3 is a top view showing an example of a user moving his finger 300 downward. When the user observes the downward movement guide image 240b, as shown in FIG. Figure 8B As shown in FIG. 1 , the user may move his finger 300 downward. When the user's finger 300 moves downward, the display device 200 may perform a PPG sensing operation to generate a downward moving PPG signal ( S175 ).

[0064] Here, the downward movement PPG signal may refer to a PPG signal generated by a PPG sensing operation after the finger 300 moves downward. Figure 8B As shown in , in the case where the blood vessels 350 of the user's finger 300 are in an initial position (e.g., shifted upward), a portion of the blood vessels 350 may hardly exist within the sensing space 260. Therefore, the first PPG signal may have a low signal quality. However, in this case, when the finger 300 moves downward, a larger portion (or most of) the blood vessels 350 of the finger 300 may exist within the sensing space 260. Therefore, the downward moving PPG signal may have a high signal quality.

[0065] In one embodiment, only one of the upward moving PPG signal and the downward moving PPG signal may be generated. In other embodiments, both the upward moving PPG signal and the downward moving PPG signal may be generated. For example, when one of the upward moving PPG signal and the downward moving PPG signal having a low signal quality (e.g., below a predetermined value) is generated, the other of the upward moving PPG signal and the downward moving PPG signal may be generated.

[0066] In one embodiment, the display device 200 may select an optimal PPG signal with the highest signal quality among the first PPG signal, at least one second PPG signal, and at least one third PPG signal (S180). In some embodiments, the display device 200 may select a PPG signal with the largest AC component among the first PPG signal, the second PPG signal, and the third PPG signal as the optimal PPG signal. In other embodiments, the display device 200 may select a PPG signal with the highest SQI among the first PPG signal, the second PPG signal, and the third PPG signal as the optimal PPG signal. In still other embodiments, the display device 200 may select a PPG signal with the highest SNR among the first PPG signal, the second PPG signal, and the third PPG signal as the optimal PPG signal.

[0067] exist Fig. 9 , 410 may represent a first PPG signal generated when the finger 300 has an initial position, 430 may represent a left-side tilted PPG signal generated when the finger 300 is tilted to the left, 450 may represent a right-side tilted PPG signal generated when the finger 300 is tilted to the right, 470 may represent an upward movement PPG signal generated when the finger 300 moves upward, and 490 may represent a downward movement PPG signal generated when the finger 300 moves downward. Fig. 9 In the example shown in , the display device 200 may compare an amount A1 of the AC component of the first PPG signal 410, an amount A2 of the AC component of the left-side tilt PPG signal 430, an amount A3 of the AC component of the right-side tilt PPG signal 450, an amount A4 of the AC component of the upward-moving PPG signal 470, and an amount A5 of the AC component of the downward-moving PPG signal 490 with one another.

[0068] For example, the amount of the AC component may be determined by calculating the difference between the maximum value and the minimum value of each PPG signal, but is not limited thereto. In addition, the display device 200 may select an optimal PPG signal having the largest AC component among the first PPG signal 410, the left tilt PPG signal 430, the right tilt PPG signal 450, the upward movement PPG signal 470, and the downward movement PPG signal 490. That is, Fig. 9 In the example shown in , since the AC component of the right tilt PPG signal 450 has the largest amount A3, the display apparatus 200 may select the right tilt PPG signal 450 as the optimal PPG signal.

[0069] The display device 200 may store optimal guide image information indicating an optimal guide image (S185). Here, the optimal guide image may be a guide image corresponding to an optimal PPG signal among an initial guide image, at least one tilted guide image, and at least one moving guide image. Fig. 9 As shown in , in the case where the right oblique PPG signal 450 is selected as the optimal PPG signal, the display device 200 may store the optimal guide image information representing the right oblique guide image 230 b as the optimal guide image.

[0070] In addition, the display device 200 may determine a biomarker of the user based on the optimal PPG signal and may display the biomarker (S190). Fig.10 As shown in FIG. 1 , the display device 200 can display the user's blood pressure BP, heart rate Stress level SL and / or cardiovascular health CH as biomarkers. For example, blood pressure BP can be determined by detecting the characteristics of the optimal PPG signal and analyzing the characteristics of the optimal PPG signal (e.g., machine learning, neural network analysis, etc.). Heart rate HR can be determined based on the period of the optimal PPG signal. Stress level SL can be determined based on the change in the period of the optimal PPG signal. Cardiovascular health CH can be determined based on the peak time of the optimal PPG signal or the difference in blood pressure between the left hand finger and the right hand finger. In other embodiments, the display device 200 can also display respiratory rate, vascular age (or vascular elasticity) and / or oxygen saturation as biomarkers. For example, the respiratory rate can be determined based on the period of the low-frequency component of the optimal PPG signal, the vascular age can be determined based on the waveform of the optimal PPG signal, and the oxygen saturation can be determined by the intensity difference between the green reflected light and the red reflected light.

[0071] For example, when performing the first biomarker sensing for the user, the display of at least one tilted guide image 230a and 230b and at least one moving guide image 240a and 240b, the selection of the optimal PPG signal, and the storage of the optimal guide image information may be performed. If the user subsequently requests the sensing of the biomarker after the optimal guide image information is stored (S100: No), the display device 200 may display the optimal guide image for the user based on the optimal guide image information (S192). For example, in a case where the optimal guide image information representing the right tilted guide image 230b is stored, the display device 200 may display the right tilted guide image 230b in response to a subsequent request. When the user observes the optimal guide image and places the finger 300 at the optimal position, the display device 200 may generate a subsequent PPG signal by performing a PPG sensing operation (S194). When the PPG sensing operation is performed, as Fig.11As shown in , the display device 200 may display a progress image 270 indicating the progress status of the PPG sensing operation, and / or may display a real-time image 290 indicating a subsequent PPG signal generated by the PPG sensing operation. The progress image 270 may gradually change to a completion image 280 until the PPG sensing operation is completed.

[0072] As described above, in the method of providing a biomarker according to an embodiment, when the finger 300 of the user is located in the sensing area 250 of the display device 200, the first PPG signal 410 may be generated by performing a PPG sensing operation. After displaying at least one tilted guide image 230a and 230b, at least one second PPG signal 430 or 450 may be generated by performing a PPG sensing operation. After displaying at least one moving guide image 240a and 240b, at least one third PPG signal 470 or 490 may be generated by performing a PPG sensing operation. An optimal PPG signal among the first PPG signal 410, at least one second PPG signal 430 and 450, and at least one third PPG signal 470 and 490 may be selected, and the biomarker of the user may be determined based on the optimal PPG signal. Therefore, the contact surface between the finger 300 and the sensing area 250 may be optimized for each user, the signal quality of the PPG signal may be improved, and the biomarker of the user may be accurately sensed.

[0073] Fig.12 is a flowchart illustrating a method for providing a biomarker by a display device according to an embodiment, Fig.13A is a diagram showing an example of an upward tilt guide image displayed in a display device, Fig. 13B is a diagram showing an example of a finger tilted upward, Fig.14A is a diagram showing an example of a downward tilt guide image displayed in a display device, and Fig. 14B is a diagram showing an example of a finger tilted downward.

[0074] Reference Figure 2 and Fig.12 In the method of providing a biomarker by the display device 200 according to the embodiment, when performing a first biomarker sensing operation for a user (S100: Yes), the display device 200 may display an initial guide image 220 (S110). When the user's finger is located in the sensing area 250, the display device 200 may perform a PPG sensing operation to generate a first PPG signal (S115).

[0075] The display device 200 may display at least one tilt guide image requesting the user to tilt his finger in at least one direction (S120a), and when the finger is tilted in at least one direction, may additionally generate at least one second PPG signal by performing a PPG sensing operation (S125a). The display device 200 may display a left tilt guide image requesting the user to tilt his finger to the left (S130), may perform a PPG sensing operation to generate a left tilt PPG signal (S135), may display a right tilt guide image requesting the user to tilt his finger to the right (S140), and may perform a PPG sensing operation to generate a right tilt PPG signal (S145).

[0076] In some embodiments, Fig.13A As shown in FIG. 1 , the display device 200 may also display an upward tilt guide image 230c requesting the user to tilt his finger upward (S160a). When the user observes the upward tilt guide image 230c, the user may Fig. 13B As shown in FIG. 1 , the finger 300 is tilted upward (or forward). When the finger 300 is tilted upward, the display device 200 may perform a PPG sensing operation to generate an upward tilt PPG signal (S165). Here, the upward tilt PPG signal may refer to a PPG signal generated by the PPG sensing operation after the finger 300 is tilted upward (or forward).

[0077] In addition, if Fig.14A As shown in FIG. 1 , the display device 200 may also display a downward tilt guide image 230d requesting the user to tilt the finger downward (S170a). When the user observes the downward tilt guide image 230d, the user may Fig. 14B 300 tilts his finger downward (or backward) as shown in . When the finger 300 tilts downward, the display device 200 may perform a PPG sensing operation to generate a downward tilt PPG signal (S175). Here, the downward tilt PPG signal may refer to a PPG signal generated by the PPG sensing operation after the finger 300 tilts downward (or backward).

[0078] The display device 200 may select an optimal PPG signal (e.g., a signal with the highest signal quality) among the first PPG signal and the at least one second PPG signal (S180). In some embodiments, the processor of the display device 200 may compare all or part of the following: the amplitude of the AC component of the first PPG signal, the amplitude of the AC component of the left tilt PPG signal, the amplitude of the AC component of the right tilt PPG signal, the amplitude of the AC component of the upward tilt PPG signal, and the amplitude of the AC component of the downward tilt PPG signal. The processor may then select an optimal PPG signal having the largest AC component among the first PPG signal, the left tilt PPG signal, the right tilt PPG signal, the upward tilt PPG signal, and the downward tilt PPG signal. In addition, the display device 200 may store optimal guide image information representing a guide image corresponding to the optimal PPG signal among the initial guide image, the left tilt guide image, the right tilt guide image, the upward tilt guide image 230c, and the downward tilt guide image 230d as an optimal guide image for the user (S185). The display apparatus 200 may determine a biomarker of the user based on the optimal PPG signal, and may display the biomarker ( S190 ).

[0079] If the user subsequently requests sensing of the biomarker after storing the optimal guide image information (S100: No), the display device 200 may display an optimal guide image for the user based on the optimal guide image information (S192). When the user observes the optimal guide image and places the finger 300 at the optimal position, the display device 200 may generate a subsequent PPG signal by performing a PPG sensing operation (S194).

[0080] As described above, in the method of providing a biomarker according to the embodiment, when the user's finger 300 is located in the sensing area 250, a first PPG signal may be generated by performing a PPG sensing operation, at least one second PPG signal may be generated by performing a PPG sensing operation after displaying at least one tilt guide image, an optimal PPG signal among the first PPG signal 410 and the at least one second PPG signal may be selected, and the user's biomarker may be determined based on the optimal PPG signal. Therefore, the contact surface between the finger 300 and the sensing area 250 may be optimized for each user, the signal quality of the PPG signal may be improved, and the user's biomarker may be accurately sensed.

[0081] Fig.15 is a block diagram showing a display device according to an embodiment, Fig.16 is a circuit diagram showing an example of a light emitting pixel and a light sensing pixel included in a display device according to an embodiment, and Fig.17is a diagram showing an example of a sensing region where a light sensing pixel is driven and an adjacent region where a light emitting pixel is driven.

[0082] Reference Fig.15 According to an embodiment, the display device 500 may include a display panel 510 including a plurality of pixel groups 515 and a panel driver 505 driving the display panel 510. In some embodiments, as Fig.15 As shown in , the panel driver 505 may include a scan driver 520 that provides a scan signal SS to the display panel 510, an emission driver 530 that provides an emission signal EM[n] to the display panel 510, a data driver 540 connected to the display panel 510 via a data line DL, a readout circuit 550 connected to the display panel 510 via a readout line RL, and a controller 560 that controls the operation of the display device 500. Herein, n may be a natural number greater than 0.

[0083] The display panel 510 may include a plurality of pixel groups 515 arranged in a predetermined pattern (e.g., a matrix having a plurality of rows and a plurality of columns). Each pixel group 515 may include at least one light-emitting pixel EL_PX having a light-emitting element and at least one light-sensing pixel OPD_PX having an organic photodiode. Fig.15 An example is shown in which each pixel group 515 includes one light-emitting pixel EL_PX and one light-sensing pixel OPD_PX, but the number of light-emitting pixels EL_PX and / or the number of light-sensing pixels OPD_PX included in each pixel group 515 is not limited to Fig.15 For example, in other embodiments, each pixel group 515 may include four light-emitting pixels EL_PX (eg, one red light-emitting pixel, two green light-emitting pixels, and one blue light-emitting pixel) and one light-sensing pixel OPD_PX.

[0084] Each luminescent pixel EL_PX may have a predetermined number of transistors and capacitors. Fig.16As shown in the figure, each light-emitting pixel EL_PX may include a first transistor T1 generating a driving current, a second transistor T2 transmitting a data signal DS of a data line DL in response to a write signal GW[n], a third transistor T3 diode-connected to the first transistor T1 in response to a compensation signal GC[n], a fourth transistor T4 transmitting an initialization voltage VINT to a gate of the first transistor T1 in response to an initialization signal GI[n], a fifth transistor T5 connecting a line to which a first power supply voltage ELVDD is applied and the first transistor T1 in response to an emission signal EM[n], a sixth transistor T6 connecting the first transistor T1 and the light-emitting element EL in response to the emission signal EM[n], a seventh transistor T7 transmitting an anode initialization voltage AINT to the light-emitting element EL in response to a bypass signal GB[n], an eighth transistor T8 transmitting a bias voltage VOBS to a terminal (e.g., a source) of the first transistor T1 in response to the bypass signal GB[n], a storage capacitor CST connected between the line to which the first power supply voltage ELVDD is applied and the gate of the first transistor T1, and the light-emitting element EL emitting light based on the driving current.

[0085] According to an embodiment, the light emitting element EL may include an organic light emitting diode (OLED), a nano light emitting diode (NED), a quantum dot (QD) light emitting diode, a micro light emitting diode, an inorganic light emitting diode, or any other suitable light emitting element. Fig.16 As shown in the figure, the first transistor T1, the second transistor T2, the fifth transistor T5, the sixth transistor T6, the seventh transistor T7 and the eighth transistor T8 can be P-type metal oxide semiconductor (PMOS) transistors, and the third transistor T3 and the fourth transistor T4 can be N-type metal oxide semiconductor (NMOS) transistors, but are not limited thereto.

[0086] In addition, if Fig.16 As shown in , the light sensing pixel OPD_PX may include a predetermined number of transistors, such as a ninth transistor T9, a tenth transistor T10, an eleventh transistor T11, and an organic photodiode OPD. The ninth transistor T9 may generate a sensing current based on the voltage of the anode of the organic photodiode OPD. In some embodiments, the ninth transistor T9 may include a gate connected to the anode of the organic photodiode OPD, a first terminal receiving a reference voltage VREF, and a second terminal.

[0087] The tenth transistor T10 may reset the voltage of the anode of the organic photodiode OPD to the reset voltage VRST in response to the global reset signal GR. In some embodiments, the tenth transistor T10 may include a gate receiving the global reset signal GR, a first terminal receiving the reset voltage VRST, and a second terminal connected to the anode of the organic photodiode OPD.

[0088] The eleventh transistor T11 may transmit the sense current generated by the ninth transistor T9 to the readout line RL in response to the write signal GW[n]. In some embodiments, the eleventh transistor T11 may include a gate receiving the write signal GW[n], a first terminal connected to the second terminal of the ninth transistor T9, and a second terminal connected to the readout line RL.

[0089] The organic photodiode OPD can be used to measure light intensity. For example, after the voltage of the anode of the organic photodiode OPD is reset to the reset voltage VRST, the voltage of the anode of the organic photodiode OPD can increase by different amounts depending on the light intensity. The sensing current of the ninth transistor T9 can be determined based on the voltage of the anode of the organic photodiode OPD. The readout circuit 550 can generate a PPG signal corresponding to the sensing current. In some embodiments, the organic photodiode OPD may include an anode connected to the gate of the ninth transistor T9 and a cathode connected to a line to which the second power supply voltage ELVSS is applied.

[0090] For example, when the user's heart contracts and the volume of the blood vessels in the user's finger increases, the intensity of the light reflected from the blood vessels decreases, and the anode voltage of the organic photodiode OPD increases by a relatively small amount. In this case, the ninth transistor T9 can generate a relatively large sensing current based on the relatively low anode voltage, and the readout circuit 550 can generate a PPG signal with a relatively large value based on the relatively large sensing current. For example, when the volume of the blood vessels increases, the readout circuit 550 can generate a PPG signal with a relatively large value.

[0091] When the user's heart expands (or relaxes) and the volume of the blood vessel decreases, the intensity of the light reflected from the blood vessel can increase, and the voltage of the anode of the organic photodiode OPD can increase by a relatively large amount. In this case, the ninth transistor T9 can generate a relatively small sensing current based on the relatively high anode voltage. The readout circuit 550 can generate a PPG signal with a relatively small value based on the relatively small sensing current. For example, when the blood vessel volume decreases, the readout circuit 550 can generate a PPG signal with a relatively small value. Therefore, the PPG signal can have a value corresponding to the volume of the blood vessel.

[0092] In some embodiments, Fig.16 As shown in FIG. 1 , the ninth transistor T9 and the eleventh transistor T11 may be PMOS transistors, and the tenth transistor T10 may be an NMOS transistor, but is not limited thereto. Fig.16 An example of the light emitting pixel EL_PX and the light sensing pixel OPD_PX is shown, but the light emitting pixel EL_PX and the light sensing pixel OPD_PX of the display device 500 according to the embodiment are not limited to Fig.16, and can have any structure.

[0093] The scan driver 520 may generate a scan signal SS based on a scan control signal SCTRL received from the controller 560, and may sequentially provide the scan signal SS to the display panel 510 row by row. In some embodiments, the scan control signal SCTRL may include, but is not limited to, a scan start signal and a scan clock signal. In addition, the scan signal SS may include, but is not limited to, a write signal GW[n], a compensation signal GC[n], an initialization signal GI[n], and a bypass signal GB[n]. In addition, in some embodiments, the scan driver 520 may be integrated or formed in the display panel 510. In other embodiments, the scan driver 520 may be implemented as one or more integrated circuits.

[0094] The emission driver 530 may generate an emission signal EM[n] based on an emission control signal EMCTRL received from the controller 560, and may sequentially provide the emission signal EM[n] to the display panel 510 row by row. In some embodiments, the emission control signal EMCTRL may include, but is not limited to, an emission start signal and an emission clock signal. In addition, in some embodiments, the emission driver 530 may be integrated or formed in the display panel 510. In other embodiments, the emission driver 530 may be implemented as one or more integrated circuits.

[0095] The data driver 540 may generate a data signal DS based on the data control signal DCTRL and output the image data ODAT received from the controller 560, and may provide the data signal DS to the light-emitting pixel EL_PX via the data line DL. In some embodiments, the data control signal DCTRL may include, but is not limited to, an output data enable signal, a horizontal start signal, and a load signal. In some embodiments, the data driver 540 and the controller 560 may be implemented as a single integrated circuit, and the single integrated circuit may be referred to as a timing controller embedded data driver (TED) integrated circuit. In other embodiments, the data driver 540 and the controller 560 may be implemented as separate integrated circuits.

[0096] The readout circuit 550 may receive a sensing current of the light sensing pixel OPD_PX via a readout line RL, may generate a PPG signal based on the sensing current, and may provide the PPG signal to the controller 560. In addition, the readout circuit 550 may apply a global reset signal GR to all light sensing pixels OPD_PX of the display panel 510 substantially at the same time. In some embodiments, the readout circuit 550 may be implemented as an integrated circuit, and the integrated circuit may be referred to as a readout integrated circuit (ROIC). In other embodiments, the readout circuit 550 may be included in the data driver 540.

[0097] The controller 560 (e.g., a timing controller (TCON)) may receive input image data IDAT and a control signal CTRL from an external host processor (e.g., a graphics processing unit (GPU), an application processor (AP), or a graphics card). In some embodiments, the input image data IDAT may be RGB image data including red image data, green image data, and blue image data. In some embodiments, the control signal CTRL may include, but is not limited to, a vertical synchronization signal, a horizontal synchronization signal, an input data enable signal, and a main clock signal. The controller 560 may generate output image data ODAT, a data control signal DCTRL, a scan control signal SCTRL, and an emission control signal EMCTRL based on the input image data IDAT and the control signal CTRL. The controller 560 may control the operation of the data driver 540 by providing the output image data ODAT and the data control signal DCTRL to the data driver 540, may control the operation of the scan driver 520 by providing the scan control signal SCTRL to the scan driver 520, and may control the operation of the emission driver 530 by providing the emission control signal EMCTRL to the emission driver 530.

[0098] In the display device 500 according to the embodiment, the processor (e.g., panel driver) may drive the display panel 510 to display an initial guide image that guides the user to place a finger in the sensing area of ​​the display panel 510. When the finger is located in the sensing area, the panel driver 505 may perform a PPG sensing operation to generate a first PPG signal. Fig.17 As shown in FIG. 5 , in order to perform the PPG sensing operation, the panel driver 505 may drive the light-emitting pixels EL_PX of the pixel group 515 located in the adjacent area 580 adjacent to the sensing area 570 (e.g., the adjacent area 580 surrounding the sensing area 570) to emit light, and may drive the light-sensing pixels OPD_PX of the pixel group 515 located in the sensing area 570 to sense the light reflected from the blood vessels of the user's finger. In addition, the readout circuit 550 may generate a first PPG signal based on the sensing current of the light-sensing pixels OPD_PX within the sensing area 570.

[0099] Thereafter, the panel driver 505 may drive the display panel 510 to display at least one tilt guide image requesting tilting of the finger in at least one direction. When the finger is tilted in at least one direction, the panel driver 505 may generate at least one second PPG signal by performing a PPG sensing operation. In addition, the panel driver 505 may select an optimal PPG signal having the highest signal quality among the first PPG signal and the at least one second PPG signal, may determine a biomarker of the user based on the optimal PPG signal, and may drive the display panel 510 to display the biomarker of the user.

[0100] In addition, the panel driver 505 may store optimal guide image information representing a guide image corresponding to an optimal PPG signal among the initial guide image and at least one tilted guide image as an optimal guide image for the user. If the user subsequently requests sensing of a biomarker, the panel driver 505 may drive the display panel 510 to display an optimal guide image for the user based on the optimal guide image information. Therefore, the contact surface between the finger and the sensing area 570 may be optimized for each specific user, the signal quality of the PPG signal may be improved, and the user's biomarker may be accurately sensed.

[0101] Fig.18 is a block diagram illustrating an electronic device 1100 including a display device according to an embodiment.

[0102] Reference Fig.18 , the electronic device 1100 may include a processor 1110, a memory device 1120, a storage device 1130, an input / output (I / O) device 1140, a power supply 1150, and a display device 1160. The electronic device 1100 may also include a plurality of ports for communicating with a video card, a sound card, a memory card, a universal serial bus (USB) device, other electronic devices, and the like.

[0103] The processor 1110 may perform various computing functions or tasks. The processor 1110 may be an application processor (AP), a microprocessor, a central processing unit (CPU), etc. The processor 1110 may be coupled to other components via an address bus, a control bus, a data bus, etc. In addition, in some embodiments, the processor 1110 may also be coupled to an expansion bus such as a peripheral component interconnect (PCI) bus. In one embodiment, the processor 1110 may correspond to the panel driver mentioned above.

[0104] The memory device 1120 may store data for operating the electronic device 1100. For example, the memory device 1120 may include at least one nonvolatile memory device such as an erasable programmable read-only memory (EPROM) device, an electrically erasable programmable read-only memory (EEPROM) device, a flash memory device, a phase change random access memory (PRAM) device, a resistive random access memory (RRAM) device, a nano floating gate memory (NFGM) device, a polymer random access memory (PoRAM) device, a magnetic random access memory (MRAM) device, a ferroelectric random access memory (FRAM) device, etc. and / or at least one volatile memory device such as a dynamic random access memory (DRAM) device, a static random access memory (SRAM) device, a mobile dynamic random access memory (mobile DRAM) device, etc. In one embodiment, the memory device 1120 may store the boot image and image information discussed previously.

[0105] The storage device 1130 may be a solid state drive (SSD) device, a hard disk drive (HDD) device, a CD-ROM device, etc. The I / O device 1140 may be an input device such as a keyboard, a keypad, a mouse, a touch screen, etc. and an output device such as a printer, a speaker, etc. The power supply 1150 may supply power for the operation of the electronic device 1100. The display device 1160 may be coupled to other components via a bus or other communication link.

[0106] In the display device 1160, when the user's finger is located in the sensing area of ​​the display device 1160, a first PPG signal may be generated by performing a PPG sensing operation, at least one second PPG signal may be generated by performing a PPG sensing operation after displaying at least one tilt guide image, an optimal PPG signal among the first PPG signal and the at least one second PPG signal may be selected, and a biomarker of the user may be determined based on the optimal PPG signal. Therefore, the contact surface between the finger and the sensing area may be optimized for each user, the signal quality of the PPG signal may be improved, and the biomarker of the user may be accurately sensed.

[0107] The inventive concept may be applied to any electronic device 1100 including the display device 1160. For example, the inventive concept may be applied to a smart phone, a wearable electronic device, a mobile phone, a television (TV) (e.g., a digital TV or a 3D TV), a personal computer (PC) (such as a tablet computer or a laptop computer), a home appliance, a personal digital assistant (PDA), a portable multimedia player (PMP), a digital camera, a music player, a portable game console, a navigation device, etc.

[0108] In one or more embodiments, the guide images described herein (e.g., right tilt, left tilt, upward tilt, downward tilt, upward movement, downward movement, etc.) may generally be referred to as finger adjustment images. The finger adjustment image may include any of the tilt or movement guide images previously discussed, and corresponding PPG signals may be generated and compared to determine the optimal PPG signal.

[0109] The method, technology and / or operation described in this article can be performed by the code or instruction executed by a computer, processor, controller or other signal processing device. The computer, processor, controller or other signal processing device can be those described in this article, or a kind of except the element described in this article. Because the algorithm forming the basis of the method (or the operation of a computer, processor, controller or other signal processing device) is described in detail, the code or instruction for realizing the operation of the method embodiment can convert a computer, processor, controller or other signal processing device into a special processor for performing the method in this article.

[0110] In addition, another embodiment may include a computer-readable medium, such as a non-transitory computer-readable medium, for storing the above code or instructions. The computer-readable medium may be a volatile or non-volatile memory or other storage device, which may be removably or fixedly coupled to a computer, processor, controller or other signal processing device that executes the code or instructions for performing the operations of the method embodiments or apparatus embodiments herein.

[0111] The controllers, processors, drivers, circuits, and other signal generation and signal processing features of the embodiments disclosed herein may be implemented, for example, in non-transitory logic, which may include hardware, software, or both. When implemented at least in part in hardware, the controllers, processors, drivers, circuits, and other signal generation and signal processing features may be, for example, any of a variety of integrated circuits, including but not limited to application specific integrated circuits, field programmable gate arrays, logic gate combinations, systems on chips, microprocessors, or other types of processing or control circuits. In some embodiments, these features may be implemented by neural networks, machine learning logic, or other forms of artificial intelligence.

[0112] When implemented at least in part in software, controllers, processors, drivers, circuits, and other signal generation and signal processing features may include, for example, a memory or other storage device for storing codes or instructions executed by, for example, a computer, processor, microprocessor, controller, or other signal processing device. The computer, processor, microprocessor, controller, or other signal processing device may be those described herein, or one in addition to the elements described herein. Because the algorithms that form the basis of the method (or the operation of a computer, processor, microprocessor, controller, or other signal processing device) are described in detail, the code or instructions for implementing the operation of the method embodiment can convert the computer, processor, controller, or other signal processing device into a dedicated processor for performing the method described herein.

[0113] The foregoing is an illustration of the embodiments and should not be construed as limiting them. Although some embodiments have been described, it will be readily appreciated by those skilled in the art that various modifications may be made to the embodiments without substantially departing from the novel teachings and advantages of the inventive concept. Therefore, all such modifications are intended to be included within the scope of the inventive concept as defined in the claims. Therefore, it should be understood that the foregoing is an illustration of various embodiments and should not be construed as being limited to the specific embodiments disclosed, and modifications to the disclosed embodiments and other embodiments are intended to be included within the scope of the appended claims. These embodiments may be combined to form additional embodiments.

Claims

1. A method for providing a biomarker by a display device, wherein: The method comprises: displaying an initial guiding image guiding a user to place a finger in a sensing area of ​​the display device; generating a first photoplethysmographic signal by performing a photoplethysmographic sensing operation when the finger is located in the sensing area; displaying at least one tilt guide image requesting the user to tilt the finger in at least one direction; generating at least one second photoplethysmographic signal by performing the photoplethysmographic sensing operation when the finger is tilted in the at least one direction in the sensing area; selecting an optimal photoplethysmographic signal having the highest signal quality among the first photoplethysmographic signal and the at least one second photoplethysmographic signal; and A biomarker of the user determined based on the optimal photoplethysmographic signal is displayed.

2. The method according to claim 1, wherein: The display panel of the display device includes light-emitting pixels having light-emitting elements and light-sensing pixels having organic photodiodes, and The photoplethysmography sensing operation is performed so that the light emitting pixels emit light and the light sensing pixels sense light reflected from blood vessels of the finger.

3. The method according to claim 1, wherein: The displaying the at least one oblique guide image comprises: displaying a left-side tilt guide image requesting the user to tilt the finger to the left; and A right tilt guide image requesting the user to tilt the finger to the right is displayed.

4. The method according to claim 3, wherein: Generating the at least one second photoplethysmographic signal comprises: When the finger is tilted toward the left side, generating a left-side tilt photoplethysmographic signal by performing the photoplethysmographic sensing operation; and When the finger is tilted to the right side, a right tilt photoplethysmographic signal is generated by performing the photoplethysmographic sensing operation.

5. The method according to claim 4, wherein: The selecting the optimal photoplethysmography signal comprises: comparing the amplitude of the AC component of the first photoplethysmographic signal, the amplitude of the AC component of the left oblique photoplethysmographic signal, and the amplitude of the AC component of the right oblique photoplethysmographic signal; and The optimal photoplethysmographic signal having the largest AC component among the first photoplethysmographic signal, the left oblique photoplethysmographic signal, and the right oblique photoplethysmographic signal is selected.

6. The method according to claim 3, wherein: The displaying the at least one oblique guide image further comprises: displaying an upward tilt guide image requesting the finger to be tilted upward; and A downward tilt guide image requesting the finger to be tilted downward is displayed.

7. The method according to claim 6, wherein: Generating the at least one second photoplethysmographic signal comprises: When the finger is tilted toward the left side, generating a left-side tilt photoplethysmographic signal by performing the photoplethysmographic sensing operation; When the finger is tilted toward the right side, generating a right-side tilt photoplethysmographic signal by performing the photoplethysmographic sensing operation; When the finger is tilted upward, generating an upward tilt photoplethysmographic signal by performing the photoplethysmographic sensing operation; and When the finger is tilted downward, a downward tilt photoplethysmographic signal is generated by performing the photoplethysmographic sensing operation.

8. The method according to claim 7, wherein: The selecting the optimal photoplethysmography signal comprises: comparing the amplitude of the AC component of the first photoplethysmographic signal, the amplitude of the AC component of the left-side tilted photoplethysmographic signal, the amplitude of the AC component of the right-side tilted photoplethysmographic signal, the amplitude of the AC component of the upward tilted photoplethysmographic signal, and the amplitude of the AC component of the downward tilted photoplethysmographic signal; and The optimal photoplethysmographic signal having the largest AC component among the first photoplethysmographic signal, the left-side tilted photoplethysmographic signal, the right-side tilted photoplethysmographic signal, the upward tilted photoplethysmographic signal, and the downward tilted photoplethysmographic signal is selected.

9. The method according to claim 1, wherein: The method further comprises: displaying at least one movement guide image requesting movement of the finger; and When the finger moves, at least one third photoplethysmographic signal is generated by performing the photoplethysmographic sensing operation.

10. The method according to claim 9, wherein: The displaying the at least one oblique guide image comprises: displaying a left-side tilt guide image requesting the finger to be tilted to the left; and displaying a right tilt guide image requesting the finger to be tilted to the right, And wherein, displaying the at least one moving guide image comprises: displaying an upward movement guide image requesting the user to move the finger upward; and A downward movement guide image requesting the user to move the finger downward is displayed.

11. The method according to claim 10, wherein: Generating the at least one second photoplethysmographic signal comprises: When the finger is tilted toward the left side, generating a left-side tilt photoplethysmographic signal by performing the photoplethysmographic sensing operation; and When the finger is tilted to the right side, a right tilt photoplethysmographic signal is generated by performing the photoplethysmographic sensing operation, and wherein the generating the at least one third photoplethysmographic signal comprises: When the finger is moved upward, generating an upward-movement photoplethysmographic signal by performing the photoplethysmographic sensing operation; and When the finger is moved downward, a downward-moving photoplethysmographic signal is generated by performing the photoplethysmographic sensing operation.

12. The method according to claim 11, wherein: The selecting the optimal photoplethysmography signal comprises: comparing the amplitude of the AC component of the first photoplethysmographic signal, the amplitude of the AC component of the left-side tilted photoplethysmographic signal, the amplitude of the AC component of the right-side tilted photoplethysmographic signal, the amplitude of the AC component of the upward-moving photoplethysmographic signal, and the amplitude of the AC component of the downward-moving photoplethysmographic signal; and The optimal photoplethysmographic signal having the largest AC component among the first photoplethysmographic signal, the left-side oblique photoplethysmographic signal, the right-side oblique photoplethysmographic signal, the upward-moving photoplethysmographic signal, and the downward-moving photoplethysmographic signal is selected.

13. The method according to claim 1, wherein: The displaying the biomarker of the user comprises: At least one of the user's blood pressure, heart rate, stress level, and cardiovascular health determined based on the optimal photoplethysmographic signal is displayed.

14. The method according to claim 1, wherein: The method further comprises: Optimal guide image information indicating an optimal guide image for the user is stored, wherein the optimal guide image is a guide image corresponding to the optimal photoplethysmographic signal among the initial guide image and the at least one tilted guide image.

15. The method according to claim 14, wherein: The method further comprises: when the user subsequently requests sensing of the biomarker, displaying the optimal guidance image for the user based on the optimal guidance image information; generating a subsequent photoplethysmographic signal by performing said photoplethysmographic sensing operation; and The biomarker of the user determined based on the subsequent photoplethysmographic signal is displayed.

16. A display device, wherein: The display device comprises: A display panel including a plurality of pixel groups, each of the plurality of pixel groups including a light emitting pixel having a light emitting element and a light sensing pixel having an organic photodiode; and a panel driver configured to drive the display panel, Wherein, the panel driver is configured as follows: driving the display panel to display an initial guide image guiding a user to place a finger in a sensing area of ​​the display panel; generating a first photoplethysmographic signal by performing a photoplethysmographic sensing operation when the finger is located in the sensing area; driving the display panel to display at least one tilt guide image requesting the user to tilt the finger in at least one direction; generating at least one second photoplethysmographic signal by performing the photoplethysmographic sensing operation when the finger is tilted in the at least one direction in the sensing area; selecting an optimal photoplethysmographic signal having the highest signal quality among the first photoplethysmographic signal and the at least one second photoplethysmographic signal; and The display panel is driven to display a biomarker of the user determined based on the optimal photoplethysmographic signal.

17. A method for providing a biomarker by a display device, wherein: The method comprises: generating a first bio-signal based on a sensing operation performed with respect to a finger of a user on a display screen; Displaying a finger adjustment image on the display screen to guide the user to adjust the position of the finger; generating a second bio-signal based on a sensing operation performed with respect to the adjusted position of the finger; selecting the first bio-signal or the second bio-signal; and A biomarker is displayed in the display screen based on the selected first biosignal or the second biosignal.

18. The method according to claim 17, wherein: Each of the first biosignal and the second biosignal is a photoplethysmographic signal.

19. The method according to claim 17, wherein: The selecting the first biological signal or the second biological signal comprises: determining a signal quality of the first bio-signal; determining a signal quality of the second bio-signal; comparing the signal quality of the first bio-signal with the signal quality of the second bio-signal; and selecting the second bio-signal based on the comparison, and The second biological signal has a higher signal quality than the first biological signal.

20. The method according to claim 17, wherein: The finger adjustment image guides the user to tilt or move the finger.

Images