Device and method for providing image-based cardiovascular bio-information or user information based thereon

Abstract

The present invention proposes a device for outputting image-based cardiovascular bio-information or user information based thereon. The device may comprise: a memory configured to store a code for outputting the image-based cardiovascular bio-information or the user information based thereon; and a processor configured to execute the code for performing an operation for outputting the image-based cardiovascular bio-information or the user information based thereon, wherein the operation comprises acquiring a user's cardiovascular bio-information estimated from a captured image of a body part including the user's face or acquiring a physical health index based on the user's cardiovascular bio-information, and outputting the cardiovascular bio-information or the physical health index to a display.

Description

Device for providing image-based cardiovascular biometric information or user information based thereon, and method for providing the same

[0001] The present invention relates to an apparatus and a method for providing image-based cardiovascular bio-information or user information based thereon. More specifically, the invention relates to an apparatus and a method for providing a user’s rPPG (remote photoplethysmography) obtained from an image, the user’s cardiovascular bio-information obtained therefrom, or user information derived from the cardiovascular bio-information (e.g., user condition information) through an interface such as a display.

[0002] rPPG (remote photoplethysmography) refers to a technology that measures physiological signals, such as heart rate, in a non-contact manner. This technology is based on the principle of tracking blood flow by analyzing changes in light reflected from the skin.

[0003] Specific color changes (primarily in the green channel) are analyzed in images captured by a camera through the skin surface, and these color changes occur as the amount of blood in the skin changes with the heartbeat.

[0004] Sophisticated algorithms are used on captured image data to remove noise (movement, lighting changes, etc.) and extract periodic signals corresponding to blood flow.

[0005] rPPG offers high user convenience as it does not require sensors to be attached to the skin, and allows for various applications as measurements can be taken using smartphones, webcams, or CCTVs. Furthermore, it is safe and simple as it does not directly touch the body while measuring biosignals.

[0006] Therefore, recently, it is being used or applied in fields such as healthcare for health monitoring by measuring heart rate, blood pressure, and stress levels; fitness for analyzing heart rate and physical condition during exercise; and security monitoring and emotional state analysis by identifying stress or tension.

[0007] rPPG technology is continuously advancing and evolving into a system capable of more accurate and real-time applications when combined with artificial intelligence.

[0008] Figure 1 is a diagram illustrating the principle of heart rate detection using PPG (Photoplethysmography).

[0009] PPG is a non-invasive optical technology that is a method for acquiring physiological signals to measure the body's blood flow behaviors resulting from changes in blood volume. PPG is primarily based on the principle of detecting changes in reflected or transmitted light after irradiating the skin with infrared (IR) or visible light. Referring to Fig. 1, the process of acquiring an analog signal is illustrated in which a light source (LED) is irradiated toward the skin, and a photodetector (PD) detects light reflected from hemoglobin in the blood.

[0010] This utilizes the principle of detecting periodic changes in blood flow according to the heartbeat by utilizing the light absorption characteristics of blood.

[0011]

[0012] Meanwhile, while heart rate is a representative cardiovascular biometric information obtained from PPG or rPPG, the following biometric information in addition to heart rate may be included in the cardiovascular biometric information.

[0013] - Heart Rate Variability (HRV)

[0014] - Blood oxygen saturation (SpO₂)

[0015] - Respiratory Rate (RR)

[0016] - Pulse Wave Velocity (PWV)

[0017] - Blood Pressure (BP)

[0018] - Vascular Compliance & Volume Changes

[0019] - Stress Index

[0020] - Cardiac Output (CO)

[0021] Derived Cardiac Indices

[0022] - Macpa analysis-based indicators

[0023] In addition to the information listed above, fatigue index, circulatory health, blood pressure, etc., may be included in the cardiovascular bio-information obtained from PPG or rPPG.

[0024]

[0025] Figure 2 is a diagram illustrating the principle of rPPG. Basically, rPPG is the same as PPG, but differs in that it is non-contact. Referring to Figure 2, it can be seen that both the light source and the sensor (camera) are separated from the skin.

[0026] Similar to PPG, by monitoring components of external light that are absorbed and scattered within the skin and reflected to the camera (diffused reflection) in addition to components reflected from the skin surface, heart rate information caused by minute changes in blood flow on the skin surface can be detected.

[0027] Various cardiovascular biometric information can be estimated or obtained using rPPG extracted from an image of a user. This specification proposes a means for providing the user with the obtained cardiovascular biometric information or information for the user based thereon.

[0028] The present invention aims to provide a device and method for providing a user with cardiovascular bio-information obtained from an image or information for the user based thereon.

[0029] The problems to be solved by the present invention are not limited to the problems to be solved above, and other problems not mentioned will be clearly understood by those skilled in the art to which the present invention belongs from the description below.

[0030] According to the present invention, an apparatus for outputting image-based cardiovascular bio-information or user information based thereon is proposed, wherein the apparatus comprises: a memory configured to store code for outputting the image-based cardiovascular bio-information or user information based thereon; and a processor configured to execute the code for performing an operation for outputting the image-based cardiovascular bio-information or user information based thereon, wherein the operation may include obtaining a user’s cardiovascular bio-information estimated from an image of a body part including the user’s face, obtaining a body health index based on the user’s cardiovascular bio-information, and outputting the cardiovascular bio-information or the body health index to a display.

[0031] Additionally or alternatively, the operation may include outputting to the display the progress rate of the process of acquiring the cardiovascular bio-information or the progress rate of the process of acquiring the body health index based on the user's cardiovascular bio-information while acquiring the user's cardiovascular bio-information.

[0032] Additionally or alternatively, the operation may include detecting the user's movement while acquiring the user's cardiovascular biometric information or acquiring a body health index based on the user's cardiovascular biometric information; and outputting a warning or posture guide to the display when the acquisition of the cardiovascular biometric information is impossible due to the user's movement or when the accuracy of the acquired cardiovascular biometric information is lower than a threshold.

[0033] Additionally or alternatively, the cardiovascular biometric information can be acquired at preset intervals.

[0034] Additionally or alternatively, the cardiovascular bio-information can be acquired from a preset number of image frames over a preset period of time.

[0035] Additionally or alternatively, the above-mentioned preset number of image frames may include non-consecutive image frames.

[0036] Additionally or alternatively, the above operation may include identifying the user from an image of a body part including the user's face.

[0037] Additionally or alternatively, the operation may include matching the user's identification information with the cardiovascular biometric information or the body health index.

[0038] Additionally or alternatively, the above operation may include storing the cardiovascular bio-information or the body health index in the memory or a wired or wirelessly connected server.

[0039] Additionally or alternatively, the operation may include collecting the cardiovascular biometric information or the physical health index over time for individual users and generating pattern information for the collected cardiovascular biometric information or physical health index.

[0040] Additionally or alternatively, the operation may include estimating the cardiovascular bio-information or the body health index according to the generated pattern information.

[0041] Additionally or alternatively, the operation may include collecting the cardiovascular biometric information or the physical health index over time for an individual user, and outputting an alarm message to the display if the collected acquired cardiovascular biometric information or physical health index deteriorates over time.

[0042] Additionally or alternatively, the operation may include outputting to the display a user interface that guides a recommendation service corresponding to the cardiovascular bio-information or the body health index.

[0043] Additionally or alternatively, the above operation may include providing a recommendation service corresponding to the cardiovascular bio-information or the body health index.

[0044] Additionally or alternatively, the recommendation service may be determined based on the history information of the user's cardiovascular biometric information or physical health index and the corresponding service history information.

[0045] Additionally or alternatively, the device may further include a camera configured to photograph body parts including the user's face.

[0046] A method for outputting image-based cardiovascular bio-information or user information based thereon is proposed according to another embodiment of the present invention, wherein the method may include the steps of: obtaining a user’s cardiovascular bio-information estimated from an image of a body part including the user’s face, or obtaining a body health index based on said user’s cardiovascular bio-information; and outputting said cardiovascular bio-information or said body health index to a display.

[0047] In addition, a computer-readable medium is proposed that stores code configured to be executed by a computer or processor for a method to output image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0048] The above-mentioned problem-solving methods are merely some of the embodiments of the present invention, and various embodiments reflecting the technical features of the present invention can be derived and understood by those skilled in the art based on the detailed description of the present invention to be described below.

[0049] The present invention has the following technical effects.

[0050] The present invention can provide the user with status information based on their cardiovascular bio-information.

[0051] In addition, the present invention can provide the user with status information based on their cardiovascular bio-information over time.

[0052] In addition, the present invention provides a recommendation service to the user that enables them to change their cardiovascular bio-information-based status information, thereby inducing a change in the user's cardiovascular bio-information-based status information.

[0053] The effects according to the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the following detailed description of the invention.

[0054] The accompanying drawings, which are included as part of the detailed description to aid in understanding the present invention, provide embodiments of the present invention and explain the technical concept of the present invention together with the detailed description.

[0055] Figure 1 is a diagram illustrating the principle of heart rate detection using PPG.

[0056] Figure 2 is a diagram illustrating the principle of rPPG.

[0057] FIG. 3 shows a flowchart of a method for providing image-based cardiovascular bio-information or user information based thereon according to the present invention.

[0058] FIG. 4 illustrates an example of a user interface for providing image-based cardiovascular bio-information or user information based thereon according to an embodiment of the present invention.

[0059] FIG. 5 illustrates an example of an interface for inputting user body information to provide image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0060] FIG. 6 illustrates an example of a user interface provided in the process of acquiring image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0061] FIG. 7 illustrates an example of a user interface for providing image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0062] FIG. 8 shows a flowchart of a method for outputting image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0063] FIG. 9 illustrates an example of a user interface for providing image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0064] FIGS. 10 to 12 illustrate examples of user interfaces for providing image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0065] FIG. 13 illustrates the transmission flow of image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0066] FIG. 14 illustrates a block diagram of a device for providing image-based cardiovascular bio-information or user information based thereon according to the present invention.

[0067] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols will be assigned the same reference number, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles. Furthermore, in describing embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and technical scope of the present invention.

[0068] Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.

[0069] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0070] A singular expression includes a plural expression unless the context clearly indicates otherwise.

[0071] In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0072]

[0073] FIG. 3 shows a flowchart of a method for providing image-based cardiovascular bio-information or user information based thereon according to the present invention. The method illustrated in FIG. 3 may be performed by a device or processor thereof for providing image-based cardiovascular bio-information or user information based thereon. A description of a device for providing image-based cardiovascular bio-information or user information based thereon will be provided later with reference to FIG. 14. Hereinafter, it will be simply described that the device (10) performs an operation for providing image-based cardiovascular bio-information or user information based thereon.

[0074] The device (10) may be configured to identify a user (S310). This is to provide cardiovascular biometric information or user information based thereon to each user when the device (10) is available for use or access by multiple users. User identification may be performed through the processing of an image of the user, which may be included in an image for measuring the user's condition, which will be described later, or may be an image acquired separately.

[0075] When a user is identified, the device (10) may be configured to output the user's past or most recently acquired cardiovascular biometric information or user information based thereon through a display or a user interface on the display. Referring to FIG. 4, a user interface (1) according to one embodiment of the present invention is shown, in which the user's past or most recent cardiovascular biometric information (13, 14) and user information based thereon (i.e., physical health index) (12) are provided therein.

[0076] Additionally, the user interface (1) may include a message interface (11) for interaction with the user to induce the user to input commands to obtain and output cardiovascular bio-information or user information based thereon.

[0077] Additionally, the user interface (1) may include a message interface (18) for interaction with the user, and in FIG. 4, it is shown as being output in a manner that is overlaid on the user interface (16) for outputting the appearance of the user.

[0078] Additionally, the user interface (1) includes a user interface (15) for inputting user body information necessary to obtain cardiovascular bio-information or user information. When a user's touch input or other input is applied to the user interface (15), a user interface (151) for inputting user body information is displayed on a display, and FIG. 5 corresponds to an example thereof.

[0079] Additionally, the user interface (1) includes a user interface (16) for outputting the image of the user obtained through a camera.

[0080] Additionally, the user interface (1) includes an interface (17) for input control to initiate the acquisition of cardiovascular bio-information or user information. When a user's touch input or other input is applied to the interface (17), the acquisition of image-based cardiovascular bio-information or user information may be initiated.

[0081]

[0082] Returning to FIG. 3, the device (10) can be configured to acquire an image of the user and measure the user's condition from the acquired image (S320).

[0083] The acquired image may be a photograph of a body part including the user's face.

[0084] Additionally, in the present invention, the user's state measured from the acquired image may include the user's cardiovascular biometric information or a physical health index based on the user's cardiovascular biometric information. This may be information derived from rPPG acquired from the image. The physical health index acquired based on cardiovascular biometric information may be simply referred to as user information in this specification.

[0085] The device (10) may be configured to output the progress of the process of acquiring cardiovascular bio-information or the progress of the process of acquiring the body health index based on the user's cardiovascular bio-information to a display while acquiring the user's cardiovascular bio-information or acquiring the user's cardiovascular bio-information-based body health index. As an example, referring to FIGS. 4 and FIGS. 6, the user's real-time appearance may be displayed on the user interface (16), and a display interface (161) for displaying the progress may be set up and displayed around it. The device (10) may be configured to display the progress of the process of acquiring cardiovascular bio-information by filling the display interface (161) with a preset color, hatching, or pattern.

[0086] Additionally, time is required to acquire the user's cardiovascular biometric information or to acquire the user's cardiovascular biometric information-based physical health index. Accordingly, while acquiring the user's cardiovascular biometric information or the physical health index, the user's appearance may be displayed on the user interface (16), and the progress of the acquisition process described above may be displayed on the display interface (161).

[0087] Additionally, the device (10) may be configured to determine whether it is impossible to obtain the user's cardiovascular bio-information or the accuracy of the obtained cardiovascular bio-information based on the user's movement. If the user's movement makes it impossible to obtain the user's cardiovascular bio-information or if the accuracy of the obtained cardiovascular bio-information is lower than a threshold, the device (10) may be configured to output a warning to the user or a posture guide for the user on the display.

[0088] Additionally, the device (10) may be configured to acquire the user's condition at preset intervals. That is, the user's cardiovascular biometric information or a physical health index based on the user's cardiovascular biometric information may be acquired at preset intervals.

[0089] Additionally, the device (10) may be configured to use a preset number of image frames to acquire the user's cardiovascular biometric information or physical health index. For example, N image frames may be used to acquire the user's cardiovascular biometric information or physical health index (wherein N is an integer greater than or equal to 1). When multiple image frames are used to acquire the user's cardiovascular biometric information or physical health index, the multiple image frames may be non-continuous. For example, when a camera captures the user at 30fps, an image frame may be acquired every 1 / 30 sec, but the image acquired at 1 / 30 sec intervals is not necessarily used to acquire the user's cardiovascular biometric information or physical health index.

[0090] Additionally, the device (10) may be configured to acquire cardiovascular biometric information for multiple users or a body health index based on cardiovascular biometric information.

[0091] The device (10) may require a preset time to acquire the user's cardiovascular biometric information or physical health index. That is, a preset time may be required to acquire the user's cardiovascular biometric information or physical health index from an image.

[0092] In this case, the device (10) may be configured to process or analyze a plurality of image frames acquired during a preset time, and to stop the cardiovascular bio-information acquisition procedure if a user is not detected in a specific image frame.

[0093]

[0094] Additionally, the device (10) may be configured to match user identification information with the acquired user's cardiovascular biometric information or the acquired user's physical health index. Here, matching indicates linking the user identification information with the cardiovascular biometric information or the physical health index. That is, it is intended to specify or identify which user the acquired user's cardiovascular biometric information or the acquired user's physical health index belongs to.

[0095] Meanwhile, the device (10) may be configured to identify the user from the acquired image. That is, in this case, S310 and S320 may be integrated.

[0096] Meanwhile, the device (10) can acquire the user's cardiovascular biometric information or the user's physical health index on a per-user basis. Additionally, the device (10) can be configured to collect the user's cardiovascular biometric information or the user's physical health index over time. Referring to FIG. 7, the user's overall condition score, which is a type of physical health index over time, is shown. The device (10) can be configured to generate pattern information regarding the collected cardiovascular biometric information or physical health index.

[0097] For example, pattern information can be represented quantitatively as follows. This may be a value obtained by averaging the previously acquired physical health index values ​​by day of the week.

[0098] Day of the Week Overall Condition Score Sun 90 Mon 55 Tue 50 Wed 65 Thu 70 Fri 80 Sat 95

[0099] For example, pattern information can be represented quantitatively as follows. This may be a value obtained by averaging the previously acquired physical health index values ​​on a monthly basis.

[0100] Monthly Overall Condition Score Jan 45 Feb 55 Mar 65 Apr 65 May 70 Jun 80… …

[0101] Additionally, the device (10) may be configured to generate a message to guide the user to the generated pattern information and output it to a display or a user interface on the display.

[0102]

[0103] Additionally, the device (10) may be configured to estimate cardiovascular biometric information or a physical health index according to the generated pattern information. Accordingly, instead of performing image-based measurements of the user's state, the device (10) may provide an estimate of the current user's cardiovascular biometric information or physical health index. Alternatively, as illustrated in FIG. 8, the device (10) may be configured to output a message to a message interface (111) containing content based on the current user's cardiovascular biometric information or physical health index.

[0104] Additionally, the device (10) may be configured to generate trend information of the user's cardiovascular biometric information or physical health index using the user's cardiovascular biometric information or the user's physical health index collected over time. If the generated trend information indicates that the user's cardiovascular biometric information or physical health index is deteriorating over time, the device (10) may be configured to output an alarm message to a display or a user interface on the display. Additionally, if the generated trend information indicates that the user's cardiovascular biometric information or physical health index is improving over time, the device (10) may be configured to output an encouragement or congratulatory message to a display or a user interface on the display.

[0105]

[0106] The device (10) may be configured to output the results of the measured user state through a display or a user interface on the display (S330). That is, the device (10) may be configured to output the acquired user's cardiovascular bio-information or the acquired user's physical health index to a display or a user interface on the display, etc. Referring to FIG. 9, an example of a user interface according to an embodiment of the present invention is illustrated.

[0107] Referring to FIG. 9, the user interface (1) may include a message interface (11) for interaction with the user. Additionally, the user interface (1) may display a comparison display (141) of the acquired user's cardiovascular biometric information (13, 14) and the past or most recently acquired cardiovascular biometric information and the current cardiovascular biometric information, such as an arrow indicating whether it has improved or worsened, to the left of each individual piece of cardiovascular biometric information.

[0108] Additionally, the user interface (1) includes a user interface (16) for outputting the image of the user obtained through a camera.

[0109] Additionally, the user interface (1) includes an interface (171) for input control to restart the acquisition of cardiovascular bio-information or user information. Additionally, the user interface (1) includes an interface (172) for input control to terminate the acquisition of cardiovascular bio-information or user information. When a user's touch input or other input is applied to the interfaces (171, 172), the acquisition of image-based cardiovascular bio-information or user information may be restarted or terminated.

[0110] Additionally, the user interface (1) may include a message interface (19) for interaction with the user, and in FIG. 9, it is shown as being output in a manner that is overlaid on the user interface (16) for outputting the appearance of the user.

[0111] Additionally, the user interface (1) includes a user interface (15) for inputting user body information necessary to obtain cardiovascular bio-information or user information. When a user's touch input or other input is applied to the user interface (15), a user interface (151) for inputting user body information is displayed on a display, and FIG. 5 corresponds to an example thereof.

[0112]

[0113] Meanwhile, the device (10) may be configured to store the acquired cardiovascular bio-information or body health index in the memory of the device (10) or in a server connected to the device (10) via wired or wireless connection.

[0114]

[0115] The device (10) may be configured to output a suggestion to guide a recommendation service corresponding to the acquired cardiovascular bio-information or acquired user information (or physical health index) to a display or a user interface on the display (S340). Alternatively, the device (10) may be configured to automatically provide a recommendation service corresponding to the acquired cardiovascular bio-information or acquired user information (or physical health index).

[0116] In this specification, the recommendation service may include any one of the following: launching an app for the user, playing video or audio content, or changing the background image of the display of the user device. Additionally or alternatively, the recommendation service may include at least one contact in the address book stored on the user device or contacting at least one contact. Additionally or alternatively, the recommendation service may include displaying any one of the photos (images) stored on the user device or displaying them on a user interface on the display. Additionally or alternatively, the recommendation service may include displaying keywords or displaying them on a user interface on the display. Additionally or alternatively, the recommendation service may include physical activity for the user. For example, physical activity such as stretching, jogging, or walking may be included. Referring to FIG. 10, the user interface (1) includes a message interface (112) for suggesting rest to the user as a recommendation service.

[0117] Meanwhile, although a user device has been mentioned, in most embodiments, the user device may be integrated with the device (10), included in the device (10), or be an object equivalent to the device (10). For example, the user device may be a laptop computer, and the laptop computer or the processor mounted thereon may correspond to the aforementioned device (10).

[0118] Meanwhile, the recommendation service may be determined based on cardiovascular biometric information or physical health index previously acquired for the user, that is, historical information of the cardiovascular biometric information or physical health index. Alternatively, the recommendation service may be determined based on historical information of services executed by the user on the user's device. Alternatively, the recommendation service may be determined based on historical information of the user's cardiovascular biometric information or physical health index and historical information of the corresponding service.

[0119] For example, if the acquired user's cardiovascular biometric information or physical health index indicates fatigue, depression, etc., the recommendation service may be determined as one of the services executed on the user's device when vitality, enjoyment, etc. are indicated based on the user's past history.

[0120] Referring to FIG. 11, the user interface (1) includes a message interface (113) for suggesting the playback of video content to the user as a recommendation service. Additionally, the user interface (1) includes an interface (114) for displaying a list of video content.

[0121]

[0122] Meanwhile, the method for providing image-based cardiovascular bio-information or user information based thereon according to the present invention, as described with reference to FIG. 3, can be performed repeatedly. As a variation, referring to FIG. 12, the process returns to acquiring an image again and measuring the user's condition (S320) after S330 or S340. This corresponds to the feature described above where the user's cardiovascular bio-information is acquired at preset intervals.

[0123]

[0124] Meanwhile, the operation of the device (10) described above may be performed by executing code to output image-based cardiovascular bio-information or user information based thereon. In this case, the device (10) may include a memory configured to store code to output image-based cardiovascular bio-information or user information based thereon.

[0125]

[0126] FIG. 13 illustrates the transmission flow of image-based cardiovascular bio-information or user information based thereon according to another embodiment of the present invention.

[0127] The device (10) may be configured to transmit the user's cardiovascular biometric information or user information (or physical health index) measured or acquired by the device (10) to a server (30) connected via wired or wireless communication. Additionally, the server (30) may be configured to transmit the user's cardiovascular biometric information or user information (or physical health index) received from the device (10) to a third device (20) connected via wired or wireless communication.

[0128] The acquired user's cardiovascular biometric information or user information (or physical health index) is uploaded to the server (30) and can be downloaded from another device owned by the user, namely the third device (20). Through this, the user can access their cardiovascular biometric information or physical health index, etc., regardless of location or device, and can also measure, acquire, and store it.

[0129] The server (30) may include not only physical devices but also virtual devices.

[0130]

[0131] FIG. 14 illustrates a block diagram of a device for providing image-based cardiovascular bio-information or user information based thereon according to the present invention.

[0132] The device (10) may include a memory (100) configured to store an algorithm or protocol for outputting image-based cardiovascular bio-information or user information based thereon. Additionally, the memory (100) may store an algorithm or protocol capable of obtaining cardiovascular bio-information or user information based thereon from an image.

[0133] The device (10) may include a processor (101) configured to execute an algorithm or protocol for performing an operation to output image-based cardiovascular bio-information or user information based thereon. The processor (101) may be configured to obtain the user's cardiovascular bio-information estimated from an image of a body part including the user's face, or to obtain a body health index based on the user's cardiovascular bio-information.

[0134] Additionally, the device (10) may include a display (102) configured to output the acquired user's cardiovascular biometric information or physical health index.

[0135] The processor (101) may be configured to output the progress of the process of acquiring cardiovascular bio-information or the progress of the process of acquiring the body health index based on the user's cardiovascular bio-information to the display (102) while acquiring the user's cardiovascular bio-information or acquiring the user's cardiovascular bio-information-based body health index.

[0136] The processor (101) may be configured to detect the user's movement while acquiring the user's cardiovascular biometric information or acquiring the user's cardiovascular biometric information-based physical health index. Additionally, the processor (101) may be configured to determine whether the acquisition of cardiovascular biometric information is impossible due to the user's movement or whether the accuracy of the acquired cardiovascular biometric information is lower than a threshold. The processor (101) may be configured to output a warning or posture guide to the display (102) depending on whether the acquisition of cardiovascular biometric information is impossible due to the user's movement or whether the accuracy of the acquired cardiovascular biometric information is lower than a threshold.

[0137] The processor (101) may be configured to acquire cardiovascular bio-information at preset intervals. Alternatively, cardiovascular bio-information may be acquired from a preset number of image frames over a preset period of time. In this case, the preset number of image frames may include non-continuous image frames.

[0138] The processor (101) may be configured to identify the user from an image of a body part including the user's face. Additionally, the processor (101) may be configured to match the user's identification information with cardiovascular biometric information or a physical health index.

[0139] The processor (101) may be configured to store cardiovascular bio-information or a body health index in the memory or a server connected via wired or wireless connection.

[0140] The processor (101) may be configured to collect cardiovascular biometric information or physical health indices over time for individual users. Additionally, the processor (101) may be configured to generate pattern information for the collected cardiovascular biometric information or physical health indices.

[0141] The processor (101) may be configured to estimate cardiovascular bio-information or a body health index according to the generated pattern information.

[0142] The processor (101) may be configured to collect cardiovascular biometric information or physical health index over time for individual users and to output an alarm message to the display (102) if the collected acquired cardiovascular biometric information or physical health index deteriorates over time.

[0143] The processor (101) may be configured to output a user interface to the display (102) that guides a recommendation service corresponding to cardiovascular bio-information or a physical health index.

[0144] The processor (101) may be configured to provide a recommendation service corresponding to cardiovascular biometric information or a physical health index. Specifically, the processor (101) may be configured to output a user interface for guidance or suggestion of the recommendation service to a display (102). Here, the recommendation service may be determined based on the history information of the user's cardiovascular biometric information or physical health index and the corresponding service history information.

[0145] Additionally, the device (10) may include a camera (103) configured to photograph body parts including the user's face.

[0146]

[0147] Even if not described with reference to FIG. 14, the device (10) of the present invention may perform the operation according to the present invention as described above in FIG. 1 to FIG. 13.

[0148]

[0149] In addition, as another aspect of the present invention, the operation of the above-described proposal or invention may be provided as code that can be implemented, practiced, or executed by a "computer" (a comprehensive concept including a system on chip (SoC) or (micro)processor, etc.), or as a computer-readable storage medium or computer program product that stores or contains said code, and the scope of the present invention may be extended to said code or as a computer-readable storage medium or computer program product that stores or contains said code.

[0150]

[0151] The detailed description of the preferred embodiments of the present invention disclosed above is provided to enable those skilled in the art to implement and practice the present invention. Although the present invention has been described with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the present invention as described in the following claims. Accordingly, the present invention is not intended to be limited to the embodiments shown herein, but to be given the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. A device for providing image-based cardiovascular biometric information or user information based thereon, A memory configured to store code for outputting the above-mentioned image-based cardiovascular bio-information or user information based thereon; and It includes a processor configured to execute the code for performing an operation to output the above-mentioned image-based cardiovascular bio-information or user information based thereon, and The above operation is: Acquiring the user's cardiovascular biometric information estimated from an image of a body part including the user's face, or acquiring a body health index based on the user's cardiovascular biometric information, A device comprising outputting the above cardiovascular bio-information or the above physical health index to a display.

2. In paragraph 1, the above operation is: A method comprising outputting to the display the progress rate of the process of acquiring the cardiovascular bio-information or the progress rate of the process of acquiring the body health index based on the cardiovascular bio-information of the user, while acquiring the cardiovascular bio-information of the user or acquiring the body health index based on the cardiovascular bio-information of the user. device.

3. In paragraph 1, the above operation is: Detecting the movement of the user while acquiring the user's cardiovascular biometric information or acquiring a body health index based on the user's cardiovascular biometric information; A device comprising outputting a warning or posture guide to the display when the acquisition of the cardiovascular bio-information is impossible due to the movement of the user or when the accuracy of the acquired cardiovascular bio-information is lower than a threshold.

4. A device according to claim 1, wherein the cardiovascular bio-information is acquired at preset intervals.

5. The device according to claim 1, wherein the cardiovascular bio-information is acquired from a preset number of image frames over a preset period of time.

6. In paragraph 5, the device wherein the preset number of image frames includes non-continuous image frames.

7. In paragraph 1, the above operation is: A device comprising identifying the user from an image of a body part including the user's face.

8. In paragraph 7, the above operation is: A device comprising matching the identification information of the above user with the cardiovascular biometric information or the body health index.

9. In paragraph 1, the above operation is: A device comprising storing the above cardiovascular bio-information or the above physical health index in the memory or a server connected via wired or wireless connection.

10. In paragraph 1, the above operation is: A device comprising collecting the cardiovascular biometric information or the physical health index over time for individual users and generating pattern information for the collected cardiovascular biometric information or physical health index.

11. In Clause 10, the above operation is: A device comprising estimating the cardiovascular bio-information or the body health index according to the generated pattern information.

12. In paragraph 1, the above operation is: A device comprising collecting the cardiovascular biometric information or the physical health index over time for an individual user, and outputting an alarm message to the display when the collected acquired cardiovascular biometric information or physical health index deteriorates over time.

13. In paragraph 1, the above operation is: A device comprising outputting to the display a user interface that guides a recommendation service corresponding to the cardiovascular bio-information or the body health index.

14. In paragraph 1, the above operation is: A device comprising providing a recommendation service corresponding to the above cardiovascular bio-information or the above physical health index.

15. In Paragraph 13, the above recommendation service is, A device determined based on the history information of the cardiovascular biometric information or physical health index of the above-mentioned user and the corresponding service history information.

16. In Paragraph 1, A device further comprising a camera configured to photograph a body part including the face of the user.

17. A method for providing image-based cardiovascular biometric information or user information based thereon, A step of obtaining a user’s cardiovascular bio-information estimated from an image of a body part including the user’s face, or obtaining a body health index based on the user’s cardiovascular bio-information; and A method comprising the step of outputting the above cardiovascular bio-information or the above body health index to a display.

18. In Paragraph 17, A step of collecting the cardiovascular biometric information or the physical health index over time for individual users; and A method comprising the step of outputting an alarm message to the display when the collected acquired cardiovascular bio-information or body health index deteriorates over time.

19. In Paragraph 17, A method comprising the step of outputting to the display a user interface that guides a recommendation service corresponding to the cardiovascular bio-information or the body health index.

20. In Paragraph 17, A method comprising the step of providing a recommendation service corresponding to the cardiovascular bio-information or the body health index.

21. A computer-readable medium storing code configured to execute a method according to any one of paragraphs 17 through 20 by a computer or processor.

Images