Apparatus and method for providing user interface for artificial intelligence-based reading of electrocardiogram data

Abstract

The present disclosure provides an apparatus and method for providing a user interface for artificial intelligence-based reading of electrocardiogram data. The method for providing a user interface for artificial intelligence-based reading of electrocardiogram data, according to an embodiment of the present disclosure, comprises the steps of: displaying an electrocardiogram graph through the user interface for electrocardiogram data reading; if a first input of a user is acquired through the user interface, displaying a first reference point on the electrocardiogram graph on the basis of a position selected according to the first input; if a second input of the user is detected through the user interface after the first reference point is identified, displaying a second reference point on the electrocardiogram graph on the basis of a position selected according to the second input; and calculating and displaying a measured value corresponding to an interval between the first reference point and the second reference point through the user interface.

Description

Device and method for providing a user interface for reading electrocardiogram data based on artificial intelligence

[0001] The present disclosure relates to deep learning technology in the medical field, and more specifically, to a device that provides a UI (User Interface) and a function for reading electrocardiogram data using a pre-trained deep learning model, and a control method thereof.

[0002] Electrocardiogram (ECG) data is a recording of electrocardiogram (ECG) signals generated by microcurrents within the heart. Accurate analysis of ECG data is essential in the medical field, as it can lead to early detection of cardiovascular disease or structural abnormalities in patients. Currently, most ECG analysis relies on the human eye. Specifically, doctors observe ECG data, analyze its waveform, or extract feature values ​​to diagnose patients. However, this approach not only slows down ECG analysis speed but can also have limited accuracy. Consequently, the medical field is increasingly seeking tools that can analyze ECG data more conveniently and accurately.

[0003] Meanwhile, recent advancements in information and communication technology have led to the utilization of artificial intelligence in various fields. In particular, various attempts are being made to integrate AI technology into the medical field, which previously relied on specialized and limited resources such as doctors and researchers to diagnose patients' illnesses, to improve efficiency. However, a suitable method for applying AI technology to electrocardiogram data analysis has not yet been sufficiently proposed.

[0004] The present disclosure has been made in response to the aforementioned background technology, and aims to provide a device and method for providing a user interface for reading electrocardiogram data based on artificial intelligence.

[0005] However, the problems to be solved in this disclosure are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood based on the description below.

[0006] In order to achieve the above-described task, according to one embodiment of the present disclosure, a method for providing a user interface for reading electrocardiogram data based on artificial intelligence is provided, the method comprising: displaying an electrocardiogram graph through a user interface for reading electrocardiogram data; when a first input of a user is obtained through the user interface, displaying a first reference point on the electrocardiogram graph based on a position selected according to the first input; when a second input of the user is obtained through the user interface after identifying the first reference point, displaying a second reference point on the electrocardiogram graph based on a position selected according to the second input; and calculating and displaying a measurement value corresponding to an interval between the first reference point and the second reference point through the user interface.

[0007] Alternatively, the measurement value may include a first measurement value corresponding to a distance between the first reference point and the second reference point in the first axis direction of the electrocardiogram graph and a second measurement value corresponding to a distance between the first reference point and the second reference point in the second axis direction different from the first axis of the electrocardiogram graph.

[0008] Alternatively, the step of calculating and displaying the measurement value may include a step of displaying at least one of the first measurement value or the second measurement value based on a movement direction of an indicator corresponding to a user input in the user interface.

[0009] Alternatively, the first measurement value may be displayed through the user interface when the indicator moves in the second axis direction after the second input of the user is obtained, and the second measurement value may be displayed through the user interface when the indicator moves in the first axis direction after the second input of the user is obtained.

[0010] Alternatively, the method may include a step of displaying a third reference point on the electrocardiogram graph based on a location selected according to the third input when a third input of the user is obtained through the user interface after displaying the second reference point, and the step of calculating and displaying the measurement value may include a step of calculating and displaying at least two of a third measurement value corresponding to an interval between the first reference point and the second reference point, a fourth measurement value corresponding to an interval between the second reference point and the third reference point, and a fifth measurement value corresponding to an interval between the first reference point and the third reference point through the user interface.

[0011] Alternatively, the method may further include, while displaying the measurement value, if a fourth input of the user is obtained through the user interface, displaying a graphical object indicating a distance between the first reference point and the second reference point, the graphical object being movable according to the input of the user.

[0012] Alternatively, the method may further include a step of displaying at least one reference point corresponding to feature information of the electrocardiogram graph on the electrocardiogram graph through the user interface, or displaying a graphic object that induces a user's input for a location corresponding to the at least one reference point.

[0013] Alternatively, the at least one reference point may be generated based on feature information obtained by inputting the electrocardiogram graph into a pre-trained neural network model.

[0014] Alternatively, the method may include a step of moving the position of the indicator corresponding to the user input in the user interface to the at least one reference point if the position of the indicator is within a preset range from the at least one reference point.

[0015] Alternatively, the method may further include a step of setting an electrocardiogram graph in which the at least one reference point is adjusted as new learning data when the position of the at least one reference point is adjusted according to a fifth input of the user.

[0016] Alternatively, the step of displaying a graphic object that indicates at least one reference point or induces a user's input for a location corresponding to the at least one reference point may include a step of displaying a plurality of feature values ​​corresponding to feature information of the electrocardiogram graph, the at least one reference point, and the feature information, calculated based on the at least one reference point.

[0017] Alternatively, the method may include a step of identifying the remaining reference points included in the first reference point set as fourth reference points and displaying them through the interface when the first reference point and the second reference point are included in a plurality of reference point sets, each of which includes two different reference points in pairs corresponding to the feature information of the electrocardiogram graph, and the first reference point and the second reference point match the first reference point and the first reference point, and a step of calculating and displaying a plurality of feature values ​​corresponding to the feature information of the electrocardiogram graph based on the first reference point, the second reference point, and the fourth reference point.

[0018] According to one embodiment of the present disclosure, a computer program stored in a computer-readable storage medium, wherein the computer program, when executed on one or more processors, performs an operation of providing a user interface for reading electrocardiogram data based on artificial intelligence, the operation may include an operation of displaying an electrocardiogram graph through the user interface for reading electrocardiogram data, an operation of displaying a first reference point on the electrocardiogram graph based on a location selected according to a first input when a first input of a user is obtained through the user interface, an operation of displaying a second reference point on the electrocardiogram graph based on a location selected according to a second input when a second input of the user is detected through the user interface after identifying the first reference point, and an operation of calculating and displaying a measurement value corresponding to an interval between the first reference point and the second reference point through the user interface.

[0019] According to one embodiment of the present disclosure, a device for providing a user interface for reading electrocardiogram data based on artificial intelligence includes a processor including at least one core, a memory including program codes executable by the processor, and a display, wherein the processor displays an electrocardiogram graph for reading electrocardiogram data through the display, and when a first input of a user is obtained through the display, displays a first reference point on the electrocardiogram graph based on a position selected according to the first input, and when a second input of the user is detected through the display after identifying the first reference point, displays a second reference point on the electrocardiogram graph based on a position selected according to the second input, and calculates and displays a measurement value corresponding to an interval between the first reference point and the second reference point through the display.

[0020] A computing device and a control method thereof providing an artificial intelligence-based tool function for reading electrocardiogram data according to an embodiment of the present disclosure can increase the accuracy of analysis of electrocardiogram data by supporting a user to accurately calculate a feature value that the user wishes to identify in an electrocardiogram graph.

[0021] In addition, it improves analysis efficiency by simultaneously calculating multiple feature values ​​from an electrocardiogram graph and providing a function to analyze the electrocardiogram graph using artificial intelligence technology.

[0022] FIG. 1 is an exemplary diagram of a computing device according to one embodiment of the present disclosure.

[0023] FIG. 2 is a block diagram schematically illustrating the configuration of a computing device that provides an artificial intelligence-based tool function for reading electrocardiogram data according to one embodiment of the present disclosure.

[0024] FIG. 3 is a flowchart illustrating a method for controlling a computing device that provides an artificial intelligence-based tool function for reading electrocardiogram data according to one embodiment of the present disclosure.

[0025] FIGS. 4A to 4F are exemplary diagrams showing a method for reading electrocardiogram data by displaying a plurality of reference points according to one embodiment of the present disclosure.

[0026] FIG. 5A and FIG. 5B are exemplary diagrams illustrating a method of displaying one of a first measurement value and a second measurement value based on a user's input direction, according to one embodiment of the present disclosure.

[0027] FIG. 6 is an exemplary diagram of a graphic object representing a measurement value between a first reference point and a second reference point that can move according to a user's input according to one embodiment of the present disclosure.

[0028] FIGS. 7A to 7D are exemplary diagrams showing a method of reading electrocardiogram data by indicating three reference points according to one embodiment of the present disclosure.

[0029] FIG. 8 is an exemplary diagram showing a function of a tool for reading an electrocardiogram graph using a pre-learned neural network model according to an embodiment of the present disclosure.

[0030] FIG. 9 is a block diagram of a computing device according to another embodiment of the present disclosure.

[0031] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. The embodiments presented in this disclosure are provided to enable those skilled in the art to utilize or implement the contents of the present disclosure. Accordingly, various modifications to the embodiments of the present disclosure will be apparent to those skilled in the art. That is, the present disclosure may be implemented in various different forms and is not limited to the embodiments described below.

[0032] Throughout the specification of this disclosure, identical or similar drawing numbers refer to identical or similar components. Furthermore, for the purpose of clearly describing the disclosure, drawing numbers for parts in the drawings that are not relevant to the description of the disclosure may be omitted.

[0033] The term "or" as used herein is intended to mean an inclusive "or" rather than an exclusive "or." That is, unless otherwise specified herein or clear from context, "X employs A or B" should be understood to mean either of its natural inclusive permutations. For example, unless otherwise specified herein or clear from context, "X employs A or B" can be interpreted to mean either X employs A, X employs B, or X employs both A and B.

[0034] The term "and / or" as used herein should be understood to refer to and include all possible combinations of one or more of the related concepts listed.

[0035] The terms "comprises" and / or "comprising" as used herein should be understood to mean the presence of certain features and / or components. However, it should be understood that the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other features, other components, and / or combinations thereof.

[0036] Unless otherwise specified in this disclosure or unless the context makes it clear that the singular form is being referred to, the singular should generally be construed to include “one or more.”

[0037] The term "Nth (N is a natural number)" used in this disclosure can be understood as an expression used to distinguish components of this disclosure from each other based on a predetermined standard such as a functional perspective, a structural perspective, or convenience of explanation. For example, components performing different functional roles in this disclosure can be distinguished as a first component or a second component. However, components that are substantially the same within the technical spirit of this disclosure but must be distinguished for convenience of explanation may also be distinguished as a first component or a second component.

[0038] The term "acquisition" as used in this disclosure may be understood to mean not only receiving data through a wired or wireless communication network with an external device or system, but also generating data in an on-device form.

[0039] Meanwhile, the term "module" or "unit" used in the present disclosure can be understood as a term referring to an independent functional unit that processes computing resources, such as a computer-related entity, firmware, software or a part thereof, hardware or a part thereof, or a combination of software and hardware. At this time, the "module" or "unit" may be a unit composed of a single element, or a unit expressed as a combination or set of multiple elements. For example, as a narrow concept, a "module" or "unit" may refer to a hardware element of a computing device or a set thereof, an application program that performs a specific function of software, a processing process implemented through software execution, or a set of instructions for program execution, etc. In addition, as a broad concept, a "module" or "unit" may refer to the computing device itself that constitutes the system, or an application running on the computing device, etc. However, since the above-described concept is only an example, the concept of “module” or “part” may be defined in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0040] The term "model" as used herein may be understood as a system implemented using mathematical concepts and language to solve a specific problem, a set of software units to solve a specific problem, or an abstract model of a processing process to solve a specific problem. For example, a neural network "model" may refer to the entire system implemented as a neural network that has problem-solving capabilities through learning. In this case, the neural network can have problem-solving capabilities by optimizing the parameters connecting nodes or neurons through learning. A neural network "model" may include a single neural network or a set of neural networks that are a combination of multiple neural networks.

[0041] The term "data" used in this disclosure may include "images," signals, and the like. The term "image" used in this disclosure may refer to multidimensional data composed of discrete image elements. In other words, "image" may be understood as a term referring to a digital representation of an object visible to the human eye. For example, "image" may refer to multidimensional data composed of elements corresponding to pixels in a two-dimensional image. "Image" may refer to multidimensional data composed of elements corresponding to voxels in a three-dimensional image.

[0042] The explanation of the above terms is intended to aid understanding of the present disclosure. Therefore, unless explicitly stated as limiting the contents of the present disclosure, it should be noted that the above terms are not intended to limit the technical ideas of the contents of the present disclosure.

[0043] FIG. 1 is an exemplary diagram of a computing device according to one embodiment of the present disclosure.

[0044] A computing device (100) according to an embodiment of the present disclosure may be a hardware device or a part of a hardware device that performs comprehensive processing and calculation of data, or may be a software-based computing environment connected to a communication network. For example, the computing device (100) may be a server that performs intensive data processing functions and shares resources, or may be a client that shares resources through interaction with a server. In addition, the computing device (100) may be a cloud system in which multiple servers and clients interact to comprehensively process data. Since the above description is only one example related to the type of computing device (100), the type of computing device (100) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0045] For example, a computing device (100) according to an embodiment of the present disclosure may be implemented as a biosignal measuring device that measures biometric data of a user (e.g., a patient, etc.). However, the present invention is not limited thereto, and the computing device (100) may be implemented as various electronic devices equipped with displays, such as a desktop, laptop, smartphone, server device, smart watch, smart band, smart ring, etc. The computing device (100) may also be referred to as an interface device, a tool device, etc.

[0046] Referring to FIG. 1, a computing device displays electrocardiogram (ECG) data on a display of the computing device. More specifically, the computing device converts electrocardiogram (ECG) data acquired by the computing device or received from another biosignal measuring device into an electrocardiogram graph format and displays the converted data on the display. However, the present invention is not limited thereto, and the computing device may convert various biosignals, such as electroencephalogram (EEG) graphs corresponding to electroencephalogram (EEG) signals, into a graph format and display them.

[0047] A computing device may display reference points for characteristic information desired by the user on an electrocardiogram (ECG) graph and provide tool functions to determine the values ​​of the characteristic information. In particular, the computing device may provide a user interface (UI) that allows the user to display reference points on the ECG graph. Furthermore, the computing device may provide a UI that allows the user to change the color, shape, etc., of the reference points displayed on the ECG graph.

[0048] In particular, the computing device may not only provide the user with feature information that can be identified from an electrocardiogram graph using a pre-learned neural network model, but may also guide the user's movement of the UI to set a reference point so that the user can receive useful feature information, or may display useful reference points that have not been set by the user.

[0049] Hereinafter, embodiments of the present disclosure related thereto will be described with reference to FIGS. 2 to 8.

[0050] FIG. 2 is a block diagram schematically illustrating the configuration of a computing device (hereinafter, “computing device”) that provides an artificial intelligence-based tool function for reading electrocardiogram data according to one embodiment of the present disclosure.

[0051] Referring to FIG. 2, a computing device (100) according to one embodiment of the present disclosure may include one or more processors (hereinafter, “processors”) (110), memory (120), and a display unit (130). However, FIG. 2 is merely an example, and the computing device (100) may include other configurations for implementing a computing environment. In addition, only some of the disclosed configurations may be included in the computing device (100).

[0052] The processor (110) according to one embodiment of the present disclosure may be understood as a configuration unit including hardware and / or software for performing computing operations. For example, the processor (110) may read a computer program to perform data processing for machine learning. The processor (110) may process computational processes such as processing input data for machine learning, feature extraction for machine learning, and error calculation based on backpropagation. The processor (110) for performing such data processing may include a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), a tensor processing unit (TPU), an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA). The type of the processor (110) described above is only one example, and thus, the type of the processor (110) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0053] The processor (110) is connected to other components of the computing device (100) (i.e., memory (120) and display (130)) and controls the overall operation of the computing device (100).

[0054] The memory (120) according to one embodiment of the present disclosure may be understood as a configuration unit including hardware and / or software for storing and managing data processed in the computing device (100). That is, the memory (120) may store any type of data generated or determined by the processor (110) and any type of data received by a communication interface (not shown). For example, the memory (120) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory, a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. In addition, the memory (120) may also include a database system that controls and manages data in a predetermined system. The type of memory (120) described above is only one example, and thus the type of memory (120) can be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0055] The memory (120) can structure and organize and manage data, combinations of data, and program codes executable by the processor (110) required for the processor (110) to perform operations. For example, the memory (120) can store a program for converting or displaying an electrocardiogram graph, a pre-learned neural network model (30) to be described later, and a reference set. In addition, the memory (120) can store program codes for operating a pre-learned neural network model (30) or evaluating a pre-set condition set in a pre-learned neural network model (30), program codes for operating a pre-learned neural network model (30) to perform inference in accordance with the purpose of use of the computing device (100), and processed data generated as the program codes are executed.

[0056] The display (130) can display various images. Here, the images include both still images and moving images. In particular, the display (130) can display an electrocardiogram graph corresponding to an electrocardiogram signal (or electrocardiogram data) acquired by the computing device (100), and can also display various UIs for reading the electrocardiogram graph.

[0057] The display (130) may be implemented as a display of various forms, such as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), an LCoS (Liquid Crystal on Silicon), a DLP (Digital Light Processing), etc. In addition, the display (130) may also include a driving circuit, a backlight unit, etc., which may be implemented as a form, such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc.

[0058] Meanwhile, the display (130) may be implemented as a touch screen by being combined with a touch panel, and in this case, the display (130) may perform the function of not only an output interface that outputs an image through the touch screen, but also an input interface that receives a user's touch input.

[0059] FIG. 3 is a flowchart illustrating a method for controlling a computing device (100) that provides an artificial intelligence-based tool function for reading electrocardiogram data according to one embodiment of the present disclosure.

[0060] FIG. 4 is an exemplary diagram showing a method for reading electrocardiogram data by indicating a plurality of reference points according to one embodiment of the present disclosure.

[0061] According to one embodiment of the present disclosure, the processor (110) displays an electrocardiogram graph (10) through a user interface for reading electrocardiogram data (S310). As described above, the electrocardiogram graph (10) represents a waveform of electrocardiogram data acquired by detecting electrical activity of the heart of a subject (e.g., a patient, etc.). The processor (110) may acquire the electrocardiogram data of the subject and then convert the acquired electrocardiogram signal into an electrocardiogram graph (10) and display it. The processor (110) may display the electrocardiogram graph (10) on a grid background screen and a plurality of reference axes defining the electrocardiogram graph so as to identify feature values ​​related to the electrocardiogram graph.

[0062] Meanwhile, the user interface is a medium connecting the computing device (100) and the user, and may be the display (130) of the computing device (100), or may be UI graphics displayed on the display (130). Alternatively, it may be an input device (e.g., a mouse, keyboard, touch pen, touch pad, etc.) connected to the computing device (100). However, for the convenience of explanation of the present disclosure, the user interface will be described below assuming the display (130).

[0063] And, when the processor (110) obtains the user's first input through the user interface, it displays the first reference point on the electrocardiogram graph (10) based on the location selected according to the first input (S320).

[0064] Specifically, the processor (110) can obtain a user's input through a user interface while displaying an electrocardiogram graph (10). Furthermore, the processor (110) can identify a location selected based on the user's input. Here, the location selected based on the user's input can be identified on a user interface where the electrocardiogram graph is displayed. For example, the processor (110) can identify the location selected based on the user's input on the display (130). Furthermore, the processor (110) can display a reference point on the electrocardiogram graph based on the selected location. Here, the reference point can be a point-shaped graphic object that specifies a point on the electrocardiogram graph.

[0065] The processor (110) can detect a user's input on the display (130) while displaying an electrocardiogram graph (10) through the display (130). Here, the user's input can be input through an input device connected to the computing device (100), or can be input through an input interface provided in the computing device (100), or can be a touch input through a touch panel of the display (130). Then, when the processor (110) detects the user's input, the processor (110) can identify the location of the detected user's input on the display (130). Then, the processor (110) can display a reference point at the identified location. At this time, the processor (110) can display the coordinate values ​​of the reference point.

[0066] Hereinafter, for the convenience of explanation of the present disclosure, the user's initial input will be referred to as the first input, and the first displayed reference point will be referred to as the first reference point.

[0067] For example, referring to FIG. 4a, when a user clicks a point on the display (130) using a mouse (200) connected to a computing device (100), the processor (110) can detect the user's first input on the display (130). At this time, when the user clicks the mouse on the electrocardiogram graph (10), the processor (110) can detect the user's first input on the electrocardiogram graph (10).

[0068] And, referring to FIG. 4B, the processor (110) can display a first reference point (p1) at a location where the first input is detected. At this time, the processor (110) can display the coordinate values ​​of the first reference point (p1). In FIG. 4B, the reference point (i.e., the first reference point (p1)) is illustrated in the shape of a circle, but the reference point can be displayed in various shapes such as a triangle or a diamond. Meanwhile, the processor (110) can further display an auxiliary line (a1) indicating an input position of the user (e.g., the position of the indicator (20) of the input device) that moves together with the first reference point (p1). Meanwhile, in FIG. 4B, the auxiliary line (a1) is displayed as a dotted line, but the auxiliary line can be displayed in various shapes such as a single-dot chain line, a two-dot chain line, etc.

[0069] Meanwhile, according to one embodiment of the present disclosure, after the processor (110) identifies the first reference point (p1), when a second input from the user is obtained through the user interface, the processor (110) displays the second reference point on the electrocardiogram graph (10) based on the location selected according to the second input (S330).

[0070] Specifically, after displaying the first reference point (p1), the processor (110) can obtain another user input through the user interface. Then, the processor (110) can identify a selected location based on another user input and display another reference point based on the identified location.

[0071] At this time, another input from the user may be of the same type (first type) as the first input obtained (i.e., the first input). That is, after the processor (110) displays the first reference point (p1), if another input of the same type (first type) as the first input is obtained through the user interface, another reference point may be displayed at a location selected according to the other input.

[0072] Hereinafter, for the convenience of explanation of the present disclosure, another input after the user's initial input will be referred to as a second input, and a reference point displayed based on the second input will be referred to as a second reference point (p2).

[0073] For example, referring to FIG. 4c, after the first reference point (p1) is displayed, if the user clicks another point on the display (130) using the mouse, the processor (110) can detect the user's input on the display (130). At this time, if the user clicks the mouse (200) on the electrocardiogram graph (10), the processor (110) can detect the user's second input on the electrocardiogram graph (10). And, referring to FIG. 4d, the processor (110) can display the second reference point (p2) (and the auxiliary line (a1) connecting the first and second reference points (p1 and p2)) at the location where the user's second input is detected. At this time, the processor (110) can display the coordinate values ​​of the second reference point (p2).

[0074] Meanwhile, according to one embodiment of the present disclosure, the processor (110) may remove the displayed reference point from the display (130) based on another input of the user detected after displaying the reference point. Here, the other input of the user for removing the reference point may be an input of a different type (second type) from the input of the user for displaying the reference point (i.e., the first and second inputs). For example, if the first and second inputs were clicks via the left button of the mouse, the user input for removing the reference point may be a click via the right button of the mouse. That is, the second type of input may be an input for resetting the reference point (and the measurement value) displayed on the display (130) excluding the electrocardiogram graph (10).

[0075] And, according to one embodiment of the present disclosure, the processor (110) calculates and displays a measurement value corresponding to the distance between the first and second reference points (p1 and p2) through a user interface. Specifically, the processor (110) can measure the distance (or distance) between the first reference point (p1) and the second reference point (p2) and calculate the measurement value. The processor (110) can calculate and display the measurement value based on a user input requesting the display of the measurement value.

[0076] At this time, according to one embodiment of the present disclosure, the measurement value may include a first measurement value corresponding to the interval between the first reference point (p1) and the second reference point (p2) in the first axis direction of the electrocardiogram graph (10) and a second measurement value corresponding to the interval between the first reference point (p1) and the second reference point (p2) in the second axis direction different from the first axis of the electrocardiogram graph (10). For example, referring to FIGS. 4e and 4f, the measurement value may include a interval corresponding to the interval between the first and second reference points (p1 and p2) in the horizontal axis (i.e., x-axis) direction of the electrocardiogram graph (10) and a second measurement value (d2) corresponding to the interval between the first and second reference points (p1 and p2) in the vertical axis (i.e., y-axis) direction perpendicular to the horizontal axis of the electrocardiogram graph (10).

[0077] Specifically, the processor (110) may calculate a measurement value (hereinafter, a first measurement value (d1)) measuring the distance between the first and second reference points (p1 and p2) in a direction parallel to the horizontal axis, or may calculate a measurement value (hereinafter, a second measurement value (d2)) measuring the distance between the first and second reference points (p1 and p2) in a direction parallel to the vertical axis. In addition, the processor (110) may selectively display either the first or second measurement value (d2).

[0078] Meanwhile, the processor (110) may display auxiliary lines (a2, a3, and a4) corresponding to the measurement value together with the measurement value. The auxiliary line (a4) displayed on the measurement value may be a line extending in a direction corresponding to the direction in which the measurement value was calculated, and may be perpendicular to the auxiliary lines (a2 and a3) displayed on the reference point. In order for the user to intuitively recognize how the measurement value was calculated, the processor (110) may display the measurement value adjacent to the auxiliary line (a4).

[0079] Referring to FIG. 4E, the processor (110) can measure the distance in the x-axis (e.g., time axis) direction between the first reference point (p1) and the second reference point (p2) and display the distance value (and the auxiliary line (a4) displayed in the measured value and the auxiliary lines (a2 and a3) corresponding to the positions of the first and second reference points (p1 and p2)). That is, the processor (110) can calculate the distance value in the x-axis direction between the first reference point (p1) and the second reference point (p2) using the x-coordinate values ​​of the first reference point (p1) and the second reference point (p2), and display the calculated distance value on the display (130).

[0080] The processor (110) can display an auxiliary line extending in the vertical axis direction from the first and second reference points (p1 and p2) and parallel to the vertical axis of the electrocardiogram graph (10) and an auxiliary line parallel to the horizontal axis between the first and second reference points (p1 and p2). The direction and shape of the auxiliary line can be determined depending on whether the measurement value acquired by the user through the plurality of reference points is a measurement value corresponding to the interval in the vertical axis (i.e., y-axis) direction between the plurality of reference points or a measurement value corresponding to the interval in the horizontal axis (i.e., x-axis) direction between the plurality of reference points. Meanwhile, the type of the measurement value (a measurement value corresponding to the interval in the vertical axis direction or a measurement value corresponding to the interval in the horizontal axis direction) can be determined depending on the user's setting.

[0081] On the other hand, referring to FIG. 4F, the processor (110) can measure the distance in the y-axis (e.g., voltage axis) direction between the first reference point (p1) and the second reference point (p2) and display the distance value (and the auxiliary line (a7) parallel to the vertical axis corresponding to the measured value, and the auxiliary lines (a5 and a6) parallel to the horizontal axis at the first reference point (p1) and the second reference point (p2)). That is, the processor (110) can calculate the distance value in the y-axis direction between the first reference point (p1) and the second reference point (p2) using the y-coordinate values ​​of the first reference point (p1) and the second reference point (p2), and display the calculated distance value on the display (130).

[0082] Through this, the user can set any number of points to be identified on the electrocardiogram graph (10) and accurately identify the intervals and distances between any number of points.

[0083] Meanwhile, according to one embodiment of the present disclosure, if a second type of input from the user is detected after displaying the measurement value, the processor (110) may remove the first and second reference points (p1 and p2) and the measurement value from the display (130).

[0084] Additionally, according to one embodiment of the present disclosure, when the position of at least one of the first and second reference points (p1 and p2) is changed based on a user input while the measurement value is displayed, the processor (110) may re-measure the interval between the first and second reference points (p1 and p2) based on the changed position, and display the changed measurement value.

[0085] FIG. 5A and FIG. 5B are exemplary diagrams illustrating a method of displaying one of a first measurement value (d1) and a second measurement value (d2) based on a user's input direction, according to one embodiment of the present disclosure.

[0086] Meanwhile, according to one embodiment of the present disclosure, the processor (110) may display at least one of the first measurement value or the second measurement value based on the movement direction of the indicator corresponding to the user's input in the user interface.

[0087] Specifically, the processor (110) can select and display either the first measurement value (d1) or the second measurement value (d2) based on the user's input direction detected on the display (130). Here, in order to select and display the first measurement value (d1) and the second measurement value (d2), the user's input may be of a different type (third type) from the user's input for displaying the reference point. For example, if the user's input for displaying the reference point on the electrocardiogram graph (10) is a mouse click, the user's input for selecting and displaying the measurement value may be a mouse drag input.

[0088] In particular, referring to FIGS. 5A and 5B, the processor (110) may select and display either a first measurement value (d1) or a second measurement value (d2) based on the movement direction of an indicator (20) corresponding to an input device identified on the display (130). Here, the indicator (20) may be a graphic object that displays the input device. For example, when the input device is a mouse (200), the processor (110) may display a second reference point (p2) and then select and display either a first measurement value (d1) or a second measurement value (d2) based on the movement direction of a mouse cursor displayed on the display (130).

[0089] According to one embodiment of the present disclosure, the first measurement value may be displayed through the user interface when the indicator moves in the second axis direction after the second input of the user is acquired. Referring to FIG. 5A, when the processor (110) detects that the mouse cursor (20) moves in the x-axis direction after the second input of the user is acquired, the processor (110) may display the second reference point (p2) and display the distance value in the y-axis direction between the first reference point (p1) and the second reference point (p2) (i.e., the second measurement value (d2)). In addition, according to one embodiment of the present disclosure, when the indicator moves in the first axis direction after the second input of the user is acquired, the first measurement value may be displayed through the user interface. Referring to FIG. 5b, when the processor (110) detects that the mouse cursor (20) is moving in the x-axis direction after the user's second input is detected, the processor (110) can display a second reference point (p2) and display a distance value in the x-axis direction between the first reference point (p1) and the second reference point (p2) (i.e., the first measurement value (d1)).

[0090] That is, after the processor (110) displays the second reference point (p2), if it is detected that the indicator (20) is moving in the horizontal axis direction, it can display the second measurement value (d2), and if it is detected that the indicator (20) is moving in the vertical axis direction, it can display the first measurement value (d1).

[0091] Meanwhile, if a user's input is detected at a point other than the electrocardiogram graph (10) on the display (130), the processor (110) can extend the detected point in the horizontal axis direction (or vertical axis direction), identify a point intersecting the electrocardiogram graph (10), and display a reference point at the identified point.

[0092] While displaying a measurement value according to one embodiment of the present disclosure, if another user input is detected through the user interface, the processor (110) may display a graphical object representing a distance between first and second reference points (p1 and p2) that is movable according to the user input.

[0093] Specifically, while the processor (110) displays a measurement value (a first measurement value (d1) or a second measurement value (d2)) on the display (130), the processor (110) may detect another user input for extracting and displaying the measurement value on the display (130). At this time, the other user input for extracting and displaying the measurement value may be an input of a different type (a fourth type) from the user input for displaying the reference point. For example, if the first and second inputs were single clicks of the mouse, the user input for extracting and displaying the measurement value may be a double click of the mouse.

[0094] When a fourth type of input from the user is detected while the processor (110) is displaying the measurement value, the processor (110) may extract the measurement value and display a graphic object on the display (130) that represents a fixed distance between the first and second reference points (p1 and p2) corresponding to the extracted measurement value. In particular, the processor (110) may display a graphic object on an area of ​​the display (130) that represents a separate extracted measurement value that is identical to the displayed measurement value and a fixed distance between the first and second reference points (p1 and p2) based on the fourth type of input.

[0095] FIG. 6 is an exemplary diagram of a graphic object representing a measurement value between a first reference point and a second reference point that can move according to a user's input according to one embodiment of the present disclosure.

[0096] For example, referring to FIG. 6, the graphic object (40) indicating the distance between the first and second reference points (p1 and p2) may be an auxiliary line in the form of a double line. In this case, the displayed measurement value and the auxiliary line of the double line based on the fourth type of input may be moved on the display (130) according to the user's input.

[0097] Meanwhile, when another user input is detected on the display (130) after the processor (110) displays the second reference point (p2), the processor (110) may display another reference point other than the first and second reference points (p1 and p2), and calculate and display a measurement value corresponding to the interval between the first reference point (p1) and the other reference point or the interval between the second reference point (p2) and the other reference point.

[0098] Hereinafter, for the convenience of explanation of the present disclosure, another input following the user's second input will be referred to as a third input, and a reference point displayed based on the third input will be referred to as a third reference point (p3).

[0099] FIGS. 7A to 7D are exemplary diagrams showing a method of reading electrocardiogram data by indicating three reference points according to one embodiment of the present disclosure.

[0100] According to one embodiment of the present disclosure, after displaying a second reference point, when a third input from a user is obtained through a user interface, the processor (110) may display a third reference point on an electrocardiogram graph (10) based on a location selected according to the third input.

[0101] When a third input from a user is detected through the user interface, the processor (110) can identify a location selected according to the third input on the user interface, and display a third reference point on the electrocardiogram graph (10) based on the selected location. Here, the third input can be an input of the same type as the first and second inputs (i.e., the first type).

[0102] For example, the processor (110) may identify the location of a third user input detected on the display (130) and display a third reference point at the identified location. Meanwhile, the processor (110) may display the third reference point when a first type of input is detected on the display (130) without detecting a separate user input requesting display of the user's measurement value.

[0103] In addition, the processor (110) can calculate and display at least two of a measurement value corresponding to the interval between the first reference point and the second reference point (hereinafter, a third measurement value), a measurement value corresponding to the interval between the second reference point and the third reference point (hereinafter, a fourth measurement value), and a measurement value corresponding to the interval between the first reference point and the third reference point (hereinafter, a fifth measurement value) through a user interface.

[0104] At this time, the third measurement value corresponding to the interval between the first reference point (p1) and the second reference point (p2), the fourth measurement value corresponding to the interval between the second reference point (p2) and the third reference point, and the fifth measurement value corresponding to the interval between the first reference point (p1) and the third reference point can all be calculated in the same axial direction.

[0105] For example, the processor (110) can display the two measurement values ​​excluding the maximum measurement value among the plurality of measurement values.

[0106] Meanwhile, the processor (110) can display an auxiliary line corresponding to the direction in which the multiple measurement values ​​were calculated, along with a plurality of measurement values, and display the multiple measurement values ​​on the displayed auxiliary line. Through this, the user can intuitively recognize the multiple measurement values ​​calculated through the multiple reference points.

[0107] Referring to FIG. 7a, when a user clicks a point on the display (130) using a mouse after the first reference point and the second reference point are displayed, the processor (110) can detect the user's third input on the display (130). In addition, referring to FIG. 7b, the processor (110) can display a third reference point (p3) at the location where the user's third input is detected. At this time, the processor (110) can display the coordinate values ​​of the third reference point (p3). And, referring to FIG. 7c, the processor (110) can measure the distance value in the x-axis (e.g., time axis) direction between the first reference point (p1) and the second reference point (p2) and the distance in the x-axis direction between the second reference point (p2) and the third reference point (p3) and calculate and display the measured values ​​(d1 and d3) (and auxiliary lines (a2, a3, a4, a9, and a10), respectively). Meanwhile, although not shown in the drawing, the processor (110) can also calculate and display the distance value in the x-axis direction between the first reference point (p1) and the third reference point (p3).

[0108] On the other hand, referring to FIG. 7d, the processor (110) can measure the distance value in the y-axis (e.g., time axis) direction between the first reference point (p1) and the third reference point (p3) and the distance in the y-axis direction between the second reference point (p2) and the third reference point (p3) and display the measured values ​​(d2, d4, and d5) (and auxiliary lines (a5, a6, a7, and a12)). Meanwhile, although not shown in the drawing, the processor (110) can also calculate and display the distance value in the y-axis direction between the first reference point (p1) and the second reference point (p2).

[0109] Meanwhile, the embodiments described in FIGS. 5a and 5b are equally applied, so that the processor (110) can display a third measurement value, a fourth measurement value, and a fifth measurement value corresponding to the x-axis direction according to the movement direction of the indicator (20), or can display a third measurement value, a fourth measurement value, and a fifth measurement value corresponding to the y-axis direction. At this time, the processor (110) can also sequentially display a plurality of measurement values ​​(the third measurement value, the fourth measurement value, and the fifth measurement value) corresponding to the movement distance or movement speed of the indicator (20).

[0110] According to one embodiment of the present disclosure, the processor (110) may display at least one reference point corresponding to feature information of the electrocardiogram graph (10) on the electrocardiogram graph (10) through a user interface, or may display a graphic object that induces a user's input for a location corresponding to at least one reference point. The reference point may be a graphic object that displays a point related to feature information identified on the electrocardiogram graph (10) regardless of the user's input. The processor (110) may identify feature information on the electrocardiogram graph (10). For example, the feature information may be the height of the P wave, the duration of the P wave, the PR interval, the QRS duration, the Q wave depth, the R wave height, the S wave depth, etc. identified in the electrocardiogram graph (10). In addition, the processor (110) may display a reference point related to the identified feature information on the electrocardiogram graph (10). At this time, the coordinate values ​​of the reference point may also be displayed together.

[0111] Meanwhile, the processor (110) may display a graphic object that induces a user input for a location corresponding to at least one reference point through a user interface. That is, the processor (110) may identify the location of a reference point on the electrocardiogram graph (10) without displaying the reference point, and display a graphic object that induces a user input to the identified location. The graphic object that induces a user input may be displayed in various forms. For example, it may be a dotted circle, or it may be the coordinate values ​​of each reference point.

[0112] Meanwhile, the processor (110) may display at least one reference point corresponding to the characteristic information of the electrocardiogram graph (10) depending on the mode of the computing device, or may display a graphic object that induces a user's input for a location corresponding to at least one reference point. For example, when the mode of the tool device is set to AI mode, the processor (110) may identify a plurality of reference points using an artificial intelligence model (30).

[0113] According to one embodiment of the present disclosure, at least one reference point may be generated based on feature information acquired by inputting an electrocardiogram graph into a pre-trained neural network model. Specifically, an electrocardiogram graph (10) may be input into a neural network model (30) trained to identify feature information (or feature values) of an electrocardiogram signal in the electrocardiogram graph (10) or to identify points (hereinafter, reference points) corresponding to the identified feature information. At this time, a plurality of reference points may correspond to respective feature information. For example, a reference point corresponding to a QRS duration may be a start point of a Q wave and an end point of an R wave, and a reference point corresponding to an RR interval may be a peak point of a preceding R wave and a peak point of a following R wave in the electrocardiogram graph (10). When an electrocardiogram graph (10) is input, the neural network model (30) may be trained to display a plurality of points corresponding to feature information on the input electrocardiogram graph (10). To this end, the neural network model (30) may be pre-trained with training data including a plurality of electrocardiogram graphs (10) and label data including a plurality of electrocardiogram graphs (10) on which points corresponding to feature information are marked. For example, the neural network model (30) may be a multi-layer perceptron (MLP), a convolutional neural network (CNN), a recurrent neural network (RNN), or a generative adversarial network.

[0114] Meanwhile, the processor (110) can transmit the electrocardiogram graph (10) to a server device that is linked to the computing device (100) to obtain feature information about the electrocardiogram graph (10) and / or information about a plurality of reference points. At this time, the server device can store the aforementioned pre-learned neural network model (30).

[0115] According to one embodiment of the present disclosure, the processor (110) may move the position of the indicator (20) to at least one reference point when the position of the indicator (20) corresponding to the user input in the user interface is within a preset range from at least one reference point.

[0116] Specifically, the processor (110) can identify whether the position of the indicator (20) corresponding to the input device is adjacent to any one of the plurality of reference points. To this end, the processor (110) can determine whether the indicator (20) is located within a preset range based on the identified position for each reference point. Then, if the processor (110) identifies that the indicator (20) is within a preset range from the position of any one of the plurality of reference points, the processor (110) can move the position of the indicator (20) to the position of any one of the adjacent reference points. Through this, the user can be guided to conveniently set a reference point from which feature information can be extracted on the electrocardiogram graph (10).

[0117] Meanwhile, if the indicator (20) is positioned overlappingly within a preset range of multiple reference points, the processor (110) can move the indicator (20) to a reference point that is closer to the indicator (20).

[0118] Meanwhile, the processor (110) is not limited thereto, and can identify the input location by moving it to an adjacent reference point for various inputs, such as the indicator (20) of the mouse as well as the user's touch input.

[0119] FIG. 8 is an exemplary diagram showing a reading tool function of an electrocardiogram graph (10) using a pre-learned neural network model (30) according to one embodiment of the present disclosure.

[0120] According to one embodiment of the present disclosure, the processor (110) may display a plurality of identified reference points. Specifically, the processor (110) may input an electrocardiogram graph (10) into a pre-trained neural network model (30) and display a plurality of reference points corresponding to the identified feature information of the electrocardiogram graph (10).

[0121] Referring to FIG. 8, the processor (110) may display a plurality of reference points corresponding to the starting point of the P wave, the starting point of the QRS complex, and the starting point of the T wave on the electrocardiogram graph (10), a plurality of reference points corresponding to the ending point of the P wave, the ending point of the QRS complex, and the ending point of the T wave, a plurality of reference points corresponding to the highest point of the P wave, the highest point of the R wave, and the highest point of the T wave, and a plurality of reference points corresponding to the maximum depth point of the Q wave and the maximum depth point of the S wave. Although 11 reference points are shown in FIG. 8, the present invention is not limited thereto. That is, the number of reference points may vary, and may be determined according to user settings.

[0122] Meanwhile, according to one embodiment of the present disclosure, the processor (110) may display a plurality of feature values, at least one reference point, and feature information corresponding to feature information of the electrocardiogram graph (10) calculated based on a plurality of identified reference points. Specifically, the processor (110) may identify feature information of the electrocardiogram graph (10) identified using a plurality of reference points, and display the feature value corresponding to the identified feature information. In particular, the processor (110) may identify a plurality of feature information by combining a plurality of reference points. Referring again to FIG. 8, the processor (110) may identify feature information of the electrocardiogram graph (10) including the height of the P wave, the height of the R wave, the height of the T wave, the depth of the Q wave, the depth of the R wave, the PR interval, the QRS width, the QT interval, the PR segment, and the ST segment by combining a plurality of reference points, and may calculate and display the feature value of each feature information.

[0123] For example, when the mode of the tool device (110) is set to the guide mode among the AI ​​modes, the processor (110) can display a plurality of reference points identified using the artificial intelligence model (30).

[0124] Meanwhile, according to one embodiment of the present disclosure, when the position of at least one of the plurality of reference points displayed is adjusted according to a user's input, the processor (110) can set the electrocardiogram graph (10) on which the plurality of reference points are displayed as new learning data.

[0125] Specifically, the processor (110) can display a plurality of reference points and detect whether the plurality of reference points move according to a user input (hereinafter, referred to as a fifth input). That is, the user can set a reference point by adjusting the positions of the plurality of reference points. At this time, when the position of any one of the reference points is adjusted according to the user input, the processor (110) can recalculate and display the feature value of the feature information related to the adjusted reference point.

[0126] In addition, when the position of any one of the reference points is adjusted according to the user's input, the processor (110) can set new learning data including an electrocardiogram graph (10) in which a plurality of reference points including the adjusted reference point are displayed as label data and an electrocardiogram graph (10) in which a plurality of reference points are not displayed as input data. In this way, the set new learning data can be transmitted to a server device in which a previously learned neural network model is stored and used to retrain the neural network model (30). At this time, the neural network model (30) can perform supervised learning using a loss function (e.g., a cross-entropy loss function, etc.).

[0127] Meanwhile, whether or not to set new learning data can be determined based on the number of reference points whose positions have been adjusted, the degree of adjustment of the positions, etc. That is, the processor (110) identifies reference points whose positions have been adjusted to a preset value or more, and if the number of identified reference points is more than the preset number, the processor (110) can set an electrocardiogram graph (10) displaying a plurality of reference points, including the adjusted reference points, as new learning data.

[0128] Meanwhile, according to one embodiment of the present disclosure, the processor (110) may identify a reference point set including a plurality of reference points corresponding to the characteristic information of the electrocardiogram graph (10). Here, the reference point set may be a set including a plurality of different reference points set by a user. In particular, the reference point set may include a plurality of reference point sets each including two different reference points in pairs corresponding to the characteristic information of the electrocardiogram graph.

[0129] Alternatively, the processor (110) may set a user-customized reference point set by considering the number of reference points previously set by the user, the location of the reference points on the electrocardiogram graph (10), electrocardiogram characteristic information corresponding to the reference points, etc. As an example, the processor (110) may set a reference point set according to multiple users and select a reference point set corresponding to the user. The processor (110) may identify the user based on the user's identification information (e.g., ID, etc.).

[0130] And, if at least one of the first reference point (p1) and the second reference point (p2) matches a reference point included in a plurality of reference point sets, the processor (110) can identify the remaining reference points included in the reference point sets as a plurality of fourth reference points and display them on the display (130), and can calculate and display a plurality of feature values ​​corresponding to feature information of the electrocardiogram graph (10) based on the first reference point, the second reference point, and the plurality of fourth reference points.

[0131] Specifically, the processor (110) can identify whether at least one of the first reference point (p1) and the second reference point (p2) matches any one of the plurality of reference points included in the reference point set. To this end, the processor (110) can compare the positions of the first reference point (p1) and the second reference point (p2) with the positions of the plurality of reference points included in the reference point set. Then, if at least one of the first reference point (p1) and the second reference point (p2) matches any one of the plurality of reference points included in the reference point set, the processor (110) can identify the remaining reference points included in the reference point set as reference points (hereinafter, referred to as fourth reference points). Then, the processor (110) can display the fourth reference point. At this time, before displaying the fourth reference point, the processor (110) can display a message to the user to confirm whether to display the fourth reference point, and can receive a user input for displaying the fourth reference point through the message. In addition, the processor (110) can calculate and display measurement values ​​corresponding to the intervals between the first reference point, the second reference point, and a plurality of fourth reference points. In this regard, the description of the present disclosure described above applies equally, so a detailed description will be omitted.

[0132] FIG. 9 is a block diagram of a computing device (900) according to another embodiment of the present disclosure.

[0133] Referring to FIG. 9, a computing device (900) according to an embodiment of the present disclosure includes a processor (910), a memory (920), a display (930), a sensing unit (940), a communication interface (950), a user interface (960), a camera (970), and a speaker (980). Among the configurations illustrated in FIG. 7, the processor (910), the memory (920), and the display (930) correspond to the processor (110), the memory (120), and the display (130) configurations of the computing device (100) illustrated in FIG. 2, and thus a detailed description thereof will be omitted.

[0134] The sensing unit (940) can obtain biometric information about the user. For example, the sensing unit (940) may include a plurality of electrodes. In this case, the processor (910) can obtain electrocardiogram data of the user as biometric information through at least one electrode. In addition, the sensing unit (940) may include an image sensor or a light sensor. In this case, the processor (910) can obtain a photo blood flow signal of the user as biometric information through the image sensor (or light sensor). In addition, the sensing unit (940) may further include a blood pressure monitor, a thermometer, etc.

[0135] A communication interface (950) according to one embodiment of the present disclosure may be understood as a component that transmits and receives data through any type of known wired or wireless communication system. For example, the communication interface (950) may perform data transmission and reception using a wired or wireless communication system such as a local area network (LAN), wideband code division multiple access (WCDMA), long term evolution (LTE), wireless broadband internet (WiBro), fifth generation mobile communication (5G), ultrawide-band, ZigBee, radio frequency (RF) communication, wireless LAN, wireless fidelity, near field communication (NFC), or Bluetooth. Since the above-described communication systems are only examples, the wired and wireless communication system for data transmission and reception of the communication interface (950) may be applied in various ways other than the above-described examples.

[0136] The communication interface (950) can receive data necessary for the processor (910) to perform calculations through wired or wireless communication with any system or any client, etc. In addition, the communication interface (950) can transmit data generated through calculations of the processor (910) through wired or wireless communication with any system or any client, etc. For example, the communication interface (950) can receive medical data (e.g., electrocardiogram data) through communication with a cloud server that performs tasks such as databases and standardization of medical data in a hospital environment, other computing devices, signal measuring devices, etc. The communication interface (950) can transmit output data of a neural network model, intermediate data derived from the calculation process of the processor (910), processed data, etc. through communication with the aforementioned database, server, or computing device. The processor (910) can obtain a plurality of biometric data through the communication interface (950).

[0137] The user interface (960) is a configuration used by the computing device (100) to perform interaction with the user, and may include at least one of a touch sensor, a motion sensor, a button, a jog dial, and a switch, but is not limited thereto. The processor (110) may receive user input for selecting biometric data and diseases through the user interface (960), or may receive user input for changing a plurality of elements included in the judgment criteria through the user interface (960).

[0138] The camera (970) captures an image of the user and obtains an image of the user. Specifically, the camera (970) can capture biometric data of the user by capturing the user. To this end, the camera (970) can be implemented with an imaging device such as a CMOS image sensor (CIS) having a CMOS structure, a charge coupled device (CCD) having a CCD structure, etc. However, the present invention is not limited thereto, and the camera (970) can be implemented with a camera module of various resolutions capable of capturing an object. Meanwhile, the camera (970) can be implemented with a depth camera (e.g., an IR depth camera), a stereo camera, an RGB camera, etc.

[0139] The speaker (980) is a component that outputs various audio data that has undergone various processing operations, such as decoding, amplification, and noise filtering, by an audio processing unit (not shown). The speaker (980) can output various notification sounds or voice messages. According to one embodiment of the present disclosure, the processor (910) can convert an electrical signal received from an external device into a user's voice and output it through the speaker (980).

[0140] The various embodiments of the present disclosure described above can be combined with additional embodiments and modified within the scope understood by those skilled in the art in light of the detailed description above. It should be understood that the embodiments of the present disclosure are illustrative in all respects and not restrictive. For example, each component described as a single component may be implemented in a distributed manner, and likewise, components described as distributed may be implemented in a combined manner. Accordingly, all changes or modifications derived from the meaning, scope, and equivalent concepts of the claims of the present disclosure should be construed as being included within the scope of the present disclosure.

[0141] The various embodiments of the present disclosure described above can be combined with additional embodiments and modified within the scope understood by those skilled in the art in light of the detailed description above. It should be understood that the embodiments of the present disclosure are illustrative in all respects and not restrictive. For example, each component described as a single component may be implemented in a distributed manner, and likewise, components described as distributed may be implemented in a combined manner. Accordingly, all changes or modifications derived from the meaning, scope, and equivalent concepts of the claims of the present disclosure should be construed as being included within the scope of the present disclosure.

Claims

1. A method for providing a user interface for reading electrocardiogram data based on artificial intelligence, A step of displaying an electrocardiogram graph through a user interface for reading electrocardiogram data; When a first input from a user is obtained through the user interface, a step of displaying a first reference point on the electrocardiogram graph based on a location selected according to the first input; After displaying the first reference point, if a second input from the user is obtained through the user interface, a step of displaying a second reference point on the electrocardiogram graph based on a location selected according to the second input; and A step of calculating and displaying a measurement value corresponding to the interval between the first reference point and the second reference point through the user interface; including, method.

2. In paragraph 1, The above measurement values ​​are, A first measurement value corresponding to the interval between the first reference point and the second reference point in the first axis direction of the electrocardiogram graph and a second measurement value corresponding to the interval between the first reference point and the second reference point in the second axis direction different from the first axis of the electrocardiogram graph, method.

3. In paragraph 2, The step of calculating and displaying the above measurement value is as follows: A step of displaying at least one of the first measurement value or the second measurement value based on the movement direction of the indicator corresponding to the user's input in the user interface; including, method.

4. In paragraph 3, The above first measurement value is, After the second input of the user is obtained, when the indicator moves in the second axis direction, it is displayed through the user interface, The above second measurement value is, After the second input of the user is obtained, when the indicator moves in the first axis direction, it is displayed through the user interface. method.

5. In paragraph 1, A step of displaying a third reference point on the electrocardiogram graph based on a location selected according to the third input, when a third input from the user is obtained through the user interface after displaying the second reference point; Including, The step of calculating and displaying the above measurement value is as follows: A step of calculating and displaying at least two of a third measurement value corresponding to the interval between the first reference point and the second reference point, a fourth measurement value corresponding to the interval between the second reference point and the third reference point, and a fifth measurement value corresponding to the interval between the first reference point and the third reference point through the user interface; including more, method.

6. In paragraph 1, While displaying the above measurement value, when a fourth input of the user is obtained through the user interface, a step of displaying a graphic object indicating a distance between the first reference point and the second reference point, which is movable according to the input of the user; including more, method.

7. In paragraph 1, A step of displaying at least one reference point corresponding to characteristic information of the electrocardiogram graph on the electrocardiogram graph through the user interface, or displaying a graphic object that induces a user's input for a location corresponding to the at least one reference point; including more, method.

8. In paragraph 7, At least one of the above reference points, It is generated based on the feature information obtained by inputting the above electrocardiogram graph into a pre-trained neural network model. method.

9. In paragraph 7, A step of moving the position of an indicator corresponding to a user input in the user interface to the at least one reference point when the position of the indicator is within a preset range from the at least one reference point; including, method.

10. In paragraph 7, A step of setting an electrocardiogram graph in which the at least one reference point is adjusted as new learning data when the position of the at least one reference point is adjusted according to the fifth input of the user; including more, method.

11. In paragraph 7, The step of displaying a graphic object that displays at least one reference point or induces a user's input for a location corresponding to the at least one reference point, A step of displaying a plurality of feature values ​​corresponding to feature information of the electrocardiogram graph, the at least one reference point, and the feature information, calculated based on the at least one reference point; including, method.

12. In paragraph 1, A step of identifying the remaining reference points included in the first reference point set as fourth reference points and displaying them through the interface when the first reference point included in the first reference point set among a plurality of reference point sets each including two different reference points in pairs corresponding to the characteristic information of the electrocardiogram graph matches the first reference point; and A step of calculating and displaying a plurality of feature values ​​corresponding to feature information of the electrocardiogram graph based on the first reference point and the fourth reference point; including, method.

13. A computer program stored in a computer-readable storage medium, wherein the computer program, when executed on one or more processors, performs an operation of providing a user interface for reading electrocardiogram data based on artificial intelligence. The above action is, An action to display an electrocardiogram graph through a user interface for reading electrocardiogram data; An operation of displaying a first reference point on the electrocardiogram graph based on a location selected according to the first input when a first input of the user is obtained through the user interface; After identifying the first reference point, if a second input from the user is detected through the user interface, an operation of displaying a second reference point on the electrocardiogram graph based on a location selected according to the second input; and An operation of calculating and displaying a measurement value corresponding to the interval between the first reference point and the second reference point through the user interface; including, Computer program.

14. A device providing a user interface for reading electrocardiogram data based on artificial intelligence, A processor comprising at least one core; A memory containing program codes executable by the processor; and including a display; The above processor, An electrocardiogram graph for reading electrocardiogram data is displayed through the display, and when a first input of a user is obtained through the display, a first reference point is displayed on the electrocardiogram graph based on a position selected according to the first input, and after identifying the first reference point, when a second input of the user is detected through the display, a second reference point is displayed on the electrocardiogram graph based on a position selected according to the second input, and a measurement value corresponding to an interval between the first reference point and the second reference point is calculated and displayed through the display. device.

Images