Information processor, information processing method and program

Abstract

To process motion information showing a plurality of repeated motions of a living organism such as an electrocardiogram and to analyze waveforms showing the plurality of respective motions.SOLUTION: An information processor includes at least one processor and processes motion information showing a plurality of repeated motions of a living organism. The at least one processor obtains the motion information, divides the obtained motion information into a plurality of pieces of first waveform information showing the respective waveforms of the plurality of repeated motions of the living organism, clusters the plurality of pieces of first waveform information into a plurality of clusters including the plurality of pieces of first waveform information, respectively, selects one or more pieces of second waveform information showing a waveform representing a waveform showing the first waveform information included in the respective clusters from the first waveform information included in the respective clusters, and executes processing for list displaying to at least one screen a plurality of pieces of second waveform information showing waveforms representing the respective clusters.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program for processing movement information that electrically indicates the movement of the heart or the like of a living organism. [Background technology]

[0002] Electrocardiographs that are attached to the body of a subject and can measure the electrocardiogram over a long period of time are known (see, for example, Patent Document 1). In addition, as methods of statistical processing and correction of information, individual correction, Bazett correction, and Fridericia correction are known (Non-Patent Documents 1 and 2). In addition, as a method of processing time-series information such as an electrocardiogram, a time-series data clustering method is known (Non-Patent Document 3). In addition, a dynamic time warping (DTW (Dynamic Time Warping)) method is known as a method of determining the similarity between time-series data (Non-Patent Document 4). In addition, a method of determining a representative waveform from a signal that includes a large number of repeating waveforms, such as the heartbeat of an electrocardiogram, is known (Non-Patent Document 5). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Utilization of QT measurement index and QT / RR relationship (Kouichi Mizumaki, Heart, 48(4), 2016; Vol.48 No.4(2016) https: / / www.jstage.jst.go.jp / article / shinzo / 48 / 4 / 48_388 / _pdf) [Non-Patent Document 2] Study design and statistical evaluation method for evaluating QT prolongation (Watashi, Jpn J Biomet Vol. 29, Special Issue, 1 2008;https: / / www.jstage.jst.go.jp / article / jjb / 29 / Special_Issue_1 / 29_Special_Issue_1_S61 / _pdf / -char / ja) [Non-Patent Document 3] Time series data clustering and K-Shape (http: / / www.cybergarage.org / memo / timeseries_clustering-kshape / ) [Non-Patent Document 4] DTW(Dynamic Time Warping) Dynamic time warping method (https: / / data-analysis-stats.jp / %E6%A9%9F%E6%A2%B0%E5%AD%A6%E7%BF%92 / dt wdynamic-time-warping%E5%8B%95%E7%9A%84%E6%99%82%E9%96%93%E4%BC%B8%E7%B8%AE%E6%B3%95 / ) [Non-Patent Document 5] A Holter ECG QRS Wave Morphology Classification System Using a Double-Layer SOM (Kaneko et al., Biomedical Engineering, 46(6), 576-586,<h2 style=";text-align:left;direction:ltr">2008;https: / / www.jstage.jst.go.jp / article / jsmbe / 46 / 6 / 46_6_576 / _pdf / -char / ja#:~:text=%E3%83%9B%E3%83%AB%E3%82%BF%E3%83%BC%E5%BF%83%E9%9B%BB%E5%9B%B3%E3%81%A7%E3%81%AE%E4%B8%8D%E6%95%B4%E8%84%88%E8%87%AA%E5%8B%95%E8%A7%A3%E6%9E%90%E6%A9%9F%E8%83%BD%E3 %81%AB%E3%81%AF%E6%A4%9C%E5%87%BA%E3%81%95%E3%82%8C%E3%81%9F%20%E5%BF%83%E9%9B%BB%E6%B3%A2%E5%BD%A2%E3%82%92%E4%B8%80%E5%BF%83%E6%8B%8D%E6%AF%8E%E3%81%AB%E5%88%87%E3%82%8A%E5%87%BA%E3%81%97%EF%BC%8C%E4%B8%BB%E3%81%ABQRS%E6%B3%A2%E3%81%AE%E5%BD%A2%E6 %85%8B%E6%AF%8E%E3%81%AB%20%E5%88%86%E9%A1%9E%E3%81%99%E3%82%8B%E6%A9%9F%E8%83%BD%E3%81%8C%E3%81%82%E3%82%8B%EF%BC%8E%E6%AD%A3%E5%B8%B8%E3%81%AA%E5%BF%83%E6%8B%8D%E3%81%AE%E6%B3%A2%E5%BD%A2%E3%82%84%E7%95%B0%E5%B8%B8%E5%BF%83%E6%8B%8D%E3%81%AE%E6%B3 %A2%E5%BD%A2%20%E5%90%8C%E5%A3%AB%E3%81%8C%E3%82%B0%E3%83%AB%E3%83%BC%E3%83%94%E3%83%B3%E3%82%B0%E3%81%95%E3%82%8C%E3%82%8B%E3%81%93%E3%81%A8%E3%81%A7%EF%BC%8C%E5%8C%BB%E7%99%82%E5%BE%93%E4%BA%8B%E8%80%85%E3%81%AF%E5%8A%B9%E7%8E%87%E7%9A%84%E3%81%AB,%E7%95%B0%E5%B8%B8%E5%BF%83%E9%9B%BB%E5%9B%B3%E3%81%AE%E7%A2%BA%E8%AA%8D%EF%BC%8C%E8%A8%B A%E6%96%AD%E3%81%8C%E3%81%A7%E3%81%8D%E6%9C%89%E7%94%A8%E3%81%AA%E8%A8%BA%E6%96%AD%E6%94% AF%E6%8F%B4%E6%A9%9F%E8%83%BD%E3%81%A8%E3%81%97%E3%81%A6%20%E7%94%A8%E3%81%84%E3%82%89%E3 %82%8C%E3%81%A6%E3%81%84%E3%82%8B%EF%BC%8E%E4%B8%80%E8%88%AC%E7%9A%84%E3%81%AB%E3%81%AF%E7 %9B%B8%E4%BA%92%E7%9B%B8%E9%96%A2%E4%BF%82%E6%95%B0%E6%B3%95%E3%82%92%E7%94%A8%E3%81%84%E 3%81%9F%E3%83%9E%E3%83%AB%20%E3%83%81%E3%83%86%E3%83%B3%E3%83%97%E3%83%AC%E3%83%BC%E3%83%8 8%E3%83%9E%E3%83%83%E3%83%81%E3%83%B3%E3%82%B0%E6%96%B9%E5%BC%8F%E3%81%8C%E7%94%A8%E3%81% 84%E3%82%89%E3%82%8C%E3%81%A6%E3%81%84%E3%82%8B%EF%BC%BB7%20%E2%80%958%EF%BC%BD%EF%BC%8E), Summary of the Invention [Problem to be solved by the invention]

[0004] An electrocardiogram measured from a single subject over a long period of time, such as a day, can contain waveforms representing a large number of heartbeats, on the order of 100,000. However, even for doctors and other experts, analyzing each of these waveforms representing a large number of heartbeats has been difficult.

[0005] The present invention has been made against this background, and has as its objective the processing of motion information indicating multiple repeated movements of a living organism, such as an electrocardiogram obtained by measuring a single human, and analyzing waveforms indicating each of the multiple movements contained in the motion information. [Means for solving the problem]

[0006] According to one aspect of the present disclosure, there is provided an information processing device including at least one processor that processes movement information indicating multiple repetitive movements of an organism, wherein the at least one processor is configured to execute a process of acquiring the movement information, dividing the acquired movement information into a plurality of first waveform information indicating waveforms of each of the multiple repetitive movements of the organism, clustering the plurality of first waveform information into a plurality of clusters each including a plurality of the first waveform information, selecting one or more second waveform information indicating a waveform representative of the waveform indicated by the first waveform information included in each of the clusters from the first waveform information included in each of the clusters, and displaying a list of the plurality of second waveform information indicating the waveforms representative of each of the clusters on at least one screen.

[0007] Furthermore, according to one aspect of the present disclosure, there is provided a method in an information processing device including at least one processor, which processes movement information indicating multiple repetitive movements of an organism, by the at least one processor executing a predetermined instruction command, the method including the steps of acquiring the movement information, dividing the acquired movement information into a plurality of first waveform information indicating waveforms of each of the multiple repetitive movements of the organism, clustering the plurality of first waveform information into a plurality of clusters, each cluster including a plurality of the first waveform information, selecting, from the first waveform information included in each of the clusters, one or more second waveform information indicating a waveform representative of the waveform indicated by the first waveform information included in each of the clusters, and displaying, in a list on at least one screen, the plurality of second waveform information indicating the waveform representative of each of the clusters.

[0008] Furthermore, according to one aspect of the present disclosure, there is provided a program that causes an information processing device, which includes at least one processor, to function as a processor configured to execute a process of acquiring the movement information, dividing the acquired movement information into a plurality of first waveform information indicating waveforms of each of the plurality of repetitive movements of the organism, clustering the plurality of first waveform information into a plurality of clusters, each of the plurality of first waveform information including a plurality of the first waveform information, selecting one or more second waveform information indicating a waveform representative of the waveform indicated by the first waveform information included in each of the clusters from the first waveform information included in each of the clusters, and displaying a list of the plurality of second waveform information indicating the waveforms representative of each of the clusters on at least one screen. Effect of the Invention

[0009] According to the present invention, it is possible to process movement information indicating multiple repeated movements of a living organism, and to analyze waveforms indicating each of the multiple movements included in the movement information.

[0010] It should be noted that the above-mentioned effects are merely illustrative for the convenience of explanation and are not limiting. In addition to or instead of the above-mentioned effects, any effect described in this disclosure or any effect obvious to a person skilled in the art may be achieved. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating an example of a configuration of an information processing system 1 according to the present disclosure. [Figure 2A] 2 is a diagram illustrating a hardware configuration of the electrocardiograph 2 shown in FIG. 1. [Figure 2B] 2 is a diagram illustrating an example of a hardware configuration of an information processing device 3 and a terminal device 12 illustrated in FIG. [Figure 3A] 4 is a diagram illustrating an example of a waveform of an electrocardiogram signal indicated by electrocardiogram information. FIG. [Figure 3B] 10A and 10B are diagrams illustrating examples of waveforms indicated by waveform information. [Figure 3C] FIG. 13 is a diagram illustrating an example of a user identifying the end point of the T wave as the portion of the waveform to be measured. [Figure 4] 13 is a diagram showing an information table used for information processing in the information processing device 3. FIG. [Diagram 5] 2 is a diagram showing program modules included in an information processing program 34 for performing information processing in the information processing device 3. FIG. [Figure 6A] FIG. 2 is a diagram illustrating a template screen 4. [Figure 6B] 1 is a diagram illustrating an example of a template screen 4 including a template 40 having a characteristic that the change in the T wave is gradual. [Figure 6C] 6C is an enlarged view of the T wave of the ith template 40, which has a particularly gradual change, out of the n templates 40 shown in FIG. 6B (1≦i≦n). [Figure 7] 2 is a diagram showing a communication sequence performed among an electrocardiograph 2, an information processing device 3, and a terminal device 12 included in the information processing system 1 shown in FIG. [Figure 8A] FIG. 13 is a diagram illustrating a template screen 4 including a template 40 annotated with a Δ wave. [Figure 8B] FIG. 1 is a diagram illustrating a trend graph plotting the duration of QTc intervals measured over a long period of time. [Figure 9A] 1 is a diagram illustrating a normal cardiac waveform when no intraventricular conduction disorder occurs in the heart. [Figure 9B] FIG. 1 is a diagram illustrating an example of an abnormal cardiac waveform when intraventricular conduction disorder occurs in the heart. [Figure 9C] 9A and 9B are diagrams illustrating an example of a template screen 4 including a template 40 annotated with ventricular conduction disorder. [Figure 9D] FIG. 13 is a diagram illustrating an example of a trend graph. [Figure 10A] FIG. 13 is a diagram illustrating a template screen 4 including a template 40 annotated with a PVC. [Figure 10B] FIG. 13 is a diagram illustrating an example of a trend graph. [Figure 11A] FIG. 13 is a diagram illustrating a template screen 4 including a template 40 annotated with ST elevation. [Figure 11B] FIG. 13 is a diagram illustrating an example of a trend graph. [Figure 12A] 6B is a diagram illustrating an example of a waveform of the template 40 included in the template 40 shown in FIG. 6A etc. [Figure 12B] 12B is a diagram illustrating an example of a cardiac waveform indicated by waveform information included in cluster information D corresponding to the template 40 selected as shown in FIG. 12A. FIG. [Figure 13A] 1 is a diagram illustrating an example of a template screen 4 including a template 40 on which a cardiac waveform of arrhythmia is displayed. [Figure 13B] FIG. 1 is a diagram illustrating an example of an arrhythmia heart rate waveform. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [First embodiment] First, a first embodiment of the present disclosure will be described with reference to the accompanying drawings. In addition, common components and processes in the drawings are given the same reference numerals. In addition, in the drawings, for convenience of illustration, some of the names of components, such as "module", may be omitted as appropriate, and lines indicating information transmitted and received between components may be omitted as appropriate.

[0013] Furthermore, the information processing device according to the present disclosure can display waveforms of signals corresponding to multiple repeated movements contained in signals indicating multiple repeated movements in the human body, such as electrocardiograms obtained by measuring the human heart, for example, electroencephalograms obtained by measuring the human brain. In other words, this "movement" is not limited to physical movements in the human body, but also includes static movements such as the brain.

[0014] Furthermore, the information processing device according to the present disclosure can process signals obtained by measuring various living and non-living things, including not only humans but also mammals, reptiles, amphibians, fish, invertebrates, plants, and natural phenomena, and can process signals indicating the movements of these living things. Furthermore, the information processing device according to the present disclosure can process signals obtained by measuring not only one living thing, but also multiple living things, and can process signals indicating the movements inside the bodies of these individuals. However, in the following, in order to make the explanation more specific and easy to understand, a specific example will be a case in which the information processing device according to the present disclosure processes an electrocardiogram of a single person (subject) undergoing a health check or treatment for an illness.

[0015] 1. Information Processing System Configuration First, the configuration of an information processing system 1 according to the present disclosure will be described. Fig. 1 is a diagram illustrating the configuration of the information processing system 1 according to the present disclosure. As shown in Fig. 1, the information processing system 1 has a configuration in which an electrocardiograph 2, an information processing device 3, and a terminal device 12 are connected to each other via a communication network 100 so as to be able to transmit and receive information. However, the electrocardiograph 2 and the information processing device 3, and the information processing device 3 and the terminal device 12 can be connected to each other via electric wires or cables so as to be able to transmit information directly without the communication network 100.

[0016] The communication network 100 is a wired communication network or a wireless network capable of data communication, or a combination of a wired communication network and a wireless network. The communication network 100 transmits the electrocardiogram information transmitted by the electrocardiograph 2 to the information processing device 3. The communication network 100 also transmits information between the information processing device 3 and the terminal device 12 when a user, such as a doctor performing an examination, uses the terminal device 12 to operate the information processing device 3 or to observe and analyze the electrocardiogram information and waveform information processed by the information processing device 3.

[0017] 2. Configuration of Electrocardiograph 2 2A is a diagram illustrating a hardware configuration of the electrocardiograph 2 shown in FIG. 1. As shown in FIG. 2A, an electrode interface (electrode IF) 202, a processor 206, a memory 208, and a communication interface 212 including a communication processing circuit 214 are connected via a bus 200 so as to be capable of transmitting and receiving information and data to each other. The electrocardiograph 2 is, for example, a portable electrocardiograph worn on the subject's body, or a so-called 12-lead electrocardiograph. The electrocardiograph 2 measures the subject's heart using these components, and transmits the electrocardiogram information to the information processing device 3 via the information processing system 100 in real time. Alternatively, the electrocardiograph 2 stores the electrocardiogram information in the memory 208, and transmits the stored electrocardiogram information to the information processing device 3 via the communication network 100 in response to a request from the information processing device 3. Alternatively, the information processing device 3 stores electrocardiogram information obtained over a predetermined period of time, for example one hour to one day, in memory 208, and outputs the stored electrocardiogram information to the information processing device 3 via a cable (not shown) or via the memory 208 and an external recording medium 210 that is detachable from the information processing device 3 and includes a non-volatile memory.

[0018] The electrode interface 202 is connected to n (1≦n) electrodes 204 that are placed on the subject's body surface and detect analog electrical signals (electrocardiogram signals) generated by the subject's heart. The electrode interface 202 includes an amplifier that amplifies the electrocardiogram signals, and an analog / digital (A / D) converter that converts the amplified electrocardiogram signals into digital data. The electrode interface 202 amplifies the electrocardiogram signals of the subject and converts them into digital data to generate electrocardiogram information indicating the electrocardiogram of the subject.

[0019] The processor 206 is composed of at least one processor (CPU), or a combination of at least one CPU and at least one digital signal processor (DSP) specialized for a specific process such as signal processing. The processor 206 executes instructions included in a program stored in the memory 208 and functions as a control unit that controls other components connected via the bus 200. The programs stored in the memory 208 may include a program including instructions for implementing the functions of an OS (not shown), and an application program including instructions for acquiring an electrocardiogram signal of a subject, generating electrocardiogram information, and transmitting or storing the generated electrocardiogram information.

[0020] The memory 208 is composed of a ROM, a RAM, a non-volatile memory, a HDD (not shown), an SSD (not shown), and the like, and functions as a storage unit. The ROM stores an application program including an instruction command for using the information provision service according to the present disclosure, and a program including an instruction command for executing an OS. The RAM is a memory used for writing and reading data while the instruction command of the program stored in the ROM is being executed by the processor 206. The non-volatile memory is a memory into which data is written and read by the execution of a program, and for example, when the electrocardiograph 2 is a portable electrocardiograph, the electrocardiogram information written in the non-volatile memory is stored even after the power supply of the electrocardiograph 2 is turned off. Note that, depending on the specifications of the application program, the external recording medium 210 or the like may be attached and detached to the memory 208 as described above, and the memory 208 may write the electrocardiogram information to the external recording medium 210.

[0021] The communication interface 212 functions as a communication unit that transmits, in real time, electrocardiogram information obtained by measuring the subject to the information processing device 3 connected via the communication network 100, via the communication processing circuit 214 and an antenna (not shown). Depending on the specifications of the application program stored in the memory 208, the communication interface 212 may transmit the electrocardiogram information stored in the memory 208 in response to a request from the information processing device 3, as described above.

[0022] The communication processing circuit 214 performs communication processing for a wideband wireless communication system conforming to the LTE system. Alternatively, the communication processing circuit 214 performs communication processing for a wireless LAN conforming to the IEEE802.11 standard or a wireless communication system conforming to the Bluetooth (registered trademark) standard. Furthermore, the communication processing circuit 214 can also perform communication processing for wired communication instead of or in addition to wireless communication.

[0023] 3. Configuration of the information processing device 3 and the terminal device 12 2B is a diagram illustrating an example of the hardware configuration of the information processing device 3 and the terminal device 12 shown in FIG. 1. The information processing device 3 and the terminal device 12 do not need to have all of the components shown in FIG. 2B, and may have a configuration in which some components are omitted, or may have other components added. In addition, the information processing device 3 and the terminal device 12 do not need to be integrally configured in a single housing, and may be configured across multiple computers connected to each other via the communication network 100. In addition, the information processing device 3 and the terminal device 12 do not necessarily need to be the same type of device, and for example, the information processing device 3 may be a server device, and the terminal device 12 may be a personal computer.

[0024] 2B, the information processing device 3 and the terminal device 12 have a configuration in which an output interface 302, a processor 306, a memory 308, a communication interface 312, and an input interface 316 are connected via a bus 300 so as to be capable of transmitting and receiving information and data to and from each other. Output devices such as a printer (not shown) and a display 304 are connected to the output interface 302. Input devices such as a mouse 318 and a keyboard 320 are connected to the input interface 316. In other words, the information processing device 3 and the terminal device 12 include components as a general computer.

[0025] The keyboard 320 is, for example, a general keyboard connected to a personal computer or displayed on a smartphone. When the keyboard 320 is a keyboard connected to a personal computer, the keyboard 320 includes hardware key switches used for inputting alphabets, numbers, and symbols, and hardware key switches used for controlling the computer, such as a control key. By simultaneously pressing the key switch of the control key of the keyboard 320 and the key switch for inputting alphabets, the user of the information processing system 1 can perform operations on the information processing system 1 using so-called shortcut keys.

[0026] The information processing device 3 processes the electrocardiogram information of the subject input from the electrocardiograph 2 by these components. Furthermore, the information processing device 3 can display waveform information showing waveforms corresponding to each of the many beats included in the electrocardiogram information on the display 304 of the information processing device 3 and the terminal device 12 so as to make it easy to observe, or print it out from a printer. In the following description, "beat" and "heartbeat" are almost synonymous, but "beat" is used for the sake of uniformity of terminology. The terminal device 12 functions as an input / output device of the information processing device 3 located at a distance from the information processing device 3 by these components. In other words, the information processing device 3 transmits and receives information to and from the information processing device 3 so that the user can operate the information processing device 3 from a location away from the information processing device 3 and observe the electrocardiogram information and waveform information, transmits the user's operation contents to the information processing device 3, and outputs the electrocardiogram information and waveform information transmitted from the information processing device 3 from an output device such as the output interface 302 and displays it to the user.

[0027] The output interface 302 is connected to various output devices as described above and functions as an information output unit for outputting information from the connected output devices. As the output interface 302, a known connection format such as a serial port, a parallel port, a USB, or an HDMI (registered trademark) may be adopted depending on the application.

[0028] The processor 306, like the processor 206 of the electrocardiograph 2, is composed of at least one processor (CPU), or a combination of at least one CPU and at least one DSP or GPU specialized for a specific process such as signal processing or image processing. The processor 306 executes instructions included in the programs stored in the memory 308 and functions as a control unit that controls other components connected via the bus 300. In the information processing device 3, the programs stored in the memory 308 may include a program including instructions for implementing the functions of the OS. In addition, the programs stored in the memory 308 may include an application program including instructions for analyzing electrocardiogram information input from the electrocardiograph 2 and displaying waveform information that is included in the electrocardiogram information and indicates a waveform (beat waveform) corresponding to each of a plurality of beats.

[0029] Furthermore, processor 306 executes a process of acquiring movement information indicating multiple repetitive movements of the organism, dividing the acquired movement information into multiple first waveform information indicating the waveform of each of the multiple repetitive movements of the organism, clustering the multiple first waveform information into multiple clusters each including multiple first waveform information, selecting one or more second waveform information indicating a waveform representative of the waveform indicated by the first waveform information included in each cluster from the first waveform information included in each cluster, and displaying a list of the multiple second waveform information indicating the waveform representative of each cluster on at least one screen.

[0030] The memory 308 includes the above-mentioned storage device and functions as a storage unit. The memory 308 further stores an application program (described later with reference to FIG. 5 and the like) for processing to acquire motion information indicating a plurality of repeated motions of the living organism, divide the acquired motion information into a plurality of first waveform information indicating waveforms of the respective plurality of repeated motions of the living organism, cluster the plurality of first waveform information into a plurality of clusters each including a plurality of first waveform information, select one or more second waveform information indicating waveforms representative of the waveforms indicated by the first waveform information included in each cluster from the first waveform information included in each cluster, and display a list of the plurality of second waveform information indicating waveforms representative of each cluster on at least one screen. Note that the external recording medium 210 is detachably attached to the memory 308, similar to the memory 208 of the electrocardiograph 2, and the memory 308 can read out electrocardiogram information from the external recording medium 210.

[0031] The communication interface 312 performs processing for transmitting and receiving information and data via the communication network 100 according to the wireless communication method described above for the communication interface 212 or a known wired communication method. In the information processing device 3, the communication processing circuit 314 performs processing for receiving electrocardiogram information from the electrocardiograph 2 via the communication network 100, for example. The communication processing circuit 314 also performs processing for transmitting electrocardiogram information and waveform information obtained from the electrocardiogram information to the terminal device 12 via the communication network 100. The communication processing circuit 314 also performs processing for receiving information indicating an operation performed by a user on the keyboard 320 or the like from the terminal device 12. In the terminal device 12, the communication processing circuit 314 also performs processing for receiving electrocardiogram information and waveform information from the information processing device 3 via the communication network 100. The communication processing circuit 314 also performs processing for receiving information indicating an operation performed by a user on an input device of the terminal device 12 via the communication network 100.

[0032] The input interface 316 accepts operations performed by the user on the above-mentioned input devices, and outputs information indicating the accepted operations to the processor 306 via the bus 300.

[0033] 4. Explanation of electrocardiogram information and waveform information The electrocardiogram information and waveform information (first waveform information) will be described below. FIG. 3A is a diagram illustrating an example of the waveform of an electrocardiogram signal indicated by the electrocardiogram information. FIG. 3B is a diagram illustrating an example of the waveform indicated by the waveform information. The electrocardiogram information and the waveform indicated by the waveform information are generally widely known without needing to be described with reference to FIG. 3A and FIG. 3B. The electrocardiogram information indicates the electrocardiogram waveform of the subject. The information processing device 3 processes the electrocardiogram waveform and generates waveform information by dividing the electrocardiogram information into information corresponding to each of multiple heartbeats. The electrocardiogram information is displayed as an electrocardiogram waveform on the display 304 or the like in the information processing device 3 and the terminal device 12. The waveform information is also displayed as a beat waveform on the display 304 or the like in the information processing device 3 and the terminal device 12.

[0034] The electrocardiograph 2 generates electrocardiogram information by converting an analog electrocardiogram signal detected from the subject via the electrodes 204 into a digital format using the electrode interface 202. The electrocardiogram information indicates the waveform of the electrocardiogram signal. The electrocardiogram signal includes a pulsation signal indicating a series of pulsation waveforms. The information processing device 3 divides the electrocardiogram information into a plurality of pieces of waveform information corresponding to the respective pulsation signals included in the electrocardiogram signal.

[0035] As shown in Fig. 3B, one beat waveform included in an electrocardiogram signal includes waveforms called P waves, Q waves, R waves, S waves, T waves, and U waves. Each of the P waves, Q waves, R waves, S waves, T waves, and U waves included in one beat waveform can be measured for analyzing electrocardiogram information to diagnose the heart. In addition, the start point, end point, maximum point (peak), and minimum point of these waveforms included in one beat waveform can also be measured.

[0036] In addition, the time length between the start point, end point, maximum point, minimum point, etc. of these waveforms included in one pulsating waveform may also be the object of measurement. In addition, the time length between the start point, end point, maximum point, minimum point, etc. of these waveform components included in each adjacent pulsating waveform may also be the object of measurement or analysis. Hereinafter, the waveforms and the start points of the waveforms included in the electrocardiogram signal that may be the object of measurement may also be described as the measurement object part. Furthermore, the difference in voltage value between the maximum point and minimum point of the ST wave (ST wave peak value), the difference in voltage value between the maximum point and minimum point of the T wave (peak value of the T wave) relative to the difference in voltage value between the maximum point and minimum point of the QRS complex from the start point of the Q wave to the end point of the S wave (peak value in the QRS width), etc. may also be the measurement object part.

[0037] The time length between the measurement target portions included in each of the pulsation waveforms is, for example, the time length of the QT interval from the start point of the Q wave to the end point of the T wave, the time length of the QRS width, the time length of the PR interval, the time length from the start point of the Q wave to the maximum point of the T wave, and the time length from the maximum point of the T wave to the end point of the T wave. The time length between the measurement target portions included in each of the adjacent pulsation waveforms is, for example, the RR interval indicating the time length between the peaks of the R waves included in two adjacent waveforms. In an electrocardiogram waveform, the period from just before the start point of one P wave to the time corresponding to the RR interval is one pulsation waveform. In the explanation of the present disclosure, the multiple pulsations of the heart are not described as being "periodic" but are described as being "repeated", etc., because the time corresponding to the RR interval changes depending on the physical condition and exercise state of the subject.

[0038] A user can specify any one of the points included in the waveform indicated by the waveform signal. FIG. 3C is a diagram illustrating an example of a user specifying the end point of the T wave as the measurement target portion of the waveform. For example, as shown in FIG. 3C, two users can each independently observe the waveform indicated by the displayed waveform information and specify the end point of the T wave in the displayed waveform. In such a case, if each of these users assumes a different baseline for the waveform information, the end points of the T wave specified by each of the two users may not match, as shown by arrows a and b in FIG. 3C. In this way, when the specified measurement target portions do not match between multiple users, there will be variation in the intervals between the measurement target portions obtained by analyzing the waveform information, such as the QT interval. According to the present disclosure, it is possible to eliminate or reduce the variation in the specification of the measurement target portions and the intervals between the measurement target portions.

[0039] In addition, when the electrocardiograph 2 is portable and is attached to the subject to generate electrocardiogram information for a long time, the electrocardiograph 2 measures electrocardiogram information in the subject's daily life. In such a case, the baseline, which is important in the analysis of the electrocardiogram waveform indicated by the electrocardiogram information, changes according to the subject's movements, so that if the electrocardiogram information is analyzed assuming a horizontal baseline, a significant error may occur in the analysis result. In addition, if a common baseline is assumed for the multiple electrocardiogram information in order to analyze multiple electrocardiogram information obtained by measuring multiple users, a significant error may occur in the analysis result for the electrocardiogram information. According to the present disclosure, when such an analysis of electrocardiogram information is performed, it is possible to eliminate or reduce errors occurring in the analysis result of the electrocardiogram information due to the assumption of the baseline. In other words, the present disclosure is not only effective for the analysis of electrocardiogram information obtained by short-term measurement in seconds, but also shows remarkable effectiveness in the analysis of electrocardiogram information obtained by long-term measurement such as several hours to a day.

[0040] 5. Information regarding information processing in the information processing device 3 Hereinafter, information on information processing in the information processing device 3 will be described. FIG. 4 is a diagram showing an information table used for information processing in the information processing device 3. This information table is stored in the memory 308 by the processor 306. As shown in FIG. 4, the information table on information processing in the information processing device 3 includes a plurality of subject identification information IDs that uniquely identify any one of a plurality of subjects or any one of a plurality of measurements on a subject. The information table further includes electrocardiogram information A, waveform information B, time information C, cluster information D, template screen information E, representative waveform information F, measurement target portion information G, analysis result information H, analysis result information I, diagnosis information J, and corrected information K that are associated with each of the plurality of subject identification information IDs, and these pieces of information associated with the same subject identification information ID correspond to each other. Note that the information table may be created as one file, or may be generated by dividing it into a plurality of files.

[0041] The electrocardiogram information A is electrocardiogram information obtained from a subject identified by the associated subject identification information ID or during measurement by the electrocardiograph 2. The waveform information B is waveform information obtained from a subject identified by the associated subject identification information ID or generated from the electrocardiogram information during measurement.

[0042] The time information C is time information indicating the time when each of the plurality of waveform information included in the corresponding waveform information B was generated. In other words, the time information C is a time stamp for each of the plurality of waveform information included in the corresponding waveform information B. The cluster information D is waveform information included in n (1≦n) clusters obtained by clustering processing by time series data clustering for the corresponding waveform information B. The template screen information E is screen information indicating the format of a template screen used to display n heartbeat waveforms representing each of the n clusters included in the corresponding cluster information D as n templates. The representative waveform information F is n pieces of waveform information indicating each of the n waveforms displayed as templates in the corresponding template screen information E. Note that the representative waveform information F does not have to be waveform information itself indicating one heartbeat waveform representing each of the n clusters, and may be, for example, a flag corresponding to each of the plurality of waveform information B as described above. For example, when the representative waveform information F is a flag of the waveform information B, the waveform information corresponding to a flag with a value of 1 is representative waveform information, and the waveform information corresponding to a flag with a value of 0 is not representative waveform information. It should be noted that multiple pieces of representative waveform information F may be selected from one cluster information D.

[0043] The measurement target portion information G is information indicating the measurement target portion specified in each of the heartbeat waveforms displayed as n templates according to the user's operation. The user's operation for each of the n templates is an operation of selecting one of the n templates and specifying the measurement target portion in the selected template. Specifically, the operation of specifying the measurement target portion is, for example, an operation in which the user specifies the start point of the Q wave and the end point of the T wave in the template 40 as points on a coordinate system with the voltage value of the heartbeat waveform as the vertical axis and time as the horizontal axis. The annotation information H is information indicating annotations that a user such as a doctor can add to each of the n templates when looking at the n templates. The annotation is, for example, information for adding a note to the template when the user who looks at the template recognizes the presence of a Δ(δ) wave or a premature ventricular contraction (PVC).

[0044] The analysis result information I is information indicating the result of the analysis process for the plurality of waveform information included in the corresponding waveform information B. The analysis process for the plurality of waveform information included in the waveform information B is, for example, a process of displaying the time length between the measurement target portions of each of the plurality of waveform information included in the corresponding waveform information B in a chronological graph format with the time length as the vertical axis and the time as the horizontal axis. The diagnosis information J is information indicating a diagnosis given by a user such as a doctor to the heart of a subject identified by the corresponding subject identification information ID. Note that, when the user does not input these pieces of information, the annotation information H and the diagnosis information J are contents indicating that fact, for example, a null value (φ). Note that, in the following description, for example, information such as waveform information is given a symbol such as waveform information B as necessary. The corrected information K is information indicating the time length of the QT interval obtained by correcting the time length of the QT interval by an individual correction method or the like in order to eliminate the influence of changes in the beat rate (heart rate), as described in the second embodiment.

[0045] 6. Information processing program 34 executed in information processing device 3 Hereinafter, a description will be given of the information processing program 34 that processes information in the information processing device 3. Fig. 5 is a diagram showing program modules included in the information processing program 34 that processes information in the information processing device 3. As shown in Fig. 5, the information processing program 34 includes an electrocardiogram information acquisition module 340, a waveform information generation module 342, a clustering processing module 346, a representative waveform selection module 348, a template screen generation module 350, a target portion identification module 352, an annotation generation module 354, and a waveform information analysis module 356.

[0046] These components of the information processing program 34 include instructions necessary to realize the respective functions, and are stored in the memory 308. The instructions included in each of these components are read and executed by the processor 306. The information processing program 34 acquires electrocardiogram information A of each of a plurality of subjects or a plurality of measurements from the electrocardiograph 2, generates n templates (described later with reference to FIG. 6A, etc.), and displays them in the template screen by using these components. The n templates are preferably created for each of a plurality of subjects. There is a tendency that only a few clusters are generated from waveform information included in electrocardiogram information obtained by measurement of one subject. On the other hand, there is a tendency that many clusters are generated from waveform information included in electrocardiogram information obtained by measurement of multiple subjects. In other words, since clustering processing can be effectively performed on waveform information obtained by measurement of one subject, only a few clusters of waveform information are generated, and the number of templates can be reduced. It is clear that the fewer the number of templates, the less work the user needs to do to identify the measurement target portion in the template.

[0047] Furthermore, the information processing program 34 identifies the measurement target portion of each of the n displayed templates in response to a user operation, and attaches an image such as a cursor to the identified measurement target portion. The information processing program 34 also accepts annotation input for the template in response to a user operation, and displays the annotation by attaching it to the template. Furthermore, the information processing device 3 performs an analysis process on the waveform information B in response to a user operation, and displays the result of the analysis process on the display 304 or the like.

[0048] Each of the components of the information processing program 34 will be described below. The electrocardiogram information acquisition module 340 acquires all of the electrocardiogram information A required for the processing of the information processing program 34 from the electrocardiograph 2 at once via the communication interface 312, and stores it in the memory 308. In the following, a specific example will be given in which the electrocardiogram information A required for the information processing program 34 is electrocardiogram information obtained by measuring one subject (one individual) over one day. Alternatively, the electrocardiogram information acquisition module 340 acquires the electrocardiogram information obtained by measuring the subject from the electrocardiograph 2 in real time (real time) or at predetermined intervals, and stores it in the memory 308. When the information processing program 34 has completed acquisition of all of the electrocardiogram information required for the processing by the information processing program 34, all of the electrocardiogram information acquired and stored in the memory 308 is regarded as electrocardiogram information A. The electrocardiogram information A stored in the memory 308 is read out by the waveform information generation module 342.

[0049] The waveform information generating module 342 detects a portion showing a maximum voltage value (peak of the QRS complex) in each of the multiple heartbeat waveforms included in the electrocardiogram waveform in response to a user's operation accepted via the input interface 316 or the communication interface 312. The waveform information generating module 342 determines the time length between the peaks of two adjacent QRS complexes as the time length of one heartbeat waveform. In addition, the waveform information generating module 342 determines a portion that is a preset time length before the starting point of the preceding Q waveform of two adjacent heartbeat waveforms as the starting point of the preceding heartbeat waveform of the two heartbeat waveforms. In addition, the waveform information generating module 342 determines a portion that is a time length between the peaks of two adjacent QRS complexes after the starting point of the preceding heartbeat waveform as the ending point of the preceding heartbeat waveform. In this way, the waveform information generating module 342 repeats the process of extracting one heartbeat signal from the electrocardiogram signal over the entire electrocardiogram signal, and divides the electrocardiogram signal into a plurality of consecutive heartbeat signals. Furthermore, the waveform information generating module 342 extracts waveform information corresponding to each of the plurality of heartbeat signals obtained by this division from the electrocardiogram information. Through the above-described process, the waveform information generating module 342 divides the electrocardiogram information into a plurality of pieces of waveform information. The waveform information generating module 342 stores the plurality of pieces of waveform information B generated as described above in the memory 308. The waveform information B stored in the memory 308 is read out by the clustering processing module 346.

[0050] The clustering processing module 346 performs clustering processing on the waveform information B using a time-series data clustering method, for example, the K-Shape method, generates n clusters of multiple waveform information from the waveform information B, and stores them in the memory 308. The clustering processing module 346 may perform clustering processing using a method other than the K-Shape method, such as the K-Means method. For example, the clustering processing module 346 may classify waveform information B of similar shapes into clusters using an algorithm that sets conditions for each shape and performs clustering processing, instead of the K-Means method. Furthermore, the clustering processing module 346 may perform supervised machine learning or unsupervised machine learning on the heartbeat waveform included in the electrocardiogram waveform, and perform clustering processing using an AI-like method using the results of the machine learning, thereby improving the accuracy of the clustering processing. The cluster information D stored in the memory 308 is read out by the representative waveform selection module 348.

[0051] The representative waveform selection module 348 selects representative waveform information indicating one heartbeat waveform representative of the heartbeat waveforms indicated by the plurality of waveform information included in each of the n clusters. The representative waveform selection module 348 stores the selected n pieces of representative waveform information in the memory 308 as representative waveform information F. The representative waveform information F stored in the memory 308 is read out by the template screen generation module 350. In addition, when the similarity between the representative waveform of a certain cluster and the representative waveforms of the other n-1 clusters is low in the clustering process, the clustering processing module 346 may erase the cluster and the waveform information included in the cluster as noise so that the cluster is not used in the subsequent processing in the information processing program 34. In such a case, the set of all waveform signals included in the n clusters may be a subset of the set of waveform information B.

[0052] The template screen generating module 350 generates template screen information E from the waveform information B and the representative waveform information F. The template screen generating module 350 stores it in the memory 308 as template screen information E, and outputs it via the output interface 302 or the communication interface 312. The template screen information E output from the template screen generating module 350 is displayed on the display 304 or the like. The template screen information E stored in the memory 308 is read out by the target portion identifying module 352.

[0053] FIG. 6A is a diagram illustrating a template screen 4. Note that FIG. 6A illustrates a case where the template screen includes 11 templates (n=11). However, the number n of templates 40 included in each of the multiple template screens 4 may not be the same. As shown in FIG. 6A, the template screen 4 includes n templates 40, and each of the n templates 40 displays a heartbeat waveform indicated by each representative waveform information F of the waveform information included in the n clusters. In the template screen 4, the templates 40 are displayed in a list. However, the number of template screens 4 is not limited to one, and may be two or more. Note that, for example, cursors indicating the start point of the Q wave and the end point of the T wave as the measurement target portion, and the time length between the start point of the Q wave and the end point of the T wave (QT interval) are displayed superimposed on the template 40.

[0054] The target portion identification module 352 (FIG. 5) accepts a user's operation via the communication interface 312 or the input interface 316. The target portion identification module 352 selects one of the templates 40 in the template screen 4 in response to the user's operation, and further identifies the measurement target portion included in the heartbeat waveform of the template 40, that is, identifies the coordinate range or coordinate point described above. In this way, the user can uniformly identify the measurement target portion for all of the n clusters by referring to all of the n templates 40.

[0055] The target portion identification module 352 identifies, as the measurement target portion, a coordinate range or coordinate point in which a waveform coincides with a waveform in the vicinity of the coordinates of the measurement target portion identified for the representative waveform in each of the n clusters in the heartbeat waveform indicated by the waveform information other than the representative waveform information F of each of the n clusters, or a coordinate range or coordinate point in which a waveform showing high similarity exists. The target portion identification module 352 uses a dynamic time warping method to identify the measurement target portion. The dynamic time warping method is to find all the distances between each point included in the waveform indicated by the representative waveform information F of one cluster in a time series and each point included in another waveform information included in the same cluster in a time series, and to find a time warping path as a set of points that minimizes the distances between these points. Based on the coordinates of the start point of the Q wave and the end point of the T wave identified in the template 40 and the time warping path, the coordinates of the start point of the Q wave and the end point of the T wave in the heartbeat waveform indicating a waveform other than the representative waveform information F are identified. The target portion identification module 352 stores information indicating all measurement target portions including the coordinates of the starting point of the Q wave and the coordinates of the ending point of the T wave included in each of the n clusters thus identified, as measurement target portion information G in the memory 308. The measurement target portion information G stored in the memory 308 is read out by the waveform information analysis module 356.

[0056] The annotation generation module 354 accepts information indicating annotations input by a user for the cardiac waveforms indicated by the representative waveform information F displayed in each of the n templates 40 in the template screen 4 via the output interface 302 or the input interface 316. The annotation generation module 354 stores the information indicating the accepted annotations in the memory 308 as annotation information H. The annotation information H stored in the memory 308 is read out by the template screen generation module 350. Furthermore, the annotation generation module 354 accepts annotations for cardiac waveforms indicated by other than the representative waveform information F, using the annotation information added to each representative waveform displayed in the template 40. For example, when the annotation generation module 354 accepts annotation information for arrhythmia for the representative waveform information F, it also adds annotation information for arrhythmia to other waveform information included in the same cluster. Also, for example, when the annotation generation module 354 receives annotation information indicating that the QT interval of the representative waveform information F is not included in the analysis, the annotation generation module 354 also adds annotation information indicating that the QT interval of the representative waveform information F is not included in the analysis.

[0057] The template screen generating module 350 displays the read annotation information by superimposing it on the n templates 40. If the user observes the heartbeat waveform displayed in the template 40 as a representative waveform and makes a diagnosis of the subject's heart, the user can input the result of the diagnosis via the input device and communication interface 312 or the input interface 316. The annotation generating module 354 stores the diagnosis information indicating the result of the diagnosis in the memory 308 as diagnosis information J. The diagnosis information J stored in the memory 308 is read by the template screen generating module 350 and displayed by superimposing it on the template 40.

[0058] The waveform information analysis module 356 performs an analysis process on the waveform information B and the measurement target portion information G. The waveform information analysis module 356, for example, obtains the time lengths between the measurement target portions in all waveform signals and adjacent waveform signals specified for the template 40 in the template screen 4, for example, the QT interval and the RR interval, and stores them in the memory 308 as the analysis result information I. In addition, the waveform information analysis module 356, for example, arranges the values ​​of the waveform information B in a chronological order in a graph format, stores them in the memory 308 as the analysis result information I, and outputs them via the communication interface 312 or the input interface 316. By performing such an analysis process on the measurement target portion of the waveform information B, the user can know at what time an abnormality such as a disturbance has occurred in the subject's heartbeat waveform.

[0059] 7. Template screen 4 and identification and storage of measurement target using the same Hereinafter, a description will be given of an operation by a user to specify, for example, the starting point of a Q wave and the ending point of a T wave as measurement target portions of waveform information included in electrocardiogram information, and store them in the information processing device 3, in response to the user's operation on the information processing device 3. First, the information processing device 3 starts executing an information processing program 34 (FIG. 5) in response to the user's operation.

[0060] First, the information processing device 3 accepts all electrocardiogram information obtained by the electrocardiograph 2 performing measurements on one subject over the course of one day, stores it as electrocardiogram information A, and generates template screen information E and representative waveform information F. Furthermore, the information processing device 3 uses the generated template screen information E and representative waveform information F to generate the template screen 4 shown in Fig. 6A.

[0061] The user performs an operation to select one of the n templates 40 included in the template screen 4. The information processing device 3 highlights the template 40 selected by this operation, for example, by changing the color. Furthermore, the user performs an operation to specify the measurement target portion of the heartbeat waveform displayed in the selected template 40. This operation may be an operation using the mouse 318, or an operation using directional keys and shortcut keys on the keyboard 320. In response to such an operation, the information processing device 3 displays, for example, an image of a cursor superimposed as a mark on the starting point of the Q waveform and the ending point of the T waveform. Note that the mark indicating the starting point of the Q waveform and the ending point of the T waveform specified by the user is not limited to a cursor, and may be, for example, a circle or a flag.

[0062] When the user performs such an operation for all of the n templates 40 included in the template screen 4, the information processing device 3 identifies the starting point of the Q waveform and the ending point of the T waveform for each of the n templates 40, and displays a cursor superimposed on each of these identified measurement target portions. Furthermore, when the user performs an operation to store the measurement target portions identified in all of the n templates 40, the information processing device 3 stores information indicating the identified measurement target portions in response to this operation.

[0063] FIG. 6B is a diagram illustrating a template screen 4 including a template 40 having a characteristic that the change in the T wave is gradual. FIG. 6C is a diagram showing an enlarged view of the T wave of the i-th template 40 having a particularly gradual change among the n templates 40 shown in FIG. 6B (1≦i≦n). The user performs an operation on the information processing device 3 to specify the onset point of the Q wave and the end point of the T wave in each of the n templates 40 included in the template screen 4 shown in FIG. 6B, and an operation to store these measurement target portions. In response to these operations by the user, the information processing device 3 specifies and stores the onset point of the Q wave and the end point of the T wave in each of the n templates 40.

[0064] However, as shown in FIG. 6C, the change of the T wave of the i-th template 40 is gradual, and it may be difficult for the user to identify the end point of the T wave. In such a case, the user may be confused as to which of the positions indicated by the arrows a and b the end point of the T wave of the template 40 should be. In this case, for example, the user postpones the identification of the end point of the T wave of the i-th template 40, identifies the end part of the T wave of the template 40 other than the i-th template, and then identifies the end part of the T wave of the template 40 other than the i-th template. In this way, the user can identify the end point of the T wave of the i-th template 40 while referring to the end point of the T wave of the template 40 other than the i-th template 40 that has already been identified. As a result of such identification, the user identifies, among the positions indicated by the arrows a and b contained in the i-th template 40, for example, the position indicated by the arrow a indicating a position close to the end point of the T wave contained in the other templates 40, as the end point of the T wave contained in the i-th template 40, and the position is stored in the information processing device 3.

[0065] In addition, the template 40 for identifying the starting point of the Q wave and the ending point of the T wave for the i-th template 40 may be displayed separately from the template screen 4 displaying a list of n templates 40. As a result, the template 40 on which the heartbeat waveform to be identified for the starting point of the Q wave and the ending point of the T wave is displayed may be enlarged and displayed, so that the starting point of the Q wave and the ending point of the T wave can be accurately identified. Furthermore, such a template 40 may display heartbeat waveforms before and after the displayed heartbeat waveform, and heartbeat waveforms for about 10 to 30 seconds including this heartbeat waveform. As a result, the user can easily confirm the position of the baseline connecting the starting point of the P wave of a certain heartbeat waveform to the starting point of the P wave of the next heartbeat waveform, and its long-term fluctuation. Therefore, the starting point of the Q wave and the ending point of the T wave can be identified more accurately.

[0066] 8. Communication sequence in information processing system 1 Hereinafter, a communication sequence between the electrocardiograph 2, the information processing device 3, and the terminal device 12 of the information processing system 1 in the first embodiment will be described. FIG. 7 is a diagram showing a communication sequence performed between the electrocardiograph 2, the information processing device 3, and the terminal device 12 included in the information processing system 1 shown in FIG. 1. Note that in the information processing system 1, the information processing device 3 can operate without the terminal device 12, but in the following description, a specific example is a case where a user operates the information processing device 3 using the terminal device 12 to perform an operation on the template screen 4. As described above, the electrocardiograph 2 can transmit necessary electrocardiogram information to the information processing device 3 in real time or in multiple parts, but in the description here, a specific example is a case where all necessary electrocardiogram information is transmitted from the electrocardiograph 2 at once.

[0067] When the user operates the terminal device 12 to perform an operation to instruct the information processing device 3 to start the information processing program 34 and begin processing, the OS read from the memory 308 and executed by the processor 306 of the terminal device 12 accepts these operations via the input interface 316. Furthermore, the OS of the terminal device 12 transmits information indicating the accepted operation to the information processing device 3 via the communication interface 312 and the communication network 100 (S100).

[0068] The OS, which is read from memory 308 and executed by processor 306 of information processing device 3, receives information indicating an operation to instruct activation of information processing program 34 and start processing via communication network 100 and communication interface 312. Furthermore, the OS of information processing device 3 starts information processing program 34 and starts processing. That is, the OS of information processing device 3 makes processor 306 read each component part of information processing program 34 (FIG. 5) from memory 308 and start execution (S102).

[0069] The electrocardiogram information acquisition module 340 requests the electrocardiograph 2 to transmit electrocardiogram information via the communication interface 312 and the communication network 100 (S104). The OS read from the memory 208 and executed by the processor 206 of the electrocardiograph 2 receives this request via the communication network 100 and the communication interface 212. Furthermore, the OS of the electrocardiograph 2 reads all electrocardiogram information required for processing from the memory 308 and transmits it to the information processing device 3 via the communication interface 312 and the communication network 100 (S106). The electrocardiogram information acquisition module 340 receives the electrocardiogram information via the communication network 100 and the communication interface 312, and stores it in the memory 308 as electrocardiogram information A (S108).

[0070] The waveform information generating module 342 processes the electrocardiogram information A in response to a user's operation to generate waveform information B, and stores the information in the memory 308 (S110). The clustering processing module 346 performs clustering on the waveform information B using a shape-based clustering method such as the K-Shape method, generates n clusters from the waveform information B, each of which includes a plurality of pieces of waveform information, and stores the clusters in the memory 308 (S112). The clustering processing module 346 selects a heartbeat waveform representative of each of the n clusters from the heartbeat waveforms indicated by the waveform information included in each of the n clusters, and regards the waveform information indicating the selected heartbeat waveform as representative waveform information of the cluster. The clustering processing module 346 stores the n pieces of representative waveform information selected for each of the n clusters as representative waveform information F in the memory 308 (S114).

[0071] The template screen generating module 350 generates a template screen 4 (such as FIG. 6A) from the template screen information E and the representative waveform information F, and stores the information of the template screen 4 in the memory 308 (S116). Furthermore, the template screen generating module 350 transmits the information of the template screen 4 to the terminal device 12 via the communication interface 312 and the communication network 100 (S118). The OS of the terminal device 12 receives the information of the template screen 4 from the information processing device 3 via the communication network 100 and the communication interface 312. Furthermore, the OS of the terminal device 12 displays the received information of the template screen 4 on the display 304 or the like via the output interface 302 as the template screen 4 (S120).

[0072] When the user performs an operation to identify a measurement target portion for each of the n templates 40 included in the template screen 4 displayed on the terminal device 12, the OS of the terminal device 12 accepts the user's operation via the input interface 316 (S122). The OS of the terminal device 12 transmits information indicating the accepted user's operation, that is, information indicating the operation to identify a measurement target portion of the template 40 included in the template screen 4, to the information processing device 3 via the communication interface 312 and the communication network 100. The OS of the information processing device 3 receives the information indicating the user's operation transmitted from the terminal device 12 via the communication network 100 and the communication interface 312 (S124).

[0073] The target portion identification module 352 identifies the measurement target portion of each of the n templates 40 in the template screen 4 based on the information indicating the user's operation transmitted from the terminal device 12. Furthermore, the target portion identification module 352 generates measurement target portion information G indicating the identified measurement target portion, and stores it in the memory 308. Furthermore, when the measurement target portion is identified for the waveform indicated by the representative waveform information F, the target portion identification module 352 identifies the measurement target portion for all other waveform information B included in the cluster represented by the representative waveform information F for which the measurement target portion has been identified (S126). The user performs an operation to input annotations for one or more templates 40 included in the template screen 4 displayed on the terminal device 12. Furthermore, the user performs an operation to cause the information processing device 3 to perform an analysis process using the cluster information D and the measurement target portion information G. The OS of the terminal device 12 accepts these operations via the input interface 316 (S128).

[0074] The OS of the terminal device 12 transmits information indicating an operation for inputting the accepted annotation and an operation for performing an analysis process to the information processing device 3 via the communication interface 312 and the communication network 100. The OS of the information processing device 3 receives information indicating these operations from the terminal device 12 via the communication network 100 and the communication interface 312 (S130). Note that the template screen generation module 350 of the information processing device 3 receives information indicating these operations from the terminal device 12 via the communication network 100 and the communication interface 312. Each time it receives these operations, the template screen generation module 350 generates a template screen 4 including the annotation indicated by the received operation, transmits it to the information processing device 3, and causes it to be displayed on the display 304 via the output interface 302 (not shown).

[0075] The target portion identification module 352 identifies the measurement target portion of each of the n templates 40 based on the information received from the terminal device 12, generates measurement target portion information G, and stores it in the memory 308. The waveform information analysis module 356 processes the cluster information D based on the information received from the terminal device 12, performs analysis such as determining the time length of the QT interval in the heartbeat waveform indicated by the waveform information included in each of the n clusters, generates analysis result information I, and stores it in the memory 308 (S132). The target portion identification module 352 and the waveform information analysis module 356 transmit the generated information to the terminal device 12 via the communication interface 312 and the communication network 100. The OS of the terminal device 12 receives the information from the information processing device 3 via the communication network 100 and the communication interface 312 (S134). The OS of the terminal device 12 displays the template screen 4 including the template 40 in which a cursor image is superimposed on the measurement target portion indicated by the received information. Furthermore, the OS of the terminal device 12 displays the template screen 4 including the template 40 on which the received analysis results such as the duration of the QT interval are superimposed (S136).

[0076] [Second embodiment] Next, a second embodiment of the present disclosure will be described with reference to the attached drawings. A change in the waveform that is included in an electrocardiogram and indicates a paroxysmal or sudden pulsation is unlikely to appear in a waveform included in a measurement of about 5 to 10 seconds using a 12-lead electrocardiograph, so it is very difficult to detect by such a short-term measurement of an electrocardiogram. On the other hand, if a measurement is performed using a 12-lead electrocardiograph for, for example, about 24 hours, and all the waveforms of the pulsation included in the electrocardiogram obtained as a result of the measurement are observed, a change in the waveform that indicates a paroxysmal or sudden pulsation can be detected.

[0077] However, since a 24-hour electrocardiogram contains about 100,000 beats, it is very difficult for a user to observe all of the waveforms showing the beats contained in the electrocardiogram obtained by measurement over such a long period of time. The second embodiment of the present disclosure is configured to automatically detect and visualize waveform changes showing paroxysmal or sudden beats from waveform information B showing beats contained in electrocardiogram information A obtained by measurement over a long period of time.

[0078] In addition, changes in the measurement target portion itself in the pulsation waveform that occur spasmodically or suddenly, changes in the time length between the measurement target portions, and changes in the shape indicating the pulsation suggest WPW syndrome, Brugada syndrome, intraventricular conduction disorder, premature contraction, myocardial infarction, etc. The second embodiment of the present disclosure is configured to display the template 40 with annotations indicating changes in the pulsation waveform, etc. In addition, the second embodiment of the present disclosure is configured to perform analysis processing such as arranging the QT interval time length indicated by a large number of analysis result information I, one or more of the information of the cluster to which the pulsation belongs and the annotation information (hereinafter referred to as "QT interval time length, etc.") over time, and generating a trend graph. The trend graph makes it possible to visualize the time when a change occurred in the pulsation waveform.

[0079] A correction screen for the user to correct the annotation may be displayed over the template 40. In this correction screen, the heartbeat waveforms before and after the heartbeat waveform displayed in the template 40, or the heartbeat waveform for about 10 to 30 seconds including this heartbeat waveform may be displayed. By displaying such heartbeat waveforms, the user can more accurately determine the presence or absence of WPW syndrome, Brugada syndrome, intraventricular conduction disorder, premature ventricular contraction, myocardial infarction, etc. In addition, the user can check the annotations such as WPW syndrome, Brugada syndrome, intraventricular conduction disorder, premature ventricular contraction, and myocardial infarction, which are assigned to each cluster, for each heartbeat waveform. Furthermore, the user can check the change in the heartbeat waveform that occurs suddenly and analyze the presence or absence of a disease.

[0080] The process for visualizing Δ waves and excluding clusters described below is realized by modifying the process of the information processing program 34 (FIG. 5) as follows. That is, the clustering process module 346 is enabled to perform a process of deleting one or more clusters included in the cluster information D in response to a user's operation. Also, the clustering process module 346 is enabled to perform a process of controlling the clustering process module 346 and the representative waveform selection module 348 to generate clusters and generate the cluster information D. The waveform information analysis module 356 is enabled to perform a process of generating a trend graph. The template screen generation module 350 is enabled to perform a process of surrounding a singular part generated in the trend graph with a dotted line or the like. Also, the communication sequence (FIG. 7) shown in the first embodiment of the present disclosure is modified so that the information processing device 3 transmits a trend graph or the like to the terminal device 12, and the information processing device 3 receives information indicating an operation for designating a singular part from the terminal device 12.

[0081] 1. Visualization of delta waves First, a process for visualizing that the electrocardiogram waveform indicated by electrocardiogram information A and waveform information B contains Δ waves (sometimes written as “δ waves”) will be described. The Δ waves suggest that WPW syndrome is occurring in the heart. This process causes the template 40 in the template screen 4 to be annotated to indicate that the heartbeat waveform contains Δ waves. Furthermore, a trend graph is generated, and the time when the heartbeat waveform contains Δ waves is visualized. FIG. 8A is a diagram illustrating an example of the template screen 4 including the template 40 annotated with Δ waves. FIG. 8B is a diagram illustrating an example of a trend graph in which the duration of QTc intervals measured over a long period of time is arranged over time.

[0082] First, the user observes the beat waveforms displayed in n templates 40 included in the template screen 4 displayed on the display 304 of the terminal device 12, and finds that, for example, beat waveforms displayed in five of the n templates 40 include a Δ wave (n=12). The user performs an operation to select five templates 40 on which beat waveforms including a Δ wave are displayed on the template screen 4 using an input device such as the mouse 318 of the terminal device 12. Furthermore, the user performs an operation to display an annotation of "Δ wave" on the selected template 40. The terminal device 12 transmits information indicating these operations to the information processing device 3 via the communication network 100, and the information processing device 3 receives the information indicating these operations.

[0083] In the information processing device 3, the information processing program 34 that generated the template screen 4 displayed on the terminal device 12 is running. The annotation generation module 354 of the information processing device 3 (FIG. 5) that received the information indicating these operations generates annotation information H for annotating the five selected templates 40 with "Δ waves". Furthermore, the template screen generation module 350 uses the generated annotation information H to generate information indicating the template screen 4 including the template 40 annotated with "Δ waves", as shown in FIG. 8A, and transmits the information to the terminal device 12. The terminal device 12 receives the information indicating this template screen 4 from the information processing device 3, and updates the template screen 4 displayed on the display 304.

[0084] The waveform information analysis module 356 processes the waveform information B, the time information C, the cluster information D, and the analysis result information I. As a result of this processing, the waveform information analysis module 356 generates a trend graph with the time length of the QTc interval on the vertical axis and the time on the horizontal axis as shown in FIG. 8B. For example, the unit of the time length of the QTc interval indicated by the vertical axis of the trend graph is ms (milliseconds), and the unit of the time indicated by the horizontal axis is minutes. In the trend graph, the time lengths of the QT intervals of the heartbeat waveforms indicated by the waveform signals included in the cluster information D are arranged over time. The waveform information analysis module 356 transmits information indicating the generated trend graph to the terminal device 12. The terminal device 12 receives this information from the information processing device 3 and displays it on the display 304.

[0085] By referring to the trend graph, the user can know the time when the beat waveform including Δ waves and having a long QT interval occurred throughout the entire period during which the waveform information B was generated, as shown in Fig. 8B. Furthermore, the template screen generating module 350 can be configured to generate a screen in response to a user's operation, in which the heartbeat waveform including Δ waves and having a long QT interval is surrounded by a dotted line in the trend graph to make it stand out.

[0086] As shown in FIG. 8A and FIG. 8B, the time length of the QTc interval displayed on the trend graph is obtained by correcting the time length of the QT interval by an individual correction method to eliminate the influence of changes in the heart rate, and is stored in the memory 308 as corrected information K. When the QT interval is corrected by the Bazett correction method, the corrected QT interval may be described as QTcB interval, and when the QT interval is corrected by the Fridericia correction method, the corrected QT interval may be described as QTcF. This is the same for the following trend graphs. The information processing program 34 may be configured to apply one of a plurality of colors to the time lengths of the QTc intervals obtained from each of the n clusters in the trend graph. This allows the user to easily know which waveform information of the n clusters indicates a heartbeat waveform including a change or abnormality.

[0087] In order to generate a trend graph of the QTc interval duration, the information processing device 3 performs the above-mentioned correction on the QT interval duration obtained from, for example, one day's worth of cluster information D. The information processing device 3 may be configured to correct the QT interval duration in real time to generate information indicating the QTc interval duration. Alternatively, the information processing device 3 may be configured to store all of the QT interval durations for one day, and then perform correction to generate information indicating the QTc interval duration.

[0088] Information indicating the QTc interval corrected in this manner is stored in the memory 308 as corrected information K (FIG. 4). The template 40 to which the template is attached and the trend graph may be displayed in the same template screen 4, or may be displayed in two separate windows displayed on the screen of the display 304. The information processing device 3 may be configured to attach diagnostic information I indicating a cardiac disease suggested by the inclusion of "Δ waves" in the heartbeat waveform, for example, a diagnosis of "WPW syndrome", to the template 40 or the trend graph and further display it as an annotation. Furthermore, the information processing device 3 may be configured to further analyze the trend graph and automatically determine that the heartbeat waveform includes Δ waves.

[0089] 2. Visualization of intraventricular conduction disorders Next, a process of visualizing the waveform of an electrocardiogram that suggests that intraventricular conduction disorder occurs in the heart will be described. Details of the processes of the terminal device 12 and the information processing device 3 described in the section on visualization of Δ waves above will be omitted as appropriate to prevent duplication below. Details of the trend graph, correction of the time length of the QT interval, and modified examples of the information processing device 3 described in the section on visualization of Δ waves will also be omitted to prevent duplication below. FIG. 9A is a diagram illustrating a heartbeat waveform when there is no intraventricular conduction disorder in the heart. FIG. 9B is a diagram illustrating an abnormal heartbeat waveform when there is intraventricular conduction disorder in the heart. When intraventricular conduction disorder occurs in the heart, as can be seen by comparing FIG. 9A and FIG. 9B, when the time length of the RR interval of the heartbeat waveform is constant, the time width of the QRS complex (QRS width) included in the heartbeat waveform becomes longer than a predetermined threshold value.

[0090] FIG. 9C is a diagram illustrating a template screen 4 including a template 40 annotated with ventricular conduction disorder. FIG. 9D is a diagram illustrating a trend graph. First, the user observes the beat waveforms displayed in n templates 40 (n=12) included in the template screen 4 displayed on the display 304 of the terminal device 12 as shown in FIG. 9C. As a result of this observation, the user discovers, for example, that the time width of the QRS complex included in the beat waveform displayed in one of the n templates 40 is longer than a predetermined threshold, suggesting that intraventricular conduction disorder is occurring paroxysmically in the heart.

[0091] The user performs an operation on the template screen 4 to select one template 40 that suggests that an intracardiac conduction disorder has occurred in the heart. Furthermore, the user performs an operation to display an annotation of "ventricular conduction disorder / QRS width threshold or more" on the selected template 40. Based on information indicating these operations, the information processing device 3 generates a template screen 4 including one template 40 annotated with "ventricular conduction disorder / QRS width threshold or more", as shown in FIG. 9C. The terminal device 12 displays the generated template screen 4.

[0092] The information processing device 3 processes the waveform information B and the time information C, etc., and generates a trend graph shown in FIG. 9D. By referring to the trend graph, the user can know the time when the heartbeat waveform suggesting the occurrence of ventricular conduction disorder occurred from the cluster information D corresponding to the selected template 40, as shown in FIG. 9D, throughout the entire period in which the waveform information B was generated. The user may further operate the trend graph to surround with a dotted line the part where the time length of the QT interval is particularly long as a peculiar part. By surrounding with a dotted line, the peculiar part where the heartbeat waveform suggesting the occurrence of ventricular conduction disorder occurred can be made conspicuous. Even if the time length of the QT interval is measured, the user cannot determine that the QRS width is long. Although not directly illustrated in FIG. 9D, in the description here, it is assumed that the user who added the annotation measured the QRS width and determined that the time length of the QRS width is equal to or greater than a threshold value.

[0093] 3. Visualization of PVC Next, a process for visualizing that an electrocardiogram waveform may indicate a premature contraction will be described. Whether or not a premature contraction occurs in the subject's heart is determined by a user by comparing a specific heartbeat waveform with the heartbeat waveforms before and after the specific heartbeat waveform. Therefore, the visualization process described here is performed solely for the purpose of screening for premature contractions. FIG. 10A is a diagram illustrating a template screen 4 including a template 40 annotated with PVC. FIG. 10B is a diagram illustrating a trend graph. There are multiple types of premature contractions, such as PVC and PAC, and the process described here is performed when there is a possibility that PVC occurs in the subject's heart.

[0094] First, the user observes the pulsation waveforms displayed in n templates 40 (n=12) included in the template screen 4 displayed on the display 304 of the terminal device 12 as shown in Fig. 10A. As a result of this observation, the user discovers that, for example, the pulsation waveforms displayed in three of the n templates 40 indicate the possibility of the occurrence of a premature ventricular contraction.

[0095] The user performs an operation on the template screen 4 to select three templates 40 whose pulsation waveforms indicate premature contractions. Furthermore, the user performs an operation to display the annotation "PVC" on the selected templates 40. Based on information indicating these operations, as shown in FIG. 10A, the information processing device 3 generates a template screen 4 including the template 40 annotated with "PVC". The terminal device 12 displays the generated template screen 4.

[0096] The information processing device 3 processes the waveform information B and the time information C, etc., and generates a trend graph shown in FIG. 10B. By referring to the trend graph, the user can know the time when the heartbeat waveform shows the extrasystole throughout the entire period when the waveform information B is generated. As shown in FIG. 10B, when the heartbeat waveform shows the extrasystole, for example, three singular parts where the time length of the QT interval is particularly long are generated in the trend graph. The heartbeat waveform in these three singular parts indicates the possibility of the occurrence of the extrasystole. Furthermore, the user may highlight these three singular parts by surrounding them with dotted lines. Furthermore, a flag may be set on the template 40 in which the heartbeat waveform annotated with PVC is displayed.

[0097] 4. Visualization of ST elevation Next, a process for visualizing that an electrocardiogram waveform shows ST elevation will be described. Fig. 11A is a diagram illustrating an example of a template screen 4 including a template 40 annotated with "ST elevation." Fig. 11B is a diagram illustrating an example of a trend graph.

[0098] First, the user observes the beat waveforms displayed in n templates 40 (n=12) included in the template screen 4 displayed on the display 304 of the terminal device 12 as shown in Fig. 11A. As a result of this observation, the user discovers, for example, that the beat waveforms displayed in six of the n templates 40 indicate ST elevation.

[0099] The user performs an operation on the template screen 4 to select six templates 40 whose pulsation waveforms indicate ST elevation. Furthermore, the user performs an operation to display an annotation of "ST elevation" on the selected template 40. Based on information indicating these operations, as shown in FIG. 11A, the information processing device 3 generates a template screen 4 including the template 40 annotated with "ST elevation". The terminal device 12 displays the generated template screen 4.

[0100] The information processing device 3 processes the waveform information B and the time information C, etc., and generates a trend graph shown in FIG. 11B. By referring to the trend graph, the user can know the time when the heartbeat waveform shows ST elevation throughout the entire period when the waveform information B is generated. As shown in FIG. 11B, when the heartbeat waveform shows an extrasystole, for example, two peculiar parts a and b where the time length of the QT interval is disturbed are generated in the trend graph. As shown in FIG. 11A, the heartbeat waveform in these two peculiar parts shows ST elevation, and the heartbeat waveform in the other parts is normal without ST elevation. Furthermore, the user may highlight these two peculiar parts by surrounding them with dotted lines. It is assumed that the waveform information included in the cluster annotated as ST elevation in the trend graph is displayed in a color or with a flag.

[0101] 5. Removing and adding clusters Hereinafter, a process of deleting one or more of the n templates 40 included in the template screen 4 and adding one or more templates 40 to the template screen 4 will be described. Fig. 12A is a diagram illustrating an example of a waveform of the template 40 included in the template 40 shown in Fig. 6A etc. Fig. 12B is a diagram illustrating an example of a heartbeat waveform indicated by waveform information included in cluster information D corresponding to the template 40 selected as shown in Fig. 12A.

[0102] For example, consider a case where the template 40 selected by the user from the template screen 4 contains a lot of noise after the end point of the T wave as shown in Fig. 12A, and there are only three pieces of waveform information corresponding to the template 40 as shown in Fig. 12B. In this way, when the heartbeat waveform displayed in the template 40 contains a lot of noise and the cluster information D corresponding to the template 40 contains a small amount of waveform information, the cluster corresponding to this template 40 is not appropriate for processing in the information processing device 3. This is because it is difficult to identify the measurement target portion of the heartbeat waveform indicated by the waveform information contained in such a cluster, and there is a high possibility that it does not contain an abnormality in the heartbeat waveform.

[0103] Therefore, it is desirable to delete waveform information of a cluster that corresponds to a noisy template 40 and contains only a small amount of waveform information from the cluster information D. Conversely, if the template screen 4 contains only a small number of templates 40, it is desirable to add waveform information of a new cluster to the cluster information D.

[0104] Therefore, as described above, if the clustering processing module 346 of the information processing program 34 can perform processing to delete one or more clusters included in the cluster information D in response to a user operation, the waveform information of the above-mentioned clusters can be deleted from the cluster information D. Furthermore, if the clustering processing module 346 can control the clustering processing module 346 and the representative waveform selection module 348 in response to a user operation to generate clusters, it will be possible to add waveform information of a cluster that corresponds to a template 40 with less noise and contains a lot of waveform information to the cluster information D, instead of waveform information of a cluster that corresponds to a template 40 with a lot of noise and contains only little waveform information.

[0105] 6.Other The visualization of Δ waves and the like included in the heartbeat waveform has been described above, but in addition to the above, the information processing device 3 of the information processing system 1 can further visualize waveforms indicated by various heartbeat waveforms and various diseases suggested by the heartbeat waveforms. Fig. 13A is a diagram illustrating an example of a template screen 4 including a template 40 on which an arrhythmia heartbeat waveform is displayed. Fig. 13B is a diagram illustrating an arrhythmia heartbeat waveform.

[0106] 13A, the user observes n templates 40 included in the template screen 4 and finds an arrhythmia heartbeat waveform (n=12). The user performs an operation to annotate such a template 40 as "arrhythmia / not to be analyzed" in the information processing device 3, and can visualize the discovered template 40 with the annotation "arrhythmia / not to be analyzed."

[0107] The processes and procedures described in this specification can be realized not only in the manner explicitly described in the embodiments, but also by computer-executed software, computer hardware, or a combination of these. Specifically, the processes and procedures described in this specification are realized by implementing logic corresponding to the processes in media such as integrated circuits, volatile memories, non-volatile memories, magnetic disks, and optical storage. In addition, the processes and procedures described in this specification can be implemented as computer programs and executed by various computers including terminal devices and server devices.

[0108] Although the processes and procedures described herein are described as being executed by a single device, software, component, or module, such processes or procedures may be executed by multiple devices, multiple software, multiple components, and / or multiple modules. Furthermore, although the various information described herein is described as being stored in a single memory or storage unit, such information may be stored in multiple memories provided in a single device or multiple memories distributed across multiple devices. Furthermore, the software and hardware elements described herein may be realized by integrating them into fewer components or breaking them down into more components. [Explanation of symbols]

[0109] 1. Information Processing Systems 100 Communication Network 12 Terminal Equipment 2 Electrocardiograph 3. Information processing equipment 200,300 Bus 202 Electrode Interface 204 Electrode 206,306 processors 208,308 Memory 210 External recording media 212,312 Communication Interface 214,314 Communication processing circuit 302 Output Interface 304 Display 316 Input Interface 318 Mouse 320 Keyboard 34 Information Processing Programs 340 Electrocardiogram Information Acquisition Module 342 Waveform Information Generation Module 344 Correction Module 346 Clustering Processing Module 348 Representative Waveform Selection Module 350 Template Screen Generation Module 352 Target Part Identification Module 354 Annotation Generation Module 356 Waveform Information Analysis Module

Claims

1. An information processing device including at least one processor for processing motion information indicative of a plurality of repeated motions of a living being, The at least one processor obtaining the motion information; Dividing the acquired movement information into a plurality of first waveform information indicating waveforms of a plurality of repeated movements of the living thing; clustering the plurality of first waveform information into a plurality of clusters each including a plurality of the first waveform information; selecting, from the first waveform information included in each of the clusters, one or more pieces of second waveform information indicating a waveform representative of a waveform indicated by the first waveform information included in each of the clusters; displaying a list of the second waveform information indicating waveforms representative of the respective clusters on at least one screen; 2. An information processing device configured to execute processing for

2. Each of the first waveform information includes at least one third waveform information used to analyze a plurality of repeated movements of the living being; in response to a user's operation on the third waveform information included in the displayed second waveform information, a mark indicating at least one of the third waveform information and a point included in the third waveform information is displayed superimposed on a waveform indicated by the displayed first waveform information. The information processing device according to claim 1 .

3. the repeated multiple movements of the living being are heartbeats of the living being; the motion information is electrocardiogram information indicating the heartbeat of the living being; each of the first waveform information indicates a plurality of beats of the living being's heart; The third waveform information indicates at least one of P waves, Q waves, R waves, S waves, T waves, and U waves included in each of the first waveform information, and at least any of the start points, end points, and coordinates in an electrocardiogram of the P waves, the Q waves, the R waves, the S waves, the T waves, and the U waves. The information processing device according to claim 2 .

4. identifying a point included in the third waveform information in response to a user's operation on the third waveform information included in the displayed second waveform information; identifying points included in the third waveform information of other second waveform information included in the same cluster based on the points included in the identified third waveform information; The information processing device according to claim 1 .

5. the organism is a human, obtaining the electrocardiogram information from the individual human via a portable electrocardiograph or a 12-lead electrocardiograph; The information processing device according to claim 4.

6. Repeating the acquisition of the electrocardiogram information for a predetermined period of time. The information processing device according to claim 4.

7. The predetermined time is between 10 seconds and 30 seconds. The information processing device according to claim 6.

8. the mark indicating at least one of the third waveform information is a cursor; storing information indicating the second waveform information and the third waveform information that are displayed, and the cursors that are displayed superimposed on the second waveform information and the third waveform information that are displayed, respectively; The information processing device according to claim 2 .

9. information indicating time intervals between the plurality of cursors is displayed superimposed on each of the displayed second waveform information and the displayed third waveform information, and is further displayed superimposed on each of the displayed second waveform information and the displayed third waveform information. The information processing device according to claim 8.

10. A keyboard with shortcut keys; Further comprising: The user's operation is performed on the shortcut key of the keyboard. The information processing device according to claim 2 .

11. 1. A method for processing motion information indicating a plurality of repeated motions of a living organism, the method comprising: obtaining the motion information; Dividing the acquired movement information into a plurality of first waveform information pieces indicating waveforms of a plurality of repeated movements of the living being; clustering the plurality of first waveform information into a plurality of clusters, each cluster including a plurality of the first waveform information; selecting, from the first waveform information included in each of the clusters, one or more pieces of second waveform information indicating a waveform representative of a waveform indicated by the first waveform information included in each of the clusters; displaying a list of the second waveform information indicating representative waveforms of the clusters on at least one screen; The method includes:

12. an information processing device including at least one processor for processing motion information indicative of a plurality of repeated motions of a living being; obtaining the motion information; Dividing the acquired movement information into a plurality of first waveform information indicating waveforms of a plurality of repeated movements of the living thing; clustering the plurality of first waveform information into a plurality of clusters each including a plurality of the first waveform information; selecting, from the first waveform information included in each of the clusters, one or more pieces of second waveform information indicating a waveform representative of a waveform indicated by the first waveform information included in each of the clusters; displaying a list of the second waveform information indicating waveforms representative of the respective clusters on at least one screen; A program that causes a processor to function as configured to perform operations for the purpose of

Images