Medical information processing apparatus, medical information processing method, and program

Abstract

To enable an examiner to obtain tactile information as if he / she directly palpates a tissue inside a living body.SOLUTION: A medical information processing apparatus includes an acquisition unit, a display control unit, and a hardness information processing unit. The acquisition unit acquires at least morphological information of a tissue in a body of a subject and a measurement signal obtained by measuring hardness of the tissue in the body of the subject. The display control unit controls display of a morphological image based on at least the morphological information on a display device. The hardness information processing unit generates hardness information indicating the hardness of the tissue based on the measurement signal, and generates a hardness reproduction signal for causing the tactile reproduction device to reproduce the hardness of the tissue in the body of the subject based on the generated hardness information or the measurement signal.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The embodiments disclosed in the present specification and drawings relate to a medical information processing device, a medical information processing method, and a program. [Background technology]

[0002] Palpation is an effective diagnostic technique in medical diagnosis, but it is not possible to touch tissues inside a living body non-invasively. For this reason, doctors and other examiners palpate the area where the organ they are trying to diagnose is located from above the skin of a patient or other subject. However, because there are other biological structures, such as muscles, in addition to the skin, between the organ they are trying to palpate and the examiner's hand, the tactile sensation and hardness obtained by palpation do not necessarily match those obtained when palpating the organ they are trying to palpate invasively.

[0003] Meanwhile, medical diagnostic devices such as ultrasound diagnostic devices and magnetic resonance imaging (MRI) diagnostic devices have been used to examine the state of tissues inside living bodies. However, even with these medical diagnostic devices, although the state of tissues inside living bodies can be confirmed through images, tactile information, such as that obtained through palpation, cannot be obtained.

[0004] In recent years, in the medical field, techniques such as ultrasound elastography have been used as techniques for non-invasively measuring the stiffness of tissues inside a living body. However, even with such techniques, the information about the stiffness of tissues inside a living body obtained is, for example, expressed as a measurement result in numerical values ​​or as an image such as a color map, and therefore the examiner cannot obtain tactile information as in palpation. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2019-160036 Summary of the Invention [Problem to be solved by the invention]

[0006] The problem to be solved by the embodiments disclosed in this specification and the drawings is to enable an examiner to obtain tactile information as if directly palpating tissue inside a living body. However, the problem to be solved by the embodiments disclosed in this specification and the drawings is not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]

[0007] The medical information processing device of the embodiment has an acquisition unit, a display control unit, and a stiffness information processing unit. The acquisition unit acquires at least morphological information of tissues inside the subject's body and a measurement signal measuring the stiffness of the tissues inside the subject's body. The display control unit controls the display of a morphological image based on at least the morphological information on a display device. The stiffness information processing unit generates stiffness information representing the stiffness of the tissue based on the measurement signal, and generates a stiffness reproduction signal for causing a tactile reproduction device to reproduce the stiffness of the tissues inside the subject's body based on the generated stiffness information or the measurement signal. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing an example of the configuration and usage environment of a medical diagnostic apparatus to which a medical information processing apparatus according to an embodiment is applied; [Figure 2] FIG. 2 is a block diagram showing an example of the functional configuration of a medical image processing apparatus according to an embodiment. [Figure 3] 10A and 10B are diagrams illustrating an example of a method for specifying a position where stiffness is to be reproduced in the medical image processing apparatus according to the embodiment. [Figure 4] 10 is a flowchart showing an example of a processing flow in the medical image processing apparatus according to the embodiment. [Figure 5]FIG. 10 is a diagram showing an example of the functional configuration of a first modified example of the medical information processing apparatus according to the embodiment. [Figure 6] FIG. 10 is a diagram schematically showing an example of a method for presenting a position where the hardness of a touch is reproduced in the medical image processing apparatus according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, a medical information processing device, a medical information processing method, and a program according to embodiments will be described with reference to the drawings. The medical information processing device acquires information representing the hardness of tissues inside a living body, measured noninvasively from a subject (patient), and presents the acquired information representing the hardness of the tissue to an examiner (such as a doctor) as tactile information. In the following description, a case where the medical information processing device is applied to an ultrasound diagnostic device according to an embodiment will be described as an example. The ultrasound diagnostic device is a medical diagnostic device that performs an ultrasound examination on a subject by, for example, transmitting an ultrasound signal from an ultrasound probe and detecting, with the ultrasound probe, ultrasound signals (reflected wave signals: echo signals) that are reflected inside the subject's body. The ultrasound diagnostic device performs image processing on the reflected wave signals detected by the ultrasound probe to generate an ultrasound image based on the magnitude of the reflected wave signals, and presents the generated ultrasound image to an examiner who examines the subject through ultrasound examination by displaying it on a display device. This allows the examiner to visually confirm the condition of the tissues inside the subject's body. The medical information processing device presents to the examiner information related to the hardness of tissues inside the subject's body based on the ultrasound image generated by the ultrasound diagnostic device and information obtained by the ultrasound probe that transmits ultrasound signals into the subject's body when generating the ultrasound image.

[0010] 1 is a diagram showing an example of the configuration and usage environment of a medical diagnostic device (ultrasound diagnostic device) to which a medical information processing device according to an embodiment is applied. The ultrasound diagnostic device 1 includes, for example, a main body device 10 equipped with a medical information processing device 100, an ultrasound probe 20, a display device 30, and a tactile reproduction device 40.

[0011] The ultrasonic probe 20 is used while in contact with or in close proximity to the body surface of the subject P. The ultrasonic probe 20 transmits (transmits) ultrasonic signals directional to the body of the subject P in response to control from the main unit 10, detects reflected wave signals reflected within the body of the subject P, and outputs the signals to the main unit 10. The ultrasonic probe 20 includes multiple ultrasonic transducers. The ultrasonic transducers are, for example, piezoelectric elements such as piezoelectric ceramics. The ultrasonic probe 20 further includes matching layers provided on each of the ultrasonic transducers, and a backing material that prevents ultrasonic signals from propagating rearward (to the side opposite the subject P) of the ultrasonic transducers. The multiple ultrasonic transducers are arranged in the ultrasonic probe 20 in any arrangement, such as a line or a two-dimensional array. The ultrasonic probe 20 may be detachable from the main unit 10. The ultrasonic probe 20 and the main unit 10 may be connected by a dedicated cable or via wireless communication.

[0012] Furthermore, the ultrasonic probe 20 includes components for non-invasively measuring the stiffness of tissues inside the body of the subject P. More specifically, the ultrasonic probe 20 includes components for measuring the response of tissues inside the body to an externally applied mechanical action using an ultrasonic pulse reflection method, for example, by ultrasonic elastography. For example, when the stiffness of tissues inside the body of the subject P is measured by shear wave elastography, which is one type of ultrasonic elastography, in the ultrasonic diagnostic device 1, the ultrasonic probe 20 includes components for measuring the propagation velocity of shear waves generated inside the tissue of the subject P by acoustic radiation pressure, thereby measuring the physical quantity of the stiffness of the tissue. For example, when the ultrasound diagnostic device 1 measures the stiffness of tissues inside the body of subject P using transient elastography, which is a type of ultrasound elastography, the ultrasound probe 20 includes components for measuring the propagation velocity of shear waves generated inside the tissues of subject P by mechanical vibrations generated by a vibrator or the like, thereby measuring the physical quantity of tissue stiffness. For example, when the ultrasound diagnostic device 1 measures the stiffness of tissues inside the body of subject P using strain elastography, which is a type of ultrasound elastography, the ultrasound probe 20 includes components for measuring the relative stiffness of the tissues compared to surrounding tissues by measuring strain inside the tissues of subject P caused by manual compression by the examiner D or stress due to the pulsation of the living body. The ultrasound probe 20 sequentially (in real time) measures the stiffness of tissues inside the body of subject P. The ultrasonic probe 20 outputs a measurement signal representing the hardness of tissue inside the body of the subject P measured in real time to the main device 10 together with a reflected wave signal.

[0013] The reflected wave signal detected and output by the ultrasonic probe 20 is an example of "morphological information." The measurement signal measured and output by the ultrasonic probe 20 is an example of a "measurement signal."

[0014] The display device 30 may be, for example, a liquid crystal display (LCD), a cathode ray tube (CRT) display, or an organic electroluminescence (EL) display. The display device 30 may be connected to the main device 10, or may be realized by a terminal device, a personal computer (PC), or a display device (e.g., a tablet terminal) capable of wireless communication with the main device 10. The display device 30 displays various information including ultrasound images to be presented to the examiner D. This allows the examiner D to visually confirm the condition of the tissues inside the body of the subject P by looking at the ultrasound images displayed on the display device 30. The various information displayed by the display device 30 includes GUI (Graphical User Interface) information (GUI images) for accepting various input operations (e.g., an instruction to start acquiring ultrasound images) by the examiner D to the ultrasound diagnostic apparatus 1, i.e., the main device 10, and information (stiffness data) indicating the measured stiffness of the tissues inside the body of the subject P. The stiffness data is, for example, data that numerically represents the measured stiffness of tissues inside the body of subject P, or image data of a color map that represents each stiffness in a different color.

[0015] The display device 30 may be integrated with the functions of an input device, such as a touch panel, in addition to the function of displaying images. In this case, the examiner D can perform various operations by operating the ultrasound image, GUI image, or hardness data displayed on the display device 30. The input device may be realized, for example, by a mouse, keyboard, or microphone instead of or in addition to a touch panel. The input device may be realized by a terminal device, a personal computer (PC), or a display device (e.g., a tablet terminal) capable of wireless communication with the main device 10. In this specification, the input device is not limited to devices equipped with physical operation components such as the mouse and keyboard. For example, an example of an input device also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the terminal device, personal computer (PC), or main device 10 and outputs the electrical signal to the terminal device, personal computer (PC), or main device 10.

[0016] The ultrasound image displayed by the display device 30 is an example of a "morphological image."

[0017] The tactile sensation reproduction device 40 is a tactile device that reproduces the measured hardness of the internal tissue of the subject P. The tactile sensation reproduction device 40 has, for example, a board-like flat surface or a cubic shape of a predetermined size, and reproduces on its surface a hardness corresponding to a hardness reproduction signal based on a measurement signal indicating the measured hardness of the internal tissue of the subject P, output from the main device 10. In this case, the examiner D sets (specifies) in the main device 10 the depth into the body of the subject P at which the hardness is to be reproduced by the tactile sensation reproduction device 40. Then, by touching the surface of the tactile sensation reproduction device 40 with his / her hand, the examiner D can obtain tactile information such as the tactile sensation and hardness of tissues such as organs present at the specified depth inside the body of the subject P. In other words, the examiner D can obtain tactile information as if he / she were directly palpating the internal tissue of the subject P. FIG. 1 shows an example in which the board-like tactile sensation reproduction device 40 is arranged on the main device 10. The tactile reproduction device 40 may be detachable from the main unit 10. In this case, the tactile reproduction device 40 and the main unit 10 may be connected by a dedicated cable or by wireless communication.

[0018] The configuration of the tactile sensation simulation device 40 is not limited to a configuration that simulates hardness on the surface of a board or cube. In other words, the tactile sensation simulation device 40 may be any configuration as long as it is a tactile device that can simulate the measured hardness of the internal tissues of the subject P and provide the examiner D with tactile information as if he or she were palpating the internal tissues of the subject P. For example, the tactile sensation simulation device 40 may be an ultrasonic haptics (air haptics) tactile device configured by arranging multiple ultrasonic speakers and emitting ultrasonic waves to vibrate a hand held above the tactile sensation simulation device 40, thereby providing a sensation of actually touching an object. The tactile sensation simulation device 40 of this configuration can simulate the tactile sensation and hardness of the internal tissues of the subject P present at a specified depth in mid-air. In other words, the examiner D can obtain tactile information as if he or she were directly palpating the internal tissues of the subject P without directly touching the tactile sensation simulation device 40. Furthermore, for example, when measurement signals at multiple continuous depths can be obtained in the ultrasound diagnostic device 1, the tactile reproduction device 40, which is a tactile device using air haptics, can also reproduce the internal body tissue of the subject P in three dimensions. Alternatively, the tactile reproduction device 40 may be a tactile device shaped like a glove. In this case, by wearing the tactile reproduction device 40 on his / her hand, the examiner D can obtain tactile information as if he / she were directly palpating the internal body tissue of the subject P.

[0019] The medical information processing device 100 causes the ultrasonic probe 20 to transmit (emit) an ultrasonic signal and generates an ultrasonic image based on the reflected wave signal detected and output by the ultrasonic probe 20. The medical information processing device 100 determines the stiffness of the tissue inside the body of the subject P based on the measurement signal transmitted (transferred) by the ultrasonic probe 20. The medical information processing device 100 generates stiffness data for presenting the determined stiffness of the tissue inside the body of the subject P to the examiner D, and also generates a stiffness reproduction signal for causing the tactile reproduction device 40 to reproduce the stiffness. The medical information processing device 100 outputs a display image including both or either of the generated ultrasonic image and stiffness data to the display device 30 for display. This allows the examiner D to visually confirm the ultrasonic image and information related to the stiffness of the tissue inside the body of the subject P. The medical information processing device 100 outputs the generated stiffness reproduction signal to the tactile reproduction device 40 to reproduce the stiffness of the tissue inside the body of the subject P. This allows the examiner D to tactilely confirm the hardness of the tissue inside the body of the subject P.

[0020] [Configuration of medical information processing device] 2 is a diagram showing an example of the functional configuration of the medical information processing device 100 according to the embodiment. The medical information processing device 100 includes, for example, a processing circuit 110 and a stiffness information storage unit 120. FIG. 2 also shows components related to the medical information processing device 100 and connected to the main unit 10 in order to realize the function of presenting information related to the stiffness of tissues inside the body of a subject P to an examiner D in the ultrasound diagnostic device 1.

[0021] On the other hand, FIG. 2 does not illustrate other components and functional configurations in the medical information processing device 100 that realize functions unrelated to the function of presenting information related to the hardness of tissues inside the body of the subject P to the examiner D. For example, FIG. 2 does not illustrate an input / output circuit that outputs a control signal to cause the ultrasound probe 20 to transmit (transmit) an ultrasound signal and receives a reflected wave signal and a measurement signal output by the ultrasound probe 20. For example, FIG. 2 does not illustrate an image processing circuit (image processing function) that generates an ultrasound image based on the reflected wave signal output by the ultrasound probe 20. For example, FIG. 2 does not illustrate a control circuit (control function) that controls the overall operation of the medical information processing device 100 or the ultrasound diagnostic device 1, and an operation circuit (operation function) that allows the examiner D to operate the medical information processing device 100 when examining the examiner D using the ultrasound diagnostic device 1, i.e., an input / output interface. The configurations and operations of these omitted components and functional configurations may be equivalent to the configurations and operations of the components and functional configurations included in existing ultrasound diagnostic devices. Therefore, detailed descriptions of the configurations and operations of the omitted components and functional configurations will be omitted.

[0022] The processing circuitry 110 executes processes such as an acquisition function 112, a display control function 114, and a stiffness information processing function 116. The acquisition function 112 executes processes such as an image acquisition function 1122 and a stiffness signal acquisition function 1124. The processing circuitry 110 realizes the functions of the acquisition function 112 (including the image acquisition function 1122 and the stiffness signal acquisition function 1124), the display control function 114, and the stiffness information processing function 116, for example, by having a hardware processor execute a program (software) stored in a memory (storage unit) not shown. The memory not shown is realized by, for example, a semiconductor memory element such as a ROM (Read Only Memory), a RAM (Random Access Memory), or a flash memory, a hard disk drive (HDD), an optical disk, or the like.

[0023] The term "hardware processor" refers to a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), a large-scale integration (LSI), a system on chip (SOC), an application-specific integrated circuit (ASIC), or a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD), or a field programmable gate array (FPGA)). Instead of storing a program in a memory (not shown), the hardware processor may be configured so that the program is directly embedded in the circuit. In this case, the hardware processor realizes each function by reading and executing the program embedded in the circuit. The hardware processor is not limited to being configured as a single circuit, but may be configured as a single hardware processor by combining multiple independent circuits to realize each function. Multiple components may be integrated into a single hardware processor to realize each function. Multiple components may be integrated into a single dedicated LSI to realize each function. Here, the program (software) may be stored in advance in a storage device (storage device with a non-transitory storage medium) that constitutes a storage device such as a semiconductor memory element such as ROM, RAM, flash memory, or hard disk drive (HDD), or may be stored in a removable storage medium (non-transitory storage medium) such as a DVD or CD-ROM, and installed in a storage device (not shown) provided in the main unit 10 or medical information processing device 100 by attaching the storage medium to a drive device provided in the main unit 10 or medical information processing device 100.The program (software) may be downloaded in advance from another computer device via a network (not shown) and installed in a storage device (not shown) included in the main device 10 or the medical information processing device 100. The program (software) installed in the storage device included in the main device 10 or the medical information processing device 100 may be transferred to a processing circuit included in the medical information processing device 100 and executed therein. The medical information processing device 100 may be realized in a server device or a storage device incorporated in a cloud computing system. In this case, the functions of the medical information processing device 100 may be realized by multiple server devices and storage devices in the cloud computing system.

[0024] The acquisition function 112 acquires various information for examining the subject P through an ultrasound examination.

[0025] The image acquisition function 1122 acquires the reflected wave signal output by the ultrasound probe 20. The image acquisition function 1122 outputs the acquired reflected wave signal to an image processing circuit (image processing function) not shown. As a result, in the medical information processing device 100, an ultrasound image based on the reflected wave signal output by the ultrasound probe 20 is generated by an image processing circuit (image processing function) not shown. The acquisition function 112 may generate an ultrasound image based on the acquired reflected wave signal. In the processing circuit 110, the ultrasound image generated by the image processing circuit (image processing function) not shown or the image acquisition function 1122 is output to the display control function 114.

[0026] The stiffness signal acquisition function 1124 acquires the measurement signal output by the ultrasonic probe 20. The stiffness signal acquisition function 1124 outputs the acquired measurement signal to the stiffness information processing function .

[0027] The acquisition function 112 (image acquisition function 1122 and stiffness signal acquisition function 1124) is an example of an "acquisition unit."

[0028] The display control function 114 controls the display of the display image on the display device 30. More specifically, the display control function 114 generates a display image for displaying both or either one of the ultrasound image and the stiffness data on the display device 30, and outputs the generated display image to the display device 30 for display. At this time, the display control function 114 may generate a display image in which the sizes of the display areas for the ultrasound image and the stiffness data are changed in accordance with an input operation (e.g., an instruction on the display area) by the examiner D output from the display device 30 (more specifically, a touch panel of the display device 30), and display the display image on the display device 30.

[0029] The display control function 114 superimposes, on the ultrasound image displayed on the display device 30, a GUI image for specifying the depth inside the body of the subject P at which the tactile sensation reproduction device 40 is to reproduce stiffness, and outputs information representing the input operation performed by the examiner D on this GUI image, that is, information representing the depth inside the body of the subject P specified by the examiner D (hereinafter referred to as "depth information"), to the stiffness information processing function 116. In the processing circuit 110, the depth information is stored in the stiffness information storage unit 120 in association with the ultrasound image.

[0030] Here, an example of a method for specifying the depth inside the body of the subject P at which stiffness is to be reproduced by the tactile sensation reproduction device 40, by using a GUI image to be displayed on the ultrasound image and an input operation on the GUI image, will be described. Fig. 3 is a diagram schematically showing an example of a method for specifying the position at which stiffness is to be reproduced in the medical information processing device 100 according to the embodiment.

[0031] FIG. 3(a) shows an example of a display image FI-1 that schematically illustrates a method for specifying a depth inside the body of the subject P at which stiffness is to be reproduced by the tactile sensation reproduction device 40. When specifying a depth inside the body of the subject P and causing the tactile sensation reproduction device 40 to reproduce stiffness, the display control function 114 superimposes a depth line DL, which connects positions at the same depth on the current ultrasound image UI that shows the inside of the body of the subject P, on the ultrasound image UI. The examiner D can specify the depth inside the body of the subject P at which stiffness is to be reproduced by the tactile sensation reproduction device 40 by operating to move (slide) the depth line DL displayed on the ultrasound image UI up and down. When the examiner D specifies a depth inside the body of the subject P, the display control function 114 outputs depth information indicating the depth specified by the depth line DL to the stiffness information processing function 116.

[0032] FIG. 3(b) shows an example of a display image FI-2 that schematically illustrates a method for specifying a region inside the body of the subject P, as another method for specifying the depth inside the body of the subject P at which the tactile reproduction device 40 is to reproduce stiffness. For example, if the ultrasound diagnostic device 1 (more specifically, the ultrasound probe 20) can measure measurement signals in multiple consecutive depth regions (e.g., Regions of Interest (ROI)) in real time, the tactile reproduction device 40 can reproduce the stiffness of these multiple consecutive depth regions. In this case, the display control function 114 superimposes a reproduction area RA, which represents a depth region at which the tactile reproduction device 40 can reproduce stiffness, on the ultrasound image UI in the current ultrasound image UI. The examiner D can specify a region inside the body of the subject P at which the tactile reproduction device 40 is to reproduce stiffness, by moving (sliding) the reproduction area RA displayed on the ultrasound image UI up, down, left, or right. When the examiner D specifies a region inside the body of the subject P, the display control function 114 outputs depth information representing the region specified by the reproduction region RA to the stiffness information processing function 116.

[0033] 3 shows an example of a case where the position at which stiffness is to be reproduced in the tactile reproduction device 40 is specified by superimposing a depth line DL or a reproduction area RA on the ultrasound image UI, but the method of specifying the position is not limited to the above example. For example, when the examiner D performs an input operation such as directly inputting a depth value by referring to stiffness data included in the displayed image to specify the position or stiffness to be reproduced in the tactile reproduction device 40, the display control function 114 may output the specified information to the stiffness information processing function 116. This allows the examiner D to perform an examination by associating the stiffness value or color of the color map presented as stiffness data with the actual feel of stiffness of the tissue inside the body of the subject P reproduced by the tactile reproduction device 40.

[0034] The display control function 114 is an example of a “display control section.” GUI images such as the depth line DL and the reproduction area RA are an example of “operation information.”

[0035] Returning to FIG. 2 , the stiffness information processing function 116 generates stiffness information representing the stiffness of tissues inside the body of the subject P based on the measurement signal output by the stiffness signal acquisition function 1124. More specifically, the stiffness information processing function 116 performs processing corresponding to the measurement method of the measurement signal in the ultrasound probe 20, that is, processing corresponding to any of the ultrasonic elastography methods, such as shear wave elastography, transient elastography, or strain elastography, to generate stiffness information. Based on the generated stiffness information, the stiffness information processing function 116 generates stiffness data that represents the stiffness of tissues inside the body of the subject P as numerical values ​​or a color map to be presented to the examiner D. The processing performed by the stiffness information processing function 116 when generating stiffness information and stiffness data is equivalent to the processing performed when generating and presenting stiffness information and stiffness data in existing ultrasound diagnostic devices, and therefore will not be described in detail. In the processing circuit 110, the stiffness information (which may include stiffness data) is associated with the ultrasound image and stored in the stiffness information storage unit 120. In the processing circuit 110, the stiffness data is output to the display control function 114, which may include the stiffness data in a display image and display it on the display device 30.

[0036] Furthermore, the stiffness information processing function 116 selects a measurement signal of a specified depth represented by the depth information output by the display control function 114 from the measurement signals output by the stiffness signal acquisition function 1124. The stiffness information processing function 116 generates a stiffness reproduction signal for causing the tactile reproduction device 40 to reproduce the stiffness indicated in the selected measurement signal. The stiffness information processing function 116 may generate a stiffness reproduction signal of a depth represented by the depth information output by the display control function 114 based on the generated stiffness information. The stiffness reproduction signal is a signal conforming to a signal standard (format) required for reproducing stiffness in the tactile reproduction device 40. The stiffness information processing function 116 outputs the generated stiffness reproduction signal to the tactile reproduction device 40, causing it to reproduce the stiffness represented by the output stiffness reproduction signal. In the processing circuit 110, the stiffness reproduction signal is stored in the stiffness information storage unit 120 in association with the ultrasound image.

[0037] The stiffness information processing function 116 is an example of a "stiffness information processing unit."

[0038] The stiffness information storage unit 120 stores an ultrasound image based on a reflected wave signal acquired from the ultrasound probe 20, in association with stiffness information (which may include stiffness data) generated by the stiffness information processing function 116 based on the measurement signal acquired from the ultrasound probe 20, depth information output by the display control function 114 to the stiffness information processing function 116, and a stiffness reproduction signal generated by the stiffness information processing function 116 according to the depth information. In other words, the stiffness information storage unit 120 stores the results of examining the subject P through this ultrasound examination (examination results). The stiffness information storage unit 120 is realized by, for example, a semiconductor memory element such as a ROM, RAM, or flash memory, a hard disk drive (HDD), an optical disk, or the like.

[0039] The stiffness information storage unit 120 may store examination results of the subject P from a previous ultrasound examination. In this case, the stiffness information processing function 116 reads out the previous examination results stored in the stiffness information storage unit 120 and causes the tactile sensation reproduction device 40 to reproduce the stiffness, thereby allowing the examiner D to compare the stiffness of the tissues inside the subject P's body between the current examination and the previous examination. In this case, the stiffness information processing function 116 may divide the planar area of ​​the tactile sensation reproduction device 40 into a predetermined size (for example, divide it into two, left and right), and cause one area to reproduce the stiffness of the tissues from the current examination result, and the other area to reproduce the stiffness of the tissues from the previous examination result. In other words, the stiffness information processing function 116 may cause the tactile sensation reproduction device 40 to simultaneously reproduce the stiffness of multiple tissues side by side.

[0040] The stiffness information storage unit 120 may store, for example, stiffness information of normal tissues and stiffness information of representative tissues to be measured for each case (including stiffness information according to the degree of progression of symptoms). In this case, the stiffness information processing function 116 reads out stiffness information of representative tissues to be measured for the disease suffered by the subject P and causes the tactile sensation reproduction device 40 to reproduce the stiffness, thereby allowing the examiner D to compare the current examination results with the stiffness information of representative tissues in the case. In this case, the stiffness information processing function 116 may also cause the tactile sensation reproduction device 40 to simultaneously reproduce the stiffness of multiple tissues. For example, the stiffness information processing function 116 may divide the planar area of ​​the tactile sensation reproduction device 40 into two, left and right, and reproduce the stiffness of the tissues from the current examination results in one area and the stiffness of representative tissues in the case in the other area. For example, the hardness information processing function 116 may divide the planar area of ​​the tactile reproduction device 40 into thirds on the left and right, and cause the tactile reproduction device 40 to simultaneously reproduce the tissue hardness of the current examination results, the tissue hardness of the previous examination results, the hardness of normal tissue, and the hardness of typical tissue in a case.

[0041] The stiffness information storage unit 120 is an example of a "stiffness information storage unit."

[0042] [Processing by medical information processing device] Next, a flow of operations (processing) in the medical information processing device 100 for displaying an ultrasound image on the display device 30 and reproducing hardness information on the tactile reproduction device 40 will be described. FIG. 4 is a flowchart showing an example of the flow of processing in the medical information processing device 100 according to the embodiment. In the following description, it is assumed that an examiner D has started up the ultrasound diagnostic device 1 and is examining a subject P using the ultrasound probe 20. In the processing of this flowchart, while the ultrasound diagnostic device 1 is examining the subject P, the operation of capturing an ultrasound image and the processing of each function are repeatedly executed in the medical information processing device 100.

[0043] When the examiner D starts examining the subject P through an ultrasound examination using the ultrasound diagnostic device 1, a control circuit (control function) (not shown) instructs an input / output circuit (not shown) to capture an ultrasound image and causes the ultrasound probe 20 to transmit (emit) an ultrasound signal. As a result, the ultrasound probe 20 detects a reflected wave signal reflected inside the body of the subject P and outputs it to the main device 10, and also outputs a measurement signal that measures the hardness of the tissue inside the body of the subject P to the main device 10.

[0044] The image acquisition function 1122 acquires the reflected wave signal output by the ultrasonic probe 20 and generates an ultrasonic image based on the acquired reflected wave signal (step S100). The image acquisition function 1122 outputs the generated ultrasonic image to the display control function 114. Furthermore, the stiffness signal acquisition function 1124 acquires the measurement signal output by the ultrasonic probe 20 (step S102). The stiffness signal acquisition function 1124 outputs the acquired measurement signal to the stiffness information processing function 116. As a result, the stiffness information processing function 116 may generate stiffness data based on the measurement signal output by the stiffness signal acquisition function 1124.

[0045] The display control function 114 generates a display image for displaying the ultrasound image output by the image acquisition function 1122 on the display device 30, and further superimposes a GUI image (depth line DL) for specifying the depth inside the body of the subject P at which the tactile sensation reproduction device 40 is to reproduce hardness on the ultrasound image, and displays it on the display device 30 (step S110). As a result, the display image is presented to the examiner D.

[0046] Thereafter, the control circuit (control function) (not shown) checks whether or not the examiner D has specified a depth (step S112). If it is confirmed in step S112 that the examiner D has not specified a depth, the control circuit (control function) (not shown) returns the process to step S100 and instructs the input / output circuit (not shown) to capture the next ultrasound image. On the other hand, if it is confirmed in step S112 that the examiner D has specified a depth, the control circuit (control function) (not shown) causes the display control function 114 to output depth information indicating the depth inside the body of the subject P specified by the examiner D to the stiffness information processing function 116.

[0047] The stiffness information processing function 116 generates a stiffness reproduction signal corresponding to the depth information output by the display control function 114 (step S120). The stiffness information processing function 116 outputs the generated stiffness reproduction signal to the tactile reproduction device 40. As a result, the tactile reproduction device 40 reproduces the stiffness of the tissue inside the body of the subject P represented by the stiffness reproduction signal output by the stiffness information processing function 116 (step S122). As a result, the tactile sensation, stiffness, etc. of the tissue inside the body of the subject P are presented to the examiner D as tactile information.

[0048] Then, the control circuit (control function) (not shown) returns the process to step S100 and instructs the input / output circuit (not shown) to capture the next ultrasound image.

[0049] With such a configuration and processing, the medical information processing device 100 causes the tactile reproduction device 40 to reproduce the hardness of the tissues inside the body of the subject P, which is non-invasively measured by the ultrasound probe 20, instead of or in addition to presenting it to the examiner D as a numerical value or a color map as in existing ultrasound diagnostic devices. In this way, the medical information processing device 100 can present the tactile sensation and hardness of the tissues inside the body of the subject P to the examiner D as tactile information. Furthermore, the medical information processing device 100 may cause the tactile reproduction device 40 to simultaneously reproduce the hardness of the current examination result, the hardness of the previous examination result, and / or the hardness of normal tissue or the hardness of representative tissue in a case. In this way, the medical information processing device 100 can present the hardness of the current examination result, the hardness of the previous examination result, the hardness of normal tissue, or the hardness of representative tissue in a case to the examiner D as a comparison of tactile information. As a result, the examiner D who performs an examination using the ultrasound diagnostic apparatus 1 to which the medical information processing apparatus 100 is applied can examine the subject P more preferably.

[0050] In the above-described ultrasound diagnostic device 1, the examiner D obtains tactile information by touching the stiffness reproduced by the tactile sensation reproduction device 40 with his or her hand. However, compared to stiffness data displayed on the display device 30, the stiffness reproduced by the tactile sensation reproduction device 40 can be easily understood even by a person without sufficient medical knowledge, such as the subject P. Therefore, when explaining the examination results to the subject P, explaining future treatments, or showing the effects of current treatments, the subject P can be made to touch the tactile sensation reproduction device 40, thereby enhancing the subject P's understanding of the disease.

[0051] [Configuration of the first modified example of the medical information processing device] In the above-described ultrasound diagnostic device 1, the stiffness information storage unit 120 is provided in the medical information processing device 100. However, the stiffness information storage unit 120 may be provided, for example, outside the medical information processing device 100, i.e., as a component of the main unit 10. Furthermore, the stiffness information storage unit 120 may be provided in a system configured with other devices or equipment outside the main unit 10. For example, the stiffness information storage unit 120 may be realized in an external storage device connected to the main unit 10, or in a server device or storage device connected to the main unit 10 via a network. Examples of a system configured with other devices or equipment different from the main unit 10 include a medical image management system (Picture Archiving and Communication Systems: PACS) that manages data on various medical images, and a database system such as an electronic medical record system that manages electronic medical records to which information such as ultrasound images captured in past ultrasound examinations is attached.

[0052] An example of the configuration of the medical information processing device 100 in the case where the examination results (including hardness information) of a previous ultrasound examination performed on the subject P are stored in the medical image management system will be described below as a first modified example. In the following description, the medical information processing device 100 of the first modified example will be referred to as the "medical information processing device 100a," the main unit 10 equipped with the medical information processing device 100a will be referred to as the "main unit 10a," and the ultrasound diagnostic device 1 to which the medical information processing device 100a is applied will be referred to as the "ultrasound diagnostic device 1a." In the following description, in the configuration and usage environment of the ultrasound diagnostic device 1a and the functional configuration of each component equipped in the medical information processing device 100a, components similar to those in the configuration and usage environment of the ultrasound diagnostic device 1 and the functional configuration of each component equipped in the medical information processing device 100 will be assigned the same reference numerals and will not be described in detail again.

[0053] FIG. 5 is a diagram showing an example of the functional configuration of a first modified example (medical information processing device 100a) of the medical information processing device 100 according to the embodiment. The medical information processing device 100a includes, for example, a processing circuit 110 and a stiffness information storage unit 120a. FIG. 5 also shows components connected to the main body device 10a that are related to the medical information processing device 100a in order to realize the function of presenting information related to the stiffness of tissues inside the body of the subject P to the examiner D in the ultrasound diagnostic device 1a. Also, FIG. 5 omits illustration of other components and functional configurations that realize functions in the medical information processing device 100a that are not related to the function of presenting information related to the stiffness of tissues inside the body of the subject P to the examiner D.

[0054] 5 shows an example of the configuration of the ultrasound diagnostic device 1a in the case where the examination results of a previous ultrasound examination that the medical information processing device 100a displays on the display device 30 and reproduces on the tactile reproduction device 40 are stored in an external system. More specifically, this shows an example of the configuration in the case where a medical image management system (PACS) 500 is connected to the medical information processing device 100a. The medical information processing device 100a and the medical image management system 50 may be connected by a network (not shown), such as a local area network (LAN) established in a hospital, for example.

[0055] The medical image management system 50 is a database system that stores and manages various information related to patients (including subject P) undergoing treatment or examination in a hospital or the like where the ultrasound diagnostic apparatus 1a is installed. The medical image management system 50 includes, for example, a patient information database 52 and an image database 54. The patient information database 52 stores various information related to a large number of patients including subject P. The image database 54 stores information on images (including ultrasound images) of examinations performed on a large number of patients including subject P. The image database 54 may store, for example, stiffness information of normal tissue and stiffness information of representative tissues to be measured for each case (including stiffness information according to the degree of progression of symptoms). The configuration, functions, and operations of the medical image management system 50 are similar to those of existing medical image management systems, and therefore detailed description thereof will be omitted.

[0056] Similar to the stiffness information storage unit 120 included in the medical information processing device 100, the stiffness information storage unit 120a stores stiffness information (which may include stiffness data), depth information, and stiffness reproduction signals in association with ultrasound images. In addition to the storage function of the stiffness information storage unit 120, the stiffness information storage unit 120a also has a communication function for acquiring information and data via a network. Using this communication function, the stiffness information storage unit 120a acquires examination results of previous ultrasound examinations from the medical image management system 50 (more specifically, the patient information database 52 and the image database 54) via the network. More specifically, the stiffness information storage unit 120a acquires ultrasound images from previous ultrasound examinations that the medical information processing device 100a has displayed on the display device 30, and stiffness information (which may include depth information, stiffness reproduction signals, stiffness data, and may further include measurement signals) from previous ultrasound examinations that the medical information processing device 100a has reproduced on the tactile reproduction device 40, from the medical image management system 50 via the network.

[0057] The stiffness information storage unit 120a is an example of a "stiffness information storage unit."

[0058] As a result, in the medical information processing device 100a, the display control function 114 included in the processing circuit 110 can display, on the display device 30, ultrasound images represented by previous examination results stored in the medical image management system 50, in addition to the ultrasound images stored in the stiffness information storage unit 120a. Furthermore, in the medical information processing device 100a, the stiffness information processing function 116 included in the processing circuit 110 can cause the tactile reproduction device 40 to reproduce, in addition to the stiffness of the tissues inside the body of the subject P based on the stiffness information stored in the stiffness information storage unit 120a, the stiffness of the tissues inside the body of the subject P represented by previous examination results stored in the medical image management system 50, the stiffness of normal tissues, and the stiffness of typical tissues in cases.

[0059] With this configuration, the medical information processing device 100a, like the medical information processing device 100, can also non-invasively measure the hardness of the tissues inside the body of the subject P using the ultrasound probe 20. Instead of or in addition to presenting the hardness to the examiner D using numerical values ​​or a color map as in existing ultrasound diagnostic devices, the tactile sensation and hardness of the tissues inside the body of the subject P can be reproduced by the tactile sensation reproduction device 40, and the like can be presented to the examiner D as tactile information. Furthermore, like the medical information processing device 100, the medical information processing device 100a can also reproduce the hardness of the current examination result and the hardness of the previous examination result, and / or the hardness of normal tissues and the hardness of representative tissues in cases, side by side, and present these to the examiner D as comparative tactile information. As a result, the examiner D who performs an examination using the ultrasound diagnostic device 1a to which the medical information processing device 100a is applied can also more appropriately examine the subject P, just like the examiner D who performs an examination using the ultrasound diagnostic device 1 to which the medical information processing device 100 is applied.

[0060] [Second Modification of Medical Information Processing Device] The above-described ultrasound diagnostic device 1 has shown an example in which the display control function 114 superimposes, on the ultrasound image displayed on the display device 30, a GUI image for specifying the depth inside the body of the subject P at which the tactile sensation reproduction device 40 is to reproduce the hardness. In addition to this, for example, if information on the position of the surface that the examiner D is touching with his / her hand is obtained from the tactile sensation reproduction device 40, the display control function 114 may superimpose, on the ultrasound image displayed on the display device 30, a GUI image for indicating the position that the examiner D is touching with his / her hand, that is, the position of the tissue inside the body of the subject P whose hardness the examiner D is currently diagnosing.

[0061] An example of superimposing a GUI image showing the position of the tissue inside the body of the subject P that is currently being touched by the examiner D will be described below as a second modified example. Fig. 6 is a diagram schematically showing an example of a method for presenting the position where the hardness of the tissue being touched is reproduced in the medical information processing apparatus 100 according to the embodiment.

[0062] 6(a) shows a schematic diagram of the state in which examiner D is touching the tactile sensation reproduction device 40. FIG. 6(b) shows an example of a display image FI-3 that schematically presents the position where examiner D is touching the tissue inside the body of subject P, as reproduced on the tactile sensation reproduction device 40. When information indicating the contact position currently being touched by examiner D (hereinafter referred to as "position information") is output from the tactile sensation reproduction device 40, the stiffness information processing function 116 acquires this position information and outputs it to the display control function 114. The display control function 114 superimposes the contact position TP, which indicates the contact position represented in the position information output by the stiffness information processing function 116, on the depth line DL (see FIG. 3(a)) superimposed on the current ultrasound image UI showing the inside of the body of subject P. On the other hand, as shown in FIG. 3B, when specifying a region inside the body of the subject P for which stiffness is to be reproduced, the display control function 114 simply superimposes the contact position TP corresponding to the position information output by the stiffness information processing function 116 within the reproduction area RA superimposed on the current ultrasound image UI depicting the inside of the body of the subject P. If the position information output by the stiffness information processing function 116 indicates that the examiner D is touching multiple positions on the tactile reproduction device 40, the display control function 114 simply superimposes the multiple contact positions TP simultaneously on the depth line DL or within the reproduction area RA. Examples of the display image FI in these cases are easy to imagine, and are therefore not shown. This allows the examiner D to visually confirm which position he or she is currently touching on the plane depicting the stiffness of the specified depth or region. In other words, the examiner D can confirm the correspondence between the current ultrasound image UI depicting the inside of the body of the subject P and the position he or she is currently touching.

[0063] 6(b) shows an example of a case where the contact position TP is superimposed on the ultrasound image UI to indicate to the examiner D which position in the body of the subject P the position where the examiner D is checking by touching the hardness reproduced on the tactile sensation reproduction device 40 is, but the method of indicating the touched position is not limited to the above-mentioned example. In other words, any method may be used as long as it can associate the position where the hardness is reproduced on the tactile sensation reproduction device 40 with a position in the ultrasound image.

[0064] The contact position TP (GUI image) is an example of "contact information."

[0065] The configuration of the ultrasound diagnostic device 1 and ultrasound diagnostic device 1a described above is intended for use in, for example, an examination room in a hospital. However, ultrasound diagnostic devices can also be portable, i.e., small and portable, so that they can be used in, for example, home visits. Even in this case, it is very useful to be able to non-invasively measure the hardness of the tissues inside the subject P using the ultrasound probe 20 and reproduce the measured hardness of the tissues inside the subject P using the tactile sensation reproduction device 40. For example, if the hardness of the stool remaining in the subject P's intestines can be non-invasively measured during a home visit and the tactile sensation reproduction device 40 can be reproduced, the examiner D can more efficiently examine the subject P without an ultrasound expert having to visit the subject P during the home visit. Furthermore, even during home visits, for example, having someone without sufficient medical knowledge, such as the subject P, touch the tactile sensation reproduction device 40 can enhance the subject P's understanding of their illness.

[0066] Even if the ultrasound diagnostic device is portable, it can be easily considered that its configuration, functional configuration, operation, processing, etc. are equivalent to the configuration, functional configuration, operation, processing, etc. of the ultrasound diagnostic device 1 to which the above-mentioned medical information processing device 100 is applied, or the ultrasound diagnostic device 1a to which the medical information processing device 100a is applied. Therefore, detailed description of the configuration, functional configuration, operation, processing, etc. when the ultrasound diagnostic device is portable will be omitted.

[0067] As described above, the medical information processing device of the embodiment reproduces the hardness of the subject's internal tissues measured noninvasively using an ultrasound probe using a tactile reproduction device. This allows the medical information processing device of the embodiment to present the examiner with tactile information about the tactile sensation and hardness of the subject's internal tissues. In other words, the medical information processing device of the embodiment presents the examiner with information related to the tactile sensation and hardness of the subject's internal tissues in a format that is intuitively understandable, as if the examiner were directly palpating the tissues. Furthermore, the medical information processing device of the embodiment can simultaneously reproduce and present to the examiner not only the tissue hardness based on the current examination result, but also the tissue hardness based on previous examination results, normal tissue hardness, and stiffness information of representative measurement target tissues for each case (including stiffness information corresponding to the progression of symptoms). These features allow the examiner to more effectively examine the subject using an ultrasound diagnostic device incorporating the medical information processing device of the embodiment.

[0068] In the above-described embodiment, the ultrasound diagnostic apparatus 1 and the ultrasound diagnostic apparatus 1a have been described as examples of medical diagnostic apparatuses to which the medical information processing apparatus 100 and the medical information processing apparatus 100a are applied. However, this is merely an example, and the medical diagnostic apparatus to which the medical information processing apparatus 100 and the medical information processing apparatus 100a are applied may be any medical diagnostic apparatus capable of non-invasively measuring the stiffness of tissue inside the body of a subject P. For example, if a magnetic resonance imaging (MRI) diagnostic apparatus is capable of non-invasively measuring the stiffness of tissue inside the body of a subject P, the medical information processing apparatus 100 and the medical information processing apparatus 100a may be applied to a magnetic resonance imaging diagnostic apparatus. In this case, the configuration, functional configuration, operation, processing, etc. of the magnetic resonance imaging diagnostic apparatus may be equivalent to the configuration, functional configuration, operation, processing, etc. of the ultrasound diagnostic apparatus 1 and the ultrasound diagnostic apparatus 1a described above. Therefore, detailed explanations regarding the configuration, functional configuration, operation, processing, etc. when the medical information processing device 100 or the medical information processing device 100a is applied to a magnetic resonance imaging diagnostic device will be omitted.

[0069] The above-described embodiment can be expressed as follows. processing circuitry; The processing circuitry The computer of the medical information processing device Acquiring at least morphological information of tissue inside the body of the subject and a measurement signal measuring the hardness of the tissue inside the body of the subject; Controlling the display of a morphological image based on at least the morphological information on a display device; generating stiffness information representing the stiffness of the tissue based on the measurement signal; generating a stiffness reproduction signal for causing a tactile sensation reproduction device to reproduce the stiffness of the tissue inside the subject's body based on the generated stiffness information or the measurement signal; Medical information processing equipment.

[0070] According to at least one of the embodiments described above, the medical information processing device (100) is provided with an acquisition unit (112) that acquires at least morphological information (reflected wave signals) of tissues inside the body of the subject (P) and measurement signals that measure the hardness of the tissues inside the body of the subject, a display control unit (114) that controls the display of a morphological image (ultrasound image) based on at least the morphological information on a display device (30), and a hardness information processing unit (116) that generates hardness information that represents the hardness of the tissue based on the measurement signals, and generates a hardness reproduction signal that causes a tactile reproduction device (40) to reproduce the hardness of the tissues inside the body of the subject based on the generated hardness information or the measurement signals, thereby enabling the examiner (D) to obtain tactile information as if he or she were directly palpating the tissues inside the body of the subject.

[0071] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0072] 1,1a···Ultrasound diagnostic device, 10,10a···Main unit, 20···Ultrasound probe, 30···Display device, 40···Tactile reproduction device, 50···Medical image management system, 52···Patient information database, 54···Image database, 100,100a···Medical information processing device, 110···Processing circuit, 112···Acquisition function, 1122···Image acquisition function, 1124···Stiffness signal acquisition function, 114···Display control function, 116···Stiffness information processing function, 120,120a···Stiffness information storage unit

Claims

1. an acquisition unit that acquires at least morphological information of a tissue inside the body of a subject and a measurement signal that measures the hardness of the tissue inside the body of the subject; a display control unit that controls display of a morphological image based on at least the morphological information on a display device; a stiffness information processing unit that generates stiffness information representing the stiffness of the tissue based on the measurement signal, and generates a stiffness reproduction signal for causing a tactile reproduction device to reproduce the stiffness of the tissue inside the subject's body based on the generated stiffness information or the measurement signal; A medical information processing device comprising:

2. the stiffness information processing unit generates the stiffness reproduction signal based on the measurement signal measured in real time or the stiffness information based on the measurement signal. The medical information processing device according to claim 1 .

3. Further provided is a hardness information storage unit that stores a plurality of pieces of hardness information, the stiffness information storage unit stores the morphological image and the stiffness information in association with each other; the stiffness information processing unit generates the stiffness reproduction signal for causing the tactile reproduction device to reproduce the stiffness of a plurality of tissues based on the plurality of pieces of stiffness information stored in the stiffness information storage unit. The medical information processing device according to claim 2 .

4. the stiffness information processing unit generates the stiffness reproduction signal for simultaneously reproducing the stiffness of each of the tissues represented by the plurality of pieces of stiffness information stored in the stiffness information storage unit. The medical information processing device according to claim 3 .

5. The stiffness information stored by the stiffness information storage unit includes at least one of the stiffness information based on the measurement signal obtained by previously measuring the stiffness of the tissue inside the body of the subject, the stiffness information based on the measurement signal obtained by measuring the stiffness of the tissue inside the body of another subject, stiffness information representing the stiffness of normal tissue, and stiffness information of a representative tissue to be measured for each case. The medical information processing device according to claim 4 .

6. the display control unit causes the display device to superimpose on the anatomical image operation information for specifying a depth within the body of the subject at which the tactile sensation reproduction device is to reproduce the hardness of the tissue; the stiffness information processing unit generates the stiffness reproduction signal corresponding to a depth inside the body of the subject designated by an operation on the operation information. The medical information processing device according to any one of claims 1 to 5.

7. the display control unit causes the display device to superimpose on the anatomical image operation information for causing the tactile sensation reproduction device to specify regions at a plurality of depths within the body of the subject in which the hardness of the tissue is to be reproduced; the stiffness information processing unit generates the stiffness reproduction signals corresponding to a plurality of depth regions within the body of the subject designated by an operation on the operation information. The medical information processing device according to any one of claims 1 to 5.

8. the hardness information processing unit acquires, from the tactile sensation reproduction device, position information representing a contact position in contact with the tissue inside the body of the subject, which is reproduced on the tactile sensation reproduction device; the display control unit causes the display device to display contact information indicating the contact position superimposed on the morphological image. The medical information processing device according to claim 6 .

9. The computer of the medical information processing device Acquiring at least morphological information of tissue inside the body of the subject and a measurement signal measuring the hardness of the tissue inside the body of the subject; Controlling the display of a morphological image based on at least the morphological information on a display device; generating stiffness information representing the stiffness of the tissue based on the measurement signal; generating a stiffness reproduction signal for causing a tactile sensation reproduction device to reproduce the stiffness of the tissue inside the subject's body based on the generated stiffness information or the measurement signal; Medical information processing method.

10. The computer of the medical information processing device Acquiring at least morphological information of tissues in the body of the subject and a measurement signal measuring the hardness of the tissues in the body of the subject; controlling the display of a morphological image based on at least the morphological information on a display device; generating stiffness information representing the stiffness of the tissue based on the measurement signal; generating a stiffness reproduction signal for causing a tactile sensation reproduction device to reproduce the stiffness of the tissue inside the subject's body based on the generated stiffness information or the measurement signal; program.

Images