Ultrasonic diagnostic imaging system, ultrasonic diagnostic imaging program, and ultrasonic diagnostic imaging method

Abstract

To provide an ultrasonic image diagnostic system for independently displaying an image displayed on the side of an ultrasonic diagnostic apparatus, an image displayed on the side of an information terminal and an image displayed on the side of the information terminal obtained by remotely instructing the apparatus.SOLUTION: An ultrasonic image diagnosis system (1) is an ultrasonic image diagnosis system in which an ultrasonic diagnostic device (2) having a display section for displaying a first ultrasonic image generated on the basis of first ultrasonic image data obtained by transmitting and receiving ultrasonic signals by using an ultrasonic probe, and an information terminal (3) having an input section and a display section for displaying image data transmitted from the ultrasonic diagnostic device (2) are connected by a network, and the ultrasonic image diagnosis system (1) is provided with a display mode including a synchronous display mode for synchronously displaying the displays of the display section of the ultrasonic diagnostic device (2) and the display section of the information terminal (3), and an independent display mode for displaying the first ultrasonic image on the display section of the ultrasonic diagnostic device (2) and displaying the second ultrasonic image on the display section of the information terminal (3).SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an ultrasound imaging diagnostic system, an ultrasound imaging diagnostic program, and an ultrasound imaging diagnostic method for remotely displaying ultrasound images. [Background technology]

[0002] Medical diagnoses based on ultrasound images of organs and tissues in living bodies have been widely performed. Ultrasound diagnostic devices that generate these ultrasound images transmit ultrasound waves into living bodies, receive echoes reflected from the organs and tissues, and visualize them as cross-sectional images.

[0003] In recent years, an increasingly common usage pattern is that an ultrasound diagnostic device and a mobile terminal are remotely connected via a network, and ultrasound images are shared between an image taker of the ultrasound diagnostic device and a specialist using the mobile terminal.

[0004] For example, Patent Document 1 discloses an ultrasound imaging system in which ultrasound images are shared between a pocket echo device and an image workstation. Specifically, it describes that the pocket echo device receives, from the image workstation, permission / prohibition command signals related to the transmission and reception of ultrasound signals in a probe and permission / prohibition command signals related to the display of ultrasound images. It also describes that the image workstation transmits operation commands to the pocket echo device.

[0005] Patent Document 2 also discloses sharing of ultrasound images, camera images, a chat function, and a touch command screen between an ultrasound diagnostic device that is a server and an ultrasound diagnostic device that is a client. Patent Document 2 also discloses displaying a mouse pointer from the client side at any position on the screen of the server, and issuing operational instructions to the server side from a client side that has been given priority among multiple clients. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Special Publication No. 2020-508195 [Patent Document 2] Japanese Patent Publication No. 2023-039624 Summary of the Invention [Problem to be solved by the invention]

[0007] In the above-described prior art ultrasound diagnostic device and mobile device, the screen display may be operated by both the operator of the ultrasound diagnostic device and the operator of the mobile device at a remote location. In this situation, for example, when a doctor on duty or an emergency physician operating the ultrasound diagnostic device performs an emergency examination or a procedure such as an ultrasound-guided puncture, the doctor may want to continue displaying the screen containing the ultrasound image he or she is currently observing without changing the layout. In other words, the doctor may not want the display screen to change. On the other hand, a medical professional such as a specialist at a remote location may want a different screen display from that on the ultrasound diagnostic device due to differences in his or her role, observation purpose, or display operating environment.

[0008] That is, there are cases where it is desirable to change the ultrasound-specific display processing between the ultrasound diagnostic device and the mobile device for a specific reason, such as the need to obtain additional information necessary for advice or an accurate diagnosis, or the need to prioritize or limit the display of more important information because the resolution of the display unit of the information terminal is smaller than that of the ultrasound diagnostic device.

[0009] An example of the former is when a specialist in a remote location needs to obtain the information necessary for advice or an accurate diagnosis. (i) Freeze the currently displayed diagnostic ultrasound image at a specific time, measure the shape of tissues and blood vessels on the still image, and display the image and measurement results. (ii) Live display of ultrasound images (blood flow images / morphological images) in a mode different from the ultrasound images (morphological / blood flow images) currently being displayed synchronously. Examples include:

[0010] As an example of the latter, when a normal B-mode image and a B-mode image with nerve-enhanced data superimposed thereon are displayed side by side on the display unit of an ultrasound diagnostic device, the B-mode image with nerve-enhanced data superimposed thereon is preferentially displayed (on the front or in a larger size) on the display unit of a low-resolution information terminal, or only the B-mode image with nerve-enhanced data superimposed thereon is displayed.

[0011] An object of the present invention is to provide an ultrasound imaging diagnostic system that independently displays an image displayed on the ultrasound diagnostic device, an image displayed on the information terminal, and an image displayed on the information terminal obtained by remotely instructing the device. [Means for solving the problem]

[0012] The above problem is solved as follows.

[0013] (1) an ultrasound diagnostic device having a display unit that displays a first ultrasound image generated based on first ultrasound image data obtained by transmitting and receiving ultrasound signals using an ultrasound probe; an information terminal having an input unit and a display unit that displays image data transmitted from the ultrasound diagnostic device; An ultrasound imaging diagnostic system in which the following are connected via a network: a synchronous display mode in which the displays of the display unit of the ultrasonic diagnostic device and the display unit of the information terminal are synchronously displayed; an independent display mode in which the first ultrasound image is displayed on the display unit of the ultrasound diagnostic device and the second ultrasound image is displayed on the display unit of the information terminal; An ultrasound imaging system comprising a display mode including:

[0014] (2) the information terminal includes a remote control unit, When the display mode is the independent display mode, an operation input to the remote control unit is executed as an operation instruction to the information terminal, When the display mode is the synchronous display mode, an operation input to the remote control unit is transmitted from the information terminal to the ultrasonic diagnostic device and executed as an operation instruction to the ultrasonic diagnostic device. An ultrasound imaging diagnostic system according to (1).

[0015] (3) The operation transmitted from the information terminal to the ultrasonic diagnostic device when the display mode is the synchronous display mode includes any one of an operation to instruct start / stop of an imaging mode of the ultrasonic diagnostic device, an operation to instruct highlighting, a freeze operation, and a measurement operation. (2) An ultrasound imaging diagnostic system according to (1).

[0016] (4) When the display mode is the independent display mode, when a window displaying the independent display mode is closed, The display mode is changed from the independent display mode to the synchronous display mode. An ultrasound imaging diagnostic system according to (1).

[0017] (5) an ultrasound diagnostic device having a display unit that displays a first ultrasound image generated based on first ultrasound image data obtained by transmitting and receiving ultrasound signals using an ultrasound probe; an information terminal having an input unit and a display unit that displays image data transmitted from the ultrasound diagnostic device; An ultrasound imaging diagnostic method executed by an ultrasound imaging diagnostic system in which the ultrasound imaging systems are connected via a network, a step of executing a synchronous display mode in which the displays of the display unit of the ultrasonic diagnostic device and the display unit of the information terminal are synchronously displayed; executing an independent display mode in which the first ultrasound image is displayed on a display unit of the ultrasound diagnostic device and the second ultrasound image is displayed on a display unit of the information terminal; An ultrasound imaging diagnostic method comprising:

[0018] (6) a control unit of the ultrasound diagnostic device having a display unit that displays a first ultrasound image generated based on first ultrasound image data obtained by transmitting and receiving ultrasound signals using an ultrasound probe; a control unit of an information terminal having an input unit and a display unit for displaying image data transmitted from the ultrasound diagnostic device, a step of executing a synchronous display mode in which the displays of the display unit of the ultrasonic diagnostic device and the display unit of the information terminal are synchronously displayed; a step of executing an independent display mode in which the first ultrasound image is displayed on a display unit of the ultrasound diagnostic device and the second ultrasound image is displayed on a display unit of the information terminal; Ultrasound imaging diagnostic program for executing the above. [Effects of the Invention]

[0019] According to the present invention, an ultrasound imaging diagnostic system can be provided that independently displays an image displayed on the ultrasound diagnostic device, an image displayed on the information terminal, and an image obtained by remotely instructing the device and displayed on the information terminal, thereby improving user convenience. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a diagram illustrating the configuration of an ultrasound imaging diagnostic system according to an embodiment. [Figure 2] 10 is a flowchart illustrating the operation of the ultrasound imaging diagnostic system. [Figure 3] FIG. 1 is a diagram showing the contents of an ultrasonic examination in Examples 1 and 2. [Figure 4A] FIG. 2 is a diagram showing the display content of the display unit of the ultrasound diagnostic device. [Figure 4B] FIG. 2 is a diagram showing the display content of a display unit of an information terminal. [Figure 5A] FIG. 2 is a diagram showing an ultrasound image of the aorta on the display unit of the ultrasound diagnostic device. [Figure 5B] FIG. 10 is a diagram showing an ultrasound image of the aorta on the display unit of an information terminal. [Figure 5C]FIG. 10 is a diagram showing an ultrasound image of the aorta on the display unit of the information terminal after an operation instruction is given. [Figure 6] FIG. 10 is a diagram showing details of a remote control floating window. [Figure 7] FIG. 10 is a diagram showing an example in which operation buttons for setting an independent display instruction function and an independent display cancellation instruction function are provided in an ultrasound diagnostic apparatus. [Figure 8] FIG. 10 is a diagram showing an example of overwriting an ultrasound image that is independently displayed. [Figure 9] FIG. 10 is a diagram showing an example in which a first ultrasound image and a second ultrasound image are displayed in different windows. [Figure 10] FIG. 10 is a diagram showing an example in which a first ultrasound image and a second ultrasound image are displayed in different tabs in the same window. [Figure 11] FIG. 10 is a diagram showing an example of marking an ultrasound image using a drawing tool. [Figure 12] 10 is a flowchart illustrating details of an independent display process. [Figure 13A] FIG. 10 is a diagram showing a color Doppler image of a left sternal border long axis cross section on the display unit of the ultrasound diagnostic device. [Figure 13B] FIG. 10 is a diagram showing a color Doppler image of a left sternal border long axis cross section on the display unit of an information terminal. [Figure 13C] FIG. 10 is a diagram showing a B-mode image of a left sternal border long axis cross section after an instruction to display it independently is given on the display unit of the information terminal. [Figure 14A] FIG. 10 is a diagram showing a B-mode image on the display unit of an ultrasound diagnostic device, onto which enhanced data relating to the puncture needle, nerves, and blood vessels in the thigh is superimposed. [Figure 14B] FIG. 10 is a diagram showing a B-mode image on the display of an information terminal, onto which enhanced data relating to the puncture needle, nerves, and blood vessels in the thigh is superimposed. [Figure 14C] This figure shows an example in which a B-mode image without any of the emphasis data relating to the puncture needle, nerves, and blood vessels in the thigh superimposed is displayed on the display unit of an information terminal after an independent display instruction is given. [Figure 15A] FIG. 2 is a diagram showing a B-mode image of the thigh on the display unit of the ultrasound diagnostic device. [Figure 15B] FIG. 10 is a diagram showing a B-mode image of the thigh on the display unit of the information terminal. [Figure 15C] FIG. 10 is a diagram showing an example in which a B-mode image on which nerve-enhanced data of the thigh is superimposed is displayed on the display unit of the information terminal after an independent display instruction is given. [Figure 16A] FIG. 1 is a diagram showing a B-mode image including the femoral nerve on the display unit of an ultrasound diagnostic device. [Figure 16B] FIG. 10 is a diagram showing a B-mode image including the femoral nerve on the display unit of the information terminal. [Figure 16C] FIG. 10 is a diagram showing an example in which a "B-mode image without superimposed nerve-enhancing data" and a "B-mode image with superimposed nerve-enhancing data" are displayed side by side on the display unit of an ultrasound diagnostic device after an independent display instruction is given. [Figure 16D] FIG. 10 is a diagram showing an example in which a "B-mode image with nerve-enhanced data superimposed" is displayed on the display unit of an information terminal after an independent display instruction is given. [Figure 17] FIG. 10 is a diagram showing an example in which a "B-mode image without superimposed nerve-enhancing data" is displayed on the display unit of an ultrasound diagnostic device, and a message is superimposed after an independent display instruction is given. DETAILED DESCRIPTION OF THE INVENTION

[0021] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. [Example]

[0022] In the embodiment described below, the ultrasound imaging diagnostic system 1 of the embodiment is used to evaluate the presence or absence of an aortic aneurysm as part of an ultrasound examination to differentiate the pathology of a patient in shock, performed by a doctor on call and a cardiologist in a remote location.

[0023] More specifically, the doctor on duty visually diagnoses that there is no aortic aneurysm based on the B-mode ultrasound video image that he or she captured. In response, the specialist using the information terminal 3 instructs the ultrasound diagnostic device 2 operated by the doctor on duty to display an independent ultrasound image in order to obtain additional information necessary for an accurate diagnosis. The ultrasound diagnostic device 2 generates a still image of the B-mode ultrasound image and transfers it to the information terminal 3. The specialist measures the blood vessel diameter on the still image displayed on the display unit 51 of the information terminal 3 and diagnoses the presence of an aortic aneurysm based on the measured value of the blood vessel diameter including the thrombus. The specialist instructs the ultrasound diagnostic device 2 to cancel the independent display, and prompts the doctor on duty to reevaluate the aortic diameter while the same B-mode image as that of the ultrasound diagnostic device 2 is synchronously displayed on the display unit 51 of the information terminal.

[0024] Here, the configuration of an ultrasound imaging diagnostic system 1 according to an embodiment will be described with reference to FIG. The ultrasound image diagnostic system 1 is composed of an ultrasound diagnostic device 2 and an information terminal 3, which are connected via a network such as a wireless / wired LAN, mobile communication, or the Internet. In the following description, the ultrasound diagnostic device 2 is assumed to be a cart-type ultrasound diagnostic device, and the information terminal 3 is assumed to be a PC equipped with a display that supports touch screen operations.

[0025] The ultrasound diagnostic device 2 includes an ultrasound probe 42, a transmission / reception driver 25, a signal processor 24, a controller 21, a display processor 22, a display 41, a communication unit 23, an input unit 43, a camera 45, and a microphone SP 44. The signal processor 24 is also composed of a B-mode data processor 26, a color / power Doppler data processor 27, and a pulsed wave / continuous wave Doppler data processor 28.

[0026] The ultrasonic probe 42 has an ultrasonic probe, and irradiates an ultrasonic beam onto the subject in response to a drive signal from the transmission / reception driver 25, and also receives reflected ultrasonic waves (echoes) from the subject, converts them into ultrasonic signals, and supplies them to the transmission / reception driver 25. The transmission / reception driver 25 supplies a drive signal to the ultrasonic probe 42 under the control of the controller 21, and also receives an ultrasonic signal of a reflected ultrasonic wave (echo) from the ultrasonic probe 42 and supplies it to the signal processor 24.

[0027] The signal processing unit 24 generates ultrasound images such as B-mode images, color Doppler images, and pulse wave Doppler images based on the ultrasound signals supplied from the transmission / reception driver 25. The signal processing unit 24 also performs enhancement processing on the puncture needle, nerve, and blood vessel regions of the ultrasound images. The display processing unit 22 performs various image processing and user interface processing required to display the ultrasound image generated by the signal processing unit 24 on the display unit 41 . The display unit 41 displays the display image data including the ultrasound image output from the display processing unit 22. A touch panel (input unit 43) is provided on the display surface of the display unit 41 so that a tapping action by the user can be detected. Note that instead of the user tapping the setting button, the user may issue an operation instruction by clicking the setting button with a mouse, for example.

[0028] The communication unit 23 is an input / output unit for wireless / wired LAN and mobile communication that communicates with the information terminal 3. The camera 45 captures an image of the user (doctor on duty) of the ultrasound diagnostic device 2 when video chatting with the user (specialist) of the information terminal 3. The camera 45 can also capture an image of a subject against which an ultrasound probe is placed, and notify the information terminal 3 of an image showing the posture of the subject and the position and angle of the ultrasound probe at the time of imaging. The microphone SP44 is a microphone and speaker for voice chat with the user (specialist) of the information terminal 3. The input unit 43 is an input unit for operation instructions from the user (doctor on duty).

[0029] Based on operation instructions input from the input unit 43, the control unit 21 controls the driving of the ultrasonic probe 42, the display of the ultrasonic image on the display unit 41, and communication with the information terminal 3 via the communication unit 23.

[0030] The information terminal 3 includes an input unit 53 , a camera 55 , a microphone SP 54 , a control unit 31 , a display processing unit 32 , a display unit 51 , and a communication unit 33 .

[0031] The communication unit 33 is an input / output unit for wireless / wired LAN and mobile communication that communicates with the ultrasound diagnostic device 2. The display processing unit 32 performs various image processing and user interface processing required for displaying the ultrasound image notified from the ultrasound diagnostic device 2 via the communication unit 33 on the display unit 51 .

[0032] The display unit 51 displays the display image data including the ultrasound image output from the display processing unit 32. A touch panel (input unit 53) is provided on the display surface of the display unit 51 so that a tapping action by the user can be detected. Note that instead of the user tapping the setting button, the user may give an operation instruction by clicking the setting button with a mouse, for example.

[0033] The camera 55 captures an image of the user (specialist) of the information terminal 3 when video chatting with the user (doctor on duty) of the ultrasound diagnostic device 2. The microphone SP54 is a microphone and speaker for voice chat with the user of the ultrasound diagnostic device 2 (the doctor on duty). The input unit 53 is an input unit for a user (specialist) to give operational instructions.

[0034] The control unit 31 controls the display of an ultrasound image on the display unit 51 and communication with the ultrasound diagnostic device 2 via the communication unit 33 based on an operation instruction input from the input unit 53 .

[0035] More specifically, the ultrasonic diagnostic apparatus 2 and the information terminal 3 of the embodiment are realized by an information processing device (computer) that includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and a large-capacity recording medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0036] The CPU reads out the ultrasound image diagnostic program stored in the ROM or HDD / SSD, expands it into the RAM, and realizes the functions of the ultrasound diagnostic device 2 and the information terminal 3 according to the expanded program. The RAM forms a work area for temporarily storing various programs executed by the CPU and data related to these programs. The ultrasound image diagnostic program may be stored in the form of computer-readable program code and supplied from a recording medium, or may be transmitted and supplied via a network.

[0037] Next, the operation of the ultrasound diagnostic imaging system 1 of this embodiment will be described with reference to the flowchart of Fig. 2. In this embodiment, the processes of steps S24 to S26 for remotely operating the ultrasound diagnostic device 2 from the information terminal 3 are not performed.

[0038] In step S21, the ultrasound diagnostic imaging system 1 connects devices and sets imaging conditions. In detail, the doctor on duty connects the ultrasound probe 42 and the camera 45 to the ultrasound diagnostic device 2 in an examination room of the hospital and starts up the ultrasound diagnostic device 2. Meanwhile, the specialist starts up a notebook PC (information terminal 3) equipped with a camera 55 (web camera) and a touch-operable monitor (display unit 51 and input unit 53) from home and remotely connects to the ultrasound diagnostic device 2.

[0039] Then, a permission request for the following two link functions is sent from the information terminal 3 to the ultrasound diagnostic device 2, and the ultrasound diagnostic device 2 grants permission to the information terminal 3.

[0040] One is to share ultrasound images, camera images, mouse pointers, and drawing tool drawing data between the display unit 41 of the ultrasound diagnostic device 2 and the display unit 51 of the information terminal 3. Ultrasound images are shared by live transmission of the ultrasound images from the ultrasound diagnostic device 2 to the information terminal 3. In addition, when using camera images, mouse pointers, and drawing tools on each device, the drawing data is shared by live transmission to the other device. The other is to transmit a remote control command from the information terminal 3 to the ultrasonic diagnostic device 2.

[0041] Also, launch a separate web meeting tool so that you can communicate via voice and chat. Furthermore, the doctor on duty registers information about the transported patient in shock in the patient database of the ultrasound diagnostic apparatus 2, and selects the B-mode as the imaging mode condition.

[0042] In step S22, the ultrasound diagnostic device 2 starts capturing ultrasound images. Specifically, the doctor on call will begin the RUSH (Rapid Ultrasound in SHock) exam as an ultrasound examination. As shown in Figure 3, this examination involves evaluating the Pump (heart), Tank (lungs, inferior vena cava, and thoracic and abdominal cavities), and Pipes (aorta and lower limb veins) in three steps. The doctor on call will use this examination to diagnose the pathogenesis of shock (cardiogenic / obstructive / hypovolemic / abnormal blood distribution).

[0043] In step S23, the ultrasound diagnostic device 2 generates a first ultrasound image and shares the ultrasound image with the information terminal 3.

[0044] In detail, the ultrasound diagnostic device 2 scans the patient's body surface using a connected convex probe (ultrasound probe 42), generates a first B-mode ultrasound image based on the acquired ultrasound signals, and displays it on the display unit 41 as an ultrasound image 100 as shown in FIG. 4A.

[0045] Furthermore, the control unit 21 of the ultrasound diagnostic device 2 transmits the first ultrasound image from the communication unit 23 to the communication unit 33 of the information terminal 3. In the information terminal 3, the data of the first ultrasound image received by the control unit 31 is sent to the display processing unit 32, which performs conversion processing for display and displays the image as ultrasound image 100 on the observation image 61 of the display unit 51, as shown in FIG.

[0046] Here, the display screens of the ultrasonic diagnostic device 2 and the information terminal 3 will be described with reference to FIGS. 4A and 4B. 4A is a diagram showing the display content of the display unit 41 of the ultrasound diagnostic device 2. The display unit 41 displays an ultrasound image 100, and also displays an image 551 of a specialist taken by the camera 55 of the information terminal 3 during a video chat.

[0047] 4B is a diagram showing the display contents of the display unit 51 of the information terminal 3. The display unit 51 displays an observation image 61, which is the display contents of the display unit 41 of the shared ultrasound diagnostic device 2, and a remote control floating window 62 for remotely instructing the ultrasound diagnostic device 2 from the information terminal 3. The observation image 61 displays the shared ultrasound image 100, and also displays an image 451 of the doctor on duty or the subject (with the ultrasound probe in contact) captured by the camera 45 of the ultrasound diagnostic device 2 during a video chat.

[0048] Figures 5A, 5B, and 5C are figures showing ultrasound images of the abdominal aorta when the doctor on duty performs Step 1 examination (evaluation of abdominal aortic diameter) on the Pipes (blood vessels) in the examination content shown in Figure 3 and examines whether or not there is an abdominal aortic aneurysm.

[0049] 5A is a diagram showing the display content of the display unit 41 of the ultrasound diagnostic device 2. The display unit 41 displays an ultrasound image 110 (B-mode image) of the aorta. The ultrasound image 110 shows a thrombus region 112 and a blood flow region 113. The doctor on duty determines that the blood vessel diameter is normal (the blood vessel diameter is less than 5 cm) based on the blood flow region 113 on the display unit 41.

[0050] Figures 5B and 5C are diagrams showing the display contents of the display unit 51 of the information terminal 3. As will be described later, Figure 5B shows a state in which an ultrasound image 110 (B-mode image) of the aorta is displayed in synchronization with Figure 5A. Figure 5C shows a state in which the blood vessel diameter is measured after the remote control floating window 62 is operated to freeze the screen.

[0051] Returning to FIG. 2, in step S24, the ultrasound diagnostic apparatus 2 determines whether or not a remote operation instruction (remote operation command) has been received from the information terminal 3. If it has been received (Y in step S24), the process proceeds to step S25. If it has not been received (N in step S24), the process proceeds to step S27.

[0052] The remote operation instruction from the information terminal 3 refers to a remote operation command transmitted from the information terminal 3 to the ultrasound diagnostic device 2. In detail, the remote operation command is notified from the information terminal 3 to the ultrasound diagnostic device 2 in response to a user operation on the remote operation floating window 62 on the display unit 51 of the information terminal 3.

[0053] FIG. 6 shows the remote control floating window 62 in detail. The remote control floating window 62 contains commands for starting / stopping imaging modes such as B-mode, color Doppler mode, and pulse wave Doppler mode, as well as commands for specifying depth, focus position, display brightness, and frame rate. It also contains operation buttons for commands for highlighting the puncture needle, nerves, and blood vessel regions, and for applying / cancelling various filter processes.

[0054] 6 includes a "Measure" button 621, a "Freeze" button 622, a "Nerve Enhance" button 623, a "Color" button 624, a "B" button 625, and a "Local Mode" button 626. The "Measure" button 621 is used to start / end a measurement mode for measuring the actual distance between two points on an ultrasound image. The "Freeze" button 622 is used to start / end a still image display mode for the observation image 61 on the information terminal 3.

[0055] The "Nerve Enhance" button 623 instructs the start / end of nerve enhancement mode. The "Color" button 624 instructs the start / end of color Doppler mode imaging. The "B" button 625 instructs the start / end of B-mode imaging. The "Local Mode" button 626 instructs the start / end of processing to generate and transmit a second ultrasound image to be used for independent display on the information terminal 3.

[0056] When the control unit 31 of the information terminal 3 detects a user tap on the remote operation floating window 62 via the input unit 53, it notifies the ultrasound diagnostic device 2 of a remote operation instruction (remote operation command) corresponding to the operated operation button.

[0057] Returning to FIG. 2, in step S25, the ultrasonic diagnostic apparatus 2 executes the remote operation instruction (remote operation command) from the information terminal 3.

[0058] In step S26, the ultrasound diagnostic device 2 determines whether or not to continue collaboration with the information terminal 3. That is, the ultrasound diagnostic device 2 checks the connection of the information terminal 3. If it is determined that the information terminal 3 is in an unconnected state, the ultrasound diagnostic device 2 determines that collaboration should not be continued (N in step S26), and the processing in Fig. 2 ends. If it is determined that the information terminal 3 is in a connected state, the ultrasound diagnostic device 2 determines that collaboration should be continued (Y in step S26), and the processing proceeds to step S27.

[0059] In step S27, the ultrasound diagnostic apparatus 2 determines whether or not it has received an independent display instruction from the information terminal 3, notified in response to an instruction from the user (specialist) of the information terminal 3 to operate the "Local Mode" button 626. If it has received an independent display instruction (Y in step S27), the process proceeds to step S28, and if it has not received an independent display instruction (N in step S27), the process returns to step S23.

[0060] For example, a specialist notices the presence of a thrombus region 122 in the ultrasound image of the abdominal aorta shown in the observation image 61 of Fig. 5B, and taps the "Local Mode" button 626 and the "Freeze" button 622 in the remote operation floating window 62. This causes the information terminal 3 to send an independent display instruction (an instruction to generate and transmit a still image) to the ultrasound diagnostic device 2.

[0061] In the above, it has been described that the "Local Mode" button 626 for setting the independent display instruction function and the independent display cancellation instruction function is provided in the remote operation floating window 62 of the information terminal 3. However, as shown in FIG. 7 , the "Local Mode" button 411 for setting the independent display instruction function and the independent display cancellation instruction function of the screen may be provided in the display unit 41 of the ultrasound diagnostic apparatus 2. In other words, an operation button for preventing the information terminal 3 from changing the display function of the display unit 41 is provided in the ultrasound diagnostic apparatus 2. This makes it possible to prevent the user of the ultrasound diagnostic apparatus 2 (the doctor on duty) from making a treatment error due to a change in the display content.

[0062] The "Local Mode" button 626 in the remote control floating window 62 in Fig. 5B and the "Local Mode" button 411 in Fig. 7 are operation buttons that toggle between an independent display instruction function and an independent display cancellation instruction function when tapped by the user. However, the operation instruction method is not limited to this.

[0063] As another method of giving operation instructions, for example, a user interface for instructing independent display and a user interface for instructing cancellation of independent display may be arranged separately, and the desired operation button in the remote control floating window 62 may be tapped after tapping these user interfaces to give an instruction for independent display or an instruction for cancellation of independent display.

[0064] Alternatively, in the remote control floating window 62, the first tap on the operation button may be performed as an operation in a state where independent display is instructed, and the second tap may be performed as an operation in a state where independent display cancellation is instructed. In this case, there is no need to provide a user interface for instructing / canceling independent display, such as the "Local Mode" button 626.

[0065] Such a toggle operation of the operation button means that the state transitions between the independent display instruction and the independent display cancellation instruction each time the button is tapped. It is desirable to display the operation instruction button on the operation screen in a display mode (color, brightness, opacity, image, symbol, icon, etc.) that indicates the independent display instruction or the independent display cancellation instruction state. Alternatively, a predetermined operation (double tap, long press, etc.) on each operation button may be assigned as the independent display instruction function or the independent display cancellation instruction function.

[0066] When a desired operation (other than an independent display instruction / cancel instruction) is performed on the remote control floating window 62 while the independent display instruction is being executed, the operation is executed as an operation instruction for displaying the second ultrasound image only on the information terminal 3. When an independent display cancel instruction is executed, the first ultrasound image generated by the ultrasound diagnostic device 2 is displayed on the display unit 51 of the information terminal 3, and synchronous display (coordination) is restored.

[0067] Furthermore, when a desired operation is performed on the remote control floating window 62 while an instruction to cancel the independent display has been executed, the following operation is performed. That is, the operation is performed as a remote operation of the ultrasonic diagnostic device 2, and the first ultrasonic image generated by the remote operation is displayed on the display unit 41 of the ultrasonic diagnostic device 2 and the display unit 51 of the information terminal 3.

[0068] 2, in step S28, the ultrasound diagnostic device 2 performs an independent display process, the details of which will be described later. That is, the ultrasound diagnostic device 2 generates an ultrasound image for independent display (second ultrasound image) and transmits it to the information terminal 3. For example, the still image 120 is displayed on the observation image 61 of the display unit 51 of the information terminal 3 as the second ultrasound image.

[0069] As a result, by operating the "Local Mode" button 626 as an independent display instruction means, the information terminal 3 displays the second ultrasound image independently without changing the first ultrasound image displayed by the ultrasound diagnostic device 2.

[0070] As a variation of the independent display on the display unit 51 of the information terminal 3, any of the following displays may be displayed. 8, an ultrasound image 101 for independent display, which is a second ultrasound image, is displayed by overwriting the area of ​​the ultrasound image 100 that was being synchronously displayed. That is, the synchronous display (cooperative operation) with the ultrasound diagnostic device 2 is interrupted, and the second ultrasound image is displayed. As shown in FIG. 9, an ultrasound image 101 for independent display, which is a second ultrasound image, is displayed in a window (observation image 63) different from the synchronously displayed window (observation image 61). As shown in FIG. 10, an ultrasound image 101 for independent display, which is a second ultrasound image, is displayed in a tab 65 different from the tab 64 of the synchronously displayed window.

[0071] Returning to FIG. 2, in step S29, the ultrasound diagnostic device 2 determines whether or not an instruction to cancel independent display has been received from the information terminal 3. If an instruction to cancel independent display has not been received (N in step S29), the process returns to step S28. If an instruction to cancel independent display has been received (Y in step S29), the ultrasound diagnostic device 2 restores synchronous display, and then the process returns to step S23.

[0072] When the specialist taps the independent display release button ("Local Mode" button 626) on the display unit 51 of the information terminal 3, the information terminal 3 issues an instruction to release the independent display to the ultrasound diagnostic device 2. As shown in FIG. 11 , the first ultrasound image 110 after synchronous display has been restored is displayed on the information terminal 3, and the specialist uses a drawing tool to mark 115 the thrombus region and part of its boundary on the first ultrasound image 110. The drawing tool here is a function for drawing curves and shapes by specifying a coordinate series on the screen using a pointing device or the operator's finger.

[0073] The ultrasound diagnostic device 2 displays the marked ultrasound image on the display unit 41 of the ultrasound diagnostic device 2. In other words, the marked ultrasound image can be shared between the specialist and the doctor on duty. This allows the specialist to inform the doctor on duty that the aortic diameter has been underestimated and urge them to reevaluate. The doctor on duty will reevaluate the aortic diameter and diagnose an abdominal aortic aneurysm.

[0074] As a method for issuing an instruction to cancel independent display, the instruction to cancel independent display can be given by one of the following procedures, depending on the implementation method of the independent display. In FIG. 8, an ultrasound image 100 to be synchronously displayed is displayed by overwriting the area of ​​an ultrasound image 101 for independent display. In FIG. 9, the user taps the user interface (66) for closing the window (observation image 63) displaying the second ultrasound image, ie, the ultrasound image 101 for independent display, to cancel the independent display. In FIG. 10, the user taps the user interface (67) for closing the tab 65 displaying the second ultrasound image, that is, the ultrasound image 101 for independent display, to cancel the independent display.

[0075] Next, the independent display process in step S28 in FIG. 2 will be described in detail with reference to the flowchart in FIG.

[0076] In step S281, the ultrasound diagnostic device 2 generates a second ultrasound image and transmits it to the information terminal 3.

[0077] In step S282, the information terminal 3 displays the received second ultrasonic image on the display unit 51.

[0078] In step S283, the information terminal 3 determines whether or not a processor on the information terminal 3 (or the cloud) will perform ultrasound image data processing such as measurement of the second ultrasound image. If ultrasound image data processing is to be performed (Y in step S283), the process proceeds to step S284. If ultrasound image data processing is not to be performed (N in step S283), the process of FIG. 12 ends, and the process returns to step S29 in FIG. 2.

[0079] In step S284, the processor on the information terminal 3 (or the cloud) processes the ultrasound image data. Then, the process returns to step S282, and the information terminal 3 displays the ultrasound image on the display unit 51 after the data processing.

[0080] The process of FIG. 12 will be specifically described below using as an example the process of measuring the aortic diameter including the thrombus region on the still image of FIG. 5C.

[0081] The measurement process between the specified two points, which is performed by the information terminal 3 as an independent display process in step S284, is executed by a processor on the information terminal 3 (or the cloud) by specifying the measurement position 124 on the observation image 61 with a pointing device or a fingertip.

[0082] In this case, it is assumed that data regarding pixel size has been acquired in advance when acquiring the first ultrasonic image from the ultrasonic diagnostic device 2 (as part of the data for displaying the first ultrasonic image).

[0083] In step S282, the information terminal 3 displays 65.2 mm obtained in step S284 as the aortic diameter measurement value 125. The specialist diagnoses the aortic aneurysm because the measured aortic diameter is greater than 50 mm. At this time, FIG. 5A is displayed on the ultrasound diagnostic device 2.

[0084] In step S283, the information terminal 3 has already finished the measurement process and there is no other process to be executed by the processor on the information terminal 3 (or the cloud), so it ends the independent display process and returns to step S29 in FIG.

[0085] Next, a detailed description will be given of the procedure for sharing drawing data using the drawing tool shown in Fig. 11 between the ultrasound diagnostic device 2 and the information terminal 3. That is, a coordinate series is designated on the display unit 41 of the ultrasound diagnostic device 2 (or the display unit 51 of the information terminal 3) using a pointing device or the operator's fingertip. This allows a free curve or figure to be drawn on the display unit 41 of the ultrasound diagnostic device 2 (or the display unit 51 of the information terminal 3), and the drawing data is shared.

[0086] At this time, the coordinate series is shared between the display unit 41 of the ultrasonic diagnostic device 2 and the display unit 51 of the information terminal 3. That is, the coordinate series data drawn using the drawing tool on the display unit 41 of the ultrasonic diagnostic device 2 (or the display unit 51 of the information terminal 3) is transferred from the ultrasonic diagnostic device 2 to the information terminal 3 (or from the information terminal 3 to the ultrasonic diagnostic device 2).

[0087] The coordinate series is then drawn on the ultrasound image 110 on the display unit 51 of the information terminal 3 (or the display unit 41 of the ultrasound diagnostic device 2). The display position of the coordinate series on the ultrasound image 110 on the display unit 41 of the ultrasound diagnostic device 2 is the same as the display position on the ultrasound image 110 on the display unit 51 of the information terminal 3.

[0088] The coordinate series data drawn on the display unit of the device (information terminal 3 or ultrasound diagnostic device 2) that the user is directly operating can be hidden by the user performing a delete operation. The delete operation may involve specifying the type of coordinate series to be deleted and its range using a pointing device or a finger. The delete operation may also involve the user selecting the type of coordinate series to be deleted and then executing a delete command via a context menu or a delete button.

[0089] The free-form curves or figures may be automatically erased when a preset time has elapsed since they were drawn, without the need for an explicit erase operation by the user. Note that multiple free-form curves or figures drawn by the information terminal 3 or the ultrasound diagnostic device 2 may be displayed in different display modes so that they are easily distinguishable from one another, or the curves or figures drawn by the ultrasound diagnostic device 2 and the curves or figures drawn by the information terminal 3 may be displayed in different display modes.

[0090] For example, the display mode may be such that at least one of the following is different: color, line type, thickness, brightness, opacity, or end style (none / arrow / circle, etc.). Alternatively, an annotation indicating the device or creator may be displayed near each drawn freeform curve or shape. Also, a setting menu for the function of drawing curves or shapes using a drawing tool (coordinate series specification) may be provided, allowing users to set, for example, default values ​​for the display mode, the drawing period, whether drawing data is shared or not, etc. [Example]

[0091] Next, using the ultrasound imaging diagnostic system 1, a case where the presence or absence of aortic dissection is evaluated in an ultrasound image by a doctor on call and a cardiologist in a remote location as part of an ultrasound examination to differentiate the pathology of a patient in shock will be described with reference to Figures 13A, 13B, and 13C.

[0092] Specifically, the doctor on duty evaluates the presence or absence of aortic regurgitation in the color Doppler image shown in Fig. 13A (more precisely, an image in which color Doppler data is superimposed on a B-mode image) captured using the ultrasound diagnostic device 2. At this time, a cardiologist using the information terminal 3 issues an independent display instruction to the ultrasound diagnostic device 2 to evaluate the presence or absence of a flap 132 in the aortic region 130. The ultrasound diagnostic device 2 generates a B-mode image (without the color Doppler image superimposed), transfers it to the information terminal 3, and displays it on the display unit 51 (Fig. 13C). The specialist searches for the flap 132 in the aortic region 130 on the B-mode image of Fig. 13C displayed on the display unit 51 of the information terminal 3.

[0093] A detailed explanation will be given below based on the flowchart in FIG.

[0094] In steps S21 and S22, the ultrasound diagnostic imaging system 1 specifies the color Doppler mode as the imaging mode and starts imaging. In the color Doppler mode, a B-mode image and a color Doppler image are captured live and displayed live with the color Doppler image superimposed on the B-mode image.

[0095] In step S23, the ultrasound imaging diagnostic system 1 generates a color Doppler image as the first ultrasound image, and displays it on the display unit 41 of the ultrasound diagnostic device 2 and the display unit 51 of the information terminal 3, as shown in Figures 13A and 13B, thereby sharing the ultrasound image.

[0096] Specifically, the color Doppler image (first ultrasound image) exemplified in this embodiment is an ultrasound image taken in a left sternal border long axis section using a sector probe. Color Doppler data showing aortic regurgitation 131 in an aortic region 130 is displayed and shared live.

[0097] To evaluate the presence or absence of thoracic aortic dissection and aneurysm in Step 2 of the examination related to the Pipes (aorta and lower limb veins) in Figure 3, the doctor on duty displays the color Doppler image in Figure 13A and checks for the presence or absence of aortic valve regurgitation 131. Although it is relatively easy to observe aortic valve regurgitation 131, it is an indirect finding of aortic dissection, and more direct findings are required to diagnose aortic dissection.

[0098] In step S24, since remote control from the information terminal 3 is not performed in this embodiment, the processes of steps S25 and S26 are not performed, and the process proceeds to step S27.

[0099] To observe a flap 132 in the aortic region 130, which is a definitive finding indicating aortic dissection, the specialist taps the "Local Mode" button 626 and the "B" button 625 in the remote control floating window 62. Here, the "Local Mode" button 626 is an operation button for executing instructions related to independent display. The "B" button 625 is an operation button for instructing the start / end of ultrasound imaging in B mode.

[0100] As a result, in step S27, the ultrasound diagnostic imaging system 1 determines that an independent display instruction has been received, and proceeds to step S28.

[0101] In step S28, the information terminal 3 instructs the ultrasound diagnostic device 2 to generate a B-mode image, and the ultrasound diagnostic device 2 transmits a B-mode image without a color Doppler image superimposed thereon as a second ultrasound image to the information terminal 3. Then, the information terminal 3 displays the transmitted B-mode image on the display unit 51, as shown in FIG. 13C.

[0102] The specialist carefully searches for a flap 132 in the aortic region 130 on the B-mode image displayed on the information terminal 3, as shown in Fig. 13C, and finds it as a direct finding indicating aortic dissection. After completing the search in the aortic region 130, the specialist taps the "Local Mode" button 626.

[0103] In step S29, in response to receiving an independent display cancellation command from the information terminal 3, the ultrasound diagnostic apparatus 2 returns to step S23 and returns the display on the display unit 51 of the information terminal 3 to the state of synchronous display of the color Doppler image shown in Fig. 13B. The specialist then informs the doctor on duty that a flap has been confirmed on the B-mode image, and consults with the doctor on duty about a treatment plan for the aortic dissection, taking into account the findings of aortic regurgitation confirmed on the color Doppler image. [Example]

[0104] 14A, 14B, and 14C, an example of performing a femoral nerve block on a patient with a femur fracture using the ultrasound diagnostic imaging system 1 of the above embodiment will be described. The ultrasound diagnostic device operated by the emergency physician displays a B-mode image on which enhanced data related to the puncture needle and nerves and blood vessels is superimposed, and an instruction is given to display an independent B-mode image on which no enhanced data is superimposed on an information terminal operated by a specialist in anesthesiology at a remote location.

[0105] More specifically, the emergency physician performs a nerve block using a B-mode ultrasound image on which emphasis data of the puncture needle, emphasis data of the puncture target (femoral nerve), and emphasis data of tissues (blood vessels) that should not be punctured are superimposed, obtained from the ultrasound diagnostic device 2. This allows the emergency physician to reliably perform a femoral nerve block on a patient with a femur fracture.

[0106] An anesthesiologist using the information terminal 3 issues an independent display instruction to the ultrasound diagnostic device 2 to generate a normal B-mode image in order to evaluate whether the medicinal solution has been accurately injected around the nerve. Here, a normal B-mode image means a B-mode image in which the superimposed display of needle-enhanced, nerve-enhanced, and blood vessel-enhanced data is disabled.

[0107] The ultrasonic diagnostic device 2 transfers to the information terminal 3 only the B-mode image without superimposing the needle-enhanced, nerve-enhanced, or blood vessel-enhanced data. The specialist provides advice regarding nerve block while checking the state of injection of the medicinal liquid on the B-mode image transferred from the ultrasound diagnostic device 2 and displayed on the display unit 51 of the information terminal 3.

[0108] The ultrasound imaging diagnostic system 1 of this embodiment performs the following operations. That is, the information terminal 3 requests permission for the linkage function between the information terminal 3 and the ultrasound diagnostic device 2 as shown in the following (i) to (iii), and the ultrasound diagnostic device 2 grants permission to the information terminal 3.

[0109] (i) A function of sharing ultrasound images and camera images between the display unit 41 of the ultrasound diagnostic device 2 and the display unit 51 of the information terminal 3 by live transmitting ultrasound images from the ultrasound diagnostic device 2 to the information terminal 3 and live transmitting camera images between the ultrasound diagnostic device 2 and the information terminal 3. (ii) A function for transmitting remote control commands from the information terminal 3 to the ultrasound diagnostic device 2 (iii) A function for performing voice communication via a microphone connected to the ultrasound diagnostic device 2 and the information terminal 3.

[0110] The emergency doctor also registers information about the transported patient with a fracture in the patient database of the ultrasound diagnostic device 2, and selects B-mode as the imaging mode.

[0111] A detailed description will be given below based on the flowchart in FIG.

[0112] In step S21, the emergency doctor starts up the ultrasound diagnostic device 2 with the ultrasound probe 42 and camera 45 connected. Meanwhile, a specialist doctor starts up a PC (information terminal 3) equipped with a camera 55 and a touch-operable monitor (input unit 53 + display unit 51) from a remote hospital and remotely connects to the ultrasound diagnostic device 2.

[0113] In step S22, the emergency physician registers information about the patient in the DB, selects a preset and an imaging mode (B mode), and starts capturing ultrasound images on the ultrasound diagnostic device 2. The emergency physician also performs a pre-scan of the area around the surgical field with the functions of needle, nerve, and blood vessel emphasis enabled.

[0114] The emergency physician begins the puncture while adjusting the positions of the ultrasound probe and the puncture needle. In step S23, the ultrasound diagnostic device 2 generates a B-mode image with the enhanced data superimposed thereon as a first ultrasound image based on the ultrasound signals acquired by scanning the patient's body surface using the connected linear probe, and displays the image on the display unit 41 of the ultrasound diagnostic device 2 as shown in FIG. 14A.

[0115] As shown in FIG. 14A, enhanced data 147 of the puncture needle, nerve enhanced data 140 of the femoral nerve, artery enhanced data 141 of the femoral artery, and vein enhanced data 142 of the femoral vein are superimposed and displayed on the B-mode image.

[0116] The emergency physician can confirm the position of the needle and advance it toward the femoral nerve, which is the target of the blockage, while being careful not to puncture the femoral artery or vein. The emergency physician also injects the medication once the needle reaches the affected area.

[0117] In step S24, since remote control from the information terminal 3 is not performed in this embodiment, the processes of steps S25 and S26 are not performed, and the process proceeds to step S27.

[0118] The specialist taps the "Local Mode" button 626 and the "B" button 625 in the remote operation floating window 62. Here, the "Local Mode" button 626 is an operation button for setting an independent display instruction function. The "B" button 625 is an operation button for instructing the start / end of ultrasound imaging in B mode. To disable the puncture needle emphasis, nerve emphasis, and blood vessel emphasis functions, the specialist taps only the "B" button 625 without tapping the instruction buttons related to the various highlight displays.

[0119] As a result, in step S27, the ultrasound diagnostic imaging system 1 determines that an independent display instruction has been received, and proceeds to step S28.

[0120] In step S28, the information terminal 3 instructs the ultrasound diagnostic device 2 to generate a B-mode image, and the ultrasound diagnostic device 2 transmits a B-mode image, on which no needle-enhanced, nerve-enhanced, or blood vessel-enhanced data is superimposed, as a second ultrasound image to the information terminal 3. The information terminal 3 then displays the transmitted B-mode image on the display unit 51, as shown in FIG. 14C.

[0121] 14C, the specialist checks whether a hypoechoic region indicating the medicinal solution has spread sufficiently around the femoral nerve 144. After checking that the medicinal solution has spread, the specialist taps the "Local Mode" button 626.

[0122] In step S29, in response to receiving the command to cancel the independent display from the information terminal 3, the ultrasound diagnostic apparatus 2 returns to step S23. Then, the display on the display unit 51 of the information terminal 3 is returned to the synchronized display state of the B-mode image (first ultrasound image) on which the puncture needle enhancement, nerve enhancement, and blood vessel enhancement data are superimposed, as shown in Fig. 14B. Then, the success or failure of the femoral nerve block is notified to the emergency physician, and suggestions for improvement are made as necessary. [Example]

[0123] 15A, 15B, and 15C, an example of performing a femoral nerve block on a patient with a femur fracture using the ultrasound diagnostic imaging system 1 of the above embodiment will be described. In this example, an ultrasound diagnostic device operated by an emergency physician displays a B-mode image, and an information terminal operated by a remote anesthesiologist issues an instruction to independently display a B-mode image on which nerve-enhanced data is superimposed.

[0124] In more detail, the emergency physician first confirms the position of the femoral nerve by displaying a B-mode image on which nerve-enhancement data is superimposed on the ultrasound diagnostic device 2. Then, as shown in Figure 15A, the emergency physician performs a femoral nerve block while displaying a B-mode image on the ultrasound diagnostic device 2 without superimposed nerve-enhancement data. At this time, the information terminal 3 displays the B-mode image of Figure 15B synchronized with Figure 15A. To confirm that there are no misidentifications or missed observations in areas where there are particularly large differences from the typical nerve course, the specialist issues an independent display instruction to the ultrasound diagnostic device 2 to display the B-mode image with the nerve-enhancement function enabled.

[0125] The ultrasound diagnostic device 2 transfers the nerve-enhanced data and the B-mode image to the information terminal 3 based on an independent display instruction from the information terminal 3, and the information terminal 3 displays the B-mode image with the nerve-enhanced data superimposed on it on the display unit 51 (FIG. 15C). The specialist observes the B-mode image with the nerve-enhanced data superimposed, displayed on the display unit 51 of the information terminal 3, to confirm that there are no misrecognitions or omissions regarding the course of the nerves.

[0126] A detailed description will be given below based on the flowchart in FIG.

[0127] In step S21, the emergency doctor starts up the ultrasound diagnostic device 2 with the ultrasound probe 42 and camera 45 connected. Meanwhile, a specialist doctor starts up a PC (information terminal 3) equipped with a camera 55 and a touch-operable monitor (input unit 53 + display unit 51) from a remote hospital and remotely connects to the ultrasound diagnostic device 2.

[0128] In step S22, after the emergency physician registers information about the patient in the DB, the ultrasound diagnostic device 2 selects B-mode as the imaging mode and starts capturing ultrasound images. Then, the ultrasound diagnostic device 2 performs a pre-scan of the area near the surgical field with the nerve enhancement function enabled. After the pre-scan is completed, the ultrasound diagnostic device 2 disables the nerve enhancement function and displays only the normal B-mode image.

[0129] The emergency physician begins the puncture while adjusting the positions of the ultrasound probe and the puncture needle. In step S23, the ultrasound diagnostic device 2 generates a normal B-mode image as a first ultrasound image based on the ultrasound signals acquired by scanning the patient's body surface using the connected linear probe, and displays the image on the display unit 41 of the ultrasound diagnostic device 2, as shown in FIG. 15A.

[0130] As shown in Fig. 15A, the display unit 41 of the ultrasound diagnostic device 2 displays a puncture needle 148, a femoral nerve 144, a femoral artery 145, and a femoral vein 146 on a B-mode image. The emergency physician advances the needle toward the femoral nerve, which is the target for blocking, while checking the positions of the puncture needle and the femoral artery and vein. Then, the emergency physician injects a drug when the puncture needle reaches the affected area.

[0131] In step S24, since remote control from the information terminal 3 is not performed in this embodiment, the processes of steps S25 and S26 are not performed, and the process proceeds to step S27.

[0132] In FIG. 15B, the specialist taps the "Local Mode" button 626 and the "Nerve Enhance" button 623 in the remote operation floating window 62. Here, the "Local Mode" button 626 is an operation button for executing instructions related to independent display. The "Nerve Enhance" button 623 instructs the start / end of nerve enhancement mode. The specialist taps the "Nerve Enhance" button 623 to instruct the generation and transmission of nerve enhancement data and B-mode images.

[0133] As a result, in step S27, the ultrasound diagnostic imaging system 1 determines that an independent display instruction has been received, and proceeds to step S28.

[0134] In step S28, the ultrasound diagnostic device 2 generates a B-mode ultrasound image on which the nerve-enhanced data 140 is superimposed and transmits it to the information terminal 3, and the information terminal 3 displays the transmitted ultrasound image as a second ultrasound image on the display unit 51, as shown in FIG. 15C.

[0135] 15C, the specialist observes the nerve-enhanced data on the B-mode image at areas where the difference from the typical nerve trajectory is particularly large, and confirms that there are no misidentifications or omissions regarding the nerve trajectory. After confirmation, the specialist taps the "Local Mode" button 626 to notify the ultrasound diagnostic device 2 of an instruction to cancel the independent display.

[0136] In step S29, in response to receiving an instruction to cancel the independent display from the information terminal 3, the ultrasound diagnostic apparatus 2 returns to step S23, and the information terminal 3 returns the display on the display unit 51 to the synchronized display of the B-mode image shown in Fig. 15B. The information terminal 3 then notifies the emergency physician of the success or failure of the femoral nerve block and, if necessary, suggests a remedial measure. [Example]

[0137] 16A, 16B, 16C, and 16D, the operation when an orthopedic surgeon reports to a physical therapist about a patient's condition and treatment results using the ultrasound diagnostic imaging system 1 of the above embodiment will be described. At this time, it is assumed that the orthopedic surgeon uses the ultrasound diagnostic device 2 in the examination room, and the physical therapist uses the information terminal 3 in the rehabilitation room.

[0138] In more detail, first, the ultrasound diagnostic device 2 used by the orthopedic surgeon displays a B-mode image including the femoral nerve 144, as shown in Fig. 16A. Then, the information terminal 3 used by the physical therapist displays a B-mode image synchronized with the ultrasound image of the ultrasound diagnostic device 2 as a first ultrasound image, as shown in Fig. 16B.

[0139] Thereafter, the physical therapist presses the "Local Mode" button 626, which is an independent display instruction button, and the "Nerve Enhance" button 623, which is a nerve enhancement button, on the information terminal 3, thereby instructing the ultrasound diagnostic apparatus 2 to generate and transmit a B-mode image with nerve enhancement enabled. As shown in FIG. 16C, the ultrasound diagnostic apparatus 2 displays a normal B-mode image and a B-mode image with nerve enhancement enabled (nerve enhancement data 140) side by side on its display unit 41. Furthermore, the ultrasound diagnostic apparatus 2 generates a B-mode image with nerve enhancement enabled and transfers it to the information terminal 3, which then displays it on the display unit 51, as shown in FIG. 16D. This allows the orthopedic surgeon operating the ultrasound diagnostic apparatus 2 and the physical therapist operating the information terminal 3 to consult with each other about the patient's condition, treatment results, and rehabilitation plans while acquiring ultrasound images with display settings appropriate for their respective observation purposes and environments.

[0140] The ultrasound image diagnostic system 1 of this embodiment performs the following operations. That is, a permission request for a link function between the information terminal 3 and the ultrasound diagnostic device 2 is sent from the information terminal 3 to the ultrasound diagnostic device 2, as shown in the following (i) to (iii), and the ultrasound diagnostic device 2 grants permission to the information terminal 3.

[0141] (i) A function of sharing ultrasound images and camera images between the display unit 41 of the ultrasound diagnostic device 2 and the display unit 51 of the information terminal 3 by live transmitting ultrasound images from the ultrasound diagnostic device 2 to the information terminal 3 and live transmitting camera images between the ultrasound diagnostic device 2 and the information terminal 3. (ii) A function for transmitting remote control commands from the information terminal 3 to the ultrasound diagnostic device 2 (iii) A function for performing voice communication via a microphone connected to the ultrasound diagnostic device 2 and the information terminal 3.

[0142] The orthopedic surgeon also registers information about the patient in the patient database of the ultrasound diagnostic device 2 and selects the B-mode as the imaging mode.

[0143] A detailed explanation will be given below based on the flowchart in FIG.

[0144] In step S21, the orthopedic surgeon starts up the ultrasound diagnostic device 2 with the ultrasound probe 42 and camera 45 connected. Meanwhile, the physical therapist starts up a mobile information terminal (information terminal 3) equipped with a camera 55 and a touch-operable monitor (input unit 53 + display unit 51) from the rehabilitation room and remotely connects to the ultrasound diagnostic device 2.

[0145] In step S22, after the orthopedic surgeon registers information about the patient in the DB, the ultrasound diagnostic device 2 selects a preset and an imaging mode (B mode) and starts capturing an ultrasound image.

[0146] The orthopedic surgeon takes ultrasound images while moving the ultrasound probe 42 between the proximal and distal sides, and explains the patient's condition and treatment results (the state of the hydroreleased nerves) to the physical therapist.

[0147] In response to this, in step S23, the ultrasound diagnostic device 2 generates a B-mode image as a first ultrasound image based on the ultrasound signal from the ultrasound probe 42, and displays the ultrasound image on the display unit 41, as shown in Fig. 16A. Furthermore, the ultrasound diagnostic device 2 transmits the generated B-mode image to the information terminal 3, and the information terminal 3 displays the received B-mode image on the display unit 51 and shares it, as shown in Fig. 16B.

[0148] In step S24, since remote control from the information terminal 3 is not performed in this embodiment, the processes of steps S25 and S26 are not performed, and the process proceeds to step S27.

[0149] To confirm the area on the screen of Fig. 16B, the physical therapist taps the "Local Mode" button 626 and the "Nerve Enhance" button 623 in the remote operation floating window 62. Here, the "Local Mode" button 626 is an operation button for executing instructions regarding independent display. The "Nerve Enhance" button 623 is an operation button for instructing the start of nerve enhancement mode. That is, the physical therapist instructs the ultrasound diagnostic device 2 to generate and transmit a B-mode image with nerve emphasis enabled.

[0150] As a result, in step S27, the ultrasound diagnostic imaging system 1 determines that an independent display instruction has been received, and proceeds to step S28.

[0151] In step S28, the ultrasound diagnostic device 2 generates a B-mode image on which nerve-enhanced data 140, which has enhanced the nerve region, is superimposed, and transmits the generated B-mode image to the information terminal 3 as an ultrasound image. Then, as shown in FIG. 16D, the information terminal 3 displays the transmitted ultrasound image on the display unit 51. At this time, the ultrasound diagnostic device 2 displays a "B-mode image on which the nerve-enhanced data 140 is not superimposed" and a "B-mode image on which the nerve-enhanced data 140 is superimposed," side by side, as shown in FIG. 16C.

[0152] Furthermore, instead of displaying the images side by side, the ultrasound diagnostic device 2 may display the "B-mode image without superimposed nerve-enhanced data 140" (B-mode image displaying the femoral nerve 144) in FIG. 17 and display a message indicating that the nerve-enhanced image is being displayed on the information terminal 3. For example, it may display "Nerve-enhanced image is shown in remote device." 150. Note that the B-mode image with nerve-enhanced display disabled may also be displayed in a separate tab.

[0153] After checking the patient's condition and treatment results, the physical therapist notifies the orthopedic surgeon of a rehabilitation plan appropriate for the patient's condition and treatment results. The physical therapist then taps the "Local Mode" button 626 to issue an instruction to cancel the independent display to the ultrasound diagnostic device 2.

[0154] In step S29, in response to receiving an instruction to cancel independent display from the information terminal 3, the ultrasound diagnostic apparatus 2 returns to step S23, and the information terminal 3 returns the display on the display unit 51 to the state of synchronous display of the B-mode image in FIG. 16B.

[0155] Various embodiments and modifications have been described in detail, but the instructions regarding independent display or cancellation of independent display exemplified in the present invention may be realized by performing an operation to specify a predetermined mode or preset on the display unit of the ultrasound diagnostic device 2 or the information terminal 3.

[0156] Furthermore, the present invention is not limited to the above-described embodiments, and includes various modifications. The above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. [Explanation of symbols]

[0157] 1. Ultrasound imaging system 2. Ultrasound diagnostic equipment 21 Control section 22 Display processing section 23 Communications Department 24 Signal processing unit (image data generation unit) 3. Information terminals 31 Control Unit 32 Display processing section 33 Communications Department 41 Display section 42 Ultrasound probe (ultrasound probe) 43 Input section 51 Display section 53 Input section

Claims

1. an ultrasound diagnostic device having a display unit that displays a first ultrasound image generated based on first ultrasound image data obtained by transmitting and receiving ultrasound signals using an ultrasound probe; an information terminal having an input unit and a display unit that displays image data transmitted from the ultrasound diagnostic device; An ultrasound imaging diagnostic system in which the following are connected via a network: a synchronous display mode in which the displays of the display unit of the ultrasonic diagnostic device and the display unit of the information terminal are synchronously displayed; The first ultrasonic image is displayed on the display unit of the ultrasonic diagnostic device, and the first ultrasonic image is displayed on the display unit of the information terminal. an independent display mode in which the second ultrasound image is displayed on the display unit; An ultrasound imaging system comprising a display mode including:

2. the information terminal includes a remote control unit; When the display mode is the independent display mode, an operation input to the remote control unit is executed as an operation instruction to the information terminal, When the display mode is the synchronous display mode, an operation input to the remote control unit is transmitted from the information terminal to the ultrasonic diagnostic device and executed as an operation instruction to the ultrasonic diagnostic device. The ultrasound imaging system of claim 1 .

3. The operation transmitted from the information terminal to the ultrasonic diagnostic device when the display mode is the synchronous display mode includes any one of an operation to instruct start / stop of an imaging mode of the ultrasonic diagnostic device, an operation to instruct highlighting, a freeze operation, and a measurement operation. The ultrasound imaging system according to claim 2 .

4. When the display mode is the independent display mode, when a window displaying the independent display mode is closed, The display mode is changed from the independent display mode to the synchronous display mode. The ultrasound imaging system of claim 1 .

Images