Ultrasound diagnostic device, ultrasound diagnostic system and program

Abstract

To simplify an apparatus constitution and safely and accurately perform diagnosis and therapy.SOLUTION: An ultrasound diagnostic apparatus 100 is connected wirelessly with a portable terminal 3. The ultrasound diagnostic apparatus 100 comprises: an image data generation unit 13 which generates ultrasound image data based on a signal received from an ultrasound probe 2 for transmitting and receiving ultrasound waves to and from a subject; and a control unit 16 which wirelessly transmits the generated ultrasound image data to the portable terminal 3 to display thereon, acquires from the portable terminal 3 refresh rate information of the ultrasound image data displayed on the portable terminal 3, discriminates whether the refresh rate information is a first threshold or less, and when the refresh rate information is the first threshold, causes a display unit 15 to display notification information indicating that display of the ultrasound image data on the portable terminal 3 is faulty due to the deterioration of the state of the wireless communication.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an ultrasound diagnostic apparatus, an ultrasound diagnostic system, and a program. [Background technology]

[0002] Ultrasound diagnosis is a simple procedure in which an ultrasound probe is placed on the surface of a patient's body or inside a body cavity to obtain ultrasound images of the heart or fetus, and is highly safe and can be performed repeatedly. Ultrasound diagnostic devices used for such ultrasound diagnosis are known.

[0003] In addition, ultrasound diagnostic devices that use wireless communication for communication between components are known. However, wireless communication can cause a decrease in the real-time performance of ultrasound image display due to a decrease in communication speed, so there is a demand for improving the real-time performance of ultrasound image display.

[0004] For this reason, an ultrasound diagnostic device is known that includes an ultrasound probe as an ultrasound probe, a device main body connected to the ultrasound probe via wireless communication, and a monitor whose display is controlled by the device main body, in which the device main body monitors an index value of the wireless communication, and when the index value falls below a threshold, reduces the amount of ultrasound image data sent from the ultrasound probe to the device main body (see Patent Document 1).

[0005] Also known is an ultrasonic diagnostic device that includes a transmitting unit that has an ultrasonic probe and generates ultrasonic image data, and a receiving unit that is connected to the transmitting unit by wireless communication and receives and stores the ultrasonic image data, in which the receiving unit generates third packet data from first packet data received during an allowable reception period, instead of second packet data received during an unallowable reception period due to a transmission delay caused by the line state of wireless communication, and combines the first packet data and the third packet data to generate packet data for real-time observation (see Patent Document 2). [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-50648 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-223352 Summary of the Invention [Problem to be solved by the invention]

[0007] However, the ultrasound diagnostic device of Patent Document 1 reduces the data rate by lowering the scan line density of echo signals, which are the source of ultrasound image data, resulting in degradation of the image quality of all ultrasound image data displayed on the monitor. Furthermore, when simultaneously recording the displayed ultrasound image data, the image quality of the recorded ultrasound image data also deteriorates. When an operator, such as a doctor, diagnoses (examines) or treats a subject while observing the degraded ultrasound image displayed on the monitor, the accuracy of these procedures may be impaired. In particular, when administering medication to a subject or collecting bodily fluids using a puncture needle, if the displayed ultrasound image has poor real-time performance or poor image quality, there is a risk that the puncture needle may accidentally reach and injure tissues such as nerves, blood vessels, or lungs.

[0008] Furthermore, in the ultrasonic diagnostic device of Patent Document 2, unlike the ultrasonic diagnostic device of Patent Document 1, all ultrasonic image data is not degraded; however, it is necessary to add circuits or functions for performing processes such as temporary storage and interpolation of images to a display device that displays the wirelessly transmitted ultrasonic image data, which makes the device configuration complex.

[0009] An object of the present invention is to simplify the device configuration and to perform diagnosis and treatment safely and accurately. [Means for solving the problem]

[0010] In order to solve the above problem, the invention described in claim 1 is: An ultrasound diagnostic device wirelessly connected to a display device, an image data generating unit that generates ultrasound image data based on a reception signal received from an ultrasound probe that transmits and receives ultrasound to and from a subject; a transmission control unit that wirelessly transmits the generated ultrasound image data to the display device and displays it; an acquisition unit that acquires refresh rate information of ultrasound image data displayed on the display device from the display device; a notification control unit that determines whether the refresh rate information is equal to or less than a first threshold, and, when the refresh rate information is equal to or less than the first threshold, causes a notification unit to notify notification information that the display of the ultrasound image data on the display device is poor due to a deterioration in the state of the wireless communication. 、 When the refresh rate information is equal to or less than the first threshold, the transmission control unit detects the position of the puncture needle in the ultrasound image data, sets a region of interest corresponding to the detected position of the puncture needle, reduces the image quality of a region outside the region of interest in the ultrasound image data, and wirelessly transmits the reduced image data to the display device. .

[0011] The invention described in claim 2 is the ultrasound diagnostic device described in claim 1, The transmission control unit monitors the position of the puncture needle in the ultrasound image data, and when the position of the puncture needle cannot be detected, causes the notification unit to issue notification information indicating that the position of the puncture needle cannot be detected. Claim 3 The invention described in claim 1 is an ultrasonic diagnostic device, the acquisition unit acquires the refresh rate information even after the notification information is notified, The notification control unit determines whether the refresh rate information acquired after the notification information is notified is equal to or less than a second threshold value that is smaller than the first threshold value, and if the refresh rate information is equal to or less than the second threshold value, stops wireless transmission of the ultrasound image data to the display device.

[0016] Claim 4 The ultrasound diagnostic system of the invention described in From claim 1 3 an ultrasound diagnostic apparatus according to any one of the preceding claims; The display device wirelessly receives the ultrasound image data from the ultrasound diagnostic device and displays it, and wirelessly transmits refresh rate information of the ultrasound image data to the ultrasound diagnostic device.

[0017] Claim 5 The invention described in claim 4 In the ultrasound diagnostic system described in The display device includes: A display device main body; and a wireless communication device that is connected to the ultrasound diagnostic device by wireless communication, receives the ultrasound image data from the ultrasound diagnostic device by wireless, displays the ultrasound image data on the display device main body, and transmits refresh rate information of the ultrasound image data to the ultrasound diagnostic device.

[0018] Claim 6 The program of the invention described in A computer of an ultrasound diagnostic device wirelessly connected to a display device, an image data generating unit that generates ultrasound image data based on a reception signal received from an ultrasound probe that transmits and receives ultrasound to and from a subject; a transmission control unit that wirelessly transmits the generated ultrasound image data to the display device and displays it; an acquisition unit that acquires refresh rate information of the ultrasound image data displayed on the display device from the display device; a notification control unit that determines whether the refresh rate information is equal to or less than a first threshold, and when the refresh rate information is equal to or less than the first threshold, causes a notification unit to notify notification information that the display of the ultrasound image data on the display device is poor due to a deterioration in the state of the wireless communication; Function as 、 When the refresh rate information is equal to or less than the first threshold, the transmission control unit detects the position of the puncture needle in the ultrasound image data, sets a region of interest corresponding to the detected position of the puncture needle, reduces the image quality of a region outside the region of interest in the ultrasound image data, and wirelessly transmits the reduced image data to the display device. . [Effects of the Invention]

[0019] According to the present invention, the device configuration can be simplified and diagnosis and treatment can be performed safely and accurately. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a block diagram showing the functional configuration of an ultrasound diagnostic system according to a first embodiment of the present invention. [Figure 2] FIG. 1 is a schematic diagram showing an operator examining a subject using an ultrasound diagnostic system. [Figure 3]10 is a flowchart showing a first ultrasound image display process. [Figure 4] FIG. 10 is a block diagram showing the functional configuration of an ultrasound diagnostic system according to a first modified example. [Figure 5] FIG. 10 is a block diagram showing the functional configuration of an ultrasound diagnostic system according to a second embodiment. [Figure 6] 10 is a flowchart showing a second ultrasound image display process. [Figure 7] FIG. 10 is a block diagram showing the functional configuration of an ultrasound diagnostic system according to a second modified example. DETAILED DESCRIPTION OF THE INVENTION

[0021] A first embodiment, a first modification, a second embodiment, and a second modification of the present invention will be described in detail in this order with reference to the accompanying drawings. Note that the present invention is not limited to the illustrated examples.

[0022] (First embodiment) First, the device configuration of an ultrasound diagnostic system 1α according to the present embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the functional configuration of an ultrasound diagnostic system 1α according to the present embodiment.

[0023] An ultrasound diagnostic system 1α according to this embodiment is installed in a medical facility such as a hospital and generates and displays ultrasound image data of a subject. As shown in FIG. 1, the ultrasound diagnostic system 1α includes an ultrasound diagnostic device 100 and a mobile terminal 3. The ultrasound diagnostic device 100 includes an ultrasound diagnostic device main body 1, an ultrasound probe 2, and a puncture needle P1. The ultrasound diagnostic device 100 is a dedicated ultrasound diagnostic device that has wheels and moves on the floor of an examination room or the like, and generates and displays ultrasound image data. The mobile terminal 3 is a terminal device such as a medical tablet PC (Personal Computer) that has at least wireless communication capabilities and a screen display capability. The mobile terminal 3 is wirelessly connected to the ultrasound diagnostic device 100 and displays the ultrasound image data received from the ultrasound diagnostic device 100.

[0024] The ultrasound probe 2 transmits ultrasound waves (transmitted ultrasound waves) to a subject such as a living patient, and receives received ultrasound waves (echoes) reflected by the subject. The ultrasound diagnostic device main body 1 is connected to the ultrasound probe 2. The ultrasound diagnostic device main body 1 transmits an electrical drive signal to the ultrasound probe 2 to cause the ultrasound probe 2 to transmit transmitted ultrasound waves to the subject, and also visualizes the internal state of the subject as ultrasound image data based on a received signal, which is an electrical signal generated by the ultrasound probe 2 in response to the received ultrasound waves from within the subject and received by the ultrasound probe 2.

[0025] The ultrasound probe 2 has an ultrasound probe body, a cable, and a connector (all of which are not shown in FIG. 1). The ultrasound probe body is the header part of the ultrasound probe 2 that transmits and receives ultrasound. The cable is connected between the ultrasound probe body and the connector, and is a cable through which drive signals for the ultrasound probe body and ultrasound reception signals flow. The connector is a plug connector for connecting to a receptacle connector (not shown) of the ultrasound diagnostic device body 1.

[0026] The ultrasound diagnostic device main body 1 is connected to the ultrasound probe main body via a connector and cable of the ultrasound probe 2. The ultrasound probe main body includes a transducer made of a piezoelectric element, an acoustic lens that focuses transmitted ultrasound toward a focal point, and the like. A plurality of the transducers are arranged, for example, in a one-dimensional scanning direction. In this embodiment, an ultrasound probe 2 including, for example, 192 transducers is used. The transducers may also be arranged in a two-dimensional array. The number of transducers can be set arbitrarily. In this embodiment, for example, a convex scanning electronic scanning probe is used as the ultrasound probe 2. However, either an electronic scanning type or a mechanical scanning type may be used, and any type such as a linear scanning type, a sector scanning type, or a convex scanning type may also be used.

[0027] The puncture needle P1 is a puncture needle used to puncture a subject for administering medication, collecting bodily fluids, etc. The puncture needle P1 is intended to be used freehand by an operator such as a doctor. However, this is not limited to this, and the puncture needle P1 may be configured to be held in a puncture needle adapter attached to the ultrasound probe 2 (ultrasound probe main body). Furthermore, in this embodiment, an ultrasound diagnostic system 1α that scans a subject using the puncture needle P1 and its operation will be described, but the present invention can also be applied to a configuration that scans a subject without using the puncture needle P1, and the same applies to other embodiments and modified examples.

[0028] The ultrasound diagnostic device main body 1 includes, for example, a transmitter / receiver 11, a sound ray signal processor 12, an image data generator 13, a display controller 14, a display 15, a controller 16 serving as a transmission controller, an acquisition unit, and a notification controller, a wireless communication controller 17, a wireless communication unit 18, and an operation input unit 19. The mobile terminal 3 includes, for example, a wireless communication unit 31, a wireless communication controller 32, a controller 33, a display 34, and an operation input unit 35.

[0029] The transmitter / receiver unit 11 is a circuit that, under the control of the control unit 16, supplies a drive signal, which is an electrical signal, to the ultrasonic probe 2 to cause the ultrasonic probe 2 to generate transmitted ultrasonic waves, and receives a received signal, which is an electrical signal, from the ultrasonic probe 2.

[0030] The sound ray signal processing unit 12 is a circuit that processes the analog received signals input from the transmitting / receiving unit 11 under the control of the control unit 16 to generate and output sound ray signals (sound ray data). The sound ray signal processing unit 12 includes, for example, an amplifier, an A / D conversion circuit, and a phasing and summing circuit. The amplifier is a circuit that amplifies each individual path corresponding to each transducer at a predetermined amplification factor that is set in advance. The A / D conversion circuit is a circuit that performs analog-to-digital conversion (A / D conversion) on the amplified received signals. The phasing and summing circuit is a circuit that adjusts the time phase by providing a delay time for each individual path corresponding to each transducer to the A / D converted received signals, and adds these signals together (phasing and summing) to generate a sound ray signal.

[0031] The image data generating unit 13, under the control of the control unit 16, performs envelope detection processing, logarithmic amplification, etc. on the sound ray signals input from the sound ray signal processing unit 12, and performs gain adjustment and brightness conversion to generate B (Brightness) mode image data, which is tomographic image data as ultrasound image data. In other words, B mode image data represents the strength of the received signal by brightness. However, the image data generating unit 13 may be configured to be able to generate ultrasound image data of other image modes, in particular other tomographic image data such as color Doppler image data.

[0032] The display control unit 14 controls the display of the display unit 15 in accordance with the control of the control unit 16. The display control unit 14 performs processing such as coordinate conversion on the ultrasound image data input from the image data generation unit 13 to convert it into an image signal, and outputs the image signal to the display unit 15 to display it as an ultrasound image. Furthermore, the display control unit 14 outputs the ultrasound image data that has been subjected to processing such as coordinate conversion to the control unit 16 in accordance with the control of the control unit 16.

[0033] Display devices such as an LCD (Liquid Crystal Display) or an EL (Electronic Luminescence) display can be used as the display unit 15. The display unit 15 displays display information such as an ultrasound image on the display screen in accordance with the image signal of the ultrasound image input from the display control unit 14 and display information input from the control unit 16.

[0034] The control unit 16 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The CPU reads various processing programs, such as a system program, stored in the ROM, expands them into the RAM, and centrally controls the operation of each unit of the ultrasound diagnostic device 100 according to the expanded programs. The ROM is configured with non-volatile memory such as a semiconductor, and stores the system program corresponding to the ultrasound diagnostic device 100, various processing programs executable on the system program, and various data. These programs are stored in the form of computer-readable program code, and the CPU sequentially executes operations in accordance with the program code. The RAM forms a work area for temporarily storing various programs executed by the CPU and data related to these programs. The ROM is assumed to store a first ultrasound image display program for executing a first ultrasound image display process, which will be described later.

[0035] The wireless communication control unit 17 controls the wireless communication of the wireless communication unit 18 under the control of the control unit 16. The wireless communication unit 18 has an antenna, a modulation / demodulation unit, a signal processing unit, etc., and transmits and receives information to and from the mobile terminal 3 (its wireless communication unit 31) using the Miracast (registered trademark) wireless communication method. Miracast is a wireless communication method for display transmission technology using one-to-one wireless communication, and, for example, it is possible to wirelessly transmit screen information from a host device (ultrasound diagnostic apparatus 100 in this embodiment) to another display (mobile terminal 3 in this embodiment) and display the display screen of the host on the other display.

[0036] The operation input unit 19 is equipped with various switches, buttons, a trackball, a mouse, a keyboard, a touchpad, etc. for inputting commands to start diagnosis and data such as personal information of the subject, and outputs operation signals to the control unit 16.

[0037] The wireless communication unit 31 has an antenna, a modulation / demodulation unit, a signal processing unit, etc., and transmits and receives information to and from (the wireless communication unit 18 of) the ultrasound diagnostic device 100 using the Miracast wireless communication method. The wireless communication control unit 32 controls the wireless communication of the wireless communication unit 31 under the control of the control unit 33.

[0038] The control unit 33 includes, for example, a CPU, a ROM, and a RAM, and reads out various processing programs such as system programs stored in the ROM, expands them into the RAM, and centrally controls the operations of each unit of the mobile terminal 3 according to the expanded programs.

[0039] In particular, the control unit 33 decodes image data of the display screen, such as an ultrasound image of the ultrasound diagnostic device 100, input from the wireless communication unit 31 to generate an image signal, and outputs the generated image signal to the display unit 34 to mirror and display the same display information as the display screen of the ultrasound diagnostic device 100. The control unit 33 also detects the refresh rate of the video data displayed on the display unit 34 and controls the wireless communication unit 31 to wirelessly transmit the detected refresh rate information to the ultrasound diagnostic device 100 (wireless communication unit 18 thereof). The refresh rate is the number of times the displayed screen is refreshed per unit time, and is expressed in units of hertz (Hz), for example, as the number of refreshes per second. The refresh rate detected by the control unit 33 is the refresh rate of the video data (video streaming data) currently displaying the mirrored screen (display screen of a live ultrasound image) in real time on the mobile terminal 3.

[0040] The operation input unit 35 has a touch panel that is integrally arranged on the display screen of the display unit 34 , receives touch input from the operator, and outputs the operation information to the control unit 33 .

[0041] Next, an example of a situation in which the ultrasound diagnostic system 1α is used will be described with reference to Fig. 2. Fig. 2 is a schematic diagram showing an operator OP examining a subject SU using the ultrasound diagnostic system 1α.

[0042] As shown in Fig. 2, an examination table (bed) ET is set up in an examination room, and a subject SU, who is a patient to be diagnosed and treated, lies supine on the examination table ET. An operator OP, such as a doctor, scans a cross section with ultrasound and observes a live ultrasound image, while inserting the tip of a puncture needle P1 into a target area of ​​the subject SU to administer medication, collect body fluids, etc.

[0043] However, suppose the examination room is small and the ultrasound diagnostic device 100 cannot be moved to the back of the examination table ET. The operator OP uses the ultrasound diagnostic device 100 to scan the subject SU and the puncture needle P1, generate live ultrasound image data, and display it on the display unit 15. However, constantly looking at the display unit 15 is cumbersome, and there is a risk that the position of the puncture needle P1 cannot be accurately controlled or that the subject SU may be unnecessarily damaged by the puncture needle P1. Furthermore, the operator OP wants to move the monitor to the opposite side of the examination table ET from the operator OP's perspective, and wants the monitor to display the image as close to the observation area as possible in the small examination room.

[0044] For this purpose, an ultrasound diagnostic system 1α is used. A portable terminal 3 that can be placed at a position desired by the operator OP is used as a monitor, and the portable terminal 3 is placed on the opposite side of the examination table ET from the operator OP and near the area to be observed. The ultrasound diagnostic device 100 wirelessly transmits ultrasound image data of an ultrasound image that is the same as the live ultrasound image displayed on the display unit 15 to the portable terminal 3, and displays it on the display unit 34. The operator OP can diagnose and treat the subject SU while observing the ultrasound image of the subject SU and the puncture needle P1 displayed on the display unit 34.

[0045] However, if the refresh rate of the mobile terminal 3 decreases due to factors such as a communication failure in the wireless communication between the ultrasound diagnostic device 100 and the mobile terminal 3, the real-time nature of the live ultrasound image being displayed on the mobile terminal 3 decreases, the visibility and tracking of the tip (needle tip) of the puncture needle P1 deteriorates, and there is a risk that the puncture needle P1 may injure the subject SU more than necessary. This communication failure may be, for example, a slowdown or stoppage of wireless communication due to adverse effects of electromagnetic waves from other devices in the medical facility or radio wave interference from devices using the same wireless communication band. For this reason, in this embodiment, the operator is notified of the decrease in the real-time nature of the ultrasound image by a first ultrasound image display process described below.

[0046] Next, the first ultrasonic image display process executed by the ultrasonic diagnostic device 100 of the ultrasonic diagnostic system 1α will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the first ultrasonic image display process.

[0047] It is assumed that an operator such as a doctor is in an examination room, and a patient to be diagnosed enters the examination room and lies on an examination table, waiting for diagnosis and treatment using the ultrasound diagnostic system 1α. It is also assumed that the mobile terminal 3 is powered on. In the ultrasound diagnostic device 100, for example, upon receiving a power-on input from the operator, the control unit 16 executes a first ultrasound image display process in accordance with a first ultrasound image display program stored in the ROM.

[0048] 3, first, the control unit 16 starts to accept an operation to move the ultrasound probe 2 from the operator (step S11). In response to step S11, the operator places the ultrasound probe 2 against the subject, and the subject can be freely punctured with the puncture needle P1.

[0049] Then, the control unit 16 controls the transmitting and receiving unit 11, the sound ray signal processing unit 12, the image data generation unit 13, and the display control unit 14 to generate live ultrasound image data (moving image data (moving image streaming data)) of the subject and display it on the display unit 15, and also starts compressing and encoding the moving image data using a predetermined compression method (e.g., H.264 / H.265) (step S12).The control unit 16 then controls the wireless communication unit 18 via the wireless communication control unit 17 to start wirelessly transmitting the compressed moving image data generated in step S12 to the mobile terminal 3 using the Miracast wireless communication method (step S13).

[0050] In response to step S13, the control unit 33 of the mobile terminal 3 controls the wireless communication unit 31 via the wireless communication control unit 32 to receive the video data transmitted in step S13, decode (reconstruct) the received data, and start streaming display (live display of ultrasound images) of the decoded video data on the display unit 34. Furthermore, the control unit 33 detects the refresh rate of the decoded video data, and controls the wireless communication unit 31 to start wirelessly transmitting the detected refresh rate information to the ultrasound diagnostic device 100.

[0051] Then, the control unit 16 controls the wireless communication unit 18 via the wireless communication control unit 17 to receive the refresh rate information transmitted from the mobile terminal 3 (step S14). Then, the control unit 16 determines whether the refresh rate information received in step S14 is equal to or less than 30 [Hz], which is a preset threshold value (step S15).

[0052] If the frequency is greater than 30 [Hz] (step S15; NO), the control unit 16 continues the generation, compression, encoding, and transmission of the video data started in steps S12 and S13 (step S16), and proceeds to step S14. If the frequency is 30 [Hz] or less (step S15; YES), the control unit 16 determines that a communication failure has occurred in the wireless communication between the ultrasound diagnostic device 100 and the mobile terminal 3, which may reduce the real-time nature of the ultrasound image display on the mobile terminal 3 and hinder the operator's diagnosis or treatment, and displays a message on the display unit 15 to the effect that the wireless communication is continuing even though the ultrasound image display on the mobile terminal 3 remains poor due to the deterioration of the wireless communication state (step S17).

[0053] Then, the control unit 16 continues the generation, compression, encoding, and transmission of the video data started in steps S12 and S13, and controls the wireless communication unit 18 via the wireless communication control unit 17 to receive the refresh rate information transmitted from the mobile terminal 3 (step S18).Then, the control unit 16 determines whether the refresh rate information received in step S18 is equal to or less than 20 [Hz], which is a preset threshold (<threshold of step S15) (step S19).

[0054] If it is greater than 20 [Hz] (step S19; NO), the process proceeds to step S 18. If it is 20 [Hz] or less (step S19; YES), the control unit 16 stops the generation, compression, encoding, and transmission of the video data that started in steps S12 and S13 (step S20), and ends the first ultrasound image display process.

[0055] As described above, according to this embodiment, the ultrasound diagnostic device 100 is wirelessly connected to the mobile terminal 3. The ultrasound diagnostic device 100 includes an image data generation unit 13 that generates ultrasound image data based on a reception signal received from the ultrasound probe 2 that transmits and receives ultrasound to a subject, and a control unit 16 that wirelessly transmits the generated ultrasound image data to the mobile terminal 3 for display, acquires refresh rate information of the ultrasound image data displayed on the mobile terminal 3 from the mobile terminal 3, determines whether the refresh rate information is equal to or less than 30 [Hz] as a first threshold, and, if the refresh rate information is equal to or less than 30 [Hz], causes the display unit 15 to display a message indicating that the display of the ultrasound image data on the mobile terminal 3 is poor due to a deterioration in the state of wireless communication.

[0056] The ultrasound diagnostic system 1α includes an ultrasound diagnostic device 100 and a mobile terminal 3 that wirelessly receives ultrasound image data from the ultrasound diagnostic device 100, displays the data on a display unit 34, and wirelessly transmits refresh rate information for the ultrasound image data to the ultrasound diagnostic device 100.

[0057] Therefore, since processing such as interpolation of ultrasound image data is not performed, the device configuration can be simplified, and the operator quickly becomes aware of the deterioration of the wireless communication situation by receiving a message informing him / her that wireless communication will continue even though the display of ultrasound image data is poor. Therefore, the operator can quickly take measures to improve the communication situation, such as safely changing the position of the mobile terminal 3, reconnecting the wireless communication, switching the display destination of the ultrasound image data to a wired monitor, or referring to the display unit 15 of the ultrasound diagnostic device 100, and the operator can safely and accurately diagnose and treat the subject.

[0058] Furthermore, the control unit 16 acquires refresh rate information from the mobile terminal 3 even after displaying a message indicating that wireless communication will continue even though the display of the ultrasound image data is poor. The control unit 16 determines whether the refresh rate information acquired after displaying the message is equal to or less than 20 [Hz], which is a second threshold value that is smaller than 30 [Hz], and if the refresh rate information is equal to or less than 20 [Hz], stops wireless transmission of the ultrasound image data to the mobile terminal 3. Therefore, in cases where diagnosis or treatment is hindered (there is a possibility of misdiagnosis or incorrect treatment), the display of the ultrasound image can be safely stopped, preventing the risk of unnecessary injury to the subject by the puncture needle P1 and ensuring the safety of the subject.

[0059] (First Modification) A first modified example of the first embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the functional configuration of an ultrasound diagnostic system 1β of this modified example.

[0060] First, the device configuration of this modified example will be described with reference to Fig. 4. In this modified example, an ultrasound diagnostic system 1β is used as the device configuration instead of the ultrasound diagnostic system 1α of the first embodiment. In the ultrasound diagnostic system 1β, the same components as those in the ultrasound diagnostic system 1α are assigned the same reference numerals, and their description will be omitted, with the differences being mainly described.

[0061] 4, the ultrasound diagnostic system 1β includes an ultrasound diagnostic device 100 and a display device 400. The display device 400 includes a wireless communication device 4 and a display device main body 5. The wireless communication device 4 is a wireless communication relay device that is wired connected to the display device main body 5, and is, for example, a stick-shaped device (wireless communication slave device) that has a wireless communication function with a wireless communication destination and is wired-communication-connected to the wired communication destination.

[0062] The display device main body 5 is a monitor device having at least a screen display function and a wired communication connection function. Note that the display device main body 5 may be configured to use a portable terminal such as a tablet PC that does not have the function of generating and outputting refresh rate information like the portable terminal 3.

[0063] The wireless communication device 4 includes, for example, a wireless communication unit 41, a wireless communication control unit 42, a control unit 43, and a wired communication unit 44. The wireless communication unit 41 transmits and receives information to and from the ultrasound diagnostic device 100 (its wireless communication unit 18) using the Miracast wireless communication method, similar to the wireless communication unit 31 in Fig. 1. The wireless communication control unit 42 controls the wireless communication of the wireless communication unit 41 under the control of the control unit 43, similar to the wireless communication control unit 32 in Fig. 1.

[0064] Similar to the control unit 33 in FIG. 1, the control unit 43 includes, for example, a CPU, a ROM, and a RAM, and reads out various processing programs such as a system program stored in the ROM, expands them into the RAM, and centrally controls the operation of each part of the wireless communication device 4 in accordance with the expanded programs.

[0065] In particular, the control unit 43 decodes moving image data (moving image streaming data) of an ultrasound image (display screen) such as an ultrasound image of the ultrasound diagnostic device 100 input from the wireless communication unit 41, and outputs the generated moving image data to the display device main body 5 via the wired communication unit 44 to mirror and display the same display information as on the display screen of the ultrasound diagnostic device 100. The control unit 43 also detects the refresh rate of the moving image data to be displayed on the display device main body 5, and controls the wireless communication unit 41 to wirelessly transmit the detected refresh rate information to the ultrasound diagnostic device 100 (wireless communication unit 18 thereof).

[0066] The wired communication unit 44 is connected to the display device main body 5 as an external device by a wired communication method such as USB (Universal Serial Bus), and transmits and receives information to and from the display device main body 5.

[0067] The display device main body 5 includes a wired communication unit, a display panel, and a control unit. The control unit of the display device main body 5 displays on the display panel the moving image data of the ultrasound image received from the wireless communication device via the wired communication unit.

[0068] Next, the operation of the ultrasound diagnostic system 1β will be described. The control unit 16 of the ultrasound diagnostic device 100 executes the first ultrasound image display process shown in Fig. 3. In step S13, the control unit 16 controls the wireless communication unit 18 via the wireless communication control unit 17 to start wireless transmission of the compressed video data that began to be generated in step S12 to the wireless communication device 4 using the Miracast wireless communication method.

[0069] In response to step S13, the control unit 43 of the wireless communication device 4 controls the wireless communication unit 41 via the wireless communication control unit 42 to receive the video data transmitted in step S13, decode (reconstruct) the received data, and start transmitting the decoded video data to the display device main body 5 via the wired communication unit 44 for streaming display (live display of ultrasound images). Furthermore, the control unit 43 detects the refresh rate of the decoded video data and controls the wireless communication unit 41 to start wirelessly transmitting the detected refresh rate information to the ultrasound diagnostic device 100.

[0070] As described above, according to this modification, the display device 400 includes the display device main body 5 and the wireless communication device 4 that is wirelessly connected to the ultrasound diagnostic device 100, wirelessly receives ultrasound image data from the ultrasound diagnostic device 100, displays it on the display device main body 5, and transmits refresh rate information for the ultrasound image data to the ultrasound diagnostic device. Therefore, by communicatively connecting the wireless communication device 4 to an existing display device main body 5, ultrasound image data can be easily displayed on the display device main body 5.

[0071] (Second embodiment) A second embodiment of the present invention will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a block diagram showing the functional configuration of an ultrasound diagnostic system 1γ according to this embodiment. Fig. 5 is a block diagram showing the functional configuration of an ultrasound diagnostic system 1γ. Fig. 6 is a flowchart showing a second ultrasound image display process.

[0072] First, the device configuration of this embodiment will be described with reference to Fig. 5. In this embodiment, an ultrasound diagnostic system 1γ is used as the device configuration instead of the ultrasound diagnostic system 1α of the first embodiment. In the ultrasound diagnostic system 1γ, the same components as those in the ultrasound diagnostic system 1α are assigned the same reference numerals, and their description will be omitted, with differences being mainly described.

[0073] 5, the ultrasound diagnostic system 1γ includes an ultrasound diagnostic device 100A and a mobile terminal 3. The ultrasound diagnostic device 100A includes an ultrasound diagnostic device main body 1A, an ultrasound probe 2, and a puncture needle P1. The ultrasound diagnostic device main body 1A includes, for example, a transmitter / receiver unit 11, a sound ray signal processor 12, an image data generator 13, a display controller 14, a display unit 15, a controller 16A, a wireless communication controller 17, a wireless communication unit 18, an operation input unit 19, and a puncture needle region detector 20.

[0074] 1, and uses a CPU to centrally control the operations of the components of the ultrasound diagnostic device 100A. A second ultrasound image display program for executing a second ultrasound image display process, which will be described later, is stored in the ROM of the control unit 16A.

[0075] The puncture needle area detection unit 20, under the control of the control unit 16A, outputs the image data input from the image data generation unit 13 to the display control unit 14, and detects the puncture needle area as the position of the tip of the puncture needle P1 and its surrounding area from the ultrasound image of the input image data, and outputs position information of the detected puncture needle area in the ultrasound image to the control unit 16A via the display control unit 14.

[0076] A method for detecting (identifying) (the tip of) the puncture needle P1 from ultrasound image data includes, for example, a method described in Japanese Patent No. 6123458, in which motion evaluation information indicating an evaluation of motion is generated by calculating inter-frame differences and correlations from multiple frames of ultrasound image data, the moving speed of the tip of the puncture needle is calculated, and the position of the tip of the puncture needle is detected from the moving speed of the tip of the puncture needle and the motion evaluation information, thereby identifying the position of the puncture needle, including the tip. Alternatively, the subsequent position of the tip of the puncture needle P1 may be estimated based on the movement history of the tip of the puncture needle P1, the tip may be detected based on the estimated position, and the position of the puncture needle, including the tip, may be identified. Alternatively, contour detection may be performed, and the operator may select a contour similar to the selected contour from among the candidates obtained initially by inputting the selection result into the operation input unit 19, and the position of the puncture needle P1 may be detected based on the estimated position.

[0077] Next, the operation of the ultrasound diagnostic system 1γ will be described with reference to Fig. 6. In the ultrasound diagnostic device 100A, for example, when a power-on input is received from the operator and an ultrasound image display mode setting input is received from the operator via the operation input unit 19, the control unit 16A executes a second ultrasound image display process in accordance with a second ultrasound image display program stored in the ROM. The ultrasound image display modes include a puncture mode for ultrasound image display when the puncture needle P1 is used and a normal mode for ultrasound image display when the puncture needle P1 is not used.

[0078] As shown in Fig. 6, steps S31 to S36 are the same as steps S11 to S16 of the first ultrasound image display process in Fig. 3, respectively. If the frequency is 30 Hz or less (step S35; YES), controller 16A determines whether the currently set ultrasound image display mode is the puncture mode (step S37). If the currently set mode is the puncture mode (step S37; YES), controller 16A causes puncture needle region detector 20 to detect and acquire position information of the puncture needle region of the ultrasound image of the moving image data generated by image data generator 13, and sets a region of interest around puncture needle P1 based on the acquired position information of the puncture needle region (step S38). The region of interest is, for example, an area fixed in the center of the display screen (ultrasound image).

[0079] Then, the control unit 16A sets a resolution reduction to reduce the image quality of the ultrasound image of the generated moving image data in a region other than the region of interest set in step S38 (referred to as a region outside the region of interest) (step S39). The degree of reduction in the resolution of the region outside the region of interest in step S39 is set to a degree of reduction in resolution that reduces the data rate to half that of moving image data of an ultrasound image in which the resolution is not reduced in normal mode, for example.

[0080] Then, control unit 16A generates video data by superimposing an ultrasound image of the region of interest set in step S38 and an ultrasound image of the region outside the region of interest set in step S39, with the resolution reduced, based on the generated video data, compresses and encodes the video data using a predetermined compression method, and controls wireless communication unit 18 via wireless communication control unit 17 to start wirelessly transmitting the generated and compressed video data to mobile terminal 3 using the Miracast wireless communication method (step S40). In step S40, the display of the video data on display unit 15 started in step S32 is continued, but the present invention is not limited to this, and the display of the video data generated in step S40 by superimposing the region of interest and the region outside the region of interest on display unit 15 may be started.

[0081] Steps S41 to S43 are the same as steps S17 to S19 in Fig. 3. If the normal mode is selected (step S37; NO), the process proceeds to step S41. If the frequency is greater than 20 Hz (step S43; NO), the control unit 16A causes the puncture needle region detection unit 20 to detect the tip of the puncture needle P1 from the video data generated by the image data generation unit 13, and determines whether the position of the (tip of) the puncture needle P1 is undetectable because it is outside the ultrasound image (or region of interest) (step S44).

[0082] If the position of the puncture needle P1 is detectable (step S44; NO), the process proceeds to step S42. If the position of the puncture needle P1 is not detectable (step S44; YES), the control unit 16A displays a message on the display unit 15 indicating that the position of the puncture needle P1 is not detectable (step S45), and the process proceeds to step S42. If the frequency is 20 [Hz] or less (step S43; YES), step S46 is executed. Step S46 is the same as step S20 in FIG. 3.

[0083] Although the process is configured to proceed to step S42 after step S45 is executed, the present invention is not limited to this. For example, the process may proceed to step S46 after step S45 is executed, or may proceed to step S46 if the position of the puncture-needle P1 can be detected (step S44; NO).

[0084] As described above, according to this embodiment, when the refresh rate information is equal to or less than the first threshold value of 30 [Hz], the control unit 16A reduces the image quality of the ultrasound image data and wirelessly transmits it to the mobile terminal 3. This reduces the amount of ultrasound image data and reduces the amount of wireless communication traffic, which encourages an improvement in the refresh rate information and improves the real-time display of the ultrasound image data.

[0085] Furthermore, when the refresh rate information is 30 Hz or less, the control unit 16A reduces the image quality of the region outside the region of interest of the ultrasound image data and wirelessly transmits it to the mobile terminal 3. This reduces the amount of data only for the region outside the region of interest of the ultrasound image data and reduces the amount of wireless communication traffic, which encourages an improvement in the refresh rate information, improves the real-time performance of the display of the ultrasound image data, and ensures the image quality of only the region of interest for which real-time performance is desired.

[0086] Furthermore, when the refresh rate information is 30 Hz or less, the control unit 16A causes the puncture needle region detection unit 20 to detect the position (of the tip) of the puncture needle P1 in the ultrasound image of the ultrasound image data, sets a region of interest corresponding to the detected position of the puncture needle P1, reduces the image quality of the region outside the region of interest in the ultrasound image data, and wirelessly transmits the reduced image quality to the mobile terminal 3. This reduces the amount of data only in the region outside the region of interest other than the position of the puncture needle and its surroundings in the ultrasound image data, thereby reducing the amount of wireless communication traffic, thereby promoting an improvement in the refresh rate information and improving the real-time display of the ultrasound image data, while ensuring only the image quality of the region of interest that is the minimum required for observing the puncture needle P1 and for which real-time performance is desired.

[0087] Furthermore, the control unit 16A monitors the position of the puncture needle P1 in the ultrasound image data, and when the position of the puncture needle P1 cannot be detected, causes the display unit 16A to display a message indicating that the position of the puncture needle P1 cannot be detected. This notifies the operator that the relative positions of the ultrasound probe 2 and the puncture needle P1 have shifted and the puncture needle P1 can no longer be tracked, thereby preventing the risk of the subject being unnecessarily injured by the puncture needle P1.

[0088] (Second Modification) A second modified example of the second embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the functional configuration of an ultrasound diagnostic system 1δ of this modified example.

[0089] First, the device configuration of this modified example will be described with reference to Fig. 7. In this modified example, an ultrasound diagnostic system 1δ is used as the device configuration instead of the ultrasound diagnostic system 1γ of the second embodiment. In the ultrasound diagnostic system 1δ, the same components as those in the ultrasound diagnostic system 1γ are assigned the same reference numerals, and their description will be omitted, with the differences being mainly described.

[0090] As shown in FIG. 7, the ultrasound diagnostic system 1δ includes an ultrasound diagnostic device 100A, a wireless communication device 4, and a display device main body 5.

[0091] Next, the operation of the ultrasound diagnostic system 1δ will be described. The control unit 16A of the ultrasound diagnostic device 100A executes the second ultrasound image display process of Fig. 6. In steps S33 and S40, the control unit 16A controls the wireless communication unit 18 via the wireless communication control unit 17 to start wireless transmission of the generated, compressed, and encoded video data to the wireless communication device 4 using the Miracast wireless communication method.

[0092] In response to steps S33 and S40, the control unit 43 of the wireless communication device 4 controls the wireless communication unit 41 via the wireless communication control unit 42 to receive the video data transmitted in steps S33 and S40, decode (reconstruct) the received data, and start transmitting the decoded video data to the display device main body 5 via the wired communication unit 44 for streaming display (live display of ultrasound images). Furthermore, the control unit 43 detects the refresh rate of the decoded video data and controls the wireless communication unit 41 to start wirelessly transmitting the detected refresh rate information to the ultrasound diagnostic device 100.

[0093] As described above, according to this modification, similar to the first modification, ultrasound image data can be easily displayed on the display device main body 5 by communicatively connecting the wireless communication device 4 to the existing display device main body 5.

[0094] The above-described embodiments and modifications are merely examples of suitable ultrasound diagnostic devices, ultrasound diagnostic systems, and programs according to the present invention, and are not intended to be limiting. For example, at least two of the above-described embodiments and modifications may be appropriately combined.

[0095] In the above embodiment and modified example, in step S17 of the first ultrasound image display processing of FIG. 3 and steps S41 and S46 of the second ultrasound image display processing of FIG. 6, each message is displayed on the display unit 15 as a notification of the notification information. However, this is not limited to this. The displayed notification information may be an image such as a mark or a diagram other than a message, or a combination of messages, images, etc. Furthermore, the display destination of the notification information is not limited to the display unit 15, but may be the display unit 34 of the mobile terminal 3, the display device main body 5, or another display device other than the ultrasound diagnostic system, or may be a combination of at least two of the display unit 15, the display unit 34, the display device main body 5, and another display device. Furthermore, the notification unit for the notification information other than display may be another notification unit, such as a sound output unit such as a speaker that notifies the notification information corresponding to each message by sound or voice, a light source that notifies by a flashing or lighting pattern, or a vibration unit that notifies by a vibration pattern.

[0096] In addition, in the second embodiment, the resolution of the region outside the region of interest of the ultrasound image of the ultrasound image data is lowered to reduce the image quality, and the data amount of the ultrasound image data to be wirelessly transmitted is reduced, but this is not limited to this. For example, the image quality may be reduced to reduce the data amount of the ultrasound image data to be wirelessly transmitted by reducing the number of colors of the pixels in the region outside the region of interest (for example, by reducing the number of color gradations, or by displaying in monochrome when the ultrasound image data is color Doppler image data).

[0097] In the above embodiment and modified examples, examples have been described in which mobile terminals are used as the mobile terminal 3 and the display device 400, but the present invention is not limited to this. Other display devices, such as large-screen display devices for education in medical settings and stationary display devices, may also be used as the mobile terminal 3 and the display device 400.

[0098] Furthermore, the detailed configurations and operations of the components constituting the ultrasound diagnostic systems 1α, 1β, 1γ, and 1δ in the above embodiments can be modified as appropriate without departing from the spirit of the present invention. [Explanation of symbols]

[0099] 1α, 1β, 1γ, 1δ ultrasound diagnostic system 100,100A Ultrasound Diagnostic Equipment 1,1A Ultrasound diagnostic device main unit 11 Transmitter / Receiver 12. Sound ray signal processing section 13 Image data generation unit 14 Display control unit 15 Display section 16,16A Control unit 17 Wireless communication control unit 18 Radio Communication Department 19 Operation input section 2 Ultrasonic probe P1 puncture needle 3. Mobile devices 31 Radio Communication Department 32 Wireless communication control unit 33 Control Unit 34 Display section 35 Operation input section 400 display device 4. Wireless communication devices 41 Radio Communication Department 42 Wireless communication control unit 43 Control Unit 44 Wired Communications Department 5 Display device body

Claims

1. An ultrasound diagnostic device wirelessly connected to a display device, an image data generating unit that generates ultrasound image data based on a reception signal received from an ultrasound probe that transmits and receives ultrasound to and from a subject; a transmission control unit that wirelessly transmits the generated ultrasound image data to the display device and displays it; an acquisition unit that acquires refresh rate information of ultrasound image data displayed on the display device from the display device; a notification control unit that determines whether the refresh rate information is equal to or less than a first threshold, and when the refresh rate information is equal to or less than the first threshold, causes a notification unit to notify notification information that the display of the ultrasound image data on the display device is poor due to a deterioration in the state of the wireless communication; When the refresh rate information is equal to or less than the first threshold, the transmission control unit detects the position of the puncture needle in the ultrasound image data, sets a region of interest corresponding to the detected position of the puncture needle, reduces the image quality of the region of the ultrasound image data outside the region of interest, and wirelessly transmits the reduced image data to the display device.

2. An ultrasound diagnostic device as described in Claim 1, wherein the transmission control unit monitors the position of the puncture needle in the ultrasound image data, and when the position of the puncture needle cannot be detected, causes the notification unit to notify the user that the position of the puncture needle cannot be detected.

3. the acquisition unit acquires the refresh rate information even after the notification information is notified, 2. The ultrasound diagnostic device according to claim 1, wherein the notification control unit determines whether refresh rate information acquired after the notification information is notified is equal to or less than a second threshold value that is smaller than the first threshold value, and if the refresh rate information is equal to or less than the second threshold value, stops wireless transmission of the ultrasound image data to the display device.

4. The ultrasound diagnostic apparatus according to any one of claims 1 to 3; the display device that wirelessly receives the ultrasound image data from the ultrasound diagnostic device and displays it, and wirelessly transmits refresh rate information of the ultrasound image data to the ultrasound diagnostic device.

5. The display device includes: A display device main body; 5. The ultrasound diagnostic system according to claim 4, further comprising: a wireless communication device that is connected to the ultrasound diagnostic device by wireless communication, receives the ultrasound image data from the ultrasound diagnostic device by wireless, displays the ultrasound image data on the display device, and transmits refresh rate information of the ultrasound image data to the ultrasound diagnostic device.

6. A computer of an ultrasound diagnostic device wirelessly connected to a display device, an image data generating unit that generates ultrasound image data based on a reception signal received from an ultrasound probe that transmits and receives ultrasound to and from a subject; a transmission control unit that wirelessly transmits the generated ultrasound image data to the display device and displays it; an acquisition unit that acquires refresh rate information of the ultrasound image data displayed on the display device from the display device; a notification control unit that determines whether the refresh rate information is equal to or less than a first threshold, and when the refresh rate information is equal to or less than the first threshold, causes a notification unit to notify notification information that the display of the ultrasound image data on the display device is poor due to a deterioration in the state of the wireless communication; It functions as The transmission control unit is a program that, when the refresh rate information is equal to or less than the first threshold, detects the position of the puncture needle in the ultrasound image data, sets a region of interest corresponding to the detected position of the puncture needle, reduces the image quality of the region of the ultrasound image data outside the region of interest, and wirelessly transmits the reduced image quality to the display device.

Images