ULTRASONIC SYSTEM AND METHOD FOR CONTROLLING ULTRASONIC SYSTEM - Patent application

Abstract

To provide an ultrasonic system capable of acquiring an appropriate ultrasonic image and improving accuracy of ultrasonic diagnosis even when the ultrasonic image is captured in a remote area, and to provide a control method for the ultrasonic system.SOLUTION: An ultrasonic system (1) includes an ultrasonic probe (2), a portable information terminal (3), and an external device (4A). The portable information terminal (3) includes a camera part (33) for acquiring a visual field image, a first input device to which first information is input, a first information transmission part, and a terminal side wireless communication part (31) for wirelessly transmitting the visual field image, an ultrasonic image, and the first information. The external device (4A) includes an external monitor (45), a second input device to which second information is input, a second information transmission part, a display control part (44) for displaying the ultrasonic image and the visual field image in the external monitor (45), and an external wireless communication part (46A) for wirelessly transmitting the second information. An ultrasonic probe (2) and the portable information terminal (3) are controlled on the basis of the first information and the second information.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to an ultrasound system and a method for controlling an ultrasound system, and more particularly to an ultrasound system that displays ultrasound images on a portable information terminal and a method for controlling an ultrasound system. [Background technology]

[0002] In the medical field, ultrasonic diagnostic devices using ultrasonic images have been put to practical use. Generally, this type of ultrasonic diagnostic device has an ultrasonic probe with a built-in transducer array and a device main body connected to the ultrasonic probe. Ultrasonic waves are transmitted from the ultrasonic probe to a subject, ultrasonic echoes from the subject are received by the ultrasonic probe, and the received signals are electrically processed in the device main body to generate an ultrasonic image.

[0003] In recent years, as disclosed in Patent Document 1, for example, an ultrasound diagnostic device has been developed that aims to improve the convenience of ultrasound diagnosis by displaying ultrasound images acquired using an ultrasound probe on an external monitor located at a distance from the user and providing a mobile information terminal for input operations on the ultrasound probe and the external monitor. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-86360 Summary of the Invention [Problem to be solved by the invention]

[0005] It is generally known that in ultrasound diagnosis using an ultrasound diagnostic device such as that disclosed in Patent Document 1, a certain level of skill is required to accurately grasp the internal part of the subject depicted in the ultrasound image by checking the ultrasound image. It is also known that the image quality of the generated ultrasound image is greatly affected by the technique of the operator.

[0006] Here, for example, when ultrasound images are taken in a remote location outside a hospital, such as in home nursing, the operator who operates the ultrasound probe to take the ultrasound image may be different from the observer, such as a doctor, who observes the taken ultrasound image and makes a diagnosis. In this case, the operator usually needs to operate the ultrasound probe while checking the obtained ultrasound image himself / herself to capture an ultrasound image of the target region inside the subject, so that, particularly when the operator is less skilled, it can be difficult for the operator to determine whether the target region inside the subject is being accurately observed. Furthermore, an operator with less skill may not be able to operate the ultrasound probe using appropriate techniques, resulting in an ultrasound image of low image quality. Furthermore, the observer makes a diagnosis by checking the ultrasound image captured by the operator of the ultrasound diagnostic device, but because the observer cannot grasp how the operator captures the ultrasound image, it can be difficult to accurately determine whether the captured ultrasound image was captured using appropriate techniques, particularly when the ultrasound image is captured by an operator with less skill.

[0007] The present invention has been made to solve these conventional problems, and aims to provide an ultrasound system and a control method for an ultrasound system that can obtain appropriate ultrasound images and improve the accuracy of ultrasound diagnosis even when ultrasound images are taken in a remote location. [Means for solving the problem]

[0008] In order to achieve the above object, a first ultrasound system according to the present invention is an ultrasound system comprising an ultrasound probe, a mobile information terminal, and an external device, wherein the ultrasound probe comprises a transducer array, a transmission / reception circuit that transmits ultrasound from the transducer array and generates sound ray signals based on reception signals acquired by the transducer array, an ultrasound image generation unit that generates an ultrasound image based on the sound ray signals generated by the transmission / reception circuit, and a probe-side wireless communication unit that wirelessly transmits the ultrasound image only to the mobile information terminal, and the mobile information terminal comprises a terminal monitor, a camera unit that acquires a field-of-view image capturing an image of a scanning location of the ultrasound probe on a subject, a first input device into which first information is input by an operator of the mobile information terminal, and a communication unit that performs bidirectional wireless communication with the external device. and a terminal-side wireless communication unit that wirelessly transmits to an external device the field of view image acquired by the camera unit, the ultrasound image received from the ultrasound probe, and the first information input to the first input device, wherein the external device includes an external monitor, a second input device into which second information is input by an observer on the external monitor, a display control unit that displays the ultrasound image and the field of view image together on the external monitor, and an external wireless communication unit that performs bidirectional wireless communication with the mobile information terminal and wirelessly transmits the second information input to the second input device to the mobile information terminal, and the ultrasound probe and the mobile information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device.

[0009] The personal digital assistant includes a terminal monitor on which the ultrasound image and the field of view image can be displayed. The personal digital assistant may include an image synchronization unit that synchronizes the ultrasound image and the field of view image with each other. The external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit, and the second information can be displayed on the terminal monitor. The portable information terminal may be wearable on the head of an operator who operates the ultrasound probe and the portable information terminal.

[0010] A control method for an ultrasound system including an ultrasound probe, a portable information terminal, and an external device, the method comprising: in the ultrasound probe, transmitting ultrasound waves from a transducer array of the ultrasound probe and generating sound ray signals based on received signals acquired by the transducer array; generating an ultrasound image based on the generated sound ray signals; and wirelessly transmitting the ultrasound image to the portable information terminal; in the portable information terminal, acquiring a field of view image capturing a location of the subject scanned by the ultrasound probe; accepting input of first information by an operator of the portable information terminal; wirelessly transmitting the acquired field of view image, the ultrasound image wirelessly transmitted from the ultrasound probe, and the first information whose input was accepted to the external device; in the external device, displaying the ultrasound image and the field of view image together on an external monitor; accepting input of second information by an observer on the external monitor; and controlling the ultrasound probe and the portable information terminal based on the first information input by the operator and the second information input by the observer.

[0011] A second ultrasound system according to the present invention is an ultrasound system comprising an ultrasound probe, a mobile information terminal, and an external device, wherein the ultrasound probe comprises a transducer array, a transmission / reception circuit that transmits ultrasound from the transducer array and generates sound ray signals based on reception signals acquired by the transducer array, a reception data generation unit that generates reception data before imaging by performing signal processing on the sound ray signals generated by the transmission / reception circuit, and a probe-side wireless communication unit that wirelessly transmits the reception data only to the mobile information terminal, and the mobile information terminal comprises a terminal monitor, a camera unit that acquires a field-of-view image capturing an image of a scanning location of the ultrasound probe on a subject, a first input device into which first information is input by an operator of the mobile information terminal, and a wireless communication unit that performs bidirectional wireless communication with the external device. and a terminal-side wireless communication unit that wirelessly transmits at least the field of view image acquired by the camera unit and the first information input to the first input device to an external device, wherein the external device includes an external monitor, a second input device into which second information is input by an observer on the external monitor, a display control unit that displays the ultrasound image and the field of view image generated based on the received data together on the external monitor, and an external wireless communication unit that performs bidirectional wireless communication with the mobile information terminal and wirelessly transmits the second information input to the second input device to the mobile information terminal, and the ultrasound probe and the mobile information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device.

[0012] The external device may include an image processing unit that generates an ultrasound image based on received data wirelessly transmitted from the probe-side wireless communication unit. Alternatively, the probe-side wireless communication unit wirelessly transmits the received data to a portable information terminal, and the portable information terminal includes an image processing unit that generates an ultrasound image based on the received data wirelessly transmitted from the probe-side wireless communication unit, and the terminal-side wireless communication unit can wirelessly transmit the ultrasound image generated by the image processing unit and the field of view image acquired by the camera unit to an external device. In this case, the portable information terminal includes a terminal monitor, and the ultrasound image and the field of view image can be displayed on the terminal monitor.

[0013] The personal digital assistant may include an image synchronization unit that synchronizes the ultrasound image and the field of view image with each other. The external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit, and the second information can be displayed on the terminal monitor. The portable information terminal may be wearable on the head of an operator who operates the ultrasound probe and the portable information terminal.

[0014] A second ultrasound system control method according to the present invention is a control method for an ultrasound system including an ultrasound probe, a mobile information terminal, and an external device, wherein the ultrasound probe transmits ultrasound waves from a transducer array of the ultrasound probe and generates sound ray signals based on received signals acquired by the transducer array, performs signal processing on the generated sound ray signals to generate received data before imaging, and wirelessly transmits the received data to the mobile information terminal, the mobile information terminal acquires a field of view image capturing a location scanned by the ultrasound probe on the subject, accepts input of first information by an operator of the mobile information terminal, and wirelessly transmits at least the acquired field of view image and the accepted first information to the external device, the external device displays the ultrasound image generated based on the received data and the field of view image together on an external monitor, accepts input of second information by an observer on the external monitor, and controls the ultrasound probe and the mobile information terminal based on the first information input by the operator and the second information input by the observer. [Effects of the Invention]

[0015] According to the present invention, an ultrasonic probe includes a transducer array, a transmission / reception circuit that transmits ultrasonic waves from the transducer array and generates sound ray signals based on reception signals acquired by the transducer array, an ultrasonic image generation unit that generates an ultrasonic image based on the sound ray signals generated by the transmission / reception circuit, and a probe-side wireless communication unit that wirelessly transmits the ultrasonic image only to a mobile information terminal, and the mobile information terminal includes a terminal monitor, a camera unit that acquires a field of view image of a scanning location of the ultrasonic probe on a subject, a first input device into which first information is input by an operator of the mobile information terminal, and performs bidirectional wireless communication with an external device, and transmits the field of view image acquired by the camera unit, the ultrasonic image received from the ultrasonic probe, and the first information input to the first input device. and a terminal-side wireless communication unit that wirelessly transmits the first information to an external device, the external device including an external monitor, a second input device into which second information is input by an observer on the external monitor, a display control unit that displays an ultrasound image and a field of view image together on the external monitor, and an external wireless communication unit that performs bidirectional wireless communication with the mobile information terminal and wirelessly transmits the second information input to the second input device to the mobile information terminal, and the ultrasound probe and the mobile information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device, so that even when ultrasound images are taken in a remote location, appropriate ultrasound images can be obtained and the accuracy of ultrasound diagnosis can be improved. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a block diagram showing the configuration of an ultrasound system according to a first embodiment of the present invention. [Figure 2] 1 is a block diagram showing an internal configuration of a transmission / reception circuit according to a first embodiment of the present invention. [Figure 3] FIG. 1 is a diagram schematically illustrating an example of a mobile information terminal according to a first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram schematically illustrating an example of an external device according to the first embodiment of the present invention. [Figure 5]FIG. 10 is a diagram schematically showing an example of a cursor placed on a field of view image in a modification of the first embodiment of the present invention. [Figure 6] FIG. 10 is a block diagram showing a configuration of a portable information terminal according to another modification of the first embodiment of the present invention. [Figure 7] FIG. 10 is a block diagram showing a configuration of an external device according to another modification of the first embodiment of the present invention. [Figure 8] FIG. 10 is a block diagram showing the configuration of an ultrasound system according to a second embodiment of the present invention. [Figure 9] FIG. 10 is a block diagram showing the configuration of an ultrasound system according to a third embodiment of the present invention. [Figure 10] FIG. 10 is a block diagram showing the configuration of an ultrasound system according to a fourth embodiment of the present invention. [Figure 11] FIG. 10 is a block diagram showing the configuration of an ultrasound system according to a fifth embodiment of the present invention. [Figure 12] 13A and 13B are diagrams showing examples of an ultrasound image and a field of view image displayed on an external device in accordance with a fifth embodiment of the present invention. [Figure 13] FIG. 10 is a block diagram showing the configuration of an ultrasound system according to a sixth embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The following description of the components will be given based on a representative embodiment of the present invention, but the present invention is not limited to such an embodiment. In this specification, a numerical range expressed using "to" means a range that includes the numerical values ​​before and after "to" as the lower and upper limits. In this specification, the terms "same" and "identical" include a margin of error generally accepted in the technical field.

[0018] Embodiment 1 1 shows the configuration of an ultrasound system 1 according to a first embodiment of the present invention. The ultrasound system 1 includes an ultrasound probe 2, a mobile information terminal 3, and an external device 4. The mobile information terminal 3 and the external device 4 are connected to the ultrasound probe 2 via wireless communication, and the mobile information terminal 3 and the external device 4 are also connected to each other via wireless communication.

[0019] The ultrasound probe 2 includes a transducer array 21, which is sequentially connected to a transmission / reception circuit 22, a signal processing unit 23, and a probe-side wireless communication unit 24. The probe-side wireless communication unit 24 is connected by wireless communication to the mobile information terminal 3 and the external device 4. Although not shown, the signal processing unit 23 also forms a received data generation unit. A probe control unit 26 is connected to the transmission / reception circuit 22, the signal processing unit 23, and the probe-side wireless communication unit 24. The signal processing unit 23, the probe-side wireless communication unit 24, and the probe control unit 26 form a probe-side processor 27.

[0020] The mobile information terminal 3 includes a terminal-side wireless communication unit 31 that is connected to the ultrasound probe 2 and the external device 4 by wireless communication, and an image processing unit 32 is connected to the terminal-side wireless communication unit 31. The mobile information terminal 3 also includes a camera unit 33 that is connected to the terminal-side wireless communication unit 31. An image synchronization unit 34 is connected to the image processing unit 32 and the camera unit 33. Furthermore, a display control unit 35 and a terminal monitor 36 are sequentially connected to the image synchronization unit 34. Furthermore, a terminal control unit 37 is connected to the terminal-side wireless communication unit 31, image processing unit 32, camera unit 33, image synchronization unit 34, and display control unit 35. Furthermore, an input device 38 is connected to the terminal control unit 37. Furthermore, the terminal-side wireless communication unit 31, image processing unit 32, image synchronization unit 34, display control unit 35, and terminal control unit 37 form a terminal-side processor 39.

[0021] The external device 4 includes an external wireless communication unit 41 that is connected to the ultrasound probe 2 and the mobile information terminal 3 by wireless communication, and an image processing unit 42 and an image synchronization unit 43 are connected to the external wireless communication unit 41. The image processing unit 42 is also connected to the image synchronization unit 43. A display control unit 44 and an external monitor 45 are also connected to the image synchronization unit 43 in this order. An external control unit 46 is connected to the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, and the display control unit 44. An input device 47 is connected to the external control unit 46. An external device-side processor 48 is configured by the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, the display control unit 44, and the external control unit 46.

[0022] The transducer array 21 of the ultrasonic probe 2 has a plurality of transducers arranged one-dimensionally or two-dimensionally. These transducers transmit ultrasonic waves in accordance with drive signals supplied from the transmission / reception circuit 22, receive ultrasonic echoes from the subject, and output reception signals based on the ultrasonic echoes. Each transducer is configured by forming electrodes on both ends of a piezoelectric element made of, for example, a piezoelectric ceramic typified by PZT (Lead Zirconate Titanate), a polymer piezoelectric element typified by PVDF (Poly Vinylidene Di Fluoride), or a piezoelectric single crystal typified by PMN-PT (Lead Magnesium Niobate-Lead Titanate).

[0023] The transmission / reception circuit 22, under the control of the probe control unit 26, transmits ultrasonic waves from the transducer array 21 and generates sound ray signals based on reception signals acquired by the transducer array 21. As shown in Fig. 2, the transmission / reception circuit 22 has a pulser 51 connected to the transducer array 21, and an amplifier unit 52, an AD (Analog-to-Digital) converter unit 53, and a beamformer 54, which are connected in series from the transducer array 21 in this order.

[0024] The pulser 51 includes, for example, a plurality of pulse generators, and adjusts the delay amount of each drive signal and supplies it to the plurality of transducers of the transducer array 21 so that the ultrasound waves transmitted from the plurality of transducers form an ultrasound beam based on a transmission delay pattern selected in response to a control signal from the probe control unit 26. In this way, when a pulsed or continuous wave voltage is applied to the electrodes of the transducers of the transducer array 21, the piezoelectric material expands and contracts, and each transducer generates a pulsed or continuous wave ultrasound wave, and an ultrasound beam is formed from the composite wave of these ultrasound waves.

[0025] The transmitted ultrasonic beam is reflected by an object such as a part of the subject, and propagates toward the transducer array 21 of the ultrasonic probe 2. When the ultrasonic echo propagates toward the transducer array 21 in this way, each transducer constituting the transducer array 21 receives the propagating ultrasonic echo and expands and contracts to generate received signals, which are electrical signals, and outputs these received signals to the amplifier 52.

[0026] The amplifier 52 amplifies signals input from each transducer constituting the transducer array 21 and transmits the amplified signals to the AD converter 53. The AD converter 53 converts the signals transmitted from the amplifier 52 into digital reception data and transmits the reception data to the beamformer 54. The beamformer 54 performs so-called reception focusing processing by adding each piece of reception data converted by the AD converter 53 with a respective delay in accordance with the speed of sound or a distribution of sound speeds that is set based on the reception delay pattern selected in response to a control signal from the probe control unit 26. This reception focusing processing causes the reception data converted by the AD converter 53 to be phased and added, and a sound ray signal in which the focus of the ultrasonic echo is narrowed is acquired.

[0027] The signal processing unit 23 generates reception data before imaging by performing signal processing on the sound ray signals generated by the beam former 54 of the transmission / reception circuit 22. More specifically, the signal processing unit 23 performs correction for attenuation caused by the propagation distance in accordance with the depth of the position where the ultrasonic waves are reflected on the sound ray signals generated by the beam former 54 of the transmission / reception circuit 22, and then performs envelope detection processing on the sound ray signals to generate signals representing tomographic image information regarding tissues in the subject as reception data before imaging.

[0028] The probe-side wireless communication unit 24 includes an antenna for transmitting and receiving radio waves, and generates a transmission signal representing the pre-imaging received data by modulating a carrier based on the pre-imaging received data generated by the signal processing unit 23. The probe-side wireless communication unit 24 supplies the thus generated transmission signal to an antenna and transmits radio waves from the antenna, thereby wirelessly transmitting the pre-imaging received data sequentially to the terminal-side wireless communication unit 31 of the mobile information terminal 3 and the external wireless communication unit 41 of the external device 4. The carrier modulation method used may be ASK (Amplitude Shift Keying), PSK (Phase Shift Keying), QPSK (Quadrature Phase Shift Keying), 16QAM (16 Quadrature Amplitude Modulation), or the like.

[0029] In addition, wireless communication between the probe side wireless communication unit 24 of the ultrasonic probe 2, the terminal side wireless communication unit 31 of the mobile information terminal 3, and the external wireless communication unit 41 of the external device 4 can be performed in accordance with communication standards for mobile communication such as 5G (5th Generation: 5th generation mobile communication system) and 4G (4th Generation: 4th generation mobile communication system), and communication standards for short-range wireless communication such as WiFi (registered trademark), Bluetooth (registered trademark), and UWB (Ultra Wide Band: ultra wideband wireless system).

[0030] Since the ultrasonic probe 2 and the mobile information terminal 3 are expected to be located in close proximity to each other, either mobile communication or short-range wireless communication can be adopted for wireless communication between the ultrasonic probe 2 and the mobile information terminal 3. Furthermore, since the external device 4 is expected to be located in a remote location relative to the ultrasonic probe 2 and the mobile information terminal 3, it is preferable that mobile communication be used for the wireless communication between the external device 4 and the ultrasonic probe 2 and the wireless communication between the external device 4 and the mobile information terminal 3. In particular, from the viewpoint of reducing the time lag in data transmission between the external device 4 and the ultrasonic probe 2 and the mobile information terminal 3, it is preferable that mobile communication conforming to 5G be used for the wireless communication between the external device 4 and the ultrasonic probe 2 and the wireless communication between the external device 4 and the mobile information terminal 3.

[0031] The probe control unit 26 controls each part of the ultrasonic probe 2 based on a control program stored in advance. Although not shown, a probe-side storage unit is connected to the probe control unit 26. The probe-side storage unit stores a control program for the ultrasonic probe 2. As the probe-side storage unit, for example, a flash memory, a RAM (Random Access Memory), an SD card (Secure Digital card), an SSD (Solid State Drive), etc. can be used. Although not shown, the ultrasonic probe 2 has a built-in battery, and power is supplied to each circuit of the ultrasonic probe 2 from this battery.

[0032] The probe-side processor 27, which has the signal processing unit 23, the probe-side wireless communication unit 24, and the probe control unit 26, is composed of a CPU (Central Processing Unit) and a control program for causing the CPU to perform various processes, but may also be composed of an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a GPU (Graphics Processing Unit), or other ICs (Integrated Circuits), or may be composed of a combination of these.

[0033] Furthermore, the signal processing unit 23, the probe wireless communication unit 24, and the probe control unit 26 of the probe processor 27 can be configured as being partially or entirely integrated into a single CPU or the like.

[0034] The terminal-side wireless communication unit 31 of the mobile information terminal 3 includes an antenna for transmitting and receiving radio waves, and receives, under the control of the terminal control unit 37, a transmission signal representing the received data before imaging transmitted by the probe-side wireless communication unit 24 of the ultrasound probe 2 via the antenna, and outputs the received data before imaging by demodulating the received transmission signal. Furthermore, the terminal-side wireless communication unit 31 sends the received data before imaging to the image processing unit 32.

[0035] The image processing unit 32 raster-converts the received data before imaging sent from the terminal-side wireless communication unit 31 into an image signal that conforms to the scanning method of a normal television signal, and generates a B-mode (Brightness mode) image signal by performing various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, in accordance with the display format for the terminal monitor 36. The B-mode image signal generated in this manner is simply referred to as an ultrasound image U. The image processing unit 32 also sends the generated ultrasound image U to the image synchronization unit 34.

[0036] The camera unit 33 acquires a field of view image C by capturing an image of the area scanned by the ultrasound probe 2 on the subject. Although not shown, the camera unit 33 incorporates a photographing lens, an image sensor that captures an image of the area scanned by the ultrasound probe 2 through the photographing lens and acquires an analog field of view image signal, an analog signal processing circuit that amplifies the field of view image signal acquired by the image sensor and converts it into a digital signal, and a digital signal processing circuit that performs various corrections, such as gain, on the converted digital signal to generate the field of view image C. The analog signal processing circuit and the digital signal processing circuit may also be incorporated in the terminal processor 39. The camera unit 33 transmits the generated field of view image C to the terminal wireless communication unit 31 and the image synchronization unit 34. The field of view image C transmitted to the terminal wireless communication unit 31 is then wirelessly transmitted to the external device 4 by the terminal wireless communication unit 31.

[0037] The image synchronization unit 34 synchronizes the ultrasound image U generated by the image processing unit 32 with the field of view image C generated by the camera unit 33, and generates a composite image M based on the synchronized ultrasound image U and field of view image C. Here, synchronizing the ultrasound image U and field of view image C means associating the ultrasound image U and field of view image C, which were captured at the same time, with each other. For example, if the image processing unit 32 assigns a timestamp indicating the time when the ultrasound image U was generated to the ultrasound image U, and the camera unit 33 assigns a timestamp indicating the time when the field of view image C was generated to the field of view image C, the image synchronization unit 34 regards the timestamp of the ultrasound image U as indicating the time when the ultrasound image U was captured, and regards the timestamp of the field of view image C as indicating the time when the field of view image C was captured, and can synchronize the ultrasound image U and field of view image C, which were captured at the same time, with each other by referring to the timestamps of the ultrasound image U and the field of view image C.

[0038] Furthermore, when associating the ultrasound image U with the field of view image C, the image synchronization unit 34 can, for example, refer to the timestamp of the ultrasound image U and the timestamp of the field of view image C, and if the difference between the time when the ultrasound image U was captured and the time when the field of view image C was captured is within a certain range, for example, within 0.1 seconds, consider the ultrasound image U and the field of view image C to have been captured at the same time, and perform the association. Furthermore, the image synchronization unit 34 can, for example, refer to the timestamp of the ultrasound image U and the timestamp of the field of view image C, and select the field of view image C that was captured at the time closest to the time when the ultrasound image U to be associated was captured, and associate the selected ultrasound image U with the field of view image C. Furthermore, the image synchronization unit 34 can, for example, select the ultrasound image U that was captured at the time closest to the time when the field of view image C to be associated was captured, and associate the selected ultrasound image U with the field of view image C. The image synchronization unit 34 sends the thus synchronized ultrasound image U and field of view image C to the display control unit 35.

[0039] Under the control of the terminal control unit 37, the display control unit 35 performs predetermined processing on the composite image M sent from the image synchronization unit 34, and displays the synchronized ultrasound image U and field of view image C together on the terminal monitor 36 of the mobile information terminal 3, as shown in Figure 3. The terminal monitor 36 displays the ultrasound image U and the field of view image C under the control of the display control unit 35, and includes a display device such as an LCD (Liquid Crystal Display) or an organic EL display (Organic Electroluminescence Display).

[0040] The input device 38 of the mobile information terminal 3 is used by the operator to perform input operations, and includes a touch sensor placed on top of the terminal monitor 36. For example, the operator can input probe control information for controlling the ultrasound probe 2 via the input device 38. The probe control information input in this manner is sent to the terminal-side wireless communication unit 31 via the terminal control unit 37, and then wirelessly transmitted from the terminal-side wireless communication unit 31 to the ultrasound probe 2.

[0041] The terminal control unit 37 controls each unit of the mobile information terminal 3 based on a control program stored in advance. Although not shown, a terminal-side storage unit is connected to the terminal control unit 37. The terminal-side storage unit stores the control program and the like of the mobile information terminal 3. The terminal-side storage unit may be, for example, a flash memory, a RAM, an SD card, an SSD, or the like. Although not shown, the portable information terminal 3 has a built-in battery, and power is supplied to each circuit of the portable information terminal 3 from this battery.

[0042] The terminal side processor 39 having the terminal side wireless communication unit 31, image processing unit 32, image synchronization unit 34, display control unit 35 and terminal control unit 37 is composed of a CPU and a control program for causing the CPU to perform various processes, but may also be composed using an FPGA, DSP, ASIC, GPU or other IC, or a combination of these. In addition, the terminal side wireless communication unit 31, image processing unit 32, image synchronization unit 34, display control unit 35 and terminal control unit 37 of the terminal side processor 39 can be partially or entirely integrated into a single CPU or the like.

[0043] The external wireless communication unit 41 of the external device 4 includes an antenna for transmitting and receiving radio waves, and under the control of the external control unit 46, receives, via the antenna, a transmission signal representing the received data before imaging transmitted by the probe-side wireless communication unit 24 of the ultrasound probe 2 and a transmission signal representing the field of view image C transmitted by the terminal-side wireless communication unit 31 of the mobile information terminal 3, and demodulates the received transmission signal to output the received data before imaging and the field of view image C. Furthermore, the external wireless communication unit 41 sends the received data before imaging to the image processing unit 42 and sends the field of view image C to the image synchronization unit 43.

[0044] The image processing unit 42 raster-converts the received data before imaging sent from the external wireless communication unit 41 into an image signal that conforms to the scanning method of a normal television signal, and performs various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, in accordance with the display format for the external monitor 45, to generate an ultrasound image U. The image processing unit 42 sends the generated ultrasound image U to the image synchronization unit 43.

[0045] The image synchronization unit 43 of the external device 4 synchronizes the ultrasound image U sent from the image processing unit 42 with the field of view image C sent from the external wireless communication unit 41, and generates a composite image M based on the synchronized ultrasound image U and field of view image C. For example, when the image processing unit 42 of the external device 4 assigns a timestamp representing the time when the ultrasound image U was generated to the ultrasound image U, and the camera unit 33 of the mobile information terminal 3 assigns a timestamp representing the time when the field of view image C was generated to the field of view image C, the image synchronization unit 43 regards the timestamp of the ultrasound image U as representing the time when the ultrasound image U was captured, and regards the timestamp of the field of view image C as representing the time when the field of view image C was captured, and by referring to the timestamps of the ultrasound image U and the field of view image C, it is possible to synchronize the ultrasound image U and the field of view image C, which were captured at the same time, with each other.

[0046] Under the control of the external control unit 46, the display control unit 44 performs predetermined processing on the composite image M sent from the image synchronization unit 43, and displays the synchronized ultrasound image U and field of view image C together on the external monitor 45 of the external device 4, as shown in Figure 4. The external monitor 45 displays the ultrasound image U, the field of view image C, and the like under the control of the display control unit 44, and includes a display device such as an LCD or an organic EL display. The input device 47 of the external device 4 is used by the operator to perform input operations, and includes a touch sensor arranged over the external monitor 45 .

[0047] The external control unit 46 controls each part of the external device 4 based on a control program stored in advance. Although not shown, an external device-side storage unit is connected to the external device 4. The external device-side storage unit stores the control program and the like of the external device 4. The external device-side storage unit may be, for example, a flash memory, RAM, an SD card, an SSD, or the like. Although not shown, the external device 4 has a built-in battery, and power is supplied to each circuit of the external device 4 from this battery.

[0048] The external device side processor 48 having the external wireless communication unit 41, image processing unit 42, image synchronization unit 43, display control unit 44 and external control unit 46 is composed of a CPU and a control program for causing the CPU to perform various processes, but may also be composed using an FPGA, DSP, ASIC, GPU or other IC, or a combination of these. In addition, the external wireless communication unit 41, image processing unit 42, image synchronization unit 43, display control unit 44 and external control unit 46 of the external device side processor 48 can be partially or entirely integrated into a single CPU or the like.

[0049] Next, the operation of the ultrasound system 1 according to the first embodiment of the present invention will be described. First, the operator brings the ultrasonic probe 2 into contact with the body surface of the subject, and under the control of the probe control unit 26, ultrasonic beams are transmitted into the subject from the multiple transducers of the transducer array 21 in accordance with a drive signal from the pulser 51 of the transmission / reception circuit 22. Ultrasonic echoes based on the transmitted ultrasonic beams are received by each transducer, and the received signals, which are analog signals, are output to and amplified by the amplifier unit 52 and then AD converted by the AD conversion unit 53 to obtain received data. A beamformer 54 performs reception focusing processing on this received data, generating sound ray signals.

[0050] The generated sound ray signals are converted into pre-imaging reception data, which are signals representing tomographic image information relating to tissues within the subject, by the signal processing unit 23. At this time, the signal processing unit 23 performs envelope detection processing on the sound ray signals after correcting for attenuation caused by the propagation distance in accordance with the depth of the position where the ultrasonic waves are reflected. The probe-side wireless communication unit 24 wirelessly transmits the generated sound ray signal to the mobile information terminal 3 and the external device 4.

[0051] The terminal-side wireless communication unit 31 of the mobile information terminal 3 receives the pre-imaging reception data wirelessly transmitted from the ultrasound probe 2 and sends the received pre-imaging reception data to the image processing unit 32. The image processing unit 32 raster-converts the pre-imaging reception data sent from the terminal-side wireless communication unit 31 into an image signal conforming to a normal television signal scanning method, and performs various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, in accordance with the display format for the terminal monitor 36, to generate an ultrasound image U. The ultrasound image U generated in this manner is sent to the image synchronization unit 34.

[0052] Furthermore, under the control of the terminal control unit 37, the camera unit 33 of the mobile information terminal 3 acquires a field of view image C obtained by capturing an image of the scanning location of the ultrasound probe 2 on the subject. Although not shown, at this time, for example, an operator can input control information to capture the field of view image C via the input device 38 of the mobile information terminal 3 while pointing the photographing lens of the camera unit 33 toward the scanning location of the ultrasound probe 2 on the subject. In this case, for example, the control information input by the operator is input to the terminal control unit 37, and the terminal control unit 37 can control the camera unit 33 to capture the field of view image C in accordance with the control information. The field of view image C acquired in this manner is sent to the terminal-side wireless communication unit 31 and the image synchronization unit 34.

[0053] When the image synchronization unit 34 receives the ultrasound image U from the image processing unit 32 and the field of view image C from the camera unit 33, it synchronizes the received ultrasound image U and field of view image C with each other to generate a composite image M in which the synchronized ultrasound image U and field of view image C are combined. For example, if the image processing unit 32 assigns a timestamp indicating the time when the ultrasound image U was generated to the ultrasound image U, and the camera unit 33 assigns a timestamp indicating the time when the field of view image C was generated to the field of view image C, the image synchronization unit 34 regards the timestamp of the ultrasound image U as indicating the time when the ultrasound image U was captured, and regards the timestamp of the field of view image C as indicating the time when the field of view image C was captured, and by referring to the timestamps of the ultrasound image U and the field of view image C, it is possible to associate the ultrasound image U and the field of view image C, which were captured at the same time, with each other.

[0054] The ultrasound image U and the field of view image C, which have been synchronized with each other by the image synchronization unit 34, are sent to the display control unit 35 as a composite image M. The display control unit 35 performs predetermined processing on the composite image M and then sends the composite image M to the terminal monitor 36, causing the terminal monitor 36 to display the ultrasound image U and the field of view image C together, as shown in FIG. 3. In the example shown in FIG. 3, the field of view image C and the ultrasound image U are displayed at the top and bottom of the terminal monitor 36, respectively. In this example, the field of view image C depicts the ultrasound probe 2 in contact with the abdomen of the subject, and the ultrasound image U depicts the internal tissue of the subject's abdomen. Therefore, by checking the terminal monitor 36 of the mobile information terminal 3, the operator can simultaneously view the field of view image C, which represents the scanning location of the ultrasound probe 2 on the subject, and the ultrasound image U corresponding to the field of view image C, and can easily associate and grasp the scanning location of the ultrasound probe 2 on the subject with the tissue within the subject observed thereby.

[0055] Furthermore, the visual field image C acquired by the camera unit 33 is wirelessly transmitted from the terminal side wireless communication unit 31 to the external device 4. The external wireless communication unit 41 of the external device 4 receives the pre-imaging received data wirelessly transmitted from the ultrasound probe 2 and the field of view image C wirelessly transmitted from the mobile information terminal 3, sends the received pre-imaging received data to the image processing unit 42, and sends the received field of view image C to the image synchronization unit 43.

[0056] The image processing unit 42 raster-converts the received data before imaging sent from the external wireless communication unit 41 into an image signal that conforms to the scanning method of a normal television signal, and performs various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, in accordance with the display format for the external monitor 45, to generate an ultrasound image U. The image processing unit 42 sends the generated ultrasound image U to the image synchronization unit 43.

[0057] The image synchronization unit 43 synchronizes the ultrasound image U sent from the image processing unit 42 with the field of view image C sent from the external wireless communication unit 41 to generate a composite image M in which the synchronized ultrasound image U and field of view image C are combined. For example, if the image processing unit 42 of the external device 4 assigns a timestamp to the ultrasound image U indicating the time when the ultrasound image U was generated, and the camera unit 33 of the mobile information terminal 3 assigns a timestamp to the field of view image C indicating the time when the field of view image C was generated, the image synchronization unit 43 regards the timestamp of the ultrasound image U as indicating the time when the ultrasound image U was captured, and regards the timestamp of the field of view image C as indicating the time when the field of view image C was captured, and by referring to the timestamps of the ultrasound image U and the field of view image C, the ultrasound image U and the field of view image C, which were captured at the same time, can be synchronized with each other. At this time, the time on the mobile information terminal 3 and the time on the external device 4 can be shared with each other.

[0058] The time on the mobile information terminal 3 and the time on the external device 4 can be shared with each other, and specifically, for example, the time can be shared based on either the mobile information terminal 3 or the external device 4. Furthermore, for example, if either the mobile information terminal 3 or the external device 4 is connected to the Internet, the time of the built-in clock may be set using a communication protocol such as NTP (Network Time Protocol) or NITZ (Network Identity and Time Zone).

[0059] The ultrasound image U and the field of view image C, which have been synchronized with each other by the image synchronization unit 43, are sent to the display control unit 44 as a composite image M. The display control unit 44 performs predetermined processing on the composite image M, and then sends the composite image M to the external monitor 45, where the ultrasound image U and the field of view image C are displayed together on the external monitor 45, as shown in FIG. 4. In the example of FIG. 4, the external device 4 is shown to be a portable terminal similar to the mobile information terminal 3, and the field of view image C and the ultrasound image U are displayed above and below the terminal monitor 36 of the external device 4. In this example, similar to the ultrasound image U and the field of view image C displayed on the terminal monitor 36 of the mobile information terminal 3, the field of view image C depicts the ultrasound probe 2 being in contact with the abdomen of the subject, and the ultrasound image U depicts the internal tissues of the subject's abdomen.

[0060] Here, the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4 respectively display a field of view image C and an ultrasound image U that are synchronized with each other, but the same field of view image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, even if the external device 4 is located in a remote location relative to the mobile information terminal 3, an observer viewing the external monitor 45 can observe the field of view image C and ultrasound image U captured at the examination site where the subject and operator are located in almost real time.

[0061] It is generally known that a certain level of skill is required to accurately identify the internal location of a subject depicted in an ultrasound image by checking the ultrasound image, and that the image quality of an ultrasound image generated by an ultrasound diagnostic device is significantly affected by the operator's technique.

[0062] For example, when ultrasound images are taken in a remote location outside a hospital, such as in home nursing, the operator who operates the ultrasound probe to take the ultrasound image may be different from the observer, such as a doctor, who observes the taken ultrasound image and makes a diagnosis. In this case, the operator usually needs to operate the ultrasound probe while personally checking the obtained ultrasound image to take an ultrasound image of the target region inside the subject. Therefore, particularly when the operator is not skilled, it can be difficult for the operator to determine whether the target region inside the subject is accurately observed. Furthermore, an operator with low skill may not be able to operate the ultrasound probe using appropriate techniques, resulting in ultrasound images of low quality.

[0063] Furthermore, an observer located remotely from the subject and the operator makes a diagnosis by checking the ultrasound images captured by the operator of the ultrasound diagnostic device. However, since the observer cannot see how the operator captures the ultrasound images, it can be difficult to accurately determine whether the ultrasound images were captured using appropriate techniques, particularly when the ultrasound images are captured by an operator with low skill levels.

[0064] According to ultrasound system 1 according to embodiment 1 of the present invention, the same field of view image C and ultrasound image U are displayed almost simultaneously on terminal monitor 36 and external monitor 45, so that, for example, even if external device 4 is located remotely from mobile information terminal 3, an observer watching external monitor 45 can observe, in almost real time, the field of view image C and ultrasound image U captured at the examination site where the subject and operator are located. This allows, for example, a highly skilled observer to give advice to the operator in real time, so that even if an operator located remotely from the observer has low skill, an appropriate ultrasound image U can be obtained and the accuracy of ultrasound diagnosis can be improved.

[0065] Furthermore, with the ultrasound system 1 according to the first embodiment of the present invention, for example, it is possible to allow a less skilled observer located remotely from the operator to confirm a field of view image C showing how a highly skilled operator operates the ultrasound probe 2, and an appropriate ultrasound image U corresponding to the field of view image C. In this way, the ultrasound system 1 according to the first embodiment of the present invention is also very useful from the viewpoint of education.

[0066] Although it has been described that the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4 each assign a timestamp to the generated ultrasound image U, instead of the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4 assigning a timestamp to the ultrasound image U, the signal processing unit 23 of the ultrasound probe 2 can assign a timestamp to the signal that has been subjected to envelope detection processing. In this case, for example, by sharing the time in the ultrasound probe 2 and the time in the mobile information terminal 3 with each other, the ultrasound image U generated by the image processing unit 32 of the mobile information terminal 3 and the field of view image C generated by the camera unit 33 based on the time-stamped signal can be synchronized with each other, and the ultrasound image U generated by the image processing unit 42 of the external device 4 and the field of view image C generated by the camera unit 33 can be synchronized with each other.

[0067] Here, the time on the ultrasonic probe 2 and the time on the mobile information terminal 3 can be shared, for example, based on either the ultrasonic probe 2 or the mobile information terminal 3. Furthermore, for example, if either the ultrasonic probe 2 or the mobile information terminal 3 is connected to the Internet, the time on the built-in clock may be set using a communication protocol such as NTP or NITZ.

[0068] Furthermore, the method of synchronizing the ultrasound image U and the field of view image C with each other is not limited to the method using the timestamp described above. For example, as disclosed in Japanese Patent Application Laid-Open No. 2011-183056, if the timing of capturing the ultrasound image U by the ultrasound probe 2 is synchronized with the timing of capturing the field of view image C by the camera unit 33 of the mobile information terminal 3, and if the time difference between the time when the ultrasound image U was captured and the time when the field of view image C was captured is within a certain range, for example, within 0.1 seconds, the image synchronization unit 34 of the mobile information terminal 3 and the image synchronization unit 43 of the external device 4 can regard the ultrasound image U and the field of view image C as having been captured at the same time, and synchronize the ultrasound image U and the field of view image C with each other.

[0069] Furthermore, the image synchronization unit 34 of the mobile information terminal 3 generates a composite image M in which the synchronized ultrasound image U and the field of view image C are combined into one and sends the generated composite image M to the display control unit 35. However, instead of generating the composite image M, the synchronized ultrasound image U and the field of view image C can be sent to the display control unit 35, respectively. In this case, the display control unit 35 performs predetermined processing on the ultrasound image U and the field of view image C sent from the image synchronization unit 34, and displays the synchronized ultrasound image U and the field of view image C together on the terminal monitor 36, as shown in Fig. 3. This allows the operator to simultaneously check the position of the ultrasound probe 2 and the corresponding state of the tissue inside the subject.

[0070] Similarly, the image synchronization unit 43 of the external device 4 can also send the ultrasound image U and the field of view image C, which are synchronized with each other, to the display control unit 44 instead of generating the composite image M. In this case, the ultrasound image U and the field of view image C, which are synchronized with each other, are simultaneously displayed on the external monitor 45, so that the observer looking at the external monitor 45 can observe the field of view image C and the ultrasound image U, which were taken at the examination site where the subject and the operator are located, in almost real time.

[0071] Furthermore, although the ultrasonic probe 2 and the mobile information terminal 3 are connected to each other by wireless communication, they may also be connected to each other by wired communication instead of wireless communication, for example. 4, the external device 4 is illustrated as a portable thin computer known as a smartphone or tablet, similar to the mobile information terminal 3, but the external device 4 is not limited to this. For example, the external device 4 may also be a so-called notebook personal computer or a desktop personal computer.

[0072] Furthermore, although not shown, a second external device having a monitor can be installed near the site where the operator is examining the subject, and the second external device can be connected to the ultrasonic probe 2 and the mobile information terminal 3, and the ultrasonic image U and the field of view image C can be displayed on the monitor of the second external device. In particular, if the second external device has a large monitor, the operator can more clearly confirm the ultrasonic image U and the field of view image C, and can more clearly associate and grasp the scanning location of the ultrasonic probe 2 on the subject with the tissue in the subject being observed.

[0073] Although FIG. 3 illustrates the portable information terminal 3 as a portable, thin computer known as a smartphone or tablet, the portable information terminal 3 is not limited to this. For example, a terminal device that can be worn on the operator's head can also be used as the portable information terminal 3. In such a terminal device, for example, a terminal monitor 36 is positioned facing the operator's eyes when worn on the head, and a camera unit 33 captures a field of view image C representing the operator's forward field of view. Instead of directly checking the forward field of view, the operator can indirectly check the forward field of view by checking the field of view image C displayed on the terminal monitor 36. In this way, when the portable information terminal 3 is worn on the operator's head, the operator does not need to hold the portable information terminal 3 in his or her hand. Therefore, the operator can perform a wider variety of examinations, such as operating the ultrasound probe 2 with one hand while inserting a so-called puncture needle into a subject with the other hand.

[0074] 2, the transmission / reception circuit 22 has the beamformer 54 together with the amplifier 52 and the AD converter 53, but the beamformer 54 may be disposed between the transmission / reception circuit 22 and the signal processor 23 rather than inside the transmission / reception circuit 22. In this case, the beamformer 54 may also be configured by the probe-side processor 27.

[0075] 5, external input information such as a cursor A that can be moved by an input operation by the observer via the input device 47 of the external device 4 can be simultaneously displayed on the external monitor 45 of the external device 4 and the terminal monitor 36 of the mobile information terminal 3. In this case, for example, when the cursor A displayed on the external monitor 45 of the external device 4 is moved by an input operation by the observer via the input device 47 of the external device 4, the cursor A displayed on the terminal monitor 36 of the mobile information terminal 3 is similarly moved. This allows, for example, more detailed information to be shared between the operator of the ultrasound probe 2 and the mobile information terminal 3A and the observer located near the external device 4A. For example, a highly skilled observer observing the ultrasound image U and the field of view image C on the external monitor 45 of the external device 4A can use the cursor A to indicate the position where the ultrasound probe 2 should be scanned to a less skilled operator of the ultrasound probe 2 and the mobile information terminal 3A, thereby easily assisting the operator in performing an examination.

[0076] Furthermore, for example, a cursor A that can be moved by an operator's input operation via the input device 38 of the portable information terminal 3 can be simultaneously displayed on the terminal monitor 36 of the portable information terminal 3 and the external monitor 45 of the external device 4. In this case, for example, a highly skilled operator can more easily and in detail educate a less skilled observer positioned near the external device 4A about ultrasound diagnosis. The shape of the cursor A is not limited to an arrow shape, but may be any shape such as a circle or a polygon.

[0077] Also, for example, audio data can be wirelessly communicated bidirectionally between the mobile information terminal 3 and the external device 4. Fig. 6 shows the configuration of a mobile information terminal 3A in a modification of the first embodiment of the present invention. The mobile information terminal 3A is similar to the mobile information terminal 3 shown in Fig. 1 except that a microphone 61 and a speaker 62 are added, a terminal control unit 37A is provided instead of the terminal control unit 37, and a terminal processor 39A is provided instead of the terminal processor 39. In the mobile information terminal 3A, the microphone 61 and the speaker 62 are connected to the terminal wireless communication unit 31.

[0078] 7 shows the configuration of an external device 4A according to a modification of the first embodiment of the present invention. The external device 4A is similar to the external device 4 shown in FIG. 1 except that a microphone 63 and a speaker 64 are added, an external control unit 46A is provided instead of the external control unit 46, and an external device-side processor 48A is provided instead of the external device-side processor 48. In the external device 4A, the microphone 63 and the speaker 64 are connected to the external wireless communication unit 41.

[0079] In a modification of the first embodiment of the present invention, audio data is transmitted and received bidirectionally between the portable information terminal 3A and the external device 4A. For example, when the operator of the ultrasonic probe 2 and the portable information terminal 3A speaks toward the portable information terminal 3A, the spoken audio is input to the microphone 61 of the portable information terminal 3A, and audio data is generated by the microphone 61. The generated audio data is wirelessly transmitted from the terminal-side wireless communication unit 31 to the external device 4A. The external wireless communication unit 41 of the external device 4A receives the audio data wirelessly transmitted from the portable information terminal 3A and sends the received audio data to the speaker 64. The speaker 64 reproduces the audio spoken by the operator of the ultrasonic probe 2 and the portable information terminal 3A based on the audio data received from the external wireless communication unit 41.

[0080] Furthermore, for example, when an observer observing the ultrasound image U and the field of view image C on the external monitor 45 of the external device 4A speaks toward the external device 4A, the spoken voice is input to the microphone 63 of the external device 4A, and voice data is generated by the microphone 63. The generated voice data is wirelessly transmitted from the external wireless communication unit 41 to the mobile information terminal 3A. The terminal-side wireless communication unit 31 of the mobile information terminal 3A receives the voice data wirelessly transmitted from the external device 4A and sends the received voice data to the speaker 62. The speaker 62 reproduces the voice spoken by the observer located near the external device 4A based on the voice data received from the terminal-side wireless communication unit 31.

[0081] In this way, by transmitting and receiving audio data bidirectionally between the mobile information terminal 3A and the external device 4A, more detailed information can be shared between the operator of the ultrasound probe 2 and the mobile information terminal 3A and the observer located near the external device 4A. For example, a highly skilled observer observing the ultrasound image U and the field of view image C on the external monitor 45 of the external device 4A can more easily and in detail give advice to a less skilled operator of the ultrasound probe 2 and the mobile information terminal 3A. Also, for example, a highly skilled operator can more easily and in detail educate a less skilled observer located near the external device 4A about ultrasound diagnosis.

[0082] Furthermore, the operator's voice input to the microphone 61 of the mobile information terminal 3A can also be used as an input operation by the operator. For example, the terminal control unit 37A can acquire instruction information by analyzing voice data generated by the microphone 61 based on the operator's voice, and control each unit of the mobile information terminal 3A, such as starting and stopping capture of the field of view image C by the camera unit 33, according to the acquired instruction information. Furthermore, the ultrasonic probe 2 can also be controlled based on the voice data analyzed by the terminal control unit 37A. In this case, for example, the voice data analyzed by the terminal control unit 37A is wirelessly transmitted from the terminal-side wireless communication unit 31 to the ultrasonic probe 2 as input information from the operator, and input to the probe-side control unit 26 via the probe-side wireless communication unit 24. Based on the input information, the probe control unit 26 can control each unit of the ultrasonic probe 2, such as starting and stopping transmission of ultrasonic waves by the transducer array 21 and starting and stopping capture of the field of view image C by the camera unit 33.

[0083] Furthermore, the observer's voice input to the microphone 63 of the external device 4A can also be used as an input operation by the observer. For example, the external control unit 46A can acquire instruction information by analyzing audio data generated by the microphone 63 based on the observer's voice, and can control each unit of the portable information terminal 3A, such as starting and stopping the capture of the field of view image C by the camera unit 33 of the portable information terminal 3A, and can control each unit of the ultrasound probe 2, such as starting and stopping the transmission of ultrasound waves by the transducer array 21 of the ultrasound probe 2, according to the acquired instruction information.

[0084] Embodiment 2 In the first embodiment, the ultrasonic probe 2 generates pre-imaging received data by performing envelope detection processing on the sound ray signal, and the generated pre-imaging received data is wirelessly transmitted to the mobile information terminal 3 and the external device 4. However, the ultrasonic probe 2 can also generate an ultrasonic image U, and the generated ultrasonic image U can also be wirelessly transmitted to the mobile information terminal 3 and the external device 4.

[0085] 8 shows the configuration of an ultrasound system 1B according to embodiment 2 of the present invention. The ultrasound system 1 is the same as the ultrasound system 1 of embodiment 1 shown in FIG. 1 except that an ultrasound probe 2A is provided instead of the ultrasound probe 2, a mobile information terminal 3B is provided instead of the mobile information terminal 3, and an external device 4B is provided instead of the external device 4.

[0086] The ultrasonic probe 2B is the same as the ultrasonic probe 2 in embodiment 1 except that an image processing unit 71 is added, a probe control unit 26B is provided instead of the probe control unit 26, and a probe-side processor 27B is provided instead of the probe-side processor 27. In the ultrasonic probe 2B, the image processing unit 71 is connected to the signal processing unit 23. Furthermore, the probe-side wireless communication unit 24 and the probe control unit 26B are connected to the image processing unit 71. Although not shown, the signal processing unit 23 and the image processing unit 71 constitute an ultrasonic image generation unit.

[0087] The mobile information terminal 3B is the same as the mobile information terminal 3 in the first embodiment except that the image processing unit 32 is removed, a terminal control unit 37B is provided instead of the terminal control unit 37, and a terminal side processor 39B is provided instead of the terminal side processor 39. In the mobile information terminal 3B, an image synchronization unit 34 and a camera unit 33 are connected to the terminal side wireless communication unit 31. The external device 4B is the external device 4 in embodiment 1, except that the image processing unit 42 has been removed, an external control unit 46B has been provided in place of the external control unit 46, and an external device side processor 48B has been provided in place of the external device side processor 48.

[0088] The image processing unit 71 of the ultrasound probe 2B raster-converts the signal that has been envelope-detected by the signal processing unit 23 into an image signal that conforms to the scanning method of a normal television signal, and performs various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, to generate an ultrasound image U that conforms to the display format for the terminal monitor 36 of the mobile information terminal 3B and an ultrasound image U that conforms to the format for the external monitor 45 of the external device 4B. Furthermore, the image processing unit 71 wirelessly transmits the ultrasound image U that conforms to the display format for the terminal monitor 36 of the mobile information terminal 3B from the probe-side wireless communication unit 24 to the mobile information terminal 3B, and wirelessly transmits the ultrasound image U that conforms to the format for the external monitor 45 of the external device 4B from the probe-side wireless communication unit 24 to the external device 4B.

[0089] The terminal side wireless communication unit 31 of the mobile information terminal 3B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B, and sends the received ultrasound image U to the image synchronization unit . The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal-side wireless communication unit 31 with the field of view image C generated by the camera unit 33, and generates a composite image M based on the synchronized ultrasound image U and field of view image C. For example, if the image processing unit 71 of the ultrasound probe 2B assigns a timestamp indicating the time at which the ultrasound image U was generated to the ultrasound image U, and the camera unit 33 of the mobile information terminal 3B assigns a timestamp indicating the time at which the field of view image C was generated to the field of view image C, the image synchronization unit 34 can synchronize the ultrasound image U and the field of view image C with each other based on the timestamps assigned to the ultrasound image U and the field of view image C.

[0090] The display control unit 35 performs a predetermined processing on the composite image M generated by the image synchronization unit 34, and then sends the composite image M to the terminal monitor 36, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the terminal monitor 36, as shown in Figure 3.

[0091] The external wireless communication unit 41 of the external device 4B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B and the field of view image C wirelessly transmitted from the mobile information terminal 3B, and sends the received ultrasound image U and field of view image C to the image synchronization unit 43. The image synchronization unit 43 synchronizes the ultrasound image U and the field of view image C sent from the external wireless communication unit 41 with each other, and generates a composite image M based on the ultrasound image U and the field of view image C that are synchronized with each other. The display control unit 44 performs a predetermined processing on the composite image M generated by the image synchronization unit 43, and then sends the composite image M to the external monitor 45, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the external monitor 45, as shown in Figure 4.

[0092] As described above, according to ultrasound system 1B of embodiment 2 of the present invention, even when ultrasound probe 2B includes image processing unit 71, the same field of view image C and ultrasound image U are displayed almost simultaneously on terminal monitor 36 and external monitor 45, similar to ultrasound system 1 of embodiment 1 in which mobile information terminal 3 includes image processing unit 32 and external device 4 includes image processing unit 42. Therefore, for example, an observer observing field of view image C and ultrasound image U using external device 4B located at a remote location can give advice to the operator of ultrasound probe 2B and mobile information terminal 3B, thereby enabling an appropriate ultrasound image U to be obtained and improving the accuracy of ultrasound diagnosis.

[0093] 1, the image processing unit 32 is provided in the portable information terminal 3 and the image processing unit 42 is provided in the external device 4, but in the ultrasound system 1B according to the second embodiment, the image processing unit 71 is provided in the ultrasound probe 2B, so the portable information terminal 3B and the external device 4B do not need to have the image processing units 32 and 42, respectively, and the internal configurations of the portable information terminal 3B and the external device 4B are simplified compared to the internal configurations of the portable information terminal 3 and the external device 4 in the ultrasound system 1 according to the first embodiment. Therefore, according to the ultrasound system 1B according to the second embodiment, it is possible to reduce the power consumption and calculation load of the portable information terminal 3B and the external device 4B compared to the ultrasound system 1 according to the first embodiment.

[0094] Embodiment 3 In the first embodiment, the ultrasound image U and the field of view image C are synchronized in the mobile information terminal 3 and the external device 4, respectively. However, for example, the ultrasound image U and the field of view image C can also be synchronized only in the mobile information terminal 3.

[0095] 9 shows the configuration of an ultrasound system 1C according to the third embodiment of the present invention. The ultrasound system 1 is the same as the ultrasound system 1 of the first embodiment shown in FIG. 1 except that it is provided with an ultrasound probe 2C having the same internal configuration as the ultrasound probe 2, a mobile information terminal 3C instead of the mobile information terminal 3, and an external device 4C instead of the external device 4. The ultrasound probe 2C is connected only to the mobile information terminal 3C via wireless communication, and the external device 4C is connected only to the mobile information terminal 3C via wireless communication.

[0096] The mobile information terminal 3C is the same as the mobile information terminal 3 in the first embodiment, except that a terminal control unit 37C is provided instead of the terminal control unit 37, and a terminal processor 39C is provided instead of the terminal processor 39. In the mobile information terminal 3C, an image synchronization unit 34 is connected to the terminal wireless communication unit 31. In addition, the camera unit 33 is connected to the image synchronization unit 34.

[0097] The external device 4C is different from the external device 4 in the first embodiment in that the image processing unit 42 and the image synchronization unit 43 are removed, an external control unit 46C is provided instead of the external control unit 46, and an external device-side processor 48C is provided instead of the external device-side processor 48. In the external device 4C, a display control unit 44 is connected to the external wireless communication unit 41.

[0098] The probe-side wireless communication unit 24 of the ultrasonic probe 2C wirelessly transmits the received data, which has been subjected to envelope detection processing by the signal processing unit 23 and has not yet been converted into an image, only to the mobile information terminal 3C. The terminal side wireless communication unit 31 of the mobile information terminal 3C receives the pre-imaging reception data wirelessly transmitted from the ultrasound probe 2C, and sends the received pre-imaging reception data to the image processing unit 32.

[0099] The image processing unit 32 raster-converts the received data before imaging sent from the terminal-side wireless communication unit 31 into an image signal that conforms to the scanning method of a normal television signal, and performs various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, to generate an ultrasound image U that conforms to the display format for the terminal monitor 36 of the mobile information terminal 3B and an ultrasound image U that conforms to the format for the external monitor 45 of the external device 4B. Furthermore, the image processing unit 32 sends the ultrasound image U that conforms to the display format for the terminal monitor 36 of the mobile information terminal 3B and the ultrasound image U that conforms to the format for the external monitor 45 of the external device 4B to the image synchronization unit 34.

[0100] The camera unit 33 acquires a field of view image C obtained by capturing an image of a location on the subject to be scanned by the ultrasonic probe 2C, and sends the acquired field of view image C to the image synchronization unit . The image synchronization unit 34 synchronizes the ultrasound image U sent from the image processing unit 32 with the field of view image C sent from the camera unit 33. More specifically, the image synchronization unit 34 synchronizes the ultrasound image U and the field of view image C that conform to the display format for the terminal monitor 36 of the mobile information terminal 3B with each other to generate a composite image M, and further synchronizes the ultrasound image U and the field of view image C that conform to the display format for the external monitor 45 of the external device 4C with each other to generate a composite image M.

[0101] The image synchronization unit 34 also sends a composite image M generated based on the ultrasound image U and the field of view image C that conform to the display format for the terminal monitor 36 of the mobile information terminal 3B, which are synchronized with each other, to the display control unit 35. The display control unit 35 performs predetermined processing on the composite image M sent from the image synchronization unit 34, and then sends the composite image M to the terminal monitor 36, and causes the ultrasound image U and the field of view image C, which are synchronized with each other, to be displayed together on the terminal monitor 36, as shown in FIG. 3. The image synchronization unit 34 also sends a composite image M generated based on the ultrasound image U and the field of view image C that conform to the display format for the external monitor 45 of the external device 4C to the terminal-side wireless communication unit 31.

[0102] The terminal side wireless communication unit 31 wirelessly transmits the composite image M sent from the image synchronization unit 34 to the external device 4C. The external wireless communication unit 41 of the external device 4C receives the composite image M wirelessly transmitted from the mobile information terminal 3C and sends the received composite image M to the display control unit 44. The display control unit 44 performs predetermined processing on the composite image M sent from the external wireless communication unit 41, and then sends the composite image M to the external monitor 45, and causes the external monitor 45 to display the ultrasound image U and the field of view image C, which are synchronized with each other, together, as shown in FIG.

[0103] As described above, according to ultrasound system 1C of embodiment 3 of the present invention, even if image processing unit 32 and image synchronization unit 34 are provided only in mobile information terminal 3C, the same field of view image C and ultrasound image U are displayed almost simultaneously on terminal monitor 36 and external monitor 45, similar to ultrasound system 1 of embodiment 1 in which mobile information terminal 3 includes image processing unit 32 and external device 4 includes image processing unit 42. Therefore, for example, an observer observing field of view image C and ultrasound image U using external device 4C located in a remote location can give advice to the operator of ultrasound probe 2C and mobile information terminal 3C, thereby enabling an appropriate ultrasound image U to be obtained and improving the accuracy of ultrasound diagnosis.

[0104] 1, the external device 4 is provided with the image processing unit 42 and the image synchronization unit 43, but in the ultrasound system 1C according to the third embodiment, the composite image M generated based on the ultrasound image U and the field of view image C is wirelessly transmitted from the mobile information terminal 3C to the external device 4C, so the external device 4C does not need to have the image processing unit 42 and the image synchronization unit 43, and the internal configuration of the external device 4C is simpler than the internal configuration of the external device 4 according to the first embodiment. Therefore, the ultrasound system 1C according to the third embodiment can reduce the power consumption, calculation load, and the like of the external device 4C.

[0105] Embodiment 4 In the third embodiment, the received data before imaging, which has been subjected to envelope detection processing by the signal processing unit 23 of the ultrasonic probe 2, is wirelessly transmitted to the mobile information terminal 3 and the external device 4, but the ultrasonic image U can also be generated in the ultrasonic probe 2.

[0106] Fig. 10 shows the configuration of an ultrasound system 1D according to embodiment 4 of the present invention. The ultrasound system 1D is the same as the ultrasound system 1C of embodiment 3 shown in Fig. 9 except that an ultrasound probe 2D is provided instead of the ultrasound probe 2C, a mobile information terminal 3D is provided instead of the mobile information terminal 3C, and an external device 4D is provided instead of the external device 4C. The ultrasound probe 2D is connected via wireless communication only to the mobile information terminal 3D, and the external device 4D is connected via wireless communication only to the mobile information terminal 3D.

[0107] The ultrasonic probe 2D is the ultrasonic probe 2C of embodiment 3, except that an image processing unit 81 is added, a probe control unit 26D is provided instead of the probe control unit 26, and a probe-side processor 27D is provided instead of the probe-side processor 27. In the ultrasonic probe 2D, the image processing unit 81 is connected to the signal processing unit 23, and the probe-side wireless communication unit 24 and the probe control unit 26D are connected to the image processing unit 81. Although not shown, the signal processing unit 23 and the image processing unit 81 constitute an ultrasonic image generation unit.

[0108] The mobile information terminal 3D is the same as the mobile information terminal 3C in the third embodiment except that the image processing unit 32 is removed, a terminal control unit 37D is provided instead of the terminal control unit 37C, and a terminal processor 39D is provided instead of the terminal processor 39C. In the mobile information terminal 3D, an image synchronization unit 34 is connected to the terminal wireless communication unit 31. Also, the camera unit 33 is connected to the image synchronization unit 34.

[0109] The external device 4D is the same as the external device 4C in the third embodiment except that an external control unit 46D is provided instead of the external control unit 46C, and an external device processor 48D is provided instead of the external device processor 48C.

[0110] The image processing unit 81 of the ultrasound probe 2D raster-converts the signal that has been envelope-detected by the signal processing unit 23 into an image signal that conforms to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal to generate an ultrasound image U that conforms to the display format for the terminal monitor 36 of the mobile information terminal 3D and an ultrasound image U that conforms to the format for the external monitor 45 of the external device 4D. In addition, the image processing unit 81 transmits these generated ultrasound images U to the probe-side wireless communication unit 24.

[0111] The probe-side wireless communication unit 31 wirelessly transmits the ultrasound image U sent from the image processing unit 81 to the mobile information terminal 3D. The terminal-side wireless communication unit 31 receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2D, and sends the received ultrasound image U to the image synchronization unit . The camera unit 33 acquires a field of view image C obtained by capturing an image of a location on the subject that is scanned by the ultrasonic probe 2D, and sends the acquired field of view image C to the image synchronization unit .

[0112] The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal-side wireless communication unit 31 with the field of view image C sent from the camera unit 33, and generates a composite image M based on the synchronized ultrasound image U and field of view image C. Specifically, the image synchronization unit 34 synchronizes the ultrasound image U and field of view image C that conform to the format for the terminal monitor 36 of the mobile information terminal 3D, and further synchronizes the ultrasound image U and field of view image C that conform to the format for the external monitor 45 of the external device 4D.

[0113] The image synchronization unit 34 sends to the display control unit 35 a composite image M generated based on the ultrasound image U and the field of view image C that conform to a format for the terminal monitor 36 that are synchronized with each other. The display control unit 35 performs a predetermined processing on the composite image M sent from the image synchronization unit 34, and then sends the composite image M to the terminal monitor 36, and as shown in Figure 3, the ultrasound image U and the field of view image C, which are synchronized with each other, are displayed together on the terminal monitor 36.

[0114] The image synchronization unit 34 also sends to the terminal-side wireless communication unit 31 a composite image M generated based on the ultrasound image U and the field of view image C that conform to a format for the external monitor 45 that are synchronized with each other. The terminal side wireless communication unit 31 wirelessly transmits the composite image M sent from the image synchronization unit 34 to the external device 4D.

[0115] The external wireless communication unit 41 of the external device 4D receives the composite image M wirelessly transmitted from the mobile information terminal 3D, and sends the received composite image M to the display control unit . The display control unit 44 performs a predetermined processing on the composite image M sent from the external wireless communication unit 41, and then sends the composite image M to the external monitor 45, and as shown in Figure 4, the ultrasound image U and the field of view image C, which are synchronized with each other, are displayed together on the external monitor 45.

[0116] As described above, according to the ultrasound system 1D of the fourth embodiment, even if the image processing unit 81 is provided only in the ultrasound probe 2D and the image synchronization unit 34 is provided only in the mobile information terminal 3D, the same field of view image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, similar to the ultrasound system 1C of the third embodiment in which the mobile information terminal 3C has the image processing unit 32 and the external device 4 has the image processing unit 42. Therefore, for example, an observer observing the field of view image C and ultrasound image U using the external device 4D located in a remote location can give advice to the operator of the ultrasound probe 2D and the mobile information terminal 3D, so that an appropriate ultrasound image U can be obtained and the accuracy of ultrasound diagnosis can be improved.

[0117] Fifth embodiment In the third embodiment, the external device 4C receives the composite image M from the mobile information terminal 3C and displays the received composite image M on the external monitor 45. Therefore, the external device 4C was not able to freely change the layout and size of the ultrasound image U and the field of view image C displayed on the external monitor 45. However, according to the ultrasound diagnostic device 1E of the fifth embodiment shown in FIG. 11, the layout and size of the ultrasound image U and the field of view image C displayed on the external monitor 45 can be arbitrarily changed on the external device 4E side.

[0118] 11 shows the configuration of an ultrasound system 1E according to embodiment 5 of the present invention. The ultrasound system 1E is the same as the ultrasound system 1C according to embodiment 3, except that it includes an ultrasound probe 2E having the same internal configuration as the ultrasound probe 2C, a mobile information terminal 3E instead of the mobile information terminal 3C, and an external device 4E instead of the external device 4C. The ultrasound probe 2E is connected via wireless communication only to the mobile information terminal 3E, and the external device 4E is connected via wireless communication only to the mobile information terminal 3E.

[0119] The mobile information terminal 3E is the same as the mobile information terminal 3C in the third embodiment, except that a terminal control unit 37E is provided instead of the terminal control unit 37, and a terminal-side processor 39E is provided instead of the terminal-side processor 39. In the mobile information terminal 3E, an image synchronization unit 34 is connected to the camera unit 33, and the image synchronization unit 34 is connected to the terminal-side wireless communication unit 31.

[0120] The external device 4E is the same as the external device 4C in the third embodiment except that an external control unit 46E is provided instead of the external control unit 46, and an external device processor 48E is provided instead of the external device processor 48.

[0121] The probe-side wireless communication unit 24 of the ultrasonic probe 2E wirelessly transmits the received data, which has been subjected to envelope detection processing by the signal processing unit 23 and has not yet been converted into an image, to the mobile information terminal 3E. The terminal-side wireless communication unit 31 of the mobile information terminal 3E receives the pre-imaging reception data wirelessly transmitted from the ultrasound probe 2E, and sends the received pre-imaging reception data to the image processing unit 32.

[0122] The image processing unit 32 generates an ultrasound image U conforming to a format for the terminal monitor 36 of the mobile information terminal 3E and an ultrasound image U conforming to a display format for the external monitor 45 of the external device 4E, based on the received data before imaging sent from the terminal-side wireless communication unit 31. The image processing unit 32 also sends these ultrasound images U to the image synchronization unit 34. The camera unit 33 acquires a field of view image C obtained by capturing an image of a location on the subject to be scanned by the ultrasonic probe 2E, and sends the acquired field of view image C to the image synchronization unit .

[0123] The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal-side wireless communication unit 31 with the field of view image C sent from the camera unit 33. Specifically, the image synchronization unit 34 synchronizes the ultrasound image U and field of view image C that conform to the format for the terminal monitor 36 of the mobile information terminal 3E with each other, and further synchronizes the ultrasound image U and field of view image C that conform to the format for the external monitor 45 of the external device 4E with each other.

[0124] The image synchronization unit 34 sends the ultrasound image U and the field of view image C to the display control unit 35, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to a format for the terminal monitor 36 that are synchronized with each other. The display control unit 35 performs predetermined processing on the ultrasound image U and field of view image C sent from the image synchronization unit 34, and displays the ultrasound image U and field of view image C, which are synchronized with each other, together on the terminal monitor 36, as shown in Figure 3.

[0125] In addition, the image synchronization unit 34 sends the ultrasound image U and the field of view image C to the terminal side wireless communication unit 31, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to the format for the external monitor 45 that are synchronized with each other. The terminal-side wireless communication unit 31 wirelessly transmits the ultrasound image U and the field-of-view image C sent from the image synchronization unit 34 to the external device 4E. The external wireless communication unit 41 of the external device 4E receives the ultrasound image U and the field of view image C wirelessly transmitted from the mobile information terminal 3E, and sends the received ultrasound image U and field of view image C to the display control unit 44, respectively.

[0126] The display control unit 44 performs predetermined processing on the ultrasound image U and the field of view image C sent from the external wireless communication unit 41, and displays the ultrasound image U and the field of view image C synchronized with each other together on the external monitor 45. Here, the layout and size of the ultrasound image U and the field of view image C displayed on the external monitor 45, such as the display position and size, can be adjusted by an input operation by the observer via the input device 47. For example, when the observer inputs instruction information to adjust the layout and size of the ultrasound image U and the field of view image C on the external monitor 45 via the input device 47, the input instruction information is input to the display control unit 44 via the external control unit 46E. Based on the input instruction information, the display control unit 44 displays the ultrasound image U and the field of view image C synchronized with each other, for example, with the layout and size shown in FIG. 12. In the example shown in FIG. 12, the external device 4E, the ultrasound image U, and the field of view image C are rotated 90 degrees compared to the example shown in FIG. 4, and the ultrasound image U and the field of view image C are displayed on the external monitor 45 so that the field of view image C is superimposed on a portion of the ultrasound image U.

[0127] As described above, according to the ultrasound system 1E of embodiment 5 of the present invention, the position and size of the ultrasound image U and field of view image C displayed on the external monitor 45 of the external device 4E can be adjusted, so that an observer observing the ultrasound image U and field of view image C displayed on the external monitor 45 can view the ultrasound image U and field of view image C more clearly according to their preferences.

[0128] Sixth embodiment In the fifth embodiment, the received data before imaging, which has been subjected to envelope detection processing by the signal processing unit 23, is wirelessly transmitted to the mobile information terminal 3E by the probe side wireless communication unit 24, but an ultrasound image U can also be generated in the ultrasound probe 2.

[0129] Fig. 13 shows the configuration of an ultrasound system 1F according to embodiment 6 of the present invention. The ultrasound system 1F is the same as the ultrasound system 1E according to embodiment 5 shown in Fig. 11 except that an ultrasound probe 2F is provided instead of the ultrasound probe 2E, a mobile information terminal 3F is provided instead of the mobile information terminal 3E, and an external device 4F is provided instead of the external device 4E. The ultrasound probe 2F is connected only to the mobile information terminal 3F via wireless communication, and the external device 4F is connected only to the mobile information terminal 3F via wireless communication.

[0130] The ultrasonic probe 2F is the ultrasonic probe 2E of the fifth embodiment, to which an image processing unit 91 has been added, a probe control unit 26E has been provided instead of the probe control unit 26, and a probe-side processor 27E has been provided instead of the probe-side processor 27. In the ultrasonic probe 2F, the image processing unit 91 is connected to the signal processing unit 23, and the probe-side wireless communication unit 24 and the probe control unit 26F are connected to the image processing unit 91. Although not shown, the signal processing unit 23 and the image processing unit 91 constitute an ultrasonic image generation unit.

[0131] The mobile information terminal 3F is the same as the mobile information terminal 3E in the fifth embodiment except that the image processing unit 32 is removed, a terminal control unit 37F is provided instead of the terminal control unit 37E, and a terminal processor 39F is provided instead of the terminal processor 39E. In the mobile information terminal 3F, an image synchronization unit 34 is connected to the terminal wireless communication unit 31. In addition, the camera unit 33 is connected to the image synchronization unit 34.

[0132] The external device 4F is the same as the external device 4E in the fifth embodiment except that an external control unit 46F is provided instead of the external control unit 46E, and an external device-side processor 48F is provided instead of the external device-side processor 48E.

[0133] The image processing unit 91 of the ultrasound probe 2F raster-converts the signal that has been envelope-detected by the signal processing unit 23 into an image signal that conforms to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal to generate an ultrasound image U that conforms to the display format for the terminal monitor 36 of the mobile information terminal 3F and an ultrasound image U that conforms to the format for the external monitor 45 of the external device 4F. In addition, the image processing unit 91 transmits these generated ultrasound images U to the probe-side wireless communication unit 24.

[0134] The terminal side wireless communication unit 31 receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2F, and sends the received ultrasound image U to the image synchronization unit . The camera unit 33 acquires a field of view image C obtained by capturing an image of a location on the subject to be scanned by the ultrasonic probe 2F, and sends the acquired field of view image C to the image synchronization unit .

[0135] The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal-side wireless communication unit 31 with the field-of-view image C sent from the camera unit 33. Specifically, the image synchronization unit 34 synchronizes the ultrasound image U and field-of-view image C that conform to the format for the terminal monitor 36 of the mobile information terminal 3F with each other, and further synchronizes the ultrasound image U and field-of-view image C that conform to the format for the external monitor 45 of the external device 4F with each other.

[0136] The image synchronization unit 34 sends the ultrasound image U and the field of view image C to the display control unit 35, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to a format for the terminal monitor 36 that are synchronized with each other. The display control unit 35 performs predetermined processing on the ultrasound image U and the field of view image C sent from the image synchronization unit 34, and displays the ultrasound image U and the field of view image C synchronized with each other together on the terminal monitor 36.

[0137] In addition, the image synchronization unit 34 sends the ultrasound image U and the field of view image C to the terminal side wireless communication unit 31, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to the format for the external monitor 45 that are synchronized with each other. The terminal-side wireless communication unit 31 wirelessly transmits the ultrasound image U and the field-of-view image C sent from the image synchronization unit 34 to the external device 4F.

[0138] The external wireless communication unit 41 of the external device 4F receives the ultrasound image U and the field of view image C wirelessly transmitted from the mobile information terminal 3F, and sends the received ultrasound image U and field of view image C to the display control unit 44, respectively. The display control unit 44 performs predetermined processing on the ultrasound image U and field of view image C sent from the external wireless communication unit 41, and displays the ultrasound image U and field of view image C, which are synchronized with each other, together on the external monitor 45.

[0139] At this time, the display control unit 44 can adjust the arrangement and size of the ultrasound image U and the field of view image C displayed on the external monitor 45 in accordance with an input operation by the observer via the input device 47. As a result, for example, as shown in FIG. 12, the ultrasound image U and the field of view image C, which are synchronized with each other, are displayed together on the external monitor 45.

[0140] As described above, according to the ultrasound system 1F of embodiment 6 of the present invention, even if the ultrasound probe 2F is equipped with an image processing unit 91, the position and size of the ultrasound image U and field of view image C displayed on the external monitor 45 of the external device 4F can be adjusted, so that an observer observing the ultrasound image U and field of view image C displayed on the external monitor 45 can view the ultrasound image U and field of view image C more clearly according to their preferences. [Explanation of symbols]

[0141] 1, 1B, 1C, 1D, 1E, 1F Ultrasound system, 2, 2B, 2C, 2D, 2E, 2F Ultrasound probe, 3, 3A, 3B, 3C, 3D, 3E, 3F Portable information terminal, 4, 4A, 4B, 4C, 4D, 4E, 4F External device, 21 Transducer array, 22 Transmitter / receiver circuit, 23 Signal processing unit, 24 Probe side wireless communication unit, 26, 26B, 26D, 26F Probe control unit, 27, 27B, 27D, 27F Probe side processor, 31 Terminal side wireless communication unit, 32, 42, 71, 81, 91 Image processing unit, 33 Camera unit, 34, 43 Image synchronization unit, 35, 44 Display control unit, 36 Terminal monitor, 37, 37A, 37B, 37C, 37D, 37E, 37F Terminal control unit, 38, 47 Input device, 39, 39A, 39B, 39C, 39D, 39E, 39F terminal side processor, 41 external wireless communication unit, 45 external monitor, 46, 46A, 46B, 46C, 46D, 4E6, 46F external control unit, 48, 48A, 48B, 48C, 48D, 48E, 48F external device side processor, 51 pulser, 52 amplifier unit, 53 AD conversion unit, 54 beam former, 61, 63 microphone, 62, 64 speaker, A cursor, C field of view image, U ultrasound image.

Claims

1. An ultrasound system comprising an ultrasound probe, a personal digital assistant, and an external device, The ultrasonic probe includes: a transducer array; a transmission / reception circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array; an ultrasonic image generating unit that generates an ultrasonic image based on the sound ray signal generated by the transmission / reception circuit; a probe-side wireless communication unit that wirelessly transmits the ultrasound image only to the portable information terminal; Including, The mobile information terminal includes: A terminal monitor, a camera unit for acquiring a field of view image of a scanning point of the ultrasonic probe on the subject; a first input device into which first information is input by an operator of the portable information terminal; a terminal-side wireless communication unit that performs bidirectional wireless communication with the external device and wirelessly transmits to the external device the field-of-view image acquired by the camera unit, the ultrasound image received from the ultrasound probe, and the first information input to the first input device; Including, The external device is An external monitor and a second input device to which second information is input by an observer of the external monitor; a display control unit that displays the ultrasound image and the field of view image, which are synchronized with each other, together on the external monitor; an external wireless communication unit that performs bidirectional wireless communication with the portable information terminal and wirelessly transmits the second information input to the second input device to the terminal-side wireless communication unit; Including, the second information is displayed on the terminal monitor; an ultrasound system in which imaging parameters of the transmitting and receiving circuit of the ultrasound probe and imaging timing of the camera unit of the mobile information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device.

2. the portable information terminal includes a terminal monitor; The ultrasound system of claim 1 , wherein the ultrasound image and the field of view image are displayed on the terminal monitor.

3. The ultrasound system of claim 2 , wherein the portable information terminal includes an image synchronization unit that synchronizes the ultrasound image and the field of view image with each other.

4. the external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit; 4. The ultrasound system of claim 2, wherein the second information is displayed on the terminal monitor.

5. 5. The ultrasound system according to claim 1, wherein the portable information terminal is mountable on the head of an operator who operates the ultrasound probe and the portable information terminal.

6. A control method for an ultrasound system including an ultrasound probe, a personal digital assistant, and an external device, comprising: In the ultrasonic probe, transmitting ultrasonic waves from a transducer array of the ultrasonic probe and generating a sound ray signal based on a received signal acquired by the transducer array; generating an ultrasound image based on the generated sound ray signals; wirelessly transmitting the ultrasound image to the portable information terminal; In the portable information terminal, a camera unit is used to acquire a field of view image of a scanning point of the ultrasonic probe on the subject; accepting input of first information by an operator of the portable information terminal; wirelessly transmitting the acquired field of view image, the ultrasound image wirelessly transmitted from the ultrasound probe, and the first information whose input has been accepted to the external device; In the external device, Displaying the synchronized ultrasound image and the field of view image together on an external monitor; accepting input of second information by an observer of the external monitor; wirelessly transmitting the second information to the mobile information terminal; the second information is displayed on a terminal monitor of the portable information terminal; Based on the first information input by the operator and the second information input by the observer, imaging parameters of a transmitting / receiving circuit of the ultrasound probe and imaging timing of the camera unit of the portable information terminal are controlled. A method for controlling an ultrasound system.

7. An ultrasound system comprising an ultrasound probe, a personal digital assistant, and an external device, The ultrasonic probe includes: a transducer array; a transmission / reception circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array; a reception data generation unit that generates reception data before imaging by performing signal processing on the sound ray signals generated by the transmission / reception circuit; a probe-side wireless communication unit that wirelessly transmits the received data only to the portable information terminal; Including, The mobile information terminal includes: A terminal monitor, a camera unit for acquiring a field of view image of a scanning point of the ultrasonic probe on the subject; a first input device into which first information is input by an operator of the portable information terminal; a terminal-side wireless communication unit that performs bidirectional wireless communication with the external device and wirelessly transmits at least the field-of-view image acquired by the camera unit and the first information input to the first input device to the external device; Including, The external device is An external monitor and a second input device to which second information is input by an observer of the external monitor; a display control unit that displays an ultrasound image and the field of view image, which are generated based on the received data and synchronized with each other, together on the external monitor; an external wireless communication unit that performs bidirectional wireless communication with the portable information terminal and wirelessly transmits the second information input to the second input device to the terminal-side wireless communication unit; Including, the second information is displayed on the terminal monitor; an ultrasound system in which imaging parameters of the transmitting and receiving circuit of the ultrasound probe and imaging timing of the camera unit of the mobile information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device.

8. The ultrasound system according to claim 7 , wherein the external device includes an image processing unit that generates an ultrasound image based on the received data wirelessly transmitted from the probe-side wireless communication unit.

9. the probe-side wireless communication unit wirelessly transmits the received data to the portable information terminal; the portable information terminal includes an image processing unit that generates an ultrasound image based on the received data wirelessly transmitted from the probe wireless communication unit; The ultrasound system according to claim 7 , wherein the terminal-side wireless communication unit wirelessly transmits the ultrasound image generated by the image processing unit and the field-of-view image acquired by the camera unit to the external device.

10. the portable information terminal includes a terminal monitor; The ultrasound system of claim 9 , wherein the ultrasound image and the field of view image are displayed on the terminal monitor.

11. The ultrasound system of claim 10 , wherein the portable information terminal includes an image synchronization unit that synchronizes the ultrasound image and the field of view image with each other.

12. the external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit; 12. The ultrasound system of claim 10, wherein the second information is displayed on the terminal monitor.

13. 13. The ultrasound system according to claim 7, wherein the portable information terminal is mountable on the head of an operator who operates the ultrasound probe and the portable information terminal.

14. A control method for an ultrasound system including an ultrasound probe, a personal digital assistant, and an external device, comprising: In the ultrasonic probe, transmitting ultrasonic waves from a transducer array of the ultrasonic probe and generating a sound ray signal based on a received signal acquired by the transducer array; generating reception data before imaging by performing signal processing on the generated sound ray signals; wirelessly transmitting the received data to the portable information terminal; In the portable information terminal, a camera unit is used to acquire a field of view image of a scanning point of the ultrasonic probe on the subject; accepting input of first information by an operator of the portable information terminal; wirelessly transmitting at least the acquired field of view image and the first information whose input has been accepted to the external device; In the external device, an ultrasound image generated based on the received data and synchronized with each other and the field of view image are displayed together on an external monitor; accepting input of second information by an observer of the external monitor; wirelessly transmitting the second information to the mobile information terminal; the second information is displayed on a terminal monitor of the portable information terminal; Based on the first information input by the operator and the second information input by the observer, imaging parameters of a transmitting / receiving circuit of the ultrasound probe and imaging timing of a camera unit of the portable information terminal are controlled. A method for controlling an ultrasound system.

Images