Ultrasonic system and control method thereof

Abstract

The ultrasonic system (1) includes an ultrasonic probe (2), a mobile information terminal (3), and an external device (4). The ultrasonic probe (2) includes a transceiver circuit (22) that transmits ultrasonic waves from an oscillator array (21) and generates a sound ray signal, and a received data generation unit that generates received data before imaging based on the sound ray signal. The mobile information terminal (3) includes a camera unit (33) that acquires a field of view image. The external device (4) includes a display control unit (44) that displays an ultrasonic image and a field of view image generated based on the received data on an external monitor (45), and an input device (47). When a probe freeze instruction is input from the input device (47), the transmission of ultrasonic waves from the oscillator array (21) is stopped.

Description

Technical Field

[0001] The present invention relates to an ultrasonic system and a control method thereof, and more particularly to an ultrasonic system for displaying an ultrasonic image on a mobile information terminal and a control method thereof. Background Art

[0002] Conventionally, in the medical field, ultrasonic diagnostic devices using ultrasonic images have been put into practical use. Generally, such an ultrasonic diagnostic device has an ultrasonic probe with a built-in oscillator array and a device main body connected to the ultrasonic probe. Ultrasonic waves are sent from the ultrasonic probe to a subject, and ultrasonic echoes from the subject are received by the ultrasonic probe. An ultrasonic image is generated by electrically processing the received signal with the device main body.

[0003] In recent years, for example, as disclosed in Patent Document 1, an ultrasonic diagnostic device has been developed, which improves the convenience in ultrasonic diagnosis by including a mobile information terminal that displays an ultrasonic image obtained using an ultrasonic probe on an external monitor arranged at a position far from the user and is used for input operations of the ultrasonic probe and the external monitor.

[0004] Prior Art Documents

[0005] Patent Documents

[0006] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2017-86360 Summary of the Invention

[0007] Technical Problem to be Solved by the Invention

[0008] Generally, in ultrasonic diagnosis using the ultrasonic diagnostic device disclosed in Patent Document 1, in order to correctly grasp the part in the subject drawn in the ultrasonic image by confirming the ultrasonic image, a certain level of proficiency is required. And it is known that the image quality of the generated ultrasonic image depends largely on the operator's technique.

[0009] Here, for example, in the case of taking an ultrasonic image at a remote location outside a hospital such as in home care, the operator who operates the ultrasonic probe to take the ultrasonic image and the observer such as a doctor who observes the taken ultrasonic image for diagnosis are sometimes different.

[0010] At this time, the operator usually needs to operate the ultrasonic probe while personally confirming the obtained ultrasonic image to capture the ultrasonic image of the part in the target subject to be examined. In particular, when the operator's proficiency is low, it is sometimes difficult for the operator to determine whether the part of the target subject to be examined can be correctly observed. In addition, an operator with low proficiency sometimes cannot use appropriate techniques to operate the ultrasonic probe, resulting in a low-quality ultrasonic image. Moreover, the observer diagnoses by confirming the ultrasonic image captured by the operator of the ultrasonic diagnostic apparatus. However, since the situation of the operator capturing the ultrasonic image cannot be grasped, especially when the ultrasonic image is captured by an operator with low proficiency, it is sometimes difficult to correctly determine whether the captured ultrasonic image is captured by an appropriate technique.

[0011] The present invention is completed to solve such existing problems, and an object thereof is to provide an ultrasonic system and a control method of the ultrasonic system that can obtain an appropriate ultrasonic image and improve the accuracy of ultrasonic diagnosis even when an ultrasonic image is captured at a remote location.

[0012] Means for Solving the Technical Problem

[0013] To achieve the above object, a first ultrasonic system according to the present invention is an ultrasonic system including an ultrasonic probe, a mobile information terminal, and an external device, characterized in that the ultrasonic probe includes: an oscillator array; a transceiver circuit that generates a sound ray signal based on a reception signal obtained by transmitting ultrasonic waves from the oscillator array and acquired by the oscillator array; an ultrasonic image generation unit that generates an ultrasonic image based on the sound ray signal generated by the transceiver circuit; and a probe-side wireless communication unit that wirelessly transmits the ultrasonic image, the mobile information terminal includes: a camera unit that acquires a field-of-view image of a scanned part of the ultrasonic probe in the subject to be examined; and a terminal-side wireless communication unit that wirelessly transmits the field-of-view image acquired by the camera unit, and the external device includes: an external wireless communication unit that is wirelessly connected at least to the terminal-side wireless communication unit; an external monitor; a display control unit that displays the ultrasonic image wirelessly transmitted from the ultrasonic probe and the field-of-view image wirelessly transmitted from the mobile information terminal on the external monitor; and an external input device, and when a probe freeze instruction is input from the external input device, the probe freeze instruction is transmitted from the external wireless communication unit, and the transmission of ultrasonic waves from the oscillator array by the transceiver circuit of the ultrasonic probe is stopped.

[0014] When a probe freeze instruction is input from the external input device, it is preferable that the probe freeze instruction is transmitted from the external wireless communication unit to the probe-side wireless communication unit via the terminal-side wireless communication unit.

[0015] At this time, when a probe freeze instruction is input from the external input device, it is preferable that the acquisition of the field-of-view image by the camera unit of the mobile information terminal is stopped.

[0016] Alternatively, when a probe freeze instruction is input from an external input device, the probe freeze instruction can also be sent from the external wireless communication unit to the probe-side wireless communication unit.

[0017] The external wireless communication unit can be wirelessly connected to both the probe-side wireless communication unit and the terminal-side wireless communication unit, and the probe-side wireless communication unit wirelessly transmits ultrasonic images to both the mobile information terminal and the external device.

[0018] Alternatively, the probe-side wireless communication unit can also wirelessly transmit ultrasonic images to the mobile information terminal, and the terminal-side wireless communication unit wirelessly transmits the ultrasonic images wirelessly transmitted from the probe-side wireless communication unit and the field-of-view images acquired by the camera unit to the external device.

[0019] Moreover, the external monitor can also include a microphone, and the transmission stop of the ultrasonic waves from the oscillator array is cancelled by the voice input via the microphone.

[0020] Moreover, the external device can include an image synchronization unit that synchronizes ultrasonic images and field-of-view images with each other.

[0021] At this time, the external device can include: an image memory that stores ultrasonic images and field-of-view images synchronized with each other by the image synchronization unit whenever a probe freeze instruction is input from the external input device; and a thumbnail image generation unit that generates a plurality of thumbnail images composed of the ultrasonic images and field-of-view images stored in the image memory, and causes the generated plurality of thumbnail images to be displayed in a list on the external monitor.

[0022] Moreover, the mobile information terminal can also include a terminal monitor, on which ultrasonic images and field-of-view images are displayed.

[0023] At this time, the mobile information terminal can include a terminal input device, and when a probe freeze instruction is input from the external input device or the terminal input device, it is displayed as the meaning of the probe freeze instruction on the external monitor and the terminal monitor.

[0024] In addition, the external input device has a touch sensor disposed overlapping with the external monitor, and the terminal input device has a touch sensor disposed overlapping with the terminal monitor. When a probe freeze instruction is input from the external input device or the terminal input device, the transmission stop of the ultrasonic waves from the oscillator array is cancelled by touching any one of the cancel button displayed on the external monitor, the display indicating the meaning of the probe freeze instruction displayed on the external monitor, the cancel button displayed on the terminal monitor, and the display indicating the meaning of the probe freeze instruction displayed on the terminal monitor.

[0025] Alternatively, the mobile information terminal may also include a microphone, and the transmission of ultrasonic waves from the oscillator array may be stopped by voice input via the microphone.

[0026] Moreover, the mobile information terminal may include an image synchronization unit that synchronizes the ultrasonic image and the visual field image with each other.

[0027] Furthermore, the external wireless communication unit may wirelessly transmit external advice information input via an external input device to the terminal-side wireless communication unit, and the external advice information may be displayed on the terminal monitor.

[0028] In addition, the external device may include a measurement unit that analyzes the ultrasonic image and measures the measurement object in the ultrasonic image.

[0029] Alternatively, the mobile information terminal may also include a measurement unit that analyzes the ultrasonic image and measures the measurement object in the ultrasonic image.

[0030] Alternatively, a server connected to the mobile information terminal and the external device is provided.

[0031] The server may also include a measurement unit that analyzes the ultrasonic image and measures the measurement object in the ultrasonic image.

[0032] Moreover, wireless communication of voice data may be performed bidirectionally between the terminal-side wireless communication unit and the external wireless communication unit.

[0033] A control method for a first ultrasonic system according to the present invention is a control method for an ultrasonic system including an ultrasonic probe, a mobile information terminal, and an external device. The method is characterized in that, in the ultrasonic probe, ultrasonic waves are transmitted from the oscillator array of the ultrasonic probe, and a ray signal is generated based on a received signal obtained by the oscillator array. An ultrasonic image is generated based on the generated ray signal and wirelessly transmitted. In the mobile information terminal, a visual field image of a scanned portion of the ultrasonic probe in the subject is acquired and wirelessly transmitted. In the external device, the ultrasonic image wirelessly transmitted from the ultrasonic probe and the visual field image wirelessly transmitted from the mobile information terminal are displayed on an external monitor. If a probe freeze instruction is input from an external input device of the external device, the probe freeze instruction is transmitted from the external device, and the transmission of ultrasonic waves from the oscillator array of the ultrasonic probe is stopped.

[0034] The second ultrasonic system related to the present invention is an ultrasonic system including an ultrasonic probe, a mobile information terminal, and an external device, characterized in that the ultrasonic probe includes: an oscillator array; a transceiver circuit that generates a sound beam signal based on an ultrasonic wave transmitted from the oscillator array and a received signal acquired by the oscillator array; a received data generation unit that generates pre-image received data by performing signal processing on the sound beam signal generated by the transceiver circuit; and a probe-side wireless communication unit that wirelessly transmits the received data. The mobile information terminal includes: a camera unit that acquires a field-of-view image of a scanned part of the ultrasonic probe in a subject; and a terminal-side wireless communication unit that wirelessly transmits the field-of-view image acquired by the camera unit. The external device includes: an external wireless communication unit that is wirelessly connected to at least the terminal-side wireless communication unit; an external monitor; a display control unit that displays an ultrasonic image generated based on the received data wirelessly transmitted from the ultrasonic probe and the field-of-view image wirelessly transmitted from the mobile information terminal on the external monitor; and an external input device. If a probe freeze instruction is input from the external input device, the probe freeze instruction is transmitted from the external wireless communication unit, and the transmission of the ultrasonic wave from the oscillator array by the transceiver circuit of the ultrasonic probe is stopped.

[0035] When a probe freeze instruction is input from the external input device, it is preferable that the probe freeze instruction is transmitted from the external wireless communication unit to the probe-side wireless communication unit via the terminal-side wireless communication unit.

[0036] At this time, when a probe freeze instruction is input from the external input device, the acquisition of the field-of-view image by the camera unit of the mobile information terminal can be stopped.

[0037] Alternatively, when a probe freeze instruction is input from the external input device, the probe freeze instruction can also be transmitted from the external wireless communication unit to the probe-side wireless communication unit.

[0038] Moreover, the external wireless communication unit can be wirelessly connected to both the probe-side wireless communication unit and the terminal-side wireless communication unit, and the probe-side wireless communication unit wirelessly transmits the received data to both the mobile information terminal and the external device.

[0039] Alternatively, the probe-side wireless communication unit can also wirelessly transmit the received data to the mobile information terminal, and the terminal-side wireless communication unit wirelessly transmits the ultrasonic image wirelessly transmitted from the probe-side wireless communication unit and the field-of-view image acquired by the camera unit to the external device.

[0040] The external device can include an image processing unit that generates an ultrasonic image based on the received data wirelessly transmitted from the probe-side wireless communication unit.

[0041] At this time, the wireless communication unit on the probe side can also wirelessly transmit the received data to the mobile information terminal. The mobile information terminal includes an image processing unit that generates an ultrasonic image based on the received data wirelessly transmitted from the wireless communication unit on the probe side. The wireless communication unit on the terminal side wirelessly transmits the ultrasonic image generated by the image processing unit and the field of view image acquired by the camera unit to an external device.

[0042] Moreover, the external monitor can also include a microphone, and the transmission stop of the ultrasonic wave from the oscillator array can be released by the voice input via the microphone.

[0043] Furthermore, the external device can include an image synchronization unit that synchronizes the ultrasonic image and the field of view image with each other.

[0044] At this time, the external device can include: an image memory that saves the ultrasonic image and the field of view image synchronized with each other by the image synchronization unit whenever a probe freeze instruction is input from an external input device; and a thumbnail image generation unit that generates a plurality of thumbnail images composed of the ultrasonic image and the field of view image saved in the image memory, and causes the generated plurality of thumbnail images to be displayed in a list on the external monitor.

[0045] In addition, the mobile information terminal can also include a terminal monitor, on which the ultrasonic image and the field of view image are displayed.

[0046] At this time, the mobile information terminal preferably includes a terminal input device. When a probe freeze instruction is input from an external input device or the terminal input device, it is displayed as the meaning of the probe freeze instruction on the external monitor and the terminal monitor.

[0047] In addition, the external input device has a touch sensor disposed overlapping the external monitor, and the terminal input device has a touch sensor disposed overlapping the terminal monitor. When a probe freeze instruction is input from the external input device or the terminal input device, the transmission stop of the ultrasonic wave from the oscillator array is released by touching any one of the release button displayed on the external monitor, the display indicating the meaning of the probe freeze instruction displayed on the external monitor, the release button displayed on the terminal monitor, and the display indicating the meaning of the probe freeze instruction displayed on the terminal monitor.

[0048] Alternatively, the mobile information terminal can also include a microphone, and the transmission stop of the ultrasonic wave from the oscillator array can be released by the voice input via the microphone.

[0049] Moreover, the mobile information terminal can include an image synchronization unit that synchronizes the ultrasonic image and the field of view image with each other.

[0050] Also, the external wireless communication unit can wirelessly transmit external advice information input via the external input device to the terminal-side wireless communication unit, and the external advice information is displayed on the terminal monitor.

[0051] Also, the external device can include a measurement unit that analyzes an ultrasonic image and measures a measurement object within the ultrasonic image.

[0052] Alternatively, the mobile information terminal can also include a measurement unit that analyzes an ultrasonic image and measures a measurement object within the ultrasonic image.

[0053] Alternatively, a server connected to the mobile information terminal and the external device can also include a measurement unit that analyzes an ultrasonic image and measures a measurement object within the ultrasonic image.

[0054] Also, wireless communication of voice data can be performed bidirectionally between the terminal-side wireless communication unit and the external wireless communication unit.

[0055] The control method of the second ultrasonic system according to the present invention is a control method of an ultrasonic system including an ultrasonic probe, a mobile information terminal, and an external device. The method is characterized in that, in the ultrasonic probe, ultrasonic waves are transmitted from the oscillator array of the ultrasonic probe, and a ray signal is generated based on the received signal obtained by the oscillator array. An ultrasonic image is generated based on the generated ray signal and wirelessly transmitted. In the mobile information terminal, a field-of-view image of the scanned area of the ultrasonic probe in the subject is acquired and the acquired field-of-view image is wirelessly transmitted. In the external device, the ultrasonic image wirelessly transmitted from the ultrasonic probe and the field-of-view image wirelessly transmitted from the mobile information terminal are displayed on the external monitor. If a probe freeze instruction is input from the external input device of the external device, the probe freeze instruction is sent from the external device, and the transmission of ultrasonic waves from the oscillator array of the ultrasonic probe is stopped.

[0056] Advantages of the Invention

[0057] According to the present invention, since the external device includes: an external wireless communication unit wirelessly connected at least to the terminal-side wireless communication unit; an external monitor; a display control unit that displays the ultrasonic image wirelessly transmitted from the ultrasonic probe and the field-of-view image wirelessly transmitted from the mobile information terminal on the external monitor; and an external input device, if a probe freeze instruction is input from the external input device, the probe freeze instruction is sent from the external wireless communication unit, and the transmission of ultrasonic waves from the oscillator array by the transceiver circuit of the ultrasonic probe is stopped. Therefore, even when an ultrasonic image is captured at a remote location, an appropriate ultrasonic image can be obtained, and the accuracy of ultrasonic diagnosis is improved. Brief Description of the Drawings

[0058] Figure 1It is a block diagram showing the structure of the ultrasonic system according to Embodiment 1 of the present invention.

[0059] Figure 2 It is a block diagram showing the internal structure of the transceiver circuit in Embodiment 1 of the present invention.

[0060] Figure 3 It is a diagram schematically showing an example of the mobile information terminal in Embodiment 1 of the present invention.

[0061] Figure 4 It is a diagram schematically showing an example of the external device in Embodiment 1 of the present invention.

[0062] Figure 5 It is a diagram showing an example of a message indicating that the transmission of ultrasonic waves has been stopped, which is displayed on the terminal monitor in a modified example of Embodiment 1 of the present invention.

[0063] Figure 6 It is a diagram showing an example of a stop icon indicating that the transmission of ultrasonic waves has been stopped, which is displayed on the terminal monitor in a modified example of Embodiment 1 of the present invention.

[0064] Figure 7 It is a diagram showing an example of a frame line indicating that the transmission of ultrasonic waves has been stopped, which is displayed on the terminal monitor in a modified example of Embodiment 1 of the present invention.

[0065] Figure 8 It is a diagram schematically showing an example of a cursor arranged on the field of view image in another modified example of Embodiment 1 of the present invention.

[0066] Figure 9 It is a block diagram showing the structure of the mobile information terminal in yet another modified example of Embodiment 1 of the present invention.

[0067] Figure 10 It is a block diagram showing the structure of the external device in yet another modified example of Embodiment 1 of the present invention.

[0068] Figure 11 It is a block diagram showing the structure of the ultrasonic system according to Embodiment 2 of the present invention.

[0069] Figure 12 It is a block diagram showing the structure of the ultrasonic system according to Embodiment 3 of the present invention.

[0070] Figure 13 It is a block diagram showing the structure of the ultrasonic system according to Embodiment 4 of the present invention.

[0071] Figure 14 It is a block diagram showing the structure of the ultrasonic system according to Embodiment 5 of the present invention.

[0072] Figure 15 is a diagram schematically showing an example of an ultrasonic image and a field of view image displayed on an external device in Embodiment 5 of the present invention.

[0073] Figure 16 is a block diagram showing the configuration of an ultrasonic system according to Embodiment 6 of the present invention.

[0074] Figure 17 is a block diagram showing the configuration of an external device in Embodiment 7 of the present invention.

[0075] Figure 18 is a schematic diagram showing an example of a thumbnail image displayed on an external monitor in Embodiment 7 of the present invention.

[0076] Figure 19 is a block diagram showing the configuration of an external device in Embodiment 8 of the present invention.

[0077] Figure 20 is a block diagram showing the configuration of an ultrasonic system according to a modified example of Embodiment 8 of the present invention. Detailed Embodiments

[0078] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0079] The description of the constituent elements described below is based on representative embodiments of the present invention, but the present invention is not limited to such embodiments.

[0080] In addition, in this specification, a numerical range represented by "~" means a range including the numerical values described before and after "~" as the lower limit value and the upper limit value.

[0081] In this specification, "the same", "identical" include the error ranges generally allowed in the technical field.

[0082] Embodiment 1

[0083] Figure 1 shows the configuration of an ultrasonic system 1 according to Embodiment 1 of the present invention. The ultrasonic system 1 includes an ultrasonic probe 2, a mobile information terminal 3, and an external device 4. The mobile information terminal 3 and the external device 4 are wirelessly connected to the ultrasonic probe 2, and the mobile information terminal 3 and the external device 4 are wirelessly connected to each other.

[0084] The ultrasonic probe 2 is provided with an oscillator array 21, and a transceiver circuit 22, a signal processing unit 23, and a probe-side wireless communication unit 24 are sequentially connected to the oscillator array 21. The probe-side wireless communication unit 24 is connected to the mobile information terminal 3 and the external device 4 through wireless communication. And, although not shown, the signal processing unit 23 constitutes a received data generation unit.

[0085] And, a probe control unit 26 is connected to the transceiver circuit 22, the signal processing unit 23, and the probe-side wireless communication unit 24. And, the signal processing unit 23, the probe-side wireless communication unit 24, and the probe control unit 26 constitute a probe-side processor 27.

[0086] The mobile information terminal 3 is provided with a terminal-side wireless communication unit 31 that is connected to the ultrasonic probe 2 and the external device 4 through wireless communication, and an image processing unit 32 is connected to the terminal-side wireless communication unit 31. And, the mobile information terminal 3 is provided with a camera unit 33, and the camera unit 33 is connected to the terminal-side wireless communication unit 31. And, an image synchronization unit 34 is connected to the image processing unit 32 and the camera unit 33.

[0087] And, a display control unit 35 and a terminal monitor 36 are sequentially connected to the image synchronization unit 34. And, a terminal control unit 37 is connected to the terminal-side wireless communication unit 31, the image processing unit 32, the camera unit 33, the image synchronization unit 34, and the display control unit 35. And, an input device (terminal input device) 38 is connected to the terminal control unit 37. And, the terminal-side wireless communication unit 31, the image processing unit 32, the image synchronization unit 34, the display control unit 35, and the terminal control unit 37 constitute a terminal-side processor 39.

[0088] The external device 4 is provided with an external wireless communication unit 41 that is connected to the ultrasonic probe 2 and the mobile information terminal 3 through wireless communication, and an image processing unit 42 and an image synchronization unit 43 are connected to the external wireless communication unit 41. And, the image synchronization unit 43 is connected to the image processing unit 42. And, a display control unit 44 and an external monitor 45 are sequentially connected to the image synchronization unit 43.

[0089] And, an external control unit 46 is connected to the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, and the display control unit 44. And, an input device (external input device) 47 is connected to the external control unit 46. And, the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, the display control unit 44, and the external control unit 46 constitute an external device-side processor 48.

[0090] The oscillator array 21 of the ultrasonic probe 2 has a plurality of oscillators arranged in a one-dimensional or two-dimensional manner. These oscillators respectively transmit ultrasonic waves according to the drive signals supplied from the transceiver circuit 22, and receive ultrasonic echoes from the subject, thereby outputting reception signals based on the ultrasonic echoes. Each oscillator is constituted, for example, by forming electrodes at both ends of a piezoelectric body composed of piezoelectric ceramics typified by PZT (Lead Zirconate Titanate), polymer piezoelectric elements typified by PVDF (Poly Vinylidene Di Fluoride), and piezoelectric single crystals typified by PMN-PT (Lead Magnesium Niobate-Lead Titanate solid solution).

[0091] Under the control of the probe control unit 26, the transceiver circuit 22 generates a ray signal based on the reception signal obtained by transmitting ultrasonic waves from the oscillator array 21 and acquired by the oscillator array 21. As Figure 2 shown, the transceiver circuit 22 has a pulse generator 51 connected to the oscillator array 21, an amplifier 52, an AD (Analog Digital) conversion unit 53, and a beam former 54 that are connected in series in sequence from the oscillator array 21.

[0092] The pulse generator 51 includes, for example, a plurality of pulse generators, and adjusts the delay amount of each drive signal according to the transmission delay mode selected corresponding to the control signal from the probe control unit 26 and supplies it to the plurality of oscillators, so that the ultrasonic waves transmitted from the plurality of oscillators of the oscillator array 21 form an ultrasonic beam. Thus, when a pulsed or continuous-wave voltage is applied to the electrodes of the oscillators of the oscillator array 21, the piezoelectric body expands and contracts, generating pulsed or continuous-wave ultrasonic waves from each oscillator, and an ultrasonic beam is formed by the combined wave of these ultrasonic waves.

[0093] The transmitted ultrasonic beam is reflected, for example, on an object such as a part of the subject, and propagates toward the oscillator array 21 of the ultrasonic probe 2. The ultrasonic echoes propagating toward the oscillator array 21 cause each oscillator constituting the oscillator array 21 to expand and contract by receiving the propagating ultrasonic echoes, thereby generating reception signals as electrical signals, and outputting these reception signals to the amplifier 52.

[0094] The amplifier section 52 amplifies the signals input from the respective oscillators constituting the oscillator array 21, and transmits the amplified signals to the AD conversion section 53. The AD conversion section 53 converts the signals transmitted from the amplifier section 52 into digital reception data, and transmits this reception data to the beam former 54. The beam former 54 assigns respective delays to the reception data converted by the A / D conversion section 53 according to the sound velocity or the sound velocity distribution set in the reception delay mode selected corresponding to the control signal from the probe control section 26, and adds them together, thereby performing so-called reception focusing processing. Through this reception focusing processing, a line signal is obtained in which the reception data converted by the A / D conversion section 53 are coherently added together and the focus of the ultrasonic echo is narrowed.

[0095] The signal processing section 23 generates reception data before imaging by performing signal processing on the line signal generated by the beam former 54 of the transceiver circuit 22. More specifically, the signal processing section 23 performs correction of the attenuation caused by the propagation distance on the line signal generated by the beam former 54 of the transceiver circuit 22 according to the depth of the position where the ultrasonic wave is reflected, and then performs envelope detection processing, thereby generating a signal representing tomographic image information related to the tissue in the subject as reception data before imaging.

[0096] The probe-side wireless communication section 24 includes an antenna for transmitting and receiving radio waves, and modulates a carrier wave according to the reception data before imaging generated by the signal processing section 23, thereby generating a transmission signal representing the reception data before imaging. The probe-side wireless communication section 24 supplies the transmission signal thus generated to the antenna and transmits radio waves from the antenna, thereby wirelessly transmitting the reception data before imaging in sequence to the terminal-side wireless communication section 31 of the mobile information terminal 3 and the external wireless communication section 41 of the external device 4. As the modulation method of the carrier wave, ASK (Amplitude Shift Keying), PSK (Phase Shift Keying), QPSK (Quadrature Phase Shift Keying), 16QAM (16 Quadrature Amplitude Modulation), etc. can be used.

[0097] Moreover, the wireless communication among the probe-side wireless communication unit 24 of the ultrasonic probe 2, the terminal-side wireless communication unit 31 of the mobile information terminal 3, and the external wireless communication unit 41 of the external device 4 can be performed according to communication standards related to mobile communication such as 5G (5th Generation) and 4G (4th Generation), and communication standards related to short-range wireless communication such as WiFi (registered trademark), Bluetooth (registered trademark), and UWB (Ultra Wide Band).

[0098] Since it is assumed that the ultrasonic probe 2 and the mobile information terminal 3 are in the vicinity of each other, either mobile communication or short-range wireless communication can be adopted as the wireless communication between the ultrasonic probe 2 and the mobile information terminal 3.

[0099] Moreover, since it is assumed that the external device 4 is located at a remote position relative to the ultrasonic probe 2 and the mobile information terminal 3, mobile communication is preferably performed as the wireless communication between the external device 4 and the ultrasonic probe 2, and between the external device 4 and the mobile information terminal 3. In particular, from the viewpoint of reducing the time lag in data transmission between the external device 4 and the ultrasonic probe 2 and the mobile information terminal 3, mobile communication based on 5G is preferably performed as the wireless communication between the external device 4 and the ultrasonic probe 2, and between the external device 4 and the mobile information terminal 3.

[0100] The probe control unit 26 controls each part of the ultrasonic probe 2 according to a pre-stored control program or the like.

[0101] Moreover, although not shown, a probe-side storage unit is connected to the probe control unit 26. The probe-side storage unit stores the control program of the ultrasonic probe 2 and the like. As the probe-side storage unit, for example, a flash memory, a RAM (Random Access Memory), an SD card (Secure Digital card), an SSD (Solid State Drive), or the like can be used.

[0102] Moreover, although not shown, a battery is built into the ultrasonic probe 2, and power is supplied from the battery to each circuit of the ultrasonic probe 2.

[0103] In addition, the probe-side processor 27 having the signal processing unit 23, the probe-side wireless communication unit 24, and the probe control unit 26 is composed of a CPU (Central Processing Unit) and a control program for causing the CPU to perform various processes. However, it may also be composed of an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a GPU (Graphics Processing Unit), other ICs (Integrated Circuits), or may be composed by combining these.

[0104] Moreover, the signal processing unit 23, the probe-side wireless communication unit 24, and the probe control unit 26 of the probe-side processor 27 can also be partially or wholly integrated into one CPU or the like for composition.

[0105] The terminal-side wireless communication unit 31 of the mobile information terminal 3 includes an antenna for transmitting and receiving radio waves. Under the control of the terminal control unit 37, it receives a transmission signal representing the pre-image reception data transmitted by the probe-side wireless communication unit 24 of the ultrasonic probe 2 via the antenna, and outputs the pre-image reception data by demodulating the received transmission signal. In addition, the terminal-side wireless communication unit 31 sends the pre-image reception data to the image processing unit 32.

[0106] The image processing unit 32 raster-converts the pre-image reception data sent from the terminal-side wireless communication unit 31 into an image signal following the scanning method of a normal television signal, and performs various necessary image processes such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scan frequency correction, and color correction following the display format for the terminal monitor 36 on the converted image signal, thereby generating a B-mode (Brightness mode) image signal. The B-mode image signal thus generated is simply referred to as the ultrasonic image U. And the image processing unit 32 sends the generated ultrasonic image U to the image synchronization unit 34.

[0107] The camera unit 33 acquires a field-of-view image C of the scanning area of the ultrasonic probe 2 in the subject being imaged. Although not shown, the camera unit 33 includes: a photographic lens; an image sensor that captures the scanning area of the ultrasonic probe 2 through the photographic lens to acquire a field-of-view image signal as an analog signal; an analog signal processing circuit that amplifies and converts the field-of-view image signal acquired by the image sensor into a digital signal; and a digital signal processing circuit that performs various corrections such as gain on the converted digital signal to generate the field-of-view image C. The analog signal processing circuit and the digital signal processing circuit can also be incorporated into the terminal-side processor 39. The camera unit 33 sends the generated field-of-view image C to the terminal-side wireless communication unit 31 and the image synchronization unit 34. Further, the field-of-view image C sent to the terminal-side wireless communication unit 31 is wirelessly transmitted by the terminal-side wireless communication unit 31 to an external device 4.

[0108] The image synchronization unit 34 synchronizes the ultrasonic image U generated by the image processing unit 32 and the field-of-view image C generated by the camera unit 33 with each other, and generates a composite image M based on the synchronized ultrasonic image U and field-of-view image C. Here, synchronizing the ultrasonic image U and the field-of-view image C with each other means associating the ultrasonic image U and the field-of-view image C captured at the same time. For example, when a time stamp indicating the time at which the ultrasonic image U is generated by the image processing unit 32 is assigned to the ultrasonic image U, and a time stamp indicating the time at which the field-of-view image C is generated by the camera unit 33 is assigned to the field-of-view image C, the image synchronization unit 34 regards the time stamp of the ultrasonic image U as the time stamp indicating the time at which the ultrasonic image U is captured, and regards the time stamp of the field-of-view image C as the time stamp indicating the time at which the field-of-view image C is captured. By referring to the time stamps of the ultrasonic image U and the field-of-view image C, the ultrasonic image U and the field-of-view image C captured at the same time can be synchronized with each other.

[0109] Further, when the image synchronization unit 34 associates the ultrasonic image U and the field-of-view image C, for example, by referring to the time stamp of the ultrasonic image U and the time stamp of the field-of-view image C, if the difference between the time at which the ultrasonic image U is captured and the time at which the field-of-view image C is captured is within a certain range, for example, within 0.1 seconds, the ultrasonic image U and the field-of-view image C are regarded as being captured at the same time and associated with each other. Further, the image synchronization unit 34, for example, by referring to the time stamp of the ultrasonic image U and the time stamp of the field-of-view image C, selects the field-of-view image C captured at the time closest to the time at which the ultrasonic image U to be the associated object is captured, and can also associate the selected field-of-view image C with the ultrasonic image U. Further, the image synchronization unit 34, for example, selects the ultrasonic image U captured at the time closest to the time at which the field-of-view image C to be the associated object is captured, and can also associate the selected ultrasonic image U with the field-of-view image C.

[0110] The image synchronization unit 34 sends the thus synchronized ultrasonic image U and the visual field image C to the display control unit 35.

[0111] The display control unit 35, under the control of the terminal control unit 37, performs a predetermined process on the composite image M sent from the image synchronization unit 34, as Figure 3 shown, and simultaneously displays the synchronized ultrasonic image U and the visual field image C on the terminal monitor 36 of the mobile information terminal 3. Also, in Figure 3 the example shown, in addition to the ultrasonic image U and the visual field image C, a freeze button B1 for freezing the ultrasonic image U and a save button B2 for saving the ultrasonic image U and the visual field image C are also displayed. Here, freezing the ultrasonic image U means temporarily stopping the generation of the ultrasonic image U by stopping the transmission of ultrasonic waves from the oscillator array 21. Thus, the display control unit 35, under the control of the terminal control unit 37, can display so-called user interfaces such as the freeze button B1 and the save button B2 on the terminal monitor 36.

[0112] The terminal monitor 36 is a device that displays the ultrasonic image U and the visual field image C, etc. under the control of the display control unit 35, and includes, for example, display devices such as an LCD (Liquid Crystal Display) and an organic EL display (Organic Electroluminescence Display).

[0113] The input device 38 of the mobile information terminal 3 is a device for an operator to perform input operations, and includes a touch sensor arranged overlapping the terminal monitor 36. For example, the operator can input probe control information for controlling the ultrasonic probe 2 via the input device 38. The thus input probe control information is sent to the terminal-side wireless communication unit 31 through the terminal control unit 37, and is wirelessly transmitted from the terminal-side wireless communication unit 31 to the ultrasonic probe 2.

[0114] The terminal control unit 37 controls each part of the mobile information terminal 3 according to a pre-stored control program, etc.

[0115] Also, although not shown, a terminal-side storage unit is connected to the terminal control unit 37. The terminal-side storage unit stores the control program, etc. of the mobile information terminal 3. And, as the terminal-side storage unit, for example, a flash memory, a RAM, an SD card, an SSD, etc. can be used.

[0116] Also, although not shown, a battery is built in the mobile information terminal 3, and power is supplied from this battery to each circuit of the mobile information terminal 3.

[0117] In addition, the terminal-side processor 39 having a terminal-side wireless communication unit 31, an image processing unit 32, an image synchronization unit 34, a display control unit 35, and a terminal control unit 37 is composed of a CPU and a control program for causing the CPU to perform various processes. However, it may also be composed of an FPGA, a DSP, an ASIC, a GPU, or other ICs, or may be composed by combining these.

[0118] Moreover, the terminal-side wireless communication unit 31, the image processing unit 32, the image synchronization unit 34, the display control unit 35, and the terminal control unit 37 of the terminal-side processor 39 can also be partially or wholly integrated into one CPU or the like.

[0119] The external wireless communication unit 41 of the external device 4 includes an antenna for transmitting and receiving radio waves. Under the control of the external control unit 46, it receives a transmission signal representing the pre-image reception data transmitted by the probe-side wireless communication unit 24 of the ultrasonic probe 2 and a transmission signal representing the field-of-view image C transmitted by the terminal-side wireless communication unit 31 of the mobile information terminal 3 via the antenna, and outputs the pre-image reception data and the field-of-view image C by demodulating the received transmission signal. In addition, the external wireless communication unit 41 sends the pre-image reception data to the image processing unit 42 and sends the field-of-view image C to the image synchronization unit 43.

[0120] The image processing unit 42 raster-converts the pre-image reception data sent from the external wireless communication unit 41 into an image signal following the scanning method of a normal television signal, and performs various necessary image processes such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scan frequency correction, and color correction following the display format for the external monitor 45 on the converted image signal, thereby generating an ultrasonic image U. The image processing unit 42 sends the generated ultrasonic image U to the image synchronization unit 43.

[0121] The image synchronization unit 43 of the external device 4 synchronizes the ultrasonic image U sent from the image processing unit 42 and the field-of-view image C sent from the external wireless communication unit 41 with each other, and thereby generates a composite image M based on the mutually synchronized ultrasonic image U and field-of-view image C. For example, in the case where a time stamp indicating the time when the ultrasonic image U is generated by the image processing unit 42 of the external device 4 is assigned to the ultrasonic image U and a time stamp indicating the time when the field-of-view image C is generated by the camera unit 33 of the mobile information terminal 3 is assigned to the field-of-view image C, the image synchronization unit 43 regards the time stamp of the ultrasonic image U as the time stamp indicating the time when the ultrasonic image U is captured, regards the time stamp of the field-of-view image C as the time stamp indicating the time when the field-of-view image C is captured, and by referring to the time stamps of the ultrasonic image U and the field-of-view image C, can synchronize the ultrasonic image U and the field-of-view image C captured at the same time with each other.

[0122] Under the control of the external control unit 46, the display control unit 44 performs a prescribed process on the composite image M sent from the image synchronization unit 43, and as Figure 4 shown, the synchronized ultrasonic image U and the field of view image C are displayed together on the external monitor 45 of the external device 4. In Figure 4 the example shown, in addition to the ultrasonic image U and the field of view image C, a freeze button B1 and a save button B2 are also displayed. In this way, the display control unit 44 can cause user interfaces such as the freeze button B1 and the save button B2 to be displayed on the external monitor 45.

[0123] The external monitor 45 is a device that displays the ultrasonic image U, the field of view image C, etc. under the control of the display control unit 44. For example, it includes display devices such as an LCD and an organic EL display.

[0124] The input device 47 of the external device 4 is a device for an operator to perform input operations, and includes a touch sensor arranged overlapping with the external monitor 45.

[0125] The external control unit 46 controls each part of the external device 4 according to a pre-stored control program or the like.

[0126] Moreover, although not shown, an external device side storage unit is connected to the external device 4. The external device side storage unit stores the control program of the external device 4 and the like. And, as the external device side storage unit, for example, a flash memory, a RAM, an SD card, an SSD, etc. can be used.

[0127] Moreover, although not shown, a battery is built in the external device 4, and power is supplied from this battery to each circuit of the external device 4.

[0128] In addition, the external device side processor 48 having the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, the display control unit 44, and the external control unit 46 is composed of a CPU and a control program for causing the CPU to perform various processes. However, it may also be composed of an FPGA, a DSP, an ASIC, a GPU, other ICs, or may be composed by combining these.

[0129] Moreover, the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, the display control unit 44, and the external control unit 46 of the external device side processor 48 may be partially or wholly integrated into one CPU or the like and composed.

[0130] Next, the operation of the ultrasonic system 1 according to Embodiment 1 of the present invention will be described.

[0131] First, the operator brings the ultrasonic probe 2 into contact with the body surface of the subject to be examined. Under the control of the probe control unit 26, an ultrasonic beam is transmitted from a plurality of oscillators of the oscillator array 21 into the subject to be examined in accordance with a drive signal from the pulse generator 51 of the transceiver circuit 22. The ultrasonic echo based on the transmitted ultrasonic beam is received by each oscillator, output as a received signal which is an analog signal to the amplifier unit 52 and amplified, and then AD-converted by the AD conversion unit 53 to obtain received data. A ray signal is generated by performing reception focusing processing on the received data by the beam former 54.

[0132] The generated ray signal is converted by the signal processing unit 23 into a signal representing tomographic image information related to the tissue in the subject to be examined, that is, the received data before imaging. At this time, after the signal processing unit 23 corrects the attenuation caused by the propagation distance of the ray signal according to the depth of the position where the ultrasonic wave is reflected, it performs envelope detection processing.

[0133] The probe-side wireless communication unit 24 wirelessly transmits the generated ray signal to the mobile information terminal 3 and the external device 4.

[0134] The terminal-side wireless communication unit 31 of the mobile information terminal 3 receives the received data before imaging wirelessly transmitted from the ultrasonic probe 2, and sends the received received data before imaging to the image processing unit 32. The image processing unit 32 raster-converts the received data before imaging sent from the terminal-side wireless communication unit 31 into an image signal following the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction following the display format for the terminal monitor 36 on the converted image signal, thereby generating an ultrasonic image U. The ultrasonic image U thus generated is sent to the image synchronization unit 34.

[0135] Moreover, the camera unit 33 of the mobile information terminal 3 acquires a field-of-view image C of the scanning part of the ultrasonic probe 2 in the subject to be examined under the control of the terminal control unit 37. Although not shown, at this time, for example, the operator can input control information indicating the intention to capture the field-of-view image C while directing the photographic lens of the camera unit 33 towards the scanning part of the ultrasonic probe 2 in the subject to be examined. In this case, for example, the control information input by the operator is input to the terminal control unit 37, and the terminal control unit 37 can control the camera unit 33 to capture the field-of-view image C in accordance with the control information. The field-of-view image C thus acquired is sent to the terminal-side wireless communication unit 31 and the image synchronization unit 34.

[0136] If the image synchronization unit 34 receives the ultrasonic image U from the image processing unit 32 and the field of view image C from the camera unit 33, it synchronizes the received ultrasonic image U and the field of view image C with each other, thereby generating a composite image M in which the synchronized ultrasonic image U and the field of view image C are integrated into one. For example, in the case where a timestamp indicating the time when the ultrasonic image U is generated by the image processing unit 32 is assigned to the ultrasonic image U and a timestamp indicating the time when the field of view image C is generated by the camera unit 33 is assigned to the field of view image C, the image synchronization unit 34 regards the timestamp of the ultrasonic image U as the timestamp indicating the time when the ultrasonic image U is captured, regards the timestamp of the field of view image C as the timestamp indicating the time when the field of view image C is captured, and by referring to the timestamps of the ultrasonic image U and the field of view image C, the ultrasonic image U and the field of view image C captured at the same time can be associated with each other.

[0137] The ultrasonic image U and the field of view image C synchronized with each other by the image synchronization unit 34 are sent to the display control unit 35 as the composite image M. After performing a predetermined process on the composite image M, the display control unit 35 sends the composite image M to the terminal monitor 36. As Figure 3 shown, the ultrasonic image U and the field of view image C are displayed together on the terminal monitor 36. In Figure 3 the example shown, the field of view image C and the ultrasonic image U are respectively displayed above and below the terminal monitor 36. And in this example, the state where the ultrasonic probe 2 contacts the abdomen of the subject is drawn on the field of view image C, and the internal tissues of the abdomen of the subject are drawn on the ultrasonic image U. Therefore, by confirming the terminal monitor 36 of the mobile information terminal 3, the operator can simultaneously confirm the field of view image C of the scanning part of the ultrasonic probe 2 in the subject and the ultrasonic image U corresponding to the field of view image C, so that it is easy to establish a corresponding relationship between the scanning part of the ultrasonic probe 2 in the subject and the tissues in the subject being observed and master it.

[0138] Moreover, the field of view image C acquired by the camera unit 33 is wirelessly transmitted from the terminal side wireless communication unit 31 to the external device 4.

[0139] The external wireless communication unit 41 of the external device 4 receives the pre-image reception data wirelessly transmitted from the ultrasonic probe 2 and the field of view image C wirelessly transmitted from the mobile information terminal 3, sends the received pre-image reception data to the image processing unit 42, and sends the received field of view image C to the image synchronization unit 43.

[0140] The image processing unit 42 raster-converts the received data before imaging sent from the external wireless communication unit 41 into an image signal that follows the scanning method of a normal television signal, and performs various necessary image processing operations such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scan frequency correction, and color correction on the converted image signal in accordance with the display format used by the external monitor 45, thereby generating an ultrasonic image U. The image processing unit 42 sends the generated ultrasonic image U to the image synchronization unit 43.

[0141] The image synchronization unit 43 synchronizes the ultrasonic image U sent from the image processing unit 42 and the field of view image C sent from the external wireless communication unit 41 with each other, thereby generating a composite image M in which the ultrasonic image U and the field of view image C that are synchronized with each other are integrated into one. For example, in the case where a time stamp indicating the time when the ultrasonic image U is generated by the image processing unit 42 of the external device 4 is assigned to the ultrasonic image U, and a time stamp indicating the time when the field of view image C is generated by the camera unit 33 of the mobile information terminal 3 is assigned to the field of view image C, the image synchronization unit 43 regards the time stamp of the ultrasonic image U as the time stamp indicating the time when the ultrasonic image U is captured, and regards the time stamp of the field of view image C as the time stamp indicating the time when the field of view image C is captured, and thus, by referring to the time stamps of the ultrasonic image U and the field of view image C, the ultrasonic image U and the field of view image C captured at the same time can be synchronized with each other. At this time, the time in the mobile information terminal 3 and the time in the external device 4 can be shared with each other.

[0142] In addition, the time in the mobile information terminal 3 and the time in the external device 4 can be shared with each other. Specifically, for example, based on either the mobile information terminal 3 or the external device 4, the time can be shared. And, for example, in the case where either the mobile information terminal 3 or the external device 4 is connected to the Internet, communication protocols such as NTP (Network Time Protocol) and NITZ (Network Identity and Time Zone) can be used to set the time of the built-in clock.

[0143] The ultrasonic image U and the field of view image C synchronized with each other by the image synchronization unit 43 are sent to the display control unit 44 as a composite image M. After performing a prescribed process on the composite image M, the display control unit 44 sends the composite image M to the external monitor 45, as Figure 4 shown, and the ultrasonic image U and the field of view image C are displayed together on the external monitor 45. In Figure 4In the example, the external device 4 is a portable terminal identical to the mobile information terminal 3. Above and below the terminal monitor 36 of the external device 4, a visual field image C and an ultrasonic image U are respectively displayed. Also, in this example, similar to the ultrasonic image U and the visual field image C displayed on the terminal monitor 36 of the mobile information terminal 3, the state where the ultrasonic probe 2 contacts the abdomen of the subject is drawn on the visual field image C, and the internal tissues of the abdomen of the subject are drawn on the ultrasonic image U.

[0144] Here, the visual field image C and the ultrasonic image U that are synchronized with each other are respectively displayed on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4. However, the same visual field image C and ultrasonic image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, when the external device 4 is located at a remote position relative to the mobile information terminal 3, an observer observing the external monitor 45 can also observe the visual field image C and the ultrasonic image U captured at the examination site where the subject and the operator are located almost in real time.

[0145] Also, if the probe freezing instruction indicating the intention to freeze the ultrasonic image U is input by the ultrasonic probe 2 and the operator of the mobile information terminal 3 via the input device 38 of the mobile information terminal 3, the input probe freezing instruction is input to the terminal control unit 37. Triggered by the input of the probe freezing instruction, the terminal control unit 37 controls the camera unit 33 to stop the shooting of the visual field image C.

[0146] Moreover, the terminal-side wireless communication unit 31 wirelessly transmits the probe freezing instruction sent from the terminal control unit 37 to the probe-side wireless communication unit 24 of the ultrasonic probe 2. The probe-side wireless communication unit 24 receives the probe freezing instruction wirelessly transmitted from the probe-side wireless communication unit 24 and inputs the received probe freezing instruction to the probe control unit 26. The probe control unit 26 controls the transceiver circuit 22 according to the probe freezing instruction to stop the transmission of ultrasonic waves from the oscillator array 21, and the transmission of ultrasonic waves from the oscillator array 21 is stopped.

[0147] Thus, by inputting a probe freezing instruction via the input device 38 of the mobile information terminal 3, the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2 and the shooting of the field of view image C by the camera unit 33 of the mobile information terminal 3 are stopped. As a result, on the terminal monitor 36 of the mobile information terminal 3, the display of the ultrasonic image U and the field of view image C is temporarily stopped, and the ultrasonic image U and the field of view image C before the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the field of view image C by the camera unit 33 are about to be stopped are displayed. Also, on the external monitor 45 of the external device 4, similar to the terminal monitor 36 of the mobile information terminal 3, the display of the ultrasonic image U and the field of view image C is temporarily stopped, and the ultrasonic image U and the field of view image C before the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the field of view image C by the camera unit 33 are about to be stopped are displayed.

[0148] Also, if an observer who observes the ultrasonic image U and the field of view image C displayed on the external monitor 45 inputs a probe freezing instruction indicating the intention to freeze the ultrasonic image U via the input device 47 of the external device 4, the input probe freezing instruction is sent to the external wireless communication unit 41 via the external control unit 46. The external wireless communication unit 41 wirelessly transmits the probe freezing instruction to the terminal-side wireless communication unit 31 of the mobile information terminal 3. The terminal-side wireless communication unit 31 wirelessly transmits the probe freezing instruction wirelessly transmitted by the external wireless communication unit 41 of the external device 4 to the probe-side wireless communication unit 24 of the ultrasonic probe 2, and inputs the probe freezing instruction to the terminal control unit 37.

[0149] The probe-side wireless communication unit 24 of the ultrasonic probe 2 receives the probe freezing instruction wirelessly transmitted by the terminal-side wireless communication unit 31 of the mobile information terminal 3, and inputs the received probe freezing instruction to the probe control unit 26. The probe control unit 26 controls the transceiver circuit 22 according to the probe freezing instruction to stop the transmission of ultrasonic waves from the oscillator array 21.

[0150] Also, the terminal control unit 37 uses the input of the probe freezing instruction as a trigger to control the camera unit 33 to stop the shooting of the field of view image C.

[0151] Thus, by inputting a probe freezing instruction via the input device 47 of the external device 4, the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2 and the shooting of the visual field image C by the camera unit 33 of the mobile information terminal 3 are stopped. As a result, in the terminal monitor 36 of the mobile information terminal 3, the display of the ultrasonic image U and the visual field image C is temporarily stopped, and the ultrasonic image U and the visual field image C before the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the visual field image C by the camera unit 33 are about to be stopped are displayed. Also, in the external monitor 45 of the external device 4, similarly to the terminal monitor 36 of the mobile information terminal 3, the display of the ultrasonic image U and the visual field image C is temporarily stopped, and the ultrasonic image U and the visual field image C before the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the visual field image C by the camera unit 33 are about to be stopped are displayed.

[0152] However, as is well known, generally, in order to accurately grasp the part in the subject under examination drawn on the ultrasonic image by confirming the ultrasonic image, a certain degree of proficiency is required. Also, it is known that the image quality of the ultrasonic image generated in the ultrasonic diagnostic apparatus depends greatly on the operator's technique.

[0153] For example, in the case of shooting an ultrasonic image at a remote location outside the hospital such as in home care, the operator who operates the ultrasonic probe to shoot the ultrasonic image and the observer such as a doctor who observes the shot ultrasonic image for diagnosis are sometimes different from each other. At this time, the operator usually needs to confirm the obtained ultrasonic image by himself / herself while operating the ultrasonic probe to shoot the ultrasonic image of the part in the target subject under examination. However, especially when the operator's proficiency is low, it is sometimes difficult for the operator to judge whether the part of the target subject has been correctly observed. Also, an operator with low proficiency sometimes cannot use an appropriate technique to operate the ultrasonic probe, resulting in an ultrasonic image with low image quality.

[0154] Also, an observer located at a remote location from the subject and the operator confirms the ultrasonic image shot by the operator of the ultrasonic diagnostic apparatus for diagnosis. However, since the situation of the operator shooting the ultrasonic image cannot be grasped, especially when the ultrasonic image is shot by an operator with low proficiency, it is sometimes difficult to correctly judge whether the shot ultrasonic image is an ultrasonic image shot by an appropriate technique.

[0155] According to the ultrasonic system 1 related to Embodiment 1 of the present invention, the same field-of-view image C and ultrasonic image U are almost simultaneously displayed on the terminal monitor 36 and the external monitor 45. Therefore, for example, when the external device 4 is located at a remote position relative to the mobile information terminal 3, an observer observing the external monitor 45 can also observe the field-of-view image C and the ultrasonic image U captured at the detection site where the subject and the operator are located almost in real time. Thus, for example, since a highly proficient observer can give real-time advice to the operator, even when the proficiency of the operator located at a remote position relative to the observer is low, an appropriate ultrasonic image U can be obtained, and the accuracy of ultrasonic diagnosis can be improved.

[0156] Moreover, according to the ultrasonic system 1 related to Embodiment 1 of the present invention, for example, it is also possible to enable an observer with low proficiency who is located at a remote position relative to the operator to confirm the field-of-view image C showing the state of a highly proficient operator operating the ultrasonic probe 2, and the appropriate ultrasonic image U corresponding to the field-of-view image C. Thus, from the perspective of education, the ultrasonic system 1 related to Embodiment 1 of the present invention is also very effective.

[0157] Furthermore, in the ultrasonic system 1 related to Embodiment 1 of the present invention, an observer observing the ultrasonic image U and the field-of-view image C displayed on the external monitor 45 inputs a probe freezing instruction via the input device 47 of the external device 4. As a result, the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2 is stopped, and the shooting of the field-of-view image C by the camera unit 33 of the mobile information terminal 3 is stopped, so that the display of the ultrasonic image U and the field-of-view image C is temporarily stopped simultaneously on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4. Therefore, for example, even when the proficiency of the operator of the ultrasonic probe 2 and the mobile information terminal 3 is low and it is difficult to determine whether an appropriate ultrasonic image U is obtained, a highly proficient observer can input a probe freezing instruction via the input device 47 of the external device 4 to temporarily stop the display of the ultrasonic image U on the terminal monitor 36 and the external monitor 45 at an appropriate moment, thereby obtaining an appropriate ultrasonic image U. And thus, the accuracy of ultrasonic diagnosis can be improved.

[0158] In addition, it has been described that the probe freezing instruction input by an observer observing the ultrasonic image U and the field-of-view image C displayed on the external monitor 45 via the input device 47 of the external device 4 is wirelessly transmitted from the external wireless communication unit 41 to the probe-side wireless communication unit 24 of the ultrasonic probe 2 via the terminal-side wireless communication unit 31 of the mobile information terminal 3, but the method of wirelessly transmitting the probe freezing instruction is not limited to this.

[0159] For example, the external wireless communication unit 41 can wirelessly send a probe freezing instruction to both the probe-side wireless communication unit 24 of the ultrasonic probe 2 and the terminal-side wireless communication unit 31 of the mobile information terminal 3. In this case, the probe freezing instruction received by the probe-side wireless communication unit 24 of the ultrasonic probe 2 is input to the probe control unit 26, and the probe control unit 26 controls the transceiver circuit 22 according to the input probe freezing instruction to stop the transmission of ultrasonic waves from the oscillator array 21. Also, the probe freezing instruction received by the terminal-side wireless communication unit 31 of the mobile information terminal 3 is input to the terminal control unit 37. The terminal control unit 37 uses the input of the probe freezing instruction as a trigger to control the display control unit 35 to temporarily stop the display of the ultrasonic image U and the field-of-view image C in the terminal monitor 36, and controls the camera unit 33 to stop the shooting of the field-of-view image C. As a result, the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the field-of-view image C by the camera unit 33 are stopped, and the display of the ultrasonic image U and the field-of-view image C is temporarily stopped simultaneously in the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4.

[0160] Also, for example, the external wireless communication unit 41 can wirelessly send a probe freezing instruction only to the probe-side wireless communication unit 24 of the ultrasonic probe 2. In this case, the probe freezing instruction received by the probe-side wireless communication unit 24 is input to the probe control unit 26 and wirelessly sent to the terminal-side wireless communication unit 31 of the mobile information terminal 3. The probe control unit 26 controls the transceiver circuit 22 according to the input probe freezing instruction to stop the transmission of ultrasonic waves from the oscillator array 21. Also, the terminal-side wireless communication unit 31 of the mobile information terminal 3 receives the probe freezing instruction wirelessly sent by the probe-side wireless communication unit 24 of the ultrasonic probe 2 and inputs the received probe freezing instruction to the terminal control unit 37. The terminal control unit 37 uses the input of the probe freezing instruction as a trigger to control the display control unit 35 to temporarily stop the display of the ultrasonic image U and the field-of-view image C in the terminal monitor 36. Also, the terminal control unit 37 uses the input of the probe freezing instruction as a trigger to control the camera unit 33 to stop the shooting of the field-of-view image C.

[0161] Also, it has been described that timestamps are respectively given to the generated ultrasonic images U in the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4. However, instead of the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4, a timestamp can be given to the ultrasonic image U, and the signal that has undergone envelope detection processing is given a timestamp by the signal processing unit 23 of the ultrasonic probe 2. In this case, for example, the time in the ultrasonic probe 2 and the time in the mobile information terminal 3 are shared with each other. Thus, based on the signal given the timestamp, the ultrasonic image U generated by the image processing unit 32 of the mobile information terminal 3 and the visual field image C generated by the camera unit 33 can be synchronized with each other, and the ultrasonic image U generated by the image processing unit 42 of the external device 4 and the visual field image C generated by the camera unit 33 can be synchronized with each other.

[0162] Here, the time in the ultrasonic probe 2 and the time in the mobile information terminal 3 can be shared, for example, based on either the ultrasonic probe 2 or the mobile information terminal 3. Also, for example, when either the ultrasonic probe 2 or the mobile information terminal 3 is connected to the Internet, communication protocols such as NTP and NITZ can be used to set the time of the built-in clock.

[0163] Also, the method of synchronizing the ultrasonic image U and the visual field image C with each other is not limited to the method using the above-mentioned timestamp. For example, as disclosed in Japanese Patent Application Laid-Open No. 2011-183056, the imaging time of the ultrasonic image U based on the ultrasonic probe 2 is synchronized with the imaging time of the visual field image C of the camera unit 33 of the mobile information terminal 3. In addition, when the time difference between the time when the ultrasonic image U is captured and the time when the visual field image C is captured is within a certain range, for example, within 0.1 second, the image synchronization unit 34 of the mobile information terminal 3 and the image synchronization unit 43 of the external device 4 regard that the ultrasonic image U and the visual field image C are captured at the same time, and the ultrasonic image U and the visual field image C can be synchronized with each other.

[0164] Also, the image synchronization unit 34 of the mobile information terminal 3 generates a composite image M in which the synchronized ultrasonic image U and visual field image C are integrated into one, and sends the generated composite image M to the display control unit 35. However, instead of generating the composite image M, the synchronized ultrasonic image U and visual field image C can be separately sent to the display control unit 35. In this case, the display control unit 35 performs prescribed processing on the ultrasonic image U and the visual field image C sent from the image synchronization unit 34, and in the terminal monitor 36, as Figure 3 shown, the synchronized ultrasonic image U and visual field image C are displayed together. Thus, the operator can simultaneously confirm the position of the ultrasonic probe 2 and the condition of the tissue in the subject corresponding thereto.

[0165] Also, similar to the image synchronization unit 43 of the external device 4, instead of generating the composite image M, the ultrasonic image U and the visual field image C that are synchronized with each other can be separately sent to the display control unit 44. In this case, the ultrasonic image U and the visual field image C that are synchronized with each other are simultaneously displayed on the external monitor 45, so that the observer who views the external monitor 45 can observe the visual field image C and the ultrasonic image U captured at the examination site where the subject and the operator are located almost in real time.

[0166] Also, the ultrasonic probe 2 and the mobile information terminal 3 are connected to each other by wireless communication. However, for example, instead of the connection based on wireless communication, they can also be connected to each other by wire communication.

[0167] Also, in Figure 4 it is exemplified that the external device 4 and the mobile information terminal 3 are both portable thin computers called so-called smartphones or tablet computers. However, the external device 4 is not limited thereto. For example, as the external device 4, so-called notebook personal computers and desktop personal computers can also be used.

[0168] Also, although not shown, a second external device having a monitor can also be set near the site where the operator examines the subject, so that the second external device is connected to the ultrasonic probe 2 and the mobile information terminal 3, and the ultrasonic image U and the visual field image C are displayed on the monitor of the second external device. In particular, when the second external device has a large monitor, the operator can more clearly confirm the ultrasonic image U and the visual field image C, so that the scanning part of the ultrasonic probe 2 in the subject and the tissue in the subject to be observed can be more clearly correlated and grasped.

[0169] Also, in Figure 3 it is exemplified that the mobile information terminal 3 is a portable thin computer called so-called smartphone or tablet computer. However, if it is a portable information terminal, it is not limited thereto. For example, as the mobile information terminal 3, a terminal device that can be worn on the operator's head can also be used. Such a terminal device, for example, in a state of being worn on the head, arranges the terminal monitor 36 to face the operator's eyes, and the camera unit 33 captures the visual field image C representing the operator's front visual field. The operator can confirm the visual field image C displayed on the terminal monitor 36 instead of directly confirming the front visual field, thereby indirectly confirming the front visual field. Thus, when the mobile information terminal 3 is worn on the operator's head, since the operator does not need to hold the mobile information terminal 3 in his hand, the operator can perform more diverse examinations. For example, a technique of operating the ultrasonic probe 2 with one hand while inserting a puncture needle into the subject with the other hand can be performed.

[0170] Also, asFigure 2 As shown, the transceiver circuit 22 has an amplification unit 52, an AD conversion unit 53, and a beam former 54. The beam former 54 can also be arranged between the transceiver circuit 22 and the signal processing unit 23 instead of inside the transceiver circuit 22. In this case, the beam former 54 can also be constituted by the probe-side processor 27.

[0171] Moreover, in the ultrasonic system 1 according to the first embodiment of the present invention, by inputting a probe freeze instruction via the input device 38 of the mobile information terminal 3 and inputting a probe freeze instruction via the input device 47 of the external device 4, the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2 and the shooting of the field-of-view image C by the camera unit 33 of the mobile information terminal 3 are stopped. However, at this time, on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4, it is possible to display instruction information transmission source information indicating the meaning of the probe freeze instruction input via the input device 38 of the mobile information terminal 3 or the meaning of the probe freeze instruction input via the input device 47 of the external device 4.

[0172] For example, in the case where an observer who observes the ultrasonic image U and the field-of-view image C displayed on the external monitor 45 inputs a probe freeze instruction via the input device 47 of the external device 4, as Figure 5 shown, on the terminal monitor 36 of the mobile information terminal 3, it is possible to display a message K indicating that a probe freeze instruction has been input via the input device 47 of the external device 4. In Figure 5 the illustrated example, the message K of "Remote Freezing" is displayed on the terminal monitor 36. At this time, although not shown, the same message K as the message K displayed on the terminal monitor 36 is also displayed on the external monitor 45. And, for example, in the case where an operator of the ultrasonic probe 2 and the mobile information terminal 3 inputs a probe freeze instruction via the input device 38 of the mobile information terminal 3, although not shown, on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4, a message K indicating that a probe freeze instruction has been input via the input device 38 of the mobile information terminal 3, such as "Local Freezing", is displayed.

[0173] Moreover, for example, in the case where an observer who observes the ultrasonic image U and the field-of-view image C displayed on the external monitor 45 inputs a probe freeze instruction via the input device 47 of the external device 4, as Figure 6As shown, in the terminal monitor 36 of the mobile information terminal 3, a stop icon N indicating that a probe freezing instruction has been input via the input device 47 of the external device 4 can be displayed. At this time, although not shown, the same stop icon N as the one displayed on the terminal monitor 36 is also displayed on the external monitor 45. And, for example, when the operator of the ultrasonic probe 2 and the mobile information terminal 3 inputs a probe freezing instruction via the input device 38 of the mobile information terminal 3, although not shown, different stop icons are displayed on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4 from the stop icon N displayed when a probe freezing instruction is input via the input device 47 of the external device 4. As such a stop icon, for example, a stop icon having a different shape, size, or color, etc. from the stop icon N displayed when a probe freezing instruction is input via the input device 47 of the external device 4 can be cited.

[0174] And, for example, when an observer who observes the ultrasonic image U and the field of view image C displayed on the external monitor 45 inputs a probe freezing instruction via the input device 47 of the external device 4, as Figure 7 shown, in the terminal monitor 36 of the mobile information terminal 3, a frame line H indicating that a probe freezing instruction has been input via the input device 47 of the external device 4 can be displayed. At this time, although not shown, the same frame line H as the one displayed on the terminal monitor 36 is also displayed on the external monitor 45. And, for example, when the operator of the ultrasonic probe 2 and the mobile information terminal 3 inputs a probe freezing instruction via the input device 38 of the mobile information terminal 3, although not shown, different frame lines are displayed on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4 from the frame line displayed when a probe freezing instruction is input via the input device 47 of the external device 4. As such a frame line, for example, a frame line having a different shape, size, thickness, or color, etc. from the frame line displayed when a probe freezing instruction is input via the input device 47 of the external device 4 can be cited.

[0175] Thus, by displaying, on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4, the indication information transmission source information indicating which one of the input device 38 of the mobile information terminal 3 and the input device 47 of the external device 4 the probe freeze indication is input from, the operator of the ultrasonic probe 2 and the mobile information terminal 3 and the observer viewing the external monitor 45 can easily grasp from which side, the mobile information terminal 3 side or the external device 4 side, the probe freeze indication is input. In particular, when the probe freeze indication is input via the input device 47 of the external device 4 and the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 of the mobile information terminal 3 is suddenly temporarily stopped, the operator of the ultrasonic probe 2 and the mobile information terminal 3 can also easily grasp that the probe freeze indication is input via the input device 47 of the external device 4. For example, operations such as saving the ultrasonic image U and the visual field image C whose display is temporarily stopped can be performed without haste.

[0176] Also, for example, in a state where the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the visual field image C by the camera unit 33 are stopped, and the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 is temporarily stopped, by the input operation of the operator via the input device 38 of the mobile information terminal 3 and the input operation of the observer via the input device 47 of the external device 4, the stop of the transmission of ultrasonic waves from the oscillator array 21 and the stop of the shooting of the visual field image C by the camera unit 33 can be released, and on the terminal monitor 36 and the external monitor 45, the ultrasonic image U and the visual field image C can be continuously displayed again.

[0177] For example, as Figure 3 and Figure 4 shown, when the freeze button B1 is displayed on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4, triggered by the operator touching the freeze button B1 displayed on the terminal monitor 36 or the observer touching the freeze button B1 displayed on the external monitor 45, the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the visual field image C by the camera unit 33 can be stopped, and the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 can be temporarily stopped. In addition, in a state where the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 is temporarily stopped, when the freeze button B1 displayed on the terminal monitor 36 or the freeze button B1 displayed on the external monitor 45 is touched again, the stop of the transmission of ultrasonic waves from the oscillator array 21 and the stop of the shooting of the visual field image C by the camera unit 33 are released, and on the terminal monitor 36 and the external monitor 45, the ultrasonic image U and the visual field image C can be continuously displayed again.

[0178] Thus, the freeze button B1 displayed on the terminal monitor 36 and the freeze button B1 displayed on the external monitor 45 can be used as release buttons for releasing the stop of the transmission of ultrasonic waves from the oscillator array 21 and the stop of the shooting of the field-of-view image C by the camera unit 33.

[0179] And, for example, on the terminal monitor 36 and the external monitor 45, Figure 5 the message K shown Figure 6 and the stop icon N shown, etc., indicate the source information of the instruction information indicating from which of the input device 38 of the mobile information terminal 3 and the input device 47 of the external device 4 the probe freeze instruction is input. In this case, when the instruction source information displayed on the terminal monitor 36 is touched by the operator or the instruction source information displayed on the external monitor 45 is touched by the observer, the stop of the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the field-of-view image C by the camera unit 33 is released, and on the terminal monitor 36 and the external monitor 45, the ultrasonic image U and the field-of-view image C can be continuously displayed again.

[0180] And, for example, as Figure 8 shown, external input information such as the cursor A that can be moved by the input operation of the observer via the input device 47 of the external device 4 can be simultaneously displayed on the external monitor 45 of the external device 4 and the terminal monitor 36 of the mobile information terminal 3. In this case, for example, if the cursor A displayed on the external monitor 45 of the external device 4 is moved by the input operation of the observer via the input device 47 of the external device 4, the cursor A displayed on the terminal monitor 36 of the mobile information terminal 3 also moves in the same way. Thus, for example, between the operator of the ultrasonic probe 2 and the mobile information terminal 3 and the observer located near the external device 4, more detailed information sharing can be performed. For example, an observer with a high proficiency in observing the ultrasonic image U and the field-of-view image C through the external monitor 45 of the external device 4 can easily support the operator with a low proficiency in the ultrasonic probe 2 and the mobile information terminal 3 in performing an examination, such as indicating the position where the ultrasonic probe 2 should be scanned using the cursor A, etc.

[0181] And, for example, the cursor A that can be moved by the input operation of the operator via the input device 38 of the mobile information terminal 3 can also be simultaneously displayed on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4. In this case, for example, an operator with a high proficiency can more easily and in detail educate an observer with a low proficiency located near the external device 4 about ultrasonic diagnosis.

[0182] In addition, the shape of the cursor A is not limited to an arrow shape, and can have any shape such as a circle or a polygon.

[0183] Moreover, for example, wireless communication of voice data can also be performed bidirectionally between the mobile information terminal 3 and the external device 4. Figure 9 The structure of the mobile information terminal 3A in a modification of Embodiment 1 of the present invention is shown. The mobile information terminal 3A Figure 1 adds a microphone 61 and a speaker 62 to the mobile information terminal 3 shown, and includes a terminal control unit 37A instead of the terminal control unit 37, and includes a terminal-side processor 39A instead of the terminal-side processor 39. In the mobile information terminal 3A, the microphone 61 and the speaker 62 are connected to the terminal-side wireless communication unit 31.

[0184] And Figure 10 The structure of the external device 4A in a modification of Embodiment 1 of the present invention is shown. The external device 4A Figure 1 adds a microphone 63 and a speaker 64 to the external device 4 shown, and includes an external control unit 46A instead of the external control unit 46, and includes an external device-side processor 48A instead of the external device-side processor 48. In the external device 4A, the microphone 63 and the speaker 64 are connected to the external wireless communication unit 41.

[0185] In a modification of Embodiment 1 of the present invention, voice data is transmitted and received bidirectionally between the mobile information terminal 3A and the external device 4A. For example, if the ultrasonic probe 2 and the operator of the mobile information terminal 3A issue a voice to the mobile information terminal 3A, the issued voice is input to the microphone 61 of the mobile information terminal 3A, and voice data is generated by the microphone 61. The generated voice data is wirelessly transmitted from the terminal-side wireless communication unit 31 to the external device 4A. The external wireless communication unit 41 of the external device 4A receives the voice data wirelessly transmitted from the mobile information terminal 3A, and sends the received voice data to the speaker 64. The speaker 64 regenerates the voice issued by the ultrasonic probe 2 and the operator of the mobile information terminal 3A according to the voice data received from the external wireless communication unit 41.

[0186] Also, for example, if an observer who observes the ultrasonic image U and the visual field image C through the external monitor 45 of the external device 4A makes a voice to the external device 4A, the voice made is input to the microphone 63 of the external device 4A, and voice data is generated by the microphone 63. The generated voice data is wirelessly transmitted from the external wireless communication unit 41 to the mobile information terminal 3A. The terminal-side wireless communication unit 31 of the mobile information terminal 3A receives the voice data wirelessly transmitted from the external device 4A, and sends out the received voice data to the speaker 62. The speaker 62 regenerates the voice made by the observer located near the external device 4A according to the voice data received from the terminal-side wireless communication unit 31.

[0187] In this way, by two-way transceiver of voice data between the mobile information terminal 3A and the external device 4A, more detailed information sharing can be performed between the operator of the ultrasonic probe 2 and the mobile information terminal 3A and the observer located near the external device 4A. For example, an observer with high proficiency in observing the ultrasonic image U and the visual field image C through the external monitor 45 of the external device 4A can more easily and detailedly give advice to an operator with low proficiency in the ultrasonic probe 2 and the mobile information terminal 3A. Also, for example, an operator with high proficiency can more easily and detailedly educate an observer with low proficiency located near the external device 4A about ultrasonic diagnosis.

[0188] Also, the voice of the operator input to the microphone 61 of the mobile information terminal 3A can be used as an input operation of the operator. For example, the terminal control unit 37A obtains instruction information by analyzing the voice data generated by the microphone 61 according to the voice of the operator, and can control each part of the mobile information terminal 3A according to the obtained instruction information. For example, the camera unit 33 starts and stops shooting the visual field image C. In addition, the ultrasonic probe 2 can also be controlled according to the voice data analyzed by the terminal control unit 37A. In this case, for example, the voice data analyzed by the terminal control unit 37A is wirelessly transmitted from the terminal-side wireless communication unit 31 to the ultrasonic probe 2 as input information from the operator, and is input to the probe control unit 26 through the probe-side wireless communication unit 24. The probe control unit 26 can control each part of the ultrasonic probe 2 according to the input information. For example, the oscillator array 21 starts and stops transmitting ultrasonic waves.

[0189] Also, the voice of the observer input to the microphone 63 of the external device 4A can be used as the input operation of the observer. For example, the external control unit 46A obtains the instruction information by analyzing the voice data generated by the microphone 63 according to the voice of the observer, and can also control each part of the ultrasonic probe 2 according to the obtained instruction information. For example, the shooting start and shooting stop of the visual field image C and other controls of each part of the mobile information terminal 3A are performed by the camera unit 33 of the mobile information terminal 3A, and the transmission start and transmission stop of ultrasonic waves and other operations of the oscillator array 21 of the ultrasonic probe 2 are performed.

[0190] Embodiment 2

[0191] In Embodiment 1, the received data before imaging obtained by envelope detection processing of the acoustic line signal is generated in the ultrasonic probe 2, and the generated received data before imaging is wirelessly transmitted to the mobile information terminal 3 and the external device 4. However, an ultrasonic image U is generated in the ultrasonic probe 2, and the generated ultrasonic image U can also be wirelessly transmitted to the mobile information terminal 3 and the external device 4.

[0192] Figure 11 shows the structure of the ultrasonic system 1B according to Embodiment 2 of the present invention. The ultrasonic system 1B is in Figure 1 In the ultrasonic system 1 of the shown Embodiment 1, the ultrasonic probe 2B is provided instead of the ultrasonic probe 2, the mobile information terminal 3B is provided instead of the mobile information terminal 3, and the external device 4B is provided instead of the external device 4.

[0193] The ultrasonic probe 2B adds an image processing unit 71 to the ultrasonic probe 2 of Embodiment 1, and is provided with a probe control unit 26B instead of the probe control unit 26, and a probe side processor 27B instead of the probe side processor 27. In the ultrasonic probe 2B, the image processing unit 71 is connected to the signal processing unit 23. Although not shown, the signal processing unit 23 and the image processing unit 71 constitute an ultrasonic image generation unit. And, the probe side wireless communication unit 24 and the probe control unit 26B are connected to the image processing unit 71.

[0194] The mobile information terminal 3B removes the image processing unit 32 from the mobile information terminal 3 of Embodiment 1, and is provided with a terminal control unit 37B instead of the terminal control unit 37, and a terminal side processor 39B instead of the terminal side processor 39. In the mobile information terminal 3B, the image synchronization unit 34 and the camera unit 33 are connected to the terminal side wireless communication unit 31.

[0195] The external device 4B removes the image processing unit 42 from the external device 4 of Embodiment 1, and is provided with an external control unit 46B instead of the external control unit 46, and an external device side processor 48B instead of the external device side processor 48.

[0196] The image processing unit 71 of the ultrasonic probe 2B converts the signal raster of the signal that has been envelope detection processed by the signal processing unit 23 into an image signal that follows the scanning method of a normal television signal, and performs various necessary image processing operations on the converted image signal, such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, thereby generating an ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3B and an ultrasonic image U in the display format for the external monitor 45 of the external device 4B. In addition, the image processing unit 71 wirelessly transmits the ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3B from the probe-side wireless communication unit 24 to the mobile information terminal 3B, and wirelessly transmits the ultrasonic image U in the display format for the external monitor 45 of the external device 4B from the probe-side wireless communication unit 24 to the external device 4B.

[0197] The terminal-side wireless communication unit 31 of the mobile information terminal 3B receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2B, and sends the received ultrasonic image U to the image synchronization unit 34.

[0198] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 and the field-of-view image C generated by the camera unit 33 with each other, and thereby generates a composite image M based on the mutually synchronized ultrasonic image U and field-of-view image C. For example, in the case where a time stamp indicating the time when the ultrasonic image U is generated by the image processing unit 71 of the ultrasonic probe 2B is assigned to the ultrasonic image U, and a time stamp indicating the time when the field-of-view image C is generated by the camera unit 33 of the mobile information terminal 3B is assigned to the field-of-view image C, the image synchronization unit 34 can synchronize the ultrasonic image U with the field-of-view image C based on the time stamps assigned to the ultrasonic image U and the field-of-view image C.

[0199] After performing a prescribed process on the composite image M generated by the image synchronization unit 34, the display control unit 35 sends the composite image M to the terminal monitor 36. As Figure 3 shown, in the terminal monitor 36, the mutually synchronized ultrasonic image U and field-of-view image C are displayed together.

[0200] The external wireless communication unit 41 of the external device 4B receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2B and the field-of-view image C wirelessly transmitted from the mobile information terminal 3B, and sends the received ultrasonic image U and field-of-view image C to the image synchronization unit 43.

[0201] The image synchronization unit 43 synchronizes the ultrasonic image U sent from the external wireless communication unit 41 with the visual field image C, and generates a composite image M based on the mutually synchronized ultrasonic image U and visual field image C.

[0202] After performing a prescribed process on the composite image M generated by the image synchronization unit 43, the display control unit 44 sends the composite image M to the external monitor 45. As Figure 4 shown, in the external monitor 45, the mutually synchronized ultrasonic image U and visual field image C are displayed together.

[0203] As described above, according to the ultrasonic system 1B according to the second embodiment of the present invention, even when the ultrasonic probe 2B is provided with the image processing unit 71, it is the same as the ultrasonic system 1 of the first embodiment in which the mobile information terminal 3 is provided with the image processing unit 32 and the external device 4 is provided with the image processing unit 42. The same visual field image C and ultrasonic image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, since an observer who observes the visual field image C and the ultrasonic image U by the external device 4B arranged at a remote location can give advice to the operator of the ultrasonic probe 2B and the mobile information terminal 3B, an appropriate ultrasonic image U can be obtained, and the accuracy of ultrasonic diagnosis can be improved.

[0204] Moreover, in the ultrasonic system 1B according to the second embodiment of the present invention, similar to the ultrasonic system 1 of the first embodiment, an observer who observes the ultrasonic image U and the visual field image C displayed on the external monitor 45 inputs a probe freeze instruction via the input device 47 of the external device 4B, the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2B is stopped, and the shooting of the visual field image C by the camera unit 33 of the mobile information terminal 3B is stopped. Thus, the display of the ultrasonic image U and the visual field image C is temporarily stopped simultaneously in the terminal monitor 36 of the mobile information terminal 3B and the external monitor 45 of the external device 4B.

[0205] Therefore, for example, even when the proficiency of the operators of the ultrasonic probe 2B and the mobile information terminal 3B is low and it is difficult to judge whether an appropriate ultrasonic image U is obtained, a highly proficient observer can input a probe freeze instruction via the input device 47 of the external device 4B to temporarily stop the display of the ultrasonic image U in the terminal monitor 36 and the external monitor 45 at an appropriate moment, thereby obtaining an appropriate ultrasonic image U. And thereby, the accuracy of ultrasonic diagnosis can be improved.

[0206] And, in Figure 1In the ultrasonic system 1 of Embodiment 1 shown, the image processing unit 32 is provided in the mobile information terminal 3, and the image processing unit 42 is provided in the external device 4. However, in the ultrasonic system 1B according to Embodiment 2, the image processing unit 71 is provided in the ultrasonic probe 2B. Therefore, the mobile information terminal 3B and the external device 4B do not need to separately have the image processing units 32 and 42, and the internal structures of the mobile information terminal 3B and the external device 4B are simplified compared to the internal structures of the mobile information terminal 3 and the external device 4 in the ultrasonic system 1 of Embodiment 1. Therefore, according to the ultrasonic system 1B according to Embodiment 2, compared to the ultrasonic system 1 of Embodiment 1, the power consumption and calculation load of the mobile information terminal 3B and the external device 4B can be reduced.

[0207] Embodiment 3

[0208] In Embodiment 1, the ultrasonic image U and the field of view image C are synchronized in the mobile information terminal 3 and the external device 4 respectively. However, for example, it is also possible to synchronize the ultrasonic image U and the field of view image C only in the mobile information terminal 3.

[0209] Figure 12 shows the structure of the ultrasonic system 1C according to Embodiment 3 of the present invention. The ultrasonic system 1C has an ultrasonic probe 2C having the same internal structure as the ultrasonic probe 2 in Figure 1 the ultrasonic system 1 of Embodiment 1 shown, and instead of the mobile information terminal 3, it has a mobile information terminal 3C, and instead of the external device 4, it has an external device 4C. The ultrasonic probe 2C is connected only to the mobile information terminal 3C by wireless communication, and the external device 4C is connected only to the mobile information terminal 3C by wireless communication.

[0210] The mobile information terminal 3C has a terminal control unit 37C instead of the terminal control unit 37 and a terminal side processor 39C instead of the terminal side processor 39 in the mobile information terminal 3 of Embodiment 1. In the mobile information terminal 3C, an image synchronization unit 34 is connected to the terminal side wireless communication unit 31. And the camera unit 33 is connected to the image synchronization unit 34.

[0211] The external device 4C removes the image processing unit 42 and the image synchronization unit 43 from the external device 4 of Embodiment 1, and has an external control unit 46C instead of the external control unit 46 and an external device side processor 48C instead of the external device side processor 48. In the external device 4C, a display control unit 44 is connected to the external wireless communication unit 41.

[0212] The probe side wireless communication unit 24 of the ultrasonic probe 2C wirelessly transmits only the pre-image reception data that has been envelope detection processed by the signal processing unit 23 to the mobile information terminal 3C.

[0213] The terminal-side wireless communication unit 31 of the mobile information terminal 3C receives the pre-image reception data wirelessly transmitted from the ultrasonic probe 2C, and sends the received pre-image reception data to the image processing unit 32.

[0214] The image processing unit 32 raster-converts the pre-image reception data sent from the terminal-side wireless communication unit 31 into an image signal that follows the scanning method of a normal television signal, and performs various necessary image processing operations on the converted image signal, such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, thereby generating an ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3C and an ultrasonic image U in the display format for the external monitor 45 of the external device 4B. In addition, the image processing unit 32 sends the ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3C and the ultrasonic image U in the display format for the external monitor 45 of the external device 4B to the image synchronization unit 34.

[0215] The camera unit 33 acquires a field-of-view image C of the scanning part of the ultrasonic probe 2C in the subject being examined, and sends the acquired field-of-view image C to the image synchronization unit 34.

[0216] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the image processing unit 32 with the field-of-view image C sent from the camera unit 33. More specifically, the image synchronization unit 34 synchronizes the ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3C with the field-of-view image C to generate a composite image M. In addition, the ultrasonic image U in the display format for the external monitor 45 of the external device 4C is synchronized with the field-of-view image C to generate a composite image M.

[0217] And the image synchronization unit 34 sends the composite image M generated based on the ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3C and the field-of-view image C that are synchronized with each other to the display control unit 35. After performing a prescribed process on the composite image M sent from the image synchronization unit 34, the display control unit 35 sends the composite image M to the terminal monitor 36. As Figure 3 shown, in the terminal monitor 36, the ultrasonic image U and the field-of-view image C that are synchronized with each other are displayed together. And the image synchronization unit 34 sends the composite image M generated based on the ultrasonic image U in the display format for the external monitor 45 of the external device 4C and the field-of-view image C to the terminal-side wireless communication unit 31.

[0218] The terminal-side wireless communication unit 31 wirelessly transmits the composite image M sent from the image synchronization unit 34 to the external device 4C.

[0219] The external wireless communication unit 41 of the external device 4C receives the composite image M wirelessly transmitted from the mobile information terminal 3C, and sends the received composite image M to the display control unit 44. After performing a prescribed process on the composite image M sent from the external wireless communication unit 41, the display control unit 44 sends the composite image M to the external monitor 45. As Figure 4 shown, on the external monitor 45, the ultrasonic image U and the visual field image C that are synchronized with each other are displayed together.

[0220] In addition, the probe freeze instruction input by the observer who observes the ultrasonic image U and the visual field image C displayed on the external monitor 45 is sent to the external wireless communication unit 41 via the input device 47 of the external device 4C and the external control unit 46C. The external wireless communication unit 41 wirelessly sends the probe freeze instruction only to the terminal-side wireless communication unit 31 of the mobile information terminal 3C. The terminal-side wireless communication unit 31 inputs the probe freeze instruction wirelessly transmitted from the external wireless communication unit 41 of the external device 4C to the terminal control unit 37C, and wirelessly transmits it to the probe control unit 26 of the ultrasonic probe 2C.

[0221] Triggered by the input of the probe freeze instruction, the terminal control unit 37C of the mobile information terminal 3C controls the camera unit 33 to stop generating the visual field image C. In addition, the probe-side wireless communication unit 24 of the ultrasonic probe 2C inputs the probe freeze instruction wirelessly transmitted from the terminal-side wireless communication unit 31 of the mobile information terminal 3C to the probe control unit 26. The probe control unit 26 controls the transceiver circuit 22 according to the input probe freeze instruction to stop the transmission of ultrasonic waves from the oscillator array 21.

[0222] As a result, the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the visual field image C by the camera unit 33 are stopped, and the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 is temporarily stopped.

[0223] As described above, according to the ultrasonic system 1C according to the third embodiment of the present invention, even when the image processing unit 32 and the image synchronization unit 34 are only provided in the mobile information terminal 3C, similar to the ultrasonic system 1 of the first embodiment in which the mobile information terminal 3 is provided with the image processing unit 32 and the external device 4 is provided with the image processing unit 42, the same visual field image C and ultrasonic image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, since the observer who observes the visual field image C and the ultrasonic image U by the external device 4C arranged at a remote location can give advice to the operator of the ultrasonic probe 2C and the mobile information terminal 3C, an appropriate ultrasonic image U can be obtained, and the accuracy of ultrasonic diagnosis can be improved.

[0224] Also, in the ultrasonic system 1C according to Embodiment 3 of the present invention, similar to the ultrasonic system 1 of Embodiment 1, an observer who observes the ultrasonic image U and the visual field image C displayed on the external monitor 45 inputs a probe freeze instruction via the input device 47 of the external device 4C. As a result, the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2C is stopped, and the shooting of the visual field image C by the camera unit 33 of the mobile information terminal 3C is stopped. Thus, the display of the ultrasonic image U and the visual field image C is temporarily stopped simultaneously on the terminal monitor 36 of the mobile information terminal 3C and the external monitor 45 of the external device 4C.

[0225] Therefore, for example, even when the proficiency of the operators of the ultrasonic probe 2C and the mobile information terminal 3C is low and it is difficult to judge whether an appropriate ultrasonic image U is obtained, an observer with high proficiency can input a probe freeze instruction via the input device 47 of the external device 4C to temporarily stop the display of the ultrasonic image U on the terminal monitor 36 and the external monitor 45 at an appropriate moment, thereby obtaining an appropriate ultrasonic image U. And thus, the accuracy of ultrasonic diagnosis can be improved.

[0226] And, in Figure 1 In the ultrasonic system 1 of Embodiment 1 shown, the external device 4 is provided with an image processing unit 42 and an image synchronization unit 43. However, in the ultrasonic system 1C according to Embodiment 3, the composite image M generated based on the ultrasonic image U and the visual field image C is wirelessly transmitted from the mobile information terminal 3C to the external device 4C. Therefore, the external device 4C does not need to have an image processing unit 42 and an image synchronization unit 43, and the internal structure of the external device 4C is simplified compared to the internal structure of the external device 4 in Embodiment 1. Therefore, according to the ultrasonic system 1C according to Embodiment 3, the power consumption and computational load of the external device 4C can be reduced.

[0227] Also, when the display of the ultrasonic image U and the visual field image C on the external monitor 45 of the external device 4C and the terminal monitor 36 of the mobile information terminal 3C is temporarily stopped by inputting a probe freeze instruction via the input device 47 of the external device 4C, a deviation may occur between the moment when the display of the ultrasonic image U and the visual field image C is temporarily stopped on the external monitor 45 and the moment when the display of the ultrasonic image U and the visual field image C is temporarily stopped on the terminal monitor 36 according to the wireless communication state between the external device 4C and the mobile information terminal 3C. At this time, for example, the ultrasonic image U and the visual field image C of several frames past with respect to the ultrasonic image U and the visual field image C displayed in a temporarily stopped state on the terminal monitor 36 are sometimes displayed in a temporarily stopped state on the external monitor 45.

[0228] In this case, for example, the ultrasonic image U and the visual field image C displayed in the terminal monitor 36 in a temporarily stopped state and the ultrasonic image U and the visual field image C displayed in the external monitor 45 in a temporarily stopped state are regarded as almost the same images, and the ultrasonic image U and the visual field image C displayed in the terminal monitor 36 and the external monitor 45 in a temporarily stopped state can be continuously displayed as they are.

[0229] Moreover, for example, the mobile information terminal 3C is equipped with an unillustrated memory for storing the composite image M generated from the ultrasonic image U and the visual field image C that are synchronized with each other. The ultrasonic image U and the visual field image C that are the same as those displayed in the external monitor 45 in a temporarily stopped state can also be retrieved from this memory and displayed on the terminal monitor 36.

[0230] For example, using the so-called 5th Generation (5G) mobile communication system, the ultrasonic probe 2C, the mobile information terminal 3C, and the external device 4C are connected to each other by wireless communication. When the frame rate of displaying the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 is set to 30 Hz, the time required for transmitting and receiving the probe freeze instruction between the ultrasonic probe 2C, the mobile information terminal 3C, and the external device 4C is about 1 ms or less. In this case, it is considered that the maximum deviation between the moment when the display of the ultrasonic image U and the visual field image C is temporarily stopped on the external monitor 45 and the moment when the display of the ultrasonic image U and the visual field image C is temporarily stopped on the terminal monitor 36 is about 1 frame amount. Therefore, when there is a deviation between the moment when the display of the ultrasonic image U and the visual field image C is temporarily stopped on the external monitor 45 and the moment when the display of the ultrasonic image U and the visual field image C is temporarily stopped on the terminal monitor 36, the ultrasonic image U and the visual field image C from one frame amount in the past are retrieved from the unillustrated memory of the mobile information terminal 3C and displayed on the terminal monitor 36, so that the ultrasonic image U and the visual field image C that are the same as those displayed in the external monitor 45 in a temporarily stopped state can be displayed on the terminal monitor 36.

[0231] Moreover, for example, the ultrasonic image U and the visual field image C displayed in a temporarily stopped state on the external monitor 45 are wirelessly transmitted from the external wireless communication unit 41 to the terminal-side wireless communication unit 31 of the mobile information terminal 3C, and the ultrasonic image U and the visual field image C wirelessly transmitted from the external wireless communication unit 41 can also be displayed on the terminal monitor 36 via the display control unit 35 of the mobile information terminal 3C. Thus, the same ultrasonic image U and visual field image C can also be displayed on the terminal monitor 36 and the external monitor 45.

[0232] Embodiment 4

[0233] In Embodiment 3, the reception data before imaging, which has been subjected to envelope detection processing by the signal processing unit 23 of the ultrasonic probe 2, is wirelessly transmitted to the mobile information terminal 3 and the external device 4. However, an ultrasonic image U can also be generated in the ultrasonic probe 2.

[0234] Figure 13 FIG. shows the structure of the ultrasonic system 1D according to Embodiment 4 of the present invention. The ultrasonic system 1D Figure 12 In the ultrasonic system 1C of the illustrated Embodiment 3, the ultrasonic probe 2D is provided instead of the ultrasonic probe 2C, the mobile information terminal 3D is provided instead of the mobile information terminal 3C, and the external device 4D is provided instead of the external device 4C. The ultrasonic probe 2D is connected only to the mobile information terminal 3D by wireless communication, and the external device 4D is connected only to the mobile information terminal 3D by wireless communication.

[0235] The ultrasonic probe 2D adds an image processing unit 81 to the ultrasonic probe 2C of Embodiment 3, and has a probe control unit 26D instead of the probe control unit 26, and a probe-side processor 27D instead of the probe-side processor 27. In the ultrasonic probe 2D, the image processing unit 81 is connected to the signal processing unit 23, and the probe-side wireless communication unit 24 and the probe control unit 26D are connected to the image processing unit 81. Although not shown, the signal processing unit 23 and the image processing unit 81 constitute an ultrasonic image generation unit.

[0236] The mobile information terminal 3D removes the image processing unit 32 from the mobile information terminal 3C of Embodiment 3, and has a terminal control unit 37D instead of the terminal control unit 37C, and a terminal-side processor 39D instead of the terminal-side processor 39C. In the mobile information terminal 3D, an image synchronization unit 34 is connected to the terminal-side wireless communication unit 31. Further, the camera unit 33 is connected to the image synchronization unit 34.

[0237] The external device 4D has an external control unit 46D instead of the external control unit 46C, and an external device-side processor 48D instead of the external device-side processor 48C in the external device 4C of Embodiment 3.

[0238] The image processing unit 81 of the ultrasonic probe 2D converts the signal raster of the signal that has undergone envelope detection processing by the signal processing unit 23 into an image signal that follows the scanning method of a normal television signal, and performs various necessary image processing operations on the converted image signal, such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, thereby generating an ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3D and an ultrasonic image U in the display format for the external monitor 45 of the external device 4D. Then, the image processing unit 81 sends these generated ultrasonic images U to the probe-side wireless communication unit 24.

[0239] The probe-side wireless communication unit 24 wirelessly transmits the ultrasonic image U sent from the image processing unit 81 to the mobile information terminal 3D.

[0240] The terminal-side wireless communication unit 31 receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2D and sends the received ultrasonic image U to the image synchronization unit 34.

[0241] The camera unit 33 acquires a field-of-view image C of the scanning part of the ultrasonic probe 2D in the subject being examined and sends the acquired field-of-view image C to the image synchronization unit 34.

[0242] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 and the field-of-view image C sent from the camera unit 33 with each other, and generates a composite image M based on the mutually synchronized ultrasonic image U and field-of-view image C. Specifically, the image synchronization unit 34 synchronizes the ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3D with the field-of-view image C, and in addition, synchronizes the ultrasonic image U in the display format for the external monitor 45 of the external device 4D with the field-of-view image C.

[0243] The image synchronization unit 34 sends the composite image M generated based on the mutually synchronized ultrasonic image U in the display format for the terminal monitor 36 and the field-of-view image C to the display control unit 35.

[0244] After performing a prescribed process on the composite image M sent from the image synchronization unit 34, the display control unit 35 sends the composite image M to the terminal monitor 36, as Figure 3 shown, and the mutually synchronized ultrasonic image U and field-of-view image C are displayed together on the terminal monitor 36.

[0245] In addition, the image synchronization unit 34 sends the composite image M generated based on the mutually synchronized ultrasonic image U in the display format for the external monitor 45 and the field-of-view image C to the terminal-side wireless communication unit 31.

[0246] The wireless communication unit 31 on the terminal side wirelessly transmits the composite image M sent from the image synchronization unit 34 to the external device 4D.

[0247] The external wireless communication unit 41 of the external device 4D receives the composite image M wirelessly transmitted from the mobile information terminal 3D, and sends the received composite image M to the display control unit 44.

[0248] After performing a prescribed process on the composite image M sent from the external wireless communication unit 41, the display control unit 44 sends the composite image M to the external monitor 45. As Figure 4 shown, the ultrasonic image U and the field of view image C that are synchronized with each other are displayed together on the external monitor 45.

[0249] As described above, according to the ultrasonic system 1D according to Embodiment 4, even when the image processing unit 81 is only provided in the ultrasonic probe 2D and the image synchronization unit 34 is only provided in the mobile information terminal 3D, it is the same as the ultrasonic system 1C of Embodiment 3 in which the mobile information terminal 3C has the image processing unit 32 and the external device 4C has the image processing unit 42. The same field of view image C and ultrasonic image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, since an observer who observes the field of view image C and the ultrasonic image U by the external device 4D located at a remote location can give advice to the operator of the ultrasonic probe 2D and the mobile information terminal 3D, an appropriate ultrasonic image U can be obtained, and the accuracy of ultrasonic diagnosis can be improved.

[0250] Moreover, in the ultrasonic system 1D according to Embodiment 4 of the present invention, similar to the ultrasonic system 1 of Embodiment 1, an observer who observes the ultrasonic image U and the field of view image C displayed on the external monitor 45 inputs a probe freeze instruction via the input device 47 of the external device 4D. As a result, the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2 is stopped, and the shooting of the field of view image C by the camera unit 33 of the mobile information terminal 3D is stopped. Thus, the display of the ultrasonic image U and the field of view image C is temporarily stopped simultaneously on the terminal monitor 36 of the mobile information terminal 3D and the external monitor 45 of the external device 4D.

[0251] Therefore, for example, even when the proficiency of the operator of the ultrasonic probe 2 and the mobile information terminal 3D is low and it is difficult to determine whether an appropriate ultrasonic image U is obtained, a highly proficient observer can input a probe freeze instruction via the input device 47 of the external device 4D to temporarily stop the display of the ultrasonic image U on the terminal monitor 36 and the external monitor 45 at an appropriate moment. Thereby, an appropriate ultrasonic image U can be obtained. And thereby, the accuracy of ultrasonic diagnosis can be improved.

[0252] Embodiment 5

[0253] In Embodiment 3, the external device 4C receives the composite image M from the mobile information terminal 3C and displays the received composite image M on the external monitor 45. Therefore, on the side of the external device 4C, the arrangement and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45 cannot be freely changed. However, according to Figure 14 the ultrasonic system 1E of Embodiment 5 shown, it is possible to arbitrarily change the arrangement and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45 on the side of the external device 4E.

[0254] Figure 14 shows the structure of the ultrasonic system 1E according to Embodiment 5 of the present invention. The ultrasonic system 1E includes an ultrasonic probe 2E having the same internal structure as the ultrasonic probe 2C in the ultrasonic system 1C of Embodiment 3, and includes a mobile information terminal 3E instead of the mobile information terminal 3C, and an external device 4E instead of the external device 4C. The ultrasonic probe 2E is connected only to the mobile information terminal 3E by wireless communication, and the external device 4E is connected only to the mobile information terminal 3E by wireless communication.

[0255] The mobile information terminal 3E includes a terminal control unit 37E instead of the terminal control unit 37 and a terminal-side processor 39E instead of the terminal-side processor 39 in the mobile information terminal 3C of Embodiment 3. In the mobile information terminal 3E, an image synchronization unit 34 is connected to the camera unit 33, and the image synchronization unit 34 is connected to the terminal-side wireless communication unit 31.

[0256] The external device 4E includes an external control unit 46E instead of the external control unit 46 and an external device-side processor 48E instead of the external device-side processor 48 in the external device 4C of Embodiment 3.

[0257] The probe-side wireless communication unit 24 of the ultrasonic probe 2E wirelessly transmits the pre-image reception data that has been envelope-detected by the signal processing unit 23 to the mobile information terminal 3E.

[0258] The terminal-side wireless communication unit 31 of the mobile information terminal 3E receives the pre-image reception data wirelessly transmitted from the ultrasonic probe 2E and sends the received pre-image reception data to the image processing unit 32.

[0259] The image processing unit 32 generates an ultrasonic image U in a display format for the terminal monitor 36 of the mobile information terminal 3E and an ultrasonic image U in a display format for the external monitor 45 of the external device 4E based on the pre-image reception data sent from the terminal-side wireless communication unit 31. And the image processing unit 32 sends these ultrasonic images U to the image synchronization unit 34.

[0260] The camera unit 33 acquires a field of view image C of the scanning area of the ultrasonic probe 2E in the subject being examined, and sends the acquired field of view image C to the image synchronization unit 34.

[0261] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 with the field of view image C sent from the camera unit 33. Specifically, the image synchronization unit 34 synchronizes the ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3E with the field of view image C, and also synchronizes the ultrasonic image U in the display format for the external monitor 45 of the external device 4E with the field of view image C.

[0262] The image synchronization unit 34 does not generate a single composite image M based on the ultrasonic image U and the field of view image C in the display format for the terminal monitor 36 that are synchronized with each other, but instead sends the ultrasonic image U and the field of view image C to the display control unit 35 respectively.

[0263] The display control unit 35 performs prescribed processing on the ultrasonic image U and the field of view image C sent from the image synchronization unit 34, and as Figure 3 shown, displays the ultrasonic image U and the field of view image C that are synchronized with each other together on the terminal monitor 36.

[0264] Also, the image synchronization unit 34 does not generate a single composite image M based on the ultrasonic image U and the field of view image C in the display format for the external monitor 45 that are synchronized with each other, but instead sends the ultrasonic image U and the field of view image C to the terminal-side wireless communication unit 31 respectively.

[0265] The terminal-side wireless communication unit 31 wirelessly transmits the ultrasonic image U and the field of view image C sent from the image synchronization unit 34 to the external device 4E.

[0266] The external wireless communication unit 41 of the external device 4E receives the ultrasonic image U and the field of view image C wirelessly transmitted from the mobile information terminal 3E, and sends the received ultrasonic image U and the field of view image C to the display control unit 44 respectively.

[0267] The display control unit 44 performs prescribed processing on the ultrasonic image U and the field of view image C sent from the external wireless communication unit 41, and displays the ultrasonic image U and the field of view image C that are synchronized with each other together on the external monitor 45.

[0268] Here, the display position, size, and other configurations and sizes of the ultrasonic image U and the visual field image C displayed on the external monitor 45 can be adjusted by the input operation of the observer via the input device 47. For example, if the observer inputs instruction information indicating the intention to adjust the configuration and size of the ultrasonic image U and the visual field image C in the external monitor 45 via the input device 47, the input instruction information is input to the display control unit 44 through the external control unit 46E. The display control unit 44 displays the ultrasonic image U and the visual field image C that are synchronized with each other according to the input instruction information. For example, according to Figure 15 the shown configuration and size. In Figure 15 the example shown, compared with the example shown in Figure 4 , the external device 4E, the ultrasonic image U, and the visual field image C are rotated by 90 degrees, and the ultrasonic image U and the visual field image C are displayed on the external monitor 45 in such a way that the visual field image C overlaps a part of the ultrasonic image U.

[0269] As described above, according to the ultrasonic system 1E according to the fifth embodiment of the present invention, since the configuration and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45 of the external device 4E can be adjusted, the observer observing the ultrasonic image U and the visual field image C displayed on the external monitor 45 can more clearly confirm the ultrasonic image U and the visual field image C according to their preferences.

[0270] Embodiment 6

[0271] In Embodiment 5, the reception data before imaging that has undergone envelope detection processing by the signal processing unit 23 is wirelessly transmitted from the probe-side wireless communication unit 24 to the mobile information terminal 3E, but the ultrasonic image U can also be generated in the ultrasonic probe 2.

[0272] Figure 16 shows the structure of the ultrasonic system 1F according to the sixth embodiment of the present invention. The ultrasonic system 1F has an ultrasonic probe 2F instead of the ultrasonic probe 2E, a mobile information terminal 3F instead of the mobile information terminal 3E, and an external device 4F instead of the external device 4E in the ultrasonic system 1E according to the fifth embodiment shown in Figure 14 . The ultrasonic probe 2F is connected to the mobile information terminal 3F only by wireless communication, and the external device 4F is connected to the mobile information terminal 3F only by wireless communication.

[0273] The ultrasonic probe 2F adds an image processing unit 91 to the ultrasonic probe 2E of Embodiment 5, and includes a probe control unit 26F instead of the probe control unit 26, and a probe-side processor 27F instead of the probe-side processor 27. In the ultrasonic probe 2F, the image processing unit 91 is connected to the signal processing unit 23, and the probe-side wireless communication unit 24 and the probe control unit 26F are connected to the image processing unit 91. And, although not shown, the signal processing unit 23 and the image processing unit 91 constitute an ultrasonic image generation unit.

[0274] The mobile information terminal 3F removes the image processing unit 32 from the mobile information terminal 3E of Embodiment 5, and includes a terminal control unit 37F instead of the terminal control unit 37E, and a terminal-side processor 39F instead of the terminal-side processor 39E. In the mobile information terminal 3F, an image synchronization unit 34 is connected to the terminal-side wireless communication unit 31. And, the camera unit 33 is connected to the image synchronization unit 34.

[0275] The external device 4F, in the external device 4E of Embodiment 5, includes an external control unit 46F instead of the external control unit 46E, and an external device-side processor 48F instead of the external device-side processor 48E.

[0276] The image processing unit 91 of the ultrasonic probe 2F converts the signal raster that has undergone envelope detection processing by the signal processing unit 23 into an image signal that follows the scanning method of a normal television signal, and performs various necessary image processing operations such as brightness correction, gray-scale correction, sharpness correction, image size correction, refresh rate correction, scan frequency correction, and color correction on the converted image signal, thereby generating an ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3F and an ultrasonic image U in the display format for the external monitor 45 of the external device 4F. And, the image processing unit 91 sends these generated ultrasonic images U to the probe-side wireless communication unit 24.

[0277] The terminal-side wireless communication unit 31 receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2F, and sends the received ultrasonic image U to the image synchronization unit 34.

[0278] The camera unit 33 acquires a field-of-view image C of the scanning part of the ultrasonic probe 2F in the subject being examined, and sends the acquired field-of-view image C to the image synchronization unit 34.

[0279] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 and the visual field image C sent from the camera unit 33 with each other. Specifically, the image synchronization unit 34 synchronizes the ultrasonic image U in the display format for the terminal monitor 36 of the mobile information terminal 3F and the visual field image C with each other, and in addition, synchronizes the ultrasonic image U in the display format for the external monitor 45 of the external device 4F and the visual field image C with each other.

[0280] The image synchronization unit 34 does not generate a single composite image M based on the ultrasonic image U and the visual field image C in the display format for the terminal monitor 36 that are synchronized with each other, but instead sends the ultrasonic image U and the visual field image C to the display control unit 35 separately.

[0281] The display control unit 35 performs prescribed processing on the ultrasonic image U and the visual field image C sent from the image synchronization unit 34, and displays the ultrasonic image U and the visual field image C that are synchronized with each other together on the terminal monitor 36.

[0282] Moreover, the image synchronization unit 34 does not generate a single composite image M based on the ultrasonic image U and the visual field image C in the display format for the external monitor 45 that are synchronized with each other, but instead sends the ultrasonic image U and the visual field image C to the terminal-side wireless communication unit 31 separately.

[0283] The terminal-side wireless communication unit 31 wirelessly transmits the ultrasonic image U and the visual field image C sent from the image synchronization unit 34 to the external device 4F.

[0284] The external wireless communication unit 41 of the external device 4F receives the ultrasonic image U and the visual field image C wirelessly transmitted from the mobile information terminal 3F, and sends the received ultrasonic image U and visual field image C to the display control unit 44 separately.

[0285] The display control unit 44 performs prescribed processing on the ultrasonic image U and the visual field image C sent from the external wireless communication unit 41, so as to display the ultrasonic image U and the visual field image C that are synchronized with each other together on the external monitor 45.

[0286] At this time, the display control unit 44 can adjust the arrangement and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45 according to the input operation of the observer via the input device 47. Thus, for example, as Figure 15 shown, the ultrasonic image U and the visual field image C that are synchronized with each other are displayed together on the external monitor 45.

[0287] As described above, according to the ultrasonic system 1F according to Embodiment 6 of the present invention, even when the ultrasonic probe 2F is provided with the image processing unit 91, it is possible to adjust the arrangement and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45 of the external device 4F. Therefore, an observer who observes the ultrasonic image U and the visual field image C displayed on the external monitor 45 can more clearly confirm the ultrasonic image U and the visual field image C according to his or her preference.

[0288] Embodiment 7

[0289] In Embodiment 1, the ultrasonic image U and the visual field image C captured by the operator of the ultrasonic probe 2 and the mobile information terminal 3 are displayed in real time on the external monitor 45 of the external device 4. However, it is also possible to save the ultrasonic image U and the visual field image C captured during the examination, and display the saved ultrasonic image U and visual field image C as so-called thumbnail images on the external monitor 45.

[0290] Figure 17 The structure of the external device 4G in Embodiment 7 of the present invention is shown. The ultrasonic system according to Embodiment 7 has Figure 1 In the ultrasonic system 1 of Embodiment 1 shown, instead of the external device 4, it is provided with Figure 17 the external device 4G shown. The ultrasonic probe 2, the mobile information terminal 3, and the external device 4G are connected to each other by wireless communication.

[0291] As Figure 17 shown, the external device 4G adds an image memory 101 and a thumbnail image generation unit 102 to the external device 4 in Embodiment 1, and instead of the external control unit 46, it is provided with an external control unit 46G, and instead of the external device side processor 48, it is provided with an external device side processor 48G. In the external device 4G, the image memory 101 is connected to the image synchronization unit 43, and the thumbnail image generation unit 102 is connected to the image memory 101. Further, the display control unit 44 and the external control unit 46G are connected to the thumbnail image generation unit 102.

[0292] The image memory 101 is a memory that stores the ultrasonic image U and the visual field image C synchronized with each other through the image synchronization unit 43. As the image memory 101, for example, a flash memory, a RAM, an SD card, an SSD, etc. can be used.

[0293] For example, in a state where the transmission of ultrasonic waves from the oscillator array 21 of the ultrasonic probe 2 and the shooting of the visual field image C by the camera unit 33 of the mobile information terminal 3 are stopped, and the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4G is temporarily stopped, an instruction to save the ultrasonic image U and the visual field image C is input via the input device 47 of the external device 4G or the input device 38 of the mobile information terminal 3 as a trigger, and the ultrasonic image U and the visual field image C synchronized with each other by the image synchronization unit 43 can be saved in the image memory 101.

[0294] More specifically, for example, as Figure 3 and Figure 4 shown, in a state where the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 is temporarily stopped by touching the freeze button B1 displayed on the terminal monitor 36 or the freeze button B1 displayed on the external monitor 45, furthermore, by touching the save button B2 displayed on the terminal monitor 36 or the save button B2 displayed on the external monitor 45, the ultrasonic image U and the visual field image C displayed in a temporarily stopped state on the terminal monitor 36 and the external monitor 45 can be saved in the image memory 101.

[0295] As Figure 18 shown, the thumbnail image generation unit 102 generates a thumbnail image TH composed of the ultrasonic image U and the visual field image C saved in the image memory 101, and causes the generated thumbnail image TH to be displayed on the external monitor 45. For example, by the observer inputting instruction information to display the thumbnail image TH on the external monitor 45 via the input device 47 of the external device 4G, the thumbnail image TH is displayed on the external monitor 45. In Figure 18 the example, a plurality of thumbnail images TH composed of the ultrasonic image U and the visual field image C synchronized with each other are displayed in a list on the external monitor 45, and the date and time DT when the ultrasonic image U and the visual field image C synchronized with each other are captured are displayed near each thumbnail image TH.

[0296] As described above, in the ultrasonic system according to Embodiment 7 of the present invention, whenever a probe freezing instruction is input from the input device 47 of the external device 4G and the input device 38 of the mobile information terminal 3, the ultrasonic image U and the visual field image C synchronized with each other by the image synchronization unit 43 are stored in the image memory 101. The thumbnail image generation unit 102 generates a thumbnail image TH based on the ultrasonic image U and the visual field image C stored in the image memory 101. Since the generated thumbnail image TH is displayed on the external monitor 45, for example, an observer viewing the external monitor 45 can compare and study the plurality of ultrasonic images U and visual field images C captured during the examination by confirming the plurality of thumbnail images TH displayed at a glance on the external monitor 45, and thus can give more appropriate advice to the operators of the ultrasonic probe 2 and the mobile information terminal 3. Thereby, the accuracy of ultrasonic diagnosis can be improved.

[0297] In addition, it has been described that the ultrasonic image U and the visual field image C synchronized with each other by the image synchronization unit 43 are stored in the image memory 101. However, for example, instead of storing the ultrasonic image U and the visual field image C in the image memory 101 respectively, a composite image M generated based on the ultrasonic image U and the visual field image C synchronized with each other can be stored in the image memory 101.

[0298] Moreover, the image memory 101 is included in the external device 4G. However, for example, instead of the external device 4G including the image memory 101, the mobile information terminal 3 can include the image memory 101, or both the external device 4G and the mobile information terminal 3 can include the image memory 101. In the case where the mobile information terminal 3 includes the image memory 101 instead of the external device 4G including the image memory 101, for example, the ultrasonic image U and the visual field image C stored in the image memory 101 are wirelessly transmitted from the terminal-side wireless communication unit 31 of the mobile information terminal 3 to the external wireless communication unit 41 of the external device 4G, and further, can be sent from the external wireless communication unit 41 to the thumbnail image generation unit 102.

[0299] Moreover, an observer viewing the external monitor 45 selects one of the plurality of thumbnail images TH displayed on the external monitor 45 via the input device 47 of the external device 4G, as Figure 3 and Figure 4 shown, the ultrasonic image U and the visual field image C corresponding to the selected thumbnail image TH can also be displayed on the external monitor 45 and the terminal monitor 36 of the mobile information terminal 3. Thereby, an observer viewing the external monitor 45 can give, for example, an instruction to reshoot the ultrasonic image U and advice while making the operators of the ultrasonic probe 2 and the mobile information terminal 3 confirm the specific ultrasonic image U and visual field image C, and thus the accuracy of ultrasonic diagnosis can be improved.

[0300] Moreover, in Embodiment 7, each time a probe freezing instruction is input by the input device 47 of the external device 4G and the input device 38 of the mobile information terminal 3, and instruction information indicating the intention to save the ultrasonic image U and the visual field image C is input, the ultrasonic image U and the visual field image C are saved in the image memory 101. However, for example, it can also be configured such that, without inputting instruction information indicating the intention to save the ultrasonic image U and the visual field image C, the ultrasonic image U and the visual field image C are automatically saved in the image memory 101 only by inputting a probe freezing instruction by the input device 47 of the external device 4G and the input device 38 of the mobile information terminal 3. Thereby, the procedures performed by the observer who observes the ultrasonic image U and the visual field image C displayed on the external monitor 45 and the operator of the ultrasonic probe 2 and the mobile information terminal 3 to save the ultrasonic image U and the visual field image C are reduced, and the ultrasonic image U and the visual field image C can be more easily saved in the image memory 101.

[0301] Moreover, for example, although not shown in the drawings, when the ultrasonic image U and the visual field image C corresponding to the thumbnail image TH are saved in the image memory 101, the instruction information transmission source information indicating which of the input device 38 of the mobile information terminal 3 and the input device 47 of the external device 4 has input the probe freezing instruction can be displayed on the external monitor 45 corresponding to each thumbnail image TH. For example, as the instruction information transmission source information, a message such as "remote freezing" or "local freezing" can be displayed near the thumbnail image TH, or two types of icons different from each other in shape, size, color, etc. can be displayed near the thumbnail image TH, or two types of frame lines different from each other in shape, size, thickness, color, etc. surrounding the thumbnail image TH can be displayed. Thereby, it is easy for the observer who views the external monitor 45 to grasp the correspondence between the thumbnail image TH displayed on the external monitor 45 and the ultrasonic image U and the visual field image C saved by inputting a probe freezing instruction via either the input device 38 of the mobile information terminal 3 or the input device 47 of the external device 4, and a plurality of thumbnail images TH can be used as a reference for comparative research.

[0302] Moreover, the method of Embodiment 7 is shown to be applicable to Embodiment 1, but it can also be similarly applicable to Embodiments 2 to 6.

[0303] Embodiment 8

[0304] In Embodiment 1, by inputting a probe freezing instruction via the input device 38 of the mobile information terminal 3 or the input device 47 of the external device 4, the ultrasonic image U and the field of view image C that are synchronized with each other are displayed in a temporarily stopped state on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4. However, it is also possible to measure the measurement object in the ultrasonic image U displayed in the temporarily stopped state by an input operation via the input device 47 of the external device 4. Here, the measurement object refers to an object such as a part of the subject included in the ultrasonic image U that becomes the measurement object.

[0305] Figure 19 shows the structure of the external device 4H according to Embodiment 8 of the present invention. The ultrasonic system according to Embodiment 8 is in Figure 1 In the ultrasonic system 1 of Embodiment 1 shown, instead of the external device 4, it is provided with Figure 19 the external device 4H shown. The ultrasonic probe 2, the mobile information terminal 3, and the external device 4H are respectively connected to each other by wireless communication.

[0306] As Figure 19 shown, the external device 4H adds a measurement unit 111 to the external device 4 of Embodiment 1, and instead of the external control unit 46, it is provided with an external control unit 46H, and instead of the external device side processor 48, it is provided with an external device side processor 48H. In the external device 4H, the measurement unit 111 is connected to the image processing unit 42. And, the external wireless communication unit 41, the display control unit 44, and the external control unit 46H are connected to the measurement unit 111.

[0307] The measurement unit 111 analyzes the ultrasonic image U generated by the image processing unit 42 to measure the measurement object in the ultrasonic image U. For example, since an instruction indicating the meaning of measurement is input by an observer via the input device 47 of the external device 4H, the ultrasonic image U for measurement is displayed on the external monitor 45. The measurement unit 111 can perform measurements such as measuring the distance between two points in the displayed ultrasonic image U according to the input operation of the observer via the input device 47. The process and result of such measurement are displayed on the external monitor 45, but at the same time, they can also be displayed on the terminal monitor 36 of the mobile information terminal 3.

[0308] As described above, according to the ultrasonic system according to Embodiment 8 of the present invention, the measurement unit 111 measures the measurement object in the ultrasonic image U according to the input operation via the input device 47 of the external device 4H. Therefore, an observer viewing the external monitor 45 can obtain more detailed information about the captured ultrasonic image U. Therefore, for example, more appropriate suggestions can be given to the operators of the ultrasonic probe 2 and the mobile information terminal 3 based on the obtained information.

[0309] In addition, in Embodiment 8, the external device 4H includes the measurement unit 111 and measures the measurement object in the ultrasonic image U according to the input operation of the observer via the input device 47 of the external device 4H. However, for example, by providing the measurement unit 111 in the mobile information terminal 3, it is also possible to measure the measurement object in the ultrasonic image U according to the input operation of the operator via the input device 38 of the mobile information terminal 3. In this case, the process and results of the measurement performed in the mobile information terminal 3 can be displayed on the external monitor 45 of the external device 4H. Thus, for example, with respect to the measurement performed by the operator of the ultrasonic probe 2 and the mobile information terminal 3, the observer viewing the external monitor 45 can give advice to the operator.

[0310] Moreover, for example, the measurement unit 111 may be provided in a server connected to the mobile information terminal 3 and the external device 4H via a network. Figure 20 FIG. shows the configuration of an ultrasonic system 1K according to a modified example of Embodiment 8 of the present invention. In the ultrasonic system 1K, an ultrasonic probe 2K is connected to a mobile information terminal 3K, and the mobile information terminal 3K and an external device 4K are connected to a server 121 via a network NW. The server 121 includes a measurement unit 122. The ultrasonic probe 2K, the mobile information terminal 3K, and the external device 4K are the same as the ultrasonic probe 2, the mobile information terminal 3, and the external device 4 in Embodiment 1, respectively.

[0311] For example, in a state where the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the visual field image C by the camera unit 33 are stopped, and the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 is temporarily stopped, an instruction to perform measurement is input as a trigger by the observer via the input device 47 of the external device 4K. For the ultrasonic image U displayed on the external monitor 45, the measurement unit 122 of the server 121 can measure the measurement object in the ultrasonic image U according to the measurement instruction of the observer input via the input device 47.

[0312] Moreover, for example, in a state where the transmission of ultrasonic waves from the oscillator array 21 and the shooting of the visual field image C by the camera unit 33 are stopped, and the display of the ultrasonic image U and the visual field image C on the terminal monitor 36 and the external monitor 45 is temporarily stopped, an instruction to perform measurement is input as a trigger by the operator via the input device 38 of the mobile information terminal 3. The measurement unit 122 of the server 121 can also measure the measurement object in the ultrasonic image U.

[0313] Thus, when the server 121 connected to the mobile information terminal 3K and the external device 4K via the network NW includes the measurement unit 122, by configuring the server 121 with a computer having high computing power, for example, advanced calculations using artificial intelligence (AI) can be performed. Therefore, according to the measurement unit 122 of the server 121, for example, when the ultrasonic image U includes the bladder of the subject, complex calculations such as calculating the urine volume in the bladder by calculating its volume can be easily performed. Thus, the observer viewing the external monitor 45 can obtain more detailed information about the captured ultrasonic image U, providing more appropriate advice to the operator of the ultrasonic probe 2K and the mobile information terminal 3K.

[0314] Moreover, the mode of Embodiment 8 shows that it can be applied to Embodiment 1, but it can also be similarly applied to Embodiments 2 to 7.

[0315] Reference Signs

[0316] 1, 1B, 1C, 1D, 1E, 1F, 1K - Ultrasonic system, 2, 2B, 2C, 2D, 2E, 2F, 2K - Ultrasonic probe, 3, 3A, 3B, 3C, 3D, 3E, 3F, 3K - Mobile information terminal, 4, 4A, 4B, 4C, 4D, 4E, 4F, 4G, 4H, 4K - External device, 21 - Transducer array, 22 - Transceiver circuit, 23 - Signal processing unit, 24 - Probe-side wireless communication unit, 26, 26B, 26D, 26F - Probe control unit, 27, 27B, 27D, 27F - Probe-side processor, 31 - Terminal-side wireless communication unit, 32, 42, 71, 81, 91 - Image processing unit, 33 - Camera unit, 34, 43 - Image synchronization unit, 35, 44 - Display control unit, 36 - Terminal monitor, 37, 37A, 37B, 37C, 37D, 37E, 37F - Terminal control unit, 38, 47 - Input device, 39, 39A, 39B, 39C, 39D, 39E, 39F - Terminal-side processor, 41 - External wireless communication unit, 45 - External monitor, 46, 46A, 46B, 46C, 46D, 46E, 46F, 46G, 46H - External control unit, 48, 48A, 48B, 48C, 48D, 48E, 48F, 48G, 48H - External device-side processor, 51 - Pulse generator, 52 - Amplifier, 53 - AD converter, 54 - Beam former, 61, 63 - Microphone, 62, 64 - Speaker, 101 - Image memory, 102 - Thumbnail image generation unit, 111, 122 - Measurement unit, 121 - Server, A - Cursor, B1 - Freeze button, B2 - Save button, C - Field of view image, DT - Date and time, H - Frame line, K - Message, N - Stop icon, NW - Network, TH - Thumbnail image, U - Ultrasonic image.

Claims

1. An ultrasonic system, comprising an ultrasonic probe, a mobile information terminal, and an external device, wherein, the ultrasonic probe includes: an oscillator array; a transceiver circuit that transmits ultrasonic waves from the oscillator array and generates a ray signal based on a received signal obtained by the oscillator array; an ultrasonic image generation unit that generates an ultrasonic image based on the ray signal generated by the transceiver circuit; and a probe-side wireless communication unit that wirelessly transmits the ultrasonic image, a timestamp indicating the time when the ultrasonic image is generated by the ultrasonic image generation unit is assigned to the ultrasonic image, the mobile information terminal includes: a camera unit that acquires a field-of-view image obtained by photographing a scanning part of the ultrasonic probe in a subject; and a terminal-side wireless communication unit that wirelessly transmits the field-of-view image acquired by the camera unit, a timestamp indicating the time when the field-of-view image is generated by the camera unit is assigned to the field-of-view image, the external device includes: an external wireless communication unit that is wirelessly connected at least to the terminal-side wireless communication unit; an external monitor; a display control unit that displays the ultrasonic image wirelessly transmitted from the ultrasonic probe and the field-of-view image wirelessly transmitted from the mobile information terminal on the external monitor; and an external input device, when a probe freeze instruction is input from the external input device, the probe freeze instruction is transmitted from the external wireless communication unit to the probe-side wireless communication unit, and the transmission of ultrasonic waves from the oscillator array by the transceiver circuit of the ultrasonic probe is stopped, the external device includes: an image synchronization unit that synchronizes the ultrasonic image and the field-of-view image photographed at the same time by referring to the timestamp of the ultrasonic image wirelessly transmitted from the ultrasonic probe and the timestamp of the field-of-view image wirelessly transmitted from the mobile information terminal; an image memory that stores the ultrasonic image and the field-of-view image synchronized with each other by the image synchronization unit every time a probe freeze instruction is input from the external input device; and a thumbnail image generation unit that generates a plurality of thumbnail images composed of the ultrasonic image and the field-of-view image stored in the image memory, and causes the generated plurality of thumbnail images to be displayed in a list on the external monitor.

2. The ultrasonic system according to claim 1, wherein, when a probe freeze instruction is input from the external input device, the probe freeze instruction is transmitted from the external wireless communication unit to the probe-side wireless communication unit via the terminal-side wireless communication unit.

3. The ultrasonic system according to claim 2, wherein, when a probe freeze instruction is input from the external input device, the acquisition of the field-of-view image by the camera unit of the mobile information terminal is stopped.

4. The ultrasonic system according to any one of claims 1 to 3, wherein, the external wireless communication unit is wirelessly connected to both the probe-side wireless communication unit and the terminal-side wireless communication unit, The probe-side wireless communication unit wirelessly transmits the ultrasonic image to both the mobile information terminal and the external device.

5. The ultrasonic system according to any one of claims 1 to 3, wherein the probe-side wireless communication unit wirelessly transmits the ultrasonic image to the mobile information terminal, the terminal-side wireless communication unit wirelessly transmits the ultrasonic image wirelessly transmitted from the probe-side wireless communication unit and the field-of-view image acquired by the camera unit to the external device.

6. An ultrasonic system, comprising an ultrasonic probe, a mobile information terminal, and an external device, wherein the ultrasonic probe includes: an oscillator array; a transceiver circuit that transmits ultrasonic waves from the oscillator array and generates a beam signal based on a received signal acquired by the oscillator array; a received data generation unit that generates pre-image received data by performing signal processing on the beam signal generated by the transceiver circuit; and a probe-side wireless communication unit that wirelessly transmits the received data, the received data generation unit assigns a timestamp to the received data, the mobile information terminal includes: a camera unit that acquires a field-of-view image obtained by photographing a scanning part of the ultrasonic probe in a subject; and a terminal-side wireless communication unit that wirelessly transmits the field-of-view image acquired by the camera unit, a timestamp indicating the time when the camera unit generates the field-of-view image is assigned to the field-of-view image, the external device includes: an external wireless communication unit that is wirelessly connected to at least the terminal-side wireless communication unit; an external monitor; a display control unit that displays an ultrasonic image generated based on the received data wirelessly transmitted from the ultrasonic probe and the field-of-view image wirelessly transmitted from the mobile information terminal on the external monitor; and an external input device, when a probe freeze instruction is input from the external input device, the probe freeze instruction is transmitted from the external wireless communication unit to the probe-side wireless communication unit, and the transmission of ultrasonic waves from the oscillator array by the transceiver circuit of the ultrasonic probe is stopped, the external device includes: an image synchronization unit that synchronizes the ultrasonic image and the field-of-view image photographed at the same time by referring to the timestamp of the ultrasonic image wirelessly transmitted from the ultrasonic probe and the timestamp of the field-of-view image wirelessly transmitted from the mobile information terminal; an image memory that stores the ultrasonic image and the field-of-view image synchronized with each other by the image synchronization unit whenever a probe freeze instruction is input from the external input device; and a thumbnail image generation unit that generates a plurality of thumbnail images composed of the ultrasonic image and the field-of-view image stored in the image memory, and causes the generated plurality of thumbnail images to be displayed in a list on the external monitor.

7. The ultrasonic system according to claim 6, wherein When a probe freezing instruction is input from the external input device, the probe freezing instruction is sent from the external wireless communication unit to the probe-side wireless communication unit via the terminal-side wireless communication unit.

8. The ultrasonic system according to claim 7, wherein when a probe freezing instruction is input from the external input device, the acquisition of the field-of-view image by the camera unit of the mobile information terminal is stopped.

9. The ultrasonic system according to any one of claims 6 to 8, wherein the external wireless communication unit is wirelessly connected to both the probe-side wireless communication unit and the terminal-side wireless communication unit, and the probe-side wireless communication unit wirelessly transmits the received data to both the mobile information terminal and the external device.

10. The ultrasonic system according to any one of claims 6 to 8, wherein the probe-side wireless communication unit wirelessly transmits the received data to the mobile information terminal, and the terminal-side wireless communication unit wirelessly transmits the received data wirelessly transmitted from the probe-side wireless communication unit and the field-of-view image acquired by the camera unit to the external device.

11. The ultrasonic system according to claim 9, wherein the external device includes an image processing unit that generates the ultrasonic image based on the received data wirelessly transmitted from the probe-side wireless communication unit.

12. The ultrasonic system according to any one of claims 6 to 8, wherein the probe-side wireless communication unit wirelessly transmits the received data to the mobile information terminal, the mobile information terminal includes an image processing unit that generates the ultrasonic image based on the received data wirelessly transmitted from the probe-side wireless communication unit, and the terminal-side wireless communication unit wirelessly transmits the ultrasonic image generated by the image processing unit and the field-of-view image acquired by the camera unit to the external device.

13. The ultrasonic system according to any one of claims 1 to 3 and 6 to 8, wherein the external monitor includes a microphone, and the stop of the transmission of ultrasonic waves from the oscillator array is released by the voice input via the microphone.

14. The ultrasonic system according to claim 4, wherein the mobile information terminal includes a terminal monitor, and the ultrasonic image and the field-of-view image are displayed on the terminal monitor.

15. The ultrasonic system according to claim 14, wherein the mobile information terminal includes a terminal input device, and when a probe freezing instruction is input from the external input device or the terminal input device, the meaning of the probe freezing instruction is displayed on the external monitor and the terminal monitor.

16. The ultrasonic system according to claim 15, wherein the external input device has a touch sensor disposed overlapping the external monitor, and the terminal input device has a touch sensor disposed overlapping the terminal monitor. When a probe freeze instruction is input from the external input device or the terminal input device, the stop of the transmission of ultrasonic waves from the oscillator array is released when any one of a release button displayed on the external monitor, a display indicating the meaning of the probe freeze instruction displayed on the external monitor, a release button displayed on the terminal monitor, or a display indicating the meaning of the probe freeze instruction displayed on the terminal monitor is touched.

17. The ultrasonic system according to claim 14 or 15, wherein, the mobile information terminal includes a microphone, the stop of the transmission of ultrasonic waves from the oscillator array is released by voice input via the microphone.

18. The ultrasonic system according to claim 14 or 15, wherein, the mobile information terminal includes an image synchronization unit that synchronizes the ultrasonic image and the field of view image with each other.

19. The ultrasonic system according to claim 14 or 15, wherein, the external wireless communication unit wirelessly transmits external advice information input via the external input device to the terminal-side wireless communication unit, the external advice information is displayed on the terminal monitor.

20. The ultrasonic system according to any one of claims 1 to 3 and 6 to 8, wherein, the external device includes a measurement unit that analyzes the ultrasonic image to measure a measurement object in the ultrasonic image.

21. The ultrasonic system according to any one of claims 1 to 3 and 6 to 8, wherein, the mobile information terminal includes a measurement unit that analyzes the ultrasonic image to measure a measurement object in the ultrasonic image.

22. The ultrasonic system according to any one of claims 1 to 3 and 6 to 8, wherein, the ultrasonic system includes a server connected to the mobile information terminal and the external device, the server includes a measurement unit that analyzes the ultrasonic image to measure a measurement object in the ultrasonic image.

23. The ultrasonic system according to any one of claims 1 to 3 and 6 to 8, wherein, two-way wireless communication of voice data is performed between the terminal-side wireless communication unit and the external wireless communication unit.

24. A control method for an ultrasonic system, the ultrasonic system including an ultrasonic probe, a mobile information terminal, and an external device, wherein, in the ultrasonic probe, ultrasonic waves are transmitted from the oscillator array of the ultrasonic probe, and a ray signal is generated based on a received signal obtained by the oscillator array, a timestamp is assigned to the ray signal, an ultrasonic image is generated based on the generated ray signal, the ultrasonic image is wirelessly transmitted, in the mobile information terminal, a field of view image obtained by photographing a scanning part of the ultrasonic probe in a subject is acquired, a timestamp indicating the time when the field of view image is generated is assigned to the field of view image, the acquired field of view image is wirelessly transmitted, in the external device, displaying the ultrasonic image wirelessly transmitted from the ultrasonic probe and the visual field image wirelessly transmitted from the mobile information terminal on an external monitor, When a probe freeze instruction is input from an external input device of the external device, the probe freeze instruction is sent from the external device to the ultrasonic probe, and the transmission of ultrasonic waves from the transducer array of the ultrasonic probe is stopped. The external device comprises: an image synchronization unit that synchronizes the ultrasonic image and the visual field image captured at the same time with each other by referring to the time stamp of the ultrasonic image wirelessly transmitted from the ultrasonic probe and the time stamp of the visual field image wirelessly transmitted from the mobile information terminal; an image memory that stores the ultrasonic image and the visual field image synchronized with each other by the image synchronization unit every time a probe freeze instruction is input from the external input device; and The thumbnail image generating unit generates a plurality of thumbnail images composed of the ultrasonic image and the field of view image stored in the image memory, and displays the generated plurality of thumbnail images in a list on the external monitor.

Images