Ultrasonic system and control method for ultrasonic system

Abstract

The invention provides an ultrasonic system and a control method of the ultrasonic system. An ultrasonic system (1) is provided with an ultrasonic probe (2), a mobile information terminal (3), and an external device (4), and the ultrasonic probe (2) is provided with a reception data generation unit that generates reception data prior to imaging on the basis of a sound beam signal, and a probe-side wireless communication unit (24) that wirelessly transmits the reception data. The mobile information terminal (3) is provided with a camera unit (33) that acquires a field image, and a terminal-side wireless communication unit (31) that wirelessly transmits the field image. The external device (4) is provided with: an external wireless communication unit (41) that is wirelessly connected to at least the terminal-side wireless communication unit (31); an external monitor (45); and a display control unit (44) that displays, on the external monitor (45), an ultrasonic image and a field-of-view image that are generated on the basis of the received data.

Description

[0001] This application is a divisional application of an invention patent application with an application date of July 16, 2020, application number: 202080057415.6 (PCT / JP2020 / 027714), and invention name: “Ultrasonic system and control method of ultrasonic system”. Technical Field

[0002] The present invention relates to an ultrasonic system and a control method of the ultrasonic system, and in particular to an ultrasonic system for displaying ultrasonic images on a mobile information terminal and a control method of the ultrasonic system. Background Art

[0003] Conventionally, ultrasonic diagnostic devices using ultrasonic images have been put into practical use in the medical field. Generally, such ultrasonic diagnostic devices include an ultrasonic probe with a built-in transducer array and a device body connected to the ultrasonic probe, and transmit ultrasonic waves to a subject, receive ultrasonic echoes from the subject with the ultrasonic probe, and generate ultrasonic images by electrically processing the received signals with the device body.

[0004] In recent years, for example, as disclosed in Patent Document 1, an ultrasonic diagnostic device has been developed that improves the convenience of ultrasonic diagnosis by having a mobile information terminal that displays ultrasonic images acquired using an ultrasonic probe on an external monitor located away from the user and is used to perform input operations on the ultrasonic probe and the external monitor.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2017-86360 Summary of the invention

[0008] Technical issues to be solved by the invention

[0009] Generally, it is known that in ultrasonic diagnosis using an ultrasonic diagnostic apparatus such as that disclosed in Patent Document 1, a certain level of proficiency is required in order to correctly understand the part of the subject drawn in the ultrasonic image by confirming the ultrasonic image. Furthermore, it is known that the quality of the generated ultrasonic image depends largely on the skill of the operator.

[0010] Here, for example, when an ultrasonic image is captured at a remote location outside a hospital such as home care, an operator who operates an ultrasonic probe to capture the ultrasonic image and an observer such as a doctor who observes the captured ultrasonic image for diagnosis may be different.

[0011] At this time, the operator usually needs to personally confirm the obtained ultrasonic image while operating the ultrasonic probe to capture the ultrasonic image of the part inside the target subject. In particular, when the operator's proficiency is low, it is sometimes difficult for the operator to determine whether the part of the target subject can be correctly observed. In addition, an operator with low proficiency sometimes cannot use appropriate techniques to operate the ultrasonic probe, resulting in an ultrasonic image with low image quality. In addition, the observer confirms the ultrasonic image captured by the operator of the ultrasonic diagnostic device for diagnosis, but because it is impossible to grasp the situation of the operator capturing the ultrasonic image, especially when the ultrasonic image is captured by an operator with low proficiency, it is sometimes difficult to correctly determine whether the captured ultrasonic image is an ultrasonic image captured by an appropriate technique.

[0012] The present invention has been made to solve such conventional problems, and an object of the present invention is to provide an ultrasonic system and a control method of the ultrasonic system that can obtain appropriate ultrasonic images and improve the accuracy of ultrasonic diagnosis even when ultrasonic images are captured at a remote location.

[0013] Means for solving technical problems

[0014] In order to achieve the above-mentioned purpose, the first ultrasound system involved in the present invention is an ultrasound system having an ultrasound probe, a mobile information terminal and an external device, characterized in that the ultrasound probe includes: a transducer array; a transceiver circuit, which generates an acoustic line signal based on the ultrasound wave sent from the transducer array and the received signal obtained by the transducer array; an ultrasound image generating unit, which generates an ultrasound image based on the acoustic line signal generated by the transceiver circuit; and a probe-side wireless communication unit, which wirelessly transmits the ultrasound image, the mobile information terminal includes: a camera unit, which obtains a field of view image of the scanning part of the ultrasound probe in the subject; and a terminal-side wireless communication unit, which wirelessly transmits the field of view image obtained by the camera unit, and the external device includes: an external wireless communication unit, which is wirelessly connected to at least the terminal-side wireless communication unit; an external monitor; and a display control unit, which displays the ultrasound image wirelessly sent from the ultrasound probe and the field of view image wirelessly sent from the mobile information terminal on the external monitor.

[0015] The external wireless communication unit can be wirelessly connected to both the probe-side wireless communication unit and the terminal-side wireless communication unit, and the probe-side wireless communication unit wirelessly transmits the ultrasonic image to both the mobile information terminal and the external device.

[0016] Furthermore, the wireless communication unit on the probe side wirelessly transmits the ultrasonic image to the mobile information terminal.

[0017] The terminal-side wireless communication unit can also wirelessly transmit the ultrasonic image wirelessly transmitted from the probe-side wireless communication unit and the visual field image acquired by the camera unit to an external device.

[0018] The external device can include an image synchronization unit that synchronizes the ultrasonic image and the visual field image with each other.

[0019] Furthermore, the mobile information terminal can also include a terminal monitor, and the ultrasonic image and the visual field image are displayed on the terminal monitor.

[0020] In this case, the mobile information terminal preferably includes an image synchronization unit that synchronizes the ultrasonic image and the visual field image with each other.

[0021] Furthermore, the external device may include an input device, and the external wireless communication unit may wirelessly transmit external input information input via the input device to the terminal-side wireless communication unit, and the external input information may be displayed on a terminal monitor.

[0022] Furthermore, wireless communication of voice data can be performed bidirectionally between the terminal-side wireless communication unit and the external wireless communication unit.

[0023] Furthermore, the mobile information terminal can be worn on the head of an operator who operates the ultrasonic probe and the mobile information terminal.

[0024] The first ultrasound system control method involved in the present invention is a control method for an ultrasound system having an ultrasound probe, a mobile information terminal and an external device, and is characterized in that, in the ultrasound probe, an acoustic line signal is generated based on ultrasound waves sent from a transducer array of the ultrasound probe and a received signal acquired by the transducer array, an ultrasound image is generated based on the generated acoustic line signal, and the ultrasound image is wirelessly transmitted to an external device, in the mobile information terminal, a field of view image of a scanning area of ​​the ultrasound probe in a subject is acquired, the acquired field of view image is wirelessly transmitted to the external device, and in the external device, the ultrasound image wirelessly transmitted from the ultrasound probe and the field of view image wirelessly transmitted from the mobile information terminal are displayed on an external monitor.

[0025] The second ultrasound system involved in the present invention is an ultrasound system having an ultrasound probe, a mobile information terminal and an external device, characterized in that the ultrasound probe includes: a transducer array; a transceiver circuit, which generates an acoustic line signal based on the ultrasound transmitted from the transducer array and the received signal acquired by the transducer array; a received data generating unit, which generates received data before imaging by performing signal processing on the acoustic line signal generated by the transceiver circuit; and a probe-side wireless communication unit, which wirelessly transmits received data, the mobile information terminal includes: a camera unit, which acquires a field of view image of a scanning part of the ultrasound probe in the subject; and a terminal-side wireless communication unit, which wirelessly transmits the field of view image acquired by the camera unit, the external device includes: an external wireless communication unit, which is wirelessly connected to at least the terminal-side wireless communication unit; an external monitor; and a display control unit, which displays the ultrasound image generated based on the received data wirelessly transmitted from the ultrasound probe and the field of view image wirelessly transmitted from the mobile information terminal on the external monitor.

[0026] The external wireless communication unit can be wirelessly connected to both the probe-side wireless communication unit and the terminal-side wireless communication unit, and the probe-side wireless communication unit wirelessly transmits received data to both the mobile information terminal and the external device.

[0027] Furthermore, the probe-side wireless communication unit can also wirelessly transmit the received data to the mobile information terminal, and the terminal-side wireless communication unit can wirelessly transmit the received data wirelessly transmitted from the probe-side wireless communication unit and the visual field image acquired by the camera unit to an external device.

[0028] Furthermore, the external device can include an image processing unit that generates an ultrasonic image based on reception data wirelessly transmitted from the probe-side wireless communication unit.

[0029] At this time, the wireless communication unit on the probe side can wirelessly send the received data to the mobile information terminal. The mobile information terminal includes an image processing unit that generates an ultrasonic image based on the received data wirelessly sent from the wireless communication unit on the probe side. The wireless communication unit on the terminal side wirelessly sends the ultrasonic image generated by the image processing unit and the field of view image acquired by the camera unit to an external device.

[0030] The external device can include an image synchronization unit that synchronizes the ultrasonic image and the visual field image with each other.

[0031] Furthermore, the mobile information terminal can also include a terminal monitor, and the ultrasonic image and the visual field image are displayed on the terminal monitor.

[0032] In this case, the mobile information terminal preferably includes an image synchronization unit that synchronizes the ultrasonic image and the visual field image with each other.

[0033] Furthermore, the external device may include an input device, and the external wireless communication unit may wirelessly transmit external input information input via the input device to the terminal-side wireless communication unit, and the external input information may be displayed on a terminal monitor.

[0034] Furthermore, wireless communication of voice data can be performed bidirectionally between the terminal-side wireless communication unit and the external wireless communication unit.

[0035] Furthermore, the mobile information terminal can be worn on the head of an operator who operates the ultrasonic probe and the mobile information terminal.

[0036] The second control method of the ultrasound system of the present invention is a control method of the ultrasound system having an ultrasound probe, a mobile information terminal and an external device, and is characterized in that, in the ultrasound probe, an acoustic line signal is generated based on an ultrasound wave sent from a transducer array of the ultrasound probe and a received signal acquired by the transducer array, received data before imaging is generated by performing signal processing on the generated acoustic line signal, the received data is wirelessly sent to an external device, in the mobile information terminal, a field of view image of a scanning part of the ultrasound probe in a subject is acquired, the acquired field of view image is wirelessly sent to an external device, and in the external device, an ultrasound image generated based on the received data wirelessly transmitted from the ultrasound probe and a field of view image wirelessly transmitted from the mobile information terminal are displayed on an external monitor.

[0037] Effects of the Invention

[0038] According to the present invention, since the ultrasonic probe includes: an ultrasonic image generating unit that generates an ultrasonic image; and a probe-side wireless communication unit that wirelessly transmits the ultrasonic image, the mobile information terminal includes: a camera unit that obtains a field of view image of a scanning part captured by the ultrasonic probe; and a terminal-side wireless communication unit that wirelessly transmits the field of view image acquired by the camera unit, the external device includes: an external wireless communication unit that is wirelessly connected to at least the terminal-side wireless communication unit; an external monitor; and a display control unit that displays the ultrasonic image wirelessly transmitted from the ultrasonic probe and the field of view image wirelessly transmitted from the mobile information terminal on the external monitor, so that even when the ultrasonic image is captured at a remote location, an appropriate ultrasonic image can be obtained and the accuracy of ultrasonic diagnosis can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is a block diagram showing the configuration of an ultrasound system according to Embodiment 1 of the present invention.

[0040] Figure 2 This is a block diagram showing the internal structure of the transmission and reception circuit in Embodiment 1 of the present invention.

[0041] Figure 3It is a diagram schematically showing an example of a mobile information terminal in Embodiment 1 of the present invention.

[0042] Figure 4 This is a diagram schematically showing an example of an external device in Embodiment 1 of the present invention.

[0043] Figure 5 This is a diagram schematically showing an example of a cursor arranged on a field of view image in a modification of the first embodiment of the present invention.

[0044] Figure 6 This is a block diagram showing the structure of a mobile information terminal in another modified example of the first embodiment of the present invention.

[0045] Figure 7 This is a block diagram showing the configuration of an external device in another modified example of the first embodiment of the present invention.

[0046] Figure 8 This is a block diagram showing the configuration of an ultrasound system according to Embodiment 2 of the present invention.

[0047] Fig. 9 This is a block diagram showing the configuration of an ultrasound system according to Embodiment 3 of the present invention.

[0048] Fig.10 This is a block diagram showing the configuration of an ultrasound system according to Embodiment 4 of the present invention.

[0049] Fig.11 This is a block diagram showing the configuration of an ultrasound system according to Embodiment 5 of the present invention.

[0050] Fig.12 This is a diagram schematically showing an example of an ultrasonic image and a visual field image displayed on an external device in Embodiment 5 of the present invention.

[0051] Fig.13 This is a block diagram showing the configuration of an ultrasound system according to Embodiment 6 of the present invention. DETAILED DESCRIPTION

[0052] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0053] The description of the constituent elements described below is based on typical embodiments of the present invention, but the present invention is not limited to these embodiments.

[0054] In addition, in this specification, the numerical range expressed using "to" means a range including the numerical values ​​described before and after "to" as the lower limit and the upper limit.

[0055] In this specification, “same” and “identical” include an error range generally allowed in the technical field.

[0056] Implementation Method 1

[0057] Figure 1 2 shows a structure of an ultrasound system 1 according to Embodiment 1 of the present invention. The ultrasound system 1 includes an ultrasound probe 2, a mobile information terminal 3, and an external device 4. The ultrasound probe 2 is connected to the mobile information terminal 3 and the external device 4 via wireless communication, and the mobile information terminal 3 and the external device 4 are connected to each other via wireless communication.

[0058] The ultrasonic probe 2 includes a transducer array 21, to which a transceiver circuit 22, a signal processing unit 23, and a probe-side wireless communication unit 24 are sequentially connected. The probe-side wireless communication unit 24 is connected to the mobile information terminal 3 and the external device 4 through wireless communication. Although not shown in the figure, the signal processing unit 23 constitutes a received data generating unit.

[0059] Furthermore, a probe control unit 26 is connected to the transceiver circuit 22, the signal processing unit 23, and the probe side wireless communication unit 24. Furthermore, the signal processing unit 23, the probe side wireless communication unit 24, and the probe control unit 26 constitute a probe side processor 27.

[0060] The mobile information terminal 3 includes a terminal-side wireless communication unit 31 connected to the ultrasonic probe 2 and the external device 4 through wireless communication, and an image processing unit 32 is connected to the terminal-side wireless communication unit 31. In addition, the mobile information terminal 3 includes a camera unit 33, and the camera unit 33 is connected to the terminal-side wireless communication unit 31. In addition, an image synchronization unit 34 is connected to the image processing unit 32 and the camera unit 33.

[0061] Furthermore, the display control unit 35 and the terminal monitor 36 are sequentially connected to the image synchronization unit 34. Furthermore, the terminal control unit 37 is connected to the terminal-side wireless communication unit 31, the image processing unit 32, the camera unit 33, the image synchronization unit 34, and the display control unit 35. Furthermore, the input device 38 is connected to the terminal control unit 37. Furthermore, the terminal-side wireless communication unit 31, the image processing unit 32, the image synchronization unit 34, the display control unit 35, and the terminal control unit 37 constitute a terminal-side processor 39.

[0062] The external device 4 includes an external wireless communication unit 41 connected to the ultrasonic probe 2 and the mobile information terminal 3 through wireless communication, and an image processing unit 42 and an image synchronization unit 43 are connected to the external wireless communication unit 41. Furthermore, the image processing unit 42 is connected to the image synchronization unit 43. Furthermore, the image synchronization unit 43 is connected to a display control unit 44 and an external monitor 45 in sequence.

[0063] The external control unit 46 is connected to the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, and the display control unit 44. The external control unit 46 is connected to an input device 47. The external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, the display control unit 44, and the external control unit 46 constitute an external device-side processor 48.

[0064] The transducer array 21 of the ultrasonic probe 2 has a plurality of transducers arranged in one dimension or two dimensions. These transducers transmit ultrasonic waves according to the driving signals supplied from the transceiver circuit 22, and receive ultrasonic echoes from the subject, thereby outputting reception signals based on the ultrasonic echoes. Each transducer is constituted by forming electrodes at both ends of a piezoelectric body composed of, for example, a piezoelectric ceramic represented by PZT (Lead Zirconate Titanate), a polymer piezoelectric element represented by PVDF (Poly Vinylidene Di Fluoride), and a piezoelectric single crystal represented by PMN-PT (Lead Magnesium Niobate-Lead Titanate).

[0065] The transceiver circuit 22 generates a sound ray signal based on the ultrasonic wave transmitted from the transducer array 21 and the received signal acquired by the transducer array 21 under the control of the probe control unit 26. Figure 2 As shown, the transceiver circuit 22 includes a pulse generator 51 connected to the transducer array 21 , an amplifier 52 , an AD (Analog Digital) converter 53 , and a beam shaper 54 which are sequentially connected in series from the transducer array 21 .

[0066] The pulse generator 51 includes, for example, a plurality of pulse generators, and adjusts the delay amount of each drive signal and supplies it to a plurality of transducers according to the transmission delay mode selected in response to the control signal from the probe control unit 26, so that the ultrasonic waves transmitted from the plurality of transducers of the transducer array 21 form an ultrasonic beam. In this way, when a pulsed or continuous wave voltage is applied to the electrodes of the transducers of the transducer array 21, the piezoelectric body expands and contracts, and pulsed or continuous wave ultrasonic waves are generated from each transducer, and the synthetic wave of these ultrasonic waves forms an ultrasonic beam.

[0067] The transmitted ultrasonic beam is reflected by an object such as a part of a subject, and propagates toward the transducer array 21 of the ultrasonic probe 2. The ultrasonic echoes thus propagated toward the transducer array 21 cause each transducer constituting the transducer array 21 to expand and contract by receiving the propagated ultrasonic echoes, thereby generating reception signals as electrical signals, and outputting these reception signals to the amplifier 52.

[0068] The amplifier 52 amplifies the signal input from each transducer constituting the transducer array 21, and sends the amplified signal to the AD converter 53. The AD converter 53 converts the signal sent from the amplifier 52 into digital received data, and sends the received data to the beam former 54. The beam former 54 adds each delay to each received data converted by the A / D converter 53 according to the sound velocity or sound velocity distribution set by the reception delay mode selected in accordance with the control signal from the probe control unit 26, thereby performing so-called reception focusing processing. Through this reception focusing processing, a sound line signal in which each received data converted by the A / D converter 53 is phased and added and the focus of the ultrasonic echo is narrowed is obtained.

[0069] The signal processing unit 23 generates received data before imaging by performing signal processing on the acoustic line signal generated by the beam former 54 of the transceiver circuit 22. More specifically, the signal processing unit 23 performs envelope detection processing on the acoustic line signal generated by the beam former 54 of the transceiver circuit 22 after correcting the attenuation caused by the propagation distance according to the depth of the position where the ultrasonic wave is reflected, thereby generating a signal representing tomographic image information related to the tissue in the subject as received data before imaging.

[0070] The probe side wireless communication unit 24 includes an antenna for transmitting and receiving radio waves, and modulates a carrier wave according to the received data before imaging generated by the signal processing unit 23, thereby generating a transmission signal representing the received data before imaging. The probe side wireless communication unit 24 supplies the transmission signal generated in this way to the antenna and transmits radio waves from the antenna, thereby wirelessly transmitting the received data before imaging to the terminal side wireless communication unit 31 of the mobile information terminal 3 and the external wireless communication unit 41 of the external device 4 in sequence. As a modulation method of the carrier wave, ASK (Amplitude Shift Keying), PSK (Phase Shift Keying), QPSK (Quadrature Phase Shift Keying), 16QAM (16Quadrature Amplitude Modulation), etc. can be used.

[0071] Furthermore, the wireless communication between the probe side wireless communication unit 24 of the ultrasonic probe 2, the terminal side wireless communication unit 31 of the mobile information terminal 3, and the external wireless communication unit 41 of the external device 4 can be carried out in accordance with communication standards related to mobile communications such as 5G (5th Generation: 5th generation mobile communication system), 4G (4th Generation: 4th generation mobile communication system), and communication standards related to short-range wireless communications such as WiFi (registered trademark), Bluetooth (registered trademark), and UWB (Ultra Wide Band: ultra-wideband wireless system).

[0072] Since it is assumed that the ultrasonic probe 2 and the mobile information terminal 3 are located near each other, any wireless communication method of mobile communication and short-range wireless communication can be adopted as the wireless communication between the ultrasonic probe 2 and the mobile information terminal 3 .

[0073] Furthermore, since the external device 4 is assumed to be located at a remote location relative to the ultrasonic probe 2 and the mobile information terminal 3, mobile communication is preferably performed as the wireless communication between the external device 4 and the ultrasonic probe 2, and the wireless communication between the external device 4 and the mobile information terminal 3. In particular, from the viewpoint of reducing the time lag in data transmission between the external device 4 and the ultrasonic probe 2 and the mobile information terminal 3, mobile communication based on 5G is preferably performed as the wireless communication between the external device 4 and the ultrasonic probe 2, and the wireless communication between the external device 4 and the mobile information terminal 3.

[0074] The probe control unit 26 controls each unit of the ultrasonic probe 2 according to a control program stored in advance or the like.

[0075] Although not shown, a probe-side storage unit is connected to the probe control unit 26. The probe-side storage unit stores control programs and the like of the ultrasonic probe 2. As the probe-side storage unit, for example, a flash memory, a RAM (Random Access Memory), an SD card (Secure Digital card), an SSD (Solid State Drive), etc. can be used.

[0076] Although not shown in the figure, a battery is built into the ultrasonic probe 2 , and power is supplied from the battery to each circuit of the ultrasonic probe 2 .

[0077] In addition, the probe side processor 27 having a signal processing unit 23, a probe side wireless communication unit 24 and a probe control unit 26 is composed of a CPU (Central Processing Unit) and a control program for causing the CPU to perform various processes, but can also be composed of an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a GPU (Graphics Processing Unit), other ICs (Integrated Circuit), or a combination of these.

[0078] Furthermore, the signal processing unit 23 , the probe-side wireless communication unit 24 , and the probe control unit 26 of the probe-side processor 27 may be partially or entirely integrated into one CPU or the like.

[0079] The terminal-side wireless communication unit 31 of the mobile information terminal 3 includes an antenna for transmitting and receiving radio waves, and receives a transmission signal representing received data before imaging transmitted by the probe-side wireless communication unit 24 of the ultrasonic probe 2 via the antenna under the control of the terminal control unit 37, and outputs the received data before imaging by demodulating the received transmission signal. In addition, the terminal-side wireless communication unit 31 sends the received data before imaging to the image processing unit 32.

[0080] The image processing unit 32 raster-converts the received data before being imaged sent from the terminal-side wireless communication unit 31 into an image signal in accordance with a scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction in accordance with the display format for the terminal monitor 36 on the converted image signal, thereby generating a B-mode (Brightness mode) image signal. The B-mode image signal generated in this way is referred to as an ultrasonic image U. The image processing unit 32 sends the generated ultrasonic image U to the image synchronization unit 34.

[0081] The camera unit 33 acquires a field of view image C of the scanned part of the ultrasonic probe 2 in the subject. Although not shown in the figure, the camera unit 33 is built with: a photographic lens; an image sensor that photographs the scanned part of the ultrasonic probe 2 through the photographic lens to acquire a field of view image signal as an analog signal; an analog signal processing circuit that amplifies the field of view image signal acquired by the image sensor and converts it into a digital signal; and a digital signal processing circuit that performs various corrections such as gain on the converted digital signal to generate the field of view image C. The analog signal processing circuit and the digital signal processing circuit can also be built into the terminal side processor 39. The camera unit 33 sends the generated field of view image C to the terminal side wireless communication unit 31 and the image synchronization unit 34. In addition, the field of view image C sent to the terminal side wireless communication unit 31 is wirelessly transmitted to the external device 4 by the terminal side wireless communication unit 31.

[0082] The image synchronization unit 34 synchronizes the ultrasonic image U generated by the image processing unit 32 and the visual field image C generated by the camera unit 33, thereby generating a synthetic image M based on the synchronized ultrasonic image U and visual field image C. Here, synchronizing the ultrasonic image U and the visual field image C means associating the ultrasonic image U and the visual field image C captured at the same time. For example, when a timestamp indicating the time when the ultrasonic image U is generated by the image processing unit 32 is assigned to the ultrasonic image U, and a timestamp indicating the time when the visual field image C is generated by the camera unit 33 is assigned to the visual field image C, the image synchronization unit 34 regards the timestamp of the ultrasonic image U as the timestamp indicating the time when the ultrasonic image U is captured, and regards the timestamp of the visual field image C as the timestamp indicating the time when the visual field image C is captured, and by referring to the timestamps of the ultrasonic image U and the visual field image C, the ultrasonic image U and the visual field image C captured at the same time can be synchronized with each other.

[0083] Furthermore, when associating the ultrasonic image U with the visual field image C, the image synchronization unit 34 refers to the timestamp of the ultrasonic image U and the timestamp of the visual field image C, and if the difference between the time when the ultrasonic image U was photographed and the time when the visual field image C was photographed is within a certain range, for example, within 0.1 seconds, the ultrasonic image U and the visual field image C are deemed to be photographed at the same time and are associated. Furthermore, the image synchronization unit 34 refers to the timestamp of the ultrasonic image U and the timestamp of the visual field image C, and selects the visual field image C photographed at the time closest to the time when the ultrasonic image U to be associated was photographed, and associates the selected visual field image C with the ultrasonic image U. Furthermore, the image synchronization unit 34 selects the ultrasonic image U photographed at the time closest to the time when the visual field image C to be associated was photographed, and associates the selected ultrasonic image U with the visual field image C, for example.

[0084] The image synchronization unit 34 sends the ultrasonic image U and the visual field image C synchronized in this way to the display control unit 35 .

[0085] The display control unit 35 performs a predetermined process on the synthesized image M sent from the image synchronization unit 34 under the control of the terminal control unit 37, such as Figure 3 As shown, the synchronized ultrasonic image U and the visual field image C are displayed together on the terminal monitor 36 of the mobile information terminal 3 .

[0086] The terminal monitor 36 is a device that displays the ultrasonic image U and the visual field image C under the control of the display control unit 35 , and includes a display device such as an LCD (Liquid Crystal Display) or an organic EL display (Organic Electroluminescence Display).

[0087] The input device 38 of the mobile information terminal 3 is a device for the operator to perform input operations, and includes a touch sensor arranged to overlap with the terminal monitor 36. For example, the operator can input probe control information for controlling the ultrasonic probe 2 via the input device 38. The probe control information input in this way is sent to the terminal side wireless communication unit 31 through the terminal control unit 37, and is wirelessly transmitted from the terminal side wireless communication unit 31 to the ultrasonic probe 2.

[0088] The terminal control unit 37 controls each unit of the mobile information terminal 3 according to a control program stored in advance or the like.

[0089] Although not shown, a terminal side storage unit is connected to the terminal control unit 37. The terminal side storage unit stores control programs and the like of the mobile information terminal 3. For example, a flash memory, a RAM, an SD card, an SSD, etc. can be used as the terminal side storage unit.

[0090] Although not shown in the figure, the mobile information terminal 3 has a built-in battery, and power is supplied from the battery to each circuit of the mobile information terminal 3 .

[0091] In addition, the terminal side processor 39 having a terminal side wireless communication unit 31, an image processing unit 32, an image synchronization unit 34, a display control unit 35 and a terminal control unit 37 is composed of a CPU and a control program for enabling the CPU to perform various processes, but can also be composed using FPGA, DSP, ASIC, GPU, other ICs, or can be composed of a combination of these.

[0092] Furthermore, the terminal side wireless communication unit 31 , the image processing unit 32 , the image synchronization unit 34 , the display control unit 35 , and the terminal control unit 37 of the terminal side processor 39 may also be partially or entirely integrated into one CPU or the like.

[0093] The external wireless communication unit 41 of the external device 4 includes an antenna for transmitting and receiving radio waves, and receives, through the antenna, a transmission signal representing received data before imaging transmitted by the probe-side wireless communication unit 24 of the ultrasonic probe 2, and a transmission signal representing the visual field image C transmitted by the terminal-side wireless communication unit 31 of the mobile information terminal 3, under the control of the external control unit 46, and outputs the received data before imaging and the visual field image C by demodulating the received transmission signal. In addition, the external wireless communication unit 41 sends the received data before imaging to the image processing unit 42, and sends the visual field image C to the image synchronization unit 43.

[0094] The image processing unit 42 raster-converts the received data before being imaged sent from the external wireless communication unit 41 into an image signal in accordance with a scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction in accordance with a display format for the external monitor 45 on the converted image signal, thereby generating an ultrasonic image U. The image processing unit 42 sends the generated ultrasonic image U to the image synchronization unit 43.

[0095] The image synchronization unit 43 of the external device 4 synchronizes the ultrasonic image U sent from the image processing unit 42 and the visual field image C sent from the external wireless communication unit 41, thereby generating a synthetic image M based on the synchronized ultrasonic image U and the visual field image C. For example, when a timestamp indicating the time when the ultrasonic image U is generated by the image processing unit 42 of the external device 4 is given to the ultrasonic image U, and a timestamp indicating the time when the visual field image C is generated by the camera unit 33 of the mobile information terminal 3 is given to the visual field image C, the image synchronization unit 43 regards the timestamp of the ultrasonic image U as the timestamp indicating the time when the ultrasonic image U is captured, and regards the timestamp of the visual field image C as the timestamp indicating the time when the visual field image C is captured, and by referring to the timestamps of the ultrasonic image U and the visual field image C, the ultrasonic image U and the visual field image C captured at the same time can be synchronized with each other.

[0096] The display control unit 44 performs a predetermined process on the synthesized image M sent from the image synchronization unit 43 under the control of the external control unit 46, such as Figure 4 As shown, the synchronized ultrasonic image U and the visual field image C are displayed together on the external monitor 45 of the external device 4 .

[0097] The external monitor 45 is a device that displays the ultrasonic image U, the visual field image C, etc. under the control of the display control unit 44 , and includes, for example, a display device such as an LCD or an organic EL display.

[0098] The input device 47 of the external device 4 is a device for an operator to perform input operations, and includes a touch sensor arranged to overlap with the external monitor 45 .

[0099] The external control unit 46 controls each unit of the external device 4 according to a control program stored in advance or the like.

[0100] Although not shown, an external device side storage unit is connected to the external device 4. The external device side storage unit stores a control program and the like of the external device 4. As the external device side storage unit, for example, a flash memory, a RAM, an SD card, an SSD, etc. can be used.

[0101] Although not shown in the figure, a battery is built in the external device 4 , and power is supplied from the battery to each circuit of the external device 4 .

[0102] In addition, the external device side processor 48 having an external wireless communication unit 41, an image processing unit 42, an image synchronization unit 43, a display control unit 44 and an external control unit 46 is composed of a CPU and a control program for causing the CPU to perform various processes, but can also be composed using FPGA, DSP, ASIC, GPU, other ICs, or can be composed of a combination of these.

[0103] Furthermore, the external wireless communication unit 41 , the image processing unit 42 , the image synchronization unit 43 , the display control unit 44 , and the external control unit 46 of the external device-side processor 48 may be partially or entirely integrated into one CPU or the like.

[0104] Next, the operation of the ultrasound system 1 according to the first embodiment of the present invention will be described.

[0105] First, the operator brings the ultrasonic probe 2 into contact with the body surface of the subject, and under the control of the probe control unit 26, the plurality of transducers of the transducer array 21 transmit ultrasonic beams into the subject in accordance with the drive signal of the pulse generator 51 of the transceiver circuit 22. Ultrasonic echoes based on the transmitted ultrasonic beams are received by each transducer, and the received signals as analog signals are output to the amplifier 52 and amplified, and the received signals are converted into analog signals by the AD converter 53 to obtain received data. The received data is subjected to receive focusing processing by the beam former 54 to generate a sound ray signal.

[0106] The generated sound ray signal is converted into a signal representing tomographic image information related to the tissue in the subject, that is, received data before imaging, by the signal processing unit 23. At this time, the signal processing unit 23 performs envelope detection processing after correcting the attenuation caused by the propagation distance of the sound ray signal according to the depth of the position where the ultrasonic wave is reflected.

[0107] The probe-side wireless communication unit 24 wirelessly transmits the generated acoustic ray signal to the mobile information terminal 3 and the external device 4 .

[0108] The terminal-side wireless communication unit 31 of the mobile information terminal 3 receives the received data before being imaged that is wirelessly transmitted from the ultrasonic probe 2, and sends the received received data before being imaged to the image processing unit 32. The image processing unit 32 raster-converts the received data before being imaged that is transmitted from the terminal-side wireless communication unit 31 into an image signal that conforms to a scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction conforming to a display format for the terminal monitor 36 on the converted image signal, thereby generating an ultrasonic image U. The ultrasonic image U generated in this way is sent to the image synchronization unit 34.

[0109] Furthermore, the camera unit 33 of the mobile information terminal 3 acquires the field of view image C of the scanned portion of the ultrasonic probe 2 in the subject, under the control of the terminal control unit 37. Although not shown in the figure, at this time, for example, the operator can input control information of the intention to capture the field of view image C through the input device 38 of the mobile information terminal 3 while directing the imaging lens of the camera unit 33 toward the scanned portion of the ultrasonic probe 2 in the subject. In this case, for example, the control information input by the operator is input to the terminal control unit 37, whereby the terminal control unit 37 can control the camera unit 33 so as to capture the field of view image C according to the control information. The field of view image C acquired in this way is sent to the terminal-side wireless communication unit 31 and the image synchronization unit 34.

[0110] When the image synchronization unit 34 receives the ultrasonic image U from the image processing unit 32 and receives the visual field image C from the camera unit 33, the image synchronization unit 34 synchronizes the received ultrasonic image U and the visual field image C with each other, thereby generating a synthetic image M in which the ultrasonic image U and the visual field image C that are synchronized with each other are integrated into one. For example, when a timestamp indicating the time when the ultrasonic image U is generated by the image processing unit 32 is given to the ultrasonic image U, and a timestamp indicating the time when the visual field image C is generated by the camera unit 33 is given to the visual field image C, the image synchronization unit 34 regards the timestamp of the ultrasonic image U as the timestamp indicating the time when the ultrasonic image U is captured, and regards the timestamp of the visual field image C as the timestamp indicating the time when the visual field image C is captured, and by referring to the timestamps of the ultrasonic image U and the visual field image C, the ultrasonic image U and the visual field image C captured at the same time can be associated with each other.

[0111] The ultrasonic image U and the visual field image C synchronized with each other by the image synchronization unit 34 are sent to the display control unit 35 as a synthesized image M. After the display control unit 35 performs a predetermined process on the synthesized image M, the synthesized image M is sent to the terminal monitor 36. Figure 3 As shown in FIG. 1 , the terminal monitor 36 displays the ultrasonic image U together with the visual field image C. Figure 3 In the example shown, a field of view image C and an ultrasonic image U are displayed above and below the terminal monitor 36, respectively. In this example, the state in which the ultrasonic probe 2 contacts the abdomen of the subject is drawn on the field of view image C, and the internal tissue of the abdomen of the subject is drawn on the ultrasonic image U. Therefore, the operator can simultaneously check the field of view image C of the scanned portion of the subject by the ultrasonic probe 2 and the ultrasonic image U corresponding to the field of view image C by checking the terminal monitor 36 of the mobile information terminal 3, thereby easily establishing a corresponding association and understanding between the scanned portion of the subject by the ultrasonic probe 2 and the tissue inside the subject observed thereby.

[0112] Then, the visual field image C acquired by the camera unit 33 is wirelessly transmitted from the terminal-side wireless communication unit 31 to the external device 4 .

[0113] The external wireless communication unit 41 of the external device 4 receives the pre-imaging reception data wirelessly sent from the ultrasonic probe 2 and the field of view image C wirelessly sent from the mobile information terminal 3, and sends the received pre-imaging reception data to the image processing unit 42, and sends the received field of view image C to the image synchronization unit 43.

[0114] The image processing unit 42 raster-converts the received data before being imaged sent from the external wireless communication unit 41 into an image signal in accordance with a scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction in accordance with a display format for the external monitor 45 on the converted image signal, thereby generating an ultrasonic image U. The image processing unit 42 sends the generated ultrasonic image U to the image synchronization unit 43.

[0115] The image synchronization unit 43 synchronizes the ultrasonic image U sent from the image processing unit 42 and the visual field image C sent from the external wireless communication unit 41, thereby generating a composite image M in which the ultrasonic image U and the visual field image C are integrated into one. For example, when a timestamp indicating the time when the ultrasonic image U is generated by the image processing unit 42 of the external device 4 is given to the ultrasonic image U, and a timestamp indicating the time when the visual field image C is generated by the camera unit 33 of the mobile information terminal 3 is given to the visual field image C, the image synchronization unit 43 regards the timestamp of the ultrasonic image U as the timestamp indicating the time when the ultrasonic image U is captured, and regards the timestamp of the visual field image C as the timestamp indicating the time when the visual field image C is captured, and thus refers to the timestamps of the ultrasonic image U and the visual field image C, and can synchronize the ultrasonic image U and the visual field image C captured at the same time. At this time, the time in the mobile information terminal 3 and the time in the external device 4 can be shared with each other.

[0116] In addition, the time in the mobile information terminal 3 and the time in the external device 4 can be shared with each other. Specifically, for example, the time can be shared based on either the mobile information terminal 3 or the external device 4. And, for example, when either the mobile information terminal 3 or the external device 4 is connected to the Internet, the time of the built-in clock can be set using communication protocols such as NTP (Network Time Protocol) and NITZ (Network Identity and Time Zone).

[0117] The ultrasonic image U and the visual field image C synchronized with each other by the image synchronization unit 43 are sent to the display control unit 44 as a synthesized image M. After the display control unit 44 performs a predetermined process on the synthesized image M, the synthesized image M is sent to the external monitor 45. Figure 4 As shown in FIG. 4 , the ultrasonic image U is displayed together with the visual field image C on the external monitor 45. Figure 4 In the example shown in FIG. 1 , the external device 4 is a portable terminal similar to the mobile information terminal 3, and a field of view image C and an ultrasonic image U are displayed above and below the external monitor 45 of the external device 4, respectively. In this example, similar to the ultrasonic image U and field of view image C displayed on the terminal monitor 36 of the mobile information terminal 3, the state that the ultrasonic probe 2 contacts the abdomen of the subject is drawn on the field of view image C, and the internal tissue of the abdomen of the subject is drawn on the ultrasonic image U.

[0118] Here, the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4 display the field of view image C and the ultrasonic image U synchronized with each other, respectively, but the same field of view image C and ultrasonic image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, in a case where the external device 4 is located at a remote location relative to the mobile information terminal 3, an observer observing the external monitor 45 can also observe the field of view image C and ultrasonic image U captured at the examination site where the subject and the operator are located in almost real time.

[0119] However, it is known that a certain level of proficiency is generally required to accurately grasp the part of the subject drawn on the ultrasonic image by checking the ultrasonic image. Also, it is known that the quality of the ultrasonic image generated by the ultrasonic diagnostic apparatus depends largely on the skill of the operator.

[0120] For example, when an ultrasonic image is taken at a remote location outside a hospital such as home care, the operator who operates the ultrasonic probe to take the ultrasonic image and the observer such as a doctor who observes the taken ultrasonic image for diagnosis are sometimes different from each other. In this case, the operator usually needs to personally confirm the obtained ultrasonic image while operating the ultrasonic probe to take the ultrasonic image of the part inside the target subject. In particular, when the operator's proficiency is low, the operator sometimes finds it difficult to determine whether the part of the target subject can be correctly observed. In addition, the operator with low proficiency sometimes cannot use the appropriate technique to operate the ultrasonic probe, resulting in a low-quality ultrasonic image.

[0121] Furthermore, an observer who is located at a remote location relative to the subject and the operator confirms the ultrasonic image taken by the operator of the ultrasonic diagnostic device to perform a diagnosis. However, since it is impossible to understand the conditions under which the operator took the ultrasonic image, it is sometimes difficult to correctly judge whether the ultrasonic image was taken using an appropriate technique, especially when the ultrasonic image is taken by an operator with low proficiency.

[0122] According to the ultrasound system 1 according to the first embodiment of the present invention, the same visual field image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, when the external device 4 is located at a remote location relative to the mobile information terminal 3, the observer who observes the external monitor 45 can also observe the visual field image C and ultrasound image U captured at the detection site where the subject and the operator are located in almost real time. As a result, for example, since an observer with high proficiency can give advice to the operator in real time, even when the operator located at a remote location relative to the observer has low proficiency, an appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

[0123] Furthermore, according to the ultrasound system 1 according to the first embodiment of the present invention, for example, an observer who is located at a remote position relative to the operator and has low proficiency can also confirm the field of view image C showing the operation of the ultrasound probe 2 by a highly proficient operator and the appropriate ultrasound image U corresponding to the field of view image C. In this way, the ultrasound system 1 according to the first embodiment of the present invention is also very effective from the viewpoint of education.

[0124] In addition, it has been described that the ultrasonic image U generated in the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4 are respectively given a time stamp, but instead of the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4 giving a time stamp to the ultrasonic image U, the signal processing unit 23 of the ultrasonic probe 2 may give a time stamp to the signal that has been subjected to the envelope detection process. In this case, for example, the time in the ultrasonic probe 2 and the time in the mobile information terminal 3 are shared with each other, so that the ultrasonic image U generated by the image processing unit 32 of the mobile information terminal 3 and the visual field image C generated by the camera unit 33 can be synchronized with each other based on the signal to which the time stamp is given, and the ultrasonic image U generated by the image processing unit 42 of the external device 4 and the visual field image C generated by the camera unit 33 can be synchronized with each other.

[0125] Here, the time in the ultrasonic probe 2 and the time in the mobile information terminal 3 can be shared, for example, based on either the ultrasonic probe 2 or the mobile information terminal 3. Furthermore, for example, when either the ultrasonic probe 2 or the mobile information terminal 3 is connected to the Internet, the time of the built-in clock can be set using a communication protocol such as NTP or NITZ.

[0126] Furthermore, the method of synchronizing the ultrasonic image U and the visual field image C is not limited to the method using the above-mentioned timestamp. For example, as disclosed in Japanese Patent Application Laid-Open No. 2011-183056, the time of photographing the ultrasonic image U by the ultrasonic probe 2 is synchronized with the time of photographing the visual field image C by the camera unit 33 of the mobile information terminal 3. Furthermore, when the time difference between the time when the ultrasonic image U is photographed and the time when the visual field image C is photographed is within a certain range, for example, within 0.1 seconds, the image synchronization unit 34 of the mobile information terminal 3 and the image synchronization unit 43 of the external device 4 regard the ultrasonic image U and the visual field image C as being photographed at the same time, and the ultrasonic image U and the visual field image C can be synchronized with each other.

[0127] Furthermore, the image synchronization unit 34 of the mobile information terminal 3 generates a composite image M in which the ultrasonic image U and the visual field image C that are synchronized with each other are integrated into one, and sends the generated composite image M to the display control unit 35. However, instead of generating the composite image M, the ultrasonic image U and the visual field image C that are synchronized with each other can be sent to the display control unit 35 separately. In this case, the display control unit 35 performs predetermined processing on the ultrasonic image U and the visual field image C that are sent from the image synchronization unit 34, and displays the composite image M on the terminal monitor 36 as shown in FIG. Figure 3 As shown, the ultrasonic image U and the field of view image C that are synchronized with each other are displayed together. Therefore, the operator can simultaneously check the position of the ultrasonic probe 2 and the state of the internal tissue of the subject corresponding thereto.

[0128] Also, the image synchronization unit 43 of the external device 4 can send the ultrasonic image U and the visual field image C synchronized with each other to the display control unit 44 instead of generating the composite image M. In this case, the ultrasonic image U and the visual field image C synchronized with each other are simultaneously displayed on the external monitor 45, so that the observer who views the external monitor 45 can observe the visual field image C and the ultrasonic image U captured at the examination site where the subject and the operator are located in almost real time.

[0129] Furthermore, the ultrasonic probe 2 and the mobile information terminal 3 are connected to each other by wireless communication, but they may be connected to each other by wired communication, for example, instead of connection by wireless communication.

[0130] And, in Figure 4 The external device 4 is exemplified as a portable thin computer called a so-called smart phone or tablet computer similar to the mobile information terminal 3, but the external device 4 is not limited thereto. For example, the external device 4 may also be a so-called notebook personal computer or a stationary personal computer.

[0131] Furthermore, although not shown, a second external device having a monitor can also be provided near the site where the operator examines the subject, so that the second external device is connected to the ultrasonic probe 2 and the mobile information terminal 3, and the ultrasonic image U and the field of view image C are displayed on the monitor of the second external device. In particular, when the second external device has a large monitor, the operator can more clearly confirm the ultrasonic image U and the field of view image C, and thus can more clearly establish a corresponding association and grasp the scanning part of the ultrasonic probe 2 in the subject and the tissue in the subject being observed.

[0132] And, in Figure 3In the figure, the mobile information terminal 3 is illustrated as a so-called portable thin computer called a smart phone or a tablet computer, but if it is a portable information terminal, it is not limited to this. For example, as the mobile information terminal 3, a terminal device that can be worn on the operator's head can also be used. This terminal device, for example, is configured with a terminal monitor 36 in a manner opposite to the operator's eyes when worn on the head, and a field of view image C representing the operator's forward field of view is captured by a camera unit 33. The operator can confirm the field of view image C displayed on the terminal monitor 36 instead of directly confirming the forward field of view, thereby indirectly confirming the forward field of view. In this way, when the mobile information terminal 3 is worn on the operator's head, since the operator does not need to hold the mobile information terminal 3 in his hand, the operator can perform more various examinations, for example, a technique of operating the ultrasonic probe 2 with one hand while inserting the puncture needle into the subject with the other hand.

[0133] And, if Figure 2 As shown, the transceiver circuit 22 includes an amplifier 52, an AD converter 53, and a beam former 54. The beam former 54 may be arranged between the transceiver circuit 22 and the signal processing unit 23 instead of being inside the transceiver circuit 22. In this case, the beam former 54 may also be formed by the probe side processor 27.

[0134] And, for example, Figure 5 As shown, external input information such as a cursor A that can be moved by an input operation of an observer via the input device 47 of the external device 4 can be simultaneously displayed on the external monitor 45 of the external device 4 and the terminal monitor 36 of the mobile information terminal 3. In this case, for example, if the cursor A displayed on the external monitor 45 of the external device 4 is moved by the input operation of the observer via the input device 47 of the external device 4, the cursor A displayed on the terminal monitor 36 of the mobile information terminal 3 is also moved. Thus, for example, more detailed information can be shared between the operator of the ultrasonic probe 2 and the mobile information terminal 3 and the observer located near the external device 4. For example, an observer who is highly skilled in observing the ultrasonic image U and the visual field image C through the external monitor 45 of the external device 4 can easily support the inspection performed by the operator who is less skilled in the ultrasonic probe 2 and the mobile information terminal 3, for example, by using the cursor A to indicate the position to be scanned by the ultrasonic probe 2.

[0135] Furthermore, for example, a cursor A that can be moved by an operator's input operation via the input device 38 of the mobile information terminal 3 can be displayed simultaneously on the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4. In this case, for example, a highly skilled operator can provide an inexperienced observer located near the external device 4 with easier and more detailed education on ultrasonic diagnosis.

[0136] In addition, the shape of the cursor A is not limited to the arrow shape, and can have any shape such as a circle or a polygon.

[0137] Furthermore, for example, wireless communication of voice data can be performed bidirectionally between the mobile information terminal 3 and the external device 4 . Figure 6 FIG. 4 shows a configuration of a mobile information terminal 3A in a modified example of the first embodiment of the present invention. The mobile information terminal 3A is Figure 1 The mobile information terminal 3 shown in the figure has a microphone 61 and a speaker 62 added thereto, and has a terminal control unit 37A instead of the terminal control unit 37, and has a terminal processor 39A instead of the terminal processor 39. In the mobile information terminal 3A, the microphone 61 and the speaker 62 are connected to the terminal wireless communication unit 31.

[0138] and, Figure 7 FIG. 4 shows a configuration of an external device 4A in a modified example of the first embodiment of the present invention. Figure 1 The external device 4 shown has a microphone 63 and a speaker 64 added thereto, and includes an external control unit 46A instead of the external control unit 46, and an external device processor 48A instead of the external device processor 48. In the external device 4A, the microphone 63 and the speaker 64 are connected to the external wireless communication unit 41.

[0139] In a variation of the first embodiment of the present invention, voice data is bidirectionally transmitted and received between the mobile information terminal 3A and the external device 4A. For example, if the operator of the ultrasonic probe 2 and the mobile information terminal 3A utters a voice to the mobile information terminal 3A, the uttered voice is input to the microphone 61 of the mobile information terminal 3A, and the microphone 61 generates voice data. The generated voice data is wirelessly transmitted from the terminal-side wireless communication unit 31 to the external device 4A. The external wireless communication unit 41 of the external device 4A receives the voice data wirelessly transmitted from the mobile information terminal 3A, and sends the received voice data to the speaker 64. The speaker 64 reproduces the voice uttered by the operator of the ultrasonic probe 2 and the mobile information terminal 3A based on the voice data received from the external wireless communication unit 41.

[0140] Furthermore, for example, if an observer who observes the ultrasonic image U and the visual field image C through the external monitor 45 of the external device 4A utters a voice to the external device 4A, the uttered voice is input to the microphone 63 of the external device 4A, and voice data is generated by the microphone 63. The generated voice data is wirelessly transmitted from the external wireless communication unit 41 to the mobile information terminal 3A. The terminal-side wireless communication unit 31 of the mobile information terminal 3A receives the voice data wirelessly transmitted from the external device 4A, and sends the received voice data to the speaker 62. The speaker 62 reproduces the voice uttered by the observer who is located near the external device 4 based on the voice data received from the terminal-side wireless communication unit 31.

[0141] In this way, by bidirectionally transmitting and receiving voice data between the mobile information terminal 3A and the external device 4A, more detailed information sharing can be performed between the operator of the ultrasonic probe 2 and the mobile information terminal 3A and the observer located near the external device 4A. For example, an observer with high proficiency in observing the ultrasonic image U and the visual field image C through the external monitor 45 of the external device 4A can more easily and in detail give advice to an operator with low proficiency in the ultrasonic probe 2 and the mobile information terminal 3A. In addition, for example, an operator with high proficiency can more easily and in detail provide education on ultrasonic diagnosis to an observer with low proficiency located near the external device 4A.

[0142] Furthermore, the operator's voice input to the microphone 61 of the mobile information terminal 3A can also be used as the operator's input operation. For example, the terminal control unit 37A acquires instruction information by analyzing the voice data generated by the microphone 61 according to the operator's voice, and can control various parts of the mobile information terminal 3A according to the acquired instruction information, such as starting and stopping the shooting of the field of view image C by the camera unit 33. In addition, the ultrasonic probe 2 can also be controlled according to the voice data analyzed by the terminal control unit 37A. In this case, for example, the voice data analyzed by the terminal control unit 37A is wirelessly transmitted from the terminal-side wireless communication unit 31 to the ultrasonic probe 2 as input information from the operator, and is input to the probe control unit 26 through the probe-side wireless communication unit 24. The probe control unit 26 can control various parts of the ultrasonic probe 2 according to the input information, such as starting and stopping the transmission of ultrasonic waves by the transducer array 21.

[0143] Furthermore, the voice of the observer input to the microphone 63 of the external device 4A can also be used as the input operation of the observer. For example, the external control unit 46A acquires instruction information by analyzing the voice data generated by the microphone 63 according to the voice of the observer, and can also control various parts of the ultrasonic probe 2 according to the acquired instruction information, such as starting and stopping the shooting of the field of view image C by the camera unit 33 of the mobile information terminal 3A, and starting and stopping the transmission of ultrasonic waves by the transducer array 21 of the ultrasonic probe 2.

[0144] Implementation Method 2

[0145] In embodiment 1, received data before imaging is generated in the ultrasonic probe 2 by performing envelope detection processing on the sound line signal, and the generated received data before imaging is wirelessly transmitted to the mobile information terminal 3 and the external device 4. However, an ultrasonic image U is generated in the ultrasonic probe 2, and the generated ultrasonic image U can also be wirelessly transmitted to the mobile information terminal 3 and the external device 4.

[0146] Figure 8 FIG. 2 shows a configuration of an ultrasound system 1B according to a second embodiment of the present invention. Figure 1 The ultrasound system 1 of the illustrated first embodiment includes an ultrasound probe 2B instead of the ultrasound probe 2 , a mobile information terminal 3B instead of the mobile information terminal 3 , and an external device 4B instead of the external device 4 .

[0147] The ultrasonic probe 2B adds an image processing unit 71 to the ultrasonic probe 2 of the first embodiment, and includes a probe control unit 26B instead of the probe control unit 26, and includes a probe side processor 27B instead of the probe side processor 27. In the ultrasonic probe 2B, the image processing unit 71 is connected to the signal processing unit 23. In addition, the probe side wireless communication unit 24 and the probe control unit 26B are connected to the image processing unit 71. Although not shown in the figure, the signal processing unit 23 and the image processing unit 71 constitute an ultrasonic image generating unit.

[0148] The mobile information terminal 3B is the mobile information terminal 3 of the first embodiment, except that the image processing unit 32 is removed, and a terminal control unit 37B is provided in place of the terminal control unit 37, and a terminal side processor 39B is provided in place of the terminal side processor 39. In the mobile information terminal 3B, the image synchronization unit 34 and the camera unit 33 are connected to the terminal side wireless communication unit 31.

[0149] The external device 4B is obtained by removing the image processing unit 42 from the external device 4 of the first embodiment, and includes an external control unit 46B instead of the external control unit 46 , and includes an external device-side processor 48B instead of the external device-side processor 48 .

[0150] The image processing unit 71 of the ultrasonic probe 2B converts the signal raster subjected to the envelope detection processing by the signal processing unit 23 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal, thereby generating an ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3B and an ultrasonic image U conforming to the display format for the external monitor 45 of the external device 4B. In addition, the image processing unit 71 wirelessly transmits the ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3B from the probe side wireless communication unit 24 to the mobile information terminal 3B, and wirelessly transmits the ultrasonic image U conforming to the display format for the external monitor 45 of the external device 4B from the probe side wireless communication unit 24 to the external device 4B.

[0151] The terminal-side wireless communication unit 31 of the mobile information terminal 3B receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2B, and sends the received ultrasonic image U to the image synchronization unit 34 .

[0152] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 and the visual field image C generated by the camera unit 33, thereby generating a synthetic image M based on the synchronized ultrasonic image U and the visual field image C. For example, when a timestamp indicating the time when the ultrasonic image U is generated by the image processing unit 71 of the ultrasonic probe 2B is assigned to the ultrasonic image U, and a timestamp indicating the time when the visual field image C is generated by the camera unit 33 of the mobile information terminal 3B is assigned to the visual field image C, the image synchronization unit 34 can synchronize the ultrasonic image U and the visual field image C based on the timestamps assigned to the ultrasonic image U and the visual field image C.

[0153] The display control unit 35 performs a predetermined process on the synthesized image M generated by the image synchronization unit 34 and then sends the synthesized image M to the terminal monitor 36. Figure 3 As shown, on the terminal monitor 36 , the ultrasonic image U and the field of view image C which are synchronized with each other are displayed together.

[0154] The external wireless communication unit 41 of the external device 4B receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2B and the visual field image C wirelessly transmitted from the mobile information terminal 3B, and sends the received ultrasonic image U and visual field image C to the image synchronization unit 43 .

[0155] The image synchronization unit 43 synchronizes the ultrasonic image U and the visual field image C transmitted from the external wireless communication unit 41 with each other, and generates a synthesized image M based on the ultrasonic image U and the visual field image C synchronized with each other.

[0156] After the display control unit 44 performs a predetermined process on the synthesized image M generated by the image synchronization unit 43, the display control unit 44 sends the synthesized image M to the external monitor 45. Figure 4 As shown, the ultrasonic image U and the visual field image C synchronized with each other are displayed together on the external monitor 45 .

[0157] As described above, according to the ultrasound system 1B according to the second embodiment of the present invention, even when the ultrasound probe 2B includes the image processing unit 71, the same field of view image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, similarly to the ultrasound system 1 according to the first embodiment in which the mobile information terminal 3 includes the image processing unit 32 and the external device 4 includes the image processing unit 42. Therefore, for example, an observer who observes the field of view image C and ultrasound image U through the external device 4B disposed at a remote location can give advice to the operator of the ultrasound probe 2B and the mobile information terminal 3B, so that an appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

[0158] And, in Figure 1 In the ultrasound system 1 of the first embodiment shown, the mobile information terminal 3 is provided with an image processing unit 32, and the external device 4 is provided with an image processing unit 42, but in the ultrasound system 1B according to the second embodiment, the ultrasound probe 2B is provided with an image processing unit 71, so that the mobile information terminal 3B and the external device 4B do not need to have the image processing units 32 and 42, respectively, and the internal structures of the mobile information terminal 3B and the external device 4B are simplified compared with the internal structures of the mobile information terminal 3 and the external device 4 in the ultrasound system 1 of the first embodiment. Therefore, according to the ultrasound system 1B according to the second embodiment, the power consumption and calculation load of the mobile information terminal 3B and the external device 4B can be reduced compared with the ultrasound system 1 of the first embodiment.

[0159] Implementation 3

[0160] In the first embodiment, the ultrasonic image U and the visual field image C are synchronized in the mobile information terminal 3 and the external device 4 , respectively. However, for example, the ultrasonic image U and the visual field image C may be synchronized only in the mobile information terminal 3 .

[0161] Fig. 9 FIG. 4 shows a configuration of an ultrasound system 1C according to Embodiment 3 of the present invention. Figure 1The ultrasound system 1 of the illustrated embodiment 1 includes an ultrasound probe 2C having the same internal structure as the ultrasound probe 2, a mobile information terminal 3C instead of the mobile information terminal 3, and an external device 4C instead of the external device 4. The ultrasound probe 2C is connected only to the mobile information terminal 3C through wireless communication, and the external device 4C is connected only to the mobile information terminal 3C through wireless communication.

[0162] The mobile information terminal 3C is provided with a terminal control unit 37C instead of the terminal control unit 37 in the mobile information terminal 3 of the first embodiment, and a terminal side processor 39C instead of the terminal side processor 39. In the mobile information terminal 3C, the image synchronization unit 34 is connected to the terminal side wireless communication unit 31. In addition, the camera unit 33 is connected to the image synchronization unit 34.

[0163] The external device 4C is obtained by removing the image processing unit 42 and the image synchronization unit 43 from the external device 4 of the first embodiment, and includes an external control unit 46C instead of the external control unit 46, and an external device side processor 48C instead of the external device side processor 48. In the external device 4C, a display control unit 44 is connected to the external wireless communication unit 41.

[0164] The probe-side wireless communication unit 24 of the ultrasonic probe 2C wirelessly transmits the received data before imaging that has been subjected to the envelope detection process by the signal processing unit 23 to only the mobile information terminal 3C.

[0165] The terminal-side wireless communication unit 31 of the mobile information terminal 3C receives the reception data before imaging wirelessly transmitted from the ultrasonic probe 2C, and sends the received reception data before imaging to the image processing unit 32 .

[0166] The image processing unit 32 raster-converts the received data before being imaged sent from the terminal-side wireless communication unit 31 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal, thereby generating an ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3C and an ultrasonic image U conforming to the display format for the external monitor 45 of the external device 4C. In addition, the image processing unit 32 sends the ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3C and the ultrasonic image U conforming to the display format for the external monitor 45 of the external device 4C to the image synchronization unit 34.

[0167] The camera unit 33 acquires a field of view image C of a scanned region of the subject captured by the ultrasonic probe 2C, and sends the acquired field of view image C to the image synchronization unit 34 .

[0168] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the image processing unit 32 and the visual field image C sent from the camera unit 33. More specifically, the image synchronization unit 34 synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the terminal monitor 36 of the mobile information terminal 3C to generate a synthesized image M, and also synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the external monitor 45 of the external device 4C to generate a synthesized image M.

[0169] Furthermore, the image synchronization unit 34 sends the synthesized image M generated based on the ultrasonic image U and the visual field image C that are synchronized with each other and conform to the display format for the terminal monitor 36 of the mobile information terminal 3C to the display control unit 35. The display control unit 35 performs a predetermined process on the synthesized image M sent from the image synchronization unit 34 and sends the synthesized image M to the terminal monitor 36, as shown in FIG. Figure 3 As shown, the terminal monitor 36 displays the ultrasonic image U and the field of view image C synchronized with each other. The image synchronization unit 34 sends the composite image M generated from the ultrasonic image U and the field of view image C in accordance with the display format for the external monitor 45 of the external device 4C to the terminal side wireless communication unit 31.

[0170] The terminal-side wireless communication unit 31 wirelessly transmits the synthesized image M sent from the image synchronization unit 34 to the external device 4C.

[0171] The external wireless communication unit 41 of the external device 4C receives the synthesized image M wirelessly transmitted from the mobile information terminal 3C, and sends the received synthesized image M to the display control unit 44. The display control unit 44 performs a predetermined process on the synthesized image M sent from the external wireless communication unit 41, and then sends the synthesized image M to the external monitor 45. Figure 4 As shown, the ultrasonic image U and the visual field image C synchronized with each other are displayed together on the external monitor 45 .

[0172] As described above, according to the ultrasound system 1C according to the third embodiment of the present invention, even when the image processing unit 32 and the image synchronization unit 34 are provided only in the mobile information terminal 3C, the same field of view image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, similarly to the ultrasound system 1 according to the first embodiment in which the mobile information terminal 3 is provided with the image processing unit 32 and the external device 4 is provided with the image processing unit 42. Therefore, for example, an observer who observes the field of view image C and ultrasound image U through the external device 4C disposed at a remote location can give advice to the operator of the ultrasound probe 2C and the mobile information terminal 3C, so that an appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

[0173] And, in Figure 1 In the ultrasound system 1 of the first embodiment shown, the external device 4 is provided with the image processing unit 42 and the image synchronization unit 43, but in the ultrasound system 1C according to the third embodiment, the synthesized image M generated based on the ultrasound image U and the visual field image C is wirelessly transmitted from the mobile information terminal 3C to the external device 4C, so the external device 4C does not need to have the image processing unit 42 and the image synchronization unit 43, and the internal structure of the external device 4C is simplified compared with the internal structure of the external device 4 in the first embodiment. Therefore, according to the ultrasound system 1C according to the third embodiment, the power consumption and calculation load of the external device 4C can be reduced.

[0174] Implementation 4

[0175] In the third embodiment, the received data before imaging after envelope detection processing by the signal processing unit 23 of the ultrasonic probe 2 is wirelessly transmitted to the mobile information terminal 3 and the external device 4 , but the ultrasonic image U may also be generated by the ultrasonic probe 2 .

[0176] Fig.10 FIG. 4 shows a configuration of an ultrasound system 1D according to a fourth embodiment of the present invention. Fig. 9 In the ultrasound system 1C of the third embodiment shown, an ultrasound probe 2D is provided instead of the ultrasound probe 2C, a mobile information terminal 3D is provided instead of the mobile information terminal 3C, and an external device 4D is provided instead of the external device 4C. The ultrasound probe 2D is connected only to the mobile information terminal 3D through wireless communication, and the external device 4D is connected only to the mobile information terminal 3D through wireless communication.

[0177] The ultrasonic probe 2D is obtained by adding an image processing unit 81 to the ultrasonic probe 2C of the third embodiment, and includes a probe control unit 26D instead of the probe control unit 26, and a probe side processor 27D instead of the probe side processor 27. In the ultrasonic probe 2D, the image processing unit 81 is connected to the signal processing unit 23, and the probe side wireless communication unit 24 and the probe control unit 26D are connected to the image processing unit 81. Although not shown in the figure, the signal processing unit 23 and the image processing unit 81 constitute an ultrasonic image generating unit.

[0178] The mobile information terminal 3D is a mobile information terminal 3C of the third embodiment, except that the image processing unit 32 is removed, and a terminal control unit 37D is provided instead of the terminal control unit 37C, and a terminal side processor 39D is provided instead of the terminal side processor 39C. In the mobile information terminal 3D, an image synchronization unit 34 is connected to the terminal side wireless communication unit 31. In addition, the camera unit 33 is connected to the image synchronization unit 34.

[0179] The external device 4D is the external device 4C according to the third embodiment, but includes an external control unit 46D instead of the external control unit 46C, and includes an external device-side processor 48D instead of the external device-side processor 48C.

[0180] The image processing unit 81 of the ultrasonic probe 2D converts the signal raster subjected to the envelope detection processing by the signal processing unit 23 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal, thereby generating an ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3D and an ultrasonic image U conforming to the display format for the external monitor 45 of the external device 4D. The image processing unit 81 then sends the generated ultrasonic images U to the probe-side wireless communication unit 24.

[0181] The probe-side wireless communication unit 24 wirelessly transmits the ultrasonic image U sent from the image processing unit 81 to the mobile information terminal 3D.

[0182] The terminal-side wireless communication unit 31 receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2D, and sends the received ultrasonic image U to the image synchronization unit 34 .

[0183] The camera unit 33 acquires a field of view image C of a scanned region of the subject captured by the ultrasonic probe 2D, and sends the acquired field of view image C to the image synchronization unit 34 .

[0184] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 and the visual field image C sent from the camera unit 33, and generates a composite image M based on the synchronized ultrasonic image U and visual field image C. Specifically, the image synchronization unit 34 synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the terminal monitor 36 of the mobile information terminal 3D, and also synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the external monitor 45 of the external device 4D.

[0185] The image synchronization unit 34 sends the composite image M generated from the ultrasonic image U and the visual field image C synchronized with each other in accordance with the display format for the terminal monitor 36 to the display control unit 35 .

[0186] The display control unit 35 performs a predetermined process on the synthesized image M sent from the image synchronization unit 34, and then sends the synthesized image M to the terminal monitor 36. Figure 3 As shown, the terminal monitor 36 displays the ultrasonic image U and the field of view image C synchronized with each other together.

[0187] Then, the image synchronization unit 34 sends the synthesized image M generated from the ultrasonic image U and the visual field image C that are synchronized with each other and conform to the display format for the external monitor 45 to the terminal side wireless communication unit 31 .

[0188] The terminal-side wireless communication unit 31 wirelessly transmits the synthesized image M sent from the image synchronization unit 34 to the external device 4D.

[0189] The external wireless communication unit 41 of the external device 4D receives the synthesized image M wirelessly transmitted from the mobile information terminal 3D, and sends the received synthesized image M to the display control unit 44 .

[0190] The display control unit 44 performs a predetermined process on the synthesized image M sent from the external wireless communication unit 41, and then sends the synthesized image M to the external monitor 45. Figure 4 As shown, the ultrasonic image U and the visual field image C are displayed together on the external monitor 45 in synchronization with each other.

[0191] As described above, according to the ultrasound system 1D according to the fourth embodiment, even when the image processing unit 81 is provided only in the ultrasound probe 2D and the image synchronization unit 34 is provided only in the mobile information terminal 3D, the same field of view image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, similarly to the ultrasound system 1C according to the third embodiment in which the mobile information terminal 3C is provided with the image processing unit 32 and the external device 4C is provided with the image processing unit 42. Therefore, for example, an observer who observes the field of view image C and ultrasound image U through the external device 4D disposed at a remote location can give advice to the operator of the ultrasound probe 2D and the mobile information terminal 3D, so that an appropriate ultrasound image U can be obtained, and the accuracy of ultrasound diagnosis can be improved.

[0192] Implementation method 5

[0193] In the third embodiment, the external device 4C receives the synthesized image M from the mobile information terminal 3C and displays the received synthesized image M on the external monitor 45. Therefore, the external device 4C cannot freely change the arrangement and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45. Fig.11 The ultrasound system 1E according to the fifth embodiment shown can arbitrarily change the arrangement and size of the ultrasound image U and the visual field image C displayed on the external monitor 45 on the external device 4E side.

[0194] Fig.112 shows the structure of an ultrasonic system 1E according to Embodiment 5 of the present invention. The ultrasonic system 1E includes an ultrasonic probe 2E having the same internal structure as the ultrasonic probe 2C in the ultrasonic system 1C according to Embodiment 3, and includes a mobile information terminal 3E instead of the mobile information terminal 3C, and includes an external device 4E instead of the external device 4C. The ultrasonic probe 2E is connected only to the mobile information terminal 3E through wireless communication, and the external device 4E is connected only to the mobile information terminal 3E through wireless communication.

[0195] The mobile information terminal 3E is provided with a terminal control unit 37E instead of the terminal control unit 37 in the mobile information terminal 3C of the third embodiment, and a terminal side processor 39E instead of the terminal side processor 39. In the mobile information terminal 3E, the image synchronization unit 34 is connected to the camera unit 33, and the image synchronization unit 34 is connected to the terminal side wireless communication unit 31.

[0196] The external device 4E is the external device 4C according to the third embodiment, but includes an external control unit 46E instead of the external control unit 46 , and includes an external device-side processor 48E instead of the external device-side processor 48 .

[0197] The probe-side wireless communication unit 24 of the ultrasonic probe 2E wirelessly transmits the received data before imaging that has been subjected to the envelope detection process by the signal processing unit 23 to the mobile information terminal 3E.

[0198] The terminal-side wireless communication unit 31 of the mobile information terminal 3E receives the reception data before imaging wirelessly transmitted from the ultrasonic probe 2E, and sends the received reception data before imaging to the image processing unit 32 .

[0199] The image processing unit 32 generates an ultrasonic image U in accordance with the display format for the terminal monitor 36 of the mobile information terminal 3E and an ultrasonic image U in accordance with the display format for the external monitor 45 of the external device 4E based on the received data before being imaged sent from the terminal-side wireless communication unit 31. The image processing unit 32 sends these ultrasonic images U to the image synchronization unit 34.

[0200] The camera unit 33 acquires a field of view image C of a scanned region of the subject captured by the ultrasonic probe 2E, and sends the acquired field of view image C to the image synchronization unit 34 .

[0201] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 with the visual field image C sent from the camera unit 33. Specifically, the image synchronization unit 34 synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the terminal monitor 36 of the mobile information terminal 3E, and also synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the external monitor 45 of the external device 4E.

[0202] The image synchronization unit 34 does not generate a single composite image M from the ultrasonic image U and the visual field image C synchronized with each other in accordance with the display format for the terminal monitor 36 , but sends the ultrasonic image U and the visual field image C to the display control unit 35 separately.

[0203] The display control unit 35 performs predetermined processing on the ultrasonic image U and the visual field image C sent from the image synchronization unit 34, such as Figure 3 As shown, the ultrasonic image U and the visual field image C are displayed together on the terminal monitor 36 in synchronization with each other.

[0204] Furthermore, the image synchronization unit 34 does not generate a single composite image M from the ultrasonic image U and the visual field image C that are synchronized with each other and conform to the display format for the external monitor 45 , but sends the ultrasonic image U and the visual field image C to the terminal side wireless communication unit 31 separately.

[0205] The terminal-side wireless communication unit 31 wirelessly transmits the ultrasonic image U and the field of view image C sent from the image synchronization unit 34 to the external device 4E.

[0206] The external wireless communication unit 41 of the external device 4E receives the ultrasonic image U and the visual field image C wirelessly transmitted from the mobile information terminal 3E, and sends the received ultrasonic image U and the visual field image C to the display control unit 44 .

[0207] The display control unit 44 performs predetermined processing on the ultrasonic image U and the visual field image C sent from the external wireless communication unit 41 , and displays the ultrasonic image U and the visual field image C synchronized with each other together on the external monitor 45 .

[0208] Here, the arrangement and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45 can be adjusted by the input operation of the observer via the input device 47. For example, if the observer inputs instruction information of the intention to adjust the arrangement and size of the ultrasonic image U and the visual field image C on the external monitor 45 via the input device 47, the input instruction information is input to the display control unit 44 through the external control unit 46E. The display control unit 44 adjusts the display according to the input instruction information, for example, according to the input instruction information. Fig.12 The configuration and size shown show the ultrasonic image U and the visual field image C synchronized with each other. Fig.12 In the example, Figure 4 Compared with the example shown, the external device 4E, the ultrasonic image U, and the visual field image C are rotated 90 degrees, and the ultrasonic image U and the visual field image C are displayed on the external monitor 45 in a manner that the visual field image C is superimposed on a part of the ultrasonic image U.

[0209] As described above, according to the ultrasound system 1E involved in embodiment 5 of the present invention, since the configuration and size of the ultrasound image U and the field of view image C displayed on the external monitor 45 of the external device 4E can be adjusted, the observer who observes the ultrasound image U and the field of view image C displayed on the external monitor 45 can confirm the ultrasound image U and the field of view image C more clearly according to his or her preference.

[0210] Implementation 6

[0211] In the fifth embodiment, the received data before imaging that has been subjected to envelope detection processing by the signal processing unit 23 is wirelessly transmitted to the mobile information terminal 3E by the probe-side wireless communication unit 24 . However, the ultrasonic image U may also be generated by the ultrasonic probe 2 .

[0212] Fig.13 FIG. 4 shows a configuration of an ultrasound system 1F according to a sixth embodiment of the present invention. Fig.11 In the ultrasound system 1E according to the fifth embodiment shown, an ultrasound probe 2F is provided instead of the ultrasound probe 2E, a mobile information terminal 3F is provided instead of the mobile information terminal 3E, and an external device 4F is provided instead of the external device 4E. The ultrasound probe 2F is connected only to the mobile information terminal 3F through wireless communication, and the external device 4F is connected only to the mobile information terminal 3F through wireless communication.

[0213] The ultrasonic probe 2F is obtained by adding an image processing unit 91 to the ultrasonic probe 2E of the fifth embodiment, and includes a probe control unit 26F instead of the probe control unit 26, and a probe side processor 27F instead of the probe side processor 27. In the ultrasonic probe 2F, the image processing unit 91 is connected to the signal processing unit 23, and the probe side wireless communication unit 24 and the probe control unit 26F are connected to the image processing unit 91. Although not shown in the figure, the signal processing unit 23 and the image processing unit 91 constitute an ultrasonic image generating unit.

[0214] The mobile information terminal 3F is a mobile information terminal 3E of the fifth embodiment, except that the image processing unit 32 is removed, and a terminal control unit 37F is provided instead of the terminal control unit 37E, and a terminal side processor 39F is provided instead of the terminal side processor 39E. In the mobile information terminal 3F, an image synchronization unit 34 is connected to the terminal side wireless communication unit 31. In addition, a camera unit 33 is connected to the image synchronization unit 34.

[0215] The external device 4F is the external device 4E according to the fifth embodiment, but includes an external control unit 46F instead of the external control unit 46E, and includes an external device-side processor 48F instead of the external device-side processor 48E.

[0216] The image processing unit 91 of the ultrasonic probe 2F converts the signal raster subjected to the envelope detection processing by the signal processing unit 23 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, grayscale correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal, thereby generating an ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3F and an ultrasonic image U conforming to the display format for the external monitor 45 of the external device 4F. Then, the image processing unit 91 sends the generated ultrasonic images U to the probe-side wireless communication unit 24.

[0217] The terminal-side wireless communication unit 31 receives the ultrasonic image U wirelessly transmitted from the ultrasonic probe 2F, and sends the received ultrasonic image U to the image synchronization unit 34 .

[0218] The camera unit 33 acquires a field of view image C of a scanned region of the subject captured by the ultrasonic probe 2F, and sends the acquired field of view image C to the image synchronization unit 34 .

[0219] The image synchronization unit 34 synchronizes the ultrasonic image U sent from the terminal-side wireless communication unit 31 with the visual field image C sent from the camera unit 33. Specifically, the image synchronization unit 34 synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the terminal monitor 36 of the mobile information terminal 3F, and also synchronizes the ultrasonic image U and the visual field image C in accordance with the display format for the external monitor 45 of the external device 4F.

[0220] The image synchronization unit 34 does not generate a single composite image M from the ultrasonic image U and the visual field image C synchronized with each other in accordance with the display format for the terminal monitor 36 , but sends the ultrasonic image U and the visual field image C to the display control unit 35 separately.

[0221] The display control unit 35 performs predetermined processing on the ultrasonic image U and the field of view image C sent from the image synchronization unit 34 , and displays the ultrasonic image U and the field of view image C synchronized with each other together on the terminal monitor 36 .

[0222] Furthermore, the image synchronization unit 34 does not generate a single composite image M from the ultrasonic image U and the visual field image C that are synchronized with each other and conform to the display format for the external monitor 45 , but sends the ultrasonic image U and the visual field image C to the terminal side wireless communication unit 31 separately.

[0223] The terminal-side wireless communication unit 31 wirelessly transmits the ultrasonic image U and the field of view image C sent from the image synchronization unit 34 to the external device 4F.

[0224] The external wireless communication unit 41 of the external device 4F receives the ultrasonic image U and the visual field image C wirelessly transmitted from the mobile information terminal 3F, and sends the received ultrasonic image U and the visual field image C to the display control unit 44 .

[0225] The display control unit 44 performs predetermined processing on the ultrasonic image U and the visual field image C sent from the external wireless communication unit 41 , thereby displaying the ultrasonic image U and the visual field image C synchronized with each other together on the external monitor 45 .

[0226] At this time, the display control unit 44 can adjust the arrangement and size of the ultrasonic image U and the visual field image C displayed on the external monitor 45 according to the input operation of the observer via the input device 47. Fig.12 As shown, the ultrasonic image U and the visual field image C are displayed together on the external monitor 45 in synchronization with each other.

[0227] As described above, according to the ultrasound system 1F involved in embodiment 6 of the present invention, even when the ultrasound probe 2F is equipped with an image processing unit 91, the configuration and size of the ultrasound image U and the field of view image C displayed on the external monitor 45 of the external device 4F can be adjusted, so that the observer who observes the ultrasound image U and the field of view image C displayed on the external monitor 45 can confirm the ultrasound image U and the field of view image C more clearly according to his or her preference.

[0228] Explanation of symbols

[0229] 1, 1B, 1C, 1D, 1E, 1F-ultrasound system, 2, 2B, 2C, 2D, 2E, 2F-ultrasound probe, 3, 3A, 3B, 3C, 3D, 3E, 3F-mobile information terminal, 4, 4A, 4B, 4C, 4D, 4E, 4F-external device, 21-vibrator array, 22-transmitting and receiving circuit, 23-signal processing unit, 24-probe side wireless communication unit, 26, 26B, 26D, 26F-probe control unit, 27, 27B, 27D, 27F-probe side processor, 31-terminal side wireless communication unit, 32, 42, 71, 81, 91-image processing unit, 33-camera unit, 34, 43-image synchronization unit, 35, 44-display control unit, 36- Terminal monitor, 37, 37A, 37B, 37C, 37D, 37E, 37F-terminal control unit, 38, 47-input device, 39, 39A, 39B, 39C, 39D, 39E, 39F-terminal side processor, 41-external wireless communication unit, 45-external monitor, 46, 46A, 46B, 46C, 46D, 46E, 46F-external control unit, 48, 48A, 48B, 48C, 48D, 48E, 48F-external device side processor, 51-pulse generator, 52-amplifier, 53-AD conversion unit, 54-beam former, 61, 63-microphone, 62, 64-speaker, A-cursor, C-field of view image, U-ultrasound image.

Claims

1. An ultrasound system comprising an ultrasound probe, a mobile information terminal and an external device, wherein: The ultrasonic probe comprises: vibrator array; a transceiver circuit for generating a sound ray signal based on ultrasonic waves transmitted from the transducer array and received signals acquired by the transducer array; an ultrasonic image generating unit that generates an ultrasonic image based on the sound ray signal generated by the transmitting and receiving circuit; and a probe-side wireless communication unit for wirelessly transmitting the ultrasonic image; The mobile information terminal comprises: a camera unit that acquires a field of view image of a scanning area of ​​the ultrasonic probe in the subject; a terminal-side wireless communication unit for wirelessly transmitting the field of view image acquired by the camera unit; Terminal monitor; and a first input device, The external device comprises: an external wireless communication unit, which is wirelessly connected to at least the terminal-side wireless communication unit; a first image synchronization unit that synchronizes the ultrasonic image and the visual field image captured at the same time with each other, and generates a composite image based on the synchronized ultrasonic image and the visual field image; External monitor; and a display control unit configured to display the ultrasonic image and the visual field image synchronized with each other by the first image synchronization unit on the external monitor, A cursor that can be moved by an input operation performed via the first input device of the mobile information terminal is displayed simultaneously on the terminal monitor and the external monitor.

2. The ultrasound system according to claim 1, wherein: The external wireless communication unit is wirelessly connected to both the probe side wireless communication unit and the terminal side wireless communication unit. The probe-side wireless communication unit wirelessly transmits the ultrasonic image to both the mobile information terminal and the external device.

3. The ultrasound system according to claim 1, wherein: The probe-side wireless communication unit wirelessly transmits the ultrasonic image to the mobile information terminal. The terminal-side wireless communication unit wirelessly transmits the ultrasonic image wirelessly transmitted from the probe-side wireless communication unit and the visual field image acquired by the camera unit to the external device.

4. The ultrasound system according to claim 1, wherein: The first image synchronization unit synchronizes the ultrasonic image and the field of view image captured at the same time with each other by referring to the timestamp of the ultrasonic image wirelessly sent from the ultrasonic probe indicating the time when the ultrasonic image is captured, and the timestamp of the field of view image wirelessly sent from the mobile information terminal indicating the time when the field of view image is captured.

5. The ultrasound system according to any one of claims 1 to 4, wherein: The ultrasonic image and the visual field image are displayed on the terminal monitor.

6. The ultrasound system according to claim 5, wherein: The mobile information terminal includes a second image synchronization unit that synchronizes the ultrasonic image and the visual field image with each other.

7. The ultrasound system according to claim 5, wherein: The external device includes a second input device, The external wireless communication unit wirelessly transmits external input information input via the second input device to the terminal side wireless communication unit, The external input information is displayed on the terminal monitor.

8. The ultrasound system according to any one of claims 1 to 4, wherein: The terminal-side wireless communication unit and the external wireless communication unit perform wireless communication of voice data in both directions.

9. The ultrasound system according to any one of claims 1 to 4, wherein: The mobile information terminal can be worn on the head of an operator who operates the ultrasonic probe and the mobile information terminal.

10. A control method for an ultrasound system, the ultrasound system comprising an ultrasound probe, a mobile information terminal and an external device, wherein: In the ultrasonic probe, generating a sound ray signal based on ultrasonic waves transmitted from a transducer array of the ultrasonic probe and received signals acquired by the transducer array, generating an ultrasonic image based on the generated sound ray signal, wirelessly transmitting the ultrasound image to the external device, In the mobile information terminal, acquiring a field of view image of a scanning area of ​​the ultrasonic probe in the subject, wirelessly sending the acquired visual field image to the external device, In the external device, The ultrasonic image and the visual field image captured at the same time are synchronized with each other, and a composite image is generated based on the synchronized ultrasonic image and the visual field image. displaying the ultrasonic image and the visual field image synchronized with each other on an external monitor, A cursor that can be moved by an input operation performed via a first input device of the mobile information terminal is simultaneously displayed on the terminal monitor of the mobile information terminal and the external monitor.

11. An ultrasound system comprising an ultrasound probe, a mobile information terminal and an external device, wherein: The ultrasonic probe comprises: vibrator array; a transceiver circuit for generating a sound ray signal based on ultrasonic waves transmitted from the transducer array and received signals acquired by the transducer array; a reception data generating unit for generating reception data before visualization by performing signal processing on the sound line signal generated by the transmission and reception circuit; and a probe-side wireless communication unit that wirelessly transmits the received data, The mobile information terminal comprises: a camera unit that acquires a field of view image of a scanning area of ​​the ultrasonic probe in the subject; a terminal-side wireless communication unit for wirelessly transmitting the field of view image acquired by the camera unit; Terminal monitor; and a first input device, The external device comprises: an external wireless communication unit, which is wirelessly connected to at least the terminal-side wireless communication unit; a first image synchronization unit that synchronizes the ultrasonic image and the visual field image captured at the same time with each other, and generates a composite image based on the synchronized ultrasonic image and the visual field image; External monitor; and a display control unit configured to display the ultrasonic image and the visual field image synchronized with each other by the first image synchronization unit on the external monitor, A cursor that can be moved by an input operation performed via the first input device of the mobile information terminal is displayed simultaneously on the terminal monitor and the external monitor.

12. The ultrasound system according to claim 11, wherein: The external wireless communication unit is wirelessly connected to both the probe side wireless communication unit and the terminal side wireless communication unit. The probe-side wireless communication unit wirelessly transmits the received data to both the mobile information terminal and the external device.

13. The ultrasound system according to claim 11, wherein: The probe-side wireless communication unit wirelessly transmits the received data to the mobile information terminal. The terminal-side wireless communication unit wirelessly transmits the reception data wirelessly transmitted from the probe-side wireless communication unit and the visual field image acquired by the camera unit to the external device.

14. The ultrasound system according to any one of claims 11 to 13, wherein: The external device includes an image processing unit that generates an ultrasonic image based on the reception data wirelessly transmitted from the probe-side wireless communication unit.

15. The ultrasound system according to any one of claims 11 to 13, wherein: The first image synchronization unit synchronizes the ultrasonic image and the field of view image captured at the same time with each other by referring to the timestamp of the ultrasonic image wirelessly sent from the ultrasonic probe indicating the time when the ultrasonic image was captured, and the timestamp of the field of view image wirelessly sent from the mobile information terminal indicating the time when the field of view image was captured.

16. The ultrasound system of claim 11, wherein: The probe-side wireless communication unit wirelessly transmits the received data to the mobile information terminal. The mobile information terminal includes an image processing unit that generates an ultrasonic image based on the received data wirelessly transmitted from the probe-side wireless communication unit. The terminal-side wireless communication unit wirelessly transmits the ultrasonic image generated by the image processing unit and the visual field image acquired by the camera unit to the external device.

17. The ultrasound system of claim 16, wherein: The ultrasonic image and the visual field image are displayed on the terminal monitor.

18. The ultrasound system of claim 17, wherein: The mobile information terminal includes a second image synchronization unit that synchronizes the ultrasonic image and the visual field image with each other.

19. The ultrasound system according to claim 17 or 18, wherein: The external device includes a second input device, The external wireless communication unit wirelessly transmits external input information input via the second input device to the terminal side wireless communication unit, The external input information is displayed on the terminal monitor.

20. The ultrasound system according to any one of claims 11 to 13 and 16 to 18, wherein: The terminal-side wireless communication unit and the external wireless communication unit perform wireless communication of voice data in both directions.

21. The ultrasound system according to any one of claims 11 to 13 and 16 to 18, wherein: The mobile information terminal can be worn on the head of an operator who operates the ultrasonic probe and the mobile information terminal.

22. A control method for an ultrasound system, the ultrasound system comprising an ultrasound probe, a mobile information terminal and an external device, wherein: In the ultrasonic probe, generating a sound ray signal based on ultrasonic waves transmitted from a transducer array of the ultrasonic probe and received signals acquired by the transducer array, By performing signal processing on the generated sound ray signal, reception data before imaging is generated, wirelessly transmitting the received data to the external device, In the mobile information terminal, acquiring a field of view image of a scanning area of ​​the ultrasonic probe in the subject, wirelessly sending the acquired visual field image to the external device, In the external device, Synchronizing the ultrasonic image and the field of view image captured at the same time with each other, generating a composite image based on the synchronized ultrasonic image and the field of view image, displaying the ultrasonic image and the visual field image synchronized with each other on an external monitor, A cursor that can be moved by an input operation performed via a first input device of the mobile information terminal is simultaneously displayed on the terminal monitor of the mobile information terminal and the external monitor.

Images