Ultrasonic system and control method of ultrasonic system

Abstract

To provide an ultrasonic system capable of acquiring an appropriate ultrasonic image and improving accuracy of ultrasonic diagnosis even when the ultrasonic image is captured in a remote area, and to provide a control method for the ultrasonic system.SOLUTION: An ultrasonic system (1) includes an ultrasonic probe (2), a portable information terminal (3), and an external device (4A). The portable information terminal (3) includes a camera part (33) for acquiring a visual field image, a first input device to which first information is input, a first information transmission part, and a terminal side wireless communication part (31) for wirelessly transmitting the visual field image, an ultrasonic image, and the first information. The external device (4A) includes an external monitor (45), a second input device to which second information is input, a second information transmission part, a display control part (44) for displaying the ultrasonic image and the visual field image in the external monitor (45), and an external wireless communication part (46A) for wirelessly transmitting the second information. An ultrasonic probe (2) and the portable information terminal (3) are controlled on the basis of the first information and the second information.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an ultrasound system and a control method for an ultrasound system, and more particularly to an ultrasound system that displays an ultrasound image on a portable information terminal and a control method for an ultrasound system. [Background technology]

[0002] Conventionally, ultrasonic diagnostic devices using ultrasonic images have been put to practical use in the medical field. In general, this type of ultrasonic diagnostic device has an ultrasonic probe with a built-in transducer array and a device main body connected to the ultrasonic probe, and transmits ultrasonic waves from the ultrasonic probe to a subject, receives ultrasonic echoes from the subject by the ultrasonic probe, and electrically processes the received signals in the device main body to generate an ultrasonic image.

[0003] In recent years, as disclosed in Patent Document 1, for example, ultrasonic diagnostic devices have been developed that display ultrasonic images acquired using an ultrasonic probe on an external monitor located away from the user and that include a portable information terminal for input operations on the ultrasonic probe and the external monitor, thereby improving the convenience of ultrasonic diagnosis. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-86360 A Summary of the Invention [Problem to be solved by the invention]

[0005] It is generally known that in ultrasound diagnosis using an ultrasound diagnostic device such as that disclosed in Patent Document 1, a certain level of skill is required to accurately grasp an area in a subject depicted in an ultrasound image by checking the ultrasound image. It is also known that the image quality of a generated ultrasound image is greatly affected by the technique of the operator.

[0006] Here, for example, when ultrasound images are taken in a remote location outside a hospital, such as in home nursing, the operator who operates the ultrasound probe to take the ultrasound image may be different from the observer, such as a doctor, who observes the taken ultrasound image and makes a diagnosis. In this case, since the operator usually needs to operate the ultrasound probe while checking the obtained ultrasound image by himself, and take an ultrasound image of the part inside the subject of interest, it may be difficult for the operator to judge whether or not the part of the subject of interest is accurately observed, particularly when the operator is less skilled. Also, an operator with a low level of skill may not be able to operate the ultrasound probe using an appropriate technique, and may obtain an ultrasound image of low image quality. Also, the observer checks the ultrasound image taken by the operator of the ultrasound diagnostic device to make a diagnosis, but since the observer cannot grasp how the operator takes the ultrasound image, it may be difficult to accurately judge whether or not the taken ultrasound image is taken using an appropriate technique, particularly when the ultrasound image is taken by an operator with a low level of skill.

[0007] The present invention has been made to solve such conventional problems, and has an object to provide an ultrasound system and a control method for an ultrasound system that can obtain appropriate ultrasound images and improve the accuracy of ultrasound diagnosis even when ultrasound images are taken in a remote location. [Means for solving the problem]

[0008] In order to achieve the above object, a first ultrasound system according to the present invention is an ultrasound system including an ultrasound probe, a portable information terminal, and an external device, wherein the ultrasound probe includes a transducer array, a transmission / reception circuit that transmits ultrasound from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array, an ultrasound image generation unit that generates an ultrasound image based on the sound ray signal generated by the transmission / reception circuit, and a probe-side wireless communication unit that wirelessly transmits the ultrasound image only to the portable information terminal, and the portable information terminal includes a terminal monitor, a camera unit that acquires a field of view image capturing an image of a scanning location of the ultrasound probe on a subject, a first input device into which first information is input by an operator of the portable information terminal, and a first input device that performs wireless communication bidirectionally with the external device. and a terminal-side wireless communication unit that wirelessly transmits to an external device the field of view image acquired by the camera unit, the ultrasound image received from the ultrasound probe, and the first information input to the first input device, wherein the external device includes an external monitor, a second input device into which second information is input by an observer on the external monitor, a display control unit that displays the ultrasound image and the field of view image together on the external monitor, and an external wireless communication unit that performs bidirectional wireless communication with a portable information terminal and wirelessly transmits to the portable information terminal the second information input to the second input device, and the ultrasound probe and the portable information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device.

[0009] The personal digital assistant includes a terminal monitor, and the ultrasound image and the field of view image can be displayed on the terminal monitor. The personal digital assistant may include an image synchronisation unit that synchronises the ultrasound image and the field of view image with each other. The external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit, and the second information can be displayed on the terminal monitor. The portable information terminal may be mountable on the head of an operator who operates the ultrasound probe and the portable information terminal.

[0010] A control method for an ultrasound system including an ultrasound probe, a portable information terminal, and an external device, the method comprising the steps of: in the ultrasound probe, transmitting ultrasound from a transducer array of the ultrasound probe and generating a sound ray signal based on a received signal acquired by the transducer array; generating an ultrasound image based on the generated sound ray signal; and wirelessly transmitting the ultrasound image to the portable information terminal; in the portable information terminal, acquiring a field of view image capturing a location of the ultrasound probe on a subject; accepting input of first information by an operator of the portable information terminal; wirelessly transmitting the acquired field of view image, the ultrasound image wirelessly transmitted from the ultrasound probe, and the first information whose input was accepted to the external device; in the external device, displaying the ultrasound image and the field of view image together on an external monitor; accepting input of second information by an observer of the external monitor; and controlling the ultrasound probe and the portable information terminal based on the first information input by the operator and the second information input by the observer.

[0011] A second ultrasound system according to the present invention is an ultrasound system including an ultrasound probe, a portable information terminal, and an external device, in which the ultrasound probe includes a transducer array, a transmission / reception circuit that transmits ultrasound from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array, a reception data generation unit that generates reception data before imaging by performing signal processing on the sound ray signal generated by the transmission / reception circuit, and a probe-side wireless communication unit that wirelessly transmits the reception data only to the portable information terminal, and the portable information terminal includes a terminal monitor, a camera unit that acquires a field of view image obtained by capturing an image of a scanning location of the ultrasound probe on a subject, a first input device into which first information is input by an operator of the portable information terminal, and a wireless communication unit that performs bidirectional wireless communication with the external device. and a terminal-side wireless communication unit that wirelessly transmits at least the field of view image acquired by the camera unit and the first information inputted to the first input device to an external device, the external device including an external monitor, a second input device to which second information is inputted by an observer of the external monitor, a display control unit that displays the ultrasound image and the field of view image generated based on the received data together on the external monitor, and an external wireless communication unit that performs bidirectional wireless communication with a portable information terminal and wirelessly transmits the second information inputted to the second input device to the portable information terminal, and the ultrasound probe and the portable information terminal are controlled based on the first information inputted by the operator via the first input device and the second information inputted by the observer via the second input device.

[0012] The external device can include an image processing unit that generates an ultrasound image based on reception data wirelessly transmitted from the probe side wireless communication unit. Alternatively, the probe-side wireless communication unit wirelessly transmits the received data to a portable information terminal, and the portable information terminal includes an image processing unit that generates an ultrasound image based on the received data wirelessly transmitted from the probe-side wireless communication unit, and the terminal-side wireless communication unit can wirelessly transmit the ultrasound image generated by the image processing unit and the field of view image acquired by the camera unit to an external device. At this time, the portable information terminal includes a terminal monitor, and the ultrasound image and the visual field image can be displayed on the terminal monitor.

[0013] The personal digital assistant may include an image synchronisation unit that synchronises the ultrasound image and the field of view image with each other. The external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit, and the second information can be displayed on the terminal monitor. The portable information terminal may be mountable on the head of an operator who operates the ultrasound probe and the portable information terminal.

[0014] A second ultrasonic system control method according to the present invention is a control method for an ultrasonic system including an ultrasonic probe, a portable information terminal, and an external device, characterized in that, in the ultrasonic probe, ultrasonic waves are transmitted from a transducer array of the ultrasonic probe and a sound ray signal is generated based on a received signal acquired by the transducer array, the generated sound ray signal is subjected to signal processing to generate received data before imaging, the received data is wirelessly transmitted to the portable information terminal, in the portable information terminal, a field of view image capturing a scanning location of the ultrasonic probe on the subject is acquired, an input of first information by an operator of the portable information terminal is accepted, and at least the acquired field of view image and the first information whose input is accepted are wirelessly transmitted to the external device, in the external device, the ultrasonic image generated based on the received data and the field of view image are displayed together on an external monitor, and an input of second information by an observer of the external monitor is accepted, and the ultrasonic probe and the portable information terminal are controlled based on the first information input by the operator and the second information input by the observer. Effect of the Invention

[0015] According to the present invention, an ultrasonic probe includes a transducer array, a transmission / reception circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array, an ultrasonic image generating unit that generates an ultrasonic image based on the sound ray signal generated by the transmission / reception circuit, and a probe-side wireless communication unit that wirelessly transmits the ultrasonic image only to a portable information terminal, and the portable information terminal includes a terminal monitor, a camera unit that acquires a field of view image of a scanning location of the ultrasonic probe on a subject, a first input device to which first information is input by an operator of the portable information terminal, and performs bidirectional wireless communication with an external device, and transmits the field of view image acquired by the camera unit, the ultrasonic image received from the ultrasonic probe, and the second information input to the first input device. and a terminal-side wireless communication unit that wirelessly transmits the first information to an external device, the external device including an external monitor, a second input device into which second information is input by an observer on the external monitor, a display control unit that displays an ultrasound image and a field of view image together on the external monitor, and an external wireless communication unit that performs bidirectional wireless communication with the portable information terminal and wirelessly transmits the second information input to the second input device to the portable information terminal, and the ultrasound probe and the portable information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device, so that even when an ultrasound image is taken in a remote location, an appropriate ultrasound image can be obtained and the accuracy of ultrasound diagnosis can be improved. [Brief description of the drawings]

[0016] [Figure 1] 1 is a block diagram showing a configuration of an ultrasound system according to a first embodiment of the present invention. [Diagram 2] 1 is a block diagram showing an internal configuration of a transmission / reception circuit according to a first embodiment of the present invention. [Diagram 3] FIG. 1 is a diagram illustrating an example of a portable information terminal according to a first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram illustrating an example of an external device according to the first embodiment of the present invention. [Diagram 5]FIG. 13 is a diagram showing a schematic example of a cursor placed on a visual field image in a modified example of the first embodiment of the present invention. [Figure 6] FIG. 13 is a block diagram showing a configuration of a portable information terminal according to another modified example of the first embodiment of the present invention. [Figure 7] FIG. 13 is a block diagram showing a configuration of an external device according to another modified example of the first embodiment of the present invention. [Figure 8] FIG. 11 is a block diagram showing a configuration of an ultrasound system according to a second embodiment of the present invention. [Figure 9] FIG. 11 is a block diagram showing a configuration of an ultrasound system according to a third embodiment of the present invention. [Figure 10] FIG. 11 is a block diagram showing the configuration of an ultrasound system according to a fourth embodiment of the present invention. [Figure 11] FIG. 11 is a block diagram showing the configuration of an ultrasound system according to a fifth embodiment of the present invention. [Figure 12] 13A to 13C are diagrams showing schematic examples of an ultrasound image and a field of view image displayed on an external device in accordance with a fifth embodiment of the present invention. [Figure 13] FIG. 13 is a block diagram showing the configuration of an ultrasound system according to a sixth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The following description of the components will be given based on a representative embodiment of the present invention, but the present invention is not limited to such an embodiment. In this specification, a numerical range expressed using "to" means a range that includes the numerical values ​​before and after "to" as the lower and upper limits. In this specification, the terms "same" and "identical" include a generally acceptable margin of error in the technical field.

[0018] First embodiment 1 shows the configuration of an ultrasound system 1 according to a first embodiment of the present invention. The ultrasound system 1 includes an ultrasound probe 2, a portable information terminal 3, and an external device 4. The portable information terminal 3 and the external device 4 are connected to the ultrasound probe 2 via wireless communication, and the portable information terminal 3 and the external device 4 are connected to each other via wireless communication.

[0019] The ultrasonic probe 2 includes a transducer array 21, to which a transmission / reception circuit 22, a signal processing unit 23, and a probe-side wireless communication unit 24 are sequentially connected. The probe-side wireless communication unit 24 is connected by wireless communication to the mobile information terminal 3 and the external device 4. Although not shown, the signal processing unit 23 constitutes a received data generating unit. A probe control unit 26 is connected to the transmission / reception circuit 22, the signal processing unit 23, and the probe side wireless communication unit 24. A probe side processor 27 is configured by the signal processing unit 23, the probe side wireless communication unit 24, and the probe control unit 26.

[0020] The portable information terminal 3 includes a terminal-side wireless communication unit 31 that is connected to the ultrasonic probe 2 and the external device 4 by wireless communication, and an image processing unit 32 is connected to the terminal-side wireless communication unit 31. The portable information terminal 3 also includes a camera unit 33 that is connected to the terminal-side wireless communication unit 31. An image synchronization unit 34 is also connected to the image processing unit 32 and the camera unit 33. Moreover, a display control unit 35 and a terminal monitor 36 are sequentially connected to the image synchronization unit 34. Moreover, a terminal control unit 37 is connected to the terminal side wireless communication unit 31, the image processing unit 32, the camera unit 33, the image synchronization unit 34, and the display control unit 35. Moreover, an input device 38 is connected to the terminal control unit 37. Moreover, a terminal side processor 39 is configured by the terminal side wireless communication unit 31, the image processing unit 32, the image synchronization unit 34, the display control unit 35, and the terminal control unit 37.

[0021] The external device 4 includes an external wireless communication unit 41 that is connected to the ultrasound probe 2 and the mobile information terminal 3 by wireless communication, and an image processing unit 42 and an image synchronization unit 43 are connected to the external wireless communication unit 41. The image processing unit 42 is also connected to the image synchronization unit 43. A display control unit 44 and an external monitor 45 are also connected to the image synchronization unit 43 in this order. An external control unit 46 is connected to the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, and the display control unit 44. An input device 47 is connected to the external control unit 46. An external device side processor 48 is configured by the external wireless communication unit 41, the image processing unit 42, the image synchronization unit 43, the display control unit 44, and the external control unit 46.

[0022] The transducer array 21 of the ultrasonic probe 2 has a plurality of transducers arranged one-dimensionally or two-dimensionally. Each of these transducers transmits ultrasonic waves in accordance with a drive signal supplied from the transmission / reception circuit 22, receives ultrasonic echoes from the subject, and outputs a reception signal based on the ultrasonic echoes. Each transducer is configured by forming electrodes on both ends of a piezoelectric body made of, for example, a piezoelectric ceramic represented by PZT (Lead Zirconate Titanate), a polymeric piezoelectric element represented by PVDF (Poly Vinylidene Di Fluoride), or a piezoelectric single crystal represented by PMN-PT (Lead Magnesium Niobate-Lead Titanate).

[0023] The transmission / reception circuit 22, under the control of the probe control unit 26, transmits ultrasonic waves from the transducer array 21 and generates sound ray signals based on reception signals acquired by the transducer array 21. As shown in Fig. 2, the transmission / reception circuit 22 has a pulser 51 connected to the transducer array 21, and an amplifier unit 52, an AD (Analog-to-Digital) converter unit 53, and a beamformer 54, which are connected in series from the transducer array 21 in this order.

[0024] The pulser 51 includes, for example, a plurality of pulse generators, and adjusts the delay amount of each drive signal and supplies it to the plurality of transducers so that the ultrasonic waves transmitted from the plurality of transducers of the transducer array 21 form an ultrasonic beam based on the transmission delay pattern selected in response to the control signal from the probe control unit 26. In this way, when a pulsed or continuous wave voltage is applied to the electrodes of the transducers of the transducer array 21, the piezoelectric body expands and contracts, and each transducer generates a pulsed or continuous wave ultrasonic wave, and an ultrasonic beam is formed from the composite wave of those ultrasonic waves.

[0025] The transmitted ultrasonic beam is reflected by an object such as a part of the subject, and propagates toward the transducer array 21 of the ultrasonic probe 2. When the ultrasonic echo propagates toward the transducer array 21 in this manner, each transducer constituting the transducer array 21 receives the propagating ultrasonic echo and expands and contracts to generate received signals, which are electrical signals.

[0026] The amplifier 52 amplifies signals input from each transducer constituting the transducer array 21 and transmits the amplified signals to the AD converter 53. The AD converter 53 converts the signals transmitted from the amplifier 52 into digital reception data and transmits the reception data to the beamformer 54. The beamformer 54 performs so-called reception focusing processing by adding each of the reception data converted by the AD converter 53 with a delay according to the sound speed or sound speed distribution set based on the reception delay pattern selected in response to a control signal from the probe control unit 26. This reception focusing processing causes each of the reception data converted by the AD converter 53 to be phased and added, and a sound ray signal with a narrowed focus of the ultrasonic echo is acquired.

[0027] The signal processing unit 23 generates reception data before imaging by performing signal processing on the sound ray signals generated by the beamformer 54 of the transmission / reception circuit 22. More specifically, the signal processing unit 23 performs an envelope detection process on the sound ray signals generated by the beamformer 54 of the transmission / reception circuit 22 to correct attenuation caused by the propagation distance in accordance with the depth of the position where the ultrasonic waves are reflected, and then generates a signal representing tomographic image information on tissues in the subject as reception data before imaging.

[0028] The probe-side wireless communication unit 24 includes an antenna for transmitting and receiving radio waves, and generates a transmission signal representing the pre-imaging reception data by modulating a carrier based on the pre-imaging reception data generated by the signal processing unit 23. The probe-side wireless communication unit 24 wirelessly transmits the pre-imaging reception data sequentially to the terminal-side wireless communication unit 31 of the mobile information terminal 3 and the external wireless communication unit 41 of the external device 4 by supplying the thus generated transmission signal to an antenna and transmitting radio waves from the antenna. As a modulation method of the carrier, ASK (Amplitude Shift Keying), PSK (Phase Shift Keying), QPSK (Quadrature Phase Shift Keying), 16QAM (16 Quadrature Amplitude Modulation), etc. are used.

[0029] In addition, wireless communication between the probe side wireless communication unit 24 of the ultrasonic probe 2, the terminal side wireless communication unit 31 of the mobile information terminal 3, and the external wireless communication unit 41 of the external device 4 can be performed in accordance with communication standards for mobile communication such as 5G (5th Generation: fifth generation mobile communication system) and 4G (4th Generation: fourth generation mobile communication system), and communication standards for short-range wireless communication such as WiFi (registered trademark), Bluetooth (registered trademark), and UWB (Ultra Wide Band: ultra-wideband wireless system).

[0030] Since the ultrasonic probe 2 and the portable information terminal 3 are assumed to be located in close proximity to each other, either of the wireless communication methods, mobile communication or short-range wireless communication, can be adopted for wireless communication between the ultrasonic probe 2 and the portable information terminal 3. In addition, since it is assumed that the external device 4 is located in a remote location relative to the ultrasonic probe 2 and the mobile information terminal 3, it is preferable that mobile communication is performed as the wireless communication between the external device 4 and the ultrasonic probe 2 and the wireless communication between the external device 4 and the mobile information terminal 3. In particular, from the viewpoint of reducing the time lag in data transmission between the external device 4 and the ultrasonic probe 2 and the mobile information terminal 3, it is preferable that mobile communication conforming to 5G is performed as the wireless communication between the external device 4 and the ultrasonic probe 2 and the wireless communication between the external device 4 and the mobile information terminal 3.

[0031] The probe control unit 26 controls each part of the ultrasonic probe 2 based on a control program stored in advance. Although not shown, a probe side storage unit is connected to the probe control unit 26. The probe side storage unit stores a control program for the ultrasonic probe 2 and the like. As the probe side storage unit, for example, a flash memory, a RAM (Random Access Memory), an SD card (Secure Digital card), an SSD (Solid State Drive), or the like can be used. Although not shown, the ultrasonic probe 2 includes a built-in battery, and power is supplied to each circuit of the ultrasonic probe 2 from the battery.

[0032] The probe side processor 27 having the signal processing unit 23, the probe side wireless communication unit 24 and the probe control unit 26 is composed of a CPU (Central Processing Unit) and a control program for causing the CPU to perform various processes, but may also be composed of an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a GPU (Graphics Processing Unit) or other ICs (Integrated Circuits), or may be composed of a combination of these.

[0033] Furthermore, the signal processing unit 23, the probe wireless communication unit 24, and the probe control unit 26 of the probe-side processor 27 may be configured to be partially or entirely integrated into a single CPU or the like.

[0034] The terminal-side wireless communication unit 31 of the mobile information terminal 3 includes an antenna for transmitting and receiving radio waves, and receives, under the control of the terminal control unit 37, a transmission signal representing the received data before imaging transmitted by the probe-side wireless communication unit 24 of the ultrasonic probe 2 via the antenna, and outputs the received data before imaging by demodulating the received transmission signal. Furthermore, the terminal-side wireless communication unit 31 sends the received data before imaging to the image processing unit 32.

[0035] The image processing unit 32 raster-converts the received data before imaging sent from the terminal-side wireless communication unit 31 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal conforming to the display format for the terminal monitor 36, thereby generating a B-mode (Brightness mode) image signal. The B-mode image signal generated in this manner is simply referred to as an ultrasound image U. The image processing unit 32 also sends the generated ultrasound image U to the image synchronization unit 34.

[0036] The camera unit 33 acquires a visual field image C obtained by capturing an image of a scanning location of the ultrasonic probe 2 on the subject. Although not shown, the camera unit 33 includes a photographing lens, an image sensor that captures an image of the scanning location of the ultrasonic probe 2 through the photographing lens and acquires a visual field image signal, which is an analog signal, an analog signal processing circuit that amplifies the visual field image signal acquired by the image sensor and converts it into a digital signal, and a digital signal processing circuit that performs various corrections such as gain on the converted digital signal to generate the visual field image C. The analog signal processing circuit and the digital signal processing circuit can also be built into the terminal processor 39. The camera unit 33 transmits the generated visual field image C to the terminal wireless communication unit 31 and the image synchronization unit 34. The visual field image C transmitted to the terminal wireless communication unit 31 is wirelessly transmitted to the external device 4 by the terminal wireless communication unit 31.

[0037] The image synchronization unit 34 synchronizes the ultrasonic image U generated by the image processing unit 32 with the field of view image C generated by the camera unit 33, and generates a composite image M based on the ultrasonic image U and the field of view image C synchronized with each other. Here, synchronizing the ultrasonic image U and the field of view image C with each other means associating the ultrasonic image U and the field of view image C captured at the same timing with each other. For example, when the image processing unit 32 assigns a timestamp representing the time when the ultrasonic image U was generated to the ultrasonic image U, and the camera unit 33 assigns a timestamp representing the time when the field of view image C was generated to the field of view image C, the image synchronization unit 34 regards the timestamp of the ultrasonic image U as representing the time when the ultrasonic image U was captured, and regards the timestamp of the field of view image C as representing the time when the field of view image C was captured, and refers to the timestamps of the ultrasonic image U and the field of view image C, thereby synchronizing the ultrasonic image U and the field of view image C captured at the same timing with each other.

[0038] In addition, when associating the ultrasonic image U with the visual field image C, the image synchronization unit 34 can, for example, refer to the time stamp of the ultrasonic image U and the time stamp of the visual field image C, and if the difference between the time when the ultrasonic image U was captured and the time when the visual field image C was captured is within a certain range, for example, within 0.1 seconds, regard the ultrasonic image U and the visual field image C as having been captured at the same timing, and perform the association. In addition, the image synchronization unit 34 can, for example, refer to the time stamp of the ultrasonic image U and the time stamp of the visual field image C, select the visual field image C captured at the time closest to the time when the ultrasonic image U to be associated was captured, and associate the selected ultrasonic image U with the visual field image C. In addition, the image synchronization unit 34 can, for example, select the ultrasonic image U captured at the time closest to the time when the visual field image C to be associated was captured, and associate the selected ultrasonic image U with the visual field image C. The image synchronization unit 34 sends the ultrasound image U and the field of view image C synchronized in this manner to the display control unit 35.

[0039] The display control unit 35, under the control of the terminal control unit 37, performs a predetermined processing on the composite image M sent from the image synchronization unit 34, and displays the synchronized ultrasound image U and field of view image C together on the terminal monitor 36 of the mobile information terminal 3, as shown in Figure 3. The terminal monitor 36 displays the ultrasound image U and the visual field image C under the control of the display control unit 35, and includes, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL display (Organic Electroluminescence Display).

[0040] The input device 38 of the mobile information terminal 3 is used by the operator to perform input operations, and includes a touch sensor arranged over the terminal monitor 36. For example, the operator can input probe control information for controlling the ultrasonic probe 2 via the input device 38. The probe control information thus input is sent to the terminal-side wireless communication unit 31 via the terminal control unit 37, and wirelessly transmitted from the terminal-side wireless communication unit 31 to the ultrasonic probe 2.

[0041] The terminal control unit 37 controls each unit of the portable information terminal 3 based on a control program stored in advance. Although not shown, a terminal-side storage unit is connected to the terminal control unit 37. The terminal-side storage unit stores the control program and the like of the mobile information terminal 3. As the terminal-side storage unit, for example, a flash memory, a RAM, an SD card, an SSD, or the like can be used. Although not shown, the portable information terminal 3 includes a built-in battery, and power is supplied to each circuit of the portable information terminal 3 from the battery.

[0042] The terminal side processor 39 having the terminal side wireless communication unit 31, image processing unit 32, image synchronization unit 34, display control unit 35 and terminal control unit 37 is composed of a CPU and a control program for causing the CPU to perform various processes, but may be composed of an FPGA, DSP, ASIC, GPU or other ICs, or may be composed of a combination of these. In addition, the terminal side wireless communication unit 31, image processing unit 32, image synchronization unit 34, display control unit 35 and terminal control unit 37 of the terminal side processor 39 can be configured as a single CPU or the like, either partially or entirely integrated.

[0043] The external wireless communication unit 41 of the external device 4 includes an antenna for transmitting and receiving radio waves, and receives, under the control of the external control unit 46, a transmission signal representing the received data before imaging transmitted by the probe side wireless communication unit 24 of the ultrasound probe 2 and a transmission signal representing the visual field image C transmitted by the terminal side wireless communication unit 31 of the mobile information terminal 3 via the antenna, and demodulates the received transmission signal to output the received data before imaging and the visual field image C. Furthermore, the external wireless communication unit 41 sends the received data before imaging to the image processing unit 42, and sends the visual field image C to the image synchronization unit 43.

[0044] The image processing unit 42 raster-converts the received data before imaging sent from the external wireless communication unit 41 into an image signal conforming to a normal television signal scanning method, and performs various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, conforming to a display format for the external monitor 45, to generate an ultrasound image U. The image processing unit 42 sends the generated ultrasound image U to the image synchronization unit 43.

[0045] The image synchronization unit 43 of the external device 4 synchronizes the ultrasonic image U sent from the image processing unit 42 with the visual field image C sent from the external wireless communication unit 41, and generates a composite image M based on the ultrasonic image U and the visual field image C synchronized with each other. For example, when the image processing unit 42 of the external device 4 assigns a time stamp representing the time when the ultrasonic image U was generated to the ultrasonic image U, and the camera unit 33 of the mobile information terminal 3 assigns a time stamp representing the time when the visual field image C was generated to the visual field image C, the image synchronization unit 43 regards the time stamp of the ultrasonic image U as representing the time when the ultrasonic image U was captured, and regards the time stamp of the visual field image C as representing the time when the visual field image C was captured, and refers to the time stamps of the ultrasonic image U and the visual field image C, thereby synchronizing the ultrasonic image U and the visual field image C captured at the same timing with each other.

[0046] The display control unit 44, under the control of the external control unit 46, performs a predetermined processing on the composite image M sent from the image synchronization unit 43, and displays the synchronized ultrasound image U and field of view image C together on the external monitor 45 of the external device 4, as shown in Figure 4. The external monitor 45 displays the ultrasound image U, the visual field image C, and the like under the control of the display control unit 44, and includes, for example, a display device such as an LCD or an organic EL display. The input device 47 of the external device 4 is used by the operator to perform an input operation, and includes a touch sensor disposed on top of the external monitor 45 .

[0047] The external control unit 46 controls each part of the external device 4 based on a control program stored in advance. Although not shown, an external device side storage unit is connected to the external device 4. The external device side storage unit stores a control program and the like for the external device 4. As the external device side storage unit, for example, a flash memory, a RAM, an SD card, an SSD, etc. can be used. Although not shown, the external device 4 includes a built-in battery, and power is supplied to each circuit of the external device 4 from the battery.

[0048] The external device side processor 48 having the external wireless communication unit 41, image processing unit 42, image synchronization unit 43, display control unit 44 and external control unit 46 is composed of a CPU and a control program for causing the CPU to perform various processes, but may also be composed of an FPGA, DSP, ASIC, GPU or other ICs, or a combination of these. In addition, the external wireless communication unit 41, image processing unit 42, image synchronization unit 43, display control unit 44 and external control unit 46 of the external device side processor 48 can be configured as being partially or entirely integrated into a single CPU or the like.

[0049] Next, the operation of the ultrasound system 1 according to the first embodiment of the present invention will be described. First, the operator brings the ultrasonic probe 2 into contact with the body surface of the subject, and under the control of the probe control unit 26, ultrasonic beams are transmitted from the multiple transducers of the transducer array 21 into the subject in accordance with a drive signal from the pulsar 51 of the transmission / reception circuit 22. Ultrasonic echoes based on the transmitted ultrasonic beams are received by each transducer, and the received signals, which are analog signals, are output to the amplifier unit 52 and amplified, and are then AD converted by the AD conversion unit 53 to obtain received data. A beamformer 54 performs reception focusing processing on this received data, generating sound ray signals.

[0050] The generated sound ray signals are converted into pre-imaging reception data, which are signals representing tomographic image information related to tissues in the subject, by the signal processing unit 23. At this time, the signal processing unit 23 performs envelope detection processing on the sound ray signals after correcting attenuation caused by the propagation distance according to the depth of the position where the ultrasonic waves are reflected. The probe side wireless communication unit 24 wirelessly transmits the generated sound ray signal to the portable information terminal 3 and the external device 4.

[0051] The terminal-side wireless communication unit 31 of the mobile information terminal 3 receives the pre-imaging reception data wirelessly transmitted from the ultrasonic probe 2, and sends the received pre-imaging reception data to the image processing unit 32. The image processing unit 32 raster-converts the pre-imaging reception data sent from the terminal-side wireless communication unit 31 into an image signal conforming to a normal television signal scanning method, and performs various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal conforming to a display format for the terminal monitor 36, thereby generating an ultrasound image U. The ultrasound image U generated in this manner is sent to the image synchronization unit 34.

[0052] Also, the camera unit 33 of the mobile information terminal 3 acquires a visual field image C obtained by capturing an image of a scanning location of the ultrasonic probe 2 on the subject under the control of the terminal control unit 37. Although not shown, at this time, for example, the operator can input control information to capture the visual field image C via the input device 38 of the mobile information terminal 3 while pointing the photographing lens of the camera unit 33 toward the scanning location of the ultrasonic probe 2 on the subject. In this case, for example, the control information input by the operator is input to the terminal control unit 37, and the terminal control unit 37 can control the camera unit 33 to capture the visual field image C according to the control information. The visual field image C acquired in this manner is sent to the terminal side wireless communication unit 31 and the image synchronization unit 34.

[0053] When the image synchronization unit 34 receives the ultrasonic image U from the image processing unit 32 and the field of view image C from the camera unit 33, the image synchronization unit 34 synchronizes the received ultrasonic image U and field of view image C with each other to generate a composite image M in which the synchronized ultrasonic image U and field of view image C are combined into one. For example, when the image processing unit 32 assigns a timestamp representing the time when the ultrasonic image U was generated to the ultrasonic image U, and the camera unit 33 assigns a timestamp representing the time when the field of view image C was generated to the field of view image C, the image synchronization unit 34 regards the timestamp of the ultrasonic image U as representing the time when the ultrasonic image U was captured, and regards the timestamp of the field of view image C as representing the time when the field of view image C was captured, and by referring to the timestamps of the ultrasonic image U and the field of view image C, it is possible to associate the ultrasonic image U and the field of view image C captured at the same timing with each other.

[0054] The ultrasound image U and the field of view image C synchronized with each other by the image synchronization unit 34 are sent to the display control unit 35 as a composite image M. The display control unit 35 performs a predetermined process on the composite image M, and then sends the composite image M to the terminal monitor 36, and as shown in FIG. 3, the ultrasound image U and the field of view image C are displayed together on the terminal monitor 36. In the example shown in FIG. 3, the field of view image C and the ultrasound image U are displayed on the top and bottom of the terminal monitor 36. In this example, the field of view image C depicts the state in which the ultrasound probe 2 is in contact with the abdomen of the subject, and the ultrasound image U depicts the internal tissue of the abdomen of the subject. Therefore, by checking the terminal monitor 36 of the mobile information terminal 3, the operator can simultaneously check the field of view image C, which represents the scanning location of the ultrasound probe 2 on the subject, and the ultrasound image U corresponding to the field of view image C, and can easily associate and grasp the scanning location of the ultrasound probe 2 on the subject with the tissue inside the subject observed thereby.

[0055] Moreover, the visual field image C acquired by the camera unit 33 is wirelessly transmitted from the terminal side wireless communication unit 31 to the external device 4. The external wireless communication unit 41 of the external device 4 receives the pre-imaging received data wirelessly transmitted from the ultrasound probe 2 and the field of view image C wirelessly transmitted from the mobile information terminal 3, sends the received pre-imaging received data to the image processing unit 42, and sends the received field of view image C to the image synchronization unit 43.

[0056] The image processing unit 42 raster-converts the received data before imaging sent from the external wireless communication unit 41 into an image signal conforming to a normal television signal scanning method, and performs various necessary image processing on the converted image signal, such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, conforming to a display format for the external monitor 45, to generate an ultrasound image U. The image processing unit 42 sends the generated ultrasound image U to the image synchronization unit 43.

[0057] The image synchronization unit 43 synchronizes the ultrasonic image U sent from the image processing unit 42 with the visual field image C sent from the external wireless communication unit 41 to generate a composite image M in which the ultrasonic image U and the visual field image C synchronized with each other are combined into one. For example, when the image processing unit 42 of the external device 4 assigns a time stamp representing the time when the ultrasonic image U was generated to the ultrasonic image U, and the camera unit 33 of the mobile information terminal 3 assigns a time stamp representing the time when the visual field image C was generated to the visual field image C, the image synchronization unit 43 regards the time stamp of the ultrasonic image U as representing the time when the ultrasonic image U was captured, and regards the time stamp of the visual field image C as representing the time when the visual field image C was captured, and refers to the time stamps of the ultrasonic image U and the visual field image C, thereby synchronizing the ultrasonic image U and the visual field image C captured at the same timing with each other. At this time, the time in the mobile information terminal 3 and the time in the external device 4 can be shared with each other.

[0058] The time on the mobile information terminal 3 and the time on the external device 4 can be shared with each other, specifically, for example, the time can be shared based on either the mobile information terminal 3 or the external device 4. Also, for example, when either the mobile information terminal 3 or the external device 4 is connected to the Internet, the time of the built-in clock may be set using a communication protocol such as NTP (Network Time Protocol) or NITZ (Network Identity and Time Zone).

[0059] The ultrasound image U and the field of view image C synchronized with each other by the image synchronization unit 43 are sent to the display control unit 44 as a composite image M. The display control unit 44 performs a predetermined process on the composite image M, and then sends the composite image M to the external monitor 45, and as shown in FIG. 4, the ultrasound image U and the field of view image C are displayed together on the external monitor 45. In the example of FIG. 4, the external device 4 is shown to be a portable terminal similar to the mobile information terminal 3, and the field of view image C and the ultrasound image U are displayed above and below the terminal monitor 36 of the external device 4. In this example, similar to the ultrasound image U and the field of view image C displayed on the terminal monitor 36 of the mobile information terminal 3, the field of view image C depicts the ultrasound probe 2 being in contact with the abdomen of the subject, and the ultrasound image U depicts the internal tissue of the abdomen of the subject.

[0060] Here, the terminal monitor 36 of the mobile information terminal 3 and the external monitor 45 of the external device 4 display a visual field image C and an ultrasound image U that are synchronized with each other, but the same visual field image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45. Therefore, for example, even if the external device 4 is located in a remote location with respect to the mobile information terminal 3, an observer observing the external monitor 45 can observe the visual field image C and ultrasound image U captured at the examination site where the subject and the operator are located in almost real time.

[0061] In general, it is known that a certain level of skill is required to accurately grasp an internal part of a subject depicted in an ultrasound image by checking the ultrasound image, and that the image quality of an ultrasound image generated by an ultrasound diagnostic device is greatly affected by the technique of the operator.

[0062] For example, when an ultrasound image is taken in a remote location outside a hospital, such as in home nursing, the operator who operates the ultrasound probe to take the ultrasound image may be different from the observer, such as a doctor, who observes the taken ultrasound image and makes a diagnosis. In this case, the operator usually needs to operate the ultrasound probe while checking the obtained ultrasound image himself to take an ultrasound image of a target part inside the subject, so that, particularly when the operator is less skilled, it may be difficult for the operator to judge whether the target part of the subject is accurately observed. In addition, an operator with less skill may not be able to operate the ultrasound probe using appropriate techniques, resulting in an ultrasound image of low image quality.

[0063] In addition, an observer located remotely from the subject and the operator makes a diagnosis by checking the ultrasound images captured by the operator of the ultrasound diagnostic device. However, since the observer cannot grasp how the operator captures the ultrasound images, it can be difficult to accurately determine whether the ultrasound images have been captured using appropriate techniques, particularly when the ultrasound images are captured by an operator with low skill levels.

[0064] According to the ultrasound system 1 according to the first embodiment of the present invention, the same visual field image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, so that, for example, even if the external device 4 is located at a remote location relative to the mobile information terminal 3, the observer observing the external monitor 45 can observe, in almost real time, the visual field image C and ultrasound image U captured at the examination site where the subject and the operator are located. This allows, for example, a highly skilled observer to give advice to the operator in real time, so that even if the operator located at a remote location relative to the observer has a low level of skill, an appropriate ultrasound image U can be obtained and the accuracy of ultrasound diagnosis can be improved.

[0065] Furthermore, according to the ultrasound system 1 according to the first embodiment of the present invention, for example, it is possible to allow an observer who is located remotely from the operator and has a low level of skill to confirm a field of view image C showing how a highly skilled operator operates the ultrasound probe 2, and an appropriate ultrasound image U corresponding to the field of view image C. In this way, the ultrasound system 1 according to the first embodiment of the present invention is also very useful from the viewpoint of education.

[0066] Although it has been described that the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4 each provide a time stamp to the generated ultrasound image U, instead of the image processing unit 32 of the mobile information terminal 3 and the image processing unit 42 of the external device 4 providing a time stamp to the ultrasound image U, the signal processing unit 23 of the ultrasound probe 2 can provide a time stamp to the signal subjected to the envelope detection process. In this case, for example, by sharing the time in the ultrasound probe 2 and the time in the mobile information terminal 3 with each other, the ultrasound image U generated by the image processing unit 32 of the mobile information terminal 3 and the field of view image C generated by the camera unit 33 based on the signal provided with the time stamp can be synchronized with each other, and the ultrasound image U generated by the image processing unit 42 of the external device 4 and the field of view image C generated by the camera unit 33 can be synchronized with each other.

[0067] Here, the time in the ultrasonic probe 2 and the time in the portable information terminal 3 can be shared, for example, based on either the ultrasonic probe 2 or the portable information terminal 3. Also, for example, when either the ultrasonic probe 2 or the portable information terminal 3 is connected to the Internet, the time of the built-in clock may be set using a communication protocol such as NTP or NITZ.

[0068] In addition, the method of synchronizing the ultrasonic image U and the field of view image C with each other is not limited to the method using the time stamp described above. For example, as disclosed in Japanese Patent Application Laid-Open No. 2011-183056, when the timing of capturing the ultrasonic image U by the ultrasonic probe 2 and the timing of capturing the field of view image C by the camera unit 33 of the mobile information terminal 3 are synchronized, and further, when the time difference between the time when the ultrasonic image U is captured and the time when the field of view image C is captured is within a certain range, for example, within 0.1 seconds, the image synchronization unit 34 of the mobile information terminal 3 and the image synchronization unit 43 of the external device 4 consider that the ultrasonic image U and the field of view image C were captured at the same timing, and can synchronize the ultrasonic image U and the field of view image C with each other.

[0069] The image synchronization unit 34 of the mobile information terminal 3 generates a composite image M in which the mutually synchronized ultrasound image U and the field of view image C are combined into one, and sends the generated composite image M to the display control unit 35. Instead of generating the composite image M, the display control unit 35 can also send the mutually synchronized ultrasound image U and the field of view image C to the display control unit 35. In this case, the display control unit 35 performs a predetermined process on each of the ultrasound image U and the field of view image C sent from the image synchronization unit 34, and displays the mutually synchronized ultrasound image U and the field of view image C together on the terminal monitor 36, as shown in FIG. 3. Therefore, the operator can simultaneously check the position of the ultrasound probe 2 and the state of the tissue in the subject corresponding to the position.

[0070] Similarly, the image synchronization unit 43 of the external device 4 can also send the ultrasound image U and the field of view image C, which are synchronized with each other, to the display control unit 44 instead of generating the composite image M. In this case, the ultrasound image U and the field of view image C, which are synchronized with each other, are simultaneously displayed on the external monitor 45, so that an observer looking at the external monitor 45 can observe the field of view image C and the ultrasound image U, which are captured at the examination site where the subject and the operator are located, in almost real time.

[0071] Furthermore, although the ultrasonic probe 2 and the mobile information terminal 3 are connected to each other by wireless communication, for example, they may be connected to each other by wired communication instead of wireless communication. 4, the external device 4 is illustrated as a portable thin computer called a smartphone or tablet, similar to the mobile information terminal 3, but the external device 4 is not limited to this. For example, the external device 4 may be a so-called notebook personal computer or a desktop personal computer.

[0072] Also, although not shown, a second external device having a monitor may be installed near the site where the subject is examined by the operator, and the second external device may be connected to the ultrasonic probe 2 and the mobile information terminal 3 to display the ultrasonic image U and the field of view image C on the monitor of the second external device. In particular, when the second external device has a large monitor, the operator can more clearly confirm the ultrasonic image U and the field of view image C, and therefore can more clearly associate and grasp the scanning location of the ultrasonic probe 2 on the subject with the tissue in the subject being observed.

[0073] In addition, in FIG. 3, the mobile information terminal 3 is illustrated as a mobile thin computer called a smartphone or tablet, but is not limited to this as long as it is a mobile information terminal. For example, a terminal device that can be attached to the head of an operator can be used as the mobile information terminal 3. In such a terminal device, for example, a terminal monitor 36 is arranged so as to face the operator's eyes when the terminal device is attached to the head, and a visual field image C representing the operator's forward visual field is captured by the camera unit 33. Instead of directly checking the forward visual field, the operator can indirectly check the forward visual field by checking the visual field image C displayed on the terminal monitor 36. In this way, when the mobile information terminal 3 is attached to the operator's head, the operator does not need to hold the mobile information terminal 3 in his / her hand, so that the operator can perform a more diverse examination, such as performing a procedure of inserting a so-called puncture needle into a subject with the other hand while operating the ultrasound probe 2 with one hand.

[0074] 2, the transmission / reception circuit 22 has a beamformer 54 together with the amplifier 52 and the AD conversion unit 53, but the beamformer 54 may be disposed between the transmission / reception circuit 22 and the signal processing unit 23, rather than inside the transmission / reception circuit 22. In this case, the beamformer 54 can also be configured by the probe-side processor 27.

[0075] Also, for example, as shown in FIG. 5, external input information such as a cursor A that can be moved by an observer's input operation via the input device 47 of the external device 4 can be simultaneously displayed on the external monitor 45 of the external device 4 and the terminal monitor 36 of the mobile information terminal 3. In this case, for example, when the cursor A displayed on the external monitor 45 of the external device 4 is moved by an observer's input operation via the input device 47 of the external device 4, the cursor A displayed on the terminal monitor 36 of the mobile information terminal 3 is similarly moved. This allows, for example, more detailed information sharing between the operator of the ultrasound probe 2 and the mobile information terminal 3A and the observer located near the external device 4A. For example, a highly skilled observer who is observing the ultrasound image U and the field of view image C on the external monitor 45 of the external device 4A can easily support the examination performed by the operator by indicating, using the cursor A, the position where the ultrasound probe 2 should be scanned, to the less skilled operator of the ultrasound probe 2 and the mobile information terminal 3A.

[0076] Also, for example, a cursor A that can be moved by an input operation by the operator via the input device 38 of the portable information terminal 3 can be simultaneously displayed on the terminal monitor 36 of the portable information terminal 3 and the external monitor 45 of the external device 4. In this case, for example, a highly skilled operator can provide more easily and in detail education on ultrasound diagnosis to a less skilled observer positioned near the external device 4A. The shape of the cursor A is not limited to an arrow shape, but may be any shape such as a circle or a polygon.

[0077] Also, for example, audio data can be wirelessly communicated bidirectionally between the mobile information terminal 3 and the external device 4. Fig. 6 shows the configuration of a mobile information terminal 3A in a modification of the first embodiment of the present invention. The mobile information terminal 3A is similar to the mobile information terminal 3 shown in Fig. 1 except that a microphone 61 and a speaker 62 are added, a terminal control unit 37A is provided instead of the terminal control unit 37, and a terminal-side processor 39A is provided instead of the terminal-side processor 39. In the mobile information terminal 3A, the microphone 61 and the speaker 62 are connected to the terminal-side wireless communication unit 31.

[0078] 7 shows a configuration of an external device 4A in a modified example of the first embodiment of the present invention. The external device 4A is similar to the external device 4 shown in FIG. 1 except that a microphone 63 and a speaker 64 are added, an external control unit 46A is provided instead of the external control unit 46, and an external device-side processor 48A is provided instead of the external device-side processor 48. In the external device 4A, the microphone 63 and the speaker 64 are connected to the external wireless communication unit 41.

[0079] In a modification of the first embodiment of the present invention, audio data is transmitted and received bidirectionally between the portable information terminal 3A and the external device 4A. For example, when an operator of the ultrasonic probe 2 and the portable information terminal 3A speaks toward the portable information terminal 3A, the spoken voice is input to the microphone 61 of the portable information terminal 3A, and audio data is generated by the microphone 61. The generated audio data is wirelessly transmitted from the terminal side wireless communication unit 31 to the external device 4A. The external wireless communication unit 41 of the external device 4A receives the audio data wirelessly transmitted from the portable information terminal 3A, and transmits the received audio data to the speaker 64. The speaker 64 reproduces the audio spoken by the operator of the ultrasonic probe 2 and the portable information terminal 3A based on the audio data received from the external wireless communication unit 41.

[0080] Also, for example, when an observer observing the ultrasound image U and the visual field image C on the external monitor 45 of the external device 4A speaks toward the external device 4A, the spoken voice is input to the microphone 63 of the external device 4A, and voice data is generated by the microphone 63. The generated voice data is wirelessly transmitted from the external wireless communication unit 41 to the mobile information terminal 3A. The terminal-side wireless communication unit 31 of the mobile information terminal 3A receives the voice data wirelessly transmitted from the external device 4A, and sends the received voice data to the speaker 62. The speaker 62 reproduces the voice spoken by the observer located near the external device 4A based on the voice data received from the terminal-side wireless communication unit 31.

[0081] In this way, by bidirectionally transmitting and receiving voice data between the mobile information terminal 3A and the external device 4A, more detailed information can be shared between the operator of the ultrasound probe 2 and the mobile information terminal 3A and the observer located near the external device 4A. For example, a highly skilled observer observing the ultrasound image U and the visual field image C on the external monitor 45 of the external device 4A can give more easy and detailed advice to the less skilled operator of the ultrasound probe 2 and the mobile information terminal 3A. Also, for example, a highly skilled operator can provide more easy and detailed education on ultrasound diagnosis to a less skilled observer located near the external device 4A.

[0082] Also, the voice of the operator inputted to the microphone 61 of the mobile information terminal 3A can be used as an input operation of the operator. For example, the terminal control unit 37A can obtain instruction information by analyzing voice data generated based on the voice of the operator by the microphone 61, and control each part of the mobile information terminal 3A, such as starting and stopping the shooting of the field of view image C by the camera unit 33, according to the obtained instruction information. Furthermore, the ultrasonic probe 2 can be controlled based on the voice data analyzed by the terminal control unit 37A. In this case, for example, the voice data analyzed by the terminal control unit 37A is wirelessly transmitted from the terminal side wireless communication unit 31 to the ultrasonic probe 2 as input information from the operator, and inputted to the probe side control unit 26 via the probe side wireless communication unit 24. The probe control unit 26 can control each part of the ultrasonic probe 2, such as starting and stopping the transmission of ultrasonic waves by the transducer array 21, and starting and stopping the shooting of the field of view image C by the camera unit 33, based on the input information.

[0083] Also, the voice of the observer input to the microphone 63 of the external device 4A can be used as an input operation of the observer. For example, the external control unit 46A can acquire instruction information by analyzing voice data generated by the microphone 63 based on the voice of the observer, and control each part of the portable information terminal 3A, such as starting and stopping the capture of the visual field image C by the camera unit 33 of the portable information terminal 3A, and control each part of the ultrasonic probe 2, such as starting and stopping the transmission of ultrasonic waves by the transducer array 21 of the ultrasonic probe 2, according to the acquired instruction information.

[0084] Embodiment 2 In the first embodiment, in the ultrasonic probe 2, pre-imaging reception data is generated by performing envelope detection processing on the sound ray signal, and the generated pre-imaging reception data is wirelessly transmitted to the mobile information terminal 3 and the external device 4. However, an ultrasonic image U can also be generated in the ultrasonic probe 2, and the generated ultrasonic image U can also be wirelessly transmitted to the mobile information terminal 3 and the external device 4.

[0085] 8 shows the configuration of an ultrasound system 1B according to embodiment 2 of the present invention. The ultrasound system 1 is the same as the ultrasound system 1 of embodiment 1 shown in FIG. 1 except that an ultrasound probe 2A is provided instead of the ultrasound probe 2, a mobile information terminal 3B is provided instead of the mobile information terminal 3, and an external device 4B is provided instead of the external device 4.

[0086] The ultrasonic probe 2B is obtained by adding an image processing unit 71 to the ultrasonic probe 2 in the first embodiment, providing a probe control unit 26B instead of the probe control unit 26, and providing a probe-side processor 27B instead of the probe-side processor 27. In the ultrasonic probe 2B, the image processing unit 71 is connected to the signal processing unit 23. In addition, the probe-side wireless communication unit 24 and the probe control unit 26B are connected to the image processing unit 71. Although not shown, the signal processing unit 23 and the image processing unit 71 configure an ultrasonic image generating unit.

[0087] The mobile information terminal 3B is similar to the mobile information terminal 3 in the first embodiment in that the image processing unit 32 is removed, a terminal control unit 37B is provided instead of the terminal control unit 37, and a terminal side processor 39B is provided instead of the terminal side processor 39. In the mobile information terminal 3B, an image synchronization unit 34 and a camera unit 33 are connected to the terminal side wireless communication unit 31. The external device 4B is similar to the external device 4 in embodiment 1 in that the image processing unit 42 has been removed, the external control unit 46 has been replaced with an external control unit 46B, and the external device side processor 48 has been replaced with an external device side processor 48B.

[0088] The image processing unit 71 of the ultrasonic probe 2B raster-converts the signal that has been subjected to the envelope detection process by the signal processing unit 23 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processes such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal to generate an ultrasonic image U conforming to the display format for the terminal monitor 36 of the portable information terminal 3B and an ultrasonic image U conforming to the format for the external monitor 45 of the external device 4B. Furthermore, the image processing unit 71 wirelessly transmits the ultrasonic image U conforming to the display format for the terminal monitor 36 of the portable information terminal 3B from the probe-side wireless communication unit 24 to the portable information terminal 3B, and wirelessly transmits the ultrasonic image U conforming to the format for the external monitor 45 of the external device 4B from the probe-side wireless communication unit 24 to the external device 4B.

[0089] The terminal side wireless communication unit 31 of the portable information terminal 3B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B, and sends the received ultrasound image U to the image synchronization unit . The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal-side wireless communication unit 31 with the field of view image C generated by the camera unit 33, and generates a composite image M based on the synchronized ultrasound image U and field of view image C. For example, when the image processing unit 71 of the ultrasound probe 2B assigns a timestamp representing the time when the ultrasound image U was generated to the ultrasound image U, and the camera unit 33 of the mobile information terminal 3B assigns a timestamp representing the time when the field of view image C was generated to the field of view image C, the image synchronization unit 34 can synchronize the ultrasound image U and the field of view image C with each other based on the timestamps assigned to the ultrasound image U and the field of view image C.

[0090] The display control unit 35 performs a predetermined processing on the composite image M generated by the image synchronization unit 34, and then sends the composite image M to the terminal monitor 36, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the terminal monitor 36, as shown in Figure 3.

[0091] The external wireless communication unit 41 of the external device 4B receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2B and the field of view image C wirelessly transmitted from the mobile information terminal 3B, and sends the received ultrasound image U and field of view image C to the image synchronization unit 43. The image synchronization unit 43 synchronizes the ultrasound image U and the field of view image C sent from the external wireless communication unit 41 with each other, and generates a composite image M based on the ultrasound image U and the field of view image C that are synchronized with each other. The display control unit 44 performs a predetermined processing on the composite image M generated by the image synchronization unit 43, and then transmits the composite image M to the external monitor 45, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the external monitor 45, as shown in FIG. 4.

[0092] As described above, according to the ultrasound system 1B of the second embodiment of the present invention, even if the ultrasound probe 2B includes the image processor 71, the same visual field image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, similarly to the ultrasound system 1 of the first embodiment in which the mobile information terminal 3 includes the image processor 32 and the external device 4 includes the image processor 42. Therefore, for example, an observer who observes the visual field image C and ultrasound image U by the external device 4B located at a remote location can give advice to the operator of the ultrasound probe 2B and the mobile information terminal 3B, so that an appropriate ultrasound image U can be obtained and the accuracy of ultrasound diagnosis can be improved.

[0093] 1, the portable information terminal 3 is provided with the image processing unit 32 and the external device 4 is provided with the image processing unit 42, but in the ultrasonic system 1B according to the second embodiment, the ultrasonic probe 2B is provided with the image processing unit 71, so that the portable information terminal 3B and the external device 4B do not need to have the image processing units 32 and 42, respectively, and the internal configurations of the portable information terminal 3B and the external device 4B are simplified compared to the internal configurations of the portable information terminal 3 and the external device 4 in the ultrasonic system 1 according to the first embodiment. Therefore, according to the ultrasonic system 1B according to the second embodiment, it is possible to reduce the power consumption and calculation load of the portable information terminal 3B and the external device 4B, compared to the ultrasonic system 1 according to the first embodiment.

[0094] Third embodiment In the first embodiment, the ultrasound image U and the field of view image C are synchronized in the mobile information terminal 3 and the external device 4, respectively. However, for example, the ultrasound image U and the field of view image C may be synchronized only in the mobile information terminal 3.

[0095] Fig. 9 shows the configuration of an ultrasound system 1C according to the third embodiment of the present invention. The ultrasound system 1 is the same as the ultrasound system 1 of the first embodiment shown in Fig. 1 except that an ultrasound probe 2C having the same internal configuration as the ultrasound probe 2 is provided, a portable information terminal 3C is provided instead of the portable information terminal 3, and an external device 4C is provided instead of the external device 4. The ultrasound probe 2C is connected only to the portable information terminal 3C by wireless communication, and the external device 4C is connected only to the portable information terminal 3C by wireless communication.

[0096] The mobile information terminal 3C is configured such that a terminal control unit 37C is provided instead of the terminal control unit 37 and a terminal side processor 39C is provided instead of the terminal side processor 39 in the mobile information terminal 3 in the first embodiment. In the mobile information terminal 3C, an image synchronization unit is connected to the terminal side wireless communication unit 31. Also, the camera unit 33 is connected to the image synchronization unit .

[0097] The external device 4C is different from the external device 4 in the first embodiment in that the image processing unit 42 and the image synchronization unit 43 are removed, an external control unit 46C is provided instead of the external control unit 46, and an external device-side processor 48C is provided instead of the external device-side processor 48. In the external device 4C, a display control unit 44 is connected to the external wireless communication unit 41.

[0098] The probe side wireless communication unit 24 of the ultrasonic probe 2C wirelessly transmits the received data, which has been subjected to envelope detection processing by the signal processing unit 23 and has not yet been imaged, only to the mobile information terminal 3C. The terminal side wireless communication unit 31 of the mobile information terminal 3C receives the pre-imaging reception data wirelessly transmitted from the ultrasonic probe 2C, and sends the received pre-imaging reception data to the image processing unit 32.

[0099] The image processing unit 32 raster-converts the received data before imaging sent from the terminal-side wireless communication unit 31 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal to generate an ultrasound image U conforming to the display format for the terminal monitor 36 of the portable information terminal 3B and an ultrasound image U conforming to the format for the external monitor 45 of the external device 4B. Furthermore, the image processing unit 32 sends the ultrasound image U conforming to the display format for the terminal monitor 36 of the portable information terminal 3B and the ultrasound image U conforming to the format for the external monitor 45 of the external device 4B to the image synchronization unit 34.

[0100] The camera unit 33 acquires a field of view image C obtained by imaging a location on the subject scanned by the ultrasonic probe 2C, and sends the acquired field of view image C to an image synchronization unit . The image synchronization unit 34 synchronizes the ultrasound image U sent from the image processing unit 32 with the field of view image C sent from the camera unit 33. More specifically, the image synchronization unit 34 generates a composite image M by synchronizing the ultrasound image U and the field of view image C that conform to the display format for the terminal monitor 36 of the mobile information terminal 3B with each other, and further generates a composite image M by synchronizing the ultrasound image U and the field of view image C that conform to the display format for the external monitor 45 of the external device 4C with each other.

[0101] The image synchronization unit 34 also sends a composite image M generated based on the ultrasound image U and the field of view image C that conform to the display format for the terminal monitor 36 of the portable information terminal 3B, which are synchronized with each other, to the display control unit 35. The display control unit 35 performs a predetermined process on the composite image M sent from the image synchronization unit 34, and then sends the composite image M to the terminal monitor 36, and causes the ultrasound image U and the field of view image C, which are synchronized with each other, to be displayed together on the terminal monitor 36, as shown in Fig. 3. The image synchronization unit 34 also sends a composite image M generated based on the ultrasound image U and the field of view image C that conform to the display format for the external monitor 45 of the external device 4C, to the terminal side wireless communication unit 31.

[0102] The terminal side wireless communication unit 31 wirelessly transmits the composite image M sent from the image synchronization unit 34 to the external device 4C. The external wireless communication unit 41 of the external device 4C receives the composite image M wirelessly transmitted from the mobile information terminal 3C, and sends the received composite image M to the display control unit 44. The display control unit 44 performs a predetermined process on the composite image M sent from the external wireless communication unit 41, and then sends the composite image M to the external monitor 45, and causes the external monitor 45 to display the ultrasound image U and the visual field image C, which are synchronized with each other, together, as shown in FIG.

[0103] From the above, according to the ultrasound system 1C of the third embodiment of the present invention, even if the image processing unit 32 and the image synchronization unit 34 are provided only in the mobile information terminal 3C, the same visual field image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, similar to the ultrasound system 1 of the first embodiment in which the mobile information terminal 3 includes the image processing unit 32 and the external device 4 includes the image processing unit 42. Therefore, for example, an observer who observes the visual field image C and the ultrasound image U by the external device 4C located at a remote location can give advice to the operator of the ultrasound probe 2C and the mobile information terminal 3C, so that an appropriate ultrasound image U can be obtained and the accuracy of ultrasound diagnosis can be improved.

[0104] 1, the external device 4 includes an image processor 42 and an image synchronizer 43, but in the ultrasound system 1C according to the third embodiment, a composite image M generated based on an ultrasound image U and a field of view image C is wirelessly transmitted from a portable information terminal 3C to the external device 4C, so that the external device 4C does not need to include an image processor 42 and an image synchronizer 43, and the internal configuration of the external device 4C is simpler than that of the external device 4 according to the first embodiment. Therefore, according to the ultrasound system 1C according to the third embodiment, it is possible to reduce the power consumption and calculation load of the external device 4C.

[0105] Fourth embodiment In embodiment 3, the received data before imaging, which has been subjected to envelope detection processing by the signal processing unit 23 of the ultrasonic probe 2, is wirelessly transmitted to the mobile information terminal 3 and the external device 4, but the ultrasonic image U can also be generated in the ultrasonic probe 2.

[0106] Fig. 10 shows the configuration of an ultrasound system 1D according to the fourth embodiment of the present invention. The ultrasound system 1D is the same as the ultrasound system 1C of the third embodiment shown in Fig. 9 except that an ultrasound probe 2D is provided instead of the ultrasound probe 2C, a portable information terminal 3D is provided instead of the portable information terminal 3C, and an external device 4D is provided instead of the external device 4C. The ultrasound probe 2D is connected only to the portable information terminal 3D by wireless communication, and the external device 4D is connected only to the portable information terminal 3D by wireless communication.

[0107] The ultrasonic probe 2D is obtained by adding an image processing unit 81 to the ultrasonic probe 2C in the third embodiment, providing a probe control unit 26D instead of the probe control unit 26, and providing a probe-side processor 27D instead of the probe-side processor 27. In the ultrasonic probe 2D, the image processing unit 81 is connected to the signal processing unit 23, and the probe-side wireless communication unit 24 and the probe control unit 26D are connected to the image processing unit 81. Although not shown, the signal processing unit 23 and the image processing unit 81 configure an ultrasonic image generating unit.

[0108] The mobile information terminal 3D is a terminal in which the image processing unit 32 is removed from the mobile information terminal 3C in the third embodiment, a terminal control unit 37D is provided instead of the terminal control unit 37C, and a terminal side processor 39D is provided instead of the terminal side processor 39C. In the mobile information terminal 3D, an image synchronization unit 34 is connected to the terminal side wireless communication unit 31. Also, the camera unit 33 is connected to the image synchronization unit 34.

[0109] The external device 4D is configured such that an external control unit 46D is provided instead of the external control unit 46C of the external device 4C in the third embodiment, and an external device-side processor 48D is provided instead of the external device-side processor 48C.

[0110] The image processing unit 81 of the ultrasonic probe 2D raster-converts the signal that has been subjected to the envelope detection process by the signal processing unit 23 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processes such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal to generate an ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3D and an ultrasonic image U conforming to the format for the external monitor 45 of the external device 4D. In addition, the image processing unit 81 transmits these generated ultrasonic images U to the probe-side wireless communication unit 24.

[0111] The probe side wireless communication unit 31 wirelessly transmits the ultrasound image U sent from the image processing unit 81 to the mobile information terminal 3D. The terminal side wireless communication unit 31 receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2D, and sends the received ultrasound image U to the image synchronization unit . The camera unit 33 acquires a field of view image C obtained by imaging a location on the subject scanned by the ultrasonic probe 2D, and sends the acquired field of view image C to an image synchronization unit .

[0112] The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal side wireless communication unit 31 with the field of view image C sent from the camera unit 33, and generates a composite image M based on the synchronized ultrasound image U and field of view image C. Specifically, the image synchronization unit 34 synchronizes the ultrasound image U and field of view image C that conform to the format for the terminal monitor 36 of the mobile information terminal 3D with each other, and further synchronizes the ultrasound image U and field of view image C that conform to the format for the external monitor 45 of the external device 4D with each other.

[0113] The image synchronization unit 34 sends to the display control unit 35 a composite image M generated based on the ultrasound image U and the field of view image C, which comply with a format for the terminal monitor 36 and are synchronized with each other. The display control unit 35 performs a predetermined processing on the composite image M sent from the image synchronization unit 34, and then sends the composite image M to the terminal monitor 36, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the terminal monitor 36, as shown in Figure 3.

[0114] Furthermore, the image synchronization unit 34 sends to the terminal side wireless communication unit 31 a composite image M that is generated based on the ultrasound image U and the field of view image C that conform to a format for the external monitor 45 that are synchronized with each other. The terminal side wireless communication unit 31 wirelessly transmits the composite image M sent from the image synchronization unit 34 to the external device 4D.

[0115] The external wireless communication unit 41 of the external device 4D receives the composite image M wirelessly transmitted from the mobile information terminal 3D, and sends the received composite image M to the display control unit . The display control unit 44 performs a predetermined processing on the composite image M sent from the external wireless communication unit 41, and then sends the composite image M to the external monitor 45, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the external monitor 45, as shown in Figure 4.

[0116] From the above, according to the ultrasound system 1D of the fourth embodiment, even if the image processor 81 is provided only in the ultrasound probe 2D and the image synchronization unit 34 is provided only in the mobile information terminal 3D, the same visual field image C and ultrasound image U are displayed almost simultaneously on the terminal monitor 36 and the external monitor 45, similar to the ultrasound system 1C of the third embodiment in which the mobile information terminal 3C has the image processor 32 and the external device 4 has the image processor 42. Therefore, for example, an observer who observes the visual field image C and ultrasound image U by the external device 4D located at a remote location can give advice to the operator of the ultrasound probe 2D and the mobile information terminal 3D, so that an appropriate ultrasound image U can be obtained and the accuracy of ultrasound diagnosis can be improved.

[0117] Fifth embodiment In the third embodiment, the external device 4C receives the composite image M from the mobile information terminal 3C and displays the received composite image M on the external monitor 45. Therefore, the external device 4C cannot freely change the position and size of the ultrasound image U and the field of view image C displayed on the external monitor 45. However, according to the ultrasound diagnostic device 1E of the fifth embodiment shown in FIG. 11, the position and size of the ultrasound image U and the field of view image C displayed on the external monitor 45 can be arbitrarily changed on the external device 4E.

[0118] 11 shows the configuration of an ultrasound system 1E according to the fifth embodiment of the present invention. The ultrasound system 1E is the ultrasound system 1C according to the third embodiment, except that it is provided with an ultrasound probe 2E having the same internal configuration as the ultrasound probe 2C, a portable information terminal 3E instead of the portable information terminal 3C, and an external device 4E instead of the external device 4C. The ultrasound probe 2E is connected only to the portable information terminal 3E by wireless communication, and the external device 4E is connected only to the portable information terminal 3E by wireless communication.

[0119] The portable information terminal 3E is the same as the portable information terminal 3C in the third embodiment except that a terminal control unit 37E is provided instead of the terminal control unit 37, and a terminal side processor 39E is provided instead of the terminal side processor 39. In the portable information terminal 3E, an image synchronization unit 34 is connected to the camera unit 33, and the image synchronization unit 34 is connected to the terminal side wireless communication unit 31.

[0120] The external device 4E is configured such that an external control unit 46E is provided instead of the external control unit 46 of the external device 4C in the third embodiment, and an external device-side processor 48E is provided instead of the external device-side processor 48.

[0121] The probe side wireless communication unit 24 of the ultrasonic probe 2E wirelessly transmits the received data, which has been subjected to envelope detection processing by the signal processing unit 23 and has not yet been imaged, to the mobile information terminal 3E. The terminal side wireless communication unit 31 of the mobile information terminal 3E receives the pre-imaging reception data wirelessly transmitted from the ultrasonic probe 2E, and sends the received pre-imaging reception data to the image processing unit 32.

[0122] The image processing unit 32 generates an ultrasound image U conforming to a format for the terminal monitor 36 of the mobile information terminal 3E and an ultrasound image U conforming to a display format for the external monitor 45 of the external device 4E, based on the received data before imaging sent from the terminal side wireless communication unit 31. In addition, the image processing unit 32 sends these ultrasound images U to the image synchronization unit 34. The camera unit 33 acquires a visual field image C obtained by imaging a location on the subject scanned by the ultrasonic probe 2E, and sends the acquired visual field image C to an image synchronization unit .

[0123] The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal side wireless communication unit 31 with the field of view image C sent from the camera unit 33. Specifically, the image synchronization unit 34 synchronizes the ultrasound image U and the field of view image C that conform to the format for the terminal monitor 36 of the mobile information terminal 3E with each other, and further synchronizes the ultrasound image U and the field of view image C that conform to the format for the external monitor 45 of the external device 4E with each other.

[0124] The image synchronization unit 34 sends the ultrasound image U and the field of view image C to the display control unit 35, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to a format for the terminal monitor 36 that are synchronized with each other. The display control unit 35 performs a predetermined processing on the ultrasound image U and the field of view image C sent from the image synchronization unit 34, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the terminal monitor 36, as shown in Figure 3.

[0125] In addition, the image synchronization unit 34 sends the ultrasound image U and the field of view image C to the terminal side wireless communication unit 31, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to a format for the external monitor 45 that are synchronized with each other. The terminal side wireless communication unit 31 wirelessly transmits the ultrasound image U and the visual field image C sent from the image synchronization unit 34 to the external device 4E. The external wireless communication unit 41 of the external device 4E receives the ultrasound image U and the field of view image C wirelessly transmitted from the mobile information terminal 3E, and sends the received ultrasound image U and field of view image C to the display control unit 44, respectively.

[0126] The display control unit 44 performs predetermined processing on the ultrasound image U and the field of view image C sent from the external wireless communication unit 41, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the external monitor 45. Here, the arrangement and size of the display position and size of the ultrasound image U and the field of view image C displayed on the external monitor 45 can be adjusted by the observer's input operation via the input device 47. For example, when the observer inputs instruction information to adjust the arrangement and size of the ultrasound image U and the field of view image C on the external monitor 45 via the input device 47, the input instruction information is input to the display control unit 44 via the external control unit 46E. Based on the input instruction information, the display control unit 44 displays the ultrasound image U and the field of view image C synchronized with each other, for example, with the arrangement and size shown in FIG. 12. In the example shown in FIG. 12, the external device 4E, the ultrasound image U, and the field of view image C are rotated 90 degrees compared to the example shown in FIG. 4, and the ultrasound image U and the field of view image C are displayed on the external monitor 45 so that the field of view image C is superimposed on a part of the ultrasound image U.

[0127] As described above, according to the ultrasound system 1E of embodiment 5 of the present invention, the position and size of the ultrasound image U and field of view image C displayed on the external monitor 45 of the external device 4E can be adjusted, so that an observer observing the ultrasound image U and field of view image C displayed on the external monitor 45 can view the ultrasound image U and field of view image C more clearly according to his or her preferences.

[0128] Sixth embodiment In embodiment 5, the received data before imaging, which has been subjected to envelope detection processing by the signal processing unit 23, is wirelessly transmitted to the mobile information terminal 3E by the probe side wireless communication unit 24, but an ultrasound image U can also be generated in the ultrasound probe 2.

[0129] Fig. 13 shows the configuration of an ultrasound system 1F according to embodiment 6 of the present invention. The ultrasound system 1F is the same as the ultrasound system 1E according to embodiment 5 shown in Fig. 11 except that an ultrasound probe 2F is provided instead of the ultrasound probe 2E, a portable information terminal 3F is provided instead of the portable information terminal 3E, and an external device 4F is provided instead of the external device 4E. The ultrasound probe 2F is connected only to the portable information terminal 3F by wireless communication, and the external device 4F is connected only to the portable information terminal 3F by wireless communication.

[0130] The ultrasonic probe 2F is obtained by adding an image processing unit 91 to the ultrasonic probe 2E in the fifth embodiment, providing a probe control unit 26E instead of the probe control unit 26, and providing a probe-side processor 27E instead of the probe-side processor 27. In the ultrasonic probe 2F, the image processing unit 91 is connected to the signal processing unit 23, and the probe-side wireless communication unit 24 and the probe control unit 26F are connected to the image processing unit 91. Although not shown, the signal processing unit 23 and the image processing unit 91 configure an ultrasonic image generating unit.

[0131] The mobile information terminal 3F is a terminal in which the image processing unit 32 is removed from the mobile information terminal 3E in the fifth embodiment, the terminal control unit 37E is replaced with a terminal control unit 37F, and the terminal processor 39E is replaced with a terminal processor 39F. In the mobile information terminal 3F, an image synchronization unit 34 is connected to the terminal wireless communication unit 31. Also, the camera unit 33 is connected to the image synchronization unit 34.

[0132] The external device 4F is configured such that an external control unit 46F is provided instead of the external control unit 46E of the external device 4E in the fifth embodiment, and an external device-side processor 48F is provided instead of the external device-side processor 48E.

[0133] The image processing unit 91 of the ultrasonic probe 2F raster-converts the signal that has been subjected to the envelope detection processing by the signal processing unit 23 into an image signal conforming to the scanning method of a normal television signal, and performs various necessary image processing such as brightness correction, gradation correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction on the converted image signal to generate an ultrasonic image U conforming to the display format for the terminal monitor 36 of the mobile information terminal 3F and an ultrasonic image U conforming to the format for the external monitor 45 of the external device 4F. In addition, the image processing unit 91 transmits these generated ultrasonic images U to the probe-side wireless communication unit 24.

[0134] The terminal side wireless communication unit 31 receives the ultrasound image U wirelessly transmitted from the ultrasound probe 2F, and sends the received ultrasound image U to the image synchronization unit . The camera unit 33 acquires a field of view image C obtained by imaging a location on the subject scanned by the ultrasonic probe 2F, and sends the acquired field of view image C to an image synchronization unit .

[0135] The image synchronization unit 34 synchronizes the ultrasound image U sent from the terminal side wireless communication unit 31 with the field of view image C sent from the camera unit 33. Specifically, the image synchronization unit 34 synchronizes the ultrasound image U and the field of view image C that conform to the format for the terminal monitor 36 of the mobile information terminal 3F with each other, and further synchronizes the ultrasound image U and the field of view image C that conform to the format for the external monitor 45 of the external device 4F with each other.

[0136] The image synchronization unit 34 sends the ultrasound image U and the field of view image C to the display control unit 35, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to a format for the terminal monitor 36 that are synchronized with each other. The display control unit 35 performs a predetermined process on the ultrasound image U and the field of view image C sent from the image synchronization unit 34, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the terminal monitor 36.

[0137] In addition, the image synchronization unit 34 sends the ultrasound image U and the field of view image C to the terminal side wireless communication unit 31, respectively, without generating a single composite image M based on the ultrasound image U and the field of view image C that conform to a format for the external monitor 45 that are synchronized with each other. The terminal side wireless communication unit 31 wirelessly transmits the ultrasound image U and the visual field image C sent from the image synchronization unit 34 to the external device 4F.

[0138] The external wireless communication unit 41 of the external device 4F receives the ultrasound image U and the field of view image C wirelessly transmitted from the mobile information terminal 3F, and sends the received ultrasound image U and field of view image C to the display control unit 44, respectively. The display control unit 44 performs predetermined processing on the ultrasound image U and the field of view image C sent from the external wireless communication unit 41, and displays the ultrasound image U and the field of view image C, which are synchronized with each other, together on the external monitor 45.

[0139] At this time, the display control unit 44 can adjust the arrangement and size of the ultrasound image U and the field of view image C displayed on the external monitor 45 according to an input operation by the observer via the input device 47. As a result, for example, as shown in FIG. 12, the ultrasound image U and the field of view image C that are synchronized with each other are displayed together on the external monitor 45.

[0140] As described above, according to the ultrasound system 1F of embodiment 6 of the present invention, even if the ultrasound probe 2F is equipped with an image processing unit 91, the position and size of the ultrasound image U and field of view image C displayed on the external monitor 45 of the external device 4F can be adjusted, so that an observer observing the ultrasound image U and field of view image C displayed on the external monitor 45 can view the ultrasound image U and field of view image C more clearly according to his or her preferences. [Explanation of symbols]

[0141] 1, 1B, 1C, 1D, 1E, 1F Ultrasound system, 2, 2B, 2C, 2D, 2E, 2F Ultrasound probe, 3, 3A, 3B, 3C, 3D, 3E, 3F Portable information terminal, 4, 4A, 4B, 4C, 4D, 4E, 4F External device, 21 Transducer array, 22 Transmitter / receiver circuit, 23 Signal processing unit, 24 Probe side wireless communication unit, 26, 26B, 26D, 26F Probe control unit, 27, 27B, 27D, 27F Probe side processor, 31 Terminal side wireless communication unit, 32, 42, 71, 81, 91 Image processing unit, 33 Camera unit, 34, 43 Image synchronization unit, 35, 44 Display control unit, 36 Terminal monitor, 37, 37A, 37B, 37C, 37D, 37E, 37F Terminal control unit, 38, 47 Input device, 39, 39A, 39B, 39C, 39D, 39E, 39F Terminal side processor, 41 External wireless communication unit, 45 External monitor, 46, 46A, 46B, 46C, 46D, 4E6, 46F External control unit, 48, 48A, 48B, 48C, 48D, 48E, 48F External device side processor, 51 Pulser, 52 Amplification unit, 53 AD conversion unit, 54 Beamformer, 61, 63 Microphone, 62, 64 Speaker, A Cursor, C Field of view image, U Ultrasound image.

Claims

1. An ultrasound system including an ultrasound probe, a portable information terminal, and an external device, The ultrasonic probe includes: A transducer array; a transmission / reception circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array; an ultrasonic image generating unit that generates an ultrasonic image based on the sound ray signal generated by the transmission and reception circuit; a probe-side wireless communication unit that wirelessly transmits the ultrasound image only to the portable information terminal; Including, The portable information terminal includes: a camera unit for acquiring a visual field image obtained by imaging a portion of a subject to be scanned by the ultrasonic probe; a first input device to which first information is input by an operator of the portable information terminal; a terminal-side wireless communication unit that performs bidirectional wireless communication with the external device and wirelessly transmits to the external device the field-of-view image acquired by the camera unit, the ultrasound image received from the ultrasound probe, and the first information input to the first input device; Including, The external device is An external monitor and a second input device to which second information is input by an observer of the external monitor; a display control unit that displays the ultrasound image and the field of view image together on the external monitor; an external wireless communication unit that performs bidirectional wireless communication with the portable information terminal and wirelessly transmits the second information input to the second input device to the portable information terminal; Including, An ultrasound system in which the ultrasound probe and the portable information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device.

2. the portable information terminal includes a terminal monitor; The ultrasound system of claim 1 , wherein the ultrasound image and the field of view image are displayed on the terminal monitor.

3. The ultrasound system of claim 2 , wherein the portable information terminal includes an image synchronization unit that synchronizes the ultrasound image and the field of view image with each other.

4. the external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit; 4. The ultrasound system of claim 2, wherein the second information is displayed on the terminal monitor.

5. 5. The ultrasound system according to claim 1, wherein the portable information terminal is mountable on a head of an operator who operates the ultrasound probe and the portable information terminal.

6. A method for controlling an ultrasound system including an ultrasound probe, a portable information terminal, and an external device, comprising: In the ultrasonic probe, Transmitting ultrasonic waves from a transducer array of the ultrasonic probe and generating a sound ray signal based on a reception signal acquired by the transducer array; generating an ultrasound image based on the generated sound ray signals; wirelessly transmitting the ultrasound image to the portable information terminal; In the portable information terminal, acquiring a visual field image of a portion of a subject scanned by the ultrasonic probe; accepting an input of first information by an operator of the portable information terminal; wirelessly transmitting the acquired field of view image, the ultrasound image wirelessly transmitted from the ultrasound probe, and the first information whose input has been accepted to the external device; In the external device, Displaying the ultrasound image and the field of view image together on an external monitor; accepting input of second information by an observer of the external monitor; The ultrasonic probe and the portable information terminal are controlled based on the first information input by the operator and the second information input by the observer. A method for controlling an ultrasound system.

7. An ultrasound system including an ultrasound probe, a portable information terminal, and an external device, The ultrasonic probe includes: A transducer array; a transmission / reception circuit that transmits ultrasonic waves from the transducer array and generates a sound ray signal based on a reception signal acquired by the transducer array; a reception data generating unit that generates reception data before imaging by performing signal processing on the sound ray signal generated by the transmission and reception circuit; a probe-side wireless communication unit that wirelessly transmits the received data only to the portable information terminal; Including, The portable information terminal includes: a camera unit for acquiring a visual field image obtained by imaging a portion of a subject to be scanned by the ultrasonic probe; a first input device to which first information is input by an operator of the portable information terminal; a terminal-side wireless communication unit that performs bidirectional wireless communication with the external device and wirelessly transmits at least the field-of-view image acquired by the camera unit and the first information input to the first input device to the external device; Including, The external device is An external monitor and a second input device to which second information is input by an observer of the external monitor; a display control unit that displays an ultrasound image generated based on the received data and the field of view image together on the external monitor; an external wireless communication unit that performs bidirectional wireless communication with the portable information terminal and wirelessly transmits the second information input to the second input device to the portable information terminal; Including, An ultrasound system in which the ultrasound probe and the portable information terminal are controlled based on the first information input by the operator via the first input device and the second information input by the observer via the second input device.

8. The ultrasound system according to claim 7 , wherein the external device includes an image processing unit that generates an ultrasound image based on the reception data wirelessly transmitted from the probe side wireless communication unit.

9. the probe wireless communication unit wirelessly transmits the received data to the portable information terminal; the portable information terminal includes an image processing unit that generates an ultrasound image based on the reception data wirelessly transmitted from the probe side wireless communication unit; The ultrasound system according to claim 7 , wherein the terminal side wireless communication unit wirelessly transmits the ultrasound image generated by the image processing unit and the field of view image acquired by the camera unit to the external device.

10. the portable information terminal includes a terminal monitor; The ultrasound system of claim 9 , wherein the ultrasound image and the field of view image are displayed on the terminal monitor.

11. The ultrasound system of claim 10 , wherein the personal digital assistant includes an image synchronization unit that synchronizes the ultrasound image and the field of view image with each other.

12. the external wireless communication unit wirelessly transmits the second information input via the second input device to the terminal-side wireless communication unit; The ultrasound system of claim 10 or 11, wherein the second information is displayed on the terminal monitor.

13. 13. The ultrasound system according to claim 7, wherein the portable information terminal is mountable on a head of an operator who operates the ultrasound probe and the portable information terminal.

14. A method for controlling an ultrasound system including an ultrasound probe, a portable information terminal, and an external device, comprising: In the ultrasonic probe, Transmitting ultrasonic waves from a transducer array of the ultrasonic probe and generating a sound ray signal based on a reception signal acquired by the transducer array; generating reception data before imaging by performing signal processing on the generated sound ray signal; wirelessly transmitting the received data to the portable information terminal; In the portable information terminal, acquiring a visual field image of a portion of a subject scanned by the ultrasonic probe; accepting an input of first information by an operator of the portable information terminal; wirelessly transmitting at least the acquired visual field image and the first information whose input has been accepted to the external device; In the external device, Displaying the ultrasound image generated based on the received data and the field of view image together on an external monitor; accepting input of second information by an observer of the external monitor; The ultrasonic probe and the portable information terminal are controlled based on the first information input by the operator and the second information input by the observer. A method for controlling an ultrasound system.

Images