Ultrasonic diagnostic image display device, ultrasonic image diagnostic system, and program

Abstract

To provide an ultrasonic diagnostic image display apparatus, ultrasonic image diagnostic system and program which can improve the convenience and operability of an operator and secure the safety of a technique without increasing the work load of the operator in the time of use including blood vessel puncture.SOLUTION: An ultrasonic diagnostic image processing probe apparatus 10 is wirelessly communication-connected with a display apparatus 20, and a voice input function is mounted on the display apparatus 20. The display apparatus 20 specifies a unit operation command included in a voice command input from a user, constructs one control command by combining the specified unit operation commands, and controls the operation of at least one of the own machine and the ultrasonic diagnostic image processing probe apparatus 10.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic imaging system or the like used in the fields of medical care and the like.

Background Art

[0002] Conventionally, in the fields of medical care and the like, ultrasonic diagnostic imaging devices have been widely used for diagnosing the states of various subjects including the human body. This type of ultrasonic diagnostic imaging device generally includes an ultrasonic probe device and a main body device. The ultrasonic probe device transmits sound waves (also referred to as "ultrasonic waves") in a predetermined frequency band to a subject and receives the sound waves (i.e., echoes) reflected by the subject. The main body device generates ultrasonic diagnostic image data composed of a plurality of ultrasonic diagnostic image frames (e.g., B-mode images, etc.) obtained by imaging the subject based on a reception signal generated based on the echoes received by the ultrasonic probe device, and has a configuration for displaying an ultrasonic diagnostic image based on the generated data.

[0003] This type of ultrasonic diagnostic imaging system is very expensive and not highly portable, so the available locations are limited to examination rooms in medical institutions, etc., and it is difficult to use in individual hospital rooms or in scenarios such as home healthcare. For this reason, in recent years, an ultrasonic diagnostic imaging device with improved portability has been put into practical use by adopting a configuration in which a tablet-type main body device and an ultrasonic probe device are wired-connected by a cable. Also, recently, in order to ensure safety during blood vessel puncture, it has become common to perform puncture under echo guidance using this type of ultrasonic diagnostic imaging device, enabling safe blood vessel puncture regardless of the location of use.

[0004] On the other hand, when using an ultrasonic diagnostic imaging device for medical procedures such as blood vessel puncture, from the perspective of preventing infection accidents, it is a common usage form to wrap the ultrasonic probe device with a vinyl sheet or the like so that blood does not adhere. When adopting a configuration in which the ultrasonic probe and the main body device are wired-connected, it becomes necessary to disinfect the cable and the main body device every time a puncture is performed, increasing the workload of the operator.

[0005] Therefore, recently, a function for generating ultrasonic diagnostic image data is integrated into a portable ultrasonic probe device, and the ultrasonic diagnostic image data generated by the ultrasonic probe device alone is wirelessly transmitted to a general image display device such as a smartphone, a tablet-type information and communication terminal device, or a PC (personal computer) (hereinafter also referred to as a "display device" or an "ultrasonic diagnostic image display device"), and an ultrasonic diagnostic image is displayed on the display device, so that an ultrasonic image diagnostic system that can perform ultrasonic image diagnosis at low cost without being limited by the usage location has been put into practical use (for example, Non-Patent Document 2). An ultrasonic probe device incorporating such an ultrasonic diagnostic image data generation function (hereinafter referred to as an "ultrasonic diagnostic image processing probe device" in order to distinguish it from a general ultrasonic probe device) generates ultrasonic diagnostic image data by itself based on the reception result of echoes received from a subject, and wirelessly transmits the generated ultrasonic diagnostic image data to a display device. On the other hand, the display device has a configuration for displaying an ultrasonic diagnostic image based on the ultrasonic diagnostic image data received from the ultrasonic diagnostic image processing probe device. When such a configuration is adopted, since the ultrasonic diagnostic image processing probe device and the display device are wirelessly connected, during a medical procedure, only the ultrasonic diagnostic image processing probe device is wrapped with a plastic sheet to prevent contamination on the display device side, and the burden of disinfection work can be reduced.

[0006] However, usually, when performing vascular puncture, in some cases, some input operations have to be performed on the display device to adjust parameters such as the brightness level and display depth of the image according to the site where the blood vessel to be punctured is located. And when touching the display device during the procedure for operation, it is necessary to disinfect the display device side in the same way as a wired connection type ultrasonic diagnostic apparatus, and the disinfection work during puncture becomes complicated.

[0007] As a method for eliminating this kind of complication, for example, a method of mounting a voice input function like the ultrasonic diagnostic apparatus disclosed in Patent Document 1 and making it operable by voice can be considered.

Prior Art Documents

Patent Document

[0008]

Patent Document 1

Non-Patent Document

[0009]

Non-Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0010] However, assuming a case where an operator performs voice input to a display device constituting an ultrasonic image diagnostic system during the execution of various procedures including vascular puncture, in the case of recording an ultrasonic diagnostic image during imaging, at the start of recording, "recordstart", at the stop of recording, "recordstop", etc., two or more unit operation commands indicating different contents each (that is, a first unit operation command defining a recording operation indicated by the word "record" and a second unit operation command defining the start or stop of an operation indicated by the word "start or stop"), and a command such as "recordstart" or "recordstop" including these is defined in advance as one voice command, and it is necessary to correctly utter (input) the voice command. In this case, since the command length (that is, the number of characters) of one voice command that the operator should utter becomes long, the possibility of misrecognition during voice recognition increases. And when voice recognition fails, it becomes necessary to repeat the same voice command again, and it is difficult to improve the operability. In particular, during a procedure such as vascular puncture, the operator needs to concentrate on the puncture procedure while checking the display image, so it is very important to improve the operability while preventing misrecognition for ensuring the safety of the procedure.

[0011] The present invention has been made in view of the circumstances described above, and an object thereof is to provide an ultrasonic diagnostic image display device, an ultrasonic image diagnostic system, and a program that can improve the convenience and operability of an operator and ensure the safety of a procedure without increasing the work burden of the operator when using a device including vascular puncture.

Means for Solving the Problems

[0012] (1) To solve the above problems, an ultrasonic diagnostic image display device according to the present invention wirelessly acquires ultrasonic diagnostic image data composed of a plurality of ultrasonic diagnostic image frames obtained by transmitting sound waves in a predetermined frequency band to a subject and receiving echoes of the sound waves in the subject to image the subject, and is an ultrasonic diagnostic image display device that displays an ultrasonic diagnostic image of the subject, and includes a generating means for collecting a voice command spoken by an operator and generating a character string corresponding to the voice command; a specifying means for specifying, based on the generated character string, a unit operation command included in the voice command, the unit operation command including: (1) a first unit operation command that at least defines a type of operation in at least one of the own device and the ultrasonic diagnostic image processing probe device and is first spoken by the operator; and (2) a second unit operation command that is spoken after the first unit operation command and that (2a) defines start or stop of the operation, (2b) defines an increase or decrease direction of a parameter value to be changed along with the operation, (2c) defines an amount of change of the parameter value, or (2d) defines an observation target site; a first storage means for storing the specified first unit operation command; a constructing means for constructing a first control command that, by combining at least the stored first unit operation command and the specified second unit operation command, (A) defines start or stop of an operation of the type specified by the voice command, (B) defines the operation type specified by the voice command and the increase or decrease direction of the parameter value associated with the operation, (C) defines the operation type specified by the voice command, the increase or decrease direction of the parameter value, and the amount of change of the parameter value, or (D) defines setting the value of the parameter to a value suitable for observing a target site designated by the operator; a control means for controlling the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device based on at least the constructed first control command; an acquisition means for wirelessly acquiring the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled in accordance with at least the first control command; and a display means for displaying an ultrasonic diagnostic image of the subject based on the acquired ultrasonic diagnostic image data.

[0013] With this configuration, the ultrasonic diagnostic image display device of the present invention can wirelessly acquire ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device alone and display the ultrasonic diagnostic image of the subject. Therefore, when using the device including vascular puncture, only the ultrasonic diagnostic image processing probe device is wrapped with a plastic sheet or the like to prevent the display device side from being contaminated, simplify the disinfection work, and take reliable infection prevention measures. In addition, the display device can be realized by installing a dedicated application program in a general information communication terminal device such as a smartphone, a tablet-type information communication terminal device, or a PC (personal computer), so that ultrasonic image diagnosis can be performed at low cost.

[0014] In addition, the ultrasonic diagnostic image display device of the present invention converts the voice command spoken by the operator into a character string by voice recognition processing, and at least defines the type of operation in at least one of the own device and the ultrasonic diagnostic image processing probe device among the unit operation commands included in the voice command from the character string, and identifies and stores the first unit operation command (for example, if the input voice command is "recordstart", then "record") first spoken by the operator as the first unit operation command. By combining the stored first unit operation command and the second unit operation command (for example, if the spoken voice command is "recordstart", then "start") spoken after the first unit operation command, one first control command (in this example, "recordstart") corresponding to the voice command actually spoken by the operator (in this case, "recordstart") is constructed, and the operation of the own device or the ultrasonic diagnostic image processing probe device can be controlled based on the first control command.

[0015] With this configuration, the ultrasonic diagnostic imaging system of the present invention can control various operations by combining a plurality of short unit operation commands. As a result, there is no need to perform speech recognition based on a voice command with a long command length, and the accuracy of speech recognition can be improved, thereby improving the operability.

[0016] (2) Further, in the above configuration, when the constructed first control command defines the type of the operation and the increase / decrease direction of the parameter value associated with the operation, the control means changes the parameter value defined by the first control command from a first set value set at the timing of the start of the operator's speech by a predetermined fixed change amount in the increase / decrease direction defined by the first control command to change it to a second set value, and controls at least one of the operation of the own machine and the ultrasonic diagnostic image processing probe device. It may be configured as follows.

[0017] Generally, parameters such as image brightness level and display depth need to be adjusted by the operator touching the display device during the observation of the target site. If the operator touches the display device during a procedure including vascular puncture, the disinfection work becomes complicated. On the other hand, according to this configuration, a first unit operation command (for example, "gain" or "depth" described later) that defines the type of operation (for example, a parameter adjustment operation such as brightness level or display depth) included in the voice from the operator's speech, and a second unit operation command that defines the increase / decrease direction of the parameter (for example, "up or down" described later) are included. The first and second unit operation commands are specified from a voice command such as "gainup", and while constructing one first control command (for example, "gainup" etc.) corresponding to the speech by combining these, control can be performed to change the set value of the corresponding parameter by a predetermined fixed change amount (for example, change the brightness level by "±5", etc.). As a result, according to the present invention, it is possible to prevent the operator from touching the display device during the procedure and contaminating the display device, and to prevent an increase in the disinfection work burden. In addition, since each unit operation command can be defined by a short character string, it is possible to prevent the occurrence of misrecognition during speech recognition and improve the operability.

[0018] (3) Further, in the configuration according to claim 2, (a) the constructed first control command defines the type of the operation and the increasing or decreasing direction of the parameter value associated with the operation, and (b) according to the first control command, after the control means changes the parameter value from the first set value to the second set value, when the operator further utters a second voice command defining the increasing or decreasing direction of the parameter value within a predetermined period, the specifying means specifies the increasing or decreasing direction of the parameter value defined by the uttered second voice command based on the character string generated from the uttered second voice command, and the constructing means combines the first unit operation command stored in the first storage means with the specified increasing or decreasing direction to newly construct a second control command defining the type of the operation and the increasing or decreasing direction of the parameter value, and the control means changes the parameter value from the second set value by the predetermined change amount in the increasing or decreasing direction defined by the second control command to change it to a third set value, thereby controlling the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device, and the acquiring means may be configured to wirelessly acquire the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled according to the first and second control commands.

[0019] With this configuration, the ultrasonic diagnostic image display device of the present invention can, for example, after inputting a voice command such as "gainup or gaindown" that defines the adjustment of the luminance level once, execute control to further change a parameter such as the luminance level by a predetermined change amount only by inputting a second voice command that defines the increasing or decreasing direction such as "up or down", and can improve the operability without increasing the occurrence rate of misrecognition.

[0020] (4) Also, in the configuration according to claim 3, when the second voice command is repeatedly uttered, the specifying means specifies the increasing or decreasing direction of the parameter value based on the second voice command each time the second voice command is uttered, and the constructing means, each time the second voice command is uttered, constructs the second control command corresponding to the second voice command based on the first unit operation command stored in the first storage means and the increasing or decreasing direction specified by the corresponding second voice command, and the control means controls the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device by changing the value of the corresponding parameter by the predetermined change amount each time the second control command is constructed.

[0021] With this configuration, the ultrasonic diagnostic image display device of the present invention can gradually change the corresponding parameter value by a predetermined change amount each time a second voice command that only specifies the increasing or decreasing direction of the parameter is repeatedly uttered after uttering a first unit operation command that combines a first unit operation command that defines an adjustment operation such as a luminance level or a display depth and a second unit operation command that defines the increasing or decreasing direction of the parameter once. As a result, according to the present invention, parameter adjustment can be executed by uttering only very short words, so that the operability can be significantly improved. Note that, after the first voice command is uttered, there may be a case where the operator continuously repeats the second voice command, and there may also be a case where the operator remains silent for a while after the first voice command is uttered. In this case, in the former case, the display luminance level or the like may be continuously changed as it is, but when the latter case occurs, it is desirable to cancel and reset the previous control command once when the silent period (i.e., the period of no sound) continues for a predetermined time (for example, 10 seconds).

[0022] (5) Further, in the configuration according to any one of claims 2 to 4, when the voice command indicates a setting change of the predetermined change amount, the constructing means constructs one of the first control commands that defines the setting change of the predetermined change amount, and the control means controls the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device based on the first control command, and based on the first control command, changes the predetermined change amount. It may be configured as follows.

[0023] With this configuration, the ultrasonic diagnostic image display device of the present invention can freely set and change the predetermined change amount during control based on the first and second control commands, and can improve convenience.

[0024] (6) Further, in the configuration according to claim 1, the first unit operation command is defined as one unit operation command that combines two words, one indicating the type of operation in at least one of the own device and the ultrasonic diagnostic image processing probe device and the other indicating the increase / decrease direction of the parameter value changed along with the operation, and the second unit operation command is When defining the change amount of the parameter value with respect to the increase / decrease direction defined by the first unit operation command, the constructing means combines the first unit operation command stored in the first storage means and the specified second unit operation command, and (1) the type of operation, (2) the increase / decrease direction of the parameter value, and (3) the change amount of the parameter value. The first control command is constructed, and the control means changes the parameter value defined by the first control command by the change amount defined by the first control command in the increase / decrease direction defined by the first control command from the set value set at the timing of the operator's speech start. It may be configured to control the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device.

[0025] With this configuration, the ultrasonic diagnostic image display device of the present invention uses a voice command that combines a first unit operation command that defines the operation type and the increase / decrease direction of a parameter in two words, and a second unit operation command that defines the change amount of the parameter. By doing so, the set value of the parameter can be adjusted by a desired amount with a single voice command input, and the operability can be improved.

[0026] (7) Further, in the configuration according to claim 1, the voice command includes a first unit operation command that defines the type of operation in at least one of the own device and the ultrasonic diagnostic image processing probe device, and the second unit operation command that defines the observation target site in the subject. The specifying means specifies the first unit operation command based on the character string and stores it in the first storage means, and while specifying the target site defined by the second unit operation command, specifies the set value of the parameter suitable for observing the target site. The constructing means constructs the first control command that defines setting the value of the parameter to a value suitable for observing the target site designated by the operator based on the first unit operation command stored in the first storage means and the set value of the specified parameter. The control means may be configured to control the operation of the own device and at least one of the operations of the ultrasonic diagnostic image processing probe device based on the constructed first control command.

[0027] Normally, when observing a part of an organ in the human body (for example, various organs existing in the abdomen or chest, or blood vessels such as the brachial artery or carotid artery that are targets of blood vessel puncture) as the observation target site, the depth (distance) from the body surface, etc. are different for each observation target site, and the shape and composition are also different. Therefore, the transmittance and reflectance of sound waves are also different. For this reason, parameter values such as the luminance level, dynamic range, and display depth suitable for observation change according to the observation target site. Therefore, when actually observing an organ using an ultrasonic image diagnostic system, it is necessary to appropriately set the values of these parameters according to the observation target site. Performing this type of parameter setting according to the target site each time observing various organs increases the workload of the operator.

[0028] On the other hand, according to the above configuration, for example, parameter values suitable for observation are preset for each target site, and (1) a first unit operation command (e.g., "preset", etc.) that defines the operation type indicating the initial setting operation of these parameter values, and (2) when a voice command combining a second unit operation command that defines the observation target site (e.g., carotid artery, ulnar artery, etc.) is spoken by the operator, various parameter values can be automatically set to values suitable for observing the target site defined by the second unit operation command (hereinafter, also referred to as "preset values"), and the convenience of the operator can be significantly improved. Regarding the type of parameters to be preset, it is arbitrary. For example, various parameters such as luminance level, dynamic range, display depth, etc. can be the targets of preset, and in addition, parameters such as TGC (Time Gain Control), transmission frequency, convergence position of the sound wave beam, etc. can also be the targets of preset.

[0029] (8) Further, in the configuration according to claim 1, the voice command is indicated by a word spoken after the second unit operation command, includes a third unit operation command that defines the change amount of the corresponding parameter value, and when the second unit operation command defines the increase or decrease direction of the parameter value, the specifying means specifies the first, second, and third unit operation commands included in the voice command based on the character string, and the constructing means combines the first unit operation command stored in the first storage means with the specified second and third unit operation commands to construct the first control command that defines (1) the type of the operation, (2) the increase or decrease direction of the parameter value, and (3) the change amount of the parameter value, and the control means changes the parameter value defined by the first control command by the change amount defined by the first control command in the increase or decrease direction defined by the first control command from the set value set at the timing of the operator's speech start, so as to control the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device.

[0030] With this configuration, the ultrasonic diagnostic image display device of the present invention constructs a first control command that defines an operation type, an increase / decrease direction of a parameter value associated with the operation, and a change amount from a voice command spoken by an operator, and can control the operation of the own device or the ultrasonic diagnostic image processing probe device according to the first control command. Therefore, the set value of the parameter can be adjusted by a desired amount with a single command input, and the operability can be improved.

[0031] (9) Further, in the configuration according to claim 1, the ultrasonic diagnostic image display device further includes second storage means for storing at least a part of the acquired ultrasonic diagnostic image data, and when the voice command includes (a1) a first unit operation command for defining a recording operation of the ultrasonic diagnostic image and (a2) the second unit operation command for defining the start or stop of the recording operation, the constructing means constructs the first control command for defining the start or stop of the storage of the ultrasonic diagnostic image data, and the control means controls the storage of the ultrasonic diagnostic image data in the second storage means based on the constructed first control command. This configuration may be adopted.

[0032] With this configuration, when the operator speaks a voice command such as "recordstart", the ultrasonic diagnostic image display device of the present invention starts recording and storing the ultrasonic diagnostic image data acquired from the ultrasonic diagnostic image processing probe device, and stops the recording and storing of the ultrasonic diagnostic image data when the operator speaks a voice command such as "recordstop", so that at least a part of the ultrasonic diagnostic image data can be recorded and stored (saved) and later viewed.

[0033] (10) Further, the ultrasonic image diagnostic system of the present invention includes an ultrasonic diagnostic image processing probe device that transmits sound waves in a predetermined frequency band to a subject and generates ultrasonic diagnostic image data composed of a plurality of ultrasonic diagnostic image frames obtained by receiving echoes of the sound waves in the subject, and an ultrasonic diagnostic image display device that wirelessly acquires the ultrasonic diagnostic image data from the ultrasonic diagnostic image data and displays an ultrasonic diagnostic image of the subject. The ultrasonic diagnostic image display device includes a generating means for collecting a voice command spoken by an operator and generating a character string corresponding to the voice command, a specifying means for specifying, based on the generated character string, a unit operation command included in the voice command, which (1) at least defines the type of operation in at least one of the own device and the ultrasonic diagnostic image processing probe device and is the first unit operation command first spoken by the operator, and (2) is spoken after the first unit operation command and (2a) defines the start or stop of the operation, (2b) defines the increase or decrease direction of a parameter value to be changed along with the operation, (2c) defines the change amount of the parameter value, or (2d) defines an observation target site as the second unit operation command, a first storage means for storing the specified first unit operation command, and a constructing means for constructing one of the first control commands that (A) defines the start or stop of the operation of the type specified by the voice command, (B) defines the operation type specified by the voice command and the increase or decrease direction of the parameter value associated with the operation, (C) defines the operation type specified by the voice command, the increase or decrease direction of the parameter value, and the change amount of the parameter value, or (D) defines setting the value of the parameter to a value suitable for observing the target site designated by the operator by combining at least the stored first unit operation command and the specified second unit operation command, a control means for controlling the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device based on at least the constructed first control command, and an acquisition means for wirelessly acquiring the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled according to at least the first control command.display means for displaying an ultrasonic diagnostic image of the subject based on the acquired ultrasonic diagnostic image data;

[0034] (11) Further, in the configuration according to claim 10, it may include a plurality of the ultrasonic diagnostic image processing probe devices and one of the display devices, and the voice command includes a fourth unit operation command that defines at least the ultrasonic diagnostic image processing probe device to be the transmission target of the first control command. The specifying means specifies the ultrasonic diagnostic image processing probe device defined by the fourth unit operation command based on the character string, and the control means transmits at least the first control command to the specified ultrasonic diagnostic image processing probe device to control the operation of the ultrasonic diagnostic image processing probe device.

[0035] With this configuration, even when the ultrasonic image diagnostic system of the present invention operates a plurality of ultrasonic diagnostic image processing probe devices with one display device, the operation of the ultrasonic diagnostic image processing probe device to be controlled can be surely controlled by specifying it by voice.

[0036] (12) Further, the program of the present invention wirelessly acquires ultrasonic diagnostic image data composed of a plurality of ultrasonic diagnostic image frames obtained by transmitting sound waves in a predetermined frequency band to a subject and receiving echoes of the sound waves in the subject, and functions as an ultrasonic diagnostic image display device that displays an ultrasonic diagnostic image of the subject. A computer collects voice commands spoken by an operator and generates a character string corresponding to the voice commands. Based on the generated character string, a unit operation command included in the voice command is identified, which includes: (1) a first unit operation command that at least defines the type of operation in at least one of the own device and the ultrasonic diagnostic image processing probe device and is first spoken by the operator; and (2) a second unit operation command that is spoken after the first unit operation command and that: (2a) defines the start or stop of the operation; (2b) defines the increase or decrease direction of a parameter value to be changed along with the operation; (2c) defines the change amount of the parameter value; or (2d) defines an observation target site. A specifying means specifies the first unit operation command. A storage control means stores the specified first unit operation command in a storage means. By combining at least the stored first unit operation command and the specified second unit operation command, a first control command is constructed that: (A) defines the start or stop of the operation of the type specified by the voice command; (B) defines the type of operation specified by the voice command and the increase or decrease direction of the parameter value associated with the operation; (C) defines the type of operation specified by the voice command, the increase or decrease direction of the parameter value, and the change amount of the parameter value; or (D) defines setting the value of the parameter to a value suitable for observing the target site designated by the operator. A control means controls the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device based on at least the constructed first control command. An acquisition means wirelessly acquires the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled according to at least the first control command. A display control means causes a display means to display an ultrasonic diagnostic image of the subject based on the acquired ultrasonic diagnostic image data.It has a configuration that functions as...

Advantages of the Invention

[0037] The ultrasonic diagnostic image display device, ultrasonic image diagnostic system, and program of the present invention can improve the convenience and operability of the operator and ensure the safety of the procedure without increasing the workload of the operator during the use of the device including vascular puncture.

Brief Description of the Drawings

[0038]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Modes for Carrying Out the Invention

[0039] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following embodiments transmit sound waves (ultrasound) in a predetermined frequency band to a part of the human body as a subject, receive the echoes of the sound waves in the subject, and generate and display ultrasonic diagnostic image data composed of a plurality of image frames (for example, B-mode images, etc.) obtained by photographing the subject. This is an embodiment when the ultrasonic diagnostic image display device, the ultrasonic image diagnostic system, and the program according to the present invention are applied to an ultrasonic image diagnostic system. However, the embodiments described below do not unduly limit the content of the present invention described in the claims, and not all of the configurations described in this embodiment are essential constituent elements of the present invention.

[0040] [1] Configuration and Outline of Ultrasonic Image Diagnostic System 1 First, with reference to FIG. 1, the configuration and outline of the ultrasonic image diagnostic system 1 in an embodiment of the present invention will be described. Note that FIG. 1 is a system configuration diagram showing an example of the configuration of the ultrasonic image diagnostic system 1 of this embodiment. Also, in FIG. 1, only a part of the ultrasonic diagnostic image processing probe device 10 is shown to prevent the drawing from becoming complicated. Furthermore, the number of ultrasonic diagnostic image processing probe devices 10 constituting the ultrasonic image diagnostic system 1 is arbitrary, and it may be one or a plurality. However, in this embodiment, for ease of understanding of the description, the ultrasonic image diagnostic system 1 is described as being composed of one ultrasonic diagnostic image processing probe device 10 and one display device 20. The case where the ultrasonic image diagnostic system 1 is composed of a plurality of ultrasonic diagnostic image processing probe devices 10 and one display device 20 will be described in the section on modified examples.

[0041] As shown in FIG. 1, the ultrasonic diagnostic imaging system 1 of the present embodiment has a configuration that can be carried by an operator, and transmits sound waves having a predetermined frequency band (for example, any frequency band from 2 MHz to 22 MHz), while receiving echoes of the sound waves in a subject, and generates (i.e., captures) ultrasonic diagnostic image data of the subject based on the received echoes. Ultrasonic diagnostic imaging probe devices 10-1 to n (hereinafter, when it is not particularly necessary to specify each device, referred to as "ultrasonic diagnostic imaging probe device 10"). And (2) a display device 20 wirelessly communicatively connected to the ultrasonic diagnostic imaging probe device 10. The ultrasonic diagnostic imaging probe device 10 wirelessly transmits the ultrasonic diagnostic image data generated thereby to the display device 20, and the display device 20 displays an ultrasonic diagnostic image (moving image) of the subject. Note that the frequency band of the sound waves transmitted by the ultrasonic diagnostic imaging probe device 10, the device shape, and the scanning mode of the sound waves are arbitrary. For example, (1) in addition to the sector type and convex type using sound waves of 2 to 7.5 MHz, (2) the linear type using sound waves of 2 to 12 MHz, (3) the single type using sound waves of 2 to 22 MHz, etc. A plurality of ultrasonic diagnostic imaging probe devices 10 with the frequency band, shape, and scanning mode changed according to the observation target site (for example, organs such as the heart and lungs in the chest, the stomach, liver, kidneys, etc. in the abdomen, and organs including blood vessels such as the ulnar artery) may be used and operated on one display device 20. It is also possible to use a transducer array 11, an ultrasonic driving unit 12, and a signal processing unit 141 (see FIG. 3) capable of transmitting and receiving sound waves of a wideband frequency (for example, sound waves in a frequency band of about 2 to 25 MHz), attach and detach an attachment according to the inspection site, and change the device shape and the frequency band of the sound waves to be used.

[0042] Here, when performing procedures such as vascular puncture using the ultrasonic diagnostic system 1 as described above, generally from the perspective of infection prevention, although the ultrasonic diagnostic image processing probe device 10 is wrapped with a vinyl sheet or the like to take contamination prevention measures, when the operator adjusts parameters such as the luminance level and display depth while checking the displayed image during the implementation of various procedures, there is a need to perform some input operation on the display device 20. And if the operator touches the display device 20, it becomes necessary to disinfect the display device 20 side and the work becomes complicated. Therefore, in the ultrasonic diagnostic system 1 of the present embodiment, a method is adopted to prevent the operator from touching the display device 20 and contaminating the display device 20 during the procedure by equipping the display device 20 with a voice input function. However, even when the voice input function is equipped, misrecognition may occur as described above, and the operability may be impaired.

[0043] For example, when trying to adjust parameters such as the luminance level and display depth using the voice input function, it is necessary to adopt the following adjustment method. First, "gainup" or "gaindown" etc., which are combinations of words such as "gain" that define the adjustment operation of the luminance level and words such as "up or down" that define the increase or decrease direction of the luminance level, are defined in advance as one voice command. And when these are input (spoken), a default value of the luminance level change amount to be changed is predetermined as "±5" etc., and by repeatedly speaking "gainup" or "gaindown", control is performed to gradually change the luminance level by "±5" each time until the desired luminance level is adjusted. The voice commands such as "gainup" and "gaindown" used in this adjustment method have a long command length (that is, the length of the character string) defined as one voice command, so misrecognition is likely to occur during voice recognition. And when misrecognition occurs, it becomes necessary to input the same voice command again, and the operability may be impaired.

[0044] Regarding the adjustment of the display depth as well, first, a unit operation command composed of words such as "depth" that define the adjustment operation of the display depth and words such as "up or down" that define the increase or decrease direction of the display depth is combined, and "depthup" or "depthdown" etc. is defined as one voice command. And when these are input, a default value of the display depth change amount to be changed is preset as "±1 cm" etc., and the same command is repeatedly input, and the display depth is gradually changed by "±1 cm" each time until the desired display depth is adjusted. Also in this case, voice commands such as "depthup" and "depthdown" to be used have a long command length (that is, the length of the character string) defined as one voice command, so misrecognition is likely to occur during voice recognition. And when misrecognition occurs, there is a need to input the same voice command again, and the operability may be impaired. In particular, during procedures such as vascular puncture, the operator needs to concentrate on the puncture procedure while checking the display image, so preventing misrecognition and ensuring high operability are important for ensuring the safety of the procedure.

[0045] [2] Regarding the principle of the voice input function installed in the ultrasonic diagnostic system 1 of this embodiment For the above reasons, in the display device 20 of this embodiment, a method of preventing the occurrence of misrecognition and improving the operability is adopted by generally adopting the following method.

[0046] (A) First, in order to reduce the occurrence rate of misrecognition, it is indicated by the first word (i.e., short character string) that the operator first utters during the input operation. A voice command is used, which combines: (1) a first unit operation command that at least defines the type of operation to be executed in at least one of the own device and the ultrasonic diagnostic image processing probe device 10 (for example, control of electronic scanning by sound waves on a subject, recording and storing, pausing, still image saving, parameter adjustment such as brightness level, display depth, etc., and preset operations of various parameters, etc.); and (2) indicated by one word uttered after the word corresponding to the first unit operation command, which (2a) defines the start or stop of the operation, (2b) defines the increase or decrease direction of the parameter value to be changed along with the operation, (2c) defines the change amount of the parameter value, or (2d) defines the observation target site, i.e., a second unit operation command.

[0047] (B) Further, the display device 20 is equipped with a voice recognition function for converting the voice command input by the operator into a character string, and is also equipped with a database (hereinafter referred to as "DB") or conversion table for identifying the first and second unit operation commands included in the voice command based on the character string.

[0048] (C) Then, when the operator inputs a voice command including the first and second unit operation commands, the display device 20 executes a control command construction process for constructing a control command corresponding to the voice command.

[0049] (D) In this control command construction process, the display device 20 first converts the input voice command into a character string by means of the voice recognition function, and while doing so, identifies the first and second unit operation commands included in the voice command spoken by the operator from the character string and the data already stored in the DB or the like, and temporarily stores the first unit operation command in the RAM 264 (see FIG. 4) described later. For example, when the operator speaks a voice command "gainup" to increase the brightness level, the display device 20 identifies that the first unit operation command is "gain" which defines "brightness level adjustment" from the first word spoken in the voice command, and also identifies that the second unit operation command is "up" which defines an increase in the brightness level based on the word spoken after "gain", and temporarily stores the first unit operation command "gain" in the RAM 264 described later.

[0050] (E) Next, the display device 20 combines the first unit operation command (for example, "gain") temporarily stored in the RAM 264 and the identified second unit operation command (for example, "up") to construct one first control command (for example, "gainup", etc.) corresponding to the voice command actually spoken by the operator. Similarly, when the operator speaks a voice command "gaindown", the display device 20 constructs a first control command "gaindown" by the above control command construction process.

[0051] The display device 20 controls the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device 10 based on the first control command constructed by the control command construction process. At this time, when the constructed first control command defines an increase or decrease in the luminance level or an increase or decrease in the display depth, the display device 20 basically changes the luminance level or the display depth by a predetermined change amount in the same manner as the above adjustment method. For example, in the case of luminance level adjustment, the luminance level is increased or decreased by "±5", and in the case of display depth adjustment, the display depth is increased or decreased by "±1 cm" to change the parameter value. Note that the specific processing method for the display device 20 to identify each unit operation command from the character string generated by the voice recognition process is arbitrary. Based on the character string generated by the voice recognition process, the data stored in a database or the like may be compared and collated one by one to identify the first and second unit operation commands included in the character string. Alternatively, the generated character string may be subjected to processing such as morphological analysis to divide the character string into word units, and the divided words may be compared and collated with the data stored in a database or the like to identify the first and second unit operation commands included in the character string. In addition, in this case, the processing such as voice recognition and morphological analysis executed by the display device 20 is the same as the conventional processing such as voice recognition and morphological analysis, so the details are omitted. Furthermore, within a range where misrecognition is unlikely to occur, the first unit operation command can be defined by two words, for example, "gainup", etc. However, in the present embodiment, for the purpose of preventing misrecognition as much as possible, the description will be made assuming a configuration in which the first and second unit operation commands are defined by one word. The case where the first unit operation command is defined by two words will be described in detail in the section of the modified example.

[0052] However, even when the occurrence of misrecognition is prevented by the above method, for example, when trying to change the luminance level by "±15" or the display depth by "±3 cm", the operator needs to repeatedly utter long voice commands such as "gainup", "gaindown", "depthup", "depthdown" three times, making it difficult to improve the operability during voice input.

[0053] Therefore, in the ultrasonic image diagnostic system 1 of the present embodiment, the following method is adopted. (Step 1) First, when the operator utters a voice command that defines parameter adjustment, such as "gainup", "gaindown", "depthup", "depthdown", etc., the display device 20 temporarily stores the first unit operation command (that is, "gain" or "depth") included in the voice command in the RAM 264, and constructs a corresponding first control command (if the input voice command is "gainup", then "gainup") based on the voice command. Then, based on the first control command, control is performed to change the parameter value by a predetermined change amount (for example, the luminance level is "±5") from the first set value set at the speech timing of the voice command to change it to the second set value.

[0054] (Step 2) When the operator utters a second voice command consisting only of a unit operation command such as "up" or "down" that defines the increase / decrease direction of the parameter in a state where a first unit operation command that defines parameter adjustment, such as "gain" or "depth", is stored in the RAM 264 (i.e., when the second voice command is input), a second control command is constructed by combining the unit operation command that constitutes the second voice command and the first unit operation command already stored in the RAM 264. Based on the second control command, the value of the corresponding parameter is increased or decreased by a predetermined change amount in the increase / decrease direction specified by the second voice command, and control is performed to change the set value of the corresponding parameter from the second set value to the third set value. For example, when the luminance level set value (i.e., the first set value) at the time of the first voice command utterance is "10", if the operator utters a voice command "gain up", and based on the voice command, the luminance level is increased by "5" once to change the luminance level to "15" (i.e., the second set value), and then the operator inputs a second voice command such as "up" or "down", the display device 20 combines the first unit operation command "gain" stored in the RAM 264 and the unit operation command that constitutes the second voice command to construct a second control command such as "gain up" or "gain down", and based on the second control command, performs control to further change the luminance level by a predetermined change amount. For example, after changing the luminance level from "10" to "15" at the time of the first voice command input, if the operator inputs a command "up" as the second voice command, the display device 20 constructs a second control command "gain up" and increases the luminance level from "15" (the second set value) to "20" (the third set value), while if the operator inputs a second voice command "down", the display device 20 constructs a second control command "gain down" and decreases the luminance level from "15" to "5" and returns it to "10" (the third set value). In the following, a voice command including a first unit operation command that defines the operation type is referred to as a first voice command, and is distinguished from a second voice command consisting only of a unit operation command that defines the increase / decrease direction of the parameter.

[0055] Similarly, regarding the adjustment of the display depth, when the operator inputs a first voice command "depthup" or "depthdown", a first unit operation command "depth" that defines the adjustment of the display depth and a second unit operation command "up or down" that defines the increase or decrease direction of the parameter are specified, and the first unit operation command "depth" is temporarily stored in the RAM 264.

[0056] Then, the display device 20 constructs a first control command "depthup" or "depthdown" by combining the "depth" stored in the RAM 264 and the second unit operation command "up or down", changes the display depth from the set value (first set value) at the first voice command utterance timing by "±1 cm" once to change it to the second set value, and when a second voice command consisting only of the unit operation command "up or down" is subsequently input, the display device 20 combines the first unit operation command "depth" stored in the RAM 264 and the unit operation command (up or down) constituting the second voice command to construct a second control command "depthup" or "depthdown", and based on the second control command, executes control to change the value of the display depth from the value at the time of the second voice command utterance (i.e., the second set value) by "±1 cm" further to change it to the third set value. The same applies when the operator inputs a first voice command "gaindown" or "depthdown" for the first time. When a second voice command consisting of the unit operation command "up or down" is subsequently input, the first unit operation command stored in the RAM 264 at the time of the first voice command input and the unit operation command constituting the second voice command are combined to construct a second control command "gainup", "gaindown", "depthup", "depthdown". And control is performed to further change the corresponding parameter from the set value (i.e., the second set value) at the time of the second voice command input to the third set value. After that, when the operator repeatedly utters a second voice command consisting of the unit operation command "up or down" in a state where the first unit operation command is stored in the RAM 264, each time a second control command is constructed, control is performed to change the parameter set value such as the luminance level by the default change amount each time, and gradually adjust it to the parameter value intended by the operator.

[0057] Incidentally, it is assumed that after the operator utters a voice command such as "gainup" once, there may be a case where the silent state continues for a certain period or more without uttering the second voice command. In this case, when the silent state continues for a predetermined period (for example, 10 seconds) after the input of the first voice command, the first unit operation command once stored in the RAM 264 is cleared (erased) as a timeout. Even if a voice command such as "up or down" is input later, it is desirable to adopt a configuration in which the parameter is not continuously changed. Further, an operation end voice command (for example, "OK" or the like) for defining the operation end in advance is defined, and when the operation end voice command is input, the first unit operation command stored in the RAM 264 is cleared. Even if a voice command such as "up or down" is input later, a configuration in which the parameter value is not changed may be adopted.

[0058] With the above configuration, the ultrasonic image diagnostic system 1 of the present embodiment enables the operator to gradually change parameter values such as the luminance level and the display depth by repeating the utterance of a second voice command consisting of a short unit operation command such as "up or down" without repeating the same first voice command even if the operator utters a first voice command including a unit operation command for instructing the adjustment of the parameter value, such as "gainup", "gaindown", "depthup", or "depthdown", once. Thus, it is possible to realize control for gradually changing the parameter values and significantly improve the operability during voice input.

[0059] In addition, the ultrasonic image diagnostic system 1 of the present embodiment can wirelessly transmit the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device 10 alone to the display device 20 and display the ultrasonic diagnostic image of the subject on the display device 20. Therefore, when using a device including vascular puncture, by wrapping only the ultrasonic diagnostic image processing probe device 10 with a vinyl sheet or the like, contamination on the display device 20 side can be prevented, and a reliable infection prevention measure can be realized while simplifying the disinfection work.

[0060] Furthermore, the ultrasonic diagnostic imaging system 1 of the present embodiment can execute a process defined by a long voice command such as "gainup" while identifying first and second unit operation commands (such as "gain", "depth", "up or down", etc.) included in the uttered voice command from the words (i.e., short character strings) included in the character string corresponding to the uttered voice command of the operator generated by the voice recognition process. Therefore, it is possible to improve the operability while reducing the occurrence rate of misrecognition.

[0061] As a result, the ultrasonic diagnostic imaging system 1 of the present embodiment can achieve both prevention of misrecognition and improvement of operability without increasing the workload of the operator during use including vascular puncture, improve the convenience of the operator, and ensure the safety of the procedure. Note that the commands used as the first and second unit operation commands are not limited to those used for adjusting the luminance level and display depth, and can also be used for other operation types. However, examples of the unit operation commands used in the ultrasonic diagnostic imaging system 1 of the present embodiment will be described below.

[0062] [3] Unit operation commands used in the ultrasonic diagnostic imaging system 1 Next, with reference to FIG. 2, the unit operation commands used in the ultrasonic diagnostic imaging system 1 of the present embodiment will be described. Note that FIG. 2 is a list showing an example of the unit operation commands used in the ultrasonic diagnostic imaging system 1 of the present embodiment and the correspondence relationship between the control contents defined by the unit operation commands.

[0063] As shown in FIG. 2, in the ultrasonic diagnostic system 1 of the present embodiment, (A) as the first unit operation command, (A1) "scan" that defines the control of electronic scanning by sound waves, (A2) "record" that defines the control of recording and playback of ultrasonic diagnostic image data, (A3) "gain" that defines the adjustment control of the luminance level, (A4) "depth" that defines the adjustment control of the display depth, (A5) "preset" that defines the operation of presetting various parameters to appropriate values according to the observation target site, (A6) "freeze" that defines the operation of temporarily stopping the electronic scanning of sound waves at the voice command input timing and temporarily stopping the display update operation of the ultrasonic diagnostic image data on the display device 20 to display the ultrasonic diagnostic image frame being displayed at that speech timing as a still image, and (A7) "shutter" that defines the control of the operation of temporarily stopping the electronic scanning at the voice command input timing, temporarily stopping the image update process on the display device 20, displaying the ultrasonic diagnostic image frame being displayed at that timing as a still image, and saving the data of the corresponding ultrasonic diagnostic image frame (that is, the operation of saving the ultrasonic diagnostic image frame after the still image display) are used. In addition, (B) as the second unit operation command, (B1) "start" that defines the start of the operation defined by the first unit operation command, (B2) "stop" that defines the stop of the operation, (B3) "up" that defines that the increase / decrease direction of the parameter value is the increasing direction, (B4) "down" that defines that the increase / decrease direction of the parameter value is the decreasing direction are used. Further, (B5) a site name that defines the site to be preset (for example, a configuration that uses "RA = Radial Artery" indicating the radial artery, "CA = Carotid Artery" indicating the carotid artery, etc. as the second unit operation command) is adopted.

[0064] In addition, in the list shown in FIG. 2, the control content defined by the first voice command combining the first and second unit operation commands in the table is shown in the rightmost column. For example, the "scanstart" or "scanstop" first voice command combining the first unit operation command "scan" and the second unit operation command "start or stop" defines the control of "starting or stopping the electronic scanning of sound waves and the updated display of images". Similarly, for other voice commands, the control content executed when the first voice command combining the first and second unit operation commands in the table is uttered is shown in the rightmost column. Note that each unit operation command shown in FIG. 2 is an example, and other unit operation commands may be used. Also, the specific content of the parameters adjusted in the preset operation is arbitrary, and various parameter values can be adjusted according to the observation target site. However, in this embodiment, for the sake of concretizing the explanation, control is performed to set parameters such as (a) luminance level, (b) dynamic range, and (c) display depth to preset values suitable for observing the target site.

[0065] [4] Schematic Configuration of Ultrasonic Image Diagnosis System 1 The ultrasonic diagnostic image processing probe device 10 of this embodiment is a portable ultrasonic diagnostic image processing probe device 10 driven by a built-in battery (not shown), transmits ultrasonic waves to a subject, and generates ultrasonic diagnostic image data composed of a plurality of ultrasonic diagnostic image frames based on the echoes from the subject and transmits it to the display device 20.

[0066] In particular, the ultrasonic diagnostic image processing probe device 10 of this embodiment controls the transmission of sound waves to the subject according to the first and second control commands wirelessly transmitted from the display device 20 when a voice command is input by the operator. Specifically, the ultrasonic diagnostic image processing probe device 10 controls the input of a drive signal to the vibrator array 11 (see FIG. 3) described later according to the first and second control commands, and controls the start, stop, and temporary stop of the electronic scanning by sound waves.

[0067] In addition, the ultrasonic diagnostic image processing probe device 10 of the present embodiment has a function of controlling the generation of ultrasonic diagnostic image data based on echoes in accordance with the first and second control commands received from the display device 20. Here, the reception timing of echoes when sound waves are transmitted from the ultrasonic diagnostic image processing probe device 10 to the subject depends on the distance from the body surface. Echoes from shallow tissues close to the body surface are received at an earlier timing after the transmission of the sound waves, while echoes from deep tissues far from the body surface are received at a later timing. For this reason, the ultrasonic diagnostic image processing probe device 10 of the present embodiment adjusts the echo reception waiting period in the ultrasonic reception unit 13 and the signal processing unit 141 (see FIG. 3) described later in accordance with the first and second control commands, and generates ultrasonic diagnostic image data, thereby realizing a function of adjusting the display depth. In addition, the adjustment of the luminance level in the ultrasonic image diagnostic system 1 is realized by adjusting the amplification factor of the electrical signal (hereinafter referred to as the "output signal") output from the oscillator array 11 based on the echoes received by the ultrasonic diagnostic image processing probe device 10 in the ultrasonic reception unit 13 and the signal processing unit 141 (see FIG. 3) described later. Therefore, by adjusting the amplification factor of the output signal in accordance with the first and second control commands by such a function, the adjustment of the luminance level is realized. Note that the amplification factor control of the output signal may be set finely on a scanning line-by-line basis, or the amplification factor may be uniformly controlled for the entire output signal.

[0068] Then, the ultrasonic diagnostic image processing probe device 10 of the present embodiment controls (1) the transmission of sound waves and (2) image generation based on echoes in accordance with the first and second control commands received from the display device 20, and sequentially wirelessly transmits ultrasonic diagnostic image data obtained by imaging the subject with parameters such as the luminance level and the display depth adjusted to the intended values of the operator to the display device 20 for display on the display device 20.

[0069] With this configuration, the ultrasonic image diagnostic system 1 of the present embodiment displays, on the display device 20, an ultrasonic diagnostic image of a subject taken in a state adjusted to the intended brightness level and display depth while reflecting the operation contents defined by the first and second voice commands. While the operator confirms the displayed ultrasonic diagnostic image, by uttering the second voice command, the operator can further change the brightness level and display depth of the ultrasonic diagnostic image currently displayed on the display device 20, and can observe the target site while adjusting the brightness level and display depth to optimal values for observing the target site. Regarding the specific data configuration and transmission method of the ultrasonic diagnostic image data generated in the ultrasonic diagnostic image processing probe device 10, it is arbitrary. For example, while continuously performing ultrasonic electronic scanning from the reception timing of the control command for starting electronic scanning (i.e., "scanstart") to the reception timing of the control command for stopping electronic scanning (i.e., "scanstop"), a plurality of ultrasonic diagnostic image frames are taken, compressed by an inter-frame predictive coding method such as MPEG2 (Moving Picture Expert Group) 2, H.264, or H.265 to generate moving image format data, and the generated moving image data is sequentially transmitted to the display device 20. Alternatively, based on the received signal corresponding to the echo, ultrasonic diagnostic images corresponding to each frame are sequentially taken, and a configuration in which the ultrasonic diagnostic image data corresponding to the images is sequentially transmitted to the display device 20 may be adopted. Also, in this case, when the operator utters the "freeze" or "shutter" command as a voice command, it is desirable to configure to temporarily stop the transmission of sound waves to the subject. With this configuration, the power consumption of the ultrasonic diagnostic image processing probe device 10 during the operation of "freeze" or "shutter" can be reduced, and the diagnosable time by battery drive can be extended. Note that, regarding the operation when executing the corresponding control based on the first voice command indicated by a single word such as "freeze" and "shutter", since it is basically the same as that of a conventional ultrasonic image diagnostic device having a voice input function, the details are omitted.

[0070] The display device 20 is an information communication terminal device such as a general tablet-type information communication terminal device, a smartphone, a laptop-type or desktop-type PC, etc. For example, an iPad (registered trademark) or an iPad mini (registered trademark) can be used.

[0071] In addition, the display device 20 has a wireless communication function for performing wireless communication with the ultrasonic diagnostic image processing probe device 10 according to the same communication protocol as the wireless transmission and reception unit 15 mounted on the ultrasonic diagnostic image processing probe device 10. Regarding the wireless communication method used for communication between the display device 20 and the ultrasonic diagnostic image processing probe device 10, it is arbitrary. In addition to the communication method according to the so-called wireless LAN (Local Area Network) protocol defined by IEEE (Institute of Electrical and Electronics Engineers) 802.11a, b, g, n, ac, ax, communication methods according to various communication protocols such as the communication protocol of Bluetooth (registered trademark) defined by IEEE802.15.1 can be adopted. In the present embodiment, the display device 20 controls the operation of the ultrasonic diagnostic image processing probe device 10 by wirelessly transmitting the first and second control commands to the ultrasonic diagnostic image processing probe device 10 by this function, and realizes the function of acquiring and displaying ultrasonic diagnostic image data from the ultrasonic diagnostic image processing probe device 10.

[0072] Furthermore, as a characteristic feature of the present embodiment, the display device 20 of the present embodiment wirelessly acquires ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device 10, and based on the data, an application program (hereinafter referred to as the "display app") for displaying an ultrasonic diagnostic image of a subject is installed. Based on this display app, display processing of the ultrasonic diagnostic image data is executed, and based on the first and second voice commands included in the voice collected by the microphone 250 (see FIG. 4), the first and second control commands are constructed by the above method, and a function for controlling the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device 10 (that is, a voice input function) is realized. At this time, when the constructed first and second control commands define the operation of the ultrasonic diagnostic image processing probe device 10, the display device 20 wirelessly transmits the first and second control commands to the ultrasonic diagnostic image processing probe device 10 to control the operation of the ultrasonic diagnostic image processing probe device 10.

[0073] In particular, when the first unit operation command included in the first voice command defines an adjustment of the luminance level or the display depth, the display device 20 transmits the first control command constructed from the first voice command input by the operator to the ultrasonic diagnostic image processing probe device 10, and performs control to change the value of the corresponding parameter by a predetermined change amount in the increasing or decreasing direction specified by the first control command. For example, assuming a case where the first voice command (that is, "gainup" or the like) for increasing the luminance level is uttered in a state where the luminance level set at the input timing of the first voice command is "10" (first set value), the display device 20 constructs the first control command "gainup" corresponding to the first voice command, and transmits the first control command to the ultrasonic diagnostic image processing probe device 10 to increase the luminance level by a predetermined change amount (for example, "5") and change it to "15" (second set value).

[0074] As a result, in the ultrasonic diagnostic image processing probe device 10, generation of ultrasonic diagnostic image data continues with the luminance level changed to "15" and is sequentially transmitted to the display device 20. The display device 20 acquires and displays the ultrasonic diagnostic image data generated in the state where the parameters are adjusted in this way (that is, the state where the luminance level is "15"). Further, when the operator inputs a second voice command to change the luminance level or display depth of the image during display of the ultrasonic diagnostic image taken in the state where the parameter value is changed (in this case, the state where "the luminance level is '15'"), (a) the unit operation command constituting the second voice command (that is, "up or down"), and (b) the first unit operation command "gain" already stored in the RAM 264 at the time of input of the first voice command (in this example, the first input "gainup" command), a second control command is constructed and transmitted to the ultrasonic diagnostic image processing probe device 10, and the values of the luminance level and display depth set at the speech timing are further changed according to the second control command to change to a third set value. The display device 20 acquires and displays the ultrasonic diagnostic image data generated in the state where the luminance level and display depth are further changed in this way (that is, the state set to the third set value). When continuing to adjust the same parameter, by repeatedly uttering the second voice command consisting of the unit operation command "up or down" as described above, the second control command is repeatedly constructed, and by executing the control based on the second control command, the set value of the parameter is gradually changed. Then, the process ends when a predetermined operation end condition is satisfied, such as when a silent state continues for a predetermined period.

[0075] [5] Configuration of the Ultrasonic Diagnostic Image Processing Probe Device 10 Next, the configuration of the ultrasonic diagnostic image processing probe device 10 of the present embodiment will be described with reference to FIG. 3. Note that FIG. 3 is a block diagram showing a configuration example of the ultrasonic diagnostic image processing probe device 10 of the present embodiment.

[0076] As shown in FIG. 3, the ultrasonic diagnostic image processing probe device 10 of the present embodiment includes a transducer array 11, an ultrasonic driving unit 12, an ultrasonic receiving unit 13, a control unit 14, a wireless transmission / reception unit 15, and a memory 16. Power required for driving is supplied to each unit from a built-in battery (not shown).

[0077] The transducer array 11 is installed at a position such as the tip of a housing (not shown), and includes a plurality of ultrasonic transducers 112 arranged along a transmission / reception surface 111. Each of the plurality of ultrasonic transducers 112 is constituted by an element such as a piezoelectric element, for example. When an electrical signal corresponding to a transmission signal supplied from a signal processing unit 141 (described later) of the control unit 14 is input from the ultrasonic driving unit 12, it vibrates based on the input electrical signal (also referred to as a “driving signal”), transmits a sound wave in a frequency band corresponding to the driving signal, and generates an electrical signal based on the vibration obtained when receiving an echo of the sound wave in a subject, and outputs it as an output signal to the ultrasonic receiving unit 13. The plurality of ultrasonic transducers 112 may be arranged in two orthogonal directions.

[0078] The ultrasonic driving unit 12 is constituted by a circuit such as an amplifier, and generates a driving signal while amplifying a transmission signal supplied from the signal processing unit 141 under the control of the control unit 14, and supplies it to the transducer array 11.

[0079] The ultrasonic receiving unit 13 has an amplifier for amplifying an output signal supplied from the transducer array 11, an A / D (analog / digital) converter, etc., converts the output signal supplied from the transducer array 11 into a digital signal, and supplies it to the control unit 14. The amplifier built in the ultrasonic receiving unit 13 can change the amplification factor under the control of the control unit 14. The control unit 14 realizes a function of changing the luminance level of an ultrasonic diagnostic image by changing the amplification factor of this amplifier based on the first and second control commands received from the display device 20.

[0080] The wireless transceiver unit 15 is, for example, a wireless communication module such as a wireless LAN or Bluetooth (registered trademark), and is composed of various circuits such as an antenna, an RF circuit, a baseband circuit, and a filter circuit (not shown). While interlocking with the control unit 14, it establishes a communication connection with the display device 20, transmits ultrasonic diagnostic image data to the display device 20, and receives the first and second control commands from the display device 20 and supplies them to the control unit 14. Note that the wireless transceiver unit 15 of the present embodiment is configured to be able to communicate according to the same communication protocol as the wireless communication function mounted on the display device 20.

[0081] The memory 16 is configured by combining a NAND-type or NOR-type flash memory, a ROM (read only memory), a RAM (Random Access Memory), etc., stores the program executed by the control unit 14, and when the first and second control commands that define parameter adjustments such as "gainup", "gaindown", "depthup", and "depthdown" are input, based on the first and second control commands, the control unit 14 controls each part and various control data for executing the operations defined by the control commands is stored. For example, this control data includes data indicating the luminance level and the default change amount at the time of display depth adjustment. When the control unit 14 receives the first and second control commands such as "gainup" transmitted from the display device 20 by the wireless transceiver unit 15, based on the control commands and the control data in the memory 16, it executes control to change the value of the corresponding parameter by the default change amount from the set value at the time of command reception. Note that the memory 16 is also used as a work area when generating ultrasonic diagnostic image data. Also, in the present embodiment, for the sake of concretizing the explanation, it is described that the default change amount is determined based on the control data in the memory 16. However, regarding the default change amount, it may be determined on the display device 20 side, and the first and second control commands including the determined default change amount are transmitted from the display device 20, and the parameters such as the luminance level are changed by the default change amount according to the first and second control commands on the ultrasonic diagnostic image processing probe device 10 side.

[0082] The control unit 14 is composed of, for example, an LSI (Large Scale Integration) for ultrasonic processing, an FPGA (Field Programmable Gate Array), a CPU (Central Processing Unit), etc. Then, the control unit 14 realizes (a) a signal processing unit 141, (b) an image processing unit 142, and (c) a wireless control unit 143 by executing processing based on a program stored in the memory 16 or by executing processing pre-programmed on the circuit.

[0083] (Signal processing unit 141) The signal processing unit 141 executes the following processes 1 to 5 according to the control command received from the display device 20.

[0084] <Process 1> The signal processing unit 141 executes a process of setting various parameters such as luminance level, dynamic range, display depth, etc. to preset values according to the observation target site (hereinafter referred to as "preset process"). In this case, the preset values of the respective parameters may be stored as a part of control data in the memory 16 in association with the observation target site name, and the preset values of the respective parameters may be determined based on the target site name specified by the control command received from the display device 20. However, in the present embodiment, for the sake of concretizing the explanation, while the display device 20 determines the preset values of the respective parameters according to the target site, a first control command including the determined preset values is transmitted to the ultrasonic diagnostic image processing probe device 10, and the signal processing unit 141 adjusts the respective parameters to the preset values specified by the first control command.

[0085] <Process 2> The signal processing unit 141 executes a process of controlling the start, stop, and pause of the electronic scanning of sound waves in accordance with the first control command. At this time, the signal processing unit 141 generates a transmission signal during the period from the reception timing of the "scanstart" command to the reception timing of the "scanstop" command, and supplies it to the ultrasonic driving unit 12 to cause the electronic scanning by sound waves to be performed during this period. By the function of such a signal processing unit 141, the control of the electronic scanning based on the first control command is realized.

[0086] <Process 3> The signal processing unit 141 supplies a control signal to the ultrasonic receiving unit 13 in accordance with the first and second control commands received from the display device 20, and performs control to change the amplification factor of the amplifier of the ultrasonic receiving unit 13 according to the set value of the luminance level. By the function of such a signal processing unit 141, the adjustment of the luminance level based on the first and second control commands is realized. At this time, the signal processing unit 141 determines the luminance level to be set based on the luminance level set value at the time of receiving the corresponding control command and the control data stored in the memory 16, and changes the setting of the luminance level to the determined value.

[0087] <Process 4> The signal processing unit 141, while interlocking with the ultrasonic receiving unit 13, determines the value of the display depth to be set in accordance with the first and second control commands and the control data in the memory 16, and executes a process of adjusting the echo reception waiting period so that ultrasonic diagnostic image data is generated at the determined display depth.

[0088] <Process 5> The signal processing unit 141 performs various signal processes such as filtering processing on the digital data corresponding to the output signal supplied from the ultrasonic receiving unit 13, and supplies it to the image processing unit 142.

[0089] (Image processing unit 142) Based on the data supplied by the signal processing unit 141, the image processing unit 142 generates ultrasonic diagnostic image data of the subject, temporarily stores it in the memory 16, and keeps it in a state where the wireless control unit 143 can transmit it to the display device 20.

[0090] (Wireless control unit 143) While interlocking with the wireless transceiver unit 15 and the image processing unit 142, the wireless control unit 143 controls to transmit the ultrasonic diagnostic image data temporarily stored in the memory 16 to the display device 20 via the wireless transceiver unit 15. Also, when the first and second control commands transmitted from the display device 20 are received by the wireless transceiver unit 15, the wireless control unit 143 temporarily stores the control commands in the memory 16 and keeps them in a state where the signal processing unit 141 can use them.

[0091] [6] Configuration of the display device 20 Next, the configuration of the display device 20 of the present embodiment will be described with reference to FIG. 4. Note that FIG. 4 is a block diagram showing a configuration example of the display device 20 of the present embodiment.

[0092] As shown in FIG. 4, the display device 20 of the present embodiment includes (1) a wireless communication unit 210, (2) a display control unit 220, (3) a display unit 230 composed of a liquid crystal display panel, an organic EL (Electro Luminescence) display panel, etc., (4) a timer 240 for specifying the current date and time, (5) a microphone 250 that collects the voice spoken by the operator and supplies digital voice data corresponding to the collected voice to each unit via the bus B, (6) a storage unit 260, (7) a device management control unit 270, (8) a data processing unit 280, and (9) an operation unit 290 composed of a touch panel provided on the display unit 230, various buttons, etc. Note that the above-mentioned each unit is interconnected by the bus B, and data transfer between each component is executed. Also, for example, the wireless communication unit 210 of the present embodiment constitutes the "acquisition means" in the "claims".

[0093] The wireless communication unit 210 is a network interface such as a wireless LAN, constructs a wireless transmission / reception channel with the wireless transmission / reception unit 15 of the ultrasonic diagnostic image processing probe device 10, and mediates the transfer of data between the ultrasonic diagnostic image processing probe device 10 and the bus B. Specifically, the wireless communication unit 210 receives the ultrasonic diagnostic image data transmitted from the ultrasonic diagnostic image processing probe device 10, supplies it to each unit via the bus B, and when the first and second control commands constructed by the data processing unit 280 are supplied via the bus B, transmits the control command to the ultrasonic diagnostic image processing probe device 10. Note that it is necessary for the wireless communication unit 210 to be able to communicate according to the same communication protocol as the wireless transmission / reception unit 15 of the ultrasonic diagnostic image processing probe device 10.

[0094] The display control unit 220 is composed of a drive circuit of the display panel constituting the display unit 230, etc. While interlocking with the device management control unit 270 and the data processing unit 280, it displays a GUI (Graphical User Interface) including a home screen on the display unit 230, and controls the display of the ultrasonic diagnostic image based on the ultrasonic diagnostic image data sequentially transmitted from the ultrasonic diagnostic image processing probe device 10 from the input timing of the first voice command "scanstart" to the input timing of "scanstop", and displays a moving image corresponding to the ultrasonic diagnostic image data. In addition, when the operator utters the "freeze" or "shutter" command, the display control unit 220 temporarily stops the display update of the image based on the ultrasonic diagnostic image data, and continues to display the ultrasonic diagnostic image frame displayed at the utterance timing as a still image. Note that, for example, the display control unit 220 of the present embodiment constitutes the "display means" and "display control means" in the "claims".

[0095] The storage unit 260 is configured by combining, for example, a NAND-type or NOR-type flash memory, an HDD (Hard Disk Drive), an SSD (solid state drive), etc., and a RAM 264 used as a work area. A program storage unit 261, a command conversion data storage unit 262, and an image data storage unit 263 are provided in the storage area thereof. Note that the storage unit 260 may use a built-in storage device, or may use an external type memory such as a microSD (registered trademark) or an external HDD. Further, for example, the RAM 264 of the present embodiment constitutes the "first storage means" in the "claims" in conjunction with the unit operation command specifying unit 282 described later.

[0096] In the program storage unit 261, in addition to programs for controlling each part of the display device 20, such as an OS (Operating System), a BIOS (Basic Input Output System), and a driver program, the above display application is stored. Further, in the program storage unit 261, for example, when a first voice command including "preset" as a first unit operation command is input, preset values of various parameters such as luminance level, dynamic range, and display depth are set to values suitable for observing the target part for each part, and these preset values are stored in association with the corresponding part name for each part. Note that the data defining these preset values may be configured to be stored as a part of a DB or the like in the command conversion data storage unit 262.

[0097] The command conversion data storage unit 262 stores dictionary data for speech recognition processing and data for identifying each unit operation command included in the first and second voice commands actually spoken by the operator from the character string generated by the speech recognition processing. The specific data configuration of the data stored in this command conversion data storage unit 262 is arbitrary. For example, a DB or conversion table storing data that defines the relationship between a character string (word) and a unit operation command as shown in FIG. 2 is stored in the command conversion data storage unit 262 in advance, and the unit operation command specifying unit 282 described later compares the character string generated from the first and second voice commands with the data stored in the DB or the like to identify the first and second unit operation commands included in the character string and the unit operation commands constituting the second voice command.

[0098] The image data storage unit 263 stores at least a part of the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device 10. The storage of the ultrasonic diagnostic image data in this image data storage unit 263 is controlled by the image storage control unit 284 described later in conjunction with the device management control unit 270, and the ultrasonic diagnostic image data captured between the input timing of the first voice command "recordstart" and the input timing of "recordstop" is recorded and stored in this image data storage unit 263. Also, data corresponding to the ultrasonic diagnostic image frame displayed at the input timing of the "shutter" command is stored as still image data in the image data storage unit 263, and the ultrasonic diagnostic image data recorded and stored later is held in a state where the operator can view it. Note that, for example, the image data storage unit 263 of the present embodiment constitutes the "second storage means" in the "claims".

[0099] The device management control unit 270 is mainly constituted by a CPU, and integrally controls each part of the display device 20 by executing programs such as an OS and a BIOS.

[0100] The data processing unit 280 is configured using the same CPU as the CPU that realizes the device management control unit 270, or is configured by a CPU independent of the device management control unit 270. Then, under the control of the device management control unit 270, the data processing unit 280 executes control command construction processing based on the display application stored in the program storage unit 151, thereby realizing (1) the voice recognition processing unit 281, (2) the unit operation command specifying unit 282, (3) the control command construction unit 283, (4) the image storage control unit 284, and (5) the control command transmission unit 285. When the device management control unit 270 and the data processing unit 280 are realized by a multi-core CPU, the functions of each unit may be allocated to each core.

[0101] (Voice recognition processing unit 281) The voice recognition processing unit 281 executes voice recognition processing based on the voice data supplied from the microphone 250 in conjunction with the microphone 250 and the device management control unit 270. At this time, the voice recognition processing unit 281 uses the dictionary data stored in the command conversion data storage unit 262 to generate a character string corresponding to the first and second voice commands, and supplies the text data corresponding to the generated character string to the unit operation command specifying unit 282. For example, the voice recognition processing unit 281 of the present embodiment constitutes the "generation means" in the "claims" in conjunction with the microphone 250.

[0102] (Unit operation command specifying unit 282) The unit operation command specifying unit 282 executes a process of specifying each unit operation command included in the character string based on the text data supplied from the speech recognition processing unit 281 and the data stored in the command conversion data storage unit 262, and supplies the specified unit operation command to the control command construction unit 283. At this time, the unit operation command specifying unit 282 temporarily stores the first unit operation command indicated by the word first spoken by the operator among the unit operation commands included in the specified first voice command in the RAM 264 and holds it in a state where it can be used later. Further, when a predetermined operation end condition is satisfied, such as when there is a predetermined silent period after the input of the first voice command and before the input of the second voice command, the unit operation command specifying unit 282 clears (erases) the first unit operation command stored in the RAM 264 and resets the operation once. Note that, for example, the unit operation command specifying unit 282 of the present embodiment constitutes the "specifying means" in the "claims".

[0103] (Control command construction unit 283) The control command construction unit 283 combines the first unit operation command stored in the RAM 264 and the second unit operation command specified by the unit operation command specifying unit 282 to construct one first control command corresponding to the first voice command spoken by the operator, and supplies it to the display control unit 220, the device management control unit 270, the image storage control unit 284, and the control command transmission unit 285. While interlocking with the device management control unit 270 and the like, it controls the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device 10. Further, when the operator inputs a second voice command composed of a unit operation command that defines the increase or decrease direction of a parameter of "up or down" in a state where a predetermined operation end condition is not satisfied, the control command construction unit 283 combines the unit operation command of "up or down" that constitutes the second voice command and the first unit operation command already stored in the RAM 264 to construct a second control command, and transmits it to the ultrasonic diagnostic image processing probe device 10 to execute control to change the luminance level or the display depth by a further predetermined change amount from the set value of the parameter set at the time of input of the second voice command. For example, the control command construction unit 283 of the present embodiment constitutes the "construction means" and the "storage control means" in the "claims" in conjunction with the program storage unit 261, the command conversion data storage unit 262, and the device management control unit 270, and constitutes the "control means" in conjunction with the signal processing unit 141, the wireless communication unit 210, the display control unit 220, the device management control unit 270, the image storage control unit 284, and the control command transmission unit 285 of the ultrasonic diagnostic image processing probe device 10.

[0104] Furthermore, when a first voice command (e.g., a voice command such as "presetRA") including a first unit operation command "preset" and a second unit operation command specifying an observation target site is input, and the first unit operation command "preset" and the second unit operation command "RA: radial artery" indicating the observation target site name are specified by the unit operation command specifying unit 282, the control command construction unit 283 constructs a first control command for setting various parameters such as luminance level, dynamic range, and display depth to preset values suitable for observing the target site, and supplies it to the control command transmission unit 285. At this time, the control command construction unit 283 specifies the preset values of the respective parameters based on the data regarding the preset values stored in the program storage unit 261 and the target site name defined by the second unit operation command, and constructs a first control command including the specified preset values.

[0105] (Image storage control unit 284) When the first control command constructed by the control command construction unit 283 is "recordstart", the image storage control unit 284 starts storing the ultrasonic diagnostic image data in the image data storage unit 263 from the input timing of the corresponding first voice command. Then, the image storage control unit 284 continues to store the ultrasonic diagnostic image data in the image data storage unit 263 until the first control command "recordstop" is supplied from the control command construction unit 283. As a result, in the display device 20, among the ultrasonic diagnostic image data generated in the ultrasonic diagnostic image processing probe device 10, the ultrasonic diagnostic image data consisting of a series of ultrasonic diagnostic image frames captured between the ultrasonic diagnostic image frame displayed on the display unit 230 at the input timing of the first voice command "recordstart" and the ultrasonic diagnostic image frame displayed on the display unit 230 at the input timing of the first voice command "recordstop" is stored (recorded) in the image data storage unit 263. Further, when the control command supplied from the control command construction unit 283 is "shutter", the image storage control unit 284 stores the ultrasonic diagnostic image data corresponding to the ultrasonic diagnostic image frame displayed on the display unit 230 at the input timing of the control command in the image data storage unit 263, thereby realizing the screen capture function. For example, the image storage control unit 284 of the present embodiment constitutes the "control means" in the "claims".

[0106] (Control command transmission unit 285) When the first and second control commands supplied from the control command construction unit 283 define the operations in the ultrasonic diagnostic image processing probe device 10, the control command transmission unit 285 transmits the control command to the ultrasonic diagnostic image processing probe device 10 via the wireless communication unit 210 to control the operations of the ultrasonic diagnostic image processing probe device 10.

[0107] [7] Operations of the ultrasonic image diagnostic system 1 Next, the operation of the ultrasonic diagnostic system 1 of the present embodiment will be described with reference to FIGS. 5 and 6. FIGS. 5 and 6 are flowcharts showing the processing executed by the data processing unit 280 of the display device 20 of the present embodiment in conjunction with the device management control unit 270 and the like. In the ultrasonic diagnostic system 1 of the present embodiment, when an ultrasonic diagnostic image of a subject is taken for a procedure and diagnosis including vascular puncture, first, as preprocessing, (1) a preset control process for changing the set values of various parameters to preset values suitable for observing the target site (for example, the radial artery targeted for vascular puncture, etc.) according to the target site is performed. After that, (2) while starting the electronic scanning of sound waves in the ultrasonic diagnostic image processing probe device 10, it is necessary to execute a scanning start control process in which the display device 20 acquires the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device 10 and starts the display process based on the ultrasonic diagnostic image data.

[0108] As a result of executing the preprocessing consisting of this preset control process and scanning start control process, ultrasonic diagnostic images taken with various parameters such as luminance level, dynamic range, and display depth set to preset values are sequentially displayed on the display unit 230 of the display device 20. Note that prior to the process shown in FIG. 5, the voice recognition processing unit 281 of the data processing unit 280 operates the microphone 250 in conjunction with the device management control unit 270 to collect ambient sound and starts accepting voice operations by the operator, and is assumed to have shifted to a state of waiting for the input (utterance) of the first or second voice command (step Sa1). Also, the specific instruction method for starting the voice input operation at this time is arbitrary. For example, a button for starting the voice input operation is provided on an operation unit (not shown) of the ultrasonic diagnostic image processing probe device 10, and when the button is operated, the signal processing unit 141 transmits an operation start command instructing the start of the voice input operation to the display device 20 and shifts to the voice command input waiting state (step Sa1). For example, a voice command for instructing the start of the voice input operation (hereinafter also referred to as the "start voice command"), such as "Hi, echo", is defined in advance, and the microphone 250 constantly collects sound, and when the start voice command is input, it may be configured to shift to the voice command input waiting state (step Sa1). Further, after the scanning start control, the operator holds the ultrasonic diagnostic image processing probe device 10 and manually scans the periphery of the target site with the ultrasonic diagnostic image processing probe device 10 to take an ultrasonic diagnostic image of the target site. This point is the same as that of a conventional ultrasonic image diagnostic system.

[0109] After this preprocessing, while checking the ultrasonic diagnostic image taken and displayed, the operator adjusts the brightness level and display depth, checks the ultrasonic diagnostic image taken with the parameter values after the adjustment, further adjusts the brightness level, etc., and (B) performs procedures such as diagnosis and vascular puncture based on the image at the timing when the optimal ultrasonic diagnostic image of the observation target site is displayed. Also, at this timing, the operator needs to temporarily stop the update of the image display (i.e., display a still image), or perform a screen capture (i.e., save the corresponding ultrasonic diagnostic image frame data), or perform the start and stop operations of the recording and storage of the ultrasonic diagnostic image data.

[0110] The following describes the specific processing content. First, after explaining the operation of the display device 20 in the preset control process and the scan start control process as preprocessing, the operation when adjusting the brightness level and display depth will be explained.

[0111] [7.1] Preprocessing [7.1.1] Preset control process First, with reference to FIG. 5, the preset control process executed in the ultrasonic image diagnostic system 1 of the present embodiment will be described. It is assumed that necessary data has already been stored in the memory 16 and the command conversion data storage unit 262 of the ultrasonic diagnostic image processing probe device 10 prior to this operation. Also, in the following, for the sake of concretizing the explanation, the case where the "radial artery" is the observation target will be described as an example.

[0112] In the preset control process, the operator first needs to utter a first voice command "presetRA" including a first unit operation command "preset" and a second unit operation command "RA" indicating the "radial artery" as the observation target site name.

[0113] When this first voice command is input (step Sa1), the voice recognition processing unit 281 executes voice recognition processing (step Sa2) and converts the first voice command spoken by the operator into the character string "presetRA" (step Sa2).

[0114] Next, based on the character string generated in step Sa2 and the data stored in the command conversion data storage unit 262, the unit operation command specifying unit 282 specifies that the first unit operation command included in the first voice command spoken by the operator is "preset" and the second unit operation command is "RA" that defines "radial artery" (step Sa3).

[0115] When the first and second unit operation commands included in the first voice command "presetRA" spoken by the operator are specified in this way, the unit operation command specifying unit 282 determines whether the input first voice command corresponds to a process that requires a second voice command (that is, a process that requires further parameter adjustment such as brightness level or display depth adjustment, etc.) (step Sa4). If it is determined as "Yes", the process proceeds to step Sa9, while if it is determined as "No", the process proceeds to step Sa5.

[0116] Here, since the preset control process is not a process that requires further parameter adjustment based on the second voice command, in step Sa4, the unit operation command specifying unit 282 determines "No" and temporarily stores the first unit operation command "preset" in the RAM 264 (step Sa5). In this way, when the first and second unit operation commands are specified and the first unit operation command is stored in the RAM 264, the control command construction unit 283 combines the first unit operation command (i.e., "preset") stored in the RAM 264 with the second unit operation command (i.e., "RA") specified in step Sa3 to construct the first control command (step Sa6). At this time, based on the observation target site name (RA = radial artery) defined by the second unit operation command and the data stored in the program storage unit 261, the control command construction unit 283 specifies preset values of various parameters such as the luminance level, dynamic range, and display depth suitable for observing the radial artery, and constructs a first control command including the specified preset values (step Sa6).

[0117] Next, while interlocking with the wireless communication unit 210, the device management control unit 270, and the control command transmission unit 285, the control command construction unit 283 transmits the constructed first control command to the ultrasonic diagnostic image processing probe device 10, thereby performing control to change each parameter set in the ultrasonic diagnostic image processing probe device 10 to the preset value defined by the control command (step Sa7). After clearing the RAM 264 (step Sa8), the preset control process ends.

[0118] On one hand, in the ultrasonic diagnostic image processing probe device 10, when the wireless transceiver unit 15 receives the first control command, the signal processing unit 141 executes the above preset processing, temporarily stores the preset value of the parameter included in the first control command in the memory 16, and maintains it in a state where it can be used for generating ultrasonic diagnostic image data. As a result, in the ultrasonic diagnostic image processing probe device 10, various parameters such as the luminance level, dynamic range, and display depth are set to the preset values, and the ultrasonic diagnostic image can be taken (i.e., preset).

[0119] [7.1.2] Scanning start control process After the completion of the above preset control process, the operator needs to perform the following steps to start the scanning start control process: After following the procedure for starting the voice operation again (for example, the procedure of uttering a predetermined start voice command), the operator utters the first voice command "scanstart" to start the scanning by sound waves and the image display based on the ultrasonic diagnostic image data, so as to start the shooting and display of the ultrasonic diagnostic image.

[0120] At this time, in the display device 20, a character string corresponding to the first voice command "scanstart" is generated (step Sa2), and the first unit operation command "scan" and the second unit operation command "start" are identified (step Sa3). Here, since the scanning start control process does not require control based on the second voice command later, in step Sa4, the unit operation command identification unit 282 determines "No" and temporarily stores the first unit operation command "scan" in the RAM 264 (step Sa5).

[0121] In this way, when the first unit operation command "scan" is stored in the RAM 264, the control command construction unit 283 combines the first unit operation command "scan" stored in the RAM 264 with the second unit operation command "start" identified in step Sa3 to construct the first control command "scanstart" (step Sa6).

[0122] Next, the control command construction unit 283, in conjunction with the wireless communication unit 210, the display control unit 220, the device management control unit 270, and the control command transmission unit 285, transmits the first control command to the ultrasonic diagnostic image processing probe device 10 to execute control to start an electronic scan by sound waves on the ultrasonic diagnostic image processing probe device 10, and when ultrasonic diagnostic image data is received by the wireless communication unit 210, it shifts to a state where display processing based on the data can be started.

[0123] On the other hand, in the ultrasonic diagnostic image processing probe device 10, upon receiving the "scanstart" command by the wireless transceiver 15, the signal processing unit 141 sets various parameters such as luminance level, dynamic range, and display depth based on the preset values temporarily stored in the memory 16, while executing the above processes 2 to 5, starts an electronic scan of sound waves on the subject, generates ultrasonic diagnostic image data of the subject with various parameters set to the preset values, and the wireless control unit 143 sequentially transmits the ultrasonic diagnostic image data to the display device 20.

[0124] When the ultrasonic diagnostic image data transmitted from the ultrasonic diagnostic image processing probe device 10 is received by the wireless communication unit 210 through the above processing, the control command construction unit 283, while operating in conjunction with the device management control unit 270 and the display control unit 220, executes display processing based on the ultrasonic diagnostic image data received from the ultrasonic diagnostic image processing probe device 10, and causes the corresponding ultrasonic diagnostic image to be displayed on the display unit 230.

[0125] As a result, an ultrasonic diagnostic image taken with various parameters such as luminance level, dynamic range, and display depth set to preset values is displayed on the display unit 230. While the operator checks the displayed ultrasonic diagnostic image, the operator further changes parameters such as the luminance level and display depth, and adjusts the luminance level and display depth to optimal values for observing the radial artery. Based on an image suitable for observation, the operator performs procedures such as blood vessel puncture or makes a diagnosis. In addition, the operator inputs a first voice command "freeze" at the display timing of an ultrasonic diagnostic image frame considered to be the best shot to temporarily stop the display update of the ultrasonic diagnostic image and display a still image, or inputs a first voice command "shutter" to store the data corresponding to the ultrasonic diagnostic image frame displayed at the input timing in the image data storage unit 263 to execute a screen capture. Further, the operator inputs first voice commands "recordstart" and "recordstop" to record and store a part of the ultrasonic diagnostic image data taken and generated with the parameter values optimized. Note that the operations when inputting the first voice command consisting only of unit operation commands defined by one word such as "freeze" and "shutter" are basically the same as those of a conventional ultrasonic image diagnostic apparatus with a voice input function, so the details are omitted.

[0126] [7.2] Operations during adjustment of luminance level and display depth during display of ultrasonic diagnostic image Next, with reference to FIGS. 5 and 6, the operations when adjusting the luminance level and display depth in the state where the ultrasonic diagnostic image is being displayed on the display device 20 will be described. In the following, for the sake of concretizing the explanation, the case of adjusting the luminance level will be described as an example.

[0127] First, when the above-described scanning start control process is completed, an ultrasonic diagnostic image taken with various parameters such as luminance level, dynamic range, and display depth set to preset values will be displayed on the display unit 230. However, in this state, there is a possibility that the luminance level is not optimized for observing the target site (for example, the radial artery). Therefore, the operator needs to adjust the luminance level while checking the displayed ultrasonic diagnostic image to adjust it to an optimal luminance level for observing the target site.

[0128] In this case, after the operator follows the procedure for starting the voice operation again (for example, the procedure such as uttering a predetermined start voice command), the operator needs to input a first voice command (for example, "gainup" or "gaindown") including a first unit operation command (that is, "gain") for defining the adjustment of the luminance level and a second unit operation command (that is, "up" or "down") for defining the increase or decrease direction of the parameter.

[0129] When the operator inputs a first voice command such as "gainup", the voice recognition processing unit 281 executes voice recognition processing to generate a character string (such as "gainup") corresponding to the first voice command (step Sa2).

[0130] Next, the unit operation command specifying unit 282 specifies that the first unit operation command included in the voice command uttered by the operator is "gain" and the second unit operation command is "up" based on the character string and the data stored in the command conversion data storage unit 262 (step Sa3).

[0131] In this example, since the first voice command stipulates that the luminance level is increased by a default change amount (for example, "5"), in step Sa4, the unit operation command specifying unit 282 determines "Yes" and transfers the process to step Sa9, and temporarily stores the first unit operation command "gain" specified in step Sa2 in the RAM 264.

[0132] Next, the control command construction unit 283 combines the first unit operation command "gain" stored in the RAM 264 with the second unit operation command "up" specified in step Sa2 to construct a first control command "gainup" (step Sa10), executes control based on the first control command (step Sa11), and transfers the process to step Sb1. At this time, the control command construction unit 283, in conjunction with the wireless communication unit 210, the device management control unit 270, and the control command transmission unit 285, transmits the constructed first control command to the ultrasonic diagnostic image processing probe device 10 (step Sa11).

[0133] On the other hand, in the ultrasonic diagnostic image processing probe device 10, when the wireless transceiver unit 15 receives this first control command, the signal processing unit 141 performs a process of increasing the luminance level by a preset change amount from the preset value of the luminance level stored on the memory 16 based on the data regarding the preset change amount (for example, "±5") previously stored in the memory 16. For example, when the preset value of the luminance level is "10" and the preset change amount is "±5", the signal processing unit 141 executes a process of changing the amplification factor of the amplifier of the ultrasonic receiving unit 13 so that the luminance level increases to "15". As a result, the luminance level of the ultrasonic diagnostic image data generated in the ultrasonic diagnostic image processing probe device 10 is changed to the second set value of "15", and the ultrasonic diagnostic image data generated at the changed luminance level is sequentially transmitted to the display device 20.

[0134] Through the above processing, the ultrasonic diagnostic image taken with the luminance level changed to the second set value (for example, "15") is displayed on the display unit 230, and the control for increasing the luminance level by the preset change amount is realized.

[0135] Through such a series of processes, when the luminance level is changed from the preset value, which is the first set value, to the second set value, the voice recognition processing unit 281 transfers the process to step Sb1 and enters a state of determining whether a second voice command has been input by the operator.

[0136] While the operator checks the ultrasonic diagnostic image taken with the brightness level set to the second set value in this way, the operator further determines whether it is necessary to change the brightness level. If it is determined that a change is necessary, a second voice command consisting of a unit operation command of "up or down" is input to increase or decrease the brightness level by a further predetermined change amount to change it to a third set value.

[0137] Then, while the operator checks the image with the brightness level set to the second set value and inputs the first or second voice command, the voice recognition processing unit 281 determines whether the second voice command has been input in conjunction with the unit operation command specifying unit 282 (step Sb1). At this time, while generating a character string corresponding to the voice command input by the operator, the voice recognition processing unit 281 causes the unit operation command specifying unit 282 to specify the unit operation command included in the corresponding voice command, and determines whether the second voice command has been input based on the specified unit operation command. Specifically, when the voice command input by the operator consists only of a unit operation command of "up or down", the voice recognition processing unit 281 determines "Yes" in step Sb1, while (1) when the voice command does not include a unit operation command of "up or down" and (2) when the voice command includes the first unit operation command, it determines "No" in step Sb1.

[0138] Then, when the voice recognition processing unit 281 determines "Yes" in step Sb1, in conjunction with the unit operation command specifying unit 282, while generating a character string corresponding to the input second voice command (step Sb5), it specifies the unit operation command (that is, "up or down") constituting the second voice command from the character string (step Sb6).

[0139] Next, the control command construction unit 283 combines the unit operation command "up or down" specified in step Sb6 with the first unit operation command (in this case, "gain") stored in the RAM 264 in step Sa9 when the first voice command is input, constructs a second control command "gainup or gaindown" (step Sb7), executes a process for changing the luminance level based on the second control command (step Sb8), and then returns the process to step Sb1.

[0140] In this step Sb8, the control command construction unit 283, in conjunction with the wireless communication unit 210, the device management control unit 270, and the control command transmission unit 285, transmits the constructed second control command to the ultrasonic diagnostic image processing probe device 10, thereby increasing or decreasing the luminance level in the direction specified by the second voice command and performing control to change the luminance level to a third set value.

[0141] As a result, in the ultrasonic diagnostic image processing probe device 10, the set value of the luminance level is changed by a predetermined change amount (for example, "±5") from the second set value according to the second control command and is set to the third set value (in this case, "20" or "10"). As a result, in the ultrasonic diagnostic image processing probe device 10, ultrasonic diagnostic image data is generated with the luminance level set to the third set value, sequentially transmitted to the display device 20, and displayed on the display device 20.

[0142] On the other hand, when it is determined as "No" in step Sb1, the voice recognition processing unit 281 determines whether or not the input voice command is the first voice command (step Sb2), and determines whether to end the process when it is determined as "No" (step Sb3). In this step Sb3, the voice recognition processing unit 281 monitors the voice data supplied from the microphone 250 in conjunction with the timer 240, and when the silent state continues for a predetermined time (for example, 10 seconds) from the input end timing of the first voice command "gainup" or when a predetermined operation end voice command is input, it determines that a predetermined operation end condition is satisfied (step Sb3 "Yes"), clears the first unit operation command "gain" already stored in the RAM 264 (step Sb4), and ends the process.

[0143] On the contrary, when it is determined as "No" in step Sb3, the voice recognition processing unit 281 returns the process to step Sb1.

[0144] In this state (that is, the ultrasonic diagnostic image taken in the state where the luminance level is set to the third set value is displayed and the process has returned to step Sb1), the operator checks the ultrasonic diagnostic image and determines whether further luminance level adjustment is necessary. If not, the operator can utter the operation end voice command at that time or continue the silent state for a predetermined period to make the determination in step Sb3 "Yes", and without performing further luminance level adjustment, maintain the luminance level at the third set value and end the process.

[0145] On the other hand, when the operator determines that further adjustment of the luminance level is necessary, it is necessary to input a second voice command consisting of a unit operation command of "up or down" again. When the operator inputs the second voice command again, the voice recognition processing unit 281 repeats the processing of steps Sb5 to 7 again in conjunction with the unit operation command specifying unit 282, the control command construction unit 283, etc., and constructs a second control command for changing the luminance level in the increase / decrease direction specified by the second voice command (step Sb7), and performs control to increase or decrease the luminance level by a further predetermined change amount from the third set value and change it to the fourth set value (step Sb8). Since the processing at this time is the same as above, the details are omitted.

[0146] Thereafter, the processing of steps Sb1 to 8 is repeated until the luminance level of the ultrasonic diagnostic image is optimized. Each time, the luminance level is changed by the predetermined change amount, and it will be optimized for observing the target site.

[0147] The operator sequentially checks the ultrasonic diagnostic images taken and displayed while the luminance level is changed, and when the desired luminance level is reached, the operator issues an operation end voice command or maintains a silent state for a predetermined period to end the processing (step Sb3 "Yes"), and the adjustment of the luminance level is completed. As a result, in the ultrasonic diagnostic image processing probe device 10, the ultrasonic diagnostic image is continuously taken at the luminance level after the adjustment is completed and continues to be displayed on the display device 20.

[0148] The same applies to the adjustment of the display depth. Based on the first control command by the processing in steps Sa9 to 11, the display depth is changed by a predetermined change amount (for example, "±1 cm") from the preset value (the first setting value). After the display depth is changed to the second setting value, by repeating the processing in steps Sb1 to 8, the display depth is gradually changed by the predetermined change amount each time. When the display depth reaches the optimal value for observing the target site, an operation end voice command is input, or the silent state is maintained for a predetermined period, so that the ultrasonic diagnostic image is continuously captured while the display depth is maintained at the optimal value. Note that the adjustment of the luminance level and the display depth is performed manually while the operator grips the ultrasonic diagnostic image processing probe device 10 and scans the subject. Each time, the image is confirmed and the adjustment operation is performed. Since this is the same as the conventional ultrasonic image diagnostic system, the details are omitted.

[0149] By the processing described above, while optimizing the luminance level and the display depth, the operator inputs first voice commands such as "recordstart", "freeze", "shutter", etc., to cause the storage and recording of ultrasonic diagnostic image data, the display of still images, etc. However, if these first voice commands are input before the operation ends (that is, during the period when the answer in step Sb3 is "No"), the voice recognition processing unit 281 determines "Yes" in step Sb2, returns the processing to step Sa2, and executes the processing based on the first voice command.

[0150] For example, when the operator inputs a first voice command "recordstart" at this timing, the voice recognition processing unit 281 converts the first voice command into a character string "recordstart" (step Sa2). Based on the character string, the unit operation command specifying unit 282 specifies a first unit operation command "record" and a second unit operation command "start" (step Sa3). It is determined as "No" in step Sa4. After storing "record" in the RAM 264 (step Sa5), the control command construction unit 283 constructs a first control command "recordstart" (step Sa6). After starting the storage of ultrasonic diagnostic image data in the image data storage unit 263 (step Sa7), the first unit operation command "record" stored in the RAM 264 is cleared (step Sa8), and the process ends. Also, when the operator inputs a first voice command "freeze" or "shutter" at this timing, in the same manner as in the prior art, a still image display of the ultrasonic diagnostic image frame displayed at the input timing of the first voice command is performed. When the "shutter" command is input, further, data corresponding to the ultrasonic diagnostic image frame is stored in the image data storage unit 263 and held in a browsable state later. At this time, it is desirable that the control command construction unit 283 transmits a predetermined control command to the ultrasonic diagnostic image processing probe device 10 according to the first voice command to temporarily stop the electronic scanning by sound waves. Also, after the start of the recording operation according to the above procedure, when (1) stopping the recording and (2) stopping the electronic scanning and image display, after following procedures such as uttering the start voice command again, by inputting a first voice command "recorstop" or "scanstop", the processes of steps Sa2 to 8 are executed, and stop control such as recording stop or electronic scanning is executed. As a result, the ultrasonic diagnostic image data captured between the input timing of the first voice command "recordstart" and the input timing of "recordstop" is stored in the image data storage unit 263, and at the input timing of the "scanstop" command, the electronic scanning by sound waves and the image display stop.

[0151] As described above, the ultrasonic image diagnostic system 1 of the present embodiment wirelessly transmits the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device 10 to the display device 20 for display, and various operations including parameter adjustment can be performed by the voice input function of the display device 20. Therefore, when using the device including vascular puncture, by wrapping only the ultrasonic diagnostic image processing probe device 10 with a vinyl sheet or the like, it is possible to prevent the display device 20 from being contaminated and reduce the work burden.

[0152] Further, the ultrasonic image diagnostic system 1 of the present embodiment uses a first voice command that combines first and second unit operation commands defined by one word (i.e., a short character string). When the first voice command is input, the display device 20 identifies the first and second unit operation commands included in the first voice command spoken by the operator from the character string generated by voice recognition processing, and combines the identified first and second unit operation commands to construct one first control command corresponding to the first voice command spoken by the operator, so as to control the operation of at least one of the ultrasonic diagnostic image processing probe device 10 and the display device 20. Therefore, the occurrence rate of misrecognition can be reduced during voice input.

[0153] Furthermore, regarding parameter adjustment such as luminance level and display depth, in the ultrasonic image diagnostic system 1 of the present embodiment, after inputting a first voice command such as "gainup" once, by repeatedly speaking a second voice command consisting only of a very short unit operation command "up or down" that defines the increase or decrease direction of the parameter, while repeatedly constructing the second control command, an adjustment can be implemented to gradually change the parameter. Therefore, it is possible to achieve both prevention of misrecognition and improvement of operability.

[0154] [8] Variation [8.1] Variation 1 In the above-described embodiment, the case where the first and second unit operation commands are defined by one word has been described as an example. However, within a range where misrecognition is unlikely to occur, the first unit operation command can also be defined by two words, such as "gainup". In this case, "gainup", "gaindown", "depthup", "depthdown", etc., which are formed by combining a word that defines the type of operation to be executed in at least one of the ultrasonic diagnostic image processing probe device 10 and the display device 20, and a word that defines the increase or decrease direction of the parameter value to be changed along with the operation, may be used as the first unit operation command defined by two words.

[0155] Also, in this case, data indicating the control content defined by the first unit operation command, such as "gainup = increase the luminance level by a default change amount", "gaindown = decrease the luminance level by a default change amount", etc., is stored in advance in a DB or the like provided in the command conversion data storage unit 262. When the operator inputs a first voice command including these first unit operation commands, the first unit operation command included in the first voice command is specified, and the first unit operation command is used as it is as a control command to control the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device 10.

[0156] In particular, in this case, as the second unit operation command, a unit operation command consisting of words that define the amount of change in the corresponding parameter, such as "one, two, three, four, five...", is used. When the operator inputs a voice command such as "gainupfifteen", in step Sa3, the unit operation command specifying unit 282 specifies the first unit operation command (i.e., "gainup") and the second unit operation command (i.e., "fifteen") included in the voice command, and temporarily stores the first unit operation command in the RAM 264 (step Sa9). In step Sa10, the control command construction unit 283 combines the first unit operation command "gainup" stored in the RAM 264 with the second unit operation command "fifteen" specified in step Sa3 to construct the first control command "gainupfifteen", and it is also possible to adopt a method of executing control to increase the luminance level by "15" at once according to the first control command. Also in this case, the operator can execute the processing of steps Sb1 to 8 by uttering the second voice command while checking the ultrasonic diagnostic image after parameter adjustment, and it is also possible to gradually adjust the luminance level and the like by the amount of the preset change one by one.

[0157] As a result, according to this modification example, it becomes possible for the operator to adjust the set value of the parameter by the amount intended by the operator at once without inputting the second voice command, and the operability can be further improved.

[0158] [7.2] Modification Example 2 In the above-described embodiment, when adjusting the luminance level and display depth, control data regarding the default change amounts when each of the control commands "gainup", "gaindown", "depthup", and "depthdown" is received is stored in advance in the memory 16 of the ultrasonic diagnostic image processing probe device 10. However, as voice commands for changing the default change amounts, for example, "depthone" for setting the default change amount of the display depth to "±1 cm", "depthtwo" for setting it to "±2 cm", "gainfive" for setting the default change amount of the luminance level to "5", etc., voice commands for freely changing the default change amounts are defined in advance. When a control command corresponding to the voice command is received, the signal processing unit 141 may rewrite the control data in the memory 16 based on the control command so that the default change amount can be set and changed.

[0159] In this case, the voice command may be defined as one voice command. Two control contents, namely (1) an instruction to adjust a parameter and (2) an instruction to change the default change amount, are associated in advance with a first unit operation command "gain and depth". When the second unit operation command included in the first control command received from the display device 20 is a numerical value such as "one", "two", "three", etc., the signal processing unit 141 may perform a process of changing the default change amount in the ultrasonic diagnostic image processing probe device 10, or may be configured to construct a first control command for changing the default change amount in the control command construction unit 283 and transmit it to the ultrasonic diagnostic image processing probe device 10 to control the change of the default change amount. Also, when this method is adopted, if the second unit operation command defines the increase / decrease direction of the parameter, the configuration may be such that a first control command for changing the luminance level or display depth by the default change amount is constructed and controlled according to the control command. According to this configuration, in this modification example, the default change amount can be freely set, and the convenience can be improved.

[0160] [7.3] Modification Example 3 In the above-described embodiment, a configuration using unit operation commands exemplified in FIG. 2 is adopted. However, for example, a command of one word "scan" may be used to define an operation similar to "scanstart", and a configuration may be adopted in which control is performed to start the electronic scanning of sound waves in the ultrasonic diagnostic image processing probe device 10 and start image display on the display device 20. In short, the operation types defined by each unit operation command can be freely designed and changed.

[0161] [7.4] Modification Example 4 In the above-described embodiment, the case where the first voice command and the second voice command combining unit operation commands defined by English words are used has been described as an example. However, each unit operation command may be defined by other languages such as Japanese, German, Chinese, Spanish, etc. In this case, a configuration is adopted in which dictionary data for speech recognition based on the language and a DB or the like storing data for specifying each unit operation command from the words of the language are stored in advance in the command conversion data storage unit 262.

[0162] Then, when the first and second voice commands of the language are input, the speech recognition processing unit 281 converts the commands into appropriate character strings, and the unit operation command specifying unit 282 specifies each unit operation command included in the first voice command or the unit operation command constituting the second voice command based on the character string of the language and the data stored in the DB or the like. The control command construction unit 283 may be configured to construct the first and second control commands by combining the specified unit operation commands and control the operation in at least one of the own device and the ultrasonic diagnostic image processing probe device 10. In this case, for example, a unit operation command such as "Toukotsudomyaku = radial artery" is used as the second unit operation command for defining the observation target site, and unit operation commands such as "sosa" instead of "scan", "rokuga" instead of "record", and "zou, gen, jyou, ge, agete, sagete" instead of "up, down" can be used.

[0163] [7.5] Variant Example 5 In the above-described embodiments and variant examples, the case where voice commands combining the first and second unit operation commands were used was described as an example. However, a first voice command combining a third unit operation command that defines the amount of change in a parameter and the first and second unit operation commands may be used.

[0164] In this case, a first voice command combining a first unit operation command that defines an operation type (for example, "gain" or "depth"), a second unit operation command that defines the increasing or decreasing direction of a parameter that changes along with the operation (for example, "up" or "down"), and a third unit operation command that defines the amount of change in the parameter (for example, "one, two, three...") is used. Then, in step Sa3, the unit operation command specifying unit 282 specifies the first to third unit operation commands included in the character string corresponding to the voice command, and temporarily stores the first unit operation command in the RAM 264 (step Sa9). And in this case, the control command construction unit 283 combines the first unit operation command stored in the RAM 264 with the second and third unit operation commands specified in step Sa3 to construct one first control command corresponding to the first voice command (step Sa10), and controls the operation of at least one of the own device and the ultrasonic diagnostic image processing probe device 10 according to the first control command (step Sa11). For example, when the operator inputs a first voice command "gainupfifteen", the first unit operation command "gain", the second unit operation command "up", and the third unit operation command "fifteen" are specified, and these are combined to construct a first control command "gainupfifteen", and the operation is controlled according to the first control command "gainupfifteen" so as to perform control to increase the luminance level by "15" at once. In this case as well, the operator may execute the processing of steps Sb1 to 8 by uttering the second voice command while checking the ultrasonic diagnostic image after parameter adjustment, and may further adjust the luminance level and the like gradually by the amount of the default change.

[0165] According to this modification example, parameters such as the luminance level can be adjusted by a desired amount at once by a single utterance, and the operability can be improved. In addition, since each unit operation command is indicated by one word, misrecognition during voice recognition can be prevented.

[0166] [7.6] Modification Example 6 In the above embodiment, the ultrasonic image diagnostic system 1 is configured by one ultrasonic diagnostic image processing probe device 10 and one display device 20, and the case of realizing a 1:1 operation mode has been described as an example. However, the ultrasonic image diagnostic system 1 may be configured by one display device 20 and a plurality of ultrasonic diagnostic image processing probe devices 10 to realize a 1:N operation mode. For example, this corresponds to a case where a plurality of ultrasonic diagnostic image processing probe devices 10 having different device shapes, use frequency bands, and scanning methods according to the observation target site are operated by one display device 20 while being switched according to the diagnostic target site.

[0167] Even in this case, the configuration of each ultrasonic diagnostic image processing probe device 10 and the operation of the ultrasonic diagnostic imaging system 1 are basically the same as those in the above-described embodiment. However, when the ultrasonic diagnostic imaging system 1 is configured by a plurality of ultrasonic diagnostic image processing probe devices 10 and operated by a single display device 20, it is necessary to identify the ultrasonic diagnostic image processing probe device 10 to be controlled by the input first and second voice commands, and to send the first and second control commands to the identified ultrasonic diagnostic image processing probe device 10. For this reason, in this modification, in addition to the first to third unit operation commands, a first voice command combined with a fourth unit operation command for identifying the ultrasonic diagnostic image processing probe device 10 to be controlled is used. For example, when five ultrasonic diagnostic image processing probe devices 10 are operated by a single display device 20, identifiers 1 to 5 are assigned to each ultrasonic diagnostic image processing probe device 10. When the operator inputs a first voice command such as "gainupnumber1", a first control command such as "gainup" is sent to the ultrasonic diagnostic image processing probe device 10 to which the identifier 1 is assigned, and a configuration is adopted in which the luminance level at the time of imaging in the corresponding ultrasonic diagnostic image processing probe device 10 is increased by a predetermined change amount. Even in this case, when the adjustment of the parameters is continued using the second voice command, the second control command may be repeatedly sent to the ultrasonic diagnostic image processing probe device 10 that is the destination of the first control command, so that the luminance level and the like in the ultrasonic diagnostic image processing probe device 10 are gradually changed by a predetermined change amount each time.

[0168] [7.7] Modification 7 In the above-described embodiment, the speech period of the voice command was not particularly considered. However, when performing the respective controls of "freeze", "shutter", and "record", a plurality of ultrasonic diagnostic image frames are captured and displayed between the speech start timing and the speech end timing of the voice command. In particular, in order to improve the temporal resolution of the ultrasonic imaging diagnostic system 1, when the frame rate is increased, many ultrasonic diagnostic image frames are captured between the speech start timing and the end timing.

[0169] On the other hand, since the operator speaks these voice commands at the moment when the operator actually wants to save while checking the image displayed on the display device 20, the frame that the operator actually wants to save is considered to be the one captured and displayed at the speech start timing. Therefore, it is desirable to save the data corresponding to the frame captured and displayed at the speech start timing in order to improve the usability of the system. From the above viewpoints, in this modification example, when generating ultrasonic diagnostic image data by the ultrasonic diagnostic image processing probe device 10, a time stamp is assigned to each frame, and the voice recognition processing unit 281 identifies the input start date and time of the voice command in conjunction with the timer 240, and when executing the control based on these voice commands, the frame with the time stamp closest to the speech start date and time is displayed as a still image, saved, and screen-captured, or the configuration is adopted to start the recording of the ultrasonic diagnostic image data from the frame captured at the time closest to the speech start timing of "recordstart". With this configuration, the image displayed at the timing intended by the operator can be reliably saved and made available later.

Description of Reference Numerals

[0170] 1…Ultrasonic imaging diagnosis system, 10…Ultrasonic diagnostic image processing probe device, 11…Transducer array, 111…Transmission / reception surface, 112…Ultrasonic transducer, 12…Ultrasonic driving unit, 13…Ultrasonic receiving unit, 14…Control unit, 141…Signal processing unit, 142…Image processing unit, 143…Wireless control unit, 16…Memory, 20…Display device, 210…Wireless communication unit, 220…Display control unit, 230…Display unit, 240…Timer, 250…Microphone, 260…Storage unit, 261…Program storage unit, 262…Command conversion data storage unit, 263…Image data storage unit, 264…RAM, 270…Device management control unit, 280…Data processing unit, 281…Speech recognition processing unit, 282…Unit operation command specifying unit, 283…Control command construction unit, 284…Image storage control unit, 285…Control command transmission unit

Claims

1. An ultrasonic diagnostic image display device that wirelessly acquires ultrasonic diagnostic image data generated from a plurality of ultrasonic diagnostic image frames obtained by transmitting sound waves in a predetermined frequency band to a subject and receiving echoes of the sound waves in the subject, and displays an ultrasonic diagnostic image of the subject, comprising: a generating means for collecting voice commands spoken by an operator and generating a character string corresponding to the voice commands; based on the generated character string, a unit operation command included in the voice command, (1) at least defining a type of operation in the ultrasonic diagnostic image processing probe device and a first unit operation command first spoken by an operator, and (2) spoken after the first unit operation command, (2a) defining the start or stop of the operation, (2b) defining the increase or decrease direction of a parameter value to be changed along with the operation, (2c) defining the change amount of the parameter value, or (2d) a second unit operation command for defining an observation target site, and a specifying means for specifying; a first storage means for storing the specified first unit operation command; by combining at least the stored first unit operation command and the specified second unit operation command, (A) defining the start or stop of an operation of the type specified by the voice command, (B) defining the operation type specified by the voice command and the increase or decrease direction of the parameter value associated with the operation, (C) defining the operation type specified by the voice command, the increase or decrease direction of the parameter value, and the change amount of the parameter value, or (D) constructing a first control command for defining to set the value of the parameter to a value suitable for observing a target site designated by the operator; and a constructing means; a control means for controlling the operation of the ultrasonic diagnostic image processing probe device based on at least the constructed first control command; Means for wirelessly acquiring the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device, wherein when the constructed first control command defines at least the operation of the ultrasonic diagnostic image processing probe device, the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled based on the first control command is wirelessly acquired. Display means for displaying an ultrasonic diagnostic image of the subject based on the acquired ultrasonic diagnostic image data. It has (a) The constructed first control command defines the type of operation in the ultrasonic diagnostic image processing probe device and the increase / decrease direction of the parameter value associated with the operation, and (b) according to the first control command, after the control means changes the parameter value by a predetermined fixed change amount from the first set value set at the timing of the operator's speech start in the increase / decrease direction defined by the first control command and changes it to the second set value, when the operator repeatedly utters a second voice command defining the increase / decrease direction of the parameter value within a predetermined period, The specifying means Each time the second voice command is uttered, based on the second voice command, specifies the increase / decrease direction of the parameter value. The constructing means Each time the second voice command is uttered, based on the first unit operation command stored in the first storage means and the increase / decrease direction defined by the corresponding second voice command, repeatedly constructs a second control command corresponding to the second voice command, defining the type of operation in the ultrasonic diagnostic image processing probe device and the increase / decrease direction of the parameter value. The control means Each time the second control command is constructed, the operation of the ultrasonic diagnostic image processing probe device is controlled by increasing or decreasing the parameter value by the predetermined fixed change amount from the set value set at the timing of the construction of the second control command in the increase / decrease direction defined by the second control command. the acquisition means wirelessly acquires the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device controlled to operate based on the first and second control commands, and an ultrasonic diagnostic image display device characterized by this.

2. When the voice command indicates a setting change of the predetermined change amount, the construction means constructs one of the first control commands that defines a setting change of the predetermined change amount, the control means controls the operation of the ultrasonic diagnostic image processing probe device based on the first control command, and changes the predetermined change amount based on the first control command. The ultrasonic diagnostic image display device according to claim 1.

3. the voice command includes a first unit operation command that defines a type of operation in the ultrasonic diagnostic image processing probe device and a second unit operation command that defines an observation target site in the subject, the specifying means based on the character string, specifies the first unit operation command and stores it in the first storage means, and while specifying the target site defined by the second unit operation command, specifies a set value of the parameter suitable for observing the target site, the construction means constructs one of the first control commands that defines setting the value of the parameter to a value suitable for observing the target site designated by the operator based on the first unit operation command stored in the first storage means and the specified set value of the parameter, the control means controls the operation of the ultrasonic diagnostic image processing probe device based on the constructed first control command. The ultrasonic diagnostic image display device according to claim 1.

4. An ultrasonic diagnostic image processing probe device that transmits sound waves in a predetermined frequency band to a subject and generates ultrasonic diagnostic image data composed of a plurality of ultrasonic diagnostic image frames obtained by receiving echoes of the sound waves in the subject, An ultrasonic diagnostic image display device that wirelessly acquires the ultrasonic diagnostic image data from the ultrasonic diagnostic image data and displays an ultrasonic diagnostic image of the subject, An ultrasonic image diagnostic system having, wherein the ultrasonic diagnostic image display device, a generating means for collecting a voice command spoken by an operator and generating a character string corresponding to the voice command, Based on the generated character string, a unit operation command included in the voice command, (1) at least defining the type of operation in the ultrasonic diagnostic image processing probe device and the first unit operation command first spoken by the operator, and (2) spoken after the first unit operation command, (2a) defining the start or stop of the operation, (2b) defining the increase or decrease direction of the parameter value changed along with the operation, (2c) defining the change amount of the parameter value, or (2d) a second unit operation command for defining the observation target site, and a specifying means for specifying, a first storage means for storing the specified first unit operation command, By combining at least the stored first unit operation command and the specified second unit operation command, (A) defining the start or stop of the operation of the type specified by the voice command, (B) defining the operation type specified by the voice command and the increase or decrease direction of the parameter value associated with the operation, (C) defining the operation type specified by the voice command, the increase or decrease direction of the parameter value, and the change amount of the parameter value, or (D) constructing a first control command for defining to set the value of the parameter to a value suitable for observing the target site designated by the operator, and a constructing means, a control means for controlling the operation of the ultrasonic diagnostic image processing probe device based on at least the constructed first control command, Means for wirelessly acquiring the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device, and when the constructed first control command defines at least the operation of the ultrasonic diagnostic image processing probe device, acquiring the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled based on the first control command wirelessly. Display means for displaying an ultrasonic diagnostic image of the subject based on the acquired ultrasonic diagnostic image data. It has (a) The constructed first control command defines the type of operation in the ultrasonic diagnostic image processing probe device and the increasing or decreasing direction of the parameter value associated with the operation, and (b) according to the first control command, after the control means changes the parameter value by a predetermined fixed change amount from the first set value set at the timing of the operator's speech start in the increasing or decreasing direction defined by the first control command to change it to the second set value, when the operator repeatedly utters a second voice command defining the increasing or decreasing direction of the parameter value within a predetermined period, The specifying means Each time the second voice command is uttered, based on the second voice command, specify the increasing or decreasing direction of the parameter value. The constructing means Each time the second voice command is uttered, based on the first unit operation command stored in the first storage means and the increasing or decreasing direction defined by the corresponding second voice command, repeatedly construct a second control command corresponding to the second voice command, defining the type of operation in the ultrasonic diagnostic image processing probe device and the increasing or decreasing direction of the parameter value. The control means Each time the second control command is constructed, change the parameter value by the predetermined fixed change amount in the increasing or decreasing direction defined by the second control command from the set value set at the construction timing of the second control command, thereby controlling the operation of the ultrasonic diagnostic image processing probe device. The acquisition means wirelessly acquires the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device controlled to operate based on the first and second control commands. An ultrasonic image diagnostic system characterized by the above.

5. having a plurality of the ultrasonic diagnostic image processing probe devices and one of the display devices, The voice command includes a third unit operation command that defines at least the ultrasonic diagnostic image processing probe device to which the first control command is to be transmitted, The specifying means specifies the ultrasonic diagnostic image processing probe device defined by the third unit operation command based on the character string, and The control means transmits at least the first control command to the specified ultrasonic diagnostic image processing probe device to control the operation of the ultrasonic diagnostic image processing probe device. The ultrasonic image diagnostic system according to claim 4.

6. A computer that functions as an ultrasonic diagnostic image display device that wirelessly acquires the ultrasonic diagnostic image data from an ultrasonic diagnostic image processing probe device that generates ultrasonic diagnostic image data composed of a plurality of ultrasonic diagnostic image frames obtained by transmitting sound waves in a predetermined frequency band to a subject and receiving echoes of the sound waves in the subject, and displays an ultrasonic diagnostic image of the subject, a generation means that collects a voice command spoken by an operator and generates a character string corresponding to the voice command, Based on the generated character string, a unit operation command included in the voice command, which (1) at least defines the type of operation in the ultrasonic diagnostic image processing probe device and is the first unit operation command uttered by the operator, and (2) is uttered after the first unit operation command, and (2a) defines the start or stop of the operation, (2b) defines the increase or decrease direction of the parameter value to be changed along with the operation, (2c) defines the change amount of the parameter value, or (2d) defines the observation target site, a specifying means for specifying a second unit operation command, A storage control means for storing the specified first unit operation command in a storage means, By combining at least the stored first unit operation command and the specified second unit operation command, (A) defines the start or stop of the operation of the type specified by the voice command, (B) defines the operation type specified by the voice command and the increase or decrease direction of the parameter value associated with the operation, (C) defines the operation type specified by the voice command, the increase or decrease direction of the parameter value, and the change amount of the parameter value, or (D) constructs a first control command that defines setting the value of the parameter to a value suitable for observing the target site designated by the operator, a constructing means, A control means for controlling the operation of the ultrasonic diagnostic image processing probe device based on at least the constructed first control command, Means for wirelessly acquiring the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device, and when the constructed first control command at least defines the operation of the ultrasonic diagnostic image processing probe device, wirelessly acquiring the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled based on the first control command, an acquiring means, A display control means for causing a display means to display an ultrasonic diagnostic image of the subject based on the acquired ultrasonic diagnostic image data, function as and (a) The constructed first control command defines the type of operation in the ultrasonic diagnostic image processing probe device and the increasing / decreasing direction of the parameter value associated with the operation, and (b) according to the first control command, after the control means changes the parameter value by a predetermined fixed change amount from the first set value set at the timing of the operator's speech start in the increasing / decreasing direction defined by the first control command to the second set value, when the operator repeatedly utters a second voice command defining the increasing / decreasing direction of the parameter value within a predetermined period, the specifying means, each time the second voice command is uttered, based on the second voice command, specifies the increasing / decreasing direction of the parameter value, the constructing means, each time the second voice command is uttered, based on the first unit operation command stored in the storage means and the increasing / decreasing direction defined by the corresponding second voice command, repeatedly constructs a second control command corresponding to the second voice command, defining the type of operation in the ultrasonic diagnostic image processing probe device and the increasing / decreasing direction of the parameter value, the control means, each time the second control command is constructed, by increasing or decreasing the parameter value by the predetermined fixed change amount from the set value set at the construction timing of the second control command in the increasing / decreasing direction defined by the second control command, controls the operation of the ultrasonic diagnostic image processing probe device, the acquisition means, wirelessly acquires the ultrasonic diagnostic image data generated by the ultrasonic diagnostic image processing probe device whose operation is controlled based on the first and second control commands. A program characterized by this.

Images