Ultrasonic diagnostic system and image processing device

Abstract

To provide an ultrasonic image different from an ultrasonic image displayed on an ultrasonic diagnostic device in real time as much as possible to a person from remote.SOLUTION: An ultrasonic diagnostic device 10 acquires Raw data by ultrasonic transmission and reception, and applies first image processing to the Raw data to generate a first ultrasonic image. The Raw data is transmitted from the ultrasonic diagnostic device 10 to an image processing device 12 via a communication path N including a high-speed communication path. The image processing device 12 applies second image processing different from the first image processing to the Raw data to generate a second ultrasonic image. The second ultrasonic image is displayed on a display of the image processing device 12.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an ultrasound diagnostic system and an image processing device. [Background technology]

[0002] Typically, an ultrasound diagnostic device obtains raw data (e.g., data that has not been processed to generate an ultrasound image for display) by transmitting and receiving ultrasound, applies image processing to the raw data to generate an ultrasound image, and displays the ultrasound image on a display.

[0003] Patent Document 1 describes an apparatus that generates an ultrasound image based on raw data received from an ultrasound diagnostic apparatus. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-112357 A Summary of the Invention [Problem to be solved by the invention]

[0005] For example, even if an ultrasound diagnostic device itself can perform 3D image processing (e.g., image processing for the circulatory system) in real time, there is a limit to the real-time execution of 3D image processing in an external device other than the ultrasound diagnostic device (e.g., a medical image diagnostic system). Therefore, it is difficult to observe and analyze ultrasound images generated by the ultrasound diagnostic device in real time at a remote location.

[0006] In addition, people who observe and analyze the ultrasound images displayed on an external device (for example, doctors, family members of subjects, etc.) do not necessarily want to observe and analyze the ultrasound images displayed on an ultrasound diagnostic device, and therefore the needs of such people cannot be met by simply transmitting the ultrasound images displayed on the ultrasound diagnostic device to an external device and displaying them on the external device.

[0007] An object of the present disclosure is to provide a person in a remote location with an ultrasound image that differs from an ultrasound image displayed on an ultrasound diagnostic device in as real time as possible. [Means for solving the problem]

[0008] One aspect of the present disclosure is an ultrasound diagnostic system including an ultrasound diagnostic device and an image processing device, wherein the ultrasound diagnostic device includes an acquisition unit that acquires Raw data by transmitting and receiving ultrasound, a first image processing unit that generates a first ultrasound image by applying a first image processing to the Raw data, a first display control unit that causes the first ultrasound image generated by the first image processing unit to be displayed on a first display of the ultrasound diagnostic device, and a first transmission unit that transmits the Raw data to which the first image processing has not been applied by the first image processing unit to the image processing device via a high-speed communication path, and the image processing device includes a second receiving unit that receives the Raw data transmitted by the first transmission unit via the high-speed communication path, a second image processing unit that applies a second image processing different from the first image processing to the Raw data received by the second receiving unit to generate a second ultrasound image different from the first ultrasound image displayed on the first display of the ultrasound diagnostic device, and a second display control unit that causes the second ultrasound image generated by the second image processing unit to be displayed on a second display of the image processing device.

[0009] The second image processing unit may generate a three-dimensional ultrasound image as the second ultrasound image based on the raw data.

[0010] The image processing device may further include a user interface that accepts a selection of a second image processing, the second image processing unit generates the second ultrasound image by applying the second image processing to the raw data in accordance with the selection accepted by the user interface, and the second display control unit may display the second ultrasound image on the second display.

[0011] The image processing device may further include a user interface that accepts a selection of a second image processing, and a second transmitting unit that transmits control information indicating the selection accepted by the user interface to the ultrasound diagnostic device via a high-speed communication path, and the ultrasound diagnostic device may further include a first receiving unit that receives the control information transmitted by the second transmitting unit via the high-speed communication path, and the first image processing unit generates a third ultrasound image by applying the second image processing indicated by the control information received by the first receiving unit to the raw data, and the first display control unit may display the third ultrasound image on the first display.

[0012] The image processing device may further include a user interface that accepts a selection of a third image processing, and a second transmission unit that transmits control information indicating the selection accepted by the user interface to the ultrasound diagnostic device via a high-speed communication path, and the ultrasound diagnostic device may further include a first receiving unit that receives the control information transmitted by the second transmission unit via the high-speed communication path, and the first image processing unit generates a third ultrasound image by applying the third image processing indicated by the control information received by the first receiving unit to the raw data, and the first display control unit may display the third ultrasound image on the first display.

[0013] The first transmission unit may transmit information indicating the first image processing to the image processing device via a high-speed communication path, the second receiving unit may receive information indicating the first image processing transmitted by the first transmission unit via the high-speed communication path, the second image processing unit may generate the second ultrasonic image by applying the second image processing to the Raw data, and generate the first ultrasonic image by applying the first image processing to the Raw data in accordance with information indicated by the first image processing, and the second display control unit may display the second ultrasonic image and the first ultrasonic image side by side on the second display.

[0014] The first transmission unit may link header data including information indicating the first image processing to the Raw data and transmit the header data to the image processing device via a high-speed communication path, the second receiving unit may receive the Raw data and the header data transmitted by the first transmission unit via the high-speed communication path, the second image processing unit may generate a fourth ultrasound image by applying the first image processing to the Raw data in accordance with the information indicating the first image processing included in the header data, and the second display control unit may display the fourth ultrasound image on the second display.

[0015] The second display control unit may cause the second ultrasonic image to be displayed on the second display in accordance with a specified display mode, and may cause the second display to display mode identification information for identifying the display mode.

[0016] The display mode may be any one of a first mode in which the second ultrasound image generated by applying the second image processing to the Raw data while receiving the Raw data is displayed, a second mode in which the second ultrasound image generated by receiving the Raw data and applying the second image processing to the Raw data stored in a memory is displayed, and a third mode in which the second ultrasound image is displayed in a stationary state.

[0017] The ultrasonic diagnostic apparatus may be used for a cardiovascular examination, and the first image processing and the second image processing may be image processing related to the cardiovascular examination.

[0018] The ultrasonic diagnostic apparatus may be used for obstetric examination, and the first image processing and the second image processing may be image processing related to the obstetric examination.

[0019] Another aspect of the present disclosure is an image processing device including: a second receiving unit that receives Raw data via a high-speed communication path from an ultrasound diagnostic device that acquires Raw data by transmitting and receiving ultrasound and generates a first ultrasound image by applying first image processing to the Raw data; a second image processing unit that generates a second ultrasound image different from the first ultrasound image by applying second image processing different from the first image processing to the Raw data received by the second receiving unit; and a second display control unit that displays the second ultrasound image generated by the second image processing unit on a display. Effect of the Invention

[0020] According to the present disclosure, it is possible to provide a person in a remote location with an ultrasound image that differs from the ultrasound image displayed on an ultrasound diagnostic device as quickly as possible in real time. [Brief description of the drawings]

[0021] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an ultrasound diagnostic system according to an embodiment. [Diagram 2] 1 is a diagram illustrating an example of the configuration of an ultrasound diagnostic apparatus according to an embodiment. [Diagram 3] FIG. 1 is a diagram illustrating an example of a configuration of an image processing device according to an embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a structure of transmission data. [Diagram 5] FIG. 2 illustrates data and main memory. [Figure 6] FIG. 1 is a diagram illustrating an example of processing by an ultrasound diagnostic system. [Figure 7]FIG. 4 is a diagram illustrating an example of processing by a processor of the image processing device. [Figure 8] FIG. 4 is a diagram illustrating an example of processing by a processor of the image processing device. [Figure 9] FIG. 13 is a diagram showing a display example of a first ultrasound image. [Figure 10] FIG. 13 is a diagram showing a display example of a second ultrasound image. [Figure 11] FIG. 13 is a diagram showing a display example of a second ultrasound image. [Figure 12] FIG. 13 is a diagram showing a display example of a second ultrasound image. [Figure 13] FIG. 13 is a diagram for explaining an application example of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] An ultrasound diagnostic system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the ultrasound diagnostic system according to the embodiment.

[0023] The ultrasound diagnostic system includes an ultrasound diagnostic device 10 and an image processing device 12. The ultrasound diagnostic device 10 and the image processing device 12 have a function of communicating with each other via a communication path N.

[0024] The communication path N includes a high-speed communication path. For example, the high-speed communication path is a wireless communication path using a sixth generation mobile communication system (6G) or a wireless communication path using a next-generation communication system after 6G. A communication path capable of transmitting data acquired by the ultrasound diagnostic device 10 to the image processing device 12 in real time may be used as the high-speed communication path. The communication path N may include a network such as the Internet or a LAN (Local Area Network). A wired line may be used as part of the communication path N.

[0025] The ultrasound diagnostic device 10 generates data representing the inside of the subject by transmitting ultrasound waves into the subject using an ultrasound probe and receiving the ultrasound waves reflected from the subject. Image processing is applied to the data to generate an ultrasound image representing the tissues and the like inside the subject.

[0026] The data generated by the ultrasound diagnostic apparatus 10 is transmitted to the image processing apparatus 12 via the communication path N. For example, when a data transmission request is transmitted from the image processing apparatus 12 to the ultrasound diagnostic apparatus 10, the data is transmitted from the ultrasound diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N in response to the request.

[0027] The image processing device 12 receives data from the ultrasound diagnostic device 10 via a communication path N. The image processing device 12 generates an ultrasound image by applying image processing to the data. For example, the image processing device 12 is a personal computer (hereinafter referred to as "PC"), a tablet PC, a smartphone, a server, a mobile phone, or the like.

[0028] For example, the ultrasound diagnostic device 10 generates raw data by transmitting and receiving ultrasound. The raw data is data to which image processing for generating an ultrasound image for display has not been applied. The raw data is transmitted from the ultrasound diagnostic device 10 to the image processing device 12. The image processing device 12 generates an ultrasound image by applying image processing to the raw data. For example, the ultrasound image is displayed on a display of the image processing device 12.

[0029] For example, when a user of the image processing device 12 instructs the execution of image processing, the image processing device 12 applies the image processing instructed by the user to the raw data to generate an ultrasound image. For example, the image processing device 12 executes image processing different from the image processing executed by the ultrasound diagnostic device 10. Of course, the image processing device 12 may execute the same image processing as the image processing executed by the ultrasound diagnostic device 10.

[0030] The configuration of the ultrasound diagnostic device 10 will be described below with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of the ultrasound diagnostic device 10.

[0031] The ultrasound diagnostic device 10 includes an ultrasound probe 14, a transmitter / receiver unit 16, a signal processing unit 18, an image processing unit 20, a display processing unit 22, a display unit 24, an input unit 26, a control unit 28, a display control unit 30, a conversion unit 32, a communication unit 34, and a memory unit 36.

[0032] The ultrasonic probe 14 is a device for transmitting and receiving ultrasonic waves. For example, the ultrasonic probe 14 includes a 2D array transducer. The 2D array transducer is formed by arranging a plurality of ultrasonic transducers two-dimensionally. An ultrasonic beam is formed by the 2D array transducer. When the sound beam is repeatedly electronically scanned, a scanning plane is formed as a two-dimensional echo data acquisition space for each electronic scan. When the ultrasonic beam is scanned two-dimensionally, a three-dimensional space is formed as a three-dimensional echo data acquisition space. As a scanning method, a sector scan, a linear scan, a convex scan, or the like is used.

[0033] During transmission, the transmission / reception unit 16 supplies a plurality of transmission signals having a certain delay relationship to a plurality of ultrasonic transducers included in the ultrasonic probe 14. This forms an ultrasonic transmission beam. During reception, a reflected wave (RF signal) from inside the living body is received by the ultrasonic probe 14. This causes a plurality of reception signals to be output from the ultrasonic probe 14 to the transmission / reception unit 16. The transmission / reception unit 16 forms a reception beam by applying a phasing addition process to the plurality of reception signals. The data of the reception beam is output to the signal processing unit 18. That is, the transmission / reception unit 16 performs delay processing on the reception signals obtained from each ultrasonic transducer according to the delay processing conditions for each ultrasonic transducer, and forms a reception beam by adding the plurality of reception signals obtained from the plurality of ultrasonic transducers. The delay processing conditions are specified by reception delay data indicating the delay time. A reception delay data set (i.e., a set of delay times) corresponding to the plurality of ultrasonic transducers is supplied from the control unit 28. The transmission / reception unit 16 functions as a transmission beam former and a reception beam former. For example, the transmission / reception unit 16 includes an A / D converter, a detector, an amplifier circuit, and the like. The unit for transmitting and receiving ultrasonic waves and the unit for realizing the beamformer may be configured as separate units.

[0034] The signal processing unit 18 applies signal processing to the beam data output from the transmitting / receiving unit 16. For example, the signal processing includes detection and amplitude compression such as logarithmic compression. The data to which the signal processing has been applied is output to the image processing unit 20.

[0035] The image processing unit 20 generates an ultrasound image by applying image processing to the data to which the signal processing has been applied. For example, the image processing includes a coordinate conversion function and an interpolation processing function by a DSC (digital scan converter). For example, the ultrasound image is a B-mode image, a color Doppler image, a pulse Doppler image, a strain imaging image, a shear wave elastography image, or the like. The ultrasound image may be a three-dimensional image or may be a three-dimensional image.

[0036] The display processing unit 22 generates a display image by overlaying the necessary graphic data on the ultrasound image. The display image is output to the display unit 24. One or more images are displayed side by side in a display format according to the display mode.

[0037] The display unit 24 is a display such as a liquid crystal display or an EL display. An ultrasound image such as a B-mode image is displayed on the display unit 24. The display unit 24 may be a device that combines a display and an input unit 26. For example, a GUI (Graphic User Interface) may be realized by the display unit 24. Also, a user interface such as a touch panel may be realized by the display unit 24.

[0038] The input unit 26 is a device that allows a user to input various information (e.g., conditions required for imaging, commands, patient information, etc.) to the ultrasound diagnostic apparatus 10. For example, the input unit 26 is an operation panel, a switch, a button, a keyboard, a mouse, a trackball, a joystick, etc.

[0039] The control unit 28 controls the operation of each unit of the ultrasound diagnostic apparatus 10. The control unit 28 includes a display control unit 30.

[0040] The display controller 30 causes the display unit 24 to display the ultrasound image. The display controller 30 may cause the display unit 24 to display information or images other than the ultrasound image.

[0041] The converter 32 converts the raw data into data for transmission. The raw data is data to be transmitted from the ultrasound diagnostic device 10 to the image processing device 12. For example, the converter 32 generates the data for transmission by attaching header data to the raw data.

[0042] Raw data is data to which no processing for generating an ultrasonic image for display has been applied. For example, data output from the transmitting / receiving unit 16 to which no signal processing has been applied by the signal processing unit 18 is raw data. In this case, the transmitting / receiving unit 16 corresponds to an example of an acquiring unit. Data to which signal processing has been applied by the signal processing unit 18 may be raw data. In other words, data output from the signal processing unit 18 to which no image processing has been applied by the image processing unit 20 may be raw data. In this case, the signal processing unit 18 corresponds to an example of an acquiring unit.

[0043] The header data is metadata (i.e., incidental information) that is added to the raw data. For example, the header data includes an imaging mode, information about the raw data, scan information, signal processing information, image processing information, measurement information, frame information, and patient information. The imaging mode is an imaging mode executed by the ultrasound diagnostic device 10 to acquire the raw data. For example, the imaging mode is a B mode (THI), M mode, PW mode, CW mode, CFI mode, CFA mode, TE mode, SWE mode, and the like. The information about the raw data includes a data length, a number of samples, an interval, a size, an address, and a data type (rectangular coordinate IQ or polar coordinate rΘ), and the like. The scan information includes a number of lines, an interval, a size, an address, and a type (Lin, Sec, Conv), and the like. The signal processing information is information indicating signal processing by the signal processing unit 18. The signal processing information includes information about gain, a filter, and the like. The image processing information is information indicating image processing by the image processing unit 20. The image processing information includes information about a region of interest (ROI), a filter, and the like. The measurement information includes parameters related to the measurement performed by the ultrasound diagnostic apparatus 10. The frame information is information indicating the size, position, etc. of the ultrasound image. The patient information is information indicating the ID, sex, age, etc. of the patient from whom the raw data was acquired. For example, when imaging is performed by the ultrasound diagnostic apparatus 10, each piece of information included in the header data is input to the ultrasound diagnostic apparatus 10 by a user such as a medical technician or a doctor, or is input to the ultrasound diagnostic apparatus 10 from an external device such as a server. Information other than the above-mentioned information may be included in the header data. The user may specify the information included in the header data.

[0044] The communication unit 34 is a communication interface. The communication unit 34 has a first transmission unit 34a that transmits data to an external device and a first reception unit 34b that receives data. The first transmission unit 34a transmits data for transmission to the image processing device 12 via the communication path N. As a result, raw data is transmitted from the ultrasound diagnostic device 10 to the image processing device 12. The first reception unit 34b receives information transmitted from the image processing device 12 via the communication path N. For example, as described later, control information indicating the second image processing and the third image processing selected by the user is transmitted from the image processing device 12 to the ultrasound diagnostic device 10 via the communication path N. The first reception unit 34b receives the control information.

[0045] The storage unit 36 ​​configures one or more storage areas for storing data. For example, the storage unit 36 ​​is a hard disk drive (HDD), a solid state drive (SSD), various types of memory (e.g., RAM, DRAM, ROM, etc.), other storage devices (e.g., optical disks, etc.), or a combination thereof. For example, raw data, ultrasound image data, information indicating imaging conditions, patient information, etc. are stored in the storage unit 36. Header data and transmission data may also be stored in the storage unit 36.

[0046] The image processing unit 20 corresponds to an example of a first image processing unit. The image processing by the image processing unit 20 corresponds to an example of the first image processing. An ultrasound image generated by applying the first image processing to the raw data corresponds to an example of a first ultrasound image. The display of the display unit 24 corresponds to an example of a first display. The display control unit 30 corresponds to an example of a first display control unit.

[0047] The configuration of the image processing device 12 will be described below with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the image processing device 12.

[0048] The image processing device 12 includes a communication unit 38 , a reception unit 40 , a main memory 42 , a memory control unit 44 , an IO device 46 , an output unit 48 , an input unit 50 , and a processor 52 .

[0049] The communication unit 38 is a communication interface. The communication unit 38 has a second transmission unit 38a that transmits data to an external device and a second reception unit 38b that receives data. For example, the second transmission unit 38a transmits control information indicating the second image processing and the third image processing selected by the user to the ultrasound diagnostic device 10 via the communication path N. The second reception unit 38b receives the transmission data transmitted from the ultrasound diagnostic device 10 via the communication path N. As a result, the second reception unit 38b receives the raw data.

[0050] The receiving unit 40 receives the transmission data received by the communication unit 38 and executes a process of storing the transmission data in the main memory 42 .

[0051] The main memory 42 constitutes one or more storage areas for storing data. For example, the main memory 42 is a hard disk drive (HDD), a solid state drive (SSD), various types of memory (e.g., RAM, DRAM, ROM, etc.), other storage devices (e.g., optical disk, etc.), or a combination thereof. For example, data to be transmitted is stored in the main memory 42. Raw data and header data may be stored separately in the main memory 42. Other information may be stored in the main memory 42.

[0052] The memory control unit 44 controls the main memory 42. For example, the memory control unit 44 stores the transmission data accepted by the acceptance unit 40 in the main memory 42. The memory control unit 44 also controls the reading of data from the main memory 42.

[0053] The IO device 46 is connected to an output unit 48 and an input unit 50. For example, various information is output to the output unit 48 via the IO device 46, and is input from the input unit 50 to the image processing device 12 via the IO device 46.

[0054] The output unit 48 includes a display unit. The display unit is a display such as a liquid crystal display or an EL display. The display unit may be a device that combines a display and the input unit 50. For example, a GUI (Graphic User Interface) may be realized by the display unit. Also, a user interface such as a touch panel may be realized by the display unit. The output unit 48 may include a speaker.

[0055] The input unit 50 is a device that allows a user to input various pieces of information to the image processing device 12. For example, the input unit 50 is an operation panel, a switch, a button, a keyboard, a mouse, a trackball, a joystick, or the like.

[0056] The processor 52 includes a control unit, a calculation unit, a cache, a bus I / F, etc. The control unit controls the image processing device 12. The calculation unit performs various calculations. The processor 52 also includes an image processing unit 54 and a display control unit 56.

[0057] The image processor 54 generates an ultrasound image by applying image processing to the raw data. The image processing may include the signal processing described above.

[0058] The display control unit 56 causes the ultrasound image to be displayed on the display of the output unit 48. The display control unit 56 may cause the display of the output unit 48 to display information or images other than the ultrasound image.

[0059] The image processing unit 54 corresponds to an example of a second image processing unit. The image processing by the image processing unit 54 corresponds to an example of the second image processing. An ultrasound image generated by applying the second image processing to the raw data corresponds to an example of the second ultrasound image. The display of the output unit 48 corresponds to an example of the second display. The display control unit 56 corresponds to an example of the second display control unit.

[0060] The image processing device 12 also includes a user interface that accepts the selection of the second image processing. The user interface is realized by the output unit 48 and the input unit 50. The display control unit 56 causes a screen for selecting the second image processing to be displayed on the display of the output unit 48. For example, a list of a plurality of different second image processing is displayed on the screen. The user can operate the input unit 50 to select the second image processing on the screen. Of course, the second image processing may be selected by voice. The cross section or diagnostic region to be displayed may be specified by the user interface. The image processing unit 54 generates a second ultrasound image by applying the second image processing to the Raw data according to the selection accepted by the user interface. The display control unit 56 causes the second ultrasound image to be displayed on the display of the output unit 48.

[0061] The second transmission unit 38a may transmit control information indicating the selection accepted by the user interface to the ultrasound diagnostic device 10 via the communication path N. That is, when the second image processing is selected by the user on the above screen, the second transmission unit 38a transmits control information indicating the second image processing selected by the user to the ultrasound diagnostic device 10 via the communication path N. Similarly, when the second image processing is selected by voice, the second transmission unit 38a transmits control information indicating the selected second image processing to the ultrasound diagnostic device 10.

[0062] The first receiving unit 34b of the ultrasound diagnostic device 10 receives the control information transmitted by the second transmitting unit 38a of the image processing device 12 via the communication path N. The image processing unit 20 of the ultrasound diagnostic device 10 generates a third ultrasound image by applying the second image processing indicated by the control information received by the first receiving unit 34b to the raw data. The display control unit 30 of the ultrasound diagnostic device 10 causes the display unit 24 to display the third ultrasound image.

[0063] The structure of the transmission data will be described below with reference to Fig. 4. Fig. 4 shows an example of the structure of the transmission data.

[0064] The ultrasound diagnostic device 10 transmits and receives ultrasound to generate raw data 57. The conversion unit 32 generates transmission data 60 by attaching header data 58 to the raw data 57. The transmission data 60 is transmitted from the ultrasound diagnostic device 10 to the image processing device 12.

[0065] 5, the transmission data 60 is stored in the main memory 42 of the image processing device 12. A storage area 42a for raw data is shown in FIG.

[0066] The flow of processing by the ultrasound diagnostic system will be described below with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of processing by the ultrasound diagnostic system.

[0067] First, user authentication is performed by the image processing device 12 (S01). For example, user authentication is performed using personal information such as a password, face, or fingerprint that is registered in advance in the image processing device 12. If authentication is successful, the processes from step S02 onwards are executed. If authentication is unsuccessful, the processes from step S02 onwards are not executed. Note that user authentication does not have to be performed. In this case, the process from step S02 onwards is executed without executing the process from step S01. The processes from step S02 onwards will be described below.

[0068] For example, an instruction screen is displayed on the display of the image processing device 12. When a user requests access to the ultrasound diagnostic device 10 on the instruction screen (S02), the image processing device 12 instructs the ultrasound diagnostic device 10 to access the ultrasound diagnostic device 10 (S03).

[0069] When the ultrasound diagnostic device 10 receives the access instruction, it permits access to the ultrasound diagnostic device 10 (S04) and transmits a response corresponding to the instruction to the image processing device 12 (S05). The ultrasound diagnostic device 10 may determine whether to permit access using personal information of the user (for example, personal information input to the image processing device 12).

[0070] When the image processing device 12 receives the response from the ultrasound diagnostic device 10, the image processing device 12 requests the ultrasound diagnostic device 10 to transmit the raw data (S06). The image processing device 12 instructs the ultrasound diagnostic device 10 to transmit the raw data (S07).

[0071] When the ultrasonic diagnostic device 10 receives an instruction to transmit the Raw data, the ultrasonic diagnostic device 10 transmits transmission data including the Raw data and header data to the image processing device 12 (S08). For example, the ultrasonic diagnostic device 10 transmits the transmission data to the image processing device 12 by including the Raw data currently acquired by the ultrasonic diagnostic device 10 in the transmission data. The transmission data is transmitted to the image processing device 12 as a response to the instruction to transmit the Raw data (S09). As a result, the transmission data including the Raw data is transmitted in real time from the ultrasonic diagnostic device 10 to the image processing device 12. The Raw data is stored in the main memory 42 of the image processing device 12. The image processing device 12 also generates an ultrasonic image by executing image processing on the Raw data. The ultrasonic image is displayed on the display of the image processing device 12.

[0072] Thereafter, when the user requests the image processing device 12 to stop transmitting the raw data (S10), the image processing device 12 instructs the ultrasound diagnostic device 10 to stop transmitting the raw data (S11).

[0073] When the ultrasound diagnostic device 10 receives the instruction to stop transmission, it stops transmitting the transmission data (S12). As a result, the transmission data is not transmitted from the ultrasound diagnostic device 10 to the image processing device 12. A transmission stop response is transmitted from the ultrasound diagnostic device 10 to the image processing device 12 (S13).

[0074] Hereinafter, the processing by the processor 52 of the image processing device 12 will be described with reference to FIG.

[0075] When the transmission data is transmitted from the ultrasound diagnostic apparatus 10 to the image processing device 12, the raw data and header data are stored in a storage area 42b of the main memory 42. An image processing command is stored in a storage area 42c of the main memory 42. For example, the image processing command is input to the image processing device 12 via the input unit 50 and stored in the main memory 42, or is input to the image processing device 12 via the communication unit 38 and stored in the main memory 42.

[0076] For example, the processor 52 includes a bus interface, a cache memory, a control unit, and an arithmetic unit. The control unit includes a fetcher and a decoder. The arithmetic unit includes an ALU (Arithmetic Logic Unit) and a register.

[0077] The instructions stored in the memory area 42c are output to the fetch via the system bus, the bus interface, and the cache memory, and are converted into control information by the decoder. The control information is output to the ALU. The raw data stored in the memory area 42b is output to the register via the system bus, the bus interface, and the cache memory, and is output from the register to the ALU. The ALU performs an operation on the raw data based on the control information. The ALU outputs the result data generated by the operation to the main memory 42 via the register, the cache memory, the bus interface, and the system bus. The result data is stored in the memory area 42d of the main memory 42. For example, the result data is ultrasound image data.

[0078] In this embodiment, the image processing unit 20 of the ultrasound diagnostic device 10 generates a first ultrasound image by applying a first image processing to the raw data. The display control unit 30 displays the first ultrasound image on the display unit 24. Transmission data including the raw data and header data is transmitted from the ultrasound diagnostic device 10 to the image processing device 12 via the communication path N. The processor 52 of the image processing device 12 generates a second ultrasound image different from the first ultrasound image by applying a second image processing different from the first image processing to the raw data. The processor 52 displays the second ultrasound image on the display of the output unit 48. Since the raw data is transmitted from the ultrasound diagnostic device 10 to the image processing device 12 via the communication path N including a high-speed communication path, the second ultrasound image can be displayed on the display of the image processing device 12 in real time or almost in real time. In other words, compared to a case where a high-speed communication path is not used, the time from when the raw data is acquired by the ultrasound diagnostic device 10 to when the second ultrasound image is displayed on the display of the image processing device 12 is shorter. As a result, the second ultrasound image can be displayed on the display of the image processing device 12 in real time or almost in real time.

[0079] A specific example of image processing executed by the processor 52 will be described below with reference to Fig. 8. In Fig. 8, solid lines indicate the flow of signal data (for example, raw data, etc.), and dashed lines indicate the flow of control data.

[0080] When the transmission data is transmitted from the ultrasound diagnostic device 10 to the image processing device 12, the communication unit 38 receives the transmission data. The reception unit 40 receives the transmission data from the communication unit 38 and stores the raw data and header data in the main memory 42. If the raw data is compressed, the reception unit 40 unpacks (decompresses) the compressed data. The reception unit 40 may convert the format of the raw data.

[0081] 8 is information transmitted from the ultrasound diagnostic apparatus 10 to the image processing apparatus 12. The input information (transferred) may be included in the header data, or may be transmitted from the ultrasound diagnostic apparatus 10 to the image processing apparatus 12 separately from the header data. The input information (transferred) is received by the communication unit 38 and stored in the main memory 42 by the reception unit 40. For example, the input information (transferred) includes information indicating the first image processing executed on the raw data by the ultrasound diagnostic apparatus 10, patient information, etc.

[0082] Further, input information is stored in the main memory 42. For example, the input information includes information indicating the second image processing. The input information is input from the input unit 50 of the image processing device 12 to the image processing device 12 via the IO device 46, and stored in the main memory 42. The input information may be received by the communication unit 38 and input to the image processing device 12.

[0083] For example, the processor 52 performs signal processing for 3DUS / 2DUS, 2D image processing, cubic / volume rendering, image reconstruction processing, 4D heart function analysis (or measurement processing), analysis / measurement, and image composition processing on the raw data. Note that these processes are merely examples, and only some of these processes may be performed. For example, 4D heart function analysis, etc. may not be performed.

[0084] The processor 52 reads the raw data from the main memory 42 and applies the signal processing indicated by the signal processing information to the raw data (Signal Processing for 3DUS / 2DUS). As a result, post signal processing data is generated and stored in the main memory 42.

[0085] The processor 52 reads the post signal processing data, image information, and image processing information from the main memory 42, and applies two-dimensional image processing to the post signal processing data (2D image processing), generating post 2D image processing data, which is stored in the main memory 42. The image information includes geometric information and three-dimensional structure information.

[0086] When the processor 52 reads post signal processing data, image information and image processing information from the main memory 42 and applies 3D rendering processing to the post signal processing data (Cubic / Volume Rendering), Post Cubic / Volume Rendering data is generated and stored in the main memory 42.

[0087] When the processor 52 reads the post 2D image processing data, the post cubic / volume rendering data, and the image reconstruction information from the main memory 42 and performs the reconstruction processing (Image Reconstruction Processing), post image reconstruction data is generated and stored in the main memory 42.

[0088] When the processor 52 reads the Post 2D image processing data, Post Cubic / Volume Rendering data, Post Image Reconstruction data, and analysis / measurement information from the main memory 42 and executes the analysis processing (4D Heart function Analysis (or Measurement Processing)), Post Analysis / Measurement data is generated and stored in the main memory 42.

[0089] When the processor 52 reads the post 2D image processing data, the post cubic / volume rendering data, the post image reconstruction data, the post analysis / measurement data, the patient information, and the display layout information from the main memory 42 and executes composition processing (image composition processing), display image data is generated and stored in the main memory 42. The display image data is output to the output unit 48 via the IO device 46 and displayed on the display of the output unit 48. The data to be composed may be selected by the user, and the data selected by the user may be composed.

[0090] For example, when information included in the input information (transferred) is used as signal processing information, image information, image processing information, image destination configuration information, analysis and measurement information, patient information, and display layout information, a first ultrasonic image is generated and displayed on the ultrasonic diagnostic device 10. For example, the first ultrasonic image is displayed on the display of the output unit 48.

[0091] A second ultrasound image is generated by using the information included in the input information input via the IO device 46 as the signal processing information, image information, image processing information, image destination configuration information, analysis and measurement information, patient information, and display layout information. For example, the second ultrasound image is displayed on the display of the output unit 48.

[0092] The process shown in FIG. 8 is merely an example, and the process to be executed may be changed depending on, for example, the diagnostic region, analysis, measurement, patient or department, etc.

[0093] Specific examples of the first ultrasonic image and the second ultrasonic image will be described below.

[0094] The first ultrasonic image will be described with reference to Fig. 9. Fig. 9 shows the first ultrasonic image. As an example, an ultrasonic examination is being performed on the circulatory system.

[0095] The ultrasound images 62, 64, 66, and 68 are each a first ultrasound image, and are displayed on the display unit 24 of the ultrasound diagnostic device 10. The ultrasound images 62, 64, 66, and 68 are images constituting a CV3D image representing the blood vessels of the heart. CV stands for Cardiovascular. A 3D image is a three-dimensional ultrasound image, and is an image that represents tissues three-dimensionally. For example, the ultrasound images 62, 64, 66, and 68 are images representing the ventricles, atria, valves, etc.

[0096] For example, a 2D array probe including a 2D array transducer is used as the ultrasound probe 14. The ultrasound diagnostic device 10 acquires 4D data representing the heart by scanning a three-dimensional space including the heart with ultrasound using the 2D array probe. The 4D data is an example of raw data, and is data that represents the movement of tissue in three-dimensional space in a time series. In other words, the 4D data is data that represents the state of three-dimensional tissue movement.

[0097] The image processing unit 20 of the ultrasound diagnostic device 10 applies a first image processing (e.g., image processing for generating a CV3D image) to the 4D data to generate ultrasound images 62, 64, 66, and 68 that dynamically represent the heart (e.g., the ventricles, atria, and valves). The display control unit 30 causes the ultrasound images 62, 64, 66, and 68 to be displayed on the display unit 24. A user (e.g., a medical technician) of the ultrasound diagnostic device 10 can observe and diagnose the movement of the heart by referring to the ultrasound images 62, 64, 66, and 68. For example, the ultrasound images 62, 64, 66, and 68 are displayed on the display unit 24 in real time.

[0098] The ultrasound diagnostic device 10 may acquire flow data representing blood flow. In this case, a 4D image representing the blood flow is generated by the image processing unit 20 and displayed on the display unit 24. The 4D image is an image representing the state in which a three-dimensional tissue is moving. In other words, the 4D image can be said to be a three-dimensional moving image.

[0099] The 4D data is attached with header data as raw data and is transmitted from the ultrasound diagnostic apparatus 10 to the image processing device 12 via the communication path N. The image processing unit 54 of the image processing device 12 generates a second ultrasound image by applying second image processing to the 4D data. The display control unit 56 causes the second ultrasound image to be displayed on the display of the output unit 48. Furthermore, information indicating the first image processing is transmitted from the ultrasound diagnostic apparatus 10 to the image processing device 12 via the communication path N. The information indicating the first image processing may be included in the header data and transmitted from the ultrasound diagnostic apparatus 10 to the image processing device 12, or may be transmitted from the ultrasound diagnostic apparatus 10 to the image processing device 12 as data separate from the header data.

[0100] The second ultrasound image will be described with reference to Fig. 10. Fig. 10 shows the second ultrasound image.

[0101] The screen 70 is displayed on the display of the output unit 48 of the image processing device 12. The ultrasound image 72 is a second ultrasound image and is displayed on the screen 70. The image processing unit 54 generates the ultrasound image 72 by applying a second image processing to the above-mentioned 4D data. The second image processing is different from the first image processing. The ultrasound image 72 is a different ultrasound image from the ultrasound images 62, 64, 66, and 68 displayed on the display of the ultrasound diagnostic device 10. The ultrasound image 72 is an example of a CV4D image (i.e., an image showing a state in which a three-dimensional tissue is moving). For example, the image processing unit 54 generates the ultrasound image 72 by applying image processing for cardiac function analysis to the 4D data. The display control unit 56 displays the ultrasound image 72 on the screen 70. For example, when a user (e.g., a doctor, etc.) of the image processing device 12 instructs execution of cardiac function analysis, the image processing unit 54 generates the ultrasound image 72 by applying image processing for cardiac function analysis to the 4D data.

[0102] In the example shown in FIG. 10, an ultrasound image group 74 is displayed on the screen 70. The ultrasound image group 74 includes a plurality of first ultrasound images. For example, the ultrasound image group 74 includes the above-mentioned ultrasound images 62, 64, 66, 68. As described above, information indicating the first image processing for generating the ultrasound images 62, 64, 66, 68 is transmitted from the ultrasound diagnostic device 10 to the image processing device 12. The image processing unit 54 generates the ultrasound images 62, 64, 66, 68 by applying the first image processing to the above-mentioned 4D data. This allows the ultrasound images 62, 64, 66, 68 displayed on the display of the ultrasound diagnostic device 10 to be reproduced by the image processing device 12. In other words, even if the ultrasound images 62, 64, 66, 68 themselves are not transmitted from the ultrasound diagnostic device 10 to the image processing device 12, the ultrasound images 62, 64, 66, 68 can be reproduced by the image processing device 12 by transmitting the raw data and information indicating the first image processing from the ultrasound diagnostic device 10 to the image processing device 12. The display controller 56 displays a group of ultrasound images 74 including the ultrasound images 62 , 64 , 66 , and 68 on the screen 70 .

[0103] For example, information indicating the first image processing is included in the header data and transmitted from the ultrasound diagnostic device 10 to the image processing device 12. The image processing unit 54 applies the first image processing to the above-mentioned 4D data in accordance with the information indicating the first image processing included in the header data, thereby generating ultrasound images 62, 64, 66, and 68. The display control unit 56 displays the ultrasound images 62, 64, 66, and 68 on the screen 70. Note that the ultrasound images 62, 64, 66, and 68 can be considered as examples of images equivalent to a fourth ultrasound image.

[0104] For example, the display control unit 56 displays the ultrasound image 72 and the ultrasound image group 74 side by side on the screen 70. In the example shown in FIG. 10, the display control unit 56 displays the ultrasound image 72 and the ultrasound image group 74 on the screen 70 by making the display size of the ultrasound image group 74 smaller than that of the ultrasound image 72. This display example is merely an example, and the display control unit 56 may display the ultrasound image 72 and the ultrasound image group 74 on the screen 70 by making the display size of the ultrasound image 72 the same as that of the ultrasound image group 74. Of course, the display control unit 56 may display the ultrasound image 72 and the ultrasound image group 74 on the screen 70 by making the display size of the ultrasound image group 74 larger than that of the ultrasound image 72. Also, a user (e.g., a doctor, etc.) of the image processing device 12 may specify the display sizes of the ultrasound image 72 and the ultrasound image group 74, respectively, and the display control unit 56 may display the ultrasound image 72 and the ultrasound image group 74 on the screen 70 at the display sizes specified by the user.

[0105] Since a high-speed communication path is used as the communication path N, the ultrasound image 72 is displayed on the screen 70 in real time. For example, the ultrasound image 72 is displayed on the display of the image processing device 12 at the same or almost the same timing as the ultrasound images 62, 64, 66, and 68 are displayed on the display of the ultrasound diagnostic device 10. This allows a user (e.g., a doctor, etc.) of the image processing device 12 to observe the second ultrasound image generated based on the raw data in real time even if he or she is not near the ultrasound diagnostic device 10. In addition, the user of the image processing device 12 can observe the first ultrasound image in real time even if he or she is not near the ultrasound diagnostic device 10. For example, the user of the image processing device 12 can observe the first ultrasound image and the second ultrasound image in real time at a location (e.g., a remote location) away from the ultrasound diagnostic device 10 to perform a diagnosis, etc.

[0106] 10, by displaying the first ultrasonic image and the second ultrasonic image side by side, the user of the image processing device 12 can compare the first ultrasonic image and the second ultrasonic image in real time. For example, a CV3D image displayed on the display of the ultrasonic diagnostic device 10 and a CV4D image different from the CV3D image are displayed side by side on the screen 70. In this way, the user can compare the CV3D image and the CV4D image displayed on the display of the ultrasonic diagnostic device 10 in real time.

[0107] The ultrasound image 72 is merely an example of the second ultrasound image, and a second ultrasound image other than the ultrasound image 72 may be generated and displayed. For example, the image processing unit 54 may generate, as the second ultrasound image, a three-dimensional ultrasound image that stereoscopically represents a stationary tissue, a two-dimensional ultrasound image (i.e., a cross-sectional image) that two-dimensionally represents a stationary tissue, or a two-dimensional ultrasound image that represents a state in which the tissue is moving. The display control unit 56 displays the second ultrasound image generated by the image processing unit 54 on the screen 70. For example, when the user of the image processing device 12 specifies the second image processing, the image processing unit 54 generates the second ultrasound image by applying the second image processing specified by the user to the raw data.

[0108] For example, when a user of the image processing device 12 specifies a cross section or angle that the user wants to see using the input unit 50, the image processing unit 54 generates a second ultrasound image that represents the specified cross section, or generates a second ultrasound image of the tissue viewed from the specified angle. These second ultrasound images are displayed on the display of the output unit 48. This allows the user to observe the second ultrasound image that represents the cross section that the user wants to see, or observe the tissue from the angle that the user wants to see.

[0109] When a user specifies a cross section suitable for measurement, a second ultrasound image representing the specified cross section is generated, and measurement is performed on the second ultrasound image. In this way, the user can measure the cross section he or she wants to measure in real time at a remote location.

[0110] The display control unit 56 may cause the second ultrasound image to be displayed on the display of the output unit 48 according to the designated display mode. The display control unit 56 may cause mode identification information for identifying the display mode to be displayed on the display of the output unit 48. For example, the display mode is a LIVE mode, a CINE mode, or a LIVE OFF mode.

[0111] The LIVE mode is a mode in which a second ultrasound image generated by applying the second image processing to the raw data while receiving the raw data from the ultrasound diagnostic device 10 is displayed. The LIVE mode corresponds to an example of the first mode. For example, the LIVE mode is a mode in which the second image processing is applied in real time to the raw data acquired by the ultrasound diagnostic device 10, and the second ultrasound image generated by the application of the second image processing is displayed in real time. When the raw data is transmitted in real time from the ultrasound diagnostic device 10 to the image processing device 12 via the communication path N, the image processing unit 54 generates a second ultrasound image by applying the second image processing to the raw data. The display control unit 56 causes the second ultrasound image to be displayed on the display of the output unit 48. As a result, the second ultrasound image is displayed in real time. For example, the second ultrasound image as a moving image is displayed in real time.

[0112] The CINE mode is a mode in which a second ultrasound image generated by receiving raw data and applying a second image processing to the raw data stored in the main memory 42 is displayed. The CINE mode corresponds to an example of the second mode. For example, when a user of the image processing device 12 designates raw data stored in the main memory 42 and instructs application of the second image processing, the image processing unit 54 reads the raw data designated by the user from the main memory 42 and applies the second image processing to the raw data to generate a second ultrasound image. The display control unit 56 causes the second ultrasound image to be displayed on the display of the output unit 48. The second ultrasound image displayed according to the CINE mode is not necessarily an image displayed in real time. For example, a mode in which a recorded second ultrasound image is displayed is the CINE mode.

[0113] The LIVE OFF mode is a mode in which the second ultrasound image is displayed in a stationary state. The LIVE OFF mode corresponds to an example of the third mode. For example, when the display mode is the LIVE mode and the LIVE OFF mode is specified by the user, the display control unit 56 causes the second ultrasound image that was displayed during the LIVE mode to be displayed in a stationary state on the display of the output unit 48.

[0114] For example, when a user of the image processing device 12 specifies a display mode, the display control unit 56 causes the second ultrasound image to be displayed on the display of the output unit 48 in accordance with the display mode specified by the user.

[0115] The display mode may be specified in advance. For example, a display mode may be specified in advance for each diagnostic region, for each type of analysis, or for each type of image. The display control unit 56 displays the second ultrasound image on the display of the output unit 48 according to the display mode specified in advance. Even in this case, when the user specifies the display mode, the display control unit 56 may display the second ultrasound image on the display of the output unit 48 according to the display mode specified by the user.

[0116] The mode identifying information is, for example, an image or a character string that indicates the display mode, etc. An indicator 76 shown in Fig. 10 is an example of the mode identifying information.

[0117] The indicator 76 includes an image and a character string. The display control unit 56 changes at least one of the color, shape, and size of the image included in the indicator 76 according to the display mode, and displays the indicator 76 on the screen 70. For example, the color of the image representing the LIVE mode is red, the color of the image representing the CINE mode is blue, and the color of the image representing the LIVE OFF mode is green.

[0118] 10, the ultrasound image 72 is displayed in the LIVE mode. Therefore, the color of the image included in the indicator 76 is red. Also, the character string "LIVE" is displayed on the screen 70.

[0119] A user of the image processing device 12 may specify a display mode for the first ultrasonic image. In this case, the display control unit 56 causes the first ultrasonic image to be displayed on the display of the output unit 48 according to the display mode specified by the user. For example, in the example shown in Fig. 10, when the LIVE mode is specified as the display mode for the first ultrasonic image, the display control unit 56 displays the ultrasound image group 74 on the screen 70 according to the LIVE mode.

[0120] Another second ultrasound image is shown in Fig. 11. Ultrasound images 78, 80, 82, and 84 are second ultrasound images and are displayed on the screen 70. The image processing unit 54 generates the ultrasound images 78, 80, 82, and 84 by applying second image processing to the above 4D data. The ultrasound images 78, 80, 82, and 84 are different from the ultrasound images 62, 64, 66, and 68 displayed on the display of the ultrasound diagnostic device 10.

[0121] Ultrasound images 78, 80, 82, and 84 are examples of CV4D images. For example, ultrasound image 78 includes a 16-segment bullseye chart of the left ventricle and an image representing the myocardium. Ultrasound image 80 is an image representing the aortic valve and the mitral valve (e.g., an image generated by volume rendering). Ultrasound image 82 includes an image representing the surface of a right ventricular cavity model (e.g., an image generated by surface rendering) and a volume curve. Ultrasound image 84 is an image representing the surface of a mitral valve model (e.g., an image generated by surface rendering).

[0122] Ultrasound images 78, 80, and 84 are displayed in accordance with the LIVE OFF mode, and ultrasound image 82 is displayed in accordance with the LIVE mode.

[0123] Indicator 86 is mode identification information for the display mode of ultrasound image 78 and is displayed around ultrasound image 78. Indicator 88 is mode identification information for the display mode of ultrasound image 80 and is displayed around ultrasound image 80. Indicator 90 is mode identification information for the display mode of ultrasound image 82 and is displayed around ultrasound image 82. Indicator 92 is mode identification information for the display mode of ultrasound image 84 and is displayed around ultrasound image 84.

[0124] For example, when a user of the image processing device 12 specifies a display mode for each second ultrasound image, the display control unit 56 displays each second ultrasound image on the screen 70 according to the display mode of each second ultrasound image. Of course, the display control unit 56 may display all second ultrasound images on the screen 70 according to the same display mode.

[0125] The ultrasound images 78, 80, and 84 are images generated based on the same 4D data. In this embodiment, when a plurality of ultrasound images are generated based on the same 4D data, each ultrasound image can be displayed by making the modes of the individual ultrasound images the same or different. Here, as an example, the ultrasound image 82 is displayed according to the LIVE mode, but an ultrasound image other than the ultrasound image 82 (e.g., the ultrasound image 78) may be displayed according to the LIVE mode and the ultrasound image 82 may be displayed according to the LIVE OFF mode according to a user's instruction. In this way, the mode of each ultrasound image generated based on the same 4D data can be individually switched. In addition, the user can determine whether the display mode is not only the LIVE mode but also the CINE mode by the indicator.

[0126] Another display example of the second ultrasound image is shown in Fig. 12. Ultrasound images 82 and 84 are second ultrasound images and are displayed on the screen 70. The ultrasound images 82 and 84 shown in Fig. 12 are the same as the ultrasound images 82 and 84 shown in Fig. 11.

[0127] The indicator 94 is mode identification information for the display mode of the ultrasound image 82, and is displayed around the ultrasound image 82. The indicator 96 is mode identification information for the display mode of the ultrasound image 84, and is displayed around the ultrasound image 84.

[0128] 12, an ultrasound image 82 is displayed in accordance with the LIVE mode, and an ultrasound image 84 is displayed in accordance with the CINE mode.

[0129] For example, a user of the image processing device 12 can change the display mode according to the purpose of diagnosis or examination, and perform diagnosis or examination by observing the second ultrasound image displayed according to the display mode according to the purpose.

[0130] An application example of this embodiment will be described below with reference to Fig. 13. Fig. 13 is a diagram for explaining the application example.

[0131] For example, the ultrasound diagnostic device 10 is used for obstetric examinations. The first image processing and the second image processing are image processing related to the obstetric examinations. In other words, the first image processing and the second image processing are image processing suitable for the obstetric examinations and image processing for generating ultrasound images used for the obstetric examinations.

[0132] For example, in obstetrics, not only doctors but also third parties such as the family of the subject (patient) have a desire to view ultrasound images. For example, if a third party can go to the place where the subject is photographed by the ultrasound diagnostic device 10, the third party can view the first ultrasound image displayed on the display of the ultrasound diagnostic device 10, and the third party's desire can be satisfied.

[0133] However, there are cases where a third party wants to view the ultrasound image of the subject at a remote location, as it is not always possible for the third party to go to the location where the subject is imaged by the ultrasound diagnostic device 10. In such a case, by executing the process according to the present embodiment, the third party can view the second ultrasound image at a remote location without going to the location.

[0134] Furthermore, the ultrasound image that the third party wants to see is not necessarily the same as the ultrasound image required for the examination using the ultrasound diagnostic device 10. In this case, the processing according to the present embodiment is executed to generate and display a second ultrasound image that the third party wants, thereby satisfying the third party's request.

[0135] In the example shown in FIG. 13, a medical technician A operates an ultrasound diagnostic device 10 in an obstetrics department to obtain raw data (e.g., 4D data). The ultrasound diagnostic device 10 applies a first image processing to the raw data to generate a first ultrasound image 98. The first ultrasound image 98 is an ultrasound image required for obstetric examinations and the like. The medical technician A performs an examination and the like based on the first ultrasound image 98. The raw data is transmitted from the ultrasound diagnostic device 10 to the image processing device 12 via a communication path N.

[0136] Image processing devices 12A and 12B are shown in FIG. 13. The image processing devices 12A and 12B have the same configuration as the image processing device 12. The image processing devices 12A and 12B are devices installed in different locations. For example, the image processing device 12A is used to display an ultrasound image to a doctor B. The image processing device 12B is used to display an ultrasound image to a family member C. The family member C is a family member of the subject from whom the raw data was acquired.

[0137] For example, a second ultrasound image 100 for doctor B to make a diagnosis, an examination, or the like is generated and displayed by the image processing unit 54 of the image processing device 12A. That is, the second image processing for generating the second ultrasound image 100 is executed by the image processing unit 54 of the image processing device 12A. Doctor B can make a diagnosis, an examination, or the like at a remote location by referring to the second ultrasound image 100.

[0138] For example, the second ultrasound image 102 that Family Member C wants to see is generated and displayed by the image processing unit 54 of the image processing device 12B. That is, the second image processing for generating the second ultrasound image 102 is executed by the image processing unit 54 of the image processing device 12B. For example, Family Member C can check the growth of the fetus, etc., by referring to the second ultrasound image 102 at a remote location.

[0139] Alternatively, the terminal devices 104, 106, and 108 may be used. The terminal devices 104, 106, and 108 are PCs, tablet PCs, smartphones, or mobile phones, and are devices capable of transmitting and receiving audio.

[0140] For example, technician A uses terminal device 104, and doctor B uses terminal device 106 to talk to technician A and doctor B in real time. This allows technician A and doctor B to communicate by voice while referring to their respective ultrasound images. For example, doctor B can tell technician A by voice to take images of areas necessary for diagnosis.

[0141] Similarly, Family C uses the terminal device 108 to talk in real time with Technologist A. For example, Family C can tell Technologist A by voice which image Family C wants to see.

[0142] Although obstetrics has been taken as an example in the description, the same effects can be obtained even if this embodiment is applied to medical departments other than obstetrics.

[0143] The image processing to be performed by the ultrasound diagnostic apparatus 10 may be instructed to the ultrasound diagnostic apparatus 10 from the image processing device 12. For example, the image processing device 12 includes a user interface that accepts selection of a third image processing. The third image processing is image processing to be performed by the ultrasound diagnostic apparatus 10.

[0144] The user interface is realized by the output unit 48 and the input unit 50. The display control unit 56 causes a screen for selecting the third image processing to be displayed on the display of the output unit 48. For example, a list of a plurality of different third image processing is displayed on the screen. The user can operate the input unit 50 to select the third image processing on the screen. Of course, the third image processing may be selected by voice. The cross section or diagnostic region to be displayed may be specified by the user interface.

[0145] The communication unit 38 transmits control information indicating the selection accepted by the user interface to the ultrasound diagnostic device 10 via the communication path N. That is, when the third image processing is selected by the user on the above screen, the communication unit 38 transmits control information indicating the third image processing selected by the user to the ultrasound diagnostic device 10 via the communication path N. Similarly, when the third image processing is selected by voice, the communication unit 38 transmits control information indicating the selected third image processing to the ultrasound diagnostic device 10.

[0146] The communication unit 34 of the ultrasound diagnostic device 10 receives the control information via the communication path N. The image processing unit 20 of the ultrasound diagnostic device 10 generates a third ultrasound image by applying the third image processing indicated by the control information to the raw data. The display control unit 30 of the ultrasound diagnostic device 10 causes the display unit 24 to display the third ultrasound image.

[0147] The raw data to which the third image processing is applied may be selected, for example, by a user of the image processing device 12 or by a user of the ultrasonic diagnostic device 10. For example, the image processing unit 20 applies the third image processing to the raw data stored in the storage unit 36 ​​of the ultrasonic diagnostic device 10 to generate a third ultrasonic image.

[0148] For example, on the day of the examination, a CV3D image is displayed as the first ultrasound image on the display of the ultrasound diagnostic device 10, but later, an image other than the CV3D image is generated and displayed as the third ultrasound image. This allows more detailed analysis and examination to be performed using the ultrasound diagnostic device 10 than on the day of the examination.

[0149] According to the above-described embodiment, it is possible to realize real-time diagnosis at a remote location. For example, a doctor or the like can observe and analyze ultrasound images in real time at a remote location. In addition, the doctor or the like can observe the image he or she wants to see in real time by instructing a user (e.g., a technician) of the ultrasound diagnostic device 10 on the image he or she wants to see (e.g., the part or angle he or she wants to see, etc.). This can reduce the frequency of re-examinations using the ultrasound diagnostic device 10. As a result, it is possible to reduce the burden on the doctor, technician, and subject.

[0150] Furthermore, if the image processing device 12 has a higher performance image processing function than the ultrasound diagnostic device 10, the image processing device 12 can realize in real time image processing that cannot be realized by the ultrasound diagnostic device 10. For example, even if the ultrasound diagnostic device 10 does not have a function to realize 4D image processing for the circulatory system, if the image processing device 12 has the function, the image processing device 12 can execute 4D image processing for the circulatory system in real time. The same can be said about 4D image processing for obstetrics. For example, even if the ultrasound diagnostic device 10 is a portable ultrasound diagnostic device and does not have a high-performance function, the image processing device 12 can realize a high-performance function. Furthermore, images with different angles can be confirmed at a remote location.

[0151] Furthermore, the ultrasound diagnostic system according to this embodiment may be used for the education and training of medical technicians, doctors, etc. For example, a skilled technician operates the ultrasound diagnostic device 10 to obtain raw data, and a second ultrasound image based on the raw data is displayed on the display of the image processing device 12. A person receiving training can receive an explanation from the skilled technician while observing the second ultrasound image displayed on the display of the image processing device 12 in real time.

[0152] In this embodiment, the data of the first ultrasonic image itself may be transmitted from the ultrasonic diagnostic apparatus 10 to the image processing device 12 via the communication path, and the first ultrasonic image may be displayed on the display of the image processing device 12.

[0153] The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 can be realized by using hardware resources such as a processor or an electronic circuit. In the realization, a device such as a memory may be used as necessary. The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be realized by a computer, for example. That is, the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be realized in whole or in part by cooperation between hardware resources such as a central processing unit (CPU) and memory provided in a computer and software (program) that specifies the operation of the CPU, etc. The program is stored in the storage unit 36 ​​of the ultrasound diagnostic device 10 or another storage device via a recording medium such as a CD or a DVD, or via a communication path such as a network. As another example, the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be realized by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like. A GPU (Graphics Processing Unit) or the like may be used. The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be realized by a single device. Each function of the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be realized by one or more devices.

[0154] The reception unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 can be realized by using hardware resources such as a processor and an electronic circuit. In the realization, a device such as a memory may be used as necessary. The reception unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 may be realized by, for example, a computer. That is, the reception unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 may be realized in whole or in part by cooperation between a hardware resource such as a CPU (Central Processing Unit) and a memory provided in a computer and software (program) that defines the operation of the CPU, etc. The program is stored in the main memory 42 of the image processing device 12 or another storage device via a recording medium such as a CD or a DVD, or via a communication path such as a network. As another example, the reception unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 may be realized by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like. A GPU (Graphics Processing Unit) or the like may be used. The reception unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 may be realized by a single device. Each function of the reception unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 may be realized by one or more devices. [Explanation of symbols]

[0155] 10 Ultrasound diagnostic device, 12 Image processing device, 20, 54 Image processing unit, 30, 56 Display control unit.

Claims

1. In an ultrasound diagnostic system including an ultrasound diagnostic device and an image processing device, The ultrasonic diagnostic apparatus includes: An acquisition unit that acquires raw data by transmitting and receiving ultrasonic waves; a first image processing unit that generates a first ultrasound image by applying a first image processing to the raw data; a first display control unit that causes the first ultrasonic image generated by the first image processing unit to be displayed on a first display of the ultrasonic diagnostic apparatus; a first transmission unit that transmits the raw data to which the first image processing has not been applied by the first image processing unit to the image processing device via a high-speed communication path; Including, The image processing device includes: a second receiving unit that receives the Raw data transmitted by the first transmitting unit via a high-speed communication path; a second image processing unit that applies a second image processing different from the first image processing to the Raw data received by the second receiving unit to generate a second ultrasonic image different from the first ultrasonic image displayed on the first display of the ultrasonic diagnostic device; a second display control unit that causes the second ultrasonic image generated by the second image processing unit to be displayed on a second display of the image processing device; Including, 1. An ultrasound diagnostic system comprising:

2. 2. The ultrasound diagnostic system according to claim 1, The second image processing unit generates a three-dimensional ultrasound image as the second ultrasound image based on the Raw data.

1. An ultrasound diagnostic system comprising:

3. 2. The ultrasound diagnostic system according to claim 1, The image processing device further comprises: a user interface for receiving a selection of a second image processing; The second image processing unit generates the second ultrasound image by applying the second image processing to the Raw data in accordance with a selection accepted by the user interface; The second display control unit causes the second ultrasonic image to be displayed on the second display.

1. An ultrasound diagnostic system comprising:

4. 2. The ultrasound diagnostic system according to claim 1, The image processing device further comprises: a user interface that accepts selection of a second image processing; a second transmission unit that transmits control information indicating the selection accepted by the user interface to the ultrasound diagnostic device via a high-speed communication path; Including, The ultrasonic diagnostic apparatus further comprises: a first receiving unit that receives the control information transmitted by the second transmitting unit via a high-speed communication path; the first image processing unit applies the second image processing indicated by the control information received by the first receiving unit to the Raw data to generate a third ultrasound image; The first display control unit causes the third ultrasound image to be displayed on the first display.

1. An ultrasound diagnostic system comprising:

5. 2. The ultrasound diagnostic system according to claim 1, The image processing device further comprises: a user interface that accepts a selection of a third image processing; a second transmission unit that transmits control information indicating the selection accepted by the user interface to the ultrasound diagnostic device via a high-speed communication path; Including, The ultrasonic diagnostic apparatus further comprises: a first receiving unit that receives the control information transmitted by the second transmitting unit via a high-speed communication path; the first image processing unit generates a third ultrasound image by applying the third image processing indicated by the control information received by the first receiving unit to the Raw data; The first display control unit causes the third ultrasound image to be displayed on the first display.

1. An ultrasound diagnostic system comprising:

6. 2. The ultrasound diagnostic system according to claim 1, The first transmission unit transmits information indicating the first image processing to the image processing device via a high-speed communication path; The second receiving unit receives information indicating the first image processing transmitted by the first transmitting unit via a high-speed communication path, The second image processing unit generates the second ultrasound image by applying the second image processing to the Raw data, and generates the first ultrasound image by applying the first image processing to the Raw data in accordance with information indicated by the first image processing; The second display control unit causes the second display to display the second ultrasound image and the first ultrasound image side by side.

1. An ultrasound diagnostic system comprising:

7. 2. The ultrasound diagnostic system according to claim 1, the first transmission unit links header data including information indicating the first image processing to the Raw data and transmits the header data to the image processing device via a high-speed communication path; The second receiving unit receives the Raw data and the header data transmitted by the first transmitting unit via a high-speed communication path, The second image processing unit generates a fourth ultrasound image by applying the first image processing to the Raw data in accordance with information indicating the first image processing included in the header data; The second display control unit causes the second display to display the fourth ultrasound image.

1. An ultrasound diagnostic system comprising:

8. 2. The ultrasound diagnostic system according to claim 1, The second display control unit causes the second display to display the second ultrasound image in accordance with a designated display mode, and causes the second display to display mode identification information for identifying the display mode.

1. An ultrasound diagnostic system comprising:

9. 9. The ultrasound diagnostic system according to claim 8, The display mode is any one of a first mode in which the second ultrasound image generated by applying the second image processing to the Raw data while receiving the Raw data is displayed, a second mode in which the second ultrasound image generated by receiving the Raw data and applying the second image processing to the Raw data stored in a memory is displayed, and a third mode in which the second ultrasound image is displayed in a stationary state.

1. An ultrasound diagnostic system comprising:

10. 2. The ultrasound diagnostic system according to claim 1, The ultrasonic diagnostic apparatus is used for a circulatory system examination, The first image processing and the second image processing are image processing related to a circulatory system examination.

1. An ultrasound diagnostic system comprising:

11. 2. The ultrasound diagnostic system according to claim 1, The ultrasound diagnostic apparatus is used for obstetric examinations, The first image processing and the second image processing are image processing related to obstetric examination.

1. An ultrasound diagnostic system comprising:

12. a second receiving unit that receives raw data from an ultrasonic diagnostic device that acquires raw data by transmitting and receiving ultrasonic waves and generates a first ultrasonic image by applying a first image processing to the raw data, via a high-speed communication path; a second image processing unit that applies a second image processing different from the first image processing to the Raw data received by the second receiving unit to generate a second ultrasonic image different from the first ultrasonic image; a second display control unit that causes a display to display the second ultrasound image generated by the second image processing unit; 13. An image processing device comprising:

Images