Ultrasonic diagnostic system and image processing apparatus

Abstract

The invention provides an ultrasonic diagnostic system and an image processing apparatus. The purpose of the present invention is to provide an ultrasound image different from an ultrasound image displayed on an ultrasound diagnostic device to a person at a remote location as real-time as possible. An ultrasonic diagnostic device (10) acquires raw data by transmitting and receiving ultrasonic waves, and generates a first ultrasonic image by applying first image processing to the raw data. This Raw data is transmitted from the ultrasonic diagnostic apparatus (10) to the image processing apparatus (12) via a communication path N including a high-speed communication path. The image processing device (12) generates a second ultrasonic image by applying second image processing different from the first image processing to the Raw data. The second ultrasonic image is displayed on a display of an image processing device (12).

Description

Technical Field

[0001] The invention relates to an ultrasonic diagnosis system and an image processing device. Background Art

[0002] Generally, an ultrasonic diagnostic apparatus acquires Raw data (for example, data not subjected to processing for generating an ultrasonic image for display) by transmitting and receiving ultrasonic waves, generates an ultrasonic image by applying image processing to the Raw data, and displays the ultrasonic image on a display.

[0003] Patent Document 1 describes a device that generates an ultrasonic image based on Raw data received from an ultrasonic diagnostic device.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2009-11-2357

[0005] For example, even in the case where the ultrasound diagnostic apparatus itself can perform three-dimensional image processing (e.g., image processing for the circulatory system) in real time, the ability to perform three-dimensional image processing in real time in an external apparatus other than the ultrasound diagnostic apparatus (e.g., a medical image diagnostic system) is limited. Therefore, it is difficult to observe or analyze ultrasound images generated by the ultrasound diagnostic apparatus in real time at a remote location.

[0006] Furthermore, people who observe or analyze the ultrasonic images displayed on the external device (e.g., doctors or family members of the subject, etc.) do not necessarily want to observe or analyze the ultrasonic images displayed on the ultrasonic diagnostic device. Therefore, simply sending the ultrasonic images displayed on the ultrasonic diagnostic device to the external device and displaying them on the external device cannot satisfy the needs of such people. Summary of the invention

[0007] An object of the present invention is to provide an ultrasonic image different from an ultrasonic image displayed on an ultrasonic diagnostic apparatus to a person at a remote location as real time as possible.

[0008] One embodiment of the present invention is an ultrasonic diagnostic system, characterized in that the ultrasonic diagnostic system includes an ultrasonic diagnostic device and an image processing device, wherein the ultrasonic diagnostic device includes: an acquisition unit that acquires Raw data by transmitting and receiving ultrasonic waves; a first image processing unit that generates a first ultrasonic image by applying a first image processing to the Raw data; a first display control unit that displays the first ultrasonic image generated by the first image processing unit on a first display of the ultrasonic diagnostic device; and a first sending unit that sends the Raw data to which the first image processing has not been applied by the first image processing unit via a first display control unit. The high-speed communication path is sent to the image processing device, and the image processing device includes: a second receiving unit that receives the Raw data sent by the first sending unit via the high-speed communication path; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image displayed on the first display of the ultrasonic diagnostic device by applying a second image processing different from the first image processing to the Raw data received by the second receiving unit; and a second display control unit that displays the second ultrasonic image generated by the second image processing unit on a second display of the image processing device.

[0009] The second image processing unit may generate a three-dimensional ultrasonic image as the second ultrasonic image based on the Raw data.

[0010] It can be as follows: the image processing device also includes a user interface for accepting a selection of a second image processing, the second image processing unit generates the second ultrasonic image by applying the second image processing to the Raw data according to the selection accepted by the user interface, and the second display control unit displays the second ultrasonic image on the second display.

[0011] It can be as follows: the image processing device also includes: a user interface, which accepts a selection of a second image processing; and a second sending unit, which sends control information representing the selection accepted by the user interface to the ultrasonic diagnostic device via a high-speed communication path, the ultrasonic diagnostic device also includes a first receiving unit, the first receiving unit receives the control information sent by the second sending unit via a high-speed communication path, the first image processing unit generates a third ultrasonic image by applying the second image processing represented by the control information received by the first receiving unit to the Raw data, and the first display control unit displays the third ultrasonic image on the first display.

[0012] It can be as follows: the image processing device also includes: a user interface, which accepts the selection of the third image processing; and a second sending unit, which sends control information representing the selection accepted by the user interface to the ultrasonic diagnostic device via a high-speed communication path, and the ultrasonic diagnostic device also includes a first receiving unit, and the first receiving unit receives the control information sent by the second sending unit via a high-speed communication path, and the first image processing unit generates a third ultrasonic image by applying the third image processing represented by the control information received by the first receiving unit to the Raw data, and the first display control unit displays the third ultrasonic image on the first display.

[0013] The process may be as follows: the first sending unit sends information indicating the first image processing to the image processing device via a high-speed communication path; the second receiving unit receives the information indicating the first image processing sent by the first sending unit via a high-speed communication path; the second image processing unit generates the second ultrasonic image by applying the second image processing to the Raw data, and generates the first ultrasonic image by applying the first image processing to the Raw data according to the information indicating the first image processing; and the second display control unit displays the second ultrasonic image and the first ultrasonic image side by side on the second display.

[0014] The process may be as follows: the first sending unit associates header data including information indicating the first image processing with the Raw data and sends the data to the image processing device via a high-speed communication path; the second receiving unit receives the Raw data and the header data sent by the first sending unit via the high-speed communication path; the second image processing unit generates a fourth ultrasonic image by applying the first image processing to the Raw data according to the information indicating the first image processing included in the header data; and the second display control unit displays the fourth ultrasonic image on the second display.

[0015] The second display control unit may display the second ultrasonic image on the second display in accordance with the designated display mode, and may display mode identification information for identifying the display mode on the second display.

[0016] The display mode may be any one of a first mode for displaying the second ultrasonic image generated by applying the second image processing to the Raw data while receiving the Raw data, a second mode for displaying the second ultrasonic image generated by applying the second image processing to the Raw data received and stored in a memory, or a third mode for displaying the second ultrasonic image in a static state.

[0017] The ultrasonic diagnostic apparatus may be used for circulator inspection, and the first image processing and the second image processing may be image processing related to circulator inspection.

[0018] The ultrasonic diagnostic apparatus may be used for obstetric examination, and the first image processing and the second image processing may be image processing related to obstetric examination.

[0019] Another embodiment of the present invention is an image processing device, characterized in that it includes: a second receiving unit that receives Raw data via a high-speed communication path from an ultrasonic diagnostic device that acquires Raw data by transmitting and receiving ultrasonic waves and generates a first ultrasonic image by applying a first image processing to the Raw data; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image by applying a second image processing different from the first image processing to the Raw data received by the second receiving unit; and a second display control unit that displays the second ultrasonic image generated by the second image processing unit on a display.

[0020] Effects of the Invention

[0021] According to the present invention, an ultrasonic image different from the ultrasonic image displayed on the ultrasonic diagnostic apparatus can be provided to a person at a remote location as real time as possible. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a diagram showing an example of the configuration of an ultrasonic diagnostic system according to an embodiment.

[0023] Figure 2 It is a diagram showing an example of the configuration of an ultrasonic diagnostic apparatus according to an embodiment.

[0024] Figure 3 It is a diagram showing an example of the structure of an image processing device involved in the embodiment.

[0025] Figure 4 This is a diagram showing an example of the structure of transmission data.

[0026] Figure 5 It is a diagram representing data and main memory.

[0027] Figure 6 This is a diagram showing an example of processing by the ultrasonic diagnostic system.

[0028] Figure 7 This is a diagram showing an example of processing by a processor of the image processing device.

[0029] Figure 8 This is a diagram showing an example of processing by a processor of the image processing device.

[0030] Fig. 9 It is a diagram showing a display example of the first ultrasonic image.

[0031] Fig.10 It is a diagram showing a display example of the second ultrasonic image.

[0032] Fig.11 It is a diagram showing a display example of the second ultrasonic image.

[0033] Fig.12 It is a diagram showing a display example of the second ultrasonic image.

[0034] Fig.13 It is a diagram for explaining an application example of the embodiment.

[0035] Explanation of symbols

[0036] 10 - ultrasonic diagnostic apparatus, 12 - image processing apparatus, 20, 54 - image processing unit, 30, 56 - display control unit. DETAILED DESCRIPTION

[0037] refer to Figure 1 , an ultrasonic diagnostic system involved in an implementation method is described. Figure 1 This is a block diagram showing the configuration of an ultrasonic diagnostic system according to an embodiment.

[0038] The ultrasonic diagnostic system includes an ultrasonic diagnostic apparatus 10 and an image processing apparatus 12. The ultrasonic diagnostic apparatus 10 and the image processing apparatus 12 have a function of communicating via a communication path N with each other.

[0039] The communication path N includes a high-speed communication path. For example, the high-speed communication path is a wireless communication path using the 6th generation mobile communication system (6G) or a wireless communication path using a next generation communication system after 6G. A communication path that can send data acquired by the ultrasonic diagnostic device 10 to the image processing device 12 in real time can be used as a high-speed communication path. The communication path N may include a network such as the Internet or a LAN (Local Area Network). A wired circuit may be used for a portion of the communication path N.

[0040] The ultrasonic diagnostic apparatus 10 generates data showing the interior of the subject by transmitting ultrasonic waves into the subject through an ultrasonic probe and receiving ultrasonic waves reflected in the subject. By applying image processing to the data, an ultrasonic image showing the internal tissue of the subject is generated.

[0041] Data generated by the ultrasonic diagnostic apparatus 10 is transmitted to the image processing apparatus 12 via the communication path N. For example, when a data transmission request is transmitted from the image processing apparatus 12 to the ultrasonic diagnostic apparatus 10, data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N in response to the request.

[0042] The image processing device 12 receives data from the ultrasonic diagnostic device 10 via the communication path N. The image processing device 12 generates an ultrasonic image by applying image processing to the data. For example, the image processing device 12 is a personal computer (hereinafter referred to as "PC"), a tablet computer, a smartphone, a server, or a mobile phone.

[0043] For example, the ultrasonic diagnostic apparatus 10 generates Raw data by transmitting and receiving ultrasonic waves. Raw data is data to which image processing for generating an ultrasonic image for display has not been applied. Raw data is sent from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. The image processing apparatus 12 generates an ultrasonic image by applying image processing to the Raw data. For example, the ultrasonic image is displayed on a display of the image processing apparatus 12.

[0044] For example, if the user of the image processing device 12 instructs to perform image processing, the image processing device 12 generates an ultrasonic image by applying the image processing instructed by the user to the Raw data. For example, the image processing device 12 performs image processing different from the image processing performed by the ultrasonic diagnostic device 10. Of course, the image processing device 12 may also perform the same image processing as the image processing performed by the ultrasonic diagnostic device 10.

[0045] Below, reference Figure 2 , the structure of the ultrasonic diagnostic apparatus 10 is described. Figure 2 It is a block diagram showing an example of the configuration of the ultrasonic diagnostic apparatus 10 .

[0046] The ultrasonic diagnostic apparatus 10 includes an ultrasonic probe 14 , a transceiver 16 , a signal processor 18 , an image processor 20 , a display processor 22 , a display 24 , an input unit 26 , a controller 28 , a display controller 30 , a converter 32 , a communication unit 34 , and a storage unit 36 ​​.

[0047] The ultrasonic probe 14 is a device for transmitting and receiving ultrasonic waves. For example, the ultrasonic probe 14 includes a 2D array transducer. The 2D array transducer is formed by arranging a plurality of ultrasonic transducers in two dimensions. An ultrasonic beam is formed by the 2D array transducer. If the ultrasonic beam is electronically scanned repeatedly, a scanning plane is formed as a two-dimensional echo data input space at each electronic scan. If the ultrasonic beam is scanned two-dimensionally, a three-dimensional space is formed as a three-dimensional echo data input space. As a scanning method, sector scanning, linear scanning, convex scanning, etc. are used.

[0048] When transmitting, the transceiver 16 supplies a plurality of transmission signals having a certain delay relationship to a plurality of ultrasonic transducers included in the ultrasonic probe 14. Thus, an ultrasonic transmission beam is formed. When receiving, the ultrasonic probe 14 receives reflected waves (RF signals) from the living body. Thus, a plurality of reception signals are output from the ultrasonic probe 14 to the transceiver 16. The transceiver 16 forms a reception beam by applying a phase adjustment and addition process to the plurality of reception signals. The data of the reception beam is output to the signal processing unit 18. That is, the transceiver 16 performs delay processing on the reception signals obtained from each ultrasonic transducer according to the delay processing conditions for each ultrasonic transducer, and forms a reception beam by adding the plurality of reception signals obtained from the plurality of ultrasonic transducers. The delay processing conditions are defined by the reception delay data indicating the delay time. The reception delay data set (i.e., the delay time set) corresponding to the plurality of ultrasonic transducers is supplied from the control unit 28. The transceiver 16 functions as a transmission beamformer and a reception beamformer. For example, the transceiver 16 includes an A / D converter, a detector, an amplifier circuit, and the like. Furthermore, the unit for transmitting and receiving ultrasonic waves and the unit for realizing a beam former may be configured as separate units.

[0049] The signal processing unit 18 applies signal processing to the beam data output from the transmission and reception unit 16 . For example, the signal processing includes detection and amplitude compression such as logarithmic compression. The data to which the signal processing is applied is output to the image processing unit 20 .

[0050] The image processing unit 20 generates an ultrasonic image by applying image processing to the data to which the signal processing is applied. For example, the image processing includes a coordinate conversion function and an interpolation processing function based on a DSC (digital scan converter). For example, the ultrasonic image is a B-mode image, a color Doppler image, a pulsed Doppler image, a strain imaging image (Strain Image) or a shear wave imaging (Shear Wave Elastog raphy Image) etc. The ultrasonic image can be a two-dimensional image or a three-dimensional image.

[0051] The display processing unit 22 generates a display image by superimposing the graphic data required for the ultrasonic image. The display image is output to the display unit 24. One or more images are displayed side by side in a display manner according to the display mode.

[0052] The display unit 24 is a display such as a liquid crystal display or an EL display. Ultrasonic images such as B-mode images are displayed on the display unit 24. The display unit 24 may also be a device that has both a display and an input unit 26. For example, a GUI (Graphic User Interface) may be implemented by the display unit 24. In addition, a user interface such as a touch panel may be implemented by the display unit 24.

[0053] The input unit 26 is a device for the user to input various information (e.g., conditions required for imaging, commands, patient information, etc.) into the ultrasonic diagnostic apparatus 10. For example, the input unit 26 is an operation panel, switch, button, keyboard, mouse, trackball, joystick, etc.

[0054] The control unit 28 controls the operation of each unit of the ultrasonic diagnostic apparatus 10 . The control unit 28 includes a display control unit 30 .

[0055] The display control unit 30 displays the ultrasonic image on the display unit 24. The display control unit 30 may display information or images other than the ultrasonic image on the display unit 24.

[0056] The converter 32 converts the Raw data into data for transmission. The Raw data is data transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. For example, the converter 32 generates the data for transmission by adding header data to the Raw data.

[0057] Raw data is data to which processing for generating an ultrasonic image for display is not applied. For example, data output from the transceiver 16 and to which signal processing by the signal processing unit 18 is not applied is Raw data. In this case, the transceiver 16 is equivalent to an example of an acquisition unit. Data to which signal processing by the signal processing unit 18 is applied can be Raw data. That is, data output from the signal processing unit 18 and to which image processing by the image processing unit 20 is not applied can be Raw data. In this case, the signal processing unit 18 is equivalent to an example of an acquisition unit.

[0058] The header data is metadata (i.e., incidental information) attached to the Raw data. For example, the header data includes an imaging mode, information related to the Raw data, scanning information, signal processing information, image processing information, measurement information, frame information, and patient information. The imaging mode is an imaging mode executed in the ultrasonic diagnostic device 10 to acquire Raw data. For example, the imaging mode is B mode (THI), M mode, PW mode, CW mode, CFI mode, CFA mode, TE mode, or SWE mode. The information related to the Raw data includes data length, number of samples, interval, size, address, and data type (rectangular coordinates IQ or polar coordinates rΘ). The scanning information includes the number of rows, interval, size, address, and type (Li n, Sec, Conv: linear scan, sector scan, convex scan), etc. The signal processing information is information indicating the signal processing of the signal processing unit 18. The signal processing information includes information related to gain or filter, etc. The image processing information is information indicating the image processing of the image processing unit 20. The image processing information includes information related to the region of interest (ROI) or the filter. The measurement information includes parameters related to the measurement performed in the ultrasonic diagnostic device 10. The frame information is information indicating the size or position of the ultrasonic image. The patient information is information indicating the ID, gender, age, etc. of the patient from which the Raw data is acquired. For example, when imaging is performed in the ultrasonic diagnostic device 10, each information included in the header data is input into the ultrasonic diagnostic device 10 by a user such as an examination technician or a doctor, or is input into the ultrasonic diagnostic device 10 from an external device such as a server. Information other than the above information may be included in the header data. The user can specify the information included in the header data.

[0059] The communication unit 34 is a communication interface. The communication unit 34 includes a first transmission unit 34a that transmits data to an external device and a first reception unit 34b that receives data. The first transmission unit 34a transmits transmission data to the image processing device 12 via the communication path N. Thus, Raw data is transmitted from the ultrasonic diagnostic device 10 to the image processing device 12. The first reception unit 34b receives information transmitted from the image processing device 12 via the communication path N. For example, as described later, control information indicating the second image processing or the third image processing selected by the user is transmitted from the image processing device 12 to the ultrasonic diagnostic device 10 via the communication path N. The first reception unit 34b receives the control information.

[0060] The storage unit 36 ​​constitutes one or more storage areas for storing data. For example, the storage unit 36 ​​is a hard disk drive (HDD), a solid state drive (SSD), various memories (for example, RAM, DRAM, ROM, etc.), other storage devices (for example, optical disks, etc.), or a combination thereof. For example, Raw data, ultrasonic image data, information indicating imaging conditions, and patient information are stored in the storage unit 36. Header data or transmission data may also be stored in the storage unit 36.

[0061] The image processing unit 20 is equivalent to an example of the first image processing unit. The image processing of the image processing unit 20 is equivalent to an example of the first image processing. The ultrasonic image generated by applying the first image processing to the Raw data is equivalent to an example of the first ultrasonic image. The display of the display unit 24 is equivalent to an example of the first display. The display control unit 30 is equivalent to an example of the first display control unit.

[0062] Below, reference Figure 3 , the structure of the image processing device 12 is explained. Figure 3 It is a diagram showing an example of the structure of the image processing device 12.

[0063] The image processing apparatus 12 includes a communication unit 38 , a receiving unit 40 , a main memory 42 , a memory control unit 44 , an I / O device 46 , an output unit 48 , an input unit 50 , and a processor 52 .

[0064] The communication unit 38 is a communication interface. The communication unit 38 includes a second transmission unit 38a that transmits data to an external device and a second reception unit 38b that receives data. For example, the second transmission unit 38a transmits control information indicating the second image processing or the third image processing selected by the user to the ultrasonic diagnostic apparatus 10 via the communication path N. The second reception unit 38b receives the transmission data transmitted from the ultrasonic diagnostic apparatus 10 via the communication path N. Thus, the second reception unit 38b receives the Raw data.

[0065] The receiving unit 40 receives the transmission data received by the communication unit 38 and performs processing to store the transmission data in the main memory 42 .

[0066] The main memory 42 constitutes one or more storage areas for storing data. For example, the main memory 42 is a hard disk drive (HDD), a solid state drive (SSD), various memories (for example, RAM, DRAM, ROM, etc.), other storage devices (for example, optical disks, etc.), or a combination thereof. For example, the data for transmission is stored in the main memory 42. Raw data and header data may also be stored in the main memory 42, respectively. Other information may also be stored in the main memory 42.

[0067] The memory control unit 44 controls the main memory 42. For example, the memory control unit 44 stores the transmission data received by the receiving unit 40 in the main memory 42. In addition, the memory control unit 44 controls reading of data from the main memory 42.

[0068] The IO device 46 is connected to the output unit 48 and the input unit 50. For example, various information is output to the output unit 48 via the IO device 46, and is input from the input unit 50 to the image processing apparatus 12 via the IO device 46.

[0069] The output unit 48 includes a display unit. The display unit is a display such as a liquid crystal display, an EL display, etc. The display unit may be a device that has both a display and an input unit 50. For example, a GUI (Graphic User Interface) may be implemented by the display unit. In addition, a user interface such as a touch panel may be implemented by the display unit. The output unit 48 may include a speaker.

[0070] The input unit 50 is a device for a user to input various information into the image processing device 12. For example, the input unit 50 is an operation panel, a switch, a button, a keyboard, a mouse, a trackball, a joystick, or the like.

[0071] The processor 52 includes a control unit, a calculation unit, a cache, a bus I / F, etc. The control unit controls the image processing device 12. The calculation unit performs various calculations. In addition, the processor 52 includes an image processing unit 54 and a display control unit 56.

[0072] The image processing unit 54 generates an ultrasonic image by applying image processing to the Raw data. This image processing may include the above-mentioned signal processing.

[0073] The display control unit 56 displays the ultrasonic image on the display of the output unit 48. The display control unit 56 may display information or images other than the ultrasonic image on the display of the output unit 48.

[0074] The image processing unit 54 is equivalent to an example of the second image processing unit. The image processing of the image processing unit 54 is equivalent to an example of the second image processing. The ultrasonic image generated by applying the second image processing to the Raw data is equivalent to an example of the second ultrasonic image. The display of the output unit 48 is equivalent to an example of the second display. The display control unit 56 is equivalent to an example of the second display control unit.

[0075] Furthermore, the image processing device 12 includes a user interface for accepting a selection of a second image processing. The user interface is implemented by the output unit 48 and the input unit 50. The display control unit 56 displays a screen for selecting the second image processing on the display of the output unit 48. For example, an overview of a plurality of different second image processings is displayed on the screen. The user can operate the input unit 50 to select the second image processing on the screen. Of course, the second image processing can also be selected by voice. The cross section or diagnostic part to be displayed can also be specified through the user interface. The image processing unit 54 generates a second ultrasonic image by applying the second image processing to the Raw data according to the selection accepted by the user interface. The display control unit 56 displays the second ultrasonic image on the display of the output unit 48.

[0076] The second transmitting unit 38a may transmit control information indicating the selection accepted by the user interface to the ultrasonic diagnostic apparatus 10 via the communication path N. That is, when the user selects the second image processing on the above-mentioned screen, the second transmitting unit 38a transmits control information indicating the second image processing selected by the user to the ultrasonic diagnostic apparatus 10 via the communication path N. Similarly, when the second image processing is selected by voice, the second transmitting unit 38a transmits control information indicating the selected second image processing to the ultrasonic diagnostic apparatus 10.

[0077] The first receiving unit 34b of the ultrasonic diagnostic apparatus 10 receives the control information transmitted by the second transmitting unit 38a of the image processing apparatus 12 via the communication path N. The image processing unit 20 of the ultrasonic diagnostic apparatus 10 generates a third ultrasonic image by applying the second image processing indicated by the control information received by the first receiving unit 34b to the Raw data. The display control unit 30 of the ultrasonic diagnostic apparatus 10 displays the third ultrasonic image on the display of the display unit 24.

[0078] Below, reference Figure 4 , explaining the structure of the data to be sent. Figure 4 This shows an example of the structure of the transmission data.

[0079] The ultrasonic diagnostic apparatus 10 generates Raw data 57 by transmitting and receiving ultrasonic waves. The converter 32 generates transmission data 60 by adding header data 58 to the Raw data 57. The transmission data 60 is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12.

[0080] For example, Figure 5 As shown, the transmission data 60 is stored in the main memory 42 of the image processing device 12 . Figure 5 The Raw data storage area 42a is shown in FIG.

[0081] Below, reference Figure 6, the processing flow of the ultrasonic diagnostic system is explained. Figure 6 A flowchart showing the flow of processing of the ultrasonic diagnostic system is shown.

[0082] First, the image processing device 12 performs user authentication (S01). For example, the user authentication is performed using personal information such as a password, face or fingerprint that is pre-registered in the image processing device 12. If the authentication is successful, the processing after step S02 is performed. If the authentication fails, the processing after step S02 is not performed. In addition, user authentication may not be performed. In this case, the processing after step S02 is performed instead of step S01. The processing after step S02 is described below.

[0083] For example, the instruction screen is displayed on the display of the image processing device 12. When the user requests access to the ultrasonic diagnostic apparatus 10 on the instruction screen (S02), the image processing device 12 instructs the ultrasonic diagnostic apparatus 10 to access (S03).

[0084] When receiving the access instruction, the ultrasonic diagnostic apparatus 10 allows access to the ultrasonic diagnostic apparatus 10 (S04) and sends a response corresponding to the instruction to the image processing apparatus 12 (S05). The ultrasonic diagnostic apparatus 10 may also use the user's personal information (e.g., personal information input to the image processing apparatus 12) to determine whether to allow access.

[0085] When the image processing device 12 receives a response from the ultrasonic diagnostic device 10, it requests the ultrasonic diagnostic device 10 to transmit the Raw data (S06). The image processing device 12 instructs the ultrasonic diagnostic device 10 to transmit the Raw data (S07).

[0086] When receiving the instruction to send Raw data, the ultrasonic diagnostic device 10 sends the sending data including the Raw data and the header data to the image processing device 12 (S08). For example, the ultrasonic diagnostic device 10 includes the Raw data currently acquired by the ultrasonic diagnostic device 10 in the sending data, and sends the sending data to the image processing device 12. As a response to the instruction to send Raw data, it is sent to the image processing device 12 (S09). Thus, the sending data including the Raw data is sent from the ultrasonic diagnostic device 10 to the image processing device 12 in real time. The Raw data is stored in the main memory 42 of the image processing device 12. And, the image processing device 12 generates an ultrasonic image by performing image processing on the Raw data. The ultrasonic image is displayed on the display of the image processing device 12.

[0087] Then, when the user requests the image processing device 12 to stop transmitting the Raw data ( S10 ), the image processing device 12 instructs the ultrasonic diagnostic device 10 to stop transmitting ( S11 ).

[0088] When receiving the transmission stop instruction, the ultrasonic diagnostic apparatus 10 stops transmitting the transmission data (S12). As a result, the transmission data is not transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. A transmission stop response is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 (S13).

[0089] Below, reference Figure 7 , the processing of the processor 52 of the image processing device 12 is described.

[0090] When the transmission data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, the Raw data and the header data are stored in the storage area 42b of the main memory 42. The image processing command is stored in the storage area 42c of the main memory 42. For example, the image processing command is input to the image processing apparatus 12 via the input unit 50 and stored in the main memory 42, or is input to the image processing apparatus 12 via the communication unit 38 and stored in the main memory 42.

[0091] For example, the processor 52 includes a bus interface, a cache, a control device and an operation device. The control device includes an extractor and a decoder. The operation device includes an ALU (Arithmetic Logic Unit) and a register.

[0092] The commands stored in the storage area 42c are output to the extractor via the system bus, the bus interface and the cache, and are converted into control information by the decoder. The control information is output to the ALU. The Raw data stored in the storage area 42b is output to the register via the system bus, the bus interface and the cache, and is output from the register to the ALU. The ALU performs operations on the Raw data as an object based on the control information. The ALU outputs the result data generated by the operation to the main memory 42 via the register, the cache, the bus interface and the system bus. The result data is stored in the storage area 42d of the main memory 42. For example, the result data is ultrasonic image data.

[0093] In the present embodiment, the image processing unit 20 of the ultrasonic diagnostic apparatus 10 generates a first ultrasonic image by applying the first image processing to the raw data. The display control unit 30 displays the first ultrasonic image on the display unit 24. The transmission data including the raw data and the header data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N. The processor 52 of the image processing apparatus 12 generates a second ultrasonic image different from the first ultrasonic image by applying the second image processing different from the first image processing to the raw data. The processor 52 displays the second ultrasonic image on the display of the output unit 48. Since the raw data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N including the high-speed communication path, the second ultrasonic image can be displayed on the display of the image processing apparatus 12 in real time or substantially in real time. That is, compared with the case where the high-speed communication path is not used, the time from when the raw data is acquired by the ultrasonic diagnostic apparatus 10 to when the second ultrasonic image is displayed on the display of the image processing apparatus 12 is shortened. As a result, the second ultrasonic image can be displayed on the display of the image processing device 12 in real time or substantially in real time.

[0094] Below, reference Figure 8 , a specific example of image processing performed by the processor 52 is described. Figure 8 In the figure, the solid line represents the flow of signal data (for example, Raw data, etc.), and the dotted line represents the flow of control data.

[0095] When the transmission data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, the communication unit 38 receives the transmission data. The receiving unit 40 receives the transmission data from the communication unit 38 and stores the Raw data and the header data in the main memory 42. When the Raw data is compressed, the receiving unit 40 decompresses the compressed data. The receiving unit 40 may convert the format of the Raw data.

[0096] Figure 8 The input information (transmission) shown is information sent from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. The input information (transmission) may be included in the header data, or may be sent from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 separately from the header data. The input information (transmission) is received by the communication unit 38 and stored in the main memory 42 by the receiving unit 40. For example, the input information (transmission) includes information indicating the first image processing performed on the Raw data in the ultrasonic diagnostic apparatus 10, patient information, and the like.

[0097] Furthermore, the input information is stored in the main memory 42. For example, the input information includes information indicating the second image processing, etc. The input information is input from the input unit 50 of the image processing device 12 via the IO device 46 to the image processing device 12, and is stored in the main memory 42. The input information can be received by the communication unit 38 and input to the image processing device 12.

[0098] For example, the processor 52 performs 3DUS / 2DUS signal processing (Signal Processing for 3DUS / 2DUS), 2D image processing (2D image processing), cubic / volume rendering (Cubic / Volume Rendering), image reconstruction processing (Image Reconstruction Processing), 4D heart function analysis (4D Heart function Analysis) (or measurement processing (Measurement Processing)), analysis / measurement, and image composition processing (Image composition processing) on ​​the Raw data. In addition, these processes are examples, and only part of these processes may be performed. For example, 4D heart function analysis may not be performed.

[0099] The processor 52 reads the Raw data from the main memory 42 and applies the signal processing indicated by the signal processing information to the Raw data (3DUS / 2DUS signal processing), thereby generating post signal processing data and storing it in the main memory 42 .

[0100] If the processor 52 reads the post signal processing data, image information and image processing information from the main memory 42 and applies two-dimensional image processing (2D image processing) to the post signal processing data, post 2D image processing data is generated and stored in the main memory 42. The image information includes geometric information or three-dimensional structure information.

[0101] If the processor 52 reads the post-signal processing data, image information and image processing information from the main memory 42 and applies three-dimensional rendering processing (cubic rendering / volume rendering) to the post-signal processing data, post-cubic rendering / volume rendering data (Post Cubic / Volume Rendering data) is generated and stored in the main memory 42.

[0102] If the processor 52 reads the post 2D image processing data, post cube rendering / volume rendering data and image reconstruction information from the main memory 42 and performs reconstruction processing (image reconstruction processing), post image reconstruction data (Post Image Reconstruction data) is generated and stored in the main memory 42 .

[0103] If the processor 52 reads the post-2D image processing data, post-cube rendering / volume rendering data, post-image reconstruction data and analysis / measurement information from the main memory 42 and performs analysis processing (4D cardiac function analysis (or measurement processing)), post-analysis / measurement data (Post Analysis / Measurement data) is generated and stored in the main memory 42.

[0104] If the processor 52 reads the post-2D image processing data, post-cube rendering / volume rendering data, post-image reconstruction data, post-analysis / measurement data, patient information, and display layout information from the main memory 42 and performs synthesis processing (image synthesis processing), display image data is generated and stored in the main memory 42. The display image data is output to the output unit 48 via the IO device 46 and displayed on the display of the output unit 48. The synthesized data can be selected by the user, and the data selected by the user can be synthesized.

[0105] For example, if information included in the input information (transmission) is used as signal processing information, image information, image processing information, image reconstruction information, analysis / measurement information, patient information, and display layout information, a first ultrasonic image displayed in the ultrasonic diagnostic apparatus 10 is generated. For example, the first ultrasonic image is displayed on the display of the output unit 48.

[0106] If the information included in the input information inputted via the IO device 46 is used as signal processing information, image information, image processing information, image reconstruction information, analysis / measurement information, patient information, and display layout information, a second ultrasonic image is generated. For example, the second ultrasonic image is displayed on the display of the output unit 48.

[0107] Figure 8 The processing shown is only an example, and the processing to be executed may be changed depending on, for example, the diagnosis site, analysis, measurement, patient, or medical department.

[0108] Hereinafter, specific examples of the first ultrasonic image and the second ultrasonic image will be described.

[0109] refer to Fig. 9 , the first ultrasonic image is described. Fig. 9 1 shows a first ultrasonic image. Here, as an example, an ultrasonic examination is performed on a circulator.

[0110] Ultrasonic images 62, 64, 66, and 68 are first ultrasonic images, respectively, and are displayed on the display unit 24 of the ultrasonic diagnostic apparatus 10. Ultrasonic images 62, 64, 66, and 68 are images constituting a CV3D image representing blood vessels of the heart. CV is an abbreviation for Cardiovascular. A 3D image is a three-dimensional ultrasonic image, which is an image that represents tissues in three dimensions. For example, ultrasonic images 62, 64, 66, and 68 are images that represent ventricles, atria, valves, and the like.

[0111] For example, a 2D array probe including a 2D array transducer can be used as the ultrasonic probe 14. The ultrasonic diagnostic apparatus 10 performs ultrasonic scanning of a three-dimensional space including the heart using the 2D array probe, thereby acquiring 4D data representing the heart. The 4D data is an example of Raw data, and is data representing the movement of tissues in the three-dimensional space in a time series manner. That is, the 4D data is data representing the state in which the three-dimensional tissue is moving.

[0112] The image processing unit 20 of the ultrasonic diagnostic apparatus 10 generates ultrasonic images 62, 64, 66, 68 dynamically representing the heart (e.g., ventricles, atria, valves, etc.) by applying the first image processing (e.g., image processing for generating CV3D images) to the 4D data. The display control unit 30 displays the ultrasonic images 62, 64, 66, 68 on the display unit 24. The user of the ultrasonic diagnostic apparatus 10 (e.g., a technician) can observe or diagnose the movement of the heart by referring to the ultrasonic images 62, 64, 66, 68. For example, the ultrasonic images 62, 64, 66, 68 are displayed on the display unit 24 in real time.

[0113] The ultrasonic diagnostic apparatus 10 may also acquire flow data representing blood flow. In this case, a 4D image representing blood flow is generated by the image processing unit 20 and displayed on the display unit 24. A 4D image is an image representing a state in which a three-dimensional tissue is moving. That is, it can be said that a 4D image is a three-dimensional dynamic image.

[0114] The 4D data is accompanied by header data as Raw data, and is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N. The image processing unit 54 of the image processing apparatus 12 generates a second ultrasonic image by applying the second image processing to the 4D data. The display control unit 56 displays the second ultrasonic image on the display of the output unit 48. In addition, information indicating the first image processing is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N. The information indicating the first image processing may be included in the header data and transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, or may be transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 as data different from the header data.

[0115] refer to Fig.10 , the second ultrasonic image will be described. Fig.10 A second ultrasonic image is shown.

[0116] The screen 70 is displayed on the display of the output unit 48 of the image processing device 12. The ultrasonic image 72 is a second ultrasonic image and is displayed on the screen 70. The image processing unit 54 generates the ultrasonic image 72 by applying the second image processing to the above-mentioned 4D data. The second image processing is an image processing different from the first image processing. The ultrasonic image 72 is an ultrasonic image different from the ultrasonic images 62, 64, 66, and 68 displayed on the display of the ultrasonic diagnostic device 10. The ultrasonic image 72 is an example of a CV4D image (i.e., an image showing a state in which a three-dimensional tissue is moving). For example, the image processing unit 54 generates the ultrasonic image 72 by applying the image processing for cardiac function analysis to the 4D data. The display control unit 56 displays the ultrasonic image 72 on the screen 70. For example, if the user of the image processing device 12 (e.g., a doctor, etc.) instructs to perform cardiac function analysis, the image processing unit 54 generates the ultrasonic image 72 by applying the image processing for cardiac function analysis to the 4D data.

[0117] exist Fig.10In the example shown, an ultrasonic image group 74 is displayed on the screen 70. The ultrasonic image group 74 includes a plurality of first ultrasonic images. For example, the ultrasonic image group 74 includes the ultrasonic images 62, 64, 66, and 68. As described above, information indicating the first image processing for generating the ultrasonic images 62, 64, 66, and 68 is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. The image processing unit 54 generates the ultrasonic images 62, 64, 66, and 68 by applying the first image processing to the 4D data. As a result, the ultrasonic images 62, 64, 66, and 68 displayed on the display of the ultrasonic diagnostic apparatus 10 can be reproduced in the image processing apparatus 12. That is, even if the ultrasonic images 62, 64, 66, and 68 themselves are not transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, by transmitting the raw data and the information indicating the first image processing from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, the ultrasonic images 62, 64, 66, and 68 can be reproduced in the image processing apparatus 12. The display control unit 56 displays an ultrasonic image group 74 including the ultrasonic images 62 , 64 , 66 , and 68 on the screen 70 .

[0118] For example, information indicating the first image processing is included in the header data and is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. The image processing unit 54 generates ultrasonic images 62, 64, 66, and 68 by applying the first image processing to the 4D data according to the information indicating the first image processing included in the header data. The display control unit 56 displays the ultrasonic images 62, 64, 66, and 68 on the screen 70. In addition, the ultrasonic images 62, 64, 66, and 68 can also be said to be an example of an image corresponding to the fourth ultrasonic image.

[0119] For example, the display control unit 56 displays the ultrasonic image 72 and the ultrasonic image group 74 side by side on the screen 70. Fig.10 In the example shown, the display control unit 56 makes the display size of the ultrasonic image group 74 smaller than the display size of the ultrasonic image 72, and displays the ultrasonic image 72 and the ultrasonic image group 74 on the screen 70. This display example is only an example, and the display control unit 56 may make the display size of the ultrasonic image 72 the same as the display size of the ultrasonic image group 74, and display the ultrasonic image 72 and the ultrasonic image group 74 on the screen 70. Of course, the display control unit 56 may make the display size of the ultrasonic image group 74 larger than the display size of the ultrasonic image 72, and display the ultrasonic image 72 and the ultrasonic image group 74 on the screen 70. Furthermore, the user of the image processing device 12 (for example, a doctor, etc.) can specify the display size of each of the ultrasonic image 72 and the ultrasonic image group 74, and the display control unit 56 may display the ultrasonic image 72 and the ultrasonic image group 74 on the screen 70 at the display size specified by the user.

[0120] Since a high-speed communication path is used as the communication path N, the ultrasonic image 72 is displayed on the screen 70 in real time. For example, the ultrasonic image 72 is displayed on the display of the image processing device 12 at the same or substantially the same timing as the ultrasonic images 62, 64, 66, and 68 are displayed on the display of the ultrasonic diagnostic device 10. Thus, even when the user of the image processing device 12 (for example, a doctor, etc.) is not near the ultrasonic diagnostic device 10, the second ultrasonic image generated based on the Raw data can be observed in real time. Furthermore, even when the user of the image processing device 12 is not near the ultrasonic diagnostic device 10, the first ultrasonic image can be observed in real time. For example, the user of the image processing device 12 can observe the first ultrasonic image and the second ultrasonic image in real time at a place far away from the ultrasonic diagnostic device 10 (for example, a remote location) and perform diagnosis, etc.

[0121] And, if Fig.10 As shown, by displaying the first ultrasonic image and the second ultrasonic image side by side, the user of the image processing device 12 can compare the first ultrasonic image and the second ultrasonic image in real time. For example, a CV3D image displayed on the display of the ultrasonic diagnostic device 10 and a CV4D image different from the CV3D image are displayed side by side on the screen 70. Thus, the user can compare the CV3D image and the CV4D image displayed on the display of the ultrasonic diagnostic device 10 in real time.

[0122] The ultrasonic image 72 is only an example of the second ultrasonic image, and a second ultrasonic image other than the ultrasonic image 72 may be generated and displayed. For example, the image processing unit 54 may generate a three-dimensional ultrasonic image that stereoscopically represents a stationary tissue, a two-dimensional ultrasonic image that plane-represents a stationary tissue (i.e., a cross-sectional image), or a two-dimensional ultrasonic image that represents a moving tissue as the second ultrasonic image. The display control unit 56 displays the second ultrasonic image generated by the image processing unit 54 on the screen 70. For example, if the user of the image processing device 12 specifies the second image processing, the image processing unit 54 generates the second ultrasonic image by applying the second image processing specified by the user to the Raw data.

[0123] For example, when the user of the image processing device 12 specifies a cross section or an angle to be observed using the input unit 50, the image processing unit 54 generates a second ultrasonic image showing the specified cross section, or generates a second ultrasonic image when the tissue is observed from the specified angle. These second ultrasonic images are displayed on the display of the output unit 48. Thus, the user can observe the second ultrasonic image showing the cross section that the user wants to observe, or observe the tissue from the angle that the user wants to observe.

[0124] When the user designates a cross section suitable for measurement, a second ultrasonic image showing the cross section is generated, and measurement is performed on the second ultrasonic image. Thus, the user can measure the cross section he or she wants to measure in real time at a remote location.

[0125] The display control unit 56 may also display the second ultrasonic image on the display of the output unit 48 according to the designated display mode. The display control unit 56 may also display mode identification information for identifying the display mode on the display of the output unit 48. For example, the display mode is the LIVE mode, the CINE mode, or the LIVE OFF mode.

[0126] The LIVE mode is a mode for displaying a second ultrasonic image generated by applying the second image processing to the Raw data while receiving the Raw data from the ultrasonic diagnostic device 10. The LIVE mode is equivalent to an example of the first mode. For example, the LIVE mode is a mode for applying the second image processing to the Raw data acquired by the ultrasonic diagnostic device 10 in real time, and displaying the second ultrasonic image generated by applying the second image processing in real time. If the Raw data is sent from the ultrasonic diagnostic device 10 to the image processing device 12 in real time via the communication path N, the image processing unit 54 generates a second ultrasonic image by applying the second image processing to the Raw data. The display control unit 56 displays the second ultrasonic image on the display of the output unit 48. Thus, the second ultrasonic image is displayed in real time. For example, the second ultrasonic image is displayed as a dynamic image in real time.

[0127] The CINE mode is a mode for displaying a second ultrasonic image generated by applying the second image processing to the Raw data received and stored in the main memory 42. The CINE mode is equivalent to an example of the second mode. For example, if the user of the image processing device 12 specifies the Raw data stored in the main memory 42 to indicate the application of the second image processing, the image processing unit 54 reads the Raw data specified by the user from the main memory 42 and applies the second image processing to the Raw data, thereby generating a second ultrasonic image. The display control unit 56 displays the second ultrasonic image on the display of the output unit 48. The second ultrasonic image displayed in the CINE mode is not necessarily an image displayed in real time. For example, the mode for displaying the recorded second ultrasonic image is the CINE mode.

[0128] The LIVE OFF mode is a mode for displaying the second ultrasonic image in a static state. The LIVE OFF mode is an example of the third mode. For example, when the user specifies the LIVE OFF mode when the display mode is the LIVE mode, the display control unit 56 displays the second ultrasonic image displayed in the LIVE mode in a static state on the display of the output unit 48.

[0129] For example, when the user of the image processing device 12 specifies a display mode, the display control unit 56 displays the second ultrasonic image on the display of the output unit 48 in accordance with the display mode specified by the user.

[0130] In addition, the display mode may be pre-specified. For example, the display mode may be pre-specified for each diagnostic part, or the display mode may be pre-specified for each type of analysis, or the display mode may be pre-specified for each type of image. The display control unit 56 displays the second ultrasonic image on the display of the output unit 48 in accordance with the pre-specified display mode. Even in this case, if the user specifies the display mode, the display control unit 56 may display the second ultrasonic image on the display of the output unit 48 in accordance with the display mode specified by the user.

[0131] The mode identification information is, for example, an image or a character string representing the display mode. Fig.10 The indicator 76 shown is an example of mode recognition information.

[0132] The indicator 76 includes an image and a character string. The display control unit 56 changes at least one of the color, shape, and size of the image included in the indicator 76 according to the display mode, and displays the indicator 76 on the screen 70. For example, the color of the image indicating the LIVE mode is red, the color of the image indicating the CINE mode is blue, and the color of the image indicating the LIVE OFF mode is green.

[0133] exist Fig.10 In the example shown, the ultrasonic image 72 is displayed in the LIVE mode. Therefore, the color of the image included in the indicator 76 is red. In addition, a character string "LIV E" is displayed on the screen 70.

[0134] The user of the image processing device 12 can specify the display mode of the first ultrasonic image. In this case, the display control unit 56 displays the first ultrasonic image on the display of the output unit 48 according to the display mode specified by the user. Fig.10 In the illustrated example, when the LIVE mode is designated as the display mode of the first ultrasonic image, the display control unit 56 displays the ultrasonic image group 74 on the screen 70 in the LIVE mode.

[0135] Fig.1170. The ultrasonic images 78, 80, 82, and 84 are second ultrasonic images and are displayed on the screen 70. The image processing unit 54 generates the ultrasonic images 78, 80, 82, and 84 by applying the second image processing to the 4D data. The ultrasonic images 78, 80, 82, and 84 are different from the ultrasonic images 62, 64, 66, and 68 displayed on the display of the ultrasonic diagnostic apparatus 10.

[0136] Ultrasonic images 78, 80, 82, and 84 are examples of CV4D images. For example, ultrasonic image 78 includes a bull's eye view of 16 segments of the left ventricle and an image representing the myocardium. Ultrasonic image 80 is an image representing the aortic valve and the mitral valve (for example, an image generated by volume rendering). Ultrasonic image 82 includes an image representing the surface of the right ventricular cavity model (for example, an image generated by surface rendering) and a volume curve. Ultrasonic image 84 is an image representing the surface of the mitral valve model (for example, an image generated by surface rendering).

[0137] The ultrasonic images 78, 80, and 84 are displayed in the LIVE OFF mode, and the ultrasonic image 82 is displayed in the LIVE E mode.

[0138] The indicator 86 is the mode recognition information of the display mode of the ultrasonic image 78, and is displayed around the ultrasonic image 78. The indicator 88 is the mode recognition information of the display mode of the ultrasonic image 80, and is displayed around the ultrasonic image 80. The indicator 90 is the mode recognition information of the display mode of the ultrasonic image 82, and is displayed around the ultrasonic image 82. The indicator 92 is the mode recognition information of the display mode of the ultrasonic image 84, and is displayed around the ultrasonic image 84.

[0139] For example, if the user of the image processing device 12 specifies the display mode for each second ultrasonic image, the display control unit 56 displays each second ultrasonic image on the screen 70 according to the display mode of each second ultrasonic image. Of course, the display control unit 56 may display all the second ultrasonic images on the screen 70 according to the same display mode.

[0140] Ultrasonic images 78, 80, and 84 are images generated based on the same 4D data. In the present embodiment, when a plurality of ultrasonic images are generated based on the same 4D data, the modes of the ultrasonic images can be made the same or different and the ultrasonic images can be displayed. Here, as an example, the ultrasonic image 82 is displayed in the LIVE mode, but according to the user's instructions, ultrasonic images other than the ultrasonic image 82 (for example, the ultrasonic image 78) can be displayed in the LIVE mode, and the ultrasonic image 82 can be displayed in the LIVEOFF mode. In this way, the modes of the ultrasonic images generated based on the same 4D data can be switched separately. Furthermore, the user can determine not only whether the display mode is the LIVE mode, but also whether it is the CINE mode through the indicator.

[0141] Fig.12 Another display example of the second ultrasonic image is shown in . Ultrasonic images 82 and 84 are second ultrasonic images and are displayed on the screen 70 . Fig.12 The ultrasound images 82, 84 shown are Fig.11 The ultrasound images 82, 84 shown are identical.

[0142] The indicator 94 is mode identification information of the display mode of the ultrasonic image 82 , and is displayed around the ultrasonic image 82 . The indicator 96 is mode identification information of the display mode of the ultrasonic image 84 , and is displayed around the ultrasonic image 84 .

[0143] exist Fig.12 In the example shown, the ultrasonic image 82 is displayed in the LIVE mode, and the ultrasonic image 84 is displayed in the CINE mode.

[0144] For example, the user of the image processing device 12 can change the display mode according to the purpose of diagnosis or examination, observe the second ultrasonic image displayed in the display mode corresponding to the purpose, and perform diagnosis or examination.

[0145] Below, reference Fig.13 , an application example of this embodiment is described. Fig.13 It is a figure for explaining this application example.

[0146] For example, the ultrasonic diagnostic apparatus 10 is used for obstetric examination. The first image processing and the second image processing are image processing related to obstetric examination. That is, the first image processing and the second image processing are image processing suitable for obstetric examination or image processing for generating ultrasonic images for obstetric examination.

[0147] For example, in obstetrics, not only doctors but also third parties such as family members of the subject (patient) may want to observe ultrasonic images. For example, if the third party can go to a place where the subject is imaged by the ultrasonic diagnostic apparatus 10, the third party can observe the first ultrasonic image displayed on the display of the ultrasonic diagnostic apparatus 10, thereby satisfying the third party's request.

[0148] However, a third party may not necessarily be able to go to the place where the subject is photographed by the ultrasonic diagnostic apparatus 10, and may want to observe the ultrasonic image of the subject at a remote location. In this case, by executing the processing involved in this embodiment, the third party can observe the second ultrasonic image at a remote location even if he does not go to the place.

[0149] Furthermore, the ultrasonic image that the third party wants to observe is not necessarily the same as the ultrasonic image required for the examination using the ultrasonic diagnostic apparatus 10. In this case, the processing according to this embodiment is executed to generate and display the second ultrasonic image desired by the third party, thereby satisfying the third party's request.

[0150] exist Fig.13 In the example shown, technician A acquires Raw data (e.g., 4D data) by operating the ultrasonic diagnostic apparatus 10 in the obstetrics department. The ultrasonic diagnostic apparatus 10 generates a first ultrasonic image 98 by applying the first image processing to the Raw data. The first ultrasonic image 98 is an ultrasonic image required for obstetric examinations, etc. The technician A performs an examination, etc. based on the first ultrasonic image 98. The Raw data is sent from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N.

[0151] Fig.13 , the image processing devices 12A and 12B are shown. The image processing devices 12A and 12B have the same structure as the image processing device 12. The image processing devices 12A and 12B are devices installed in different places. For example, the image processing device 12A is used to display an ultrasonic image to the doctor B. The image processing device 12B is used to display an ultrasonic image to the family member C. The family member C is the family member of the subject who has acquired the Raw data.

[0152] For example, the image processing unit 54 of the image processing device 12A generates and displays the second ultrasonic image 100 for the doctor B to perform diagnosis or examination. That is, the second image processing for generating the second ultrasonic image 100 is performed by the image processing unit 54 of the image processing device 12A. The doctor B can perform diagnosis or examination at a remote location by referring to the second ultrasonic image 100.

[0153] For example, the image processing unit 54 of the image processing device 12B generates and displays the second ultrasonic image 102 that the family member C wants to observe. That is, the second image processing for generating the second ultrasonic image 102 is performed by the image processing unit 54 of the image processing device 12B. For example, the family member C can check the growth status of the fetus by referring to the second ultrasonic image 102 at a remote location.

[0154] Furthermore, it is also possible to use terminal devices 104, 106, and 108. The terminal devices 104, 106, and 108 are PCs, tablet computers, smartphones, or mobile phones, and are devices capable of transmitting and receiving sounds.

[0155] For example, technician A uses terminal device 104, and doctor B uses terminal device 106, and technician A and doctor B talk in real time. Thus, technician A and doctor B can refer to the ultrasound image and communicate by voice. For example, doctor B can convey to technician A the parts required for imaging diagnosis by voice.

[0156] Similarly, family member C uses terminal device 108, and laboratory technician A and family member C talk in real time. For example, family member C can convey to laboratory technician A the image that family member C wants to observe by voice.

[0157] Furthermore, although the obstetrics department has been described as an example, the same effects can be obtained even if the present embodiment is applied to a medical department other than the obstetrics department.

[0158] The image processing device 12 may instruct the ultrasonic diagnostic device 10 on image processing to be executed by the ultrasonic diagnostic device 10. For example, the image processing device 12 includes a user interface for accepting selection of the third image processing. The third image processing is image processing to be executed by the ultrasonic diagnostic device 10.

[0159] The user interface is implemented by the output unit 48 and the input unit 50. The display control unit 56 displays a screen for selecting the third image processing on the display of the output unit 48. For example, a list of a plurality of different third image processing is displayed on the screen. The user can operate the input unit 50 to select the third image processing on the screen. Of course, the third image processing can also be selected by voice. The cross section or diagnostic part to be displayed can also be specified through the user interface.

[0160] The communication unit 38 transmits control information indicating the selection accepted by the user interface to the ultrasonic diagnostic apparatus 10 via the communication path N. That is, when the user selects the third image processing on the above-mentioned screen, the communication unit 38 transmits control information indicating the third image processing selected by the user to the ultrasonic diagnostic apparatus 10 via the communication path N. Similarly, when the third image processing is selected by voice, the communication unit 38 transmits control information indicating the selected third image processing to the ultrasonic diagnostic apparatus 10.

[0161] The communication unit 34 of the ultrasonic diagnostic apparatus 10 receives the control information via the communication path N. The image processing unit 20 of the ultrasonic diagnostic apparatus 10 generates a third ultrasonic image by applying the third image processing indicated by the control information to the Raw data. The display control unit 30 of the ultrasonic diagnostic apparatus 10 displays the third ultrasonic image on the display unit 24.

[0162] The Raw data to which the third image processing is applied may be selected by, for example, a user of the image processing device 12 or a user of the ultrasonic diagnostic device 10. For example, the image processing unit 20 applies the third image processing to the Raw data stored in the storage unit 36 ​​of the ultrasonic diagnostic device 10 to generate a third ultrasonic image.

[0163] For example, on the day of the examination, a CV3D image is displayed as the first ultrasonic image on the display of the ultrasonic diagnostic apparatus 10, but later, an image other than the CV3D image is generated and displayed as the third ultrasonic image. Thus, the ultrasonic diagnostic apparatus 10 can be used to perform a more detailed analysis or examination than on the day of the examination.

[0164] According to the above-mentioned embodiment, real-time diagnosis can be realized at a remote location. For example, a doctor or the like can observe or analyze an ultrasonic image in real time at a remote location. Furthermore, the doctor or the like can observe the desired image in real time by indicating the desired image to be observed (for example, the desired part or angle, etc.) to the user of the ultrasonic diagnostic device 10 (for example, an inspection technician) in real time. As a result, the frequency of re-examination using the ultrasonic diagnostic device 10 can be reduced. As a result, the burden on doctors, inspection technicians, and subjects can be reduced.

[0165] Furthermore, when the image processing device 12 has a higher-performance image processing function than the ultrasonic diagnostic device 10, the image processing that cannot be performed in the ultrasonic diagnostic device 10 can be performed in real time by the image processing device 12. For example, even if the ultrasonic diagnostic device 10 does not have a function to perform 4D image processing for the circulatory system, if the image processing device 12 has this function, the 4D image processing for the circulatory system can be performed in real time by the image processing device 12. The same can be said for 4D image processing for obstetrics, etc. For example, even if the ultrasonic diagnostic device 10 is a portable ultrasonic diagnostic device and does not have a high-performance function, the high-performance function can be achieved by the image processing device 12. Furthermore, images with changed angles, etc. can be confirmed at a remote location.

[0166] Furthermore, the ultrasonic diagnostic system according to the present embodiment can also be used for the education or training of inspection technicians, doctors, etc. For example, a skilled technician operates the ultrasonic diagnostic apparatus 10 to acquire Raw data, and a second ultrasonic image based on the Raw data is displayed on the display of the image processing apparatus 12. The person receiving the education can receive explanations from the skilled technician while observing the second ultrasonic image displayed on the display of the image processing apparatus 12 in real time.

[0167] In the present embodiment, the data of the first ultrasonic image itself may be transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via a communication path, and the first ultrasonic image may be displayed on a display of the image processing apparatus 12 .

[0168] The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 can be implemented by hardware resources such as a processor or an electronic circuit, for example. In this implementation, a device such as a memory can be used as needed. The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 can be implemented by a computer, for example. That is, the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 can be implemented in whole or in part by the cooperation of hardware resources such as a CPU (Central Processing Unit) and a memory possessed by the computer and software (program) that defines the actions of the CPU, etc. The program is stored in the storage unit 36 ​​or other storage device of the ultrasonic diagnostic apparatus 10 via a recording medium such as a CD or a DVD or via a communication path such as a network. As another example, the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be implemented by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate Array). A GPU (Graphics Processing Unit) or the like may also be used. The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may also be implemented by a single device. Each function of the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be implemented by one or more devices.

[0169] The receiving unit 40, the memory control unit 44, the image processing unit 54 and the display control unit 56 can be implemented by hardware resources such as a processor or an electronic circuit. In this implementation, devices such as a memory can be used as needed. The receiving unit 40, the memory control unit 44, the image processing unit 54 and the display control unit 56 can also be implemented by a computer. That is, the receiving unit 40, the memory control unit 44, the image processing unit 54 and the display control unit 56 can also be implemented in whole or in part by the cooperation of hardware resources such as a CPU (Central Processing Unit) or a memory possessed by a computer and software (program) that limits the actions of the CPU and the like. The program is stored in the main memory 42 or other storage device of the image processing device 12 via a recording medium such as a CD or DVD or via a communication path such as a network. As another example, the receiving unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 can be implemented by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate Array). A GPU (Graphics Processing Unit) or the like can also be used. The receiving unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 can also be implemented by a single device. Each function of the receiving unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 can be implemented by one or more devices.

Claims

1. An ultrasonic diagnostic system, characterized in that: The ultrasonic diagnostic system includes an ultrasonic diagnostic device and an image processing device. The ultrasonic diagnostic device comprises: The acquisition part acquires Raw data by sending and receiving ultrasonic waves; a first image processing unit that generates a first ultrasonic image by applying a first image processing to the Raw data; a first display control unit that displays the first ultrasonic image generated by the first image processing unit on a first display of the ultrasonic diagnostic apparatus; and a first transmitting unit that transmits the Raw data to which the first image processing has not been applied by the first image processing unit to the image processing device via a high-speed communication path; The image processing device comprises: a second receiving unit that receives the Raw data transmitted by the first transmitting unit via a high-speed communication path; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image displayed on the first display of the ultrasonic diagnostic apparatus by applying a second image processing different from the first image processing to the Raw data received by the second receiving unit; and The second display control unit displays the second ultrasonic image generated by the second image processing unit on a second display of the image processing device.

2. The ultrasonic diagnostic system according to claim 1, characterized in that: The second image processing unit generates a three-dimensional ultrasonic image as the second ultrasonic image based on the Raw data.

3. The ultrasonic diagnostic system according to claim 1, characterized in that: The image processing device further includes a user interface for accepting a selection of a second image processing. the second image processing unit generates the second ultrasonic image by applying the second image processing to the raw data according to the selection accepted by the user interface, The second display control unit displays the second ultrasonic image on the second display.

4. The ultrasonic diagnostic system according to claim 1, characterized in that: The image processing device further comprises: A user interface for accepting a selection of a second image processing; and a second transmitting unit that transmits control information indicating the selection accepted by the user interface to the ultrasonic diagnostic apparatus via a high-speed communication path; The ultrasonic diagnostic apparatus further includes a first receiving unit configured to receive the control information transmitted by the second transmitting unit via a high-speed communication path. the first image processing unit generates a third ultrasonic image by applying the second image processing indicated by the control information received by the first receiving unit to the raw data, The first display control unit displays the third ultrasonic image on the first display.

5. The ultrasonic diagnostic system according to claim 1, characterized in that: The image processing device further comprises: A user interface for accepting a selection of a third image processing; and a second transmitting unit that transmits control information indicating the selection accepted by the user interface to the ultrasonic diagnostic apparatus via a high-speed communication path; The ultrasonic diagnostic apparatus further includes a first receiving unit configured to receive the control information transmitted by the second transmitting unit via a high-speed communication path. the first image processing unit generates a third ultrasonic image by applying the third image processing indicated by the control information received by the first receiving unit to the Raw data, The first display control unit displays the third ultrasonic image on the first display.

6. The ultrasonic diagnostic system according to claim 1, characterized in that: The first transmitting unit transmits information indicating the first image processing to the image processing device via a high-speed communication path. The second receiving unit receives the information indicating the first image processing transmitted by the first transmitting unit via a high-speed communication path, the second image processing unit generates the second ultrasonic image by applying the second image processing to the raw data, and generates the first ultrasonic image by applying the first image processing to the raw data according to information indicating the first image processing, The second display control unit displays the second ultrasonic image and the first ultrasonic image side by side on the second display.

7. The ultrasonic diagnostic system according to claim 1, characterized in that: The first transmitting unit associates header data including information indicating the first image processing with the Raw data and transmits the data to the image processing device via a high-speed communication path. The second receiving unit receives the Raw data and the header data transmitted by the first transmitting unit via a high-speed communication path, The second image processing unit generates a fourth ultrasonic image by applying the first image processing to the Raw data according to information indicating the first image processing included in the header data. The second display control unit displays the fourth ultrasonic image on the second display.

8. The ultrasonic diagnostic system according to claim 1, characterized in that: The second display control unit displays the second ultrasonic image on the second display in accordance with the designated display mode, and displays mode identification information for identifying the display mode on the second display.

9. The ultrasonic diagnostic system according to claim 8, characterized in that: The display mode is any one of a first mode, a second mode, or a third mode, the first mode displays the second ultrasonic image generated by applying the second image processing to the Raw data while receiving the Raw data, the second mode displays the second ultrasonic image generated by applying the second image processing to the Raw data received and stored in a memory, and the third mode displays the second ultrasonic image in a static state.

10. The ultrasonic diagnostic system according to claim 1, characterized in that: The ultrasonic diagnostic device is used for circulator inspection. The first image processing and the second image processing are image processing related to circulator inspection.

11. The ultrasonic diagnostic system according to claim 1, characterized in that: The ultrasonic diagnostic device is used for obstetric examination. The first image processing and the second image processing are image processing related to obstetric examination.

12. An image processing device, characterized in that: include: a second receiving unit that receives the Raw data via a high-speed communication path from an ultrasonic diagnostic apparatus that acquires the Raw data by transmitting and receiving ultrasonic waves and generates a first ultrasonic image by applying a first image processing to the Raw data; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image by applying a second image processing different from the first image processing to the Raw data received by the second receiving unit; and The second display control unit displays the second ultrasonic image generated by the second image processing unit on a display.

Images