Ultrasonic diagnostic system and image processing apparatus

Abstract

The purpose of the present invention is to provide an ultrasound diagnostic system and an image processing device which are capable of generating an ultrasound image in an ultrasound diagnostic device, displaying the ultrasound image in the ultrasound diagnostic device, and performing a diagnosis using the ultrasound image in an external device. An ultrasonic diagnostic device (10) acquires raw data by transmitting and receiving ultrasonic waves, and generates a first ultrasonic image by applying first image processing to the raw data. Raw data is transmitted from an ultrasound diagnostic device (10) to an image processing device (12). The image processing device (12) generates a second ultrasonic image by applying second image processing different from the first image processing to the Raw data. The image processing device (12) displays the second ultrasonic image on a display of the image processing device (12).

Description

Technical Field

[0001] The invention relates to an ultrasonic diagnosis system and an image processing device. Background Art

[0002] Generally, an ultrasonic diagnostic apparatus acquires Raw data (for example, data not subjected to processing for generating an ultrasonic image for display) by transmitting and receiving ultrasonic waves, generates an ultrasonic image by applying image processing to the Raw data, and displays the ultrasonic image on a display.

[0003] Patent Document 1 describes a device that generates an ultrasonic image based on Raw data received from an ultrasonic diagnostic device.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2009-112357

[0005] Generally, an ultrasonic diagnostic apparatus acquires raw data by transmitting and receiving ultrasonic waves, generates an ultrasonic image by applying image processing to the raw data, and displays the ultrasonic image on a monitor.

[0006] However, if the ultrasonic diagnostic apparatus does not have a function for performing diagnosis (for example, a measurement function or an advanced function such as three-dimensional image processing), diagnosis using the function cannot be performed by the ultrasonic diagnostic apparatus.

[0007] It is conceivable that an ultrasonic image generated by an ultrasonic diagnostic apparatus is transmitted to an external apparatus and displayed by the external apparatus. However, a person (e.g., a doctor or a family member of a subject, etc.) who observes or analyzes an ultrasonic image displayed on a display of an external apparatus does not necessarily want to observe or analyze only the ultrasonic image generated by the ultrasonic diagnostic apparatus. Therefore, the needs of such a person cannot be met by simply transmitting the ultrasonic image displayed on the ultrasonic diagnostic apparatus to an external apparatus and displaying it on the display of the external apparatus. Summary of the invention

[0008] An object of the present invention is to provide a system capable of generating an ultrasonic image in an ultrasonic diagnostic apparatus, displaying the ultrasonic image in the ultrasonic diagnostic apparatus, and performing diagnosis using the ultrasonic image in an external device.

[0009] One embodiment of the present invention is an ultrasonic diagnostic system, characterized in that the ultrasonic diagnostic system includes an ultrasonic diagnostic device and an image processing device, the ultrasonic diagnostic device including: an acquisition unit that acquires Raw data by transmitting and receiving ultrasonic waves; a first image processing unit that generates a first ultrasonic image by applying a first image processing to the Raw data; a first display control unit that displays the first ultrasonic image generated by the first image processing unit on a first display of the ultrasonic diagnostic device; and a first information sending unit that sends the Raw data to which the first image processing is not applied by the first image processing unit to the image processing device, the image processing device including: a second information receiving unit that receives the Raw data; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image by applying a second image processing different from the first image processing to the Raw data; and a second display control unit that displays the second ultrasonic image generated by the second image processing unit on a second display of the image processing device.

[0010] The second image processing may be image processing that is not implemented in the ultrasonic diagnostic apparatus.

[0011] The second image processing may be image processing for generating an image requiring higher-level computing capability than the first image processing.

[0012] The second image processing may be image processing for generating a measurement image, and the second ultrasonic image may be a measurement image.

[0013] The second display control unit may display, on the second display, an image schematically showing an operation panel provided in the ultrasonic diagnostic apparatus and showing a user interface for accepting input of parameters for displaying an image used for diagnosis or measurement.

[0014] The ultrasonic diagnostic device may be a portable ultrasonic diagnostic device.

[0015] Another embodiment of the present invention is an image processing device, characterized in that it includes: a second information receiving unit that receives Raw data from an ultrasonic diagnostic device that acquires Raw data by transmitting and receiving ultrasonic waves and generates a first ultrasonic image by applying a first image processing to the Raw data; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image by applying a second image processing different from the first image processing to the Raw data; and a second display control unit that displays the second ultrasonic image generated by the second image processing unit on a display.

[0016] Another embodiment of the present invention is an ultrasonic diagnostic system, characterized in that the ultrasonic diagnostic system includes an ultrasonic diagnostic device and an image processing device, wherein the ultrasonic diagnostic device includes: an acquisition unit that acquires Raw data by transmitting and receiving ultrasonic waves; a first image processing unit that generates a first ultrasonic image by applying a first image processing to the Raw data; a first display control unit that displays the first ultrasonic image generated by the first image processing unit on a first display of the ultrasonic diagnostic device; and a first information sending unit that compares the Raw data to which the first image processing is not applied by the first image processing unit with a first information construction indicating the first image processing. The image processing device includes: a second information receiving unit that receives the Raw data and the first information that are associated with each other; a second image processing unit that generates the first ultrasonic image by applying the first image processing represented by the first information to the Raw data, and generates a second ultrasonic image different from the first ultrasonic image by applying the second image processing different from the first image processing to the Raw data; and a second display control unit that displays the first ultrasonic image and the second ultrasonic image generated by the second image processing unit on a second display of the image processing device.

[0017] The second image processing may be image processing that is not implemented in the ultrasonic diagnostic apparatus.

[0018] The second image processing may be image processing for generating an image requiring higher-level computing capability than the first image processing.

[0019] The second image processing may be image processing for generating a measurement image, and the second ultrasonic image may be a measurement image.

[0020] The second display control unit may display the first ultrasonic image and the second ultrasonic image generated by the second image processing unit side by side on the second display.

[0021] The second display control unit may display, on the second display, an image schematically showing an operation panel provided in the ultrasonic diagnostic apparatus and showing a user interface for accepting input of parameters for displaying an image used for diagnosis or measurement.

[0022] The ultrasonic diagnostic device may be a portable ultrasonic diagnostic device.

[0023] Another embodiment of the present invention is an image processing device, characterized in that it includes: a second information receiving unit that receives the Raw data and first information indicating the first image processing that are associated with each other from an ultrasonic diagnostic device that acquires Raw data by transmitting and receiving ultrasonic waves and generates a first ultrasonic image by applying the first image processing to the Raw data; a second image processing unit that generates the first ultrasonic image by applying the first image processing indicated by the first information to the Raw data, and generates a second ultrasonic image different from the first ultrasonic image by applying the second image processing that is different from the first image processing to the Raw data; and a second display control unit that displays the first ultrasonic image and the second ultrasonic image generated by the second image processing unit side by side on a display.

[0024] Effects of the Invention

[0025] According to the present invention, an ultrasonic image can be generated and displayed in an ultrasonic diagnostic apparatus, and diagnosis using the ultrasonic image can be performed in an external apparatus. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a diagram showing an example of the configuration of an ultrasonic diagnostic system according to an embodiment.

[0027] Figure 2 It is a diagram showing an example of the configuration of an ultrasonic diagnostic apparatus according to an embodiment.

[0028] Figure 3 It is a diagram showing an example of the structure of an image processing device involved in the embodiment.

[0029] Figure 4 This is a diagram showing an example of the structure of data for information transmission.

[0030] Figure 5 It is a diagram showing data and main memory.

[0031] Figure 6 This is a diagram showing an example of processing by the ultrasonic diagnostic system.

[0032] Figure 7 This is a diagram showing an example of processing by a processor of the image processing device.

[0033] Figure 8 This is a diagram showing an example of processing by a processor of the image processing device.

[0034] Fig. 9 This is a diagram showing an example of processing by a processor of the image processing device.

[0035] Fig.10 It is a diagram showing a display example of an ultrasonic image.

[0036] Fig.11 It is a diagram showing a display example of an ultrasonic image.

[0037] Fig.12 It is a diagram showing a display example of an ultrasonic image.

[0038] Fig.13 It is a diagram showing a display example of an ultrasonic image.

[0039] Fig.14 It is a diagram showing a display example of an ultrasonic image.

[0040] Explanation of symbols

[0041] 10 - ultrasonic diagnostic apparatus, 12 - image processing apparatus, 20, 54 - image processing unit, 30, 56 - display control unit. DETAILED DESCRIPTION

[0042] refer to Figure 1 , an ultrasonic diagnostic system involved in an implementation method is described. Figure 1 This is a block diagram showing the configuration of an ultrasonic diagnostic system according to an embodiment.

[0043] The ultrasonic diagnostic system includes an ultrasonic diagnostic apparatus 10 and an image processing apparatus 12. The ultrasonic diagnostic apparatus 10 and the image processing apparatus 12 have a function of communicating with each other via a communication path N.

[0044] For example, the communication path N is a network such as the Internet or a LAN (Local Area Network). The communication path N may be formed by wireless communication or by wired communication. The communication path N may include a high-speed communication path. For example, the high-speed communication path is a wireless communication path using a 6th generation mobile communication system (6G) or a wireless communication path using a next generation communication system after 6G.

[0045] The ultrasonic diagnostic device 10 transmits ultrasonic waves into the subject through an ultrasonic probe and receives ultrasonic waves reflected in the subject, thereby generating data representing the inside of the subject. By applying image processing to the data, an ultrasonic image representing the internal tissue of the subject is generated. The ultrasonic diagnostic device 10 may be a portable ultrasonic diagnostic device. For example, a flat-panel ultrasonic diagnostic device, a portable ultrasonic diagnostic device, or a laptop-type ultrasonic diagnostic device may be used as the ultrasonic diagnostic device 10. Of course, the ultrasonic diagnostic device 10 may also be a non-portable type ultrasonic diagnostic device.

[0046] Data generated by the ultrasonic diagnostic apparatus 10 is transmitted to the image processing apparatus 12 via the communication path N. For example, when an information transmission request is transmitted from the image processing apparatus 12 to the ultrasonic diagnostic apparatus 10 , data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 via the communication path N in response to the request.

[0047] The image processing device 12 receives data from the ultrasonic diagnostic device 10 via the communication path N. The image processing device 12 generates an ultrasonic image by applying image processing to the data. For example, the image processing device 12 is a computer such as a medical image diagnosis support system, a DICOM server, or a medical image analysis system.

[0048] For example, the ultrasonic diagnostic apparatus 10 generates Raw data by transmitting and receiving ultrasonic waves. Raw data is data to which image processing for generating an ultrasonic image for display has not been applied. Raw data is sent from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. The image processing apparatus 12 generates an ultrasonic image by applying image processing to the Raw data. For example, the ultrasonic image is displayed on a display of the image processing apparatus 12.

[0049] For example, if the user of the image processing device 12 instructs to perform image processing, the image processing device 12 generates an ultrasonic image by applying the image processing instructed by the user to the Raw data. For example, the image processing device 12 performs image processing different from the image processing performed by the ultrasonic diagnostic device 10. Of course, the image processing device 12 may also perform the same image processing as the image processing performed by the ultrasonic diagnostic device 10.

[0050] Below, reference Figure 2 , the structure of the ultrasonic diagnostic apparatus 10 is described. Figure 2 It is a block diagram showing an example of the configuration of the ultrasonic diagnostic apparatus 10 .

[0051] The ultrasonic diagnostic apparatus 10 includes an ultrasonic probe 14 , an ultrasonic transceiver 16 , a signal processor 18 , an image processor 20 , a display processor 22 , a display 24 , an input unit 26 , a controller 28 , a display controller 30 , a converter 32 , a first communication unit 34 , and a storage unit 36 ​​.

[0052] The ultrasonic probe 14 is a device for transmitting and receiving ultrasonic waves. For example, the ultrasonic probe 14 includes an array transducer. The array transducer is formed by arranging a plurality of ultrasonic transducers. The array transducer forms an ultrasonic beam. If the ultrasonic beam is electronically scanned repeatedly, a scanning surface as an echo data input space is formed at each electronic scan. If the ultrasonic beam is scanned, an echo data loading input space is formed. As a scanning method, sector scanning, linear scanning, convex scanning, etc. are used.

[0053] When transmitting ultrasound, the ultrasound transceiver 16 supplies multiple ultrasound transmission signals having a certain delay relationship to multiple ultrasound transducers included in the ultrasound probe 14. Thus, an ultrasound transmission beam is formed. When receiving ultrasound, the ultrasound probe 14 receives reflected waves (RF signals) from the living body. Thus, multiple ultrasound reception signals are output from the ultrasound probe 14 to the ultrasound transceiver 16. The ultrasound transceiver 16 forms an ultrasound reception beam by applying a phase adjustment and addition process to multiple ultrasound reception signals. The data of the ultrasound reception beam is output to the signal processing unit 18. That is, the ultrasound transceiver 16 performs delay processing on the ultrasound reception signals obtained from each ultrasound vibrator according to the delay processing conditions for each ultrasound vibrator, and forms an ultrasound reception beam by adding the multiple ultrasound reception signals obtained from the multiple ultrasound vibrators. The delay processing conditions are defined by ultrasound reception delay data indicating the delay time. The ultrasound reception delay data set (i.e., the delay time set) corresponding to the multiple ultrasound vibrators is supplied from the control unit 28. The ultrasound transceiver 16 functions as an ultrasound transmission beamformer and an ultrasound reception beamformer. For example, the ultrasonic transceiver 16 includes an A / D converter, a detector, an amplifier circuit, etc. In addition, the unit for transmitting and receiving ultrasonic waves and the unit for realizing a beam former may be configured as separate units. In addition, the ultrasonic transceiver 16 corresponds to an example of an acquisition unit.

[0054] The signal processing unit 18 applies signal processing to the beam data output from the ultrasonic transmission and reception unit 16 . For example, the signal processing includes filter processing and amplitude compression such as detection and logarithmic compression. The data to which the signal processing is applied is output to the image processing unit 20 .

[0055] The image processing unit 20 generates an ultrasonic image by applying image processing to the data to which the signal processing is applied. For example, the image processing includes a coordinate conversion function and an interpolation processing function based on a DSC (digital scan converter). For example, the ultrasonic image is a B-mode image, a color Doppler image, a pulsed Doppler image, a strain imaging image (Strain Image) or a shear wave imaging (Shear Wave Elastog raphy Image) and the like.

[0056] The display processing unit 22 generates a display image by superimposing the graphic data required for the ultrasonic image. The display image is output to the display unit 24. One or more images are displayed side by side in a display manner according to the display mode.

[0057] The display unit 24 is a display such as a liquid crystal display or an EL display. Ultrasonic images such as B-mode images are displayed on the display unit 24. The display unit 24 may also be a device that has both a display and an input unit 26. For example, a GUI (Graphic User Interface) may be implemented by the display unit 24. In addition, a user interface such as a touch panel may be implemented by the display unit 24.

[0058] The input unit 26 is a device for the user to input various information (e.g., conditions required for imaging, commands, patient information, etc.) into the ultrasonic diagnostic apparatus 10. For example, the input unit 26 is an operation panel, switch, button, keyboard, mouse, trackball, joystick, etc.

[0059] The control unit 28 controls the operation of each unit of the ultrasonic diagnostic apparatus 10 . The control unit 28 includes a display control unit 30 .

[0060] The display control unit 30 displays the ultrasonic image on the display unit 24. The display control unit 30 may display information or images other than the ultrasonic image on the display unit 24.

[0061] The conversion unit 32 converts the Raw data into data for information transmission. The Raw data is data transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. For example, the conversion unit 32 generates the data for information transmission by attaching header data to the Raw data. For example, US header data and IP header data are attached to the Raw data as header data.

[0062] Raw data is data to which processing for generating an ultrasonic image for display is not applied. For example, data output from the ultrasonic transceiver 16 and to which signal processing by the signal processing unit 18 is not applied is Raw data. In this case, the ultrasonic transceiver 16 is equivalent to an example of an acquisition unit. Data to which signal processing by the signal processing unit 18 is applied can be Raw data. That is, data output from the signal processing unit 18 and to which image processing by the image processing unit 20 is not applied can be Raw data. In this case, the signal processing unit 18 is equivalent to an example of an acquisition unit.

[0063] The US header data is metadata (i.e., incidental information) attached to the Raw data. For example, the US header data includes an imaging mode, information related to the Raw data, scanning information, signal processing information, image processing information, measurement information, frame information, and patient information. The imaging mode is an imaging mode performed in the ultrasonic diagnostic device 10 to acquire Raw data. For example, the imaging mode is B mode (THI), M mode, PW mode, CW mode, CFI mode, CFA mode, TE mode, or SWE mode. The information related to the Raw data includes data length, number of samples, interval, size, address, and data type (rectangular coordinates or polar coordinates r θ). The scanning information includes the number of rows, interval, size, address, and scanning type (sector scanning, linear scanning, or convex scanning). The signal processing information is information indicating the signal processing of the signal processing unit 18. The signal processing information includes information related to gain or filters. The image processing information is information indicating the image processing of the image processing unit 20. The image processing information includes information related to the region of interest (ROI) or filters. The measurement information includes parameters related to the measurement performed in the ultrasonic diagnostic apparatus 10, etc. The frame information is information indicating the size or position of the ultrasonic image, etc. The patient information is information indicating the ID, gender, age, etc. of the patient whose Raw data is acquired. For example, when imaging is performed in the ultrasonic diagnostic apparatus 10, each information included in the US header data is input to the ultrasonic diagnostic apparatus 10 by a user such as an inspection technician or a doctor, or is input to the ultrasonic diagnostic apparatus 10 from an external device such as a server. Information other than the above information may be included in the US header data. The user can specify the information included in the US header data.

[0064] The IP header data is additional information for communication, and includes, for example, information related to the Internet Protocol.

[0065] The first communication unit 34 is a communication interface including a first information transmission unit and a first information reception unit. The first communication unit 34 has a function of transmitting data to an external device and a function of receiving data. For example, the first communication unit 34 transmits Raw data to the image processing device 12 via the communication path N. As described later, the image processing device 12 generates an ultrasonic image by applying image processing to the Raw data transmitted from the ultrasonic diagnostic device 10. As another example, the first communication unit 34 transmits information transmission data to the image processing device 12 via the communication path N. Thus, the Raw data and the US header data are transmitted from the ultrasonic diagnostic device 10 to the image processing device 12.

[0066] The storage unit 36 ​​constitutes one or more storage areas for storing data. For example, the storage unit 36 ​​is a hard disk drive (HDD), a solid state drive (SSD), various memories (for example, RAM, DRAM, ROM, etc.), other storage devices (for example, optical disks, etc.), or a combination thereof. For example, Raw data, ultrasonic image data, information indicating imaging conditions, and patient information are stored in the storage unit 36. US header data or information transmission data may also be stored in the storage unit 36.

[0067] The image processing unit 20 is equivalent to an example of the first image processing unit. The image processing of the image processing unit 20 is equivalent to an example of the first image processing. The ultrasonic image generated by applying the first image processing to the Raw data is equivalent to an example of the first ultrasonic image. The display of the display unit 24 is equivalent to an example of the first display. The display control unit 30 is equivalent to an example of the first display control unit. The first communication unit 34 is equivalent to an example of the first information transmission unit.

[0068] Below, reference Figure 3 , the structure of the image processing device 12 is explained. Figure 3 It is a diagram showing an example of the structure of the image processing device 12.

[0069] The image processing apparatus 12 includes a second communication unit 38 , a receiving unit 40 , a main memory 42 , a memory control unit 44 , an IO device 46 , an output unit 48 , an input unit 50 , and a processor 52 .

[0070] The second communication unit 38 is a communication interface including a second information sending unit and a second information receiving unit. The second communication unit 38 has a function of sending data to an external device and a function of receiving data. For example, the second communication unit 38 receives Raw data sent from the ultrasonic diagnostic device 10 via the communication path N. As described later, the image processing unit 54 generates an ultrasonic image by applying image processing to the Raw data. The image processing performed by the image processing unit 54 is an image processing different from the first image processing performed in the ultrasonic diagnostic device 10. Of course, the image processing unit 54 can also perform the same image processing as the first image processing performed in the ultrasonic diagnostic device 10. As another example, the second communication unit 38 receives information sending data sent from the ultrasonic diagnostic device 10 via the communication path N. Thus, the second communication unit 38 receives Raw data.

[0071] The receiving unit 40 receives the information transmission data received by the second communication unit 38 and performs processing to store the information transmission data in the main memory 42 .

[0072] The main memory 42 constitutes one or more storage areas for storing data. For example, the main memory 42 is a hard disk drive (HDD), a solid state drive (SSD), various memories (for example, RAM, DRAM, ROM, etc.), other storage devices (for example, optical disks, etc.), or a combination thereof. For example, information transmission data is stored in the main memory 42. Raw data and header data may also be stored in the main memory 42, respectively. Other information may also be stored in the main memory 42.

[0073] The memory control unit 44 controls the main memory 42. For example, the memory control unit 44 stores the information transmission data received by the receiving unit 40 in the main memory 42. In addition, the memory control unit 44 controls reading of data from the main memory 42.

[0074] The IO device 46 is connected to the output unit 48 and the input unit 50. For example, various information is output to the output unit 48 via the IO device 46, and is input from the input unit 50 to the image processing apparatus 12 via the IO device 46.

[0075] The output unit 48 includes a display unit. The display unit is a display such as a liquid crystal display, an EL display, etc. The display unit may be a device that has both a display and an input unit 50. For example, a GUI (Graphic User Interface) may be implemented by the display unit. In addition, a user interface such as a touch panel may be implemented by the display unit. The output unit 48 may include a speaker.

[0076] The input unit 50 is a device for a user to input various information into the image processing device 12. For example, the input unit 50 is an operation panel, a switch, a button, a keyboard, a mouse, a trackball, a joystick, or the like.

[0077] The processor 52 includes a control unit, a calculation unit, a cache, a bus I / F, etc. The control unit controls the image processing device 12. The calculation unit performs various calculations. In addition, the processor 52 includes an image processing unit 54 and a display control unit 56.

[0078] The image processing unit 54 generates an ultrasonic image by applying image processing to the Raw data. This image processing may include the above-mentioned signal processing.

[0079] The display control unit 56 displays the ultrasonic image on the display of the output unit 48. The display control unit 56 may display information or images other than the ultrasonic image on the display of the output unit 48.

[0080] The image processing unit 54 is equivalent to an example of the second image processing unit. The image processing of the image processing unit 54 is equivalent to an example of the second image processing. The ultrasonic image generated by applying the second image processing to the Raw data is equivalent to an example of the second ultrasonic image. The display of the output unit 48 is equivalent to an example of the second display. The display control unit 56 is equivalent to an example of the second display control unit. The second communication unit 38 is equivalent to an example of the second information receiving unit.

[0081] Below, reference Figure 4 , explaining the structure of data used for sending information. Figure 4 This shows an example of the structure of data for information transmission.

[0082] The ultrasonic diagnostic apparatus 10 generates Raw data 57 by transmitting and receiving ultrasonic waves. The converter 32 generates information transmission data 62 by adding US header data 58 and IP header data 60 to the Raw data 57. The information transmission data 62 is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12.

[0083] For example, Figure 5 As shown, the information transmission data 62 is stored in the main memory 42 of the image processing device 12 . Figure 5 The Raw data storage area 42a is shown in FIG.

[0084] For example, the image processing unit 54 of the image processing device 12 reads the designated Raw data from the main memory 42, applies calculation, image processing, or sound processing to the Raw data according to the signal processing or image processing indicated by the US header data, thereby generating ultrasonic image or sound data. The image processing unit 54 may also convert the measurement information or patient information included in the US header data into image data. The ultrasonic image, measurement information, and patient information are displayed on the display of the output unit 48, and the sound data is output from the speaker.

[0085] As Figure 4 and Figure 5 In an example different from the example shown, the Raw data may be sent from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 and stored in the main memory 42 of the image processing apparatus 12. The image processing unit 54 reads the designated Raw data from the main memory 42, applies calculation, image processing, or sound processing to the Raw data according to the designated signal processing or image processing, thereby generating an ultrasonic image or sound data. The signal processing or image processing applied at this time may be a process different from the signal processing or image processing applied in the ultrasonic diagnostic apparatus 10. That is, the image processing unit 54 may generate an ultrasonic image or sound data by applying a signal processing or image processing different from the signal processing or image processing applied in the ultrasonic diagnostic apparatus 10 to the Raw data.

[0086] Below, reference Figure 6 , the processing flow of the ultrasonic diagnostic system is explained. Figure 6 The following instructions or responses are performed via the communication path N between the first communication unit 34 of the ultrasonic diagnostic apparatus 10 and the second communication unit 38 of the image processing apparatus 12 .

[0087] First, the image processing device 12 performs authentication (S01). For example, authentication is performed using the user's personal information such as the model, password, face or fingerprint that is pre-registered in the image processing device 12. If the authentication is successful, the processing after step S02 is performed. If the authentication fails, the processing after step S02 is not performed. In addition, authentication may not be performed. In this case, the processing after step S02 is performed instead of step S01. The processing after step S02 is described below.

[0088] For example, the instruction screen is displayed on the display of the image processing device 12. When the user requests access to the ultrasonic diagnostic apparatus 10 on the instruction screen (S02), the image processing device 12 instructs the ultrasonic diagnostic apparatus 10 to access (S03).

[0089] When receiving the access instruction, the ultrasonic diagnostic apparatus 10 allows access to the ultrasonic diagnostic apparatus 10 (S04) and sends a response corresponding to the instruction to the image processing apparatus 12 (S05). The ultrasonic diagnostic apparatus 10 may also use the user's personal information (e.g., personal information input to the image processing apparatus 12) to determine whether to allow access.

[0090] When receiving a response from the ultrasonic diagnostic apparatus 10, the image processing apparatus 12 requests the ultrasonic diagnostic apparatus 10 to transmit the Raw data (S06). The image processing apparatus 12 instructs the ultrasonic diagnostic apparatus 10 to transmit the Raw data (S07).

[0091] When receiving the instruction to transmit the Raw data, the ultrasonic diagnostic apparatus 10 transmits information transmission data including the Raw data, US header data, and IP header data to the image processing apparatus 12 ( S08 ).

[0092] The ultrasonic diagnostic apparatus 10 may include the Raw data currently acquired by the ultrasonic diagnostic apparatus 10 in the information transmission data, and transmit the information transmission data to the image processing apparatus 12. The ultrasonic diagnostic apparatus 10 may include the Raw data specified by the user of the image processing apparatus 12 in the information transmission data, and transmit the information transmission data to the image processing apparatus 12. For example, a list of Raw data acquired by the ultrasonic diagnostic apparatus 10 (for example, a list of file names or thumbnail images) is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 and displayed on the display of the image processing apparatus 12. When the user of the image processing apparatus 12 specifies Raw data from the list, identification information for identifying the specified Raw data is transmitted from the image processing apparatus 12 to the ultrasonic diagnostic apparatus 10. The ultrasonic diagnostic apparatus 10 transmits the information transmission data including the Raw data indicated by the identification information to the image processing apparatus 12.

[0093] In response to the instruction to send the Raw data, the information transmission data is sent to the image processing device 12 (S09). The Raw data is stored in the main memory 42 of the image processing device 12. Then, the image processing device 12 generates an ultrasonic image by applying image processing to the Raw data. The ultrasonic image is displayed on the display of the image processing device 12.

[0094] Then, when the user requests the image processing device 12 to stop transmitting the Raw data ( S10 ), the image processing device 12 instructs the ultrasonic diagnostic device 10 to stop transmitting ( S11 ).

[0095] When receiving the instruction to stop transmission, the ultrasonic diagnostic apparatus 10 stops transmission of the information transmission data (S12). As a result, the information transmission data is not transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. A response to stop transmission of information is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12 (S13).

[0096] As an example different from the above example, when receiving an instruction to send Raw data, the ultrasonic diagnostic apparatus 10 may send the Raw data to the image processing apparatus 12 (S08). In response to the instruction to send Raw data, the Raw data is sent to the image processing apparatus 12 (S09). The image processing apparatus 12 generates an ultrasonic image by applying image processing to the Raw data. The ultrasonic image is displayed on the display of the image processing apparatus 12.

[0097] Below, reference Figure 7 , the processing of the processor 52 of the image processing device 12 is described.

[0098] When Raw data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, the Raw data is stored in the storage area 42b of the main memory 42. As another example, when information transmission data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, the Raw data and the US header data are stored in the storage area 42b of the main memory 42. The image processing command is stored in the storage area 42c of the main memory 42. For example, the image processing command is input to the image processing apparatus 12 via the input unit 50 and stored in the main memory 42, or is input to the image processing apparatus 12 via the second communication unit 38 and stored in the main memory 42.

[0099] For example, the processor 52 includes a bus interface, a cache, a control device and an operation device. The control device includes an extractor and a decoder. The operation device includes an ALU (Arithmetic Logic Unit) and a register.

[0100] The commands stored in the storage area 42c are output to the extractor via the system bus, the bus interface and the cache, and are converted into control information by the decoder. The control information is output to the ALU. The Raw data stored in the storage area 42b is output to the register via the system bus, the bus interface and the cache, and is output from the register to the ALU. The ALU performs operations on the Raw data as an object based on the control information. The ALU outputs the result data generated by the operation to the main memory 42 via the register, the cache, the bus interface and the system bus. The result data is stored in the storage area 42d of the main memory 42. For example, the result data is ultrasonic image data.

[0101] In the present embodiment, the image processing unit 20 of the ultrasonic diagnostic apparatus 10 generates a first ultrasonic image by applying the first image processing to the Raw data. The display control unit 30 displays the first ultrasonic image on the display unit 24 .

[0102] For example, the ultrasonic diagnostic apparatus 10 sends the Raw data to the image processing apparatus 12. The image processing apparatus 12 receives the Raw data. The processor 52 of the image processing apparatus 12 applies a second image processing different from the first image processing to the Raw data to generate a second ultrasonic image different from the first ultrasonic image. The processor 52 displays the second ultrasonic image on the display of the output unit 48.

[0103] As another example, the ultrasonic diagnostic apparatus 10 associates the Raw data with the first information indicating the first image processing and transmits the associated Raw data to the image processing apparatus 12. For example, the first information is included in the US header data and transmitted to the image processing apparatus 12 in a state attached to the Raw data. The image processing apparatus 12 receives the Raw data and the first information (for example, the first information included in the US header data) associated with each other. The processor 52 of the image processing apparatus 12 generates a first ultrasonic image by applying the first image processing indicated by the first information to the Raw data. Furthermore, the processor 52 generates a second ultrasonic image different from the first ultrasonic image by applying a second image processing different from the first image processing to the Raw data. The processor 52 displays the first ultrasonic image and the second ultrasonic image side by side on the display of the output unit 48. Of course, the processor 52 may display the first ultrasonic image and the second ultrasonic image separately on the display instead of displaying the first ultrasonic image and the second ultrasonic image side by side on the display. The processor 52 may switch the displayed ultrasonic image between the first ultrasonic image and the second ultrasonic image in accordance with the user's instruction.

[0104] For example, the second image processing is image processing that is not implemented in the ultrasonic diagnostic device 10. That is, the second image processing is image processing that is implemented by a function that the ultrasonic diagnostic device 10 does not have. For example, the second image processing includes a measurement function, an inspection function, and a diagnosis function that the ultrasonic diagnostic device 10 does not have. Thus, it is possible to use the image processing device 12 to perform measurements, inspections, or diagnoses that cannot be performed in the ultrasonic diagnostic device 10. For example, the second image processing is image processing that generates an image that requires a higher level of computing power than the first image processing. The second ultrasonic image is an image that requires a higher level of computing power than the first ultrasonic image.

[0105] For example, the second image processing is image processing for generating a diagnostic image, and the second ultrasonic image is an image used for diagnosis. By executing the second image processing by the image processing device 12, a user (for example, a doctor) of the image processing device 12 can refer to the second ultrasonic image used for diagnosis to perform a diagnosis. For example, a user such as a doctor can use the second ultrasonic image to perform a diagnosis that cannot be performed using only the first ultrasonic image displayed on the ultrasonic diagnostic device 10.

[0106] As another example, the second image processing is image processing for generating a measurement image, and the second ultrasonic image is the measurement image. By executing the second image processing by the image processing device 12, a user (e.g., a doctor) of the image processing device 12 can obtain a measurement result from the second ultrasonic image. For example, a user such as a doctor can use the second ultrasonic image to perform a measurement that cannot be performed using only the first ultrasonic image displayed on the ultrasonic diagnostic device 10.

[0107] Below, reference Figure 8 , a specific example of the first image processing performed by the processor 52 of the image processing device 12 is described. Figure 8 In the figure, the solid line represents the flow of signal data (for example, Raw data, etc.), and the dotted line represents the flow of control data.

[0108] When the information transmission data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, the second communication unit 38 receives the information transmission data. The receiving unit 40 receives the information transmission data from the second communication unit 38, and stores the Raw data and the header data (US header data and IP header data) in the main memory 42. When the Raw data is compressed, the receiving unit 40 decompresses (decompresses) the compressed data. The receiving unit 40 may convert the format of the Raw data.

[0109] Signal processing information, image information, image processing information, image reconstruction information, analysis / measurement information, patient information, and display layout information are information included in US header data attached to Raw data (an example of first information), and are stored in the main memory 42 .

[0110] For example, the processor 52 performs signal processing, 2D image processing, 3D image processing, image reconstruction processing, image analysis / measurement processing, and image composition processing on the Raw data. In addition, these processes are examples, and only part of these processes may be performed.

[0111] The processor 52 reads the Raw data from the main memory 42 and applies the signal processing indicated by the signal processing information to the Raw data (signal processing). Thus, post-signal processing data is generated and stored in the main memory 42 .

[0112] If the processor 52 reads the post signal processing data, image information and image processing information from the main memory 42 and applies 2D image processing (2D image processing) to the post signal processing data, post 2D image processing data is generated and stored in the main memory 42. The image information includes geometric information or three-dimensional structure information.

[0113] If the processor 52 reads the post signal processing data, image information and image processing information from the main memory 42 and applies three-dimensional image processing (3D image processing) to the post signal processing data, post 3D image processing data is generated and stored in the main memory 42 .

[0114] If the processor 52 reads the post-2D image processing data, the post-3D image processing data and the image reconstruction information from the main memory 42 and performs a reconstruction process (image reconstruction process), post-image reconstruction data (Post Image Reconstruction data) is generated and stored in the main memory 42 .

[0115] If the processor 52 reads the post-2D image processing data, post-3D image processing data, post-image reconstruction data and analysis / measurement information from the main memory 42 and performs analysis processing (image analysis / measurement processing), post-analysis / measurement data (Post Analysis / Measurement data) is generated and stored in the main memory 42.

[0116] If the processor 52 reads the post-2D image processing data, post-3D image processing data, post-image reconstruction data, post-analysis / measurement data, patient information, and display layout information from the main memory 42 and performs synthesis processing (image synthesis processing), display image data is generated and stored in the main memory 42. The display image data is output to the output unit 48 via the IO device 46 and displayed on the display of the output unit 48. The synthesized data can be selected by the user, and the data selected by the user can be synthesized.

[0117] When the information (an example of the first information) included in the US header data is used as signal processing information, image information, image processing information, image reconstruction information, analysis / measurement information, patient information, and display layout information, a first ultrasonic image is generated. For example, the first ultrasonic image is displayed on the display of the output unit 48.

[0118] Figure 8 The processing shown is only an example, and the processing to be executed may be changed depending on, for example, the diagnosis site, analysis, measurement, patient, or medical department.

[0119] Below, reference Fig. 9 , a specific example of the second image processing performed by the processor 52 of the image processing device 12 is described. Figure 8 In the figure, the solid line represents the flow of signal data (for example, Raw data, etc.), and the dotted line represents the flow of control data.

[0120] The input information is stored in the main memory 42. The input information includes information indicating the second image processing, etc. The input information is input to the image processing device 12 from the input unit 50 of the image processing device 12 via the IO device 46 and stored in the main memory 42. The input information can be received by the second communication unit 38 and input to the image processing device 12.

[0121] The Raw data stored in the main memory 42 is data transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. When information transmission data including Raw data is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12, the Raw data stored in the main memory 42 is data included in the information transmission data.

[0122] Signal processing information, image information, image processing information, image reconstruction information, analysis / measurement information, patient information, and display layout information are included in the input information and are stored in the main memory 42. For example, a user of the image processing device 12 operates the input unit 50 to input each information included in the input information.

[0123] For example, the processor 52 performs signal processing, 2D image processing, 3D image processing, image reconstruction processing, image analysis / measurement processing, and image composition processing on the Raw data. In addition, these processes are examples, and only part of these processes may be performed.

[0124] The processor 52 reads the Raw data from the main memory 42 and applies the signal processing indicated by the signal processing information to the Raw data (signal processing). Thus, post-signal processing data is generated and stored in the main memory 42 .

[0125] If the processor 52 reads the post signal processing data, image information and image processing information from the main memory 42 and applies 2D image processing (2D image processing) to the post signal processing data, post 2D image processing data is generated and stored in the main memory 42. The image information includes geometric information or three-dimensional structure information.

[0126] If the processor 52 reads the post signal processing data, image information and image processing information from the main memory 42 and applies three-dimensional image processing (3D image processing) to the post signal processing data, post 3D image processing data is generated and stored in the main memory 42 .

[0127] If the processor 52 reads the post-2D image processing data, the post-3D image processing data and the image reconstruction information from the main memory 42 and performs a reconstruction process (image reconstruction process), post-image reconstruction data (Post Image Reconstruction data) is generated and stored in the main memory 42 .

[0128] If the processor 52 reads the post-2D image processing data, post-3D image processing data, post-image reconstruction data and analysis / measurement information from the main memory 42 and performs analysis processing (image analysis / measurement processing), post-analysis / measurement data (Post Analysis / Measurement data) is generated and stored in the main memory 42.

[0129] If the processor 52 reads the post-2D image processing data, post-3D image processing data, post-image reconstruction data, post-analysis / measurement data, patient information, and display layout information from the main memory 42 and performs synthesis processing (image synthesis processing), display image data is generated and stored in the main memory 42. The display image data is output to the output unit 48 via the I / O device 46 and displayed on the display of the output unit 48. The synthesized data can be selected by the user, and the data selected by the user can be synthesized.

[0130] A second ultrasonic image is generated using information included in the input information inputted via the input unit 50 as signal processing information, image information, image processing information, image reconstruction information, analysis / measurement information, patient information, and display layout information. For example, the second ultrasonic image is displayed on the display of the output unit 48.

[0131] Fig. 9 The processing shown is only an example, and the processing to be executed may be changed depending on, for example, the diagnosis site, analysis, measurement, patient, or medical department.

[0132] Hereinafter, specific examples of the first ultrasonic image and the second ultrasonic image will be described.

[0133] refer to Fig.10 , an ultrasonic image displayed on the ultrasonic diagnostic apparatus 10 will be described. Fig.10 A first ultrasonic image is shown.

[0134] The screen 64 is displayed on the display of the display unit 24 of the ultrasonic diagnostic apparatus 10. The ultrasonic image 66 is a first ultrasonic image and is displayed on the screen 64. The image processing unit 20 of the ultrasonic diagnostic apparatus 10 generates the ultrasonic image 66 by applying the first image processing to the raw data (hereinafter, for convenience of explanation, referred to as "raw data A"). For example, the first image processing may be image processing designated by a user of the ultrasonic diagnostic apparatus 10 (for example, a testing technician), or may be image processing pre-registered in an examination protocol.

[0135] For example, the ultrasonic image 66 is an image obtained through the apex approach, and is a four-chamber cross-sectional image showing the apex. In addition, the four-chamber cross-sectional image is only an example of the first ultrasonic image, and other cross-sectional images, Doppler images, or color Doppler images may also be acquired and displayed as the first ultrasonic image.

[0136] The first information indicating the first image processing for generating the ultrasonic image 66 is included in the US header data attached to the Raw data A for generating the ultrasonic image 66. The information transmission data including the US header data and the Raw data A is transmitted from the ultrasonic diagnostic apparatus 10 to the image processing apparatus 12. The image processing unit 54 of the image processing apparatus 12 generates the ultrasonic image 66 by applying the first image processing indicated by the first information to the Raw data A. As a result, the ultrasonic image 66 is reproduced in the image processing apparatus 12.

[0137] refer to Fig.11 , an ultrasonic image displayed on the image processing device 12 is described. Fig.11 The screen displayed on the image processing device 12 is shown.

[0138] The screen 68 is displayed on the display of the output unit 48 of the image processing device 12. The screen 68 includes a first display area 70 and a second display area 72. The first display area 70 is an area for displaying a first ultrasonic image. The second display area 72 is an area for displaying a second ultrasonic image. The first display area 70 and the second display area 72 are arranged side by side on the screen 68. Thus, the first ultrasonic image and the second ultrasonic image are displayed side by side on the screen 68.

[0139] For example, the image processing unit 54 of the image processing device 12 generates a first ultrasonic image by applying the first image processing indicated by the first information to the Raw data (Raw data included in the information transmission data) transmitted from the ultrasonic diagnostic device 10. The first information is included in the US header data attached to the Raw data. Thus, the first ultrasonic image generated by the ultrasonic diagnostic device 10 is reproduced by the image processing device 12.

[0140] For example, the image processing unit 54 generates an ultrasonic image 66 as a first ultrasonic image by applying the first image processing indicated by the first information to the Raw data A. The first information is included in the US header data attached to the Raw data A. Thus, the ultrasonic image 66 is reproduced by the image processing device 12 .

[0141] like Fig.11 As shown, the display control unit 56 of the image processing device 12 displays the ultrasonic image 66 in the first display area 70. Thus, the user of the image processing device 12 (for example, a doctor or the like) can observe the ultrasonic image 66 displayed on the ultrasonic diagnostic apparatus 10.

[0142] In addition, the upper menu 74 and the side menu 76 are displayed on the screen 68. For example, items such as analysis or measurement of the ultrasonic image are included in the upper menu 74 and the side menu 76. When the user selects a target analysis or measurement from the upper menu 74 or the side menu 76, the image processing unit 54 generates a second ultrasonic image by applying the second image processing for realizing the selected analysis or measurement to the raw data. The second ultrasonic image is an ultrasonic image for realizing the analysis or measurement. The display control unit 56 displays the second ultrasonic image in the second display area 72.

[0143] Furthermore, as indicated by reference numeral 78, patient information and setting information are displayed on the screen 68. For example, the patient information is information included in the US header data, and the setting information is information indicating settings for image processing.

[0144] exist Fig.11 In the example shown, myocardial strain imaging (Strain Image), which is one of the ultrasonic imaging methods, is included in the side menu 76. Myocardial strain imaging is a method of imaging changes in myocardial motion and evaluating wall motion caused by myocardial ischemia. For example, when myocardial strain imaging is selected from the side menu 76, a separate menu 80 for myocardial strain imaging is further displayed on the screen 68. The separate menu 80 includes items such as the cross section to be analyzed or measured. By selecting the items included in the separate menu 80, the user can specify the cross section to be analyzed or measured. The image processing unit 54 applies the second image processing to the Raw data according to the item selected by the user. Of course, myocardial strain imaging is only an example, and other imaging methods, other analyses or measurements, etc. may also be included in the side menu 76.

[0145] Fig.12 , an ultrasonic image 82 as a second ultrasonic image is shown. The image processing unit 54 generates the ultrasonic image 82 by applying the second image processing corresponding to the analysis or measurement selected by the user to the Raw data A. The display control unit 56 displays the ultrasonic image 82 in the second display area 72 .

[0146] The ultrasonic image 82 is an image for measuring myocardial strain imaging. For example, the ultrasonic image 82 is an image showing a myocardial strain image of a four-chamber cross-sectional image acquired through an apical approach and a result of local strain measurement.

[0147] The ultrasonic image 66 as the first ultrasonic image and the ultrasonic image 82 as the second ultrasonic image are images generated based on the same Raw data A. The ultrasonic image 66 is the same as the ultrasonic image displayed on the ultrasonic diagnostic apparatus 10 .

[0148] The user can compare the first ultrasonic image and the second ultrasonic image to perform a diagnosis or inspection, etc. For example, the user can compare the ultrasonic image 66, which is a four-chamber cross-sectional image acquired through the apical approach, with the ultrasonic image 82 showing the result of myocardial strain imaging measurement to perform a diagnosis or inspection, etc.

[0149] For example, the myocardial strain imaging measurement function is a function that the ultrasonic diagnostic apparatus 10 does not have (i.e., a function that is realized by image processing that is not realized in the ultrasonic diagnostic apparatus 10). By having the image processing apparatus 12 perform the myocardial strain imaging measurement, the image processing apparatus 12 can realize the myocardial strain imaging measurement that cannot be realized only by the first ultrasonic image displayed on the ultrasonic diagnostic apparatus 10.

[0150] Fig.13 2 shows another display example of an ultrasonic image. For example, an ultrasonic image 84 is displayed in the first display area 70 , and an ultrasonic image 86 is displayed in the second display area 72 .

[0151] The ultrasonic image 84 is an example of a first ultrasonic image generated based on certain raw data (referred to as “Raw data B” for convenience of explanation). That is, the ultrasonic image 84 is an image generated by applying the first image processing to the Raw data B. The ultrasonic image 84 is an image displayed on the ultrasonic diagnostic apparatus 10 .

[0152] The ultrasonic image 86 is an example of a second ultrasonic image generated based on the Raw data B. That is, the ultrasonic image 86 is an image generated by applying the second image processing to the Raw data B.

[0153] For example, the ultrasonic image 84 is an image representing a short-axis cross section of the heart. One of the short-axis cross sections can be specified by a user of the ultrasonic diagnostic device 10 (for example, an examination technician) or can be pre-registered in the examination protocol. The ultrasonic image 86 is an image representing multiple short-axis cross sections of the same heart. The ultrasonic image 86 includes multiple images. Each of the multiple images represents a different short-axis cross section. For example, when image processing for generating images representing multiple short-axis cross sections is selected as the second image processing by a user of the image processing device 12 (for example, a doctor), the image processing unit 54 generates the ultrasonic image 86 by applying the image processing to the Raw data B.

[0154] For example, the user can perform diagnosis or inspection by comparing the ultrasonic image 84 showing a certain short-axis cross section of the heart with the ultrasonic images 86 showing a plurality of short-axis cross sections of the same heart.

[0155] For example, the function of generating ultrasonic images showing a plurality of short-axis cross sections is a function that the ultrasonic diagnostic apparatus 10 does not have (i.e., a function that is realized by image processing that is not realized in the ultrasonic diagnostic apparatus 10). By having the image processing apparatus 12 execute this function, the image processing apparatus 12 can realize a diagnosis or examination that cannot be realized only by the first ultrasonic image displayed on the ultrasonic diagnostic apparatus 10.

[0156] exist Figures 11 to 13 In the example shown, the display control unit 56 displays the first ultrasonic image and the second ultrasonic image side by side on the screen 68. This is only one display example, and the display control unit 56 may display the first ultrasonic image and the second ultrasonic image on different screens instead of displaying the first ultrasonic image and the second ultrasonic image side by side on the screen 68. For example, if the user of the image processing device 12 instructs to display the first ultrasonic image, the display control unit 56 displays the first ultrasonic image on the display of the output unit 48. If the user of the image processing device 12 instructs to display the second ultrasonic image, the display control unit 56 displays the second ultrasonic image on the display of the output unit 48. The display control unit 56 may also switch the displayed ultrasonic image between the first ultrasonic image and the second ultrasonic image according to the switching instruction of the user.

[0157] As Fig.11 and Fig.12 In an example different from the example shown, the screen 68 may include the second display area 72 but not the first display area 70. In this case, the display control unit 56 displays the ultrasonic image 82 as the second ultrasonic image in the second display area 72 but does not display the first ultrasonic image. Fig.13The display control unit 56 displays the ultrasonic image 86 as the second ultrasonic image in the second display area 72, and does not display the first ultrasonic image. Thus, the user can perform diagnosis or examination by referring to the second ultrasonic image different from the first ultrasonic image.

[0158] Fig.14 2 shows another display example of an ultrasonic image. An ultrasonic image 66 as a first ultrasonic image is displayed in the first display area 70 . The display control unit 56 displays a virtual console 88 in the second display area 72 .

[0159] The virtual console 88 is an image schematically showing an operation panel (for example, an operation panel included in the input unit 26) provided in the ultrasonic diagnostic apparatus 10, and is an image showing a user interface for accepting input of parameters for displaying an image used in diagnosis or measurement. For example, the parameters are gain, TGC (time gain control), focus, depth of field, function buttons, and the like.

[0160] For example, the virtual console 88 is an image showing a plurality of input devices such as a mouse, a trackball, a switch, a keyboard, a contact sensor, or haptics. The input devices shown in the virtual console 88 correspond to the input devices included in the input unit 26 of the ultrasonic diagnostic apparatus 10 .

[0161] The user inputs parameters for displaying an ultrasonic image by operating an input device represented by the virtual console 88. The virtual console 88 accepts the input.

[0162] For example, the image processing unit 54 applies the second image processing to the Raw data according to the parameters input via the virtual console 88 , thereby generating a second ultrasonic image reflecting the parameters. The second ultrasonic image is displayed on the screen 68 .

[0163] The parameters inputted via the virtual console 88 may be sent from the image processing device 12 to the ultrasonic diagnostic device 10. In this case, the ultrasonic transceiver 16 of the ultrasonic diagnostic device 10 may transmit and receive ultrasonic waves according to the parameters, and the image processing unit 20 of the ultrasonic diagnostic device 10 may also apply the first image processing to the Raw data according to the parameters. For example, the user of the image processing device 12 (e.g., a doctor) may input parameters using the virtual console 88 while referring to the first ultrasonic image displayed on the screen 68, thereby instructing the user of the ultrasonic diagnostic device 10 (e.g., an examiner) to use the parameters or perform imaging.

[0164] Furthermore, the display control unit 56 may display parameters (for example, gain, etc.) used to generate the first ultrasonic image together with the first ultrasonic image on the screen 68. Thus, the user of the image processing device 12 can understand the parameters or conditions under which the first ultrasonic image was captured.

[0165] As Fig.14 In a different example from the example shown, the screen 68 may include the second display area 72 but not the first display area 70. In this case, the display control unit 56 displays the virtual console 88 in the second display area 72 but does not display the first ultrasonic image. Thus, the user of the image processing device 12 can use the virtual console 88 to instruct the user of the ultrasonic diagnostic device 10 to use parameters or perform imaging.

[0166] The ultrasonic diagnostic system involved in the embodiment can be applied to POCT (point of care testing), for example. For example, when a small and portable ultrasonic diagnostic device is used as the ultrasonic diagnostic device 10, an ultrasonic examination can be performed in a hospital room or at home. However, in general, ultrasonic diagnostic devices for POCT do not have the performance required for advanced diagnosis. For example, ultrasonic diagnostic devices for POCT sometimes do not have advanced image processing or measurement functions. According to the ultrasonic diagnostic system involved in the embodiment, even if advanced image processing or measurement functions are not implemented by the ultrasonic diagnostic device 10, if the image processing device 12 has the performance of performing advanced image processing or the performance of implementing measurement functions, advanced image processing or measurement functions can be implemented.

[0167] Furthermore, the POCT ultrasonic diagnostic device can be moved to various places to acquire ultrasonic images. Therefore, the examiner can use the POCT ultrasonic diagnostic device to acquire ultrasonic images, and the doctor can use the image processing device 12 at a remote location to perform signal processing, image processing, measurement, and analysis suitable for diagnosis. Thus, the division of labor among medical practitioners can be achieved. For example, the ultrasonic diagnostic system involved in the embodiment can be used in home care or emergency treatment.

[0168] The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 can be implemented by hardware resources such as a processor or an electronic circuit, for example. In this implementation, a device such as a memory can be used as needed. The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 can be implemented by a computer, for example. That is, the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 can be implemented in whole or in part by the cooperation of hardware resources such as a CPU (Central Processing Unit) and a memory possessed by the computer and software (program) that defines the actions of the CPU, etc. The program is stored in the storage unit 36 ​​or other storage device of the ultrasonic diagnostic apparatus 10 via a recording medium such as a CD or a DVD or via a communication path such as a network. As another example, the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be implemented by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate Array). A GPU (Graphics Processing Unit) or the like may also be used. The signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may also be implemented by a single device. Each function of the signal processing unit 18, the image processing unit 20, the display processing unit 22, the control unit 28, the display control unit 30, and the conversion unit 32 may be implemented by one or more devices.

[0169] The receiving unit 40, the memory control unit 44, the image processing unit 54 and the display control unit 56 can be implemented by hardware resources such as a processor or an electronic circuit. In this implementation, devices such as a memory can be used as needed. The receiving unit 40, the memory control unit 44, the image processing unit 54 and the display control unit 56 can also be implemented by a computer. That is, the receiving unit 40, the memory control unit 44, the image processing unit 54 and the display control unit 56 can also be implemented in whole or in part by the cooperation of hardware resources such as a CPU (Central Processing Unit: central processing unit) or a memory possessed by a computer and software (program) that limits the actions of the CPU and the like. The program is stored in the main memory 42 or other storage device of the image processing device 12 via a recording medium such as a CD or DVD or via a communication path such as a network. As another example, the receiving unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 can be implemented by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate Array). A GPU (Graphics Processing Unit) or the like can also be used. The receiving unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 can also be implemented by a single device. Each function of the receiving unit 40, the memory control unit 44, the image processing unit 54, and the display control unit 56 can be implemented by one or more devices.

Claims

1. An ultrasonic diagnostic system, characterized in that: The ultrasonic diagnostic system includes an ultrasonic diagnostic device and an image processing device. The ultrasonic diagnostic device comprises: The acquisition part acquires Raw data by sending and receiving ultrasonic waves; a first image processing unit that generates a first ultrasonic image by applying a first image processing to the Raw data; a first display control unit that displays the first ultrasonic image generated by the first image processing unit on a first display of the ultrasonic diagnostic apparatus; and a first information transmitting unit that transmits the Raw data to which the first image processing has not been applied by the first image processing unit to the image processing device; The image processing device comprises: A second information receiving unit receives the Raw data; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image by applying a second image processing different from the first image processing to the Raw data; and The second display control unit displays the second ultrasonic image generated by the second image processing unit on a second display of the image processing device.

2. The ultrasonic diagnostic system according to claim 1, characterized in that: The second image processing is image processing that is not implemented in the ultrasonic diagnostic apparatus.

3. The ultrasonic diagnostic system according to claim 1, characterized in that: The second image processing is image processing for generating an image requiring higher-level computing capability than the first image processing.

4. The ultrasonic diagnostic system according to claim 3, characterized in that: The second image processing is image processing for generating an image for measurement, The second ultrasonic image is a measurement image.

5. The ultrasonic diagnostic system according to claim 1, characterized in that: The second display control unit displays, on the second display, an image schematically showing an operation panel provided in the ultrasonic diagnostic apparatus and showing a user interface for accepting input of parameters for displaying an image used for diagnosis or measurement.

6. The ultrasonic diagnostic system according to claim 1, characterized in that: The ultrasonic diagnostic device is a portable ultrasonic diagnostic device.

7. An image processing device, characterized in that: include: a second information receiving unit that receives the Raw data from an ultrasonic diagnostic apparatus that acquires the Raw data by transmitting and receiving ultrasonic waves and generates a first ultrasonic image by applying a first image processing to the Raw data; a second image processing unit that generates a second ultrasonic image different from the first ultrasonic image by applying a second image processing different from the first image processing to the Raw data; and The second display control unit displays the second ultrasonic image generated by the second image processing unit on a display.

8. An ultrasonic diagnostic system, characterized in that: The ultrasonic diagnostic system includes an ultrasonic diagnostic device and an image processing device. The ultrasonic diagnostic device comprises: The acquisition part acquires Raw data by sending and receiving ultrasonic waves; a first image processing unit that generates a first ultrasonic image by applying a first image processing to the Raw data; a first display control unit that displays the first ultrasonic image generated by the first image processing unit on a first display of the ultrasonic diagnostic apparatus; and a first information transmitting unit that associates the Raw data to which the first image processing unit has not applied the first image processing with first information indicating the first image processing and transmits the associated information to the image processing device; The image processing device comprises: a second information receiving unit that receives the Raw data and the first information that are associated with each other; a second image processing unit that generates the first ultrasonic image by applying the first image processing indicated by the first information to the Raw data, and generates a second ultrasonic image different from the first ultrasonic image by applying the second image processing different from the first image processing to the Raw data; and The second display control unit displays the first ultrasonic image and the second ultrasonic image generated by the second image processing unit on a second display of the image processing device.

9. The ultrasonic diagnostic system according to claim 8, characterized in that: The second image processing is image processing that is not implemented in the ultrasonic diagnostic apparatus.

10. The ultrasonic diagnostic system according to claim 8, characterized in that: The second image processing is image processing for generating an image requiring higher-level computing capability than the first image processing.

11. The ultrasonic diagnostic system according to claim 10, characterized in that: The second image processing is image processing for generating an image for measurement, The second ultrasonic image is a measurement image.

12. The ultrasonic diagnostic system according to claim 8, characterized in that: The second display control unit displays the first ultrasonic image and the second ultrasonic image generated by the second image processing unit side by side on the second display.

13. The ultrasonic diagnostic system according to claim 8, characterized in that: The second display control unit displays, on the second display, an image schematically showing an operation panel provided in the ultrasonic diagnostic apparatus and showing a user interface for accepting input of parameters for displaying an image used for diagnosis or measurement.

14. The ultrasonic diagnostic system according to claim 8, characterized in that: The ultrasonic diagnostic device is a portable ultrasonic diagnostic device.

15. An image processing device, characterized in that: include: a second information receiving unit that receives the Raw data and first information indicating the first image processing associated with each other from an ultrasonic diagnostic apparatus that acquires Raw data by transmitting and receiving ultrasonic waves and generates a first ultrasonic image by applying the first image processing to the Raw data; a second image processing unit that generates the first ultrasonic image by applying the first image processing indicated by the first information to the Raw data, and generates a second ultrasonic image different from the first ultrasonic image by applying the second image processing different from the first image processing to the Raw data; and The second display control unit displays the first ultrasonic image and the second ultrasonic image generated by the second image processing unit side by side on a display.

Images