Ultrasound diagnosis system, ultrasound diagnosis apparatus, and diagnosis assistance server

Abstract

The present application provides an ultrasonic diagnostic system, an ultrasonic diagnostic apparatus, and a diagnosis assistance server. A display frame data string is transferred from an ultrasonic diagnostic apparatus (10) to a diagnosis assistance server (12). In the diagnosis assistance server (12), the display frame data string is parsed, whereby a diagnosis assistance data string is generated. The diagnosis assistance data string is transferred from the diagnosis assistance server (12) to the ultrasonic diagnostic apparatus (10). A display processing section (22) performs composition while synchronizing the display frame data string and the diagnosis assistance data string.

Description

Technical Field

[0001] This disclosure relates to ultrasound diagnostic systems, ultrasound diagnostic apparatuses, and diagnostic auxiliary servers, and particularly to techniques for enabling the ultrasound diagnostic apparatus and the diagnostic auxiliary server to collaborate. Background Technology

[0002] While the functionality of ultrasound diagnostic devices is advancing, the limited processing power of these devices sometimes prevents the installation of features expected by developers and examiners. This is particularly true when incorporating machine learning-based CAD (Computer-Aided Diagnosis) functions. Another consideration is the possibility of transmitting still images acquired by the ultrasound device to an external device (e.g., a server) for processing, with the ultrasound device then receiving the processing results. However, simply transmitting images does not provide real-time support for the ongoing ultrasound examination.

[0003] Document 1 (JP Patent Application Publication No. 2016-85715) discloses an ultrasound diagnostic system that includes a database and multiple ultrasound diagnostic devices. Image sharing and communication are performed between the multiple ultrasound diagnostic devices. However, document 1 does not disclose image analysis or the feedback of image analysis results.

[0004] Document 2 (JP Patent Application Publication No. 2004-8535) discloses an ultrasound diagnostic system comprising an ultrasound diagnostic apparatus and an external information processing apparatus. In the external information processing apparatus, measurements are performed on image data transferred from the ultrasound diagnostic apparatus, and the measurement results are transmitted back to the ultrasound diagnostic apparatus. Document 2 does not disclose real-time external processing in the external information processing apparatus or real-time display of the external processing results in the ultrasound diagnostic apparatus.

[0005] Ultrasound diagnostic devices have inherent limitations in their high functionality. The goal is to enable other devices to operate in parallel, thereby providing the examiner with real-time data analysis results to assist in probe operation and image interpretation. Summary of the Invention

[0006] The purpose of this disclosure is to assist the examiner in real-time operation. Alternatively, the purpose of this disclosure is to assist the operation of the probe and the interpretation of ultrasound images without placing a heavy load on the ultrasound diagnostic device.

[0007] The ultrasound diagnostic system disclosed herein includes: an ultrasound diagnostic device; and a diagnostic auxiliary server connected to the ultrasound diagnostic device via a network. The ultrasound diagnostic device includes: a first transmission unit that transmits a plurality of time-series frame data generated by transmitting ultrasound waves and receiving reflected waves to the diagnostic auxiliary server; and a display processing unit that displays the plurality of frame data and a plurality of time-series diagnostic auxiliary data transmitted from the diagnostic auxiliary server simultaneously as a real-time dynamic image. The diagnostic auxiliary server includes: a generation unit that parses the plurality of frame data transmitted from the ultrasound diagnostic device to generate the plurality of diagnostic auxiliary data for assisting the examiner; and a second transmission unit that transmits the plurality of diagnostic auxiliary data to the ultrasound diagnostic device.

[0008] The ultrasound diagnostic device and diagnostic assistance server involved in this disclosure are connected via a network. The diagnostic assistance server parses multiple frames of data in a time-series order sent from the ultrasound diagnostic device to generate multiple diagnostic assistance data in a time-series order to assist the examiner. The multiple diagnostic assistance data is then transmitted to the ultrasound diagnostic device. The ultrasound diagnostic device includes: a transmission unit for transmitting the multiple frames of data to the diagnostic assistance server; and a display processing unit for synchronously displaying the multiple frames of data and the multiple diagnostic assistance data transmitted from the diagnostic assistance server.

[0009] The diagnostic assistance server and ultrasound diagnostic device involved in this disclosure are connected via a network. The ultrasound diagnostic device transmits multiple frames of data in a time-series order, generated by transmitting ultrasound waves and receiving reflected waves, to the diagnostic assistance server. The multiple frames of data and multiple diagnostic assistance data in a time-series order transmitted from the diagnostic assistance server are displayed synchronously. The diagnostic assistance server includes: a generation unit for parsing the multiple frames of data transmitted from the ultrasound diagnostic device to generate multiple diagnostic assistance data for assisting the examiner; and a transmission unit for transmitting the multiple diagnostic assistance data to the ultrasound diagnostic device. Attached Figure Description

[0010] Figure 1 This is a block diagram illustrating the ultrasonic diagnostic apparatus involved in the implementation.

[0011] Figure 2 This is a diagram illustrating a structural example of the display frame data.

[0012] Figure 3 This is a diagram representing a structural example of diagnostic auxiliary data.

[0013] Figure 4 This is a diagram representing the first example shown.

[0014] Figure 5 This is a diagram representing the second example.

[0015] Figure 6 This is a diagram showing a variation of the second example.

[0016] Figure 7 This is a diagram representing the third example.

[0017] Figure 8 This is a step diagram illustrating the operation of an ultrasound diagnostic system.

[0018] Figure 9 This is a diagram showing a portion of the structure of the ultrasound diagnostic device involved in the modified example.

[0019] Figure 10 This is a diagram showing a display example of an ultrasound diagnostic device involved in a modified example. Detailed Implementation

[0020] The following description of the implementation method is based on the accompanying drawings.

[0021] (1) Overview of the implementation method

[0022] The ultrasound diagnostic system according to the embodiment includes: an ultrasound diagnostic device; and a diagnostic assistance server connected to the ultrasound diagnostic device via a network. The ultrasound diagnostic device includes a first transmission unit (first transmission section) and a display processing unit (display processing section). The first transmission unit transmits multiple frames of data in a time-series order, generated by transmitting ultrasound waves and receiving reflected waves, to the diagnostic assistance server. The display processing unit displays the multiple frames of data and multiple diagnostic assistance data in a time-series order transmitted from the diagnostic assistance server as a real-time dynamic image, simultaneously. The diagnostic assistance server includes a generation unit (generation section) and a second transmission unit (second transmission section). The generation unit parses the multiple frames of data transmitted from the ultrasound diagnostic device to generate multiple diagnostic assistance data for assisting the examiner. The second transmission unit transmits the multiple diagnostic assistance data to the ultrasound diagnostic device.

[0023] According to the above structure, the diagnostic assistance server operates in real time and in parallel with the ultrasound diagnostic device. Within the ultrasound diagnostic device, multiple diagnostic assistance data points are displayed synchronously along with multiple frame data points. This allows for probe operation and lesion observation while referencing multiple diagnostic assistance data points. Consequently, the workload of the examiner can be reduced, or ultrasound examinations can be performed more accurately.

[0024] In the above structure, synchronization refers to ensuring that two data points are consistent or aligned in time. Real-time dynamic images refer to dynamic images generated simultaneously with the transmission of ultrasound waves and the reception of reflected waves. Real-time dynamic images constantly reflect the latest echo information obtained from the currently observed tissue. The action that produces this state is a real-time action. Multiple frames of data and multiple diagnostic auxiliary data displays can be displayed on the same display, or they can be displayed on different displays. Technologies such as streaming media can be used during transmission. A diagnostic auxiliary server can also be connected to multiple ultrasound diagnostic devices, performing multiple analyses for multiple ultrasound diagnostic devices in parallel.

[0025] In this implementation, the display processing unit synthesizes multiple diagnostic auxiliary data points synchronously with respect to multiple frame data points to generate multiple synthesized frame data points. These synthesized frame data points are then displayed as a real-time dynamic image. Alternatively, a portion of each diagnostic auxiliary data point can be used as the synthesis object. According to this structure, multiple frame data points and multiple diagnostic auxiliary data points are displayed on the same display.

[0026] In this implementation, each frame of data includes first synchronization information. Each piece of diagnostic auxiliary data includes second synchronization information. The synthesis unit synthesizes multiple pieces of diagnostic auxiliary data while synchronizing them with respect to the multiple frame data, based on the multiple pieces of first synchronization information contained in the multiple frames of data and the multiple pieces of second synchronization information contained in the multiple pieces of diagnostic auxiliary data. Examples of synchronization information include timestamps that determine the acquisition timing and processing timing of each received data.

[0027] In this implementation, the generation unit includes a parsing unit (parsing section) that parses multiple frames of data. Multiple diagnostic auxiliary data, including the parsing results from the parsing unit, are generated. The parsing unit can, for example, be composed of a machine learning-type parser.

[0028] In this implementation, the parsing unit includes a unit that applies processing to multiple frames of data to identify the cross-section category. Cross-section category information is included in the real-time dynamic image. The cross-section category is generally identified by organization and cross-sections. Measurements to be performed, etc., can be determined based on the identified cross-section category.

[0029] In this implementation, the parsing unit includes a unit for measuring multiple frames of data. Measurement value information is included in the real-time dynamic image. In this implementation, the measurement value information includes a dynamically changing measurement value graph. Based on this structure, all or part of the frame data string can be set as the object of measurement, and dynamically changing measurement values ​​can be obtained. Alternatively, measurements can also be performed on still images within a diagnostic assistance server.

[0030] In this implementation, the parsing unit includes a unit that applies computer diagnostic assistance, including the identification of lesion candidates, to multiple frames of data. Computer diagnostic assistance information is included in the real-time dynamic image. Based on this structure, it is possible to assist the examiner observing the ultrasound image in identifying and evaluating lesion candidates.

[0031] In one embodiment, the ultrasound diagnostic apparatus includes a unit (report generation unit) that generates an examination report based on all or part of multiple diagnostic auxiliary data. The generation of the examination report can be fully semi-automated or fully automated.

[0032] In this implementation, the first transmission unit transmits the associated information required for parsing multiple frames of data to the diagnostic assistance server. Examples of such associated information include electrocardiogram signals, coordinate information, and gestational age information.

[0033] The ultrasound diagnostic apparatus described in this embodiment is an ultrasound diagnostic apparatus connected to a diagnostic assistance server via a network. The diagnostic assistance server parses multiple time-series frame data sent from the ultrasound diagnostic apparatus to generate multiple time-series diagnostic assistance data to assist the examiner, and then transmits the multiple diagnostic assistance data back to the ultrasound diagnostic apparatus. The ultrasound diagnostic apparatus includes a transmission unit and a display processing unit. The transmission unit transmits the multiple frame data to the diagnostic assistance server. The display processing unit displays the multiple frame data and the multiple diagnostic assistance data transmitted from the diagnostic assistance server synchronously and simultaneously.

[0034] The diagnostic assistance server involved in this implementation is a diagnostic assistance server connected to an ultrasound diagnostic device via a network. The ultrasound diagnostic device transmits multiple time-series sequential frame data generated by transmitting and receiving ultrasound waves to the diagnostic assistance server, and displays the multiple time-series sequential diagnostic assistance data transmitted from the diagnostic assistance server synchronously with respect to the multiple frame data. The diagnostic assistance server includes a generation unit and a transmission unit. The generation unit parses the multiple frame data transmitted from the ultrasound diagnostic device to generate multiple diagnostic assistance data for assisting the examiner. The transmission unit transmits the multiple diagnostic assistance data to the ultrasound diagnostic device.

[0035] (2) Details of the implementation method

[0036] exist Figure 1 The illustration shows an ultrasound diagnostic system according to an embodiment. This ultrasound diagnostic system, for example, is a medical system installed in a medical facility that generates and displays ultrasound images in real time based on information obtained by sending ultrasound waves to a living organism and receiving reflected waves from within the organism.

[0037] The ultrasound diagnostic system consists of ultrasound diagnostic devices 10 interconnected via a network 13 and a diagnostic support server 12. The network 13, for example, is located within a medical facility and is a wired or wireless LAN (local area network). The network 13 can be constructed using dedicated lines. The diagnostic support server 12 possesses functions beyond those of the ultrasound diagnostic devices 10. Multiple ultrasound diagnostic devices can be connected to the diagnostic support server 12, providing them with the same or different services.

[0038] Figure 1 The method by which the ultrasound diagnostic device 10 and the diagnostic assistance server 12 operate in coordination is shown. The structure of the ultrasound diagnostic device 10 will be described below with the selection of mode B (tomography display mode), followed by the structure of the diagnostic assistance server 12.

[0039] The ultrasound diagnostic apparatus 10 has a main body 14. An ultrasound probe 16 is detachably connected to the main body 14. Known ultrasound probes 16 include those used against the surface of the patient's body and those inserted into the patient's body cavity. The ultrasound probe 16 may have, for example, an array of vibrating elements consisting of multiple one-dimensionally arranged transducers. An ultrasound beam is formed by the array of vibrating elements, and the ultrasound beam is scanned electronically. Alternatively, an array of vibrating elements consisting of multiple two-dimensionally arranged transducers may be provided in the ultrasound probe 16.

[0040] During transmission, the transceiver unit 18 supplies multiple transmission signals in parallel to the vibrating element array. During reception, the transceiver unit 18 applies given processing (amplification, A / D conversion, delay, addition, etc.) to the multiple received signals output in parallel from the vibrating element array. This generates beam data. Accompanying the repeated electronic scanning of the ultrasonic beam, a received frame data string is output from the transceiver unit 18.

[0041] The received frame data string consists of multiple received frame data arranged on the time axis. Each received frame data consists of multiple beam data arranged in the electronic scanning direction. Each beam data consists of multiple echo data arranged in the depth direction. A beam data processing unit 19 is provided after the transceiver unit 18. In the beam data processing unit 19, each beam data is processed by detection, logarithmic transformation, etc.

[0042] The image forming unit 20 generates a display frame data string based on the received frame data string. The image forming unit includes a DSC (Digital Scan Converter). The DSC is composed of a processor with coordinate transformation functions, pixel interpolation functions, etc. In this embodiment, each display frame data corresponds to a tomographic image. Each received frame data and each display frame data corresponds to image data.

[0043] The display processing unit 22 is a display processing unit or compositing unit that has image compositing functions, color processing functions, etc. Based on the display frame data string temporarily stored by the image forming unit 20, the display processing unit 22 synthesizes the display frame data string with a diagnostic assistance data string transferred from the diagnostic assistance server to generate a synthesized display frame data string.

[0044] At this time, the display processing unit 22 synthesizes data that are consistent in time. That is, the display processing unit 22 functions as a synthesis unit that performs synchronous synthesis. In order to achieve synchronous synthesis, each display frame data includes a timestamp as time information, and similarly, each diagnostic auxiliary data also includes a timestamp as time information. In the display processing unit 22, a graphic data string is also synthesized from the display frame data string. It is also considered that instead of synchronously synthesizing the display frame data string and the diagnostic auxiliary data string, synchronous display is performed.

[0045] During real-time operation, a display frame data string is displayed on the screen of display 26 as a real-time dynamic image. In a frozen state where transmission and reception are stopped, a display image of a specific time phase is displayed as a still image. Display 26 is composed of a liquid crystal display, an organic EL device, etc.

[0046] For example, timestamps can be embedded in each display frame data in the image forming unit 20, or in the information processing unit 36, which will be described below. In the diagnostic assistance server 12, when a display frame data has been processed, the embedded timestamp is extracted and embedded in the diagnostic assistance data, including the result of parsing the display frame data. In this way, by transferring timestamps from the parsing object to the parsing result, synchronous synthesis or synchronous display in the ultrasound diagnostic apparatus 10 can be reliably performed.

[0047] The information processing unit 36 ​​controls the operation of each element constituting the ultrasound diagnostic device 10. Furthermore, the information processing unit 36 ​​performs the necessary controls to enable the diagnostic assistance server 12 to cooperate. The information processing unit 36 ​​is composed of a processor that executes programs, specifically a CPU (central processing unit). Figure 1 In this diagram, the various functions performed by the processor are represented by multiple boxes. Specifically, the information processing unit 36 ​​includes a communication control unit 42, a display control unit 44, and a report generation unit 46.

[0048] The information processing unit 36 ​​is connected to the communication unit 40. The communication control unit 42 functions as a first transfer unit or a first transfer section. The communication control unit 42 controls the data transfer via the communication unit 40, and in particular controls the transfer of display frame data strings from the ultrasound diagnostic device 10 to the diagnostic assistance server 12.

[0049] The display control unit 44 controls the display processing in the display processing unit 22. The report generation unit 46 is a module that generates inspection reports semi-automatically or automatically. The report generation unit 46 functions as a report generation unit. The inspection report can include diagnostic auxiliary data generated in the diagnostic auxiliary server 12. The report generation unit 46 can also be installed in the diagnostic auxiliary server 12.

[0050] The storage unit 47, connected to the information processing unit 36, is composed of a semiconductor memory or similar component and stores various types of data. Inspection reports can be stored in the storage unit 47. The operation panel 38, connected to the information processing unit 36, has multiple switches, multiple buttons, a trackball, etc. The operation panel 38 functions as an input unit. An electrocardiogram (ECG) signal 39 is input to the information processing unit 36 ​​as associated information. Other associated information can also be input.

[0051] Next, the diagnostic assistance server 12 will be described. The diagnostic assistance server 12 is a computer, comprising an information processing unit 48, a communication unit 50, and a storage unit 52. The information processing unit 48 performs multiple functions. These functions are... Figure 1 It is represented by multiple boxes.

[0052] Specifically, in the illustrated structural example, the information processing unit 48 includes a section recognition unit 54, an annotation unit 56, a measurement unit 58, a CAD execution unit 60, a diagnostic auxiliary data generation unit 62, and a communication control unit 64. Among these, the section recognition unit 54, annotation unit 56, measurement unit 58, CAD execution unit 60, and diagnostic auxiliary data generation unit 62 correspond to generation units or generation departments. Furthermore, among these, the section recognition unit 54, annotation unit 56, measurement unit 58, and CAD execution unit 60 correspond to parsing units or parsing departments. The information processing unit 48 is composed of a processor that executes a program. The processor is, for example, a CPU.

[0053] The section recognition unit 54 applies section recognition to each display frame of data. In other words, the section recognition unit 54 applies a process to identify the section category for multiple display frame data. For example, the section recognition unit 54 is composed of a machine learning-type image estimator. The section category is determined by the section recognition unit 54. For example, the section category is determined as a four-chamber view of the heart, a two-chamber view of the heart, etc. The section recognition unit 54 also has the function of estimating the accuracy (probability of accuracy) involved in the recognition. The recognition result and accuracy information are sent from the section recognition unit 54 to the diagnostic auxiliary data generation unit 62.

[0054] Based on the results of section recognition, annotation unit 56 identifies various parts within the section as needed and assigns them labels (part names). For example, it assigns names such as aortic valve. The assigned information is then sent to diagnostic auxiliary data generation unit 62.

[0055] The measurement unit 58 performs measurements on each display frame of data in real-time operation. Furthermore, the measurement unit 58 performs measurements on specific display frame data or other data in a frozen state where transmission and reception are stopped. Examples of measurements for tomographic images include distance measurement, area measurement, and volume measurement. The measurement location and type can also be selected based on the identified cross-section. In this embodiment, in real-time operation, measurement values ​​are calculated on each display frame of data, and the measurement value string is sent from the measurement unit 58 to the diagnostic auxiliary data generation unit 62.

[0056] In the measurement unit 58, measurements can be performed on ultrasound images other than tomographic images. For example, measurements (automatic tracking, time measurement, etc.) can be performed on Doppler waveforms, as described later. When performing such processing, the Doppler waveform can be transmitted from the ultrasound diagnostic device 10 to the diagnostic assistance server 12 at the display frame rate, or it can be transmitted at other rates.

[0057] The CAD execution unit 60 performs CAD. In this embodiment, the CAD execution unit 60 has the function of determining the lesion candidates contained in the display frame data (i.e., tomographic image) on a per-display frame basis, and the function of generating information (possible disease names, operation guidance, etc.) to assist in the diagnosis of the lesion candidates. The CAD execution unit 60 may be configured as a machine learning-type image parser. The information generated by the CAD execution unit 60 is sent to the diagnostic assistance data generation unit 62.

[0058] The diagnostic auxiliary data generation unit 62 generates diagnostic auxiliary data (feedback data) for each display frame. The diagnostic auxiliary data can include section identification information, annotation information, measurement result information, CAD execution result information, etc.

[0059] The diagnostic auxiliary data generation unit 62 has the following function: extracting the timestamp contained in the display frame data that is the object of parsing, and embedding the extracted timestamp into the diagnostic auxiliary data that is the parsing result. This transfer process can be implemented in other modules such as the communication control unit 64.

[0060] In the diagnostic auxiliary data generation unit 62, a diagnostic auxiliary data string corresponding to the display frame data string is generated. The frame rate of the display frame data string and the frame rate of the diagnostic auxiliary data string can be different. For example, the frame rate of the latter can be set to half the frame rate of the former. In this case, the display processing unit 22 can establish a correspondence between the diagnostic auxiliary data that is closest in time to each display frame data. Such correspondence establishment is also a method of synchronous synthesis. To reduce the load on the diagnostic auxiliary server 12, a variation in which a portion of the received display frame data string is set as the parsing object is also considered. Alternatively, a variation in which a portion of the display frame data string generated in the ultrasonic diagnostic device 10 is transferred to the diagnostic auxiliary server is also considered.

[0061] The communication control unit 64 controls the data transfer via the communication unit 50, particularly controlling the transfer of diagnostic auxiliary data strings from the diagnostic auxiliary server 12 to the ultrasound diagnostic device 10. The communication control unit 64 is equivalent to a second transfer unit or a second transfer section. The information processing unit 48 is connected to the storage unit 52. The storage unit 52 stores display frame data strings, various parsing results, diagnostic auxiliary data strings, etc., as needed.

[0062] Communication unit 40 and communication unit 50 are interconnected via network 13. Network 13, as described above, consists of a wired LAN or a wireless LAN. These are installed within the medical facility. Network 13 can be the Internet.

[0063] In the ultrasound diagnostic device 10, when both color flow imaging mode (CFM mode) and pulsed Doppler mode (PW mode) are selected simultaneously, beam scanning for mode B, beam scanning for color Doppler, and beamforming for Doppler observation are performed according to a given transmit / receive sequence.

[0064] A first display frame data string is generated based on a first received frame data string obtained by beam scanning in mode B. A second display frame data string is generated based on a second received frame data string obtained by beam scanning in color Doppler. In this embodiment, only the first display frame data string is forwarded and parsed, but the second display frame data string may also be forwarded and parsed.

[0065] By transmitting and receiving data in a specific azimuth, Doppler information is extracted from a sample gate set at that specific azimuth, and a power spectrum is generated by frequency analysis of this Doppler information. A Doppler waveform is generated by mapping the power spectrum generated at each moment onto a time axis. For example, frequency analysis is performed in the beam data processing unit 19, and the Doppler waveform is generated in the image forming unit 20.

[0066] For example, Doppler waveforms can be transferred to the diagnostic assistance server 12 at regular intervals while the image is stored in a frozen state, where they are analyzed. Doppler waveforms can be transferred in units of display frames, allowing for real-time measurement. Images other than those mentioned above can also be transferred to the diagnostic assistance server 12.

[0067] according to Figure 1 The illustrated implementation displays ultrasound images and diagnostic auxiliary data as real-time dynamic images, allowing the examiner to operate the probe and perform image diagnosis while referring to the diagnostic auxiliary data. Since image resolution is automatically performed in the background, it does not burden the examiner, significantly reducing their workload compared to the past. Conversely, the examiner can focus on probe operation and image observation. According to this implementation, the ultrasound examination time is also shortened, further reducing the burden on the patient.

[0068] Alternatively, the ultrasound diagnostic device 10 can forward the received frame data string to the diagnostic assistance server 12. In this case, DSC can be set on the diagnostic assistance server 12. In the frozen state, the forwarding of the display frame data string can be temporarily interrupted. In this state, only the data required by the diagnostic assistance server 12 can be forwarded.

[0069] exist Figure 2 An example of display frame data is shown. Display frame data 200 consists of data entity 202 and header 204. Header 204 contains attribute information of data entity 202, including timestamp 206. In addition, header 204 may also contain information such as frame number, mode, depth information, and transmission frequency.

[0070] exist Figure 3 An example of diagnostic auxiliary data is shown. Diagnostic auxiliary data 210 consists of data entity 212 and header 214. Data entity 212 contains section recognition result information 216, measurement result information 218, and CAD execution result information 220. In addition, header 214 contains timestamp 222.

[0071] exist Figure 4The first display example is shown. Display image 70 is a real-time dynamic image displayed on the monitor of the ultrasound diagnostic device. In the illustrated example, display image 70 includes a CFM image 72, a Doppler waveform 74, and a diagnostic auxiliary image 76. CFM image 72 is a composite image generated by synthesizing a color Doppler image (blood flow image) on a B-mode tomographic image. The CFM image 72 includes an orientation marker 78, on which a gate marker 80 indicating the sampling gate position is displayed. In the Doppler waveform 74, the horizontal axis is the time axis, and the vertical axis is the velocity axis. The intensity or power of each velocity component is correlated with brightness.

[0072] In the illustrated example, diagnostic auxiliary image 76 includes information 82 indicating the section category, a numerical value 84 indicating the accuracy of the section category, and information 92 and 94 indicating the CAD execution results. This information represents the results of image parsing performed frame by frame and can change dynamically. Information 92 describes the possible diseases, and information 94 guides the subsequent operations and diagnosis.

[0073] In addition, Figure 4 In the first example shown, at the time point when the image storage operation was performed in a frozen state, the Doppler waveform displayed at that time point was transferred from the ultrasound diagnostic device to the diagnostic assistance server. Consequently, the diagnostic assistance server automatically performed three measurements on the transferred Doppler waveform. As a result, three measurement values ​​86, 88, and 90 were displayed in the diagnostic assistance image 76.

[0074] exist Figure 5 The second example is shown. Additionally, in... Figure 5 In this drawing, elements that are identical to those already described are labeled with the same reference numerals, and their descriptions are omitted. This is in... Figure 6 The same applies to the subsequent diagrams.

[0075] In the second display example, the displayed image 70A includes a CFM image 72, a Doppler waveform 74, and a diagnostic auxiliary image 76A. The CFM image 72 includes a marker 98 and information 100. The marker 98 is a graphic surrounding a potential lesion, the location of which is determined by the aforementioned CAD execution unit. Information 100 is information generated by the CAD execution unit, specifically, information indicating the possibility of a disease. The marker 98 and information 100 are updated every frame.

[0076] In the second display example, the diagnostic auxiliary image 76A includes three measurement value charts 95, 96, and 97. That is, each measurement value chart 95, 96, and 97 represents a measurement value that changes at a frame rate or other rate. Each measurement value chart 95, 96, and 97 has an axis representing the magnitude of the measurement value, displaying two values ​​on this axis: the upper limit and the lower limit representing the healthy normal range (or standard range). In the case of using the second display example, for example, the Doppler waveform updated in frames is transferred from the ultrasound diagnostic device to the diagnostic auxiliary server. In this case, the entire frame data can be transferred, or only the updated portion can be transferred. Additionally, in a frozen state, if the examiner has performed an image storage operation, the three measurement values ​​86, 88, and 90 are displayed as numerical values.

[0077] exist Figure 6 A variation of the second display example is shown. When the measurement values ​​are displayed in graphs 95A, 96A, and 97A, if each measurement value is within the normal healthy range, the graphs 95A, 96A, and 97A are displayed in the first color (e.g., green). If any measurement value exceeds the normal healthy range, the corresponding graphs 95A, 96A, and 97A are displayed in the second color (e.g., orange). Other representation methods may also be used instead of bar charts.

[0078] exist Figure 7 The third display example is shown. Display image 70B includes a CFM image 72, a Doppler waveform 74, and a diagnostic auxiliary image 76B. CFM image 72 includes a marker 98 indicating a potential lesion site. Diagnostic auxiliary image 76B includes information 82 indicating the section type, information 84 indicating accuracy, three measurement graphs 95, 96, and 97, and information 92 and 94. Information 92 describes the possible disease, and information 94 guides the recommended next steps.

[0079] exist Figure 8 An example of the operation of the ultrasound diagnostic system according to the embodiment is shown. Specifically, in Figure 8The operation examples of the ultrasound diagnostic device 10 and the diagnostic assistance server 12 are shown. In S10, multiple display frame data F1 are sequentially transferred from the ultrasound diagnostic device 10 to the diagnostic assistance server 12. In S12, the diagnostic assistance server 12 parses each display frame data sequentially. This parsing includes section identification, measurement, and lesion location determination. In S14, the diagnostic assistance server 12 sequentially generates multiple diagnostic assistance data. In S16, multiple diagnostic assistance data F2 are sequentially transferred from the diagnostic assistance server 12 to the ultrasound diagnostic device 10. In S18, the ultrasound diagnostic device 10 synchronously synthesizes the multiple display frame data and the multiple diagnostic assistance data sequentially, thereby generating multiple synthesized display frame data. During synchronous synthesis, the two data sets are made time-consistent.

[0080] The associated information R1 required for image parsing in the diagnostic assistance server 12 can also be transmitted during the transmission of multiple display frame data F1, or at the required timing. Examples of associated information R1 include, for instance, electrocardiogram signals, probe position information, and gestational age information.

[0081] exist Figure 9 A modified example of an ultrasound diagnostic apparatus is shown. The ultrasound diagnostic apparatus includes a movable or fixed touchscreen panel 102. The touchscreen panel 102 is a combination of a display panel 104 and a multi-touch sensor 106. First image information is sent from the display processing unit 22A to the display 26, and second image information is sent from the display processing unit 22A to the touchscreen panel 102. The first image information may, for example, contain information of one or more ultrasound images. All or part of the diagnostic auxiliary data may be included in the first image information. Diagnostic auxiliary data is included in the second image information.

[0082] Display processing unit 22A performs display processing, causing two data points that are in a synchronous relationship to be displayed simultaneously on two displays. Thus, display processing unit 22A performs synchronous display. It is also possible to synchronously synthesize a portion of the data within display processing unit 22A. As shown by reference numeral 108, the touchscreen panel 102 is connected to the ultrasound diagnostic device via wired or wireless means.

[0083] exist Figure 10A modified example of the display is shown. A CFM image 72 and a Doppler waveform 74 are displayed on the monitor 26. A portion of diagnostic auxiliary data is displayed on the CFM image 72; specifically, a marker 98 indicating a potential lesion is displayed. A diagnostic auxiliary image 108, including various information 82, 84, 92, and 94 generated through image analysis, is displayed on the touchscreen panel 102. For example, if the image is stored in a frozen state, three measurements are performed, and three measurement values ​​86, 88, and 90 representing the measurement results are displayed. In this modified example, since the probe is operated and the ultrasound image is observed while referring to the diagnostic auxiliary data, it assists the examiner.

Claims

1. An ultrasonic diagnostic system, characterized in that, Include: Ultrasonic diagnostic device (10); and The diagnostic auxiliary server (12) is connected to the ultrasound diagnostic device (10) via a network. The ultrasonic diagnostic device (10) comprises: The first transmission unit (42) transmits multiple frames of time-series data generated by transmitting ultrasonic waves and receiving reflected waves to the diagnostic auxiliary server. A unit that embeds first synchronization information into each frame of the multiple frame data before the transmission of the multiple frame data; and The display processing unit (22) synchronizes and synthesizes the multiple frame data and the multiple diagnostic auxiliary data transferred from the diagnostic auxiliary server (12) based on the multiple first synchronization information contained in the multiple frame data and the multiple second synchronization information contained in the multiple diagnostic auxiliary data transferred from the diagnostic auxiliary server, thereby generating multiple synthesized frame data, and displays the multiple synthesized frame data as a real-time dynamic image. The diagnostic assistance server (12) includes: The generation unit (54-62) parses the plurality of frame data sent from the ultrasound diagnostic device (10) and generates the plurality of diagnostic auxiliary data for assisting the examiner. The second transfer unit (64) transfers the plurality of diagnostic auxiliary data to the ultrasound diagnostic device (10); and Before the transmission of the plurality of diagnostic auxiliary data, a unit generates second synchronization information based on the first synchronization information contained in each frame of data sent from the ultrasound diagnostic device, and embeds the generated second synchronization information into the diagnostic auxiliary data corresponding to each frame of data sent from the ultrasound diagnostic device.

2. The ultrasonic diagnostic system according to claim 1, characterized in that, The unit that embeds the second synchronization information extracts the first synchronization information from each frame of data, and embeds the extracted first synchronization information as the second synchronization information into the diagnostic auxiliary data corresponding to each frame of data.

3. The ultrasonic diagnostic system according to claim 2, characterized in that, The plurality of frame data each has a data entity and attribute information containing the first synchronization information. The multiple diagnostic auxiliary data each have a data entity and attribute information containing the second synchronization information.

4. The ultrasonic diagnostic system according to claim 1, characterized in that, The generation unit (54-62) includes a parsing unit (54-60) for parsing the plurality of frame data, and generates the plurality of diagnostic auxiliary data including the parsing results of the parsing unit (54-60).

5. The ultrasonic diagnostic system according to claim 4, characterized in that, The parsing unit (54-60) includes: Unit (54) applies a process to identify the cross-section category to the multiple frame data. The real-time dynamic image contains cross-section category information.

6. The ultrasonic diagnostic system according to claim 4, characterized in that, The parsing unit (54-60) includes: Unit (58) performs measurements on the multiple frames of data. The real-time dynamic image contains measurement information.

7. The ultrasonic diagnostic system according to claim 6, characterized in that, The measurement information includes dynamically changing measurement value charts.

8. The ultrasonic diagnostic system according to claim 4, characterized in that, The parsing unit (54-60) includes: Unit (60) applies computer diagnostic assistance, including the determination of lesion candidates, to the multiple frames of data. The real-time dynamic images contain computer diagnostic assistance information.

9. The ultrasonic diagnostic system according to claim 1, characterized in that, The ultrasonic diagnostic device (10) comprises: Unit (46) generates an examination report based on all or part of the plurality of diagnostic auxiliary data.

10. The ultrasonic diagnostic system according to claim 4, characterized in that, The first forwarding unit (42) forwards the associated information required for parsing the multiple frame data to the diagnostic auxiliary server (12).

11. An ultrasonic diagnostic device (10) connected to a diagnostic auxiliary server (12) via a network, characterized in that, The diagnostic assistance server (12) parses multiple frames of time-series data sent from the ultrasound diagnostic device (10), generates multiple diagnostic assistance data in a time-series order to assist the examiner, and transmits the multiple diagnostic assistance data to the ultrasound diagnostic device (10). Before transmitting the multiple diagnostic auxiliary data, second synchronization information is generated based on the first synchronization information contained in each frame of data sent from the ultrasound diagnostic device. The generated second synchronization information is then embedded into the diagnostic auxiliary data corresponding to each frame of data sent from the ultrasound diagnostic device. The ultrasonic diagnostic device (10) comprises: The forwarding unit (42) forwards the multiple frame data to the diagnostic assistance server (12); Before the transmission of the plurality of frame data, a unit that embeds the first synchronization information into each frame of the plurality of frame data; and The display processing unit (22) synchronizes and synthesizes the multiple frame data and the multiple diagnostic auxiliary data transferred from the diagnostic auxiliary server (12) based on the multiple first synchronization information contained in the multiple frame data and the multiple second synchronization information contained in the multiple diagnostic auxiliary data, thereby generating multiple synthesized frame data and displaying the multiple synthesized frame data as a real-time dynamic image.

12. A diagnostic auxiliary server (12) connected to an ultrasound diagnostic device (10) via a network, characterized in that, The ultrasonic diagnostic device (10): Multiple frames of time-series data generated by transmitting ultrasonic waves and receiving reflected waves are transmitted to the diagnostic assistance server (12), and multiple diagnostic assistance data in time-series order transmitted from the diagnostic assistance server (12) are displayed synchronously with the multiple frames of data. Before the transmission of the plurality of frame data, first synchronization information is embedded in each frame data in the plurality of frame data; Based on the multiple first synchronization information contained in the multiple frame data and the multiple second synchronization information contained in the multiple diagnostic auxiliary data, the multiple diagnostic auxiliary data are synchronized and synthesized relative to the multiple frame data to generate multiple synthesized frame data. The multiple synthesized frames are displayed as real-time dynamic images. The diagnostic assistance server (12) includes: The generation unit (54-62) parses the plurality of frame data sent from the ultrasound diagnostic device (10) and generates the plurality of diagnostic auxiliary data for assisting the examiner. The transfer unit (64) transfers the plurality of diagnostic auxiliary data to the ultrasound diagnostic device; and Before the transmission of the plurality of diagnostic auxiliary data, a unit generates second synchronization information based on the first synchronization information contained in each frame of data sent from the ultrasound diagnostic device, and embeds the generated second synchronization information into the diagnostic auxiliary data corresponding to each frame of data sent from the ultrasound diagnostic device.

Images