Ultrasonic diagnostic system and extraction device

By using the extraction device in the ultrasonic diagnostic system to extract matching frame data from the server and display it, the problems of network burden and data visualization efficiency in ultrasonic inspection are solved, and the effect of quickly identifying and utilizing past volume data in ultrasonic inspection is realized.

CN119074044APending Publication Date: 2024-12-06FUJIFILM CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202410674691.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-29
Filing Date
2024-05-28
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In ultrasonic inspection, the prior art is difficult to effectively identify and utilize past volume data stored on the server, resulting in excessive burden on the network and difficulty for inspectors to quickly obtain the required data.

Method used

An ultrasonic diagnostic system is designed, including an ultrasonic diagnostic device and an extraction device. By receiving reference frame data, matching frame data is extracted from the server, and images of matching frame data are displayed in the ultrasonic diagnostic device to reduce network burden and increase data visual efficiency.

Benefits of technology

It is realized that without increasing the network burden, the inspector can identify and view the volume data stored on the server, improve the image display efficiency of ultrasonic examination, and promote the utilization of the past volume data acquired by different types of medical devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119074044A_ABST
    Figure CN119074044A_ABST
Patent Text Reader

Abstract

The invention provides an ultrasonic diagnostic system and an extraction device. The present invention addresses the problem of enabling an inspector to recognize the presence of volume data stored in a server without causing a large burden on a network during an ultrasonic inspection. An ultrasound diagnostic device (10) transmits a search request including reference frame data to an image server (12). In the image server (12), when volume data is identified, the volume data is transmitted to the extraction server (14). The extraction server (14) extracts, from the volume data, matched frame data matching the reference frame data. In an ultrasound diagnostic device (10), a thumbnail image indicating matched frame data is displayed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic system and an extraction device, and in particular to a technology for processing volume data stored in a server. Background Art

[0002] Ultrasonic diagnostic devices are used in ultrasonic examinations of subjects. Usually, the ultrasonic diagnostic devices are connected to a server via a network, typically a DICOM (Digital Imaging and Communications in Medicine) server. A large amount of data is stored in the server. In the server, a search is performed according to a search request and a transmission request from the ultrasonic diagnostic device, and the data determined by the search is transmitted from the server to the ultrasonic diagnostic device.

[0003] The data group stored in the server includes a plurality of volume data. Examples of such volume data include volume data acquired by an ultrasonic diagnostic device (ultrasound volume data), volume data acquired by an MRI (Magnetic Resonance Imaging) device (MR volume data), and volume data acquired by a CT (Computed Tomography) device (X-ray CT device) (CT volume data). If the structure of the volume data is considered, there are aggregated volume data that is an aggregate of a plurality of frame data (a plurality of slice data) and continuous volume data that has three-dimensional continuity and is composed of a data block.

[0004] When the specific volume data to be referenced is collective volume data, if a transmission request including a frame number (usually a central frame number) is sent from the ultrasonic diagnostic apparatus to the server, the frame data identified by the frame number is transmitted from the server to the ultrasonic diagnostic apparatus. In the ultrasonic diagnostic apparatus, a thumbnail image is generated based on the acquired frame data and the thumbnail image is displayed.

[0005] Patent Document 1 discloses an ultrasonic diagnostic apparatus having a DICOM server. The ultrasonic diagnostic apparatus has a function of displaying a current ultrasonic image and a past ultrasonic image side by side. Patent Document 1 does not describe a technique for searching for desired frame data from volume data.

[0006] Patent Document 1: Japanese Patent Application Publication No. 2009-22626

[0007] From the viewpoint of supporting ultrasonic examination of a subject, it is desirable to promote the use of the past volume data by allowing the examiner to recognize the existence of past volume data acquired from the subject and stored in a server when performing ultrasonic examination of the subject.

[0008] If the server searches for the subject's past volume data to meet this requirement and sends all of the past volume data to the ultrasonic diagnostic apparatus, the burden on the network increases. It is desirable to send only the data representing the portion that the examiner is about to view from the past volume data to the ultrasonic diagnostic apparatus. Summary of the invention

[0009] The present invention aims to enable an examiner to recognize the existence of volume data stored in a server without placing a large burden on the network during an ultrasonic examination. Alternatively, the present invention aims to display an image to be viewed by an examiner as an image representing volume data in an ultrasonic diagnostic apparatus.

[0010] The ultrasonic diagnostic system involved in the present invention is characterized in that it includes: an ultrasonic diagnostic device that forms an ultrasonic image based on received data obtained from a subject; and an extraction device that, when past volume data obtained from the subject is determined from a data group stored in a server, extracts matching frame data that matches the reference frame data sent from the ultrasonic diagnostic device from the past volume data, and the ultrasonic diagnostic device displays the ultrasonic image and an image representing the matching frame data together during an ultrasonic examination of the subject.

[0011] The extraction device involved in the present invention is characterized in that it includes the following mechanisms: receiving reference frame data sent from an ultrasonic diagnostic device; when past volume data obtained from a subject is determined from a data group stored in a server, extracting matching frame data that matches the reference frame data from the past volume data; and sending the matching frame data to the ultrasonic diagnostic device, in which an ultrasonic image and an image representing the matching frame data are displayed together during an ultrasonic examination of the subject.

[0012] Effects of the Invention

[0013] According to the present invention, during ultrasonic examination, the examiner can recognize the existence of volume data stored in the server without placing a large burden on the network. Alternatively, according to the present invention, the ultrasonic diagnostic apparatus displays an image to be viewed by the examiner as an image representing the volume data. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a block diagram showing the ultrasonic diagnostic system according to the first embodiment.

[0015] Figure 2 This is a diagram showing an example of extraction processing (secondary extraction processing).

[0016] Figure 3This is a flowchart showing the operation of the ultrasonic diagnostic system according to the first embodiment.

[0017] Figure 4 This is a diagram showing an example of a screen image.

[0018] Figure 5 This is a diagram showing reference frame data.

[0019] Figure 6 It is a diagram showing the operation of the ultrasonic diagnostic system according to the second embodiment.

[0020] Figure 7 It is a diagram showing the switching of thumbnail images according to the second embodiment.

[0021] Figure 8 This is a block diagram showing an ultrasonic diagnostic system according to the third embodiment.

[0022] Explanation of symbols

[0023] 10 - ultrasonic diagnostic apparatus, 12 - image server, 14 - extraction server, 29 - reference frame data, 30 - extraction unit, 40 - information processing unit, 42 - background processing control unit, 44 - thumbnail image generating unit. DETAILED DESCRIPTION

[0024] Hereinafter, embodiments will be described with reference to the drawings.

[0025] (1) Overview of Implementation

[0026] The ultrasonic diagnostic system according to the embodiment includes an ultrasonic diagnostic device and an extraction device. The ultrasonic diagnostic device forms an ultrasonic image based on received data obtained from a subject. When past volume data obtained from a subject is determined from a data group stored in a server, the extraction device extracts matching frame data that matches reference frame data sent from the ultrasonic diagnostic device from the past volume data. The ultrasonic diagnostic device displays an ultrasonic image and an image representing the matching frame data together during an ultrasonic examination of the subject.

[0027] According to the above structure, during the ultrasonic examination of the subject, an image representing the past volume data obtained from the subject is displayed. Therefore, by observing such an image, the examiner can recognize that the past volume data exists in the server. The image representing the past volume data is an image representing the matching frame data that matches the reference frame data. Therefore, based on the appropriate selection of the reference frame data, the possibility of displaying an image that can support the current ultrasonic examination is increased.

[0028] The image representing the matching frame data is, for example, a tomographic image or a thumbnail image. In the ultrasonic examination of the subject, as long as the acquisition of the matching frame data and the generation of the image representing the matching frame data are performed as background processing, there will be no burden on the examiner. According to the above structure, only a part of the past volume data is transmitted instead of all, so the load on the network is reduced. This advantage is more obvious when there are multiple past volume data in the server. At the point in time when all of the past volume data needs to be acquired, the past volume data is transmitted from the server to the ultrasonic diagnostic device.

[0029] In an embodiment, the extraction device is an information processing device connected to the ultrasonic diagnostic device via a network. The extraction device can be assembled in a server. An external information processing device physically connected to the ultrasonic diagnostic device can function as an extraction device. The above-mentioned past volume data is MR volume data, CT volume data, or ultrasonic volume data. The above-mentioned past volume data can be other volume data such as mammography volume data. According to the structure involved in the embodiment, the use of past volume data acquired by a medical device of a type different from the ultrasonic diagnostic device can be promoted.

[0030] In an embodiment, the extraction device compares the reference frame data with a plurality of candidate frame data included in the past volume data, and extracts the candidate frame data determined thereby as the matching frame data. When comparing the two frame data, various well-known techniques such as correlation operations can be used. Usually, for the past volume data, sections for cutting the candidate frame data are sequentially set at various positions and at various angles. When the volume data is composed of a plurality of frame data, these plurality of frame data can be used as a plurality of candidate frame data.

[0031] In an embodiment, the ultrasonic diagnostic apparatus includes a thumbnail image generating unit that generates a thumbnail image as an image representing the matching frame data based on the matching frame data. Typically, the thumbnail image is generated by low-resolution processing of the matching frame data. The thumbnail image can be said to be a reduced tomographic image. Typically, by selecting a thumbnail image, a tomographic image (a tomographic image that has not been processed with low resolution) representing the corresponding frame data associated with the thumbnail image is displayed.

[0032] In an embodiment, the ultrasonic diagnostic apparatus displays a screen image including an ultrasonic image. The thumbnail image is a first thumbnail image. The thumbnail image generating unit further generates a second thumbnail image representing received data obtained by the ultrasonic diagnostic apparatus. The screen image has an external data display area for displaying the first thumbnail image and an internal data display area for displaying the second thumbnail image.

[0033] According to the above structure, the examiner can identify the local data (internal data) stored in the ultrasonic diagnostic apparatus and the remote data (external data) stored in the server, thereby distinguishing the external data from the internal data and promoting the acquisition, reference and use of the external data.

[0034] In an embodiment, the extraction device is a secondary extraction device. The thumbnail image is a secondary thumbnail image. The ultrasonic diagnostic system further includes a primary extraction device that extracts designated frame data from past volume data based on designated frame identification information sent from the ultrasonic diagnostic device. The thumbnail image generation unit further generates a primary thumbnail image as an image representing the designated frame data based on the designated frame data. The ultrasonic diagnostic device displays the primary thumbnail image and the secondary thumbnail image.

[0035] Usually, the designated frame is a frame automatically designated by the ultrasonic diagnostic apparatus. When it takes time to display the secondary thumbnail image, the primary thumbnail image may be temporarily displayed in advance. The primary thumbnail image and the secondary thumbnail image may be displayed simultaneously or sequentially.

[0036] In an embodiment, the ultrasonic diagnostic apparatus first displays a primary thumbnail image, and then displays a secondary thumbnail image in place of the primary thumbnail image. According to this structure, the inspector can recognize the existence of past volume data in advance, and the image that the inspector is about to view can be provided to the inspector. When multiple secondary thumbnail images representing multiple volume data are displayed, they can be displayed sequentially in the order in which they are generated, or they can be displayed simultaneously at a certain time.

[0037] In the embodiment, the ultrasonic diagnostic apparatus displays identification information for identifying the primary thumbnail image and the secondary thumbnail image. According to this configuration, the examiner can recognize the attribute of the frame data corresponding to the thumbnail image.

[0038] In an embodiment, the extraction device calculates a matching score when comparing the reference frame data with each candidate frame data. The ultrasonic diagnostic device displays an image representing the matching frame data and information representing the matching score corresponding to the matching frame data together. According to this structure, the examiner can recognize that the cross section corresponding to the matching frame data is likely to be the cross section that the examiner wants to view by referring to the information representing the matching score.

[0039] In the embodiment, the reference frame data is one of past tomographic image data registered in the ultrasonic diagnostic apparatus, current tomographic image data acquired in the current ultrasonic examination of the subject, and pseudo tomographic image data cut out from a three-dimensional tissue model.

[0040] The reference frame data may be specified automatically or by the examiner. For example, multiple reference frame data corresponding to multiple processes constituting the ultrasound examination protocol may be registered in advance. If such a structure is adopted, multiple reference frame data are automatically selected in sequence as the ultrasound examination protocol progresses, and multiple thumbnail images are automatically displayed in sequence.

[0041] The extraction device involved in the embodiment has a receiving mechanism, an extraction mechanism, and a sending mechanism. The receiving mechanism receives the reference frame data sent from the ultrasonic diagnostic device. When the past volume data obtained from the subject is determined from the data group stored in the server, the extraction mechanism extracts the matching frame data that matches the reference frame data from the past volume data. The sending mechanism sends the matching frame data to the ultrasonic diagnostic device. In the ultrasonic diagnostic device, an ultrasonic image and an image representing the matching frame data are displayed together during the ultrasonic examination of the subject.

[0042] The above-mentioned mechanisms can be implemented as hardware functions or software functions. In the latter case, the program for executing the above-mentioned series of processes is installed in the information processing device via a network or a portable storage medium. The information processing device has a non-temporary storage medium storing the program. In addition, the information processing device has a processor for executing the program.

[0043] (2) Details of implementation methods

[0044] exist Figure 1 2 shows an ultrasonic diagnostic system according to the first embodiment. This ultrasonic diagnostic system is installed in a medical institution such as a hospital, for example. In fact, the ultrasonic diagnostic system is a medical system for supporting examination (and treatment) of a subject.

[0045] The ultrasonic diagnostic system includes an ultrasonic diagnostic apparatus 10, an image server 12, and an extraction server 14. The ultrasonic diagnostic apparatus 10 is used for ultrasonic examination of a subject. The image server 12 is, for example, a DICOM server that stores and provides medical images. As described later, the extraction server 14 is a device that extracts frame data from volume data.

[0046] The ultrasonic diagnostic system has a network 16. The network 16 is, for example, a LAN (Local Area Network). The network 16 may include the Internet. The ultrasonic diagnostic device 10, the image server 12, and the extraction server 14 are connected to the network 16. The network 16 is also connected to a CT device 18 and an MR device 20. In addition, other ultrasonic diagnostic devices not shown are also connected to the network 16.

[0047] The image server 12 is composed of an information processing device such as a computer. The image server 12 has an information processing unit 22 and a storage unit 24. The information processing unit 22 has a processor. The storage unit 24 is composed of a semiconductor memory, a hard disk, etc. A data group consisting of various data acquired by the ultrasonic diagnostic device 10, the CT device 18, and the MR device 20 is stored in the storage unit 24. Specifically, the data group includes a plurality of CT volume data, a plurality of MR volume data, and a plurality of ultrasonic volume data. The data group may also include volume data other than these.

[0048] Each volume data is data acquired from the three-dimensional space in a living body. Each volume data is a collection of volume data consisting of multiple frame data (multiple slice data) connected in space, or continuous volume data that has spatial continuity and is composed of a single data. Each data constituting the data group is associated with the subject information, the inspection area information, and the inspection date and time information.

[0049] The image server 12 has a search function and an extraction function (primary extraction function). The image server 12 is equivalent to a search device and a primary extraction device. The search function is a function of determining one or more data that meet the search condition in a data set. The extraction function is a function of extracting frame data corresponding to a specified frame number from volume data. The frame data is cross-sectional data.

[0050] Usually, the image server 12 can apply the extraction function only to the aggregate volume data. Usually, the designated frame number is the frame number corresponding to the central section. The image server 12 also has the function of receiving the search request and the transmission request and the function of sending the determined or extracted data.

[0051] The extraction server 14 is composed of an information processing device such as a computer. The extraction server 14 has an information processing unit 26 and a storage unit 28. The information processing unit 26 has a processor that executes a program. The storage unit 28 is composed of a semiconductor memory, a hard disk, etc. The reference frame data 29 sent from the ultrasonic diagnostic device 10 is stored in the storage unit 28. The program executed by the processor is also stored in the storage unit 28.

[0052] The extraction server 14 is a secondary extraction device having an extraction function (secondary extraction function). Specifically, the extraction function is a function of extracting frame data (matching frame data) that matches the reference frame data from the volume data sent by the image server 12. This will be described in detail later.

[0053] The extraction server 14 also has the function of receiving reference frame data and volume data and the function of sending matching frame data, etc. As described later, the extraction server 14 can be set in the image server 12, or the image server 12 and the extraction server 14 can be integrated. The extraction server 14 and the ultrasonic diagnostic apparatus 10 can be connected via a dedicated line.

[0054] Next, the ultrasonic diagnostic apparatus 10 is described. The ultrasonic probe 32 has a transducer array. An ultrasonic beam is formed by the transducer array, and the ultrasonic beam is electronically scanned. As electronic scanning methods, electronic linear scanning methods, electronic sector scanning methods, etc. are known. A beam scanning plane is formed in the subject by electronic scanning of the ultrasonic beam. The beam scanning plane is an observation section. The position and posture of the beam scanning plane in the subject change with changes in the position and posture of the ultrasonic probe 32. A 2D transducer array can be set in the ultrasonic probe 32, and volume data can be acquired using the 2D transducer array.

[0055] The transceiver circuit 34 is an electronic circuit that functions as a transmission beamformer and a reception beamformer. When transmitting, the transceiver circuit 34 outputs multiple transmission signals in parallel to the transducer array. As a result, ultrasound waves are radiated into the living body, forming a transmission beam. When receiving, if the reflected waves from the living body reach the transducer array, multiple reception signals are output in parallel from the transducer array to the transceiver circuit 34. The transceiver circuit 34 applies phase alignment and addition to the multiple reception signals to generate reception beam data. Each time an electronic scan is performed, multiple reception beam data arranged along the electronic scanning direction are generated. These constitute reception frame data.

[0056] The beam data processing unit 36 ​​is a module that processes the received beam data string output from the transceiver circuit 34. The beam data processing unit 36 ​​has a detector, a logarithmic converter, etc. The image forming unit 38 generates tomographic image data (B-mode tomographic image data) based on the received beam data string output from the beam data processing unit 36. The image forming unit 38 has a digital scan converter (DSC). The DSC has a coordinate conversion function, a pixel interpolation function, etc. The tomographic image data is sent from the image forming unit 38 to the information processing unit 40. Ultrasonic images other than tomographic images can also be formed.

[0057] The information processing unit 40 has a processor (specifically, a CPU) that executes a program. In addition to the display 50 described later, the information processing unit 40 is also connected to a storage unit 46 and an operation panel 48. The storage unit 46 is composed of a semiconductor memory, a hard disk, etc. The operation panel 48 is an input device having a plurality of switches, a trackball, a keyboard, etc. The inspector can specify or select the reference frame data by using the operation panel 48. The display 50 is composed of, for example, an organic EL display device or an LCD.

[0058] The storage unit 46 stores, for example, tissue model data 52 , a plurality of tomographic image data 54 , a plurality of frame data 56 , a plurality of volume data 58 , and the like.

[0059] The tissue model data 52 is data representing a tissue model. The tissue model is a three-dimensional model that artificially simulates the morphology and structure of a specific tissue (eg, heart, liver). A plurality of tissue model data 52 corresponding to a plurality of tissues that may be the subject of ultrasonic examination may be prepared.

[0060] Each tomographic image data 54 is data acquired and stored by the ultrasonic diagnostic apparatus 10. The plurality of tomographic image data 54 may include current tomographic image data acquired in the current ultrasonic examination of the subject and past tomographic image data acquired in the past ultrasonic examination of the subject. The substance of each tomographic image data 54 is frame data.

[0061] Each frame data 56 is matching frame data extracted and transmitted by the extraction server 14. Specified frame data extracted and transmitted by the image server 12 can be included in the plurality of frame data 56. Each volume data 58 is volume data extracted and transmitted by the image server 12.

[0062] The information processing unit 40 controls the operation of each component constituting the ultrasonic diagnostic apparatus 10. The information processing unit 40 functions as a background processing control unit 42 and a thumbnail image generating unit 44. The information processing unit 40 also has a function of generating a screen image displayed on the display 50. The screen image includes one or more thumbnail images representing one or more matching frame data in addition to the current tomographic image.

[0063] The background processing control unit 42 controls the background processing executed in the current ultrasonic examination of the subject. The background processing includes a search process and a thumbnail image display process.

[0064] In the search process, a past data set of the subject stored in the image server 12 is searched. The past data set may include past frame data and past volume data. The past frame data is transmitted from the image server 12 to the ultrasonic diagnostic apparatus 10. As needed, designated frame data cut from the past volume data according to the designated frame number is transmitted from the image server 12 to the ultrasonic diagnostic apparatus 10.

[0065] The past volume data determined in the image server 12 is transmitted from the image server 12 to the extraction server 14. The extraction unit 30 in the extraction server 14 extracts matching frame data that matches the reference frame data 29 from the received past volume data. The extracted matching frame data is transmitted from the extraction server 14 to the ultrasonic diagnostic apparatus 10. The thumbnail image generation unit 44 generates a thumbnail image based on the received or stored frame data (specified frame data, matching frame data, or tomographic image data).

[0066] In the above-mentioned thumbnail image display processing, thumbnail images representing past data stored in the image server 12 are displayed on the display 50. In this case, the thumbnail images represent past frame data or past volume data obtained from the above-mentioned subject. In addition, thumbnail images representing tomographic image data acquired and stored in the current ultrasonic examination are also displayed on the display 50.

[0067] In addition, a thumbnail image representing data (external data) stored in the image server 12 is a first thumbnail image, and a thumbnail image representing data (internal data) stored in the ultrasonic diagnostic apparatus 10 is a second thumbnail image. A thumbnail image representing designated frame data extracted from the volume data stored in the image server 12 is a primary thumbnail image. A thumbnail image representing matching frame data extracted from the volume data stored in the image server 12 is a secondary thumbnail image. Both the primary thumbnail image and the secondary thumbnail image are first thumbnail images. The screen image displayed on the display 50 includes one or more first thumbnail images and one or more second thumbnail images.

[0068] exist Figure 2 2 shows the extraction process of the matching frame data in the extraction server 14. Generally, a plurality of clipping sections 204 are sequentially set at various positions and angles for the received volume data 202. Reference symbol 206 represents candidate frame data corresponding to a specific clipping section 204. The sequentially extracted candidate frame data 206 are compared with the reference frame data 200 (reference symbol 210). In this case, a correlation operation, pattern matching or other techniques are used.

[0069] Each time frame data is compared, a matching score is calculated. The matching score is, for example, a correlation value, a matching score, or a similarity. The highest matching score is determined from a plurality of matching scores corresponding to a plurality of candidate frame data, and then the candidate frame data corresponding to the highest matching score is determined as the matching frame data. Thus, matching frame data is extracted from the volume data. The matching frame data and the score information indicating the matching score corresponding thereto are sent from the extraction server 14 to the ultrasonic diagnostic apparatus 10 (reference symbol 212). The matching frame data and the score information can be sent to the ultrasonic diagnostic apparatus 10 via the image server 12. In addition, when comparing two frame data, the size or scale of one of the frame data is adjusted as needed.

[0070] exist Figure 3 It is shown in Figure 1 More specifically, in Figure 3 2 shows the operation of the ultrasonic diagnostic apparatus 10, the operation of the image server 12, and the operation of the extraction server 14 in the background processing.

[0071] In the ultrasonic diagnostic apparatus 10, the subject ID is received in step S10, and the inspection area is received in step S12. The inspection area is the area to which the inspection object, i.e., the tissue, belongs (e.g., the abdomen, circulatory organs). The ultrasonic inspection is started in step S14. The reference cross section is determined in step S16. That is, the reference frame data is determined. The reference frame data can be determined automatically, or the reference frame data can be specified by the inspector.

[0072] In step S18, a search request and a transmission request are sent from the ultrasonic diagnostic device 10 to the image server 12. The search request may be sent first, and after the search results are received, the transmission request may be sent based on the search results. The search request and the transmission request may also be sent at the same time. The search request includes search conditions. The search conditions include subject identification information (subject ID), examination area identification information, search period, etc. The transmission request includes reference frame data. The transmission request includes specified frame identification information as needed. The reference frame data is sent from the ultrasonic diagnostic device 10 to the extraction server 14. The reference frame data may be sent from the ultrasonic diagnostic device 10 to the extraction server 14 via the image server 12. In step S22, the extraction server 14 receives the reference frame data.

[0073] In step S20, the image server 12 searches for a data set that meets the search condition from the stored data set. The data set includes one or more frame data (frame data set) and / or one or more volume data (volume data set). Any data is past data obtained from the object of the current ultrasound examination, i.e., the subject.

[0074] When a frame data set is determined by the above search, in step S24, the frame data set is transmitted from the image server 12 to the ultrasonic diagnostic apparatus 10. At this time, as needed, the specified frame data extracted from each volume data is also transmitted. And, when a volume data set is determined by the above search, in step S26, the volume data set is transmitted from the image server 12 to the extraction server 14.

[0075] In the extraction server 14, the volume data set is received in step S28. In step S30, for each volume data, candidate frame data matching the reference frame data is searched from the volume data. In step S32, the matching frame data set extracted from the volume data set is transmitted from the extraction server 14 to the ultrasonic diagnostic apparatus 10. The matching frame data set can be transmitted from the extraction server 14 to the ultrasonic diagnostic apparatus 10 via the image server 12.

[0076] In the ultrasonic diagnostic apparatus 10, in step S34, the frame data set sent from the image server 12 is received, and the matching frame data set sent from the extraction server 14 is received. As described above, each piece of data received is past data acquired from the subject. In step S36, a plurality of thumbnail images (thumbnail image set) are generated based on the plurality of received data. In step S38, the thumbnail image set is displayed. Usually, the plurality of thumbnail images are displayed in sequence in the order in which they are generated.

[0077] The displayed thumbnail image set includes thumbnail images representing matching frame data extracted from the volume data. The examiner can recognize that the image server 12 has past volume data by observing such thumbnail images.

[0078] For example, after starting the dual-screen display mode, the current tomographic image as a real-time tomographic image and the past tomographic image generated by the matching frame data can be displayed side by side through the thumbnail image selection operation. In this case, the two image contents can be compared and the content of the current tomographic image can be evaluated. The reference frame data is selected in advance to accurately perform such image comparison.

[0079] exist Figure 3 In the illustrated operation example, in the current ultrasound examination, a specific mode is activated in step S40. Then, in step S42, by selecting a thumbnail image, a transmission request for volume data corresponding to the thumbnail image is sent to the image server 12. In step S44, the volume data sent from the image server 12 is received by the ultrasound diagnostic apparatus 10.

[0080] The specific mode is, for example, a mode for displaying a current tomographic image as a real-time tomographic image and a past tomographic image based on past volume data side by side. In this case, both the current tomographic image and the past tomographic image are images representing the same observation section (beam scanning surface). For example, based on the position information obtained by detecting the position and posture of the ultrasonic probe 32, surface data corresponding to the observation section is cut from the past volume data, and a past tomographic image is generated based on the surface data.

[0081] exist Figure 4 2 shows an example of a screen image displayed on the display 50. The screen image 60 includes a real-time tomographic image 62, a first thumbnail image display area 64, and a second thumbnail image display area 66.

[0082] The first thumbnail image display area 64 is an area for displaying a plurality of thumbnail images 70 representing a plurality of internal data. Each internal data is data acquired and stored in the ultrasonic diagnostic apparatus 10, and is typically tomographic image data. The second thumbnail image display area 66 is an area for displaying a plurality of thumbnail images 72A to 72E representing a plurality of external data. Each external data is data stored in the image server 12, and is frame data or volume data.

[0083] The thumbnail image 72A is a thumbnail image representing the MR volume data acquired in the MRI apparatus. It includes an identifier 74 representing the data category, a mark 76 representing the thumbnail image (representing the matching frame data), and a numerical value 78 representing the matching score. The mark 76 is a simple circular mark, but various display elements can be used as the mark 76. The maximum value of the numerical value 78 is, for example, 100 (%), and the minimum value thereof is, for example, 0 (%). Instead of the numerical value, information such as a symbol or color can be displayed.

[0084] The inspector can recognize that thumbnail image 72A is a thumbnail image representing matching frame data by displaying mark 76. The inspector can be prompted with the possibility that the matching frame data is an image representing a cross section that the inspector wants to view by displaying numerical value 78.

[0085] In fact, a window selected from the plurality of windows is displayed in the second thumbnail image display area 66. A specific label is selected from the plurality of labels 84, 86, 88 corresponding to the plurality of windows, and the window corresponding to the selected label is displayed. Each window includes one or more second thumbnail images. For example, a window may be generated for each inspection date or each inspection period.

[0086] exist Figure 4The screen image shown includes a tissue model image 68. The tissue model image 68 is an image representing a three-dimensional model simulating the tissue that is the object of the current ultrasonic examination. A frame image 80 that crosses the tissue model image 68 is displayed together with the tissue model image 68. The position and posture of the frame image 80 relative to the tissue model image 68 are adjusted by the examiner. Thus, a specific cross section 82 in the tissue model image 68 is determined. Based on the specific cross section 82, cross-sectional data is cut from the tissue model. This is used as reference frame data. As described below, the reference frame data can be defined based on other data.

[0087] exist Figure 5 , a method for determining the reference frame data 96 is shown in FIG. 1 . For example, the current tomographic image data 90 can be set as the reference frame data 96. In this case, the current tomographic image data 90 can be determined at a time specified by the inspector or at a time automatically determined. The current tomographic image at the frozen time point can be set as the reference frame data.

[0088] The past tomographic image data 92 stored in the ultrasonic diagnostic apparatus 10 can be set as the reference frame data 96. The past tomographic image data 92 is past data acquired from the subject who is currently undergoing the ultrasonic examination. As described above, the pseudo tomographic image data 94, which is cross-sectional data cut out from the three-dimensional tissue model, can be set as the reference frame data 96.

[0089] Next, according to Figure 6 and Figure 7 The ultrasonic diagnostic system according to the second embodiment is described below. The structure of the ultrasonic diagnostic system according to the second embodiment is basically the same as that of the first embodiment. Figure 1 In the second embodiment, the primary thumbnail image based on the designated frame data is displayed first, and then the secondary thumbnail image based on the matching frame data is displayed. This will be described in detail below.

[0090] Reference numeral 100 indicates information included in a search request (and a transmission request) issued from the ultrasonic diagnostic apparatus 10. In the search request 100, examiner identification information 102, examination region information 104, and designated frame identification information 106 are sent to the image server 12 (reference numeral 110). The examiner identification information 102 and the examination region information 104 constitute a search condition. The search condition may include other conditions such as a search period.

[0091] The designated frame identification information 106 is information for specifying the number of the frame to be extracted from the volume data. Usually, the center (central) frame number is determined based on the beginning frame number and the last frame number, and the center frame number is set as the designated frame identification information 106. In the search request 100, the reference frame data 108 is sent to the extraction server 14 (reference symbol 112).

[0092] The image server 12 determines a data set that satisfies the search condition from the data group stored therein. From this point of view, the image server 12 is a search unit or a search device. When one or more volume data are included in the determined data set, the image server 12 extracts the specified frame data determined by the specified frame identification information from the volume data for each volume data. This process is a one-time extraction process, and from this point of view, the image server 12 is a one-time extraction unit or a one-time extraction device. The image server 12 transmits the frame data set to the ultrasonic diagnostic device 10 (reference symbol 114). In the second embodiment, one or more specified frame data are included in the frame data set.

[0093] On the other hand, when a volume data set is determined by searching in the image server 12, the volume data set is transmitted from the image server 12 to the extraction server 14 in parallel with the above-mentioned designated frame data extraction process (reference symbol 116). The extraction server 14 extracts matching frame data that matches the reference frame data from the volume data for each volume data. This process is a secondary extraction process, and from this point of view, the extraction server 14 is a secondary extraction unit or secondary extraction device. The extraction server 14 transmits the matching frame data set extracted from the volume data set to the ultrasonic diagnostic apparatus 10 (reference symbol 118).

[0094] The ultrasonic diagnostic apparatus 10 generates a plurality of thumbnail images based on the frame data set (including the designated frame data set) transmitted from the image server 12 and the matching frame data set transmitted from the extraction server 14 .

[0095] Generally, it takes a certain amount of time to extract matching frame data. On the other hand, it is possible to quickly extract designated frame data. In view of this, the ultrasonic diagnostic apparatus 10 generates a primary thumbnail image based on the designated frame data extracted from the volume data when the designated frame data extracted from the volume data is received, and displays the primary thumbnail image first. Then, when matching frame data extracted from the same volume data is received, a secondary thumbnail image is generated based on the matching frame data, and the secondary thumbnail image is displayed instead of the primary thumbnail image.

[0096] By switching the thumbnail images as described above, it is possible to avoid an increase in the blank time in which the thumbnail images are not displayed, and to meet the need to display the thumbnail images that the inspector is about to view.

[0097] exist Figure 7 An example of switching thumbnail images is shown in . First, a primary thumbnail image 120 based on designated frame data extracted from specific volume data is displayed. Next, a secondary thumbnail image 124 based on matching frame data extracted from the same specific volume data is displayed instead of the primary thumbnail image 120 .

[0098] The primary thumbnail image 120 includes information 122 that specifies the number or position of a specified frame. In the example shown in the figure, the information 122 indicates the center (center) of the volume data. The primary thumbnail image is displayed during the period from t1 to t2.

[0099] The secondary thumbnail image 124 includes a mark 126 for identifying that the displayed thumbnail image is a secondary thumbnail image. When the mark 126 is not displayed, it can be determined that the displayed thumbnail image is a primary thumbnail image. The numerical value 128 is information indicating the matching score. The secondary thumbnail image 124 is displayed during the period after t2.

[0100] When the generation of the secondary thumbnail image is completed for each volume data, the display switching of the thumbnail image can be performed separately. In this case, the display of most secondary thumbnail images starts in advance. On the other hand, when the generation of multiple secondary thumbnail images corresponding to the multiple volume data constituting the volume data set is completed, the display switching of multiple thumbnail images can be performed at the same time. In this case, it is possible to prevent the obstruction of observation caused by repeated display switching.

[0101] exist Figure 8 FIG. 4 shows an ultrasonic diagnostic system according to a third embodiment. Figure 8 In, with Figure 1 The same components as those shown are denoted by the same reference numerals.

[0102] In the third embodiment, the image server 12A includes an information processing unit 22A. The information processing unit 22A functions as a search unit 130 and an extraction unit 132. The extraction unit 132 is a module that performs a primary extraction process and a secondary extraction process. Figure 1 The storage unit 24A stores reference frame data in addition to the data group.

[0103] Figure 1 The extraction device shown may be provided in an external information processing device that is physically connected to the ultrasonic diagnostic device 10. In this case, the ultrasonic diagnostic device 10 and the external information processing device may be connected via a dedicated line.

Claims

1. An ultrasonic diagnostic system, characterized in that: include: an ultrasonic diagnostic device that forms an ultrasonic image based on received data obtained from a subject; and an extracting device that, when past volume data obtained from the subject is determined from the data group stored in the server, extracts matching frame data that matches the reference frame data sent from the ultrasonic diagnostic device from the past volume data, The ultrasonic diagnostic apparatus displays the ultrasonic image together with an image representing the matching frame data during ultrasonic examination of the subject.

2. The ultrasonic diagnostic system according to claim 1, characterized in that: The extraction means compares the reference frame data with a plurality of candidate frame data included in the past volume data, and extracts the candidate frame data determined thereby as the matching frame data.

3. The ultrasonic diagnostic system according to claim 1, characterized in that: The ultrasonic diagnostic apparatus includes a thumbnail image generating unit configured to generate a thumbnail image as an image representing the matching frame data based on the matching frame data.

4. The ultrasonic diagnostic system according to claim 3, characterized in that: The ultrasonic diagnostic apparatus displays a screen image including the ultrasonic image, The thumbnail image is the first thumbnail image, The thumbnail image generating unit further generates a second thumbnail image representing the received data obtained by the ultrasonic diagnostic apparatus. The screen image has: An external data display area, displaying the first thumbnail image; and The internal data display area displays the second thumbnail image.

5. The ultrasonic diagnostic system according to claim 3, characterized in that: The extraction device is a secondary extraction device, The thumbnail image is a secondary thumbnail image, The ultrasonic diagnostic system is provided with a primary extraction device, which extracts designated frame data from the past volume data based on designated frame identification information sent from the ultrasonic diagnostic device. The thumbnail image generating unit further generates a thumbnail image based on the designated frame data as an image representing the designated frame data. The ultrasonic diagnostic apparatus displays the primary thumbnail image and the secondary thumbnail image.

6. The ultrasonic diagnostic system according to claim 5, characterized in that: The ultrasonic diagnostic apparatus first displays the primary thumbnail image, and then displays the secondary thumbnail image in place of the primary thumbnail image.

7. The ultrasonic diagnostic system according to claim 5, characterized in that: The ultrasonic diagnostic apparatus displays identification information for identifying the primary thumbnail image and the secondary thumbnail image.

8. The ultrasonic diagnostic system according to claim 2, characterized in that: The extracting device calculates a matching score when comparing the reference frame data with each candidate frame data. The ultrasonic diagnostic apparatus displays an image representing the matching frame data together with information representing a matching score corresponding to the matching frame data.

9. The ultrasonic diagnostic system according to claim 1, characterized in that: The reference frame data is one of past tomographic image data registered in the ultrasonic diagnostic apparatus, current tomographic image data acquired in a current ultrasonic examination of the subject, and pseudo tomographic image data cut out from a three-dimensional tissue model.

10. An extraction device, characterized in that: Including the following institutions: receiving reference frame data transmitted from an ultrasonic diagnostic apparatus; When past volume data obtained from the subject is determined from the data group stored in the server, matching frame data matching the reference frame data is extracted from the past volume data; and sending the matching frame data to the ultrasonic diagnostic device, In the ultrasonic diagnostic apparatus, an ultrasonic image and an image representing the matching frame data are displayed together during ultrasonic examination of the subject.

11. A storage medium storing a program, the program being executed in an information processing device, wherein the program is characterized in that it includes the following functions: receiving reference frame data transmitted from an ultrasonic diagnostic apparatus; When past volume data obtained from the subject is determined from the data group stored in the server, matching frame data matching the reference frame data is extracted from the past volume data; and sending the matching frame data to the ultrasonic diagnostic device, In the ultrasonic diagnostic apparatus, an ultrasonic image and an image representing the matching frame data are displayed together during ultrasonic examination of the subject.

Citation Information

Patent Citations

  • Ultrasonic imager and image diagnostic system

    JP2009022626A