Ultrasonic diagnostic system and extraction device

Abstract

To enable an inspector to recognize existence of volume data stored in a server without a large load on a network during an ultrasonic inspection.SOLUTION: An ultrasonic diagnostic device 10 transmits a retrieval request including reference frame data to an image server 12. When volume data is identified in the image server 12, the volume data is transmitted to an extraction server 14. The extraction server 14 extracts adaptation frame data to adapt to the reference frame data from the volume data. A thumbnail image expressing the adaptation frame data is displayed in the ultrasonic diagnostic device 10.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an ultrasound diagnostic system and an extraction device, and in particular to a technique for processing volume data stored on a server. [Background technology]

[0002] An ultrasound diagnostic device is used in an ultrasound examination of a subject. The ultrasound diagnostic device is generally connected to a server, typically a DICOM (Digital Imaging and Communications in Medicine) server, via a network. A large amount of data is stored in the server. In response to a search request and a transfer request from the ultrasound diagnostic device, a search is performed in the server, and data identified by the search is transferred from the server to the ultrasound diagnostic device.

[0003] The data group stored in the server includes multiple volume data. Examples of such volume data include volume data acquired by an ultrasound diagnostic device (ultrasound volume data), volume data acquired by an MRI (Magnetic Resonance Imaging) device (MR volume data), and volume data acquired by a CT (Computed Tomography) device (X-ray CT device) (CT volume data). Focusing on the structure of the volume data, there are aggregate type volume data configured as an aggregate of multiple frame data (multiple slice data), and continuous type volume data configured as one data block with three-dimensional continuity.

[0004] When the specific volume data to be referenced is aggregate volume data, a transfer request including a frame number (usually a center frame number) is sent from the ultrasound diagnostic device to the server, and the frame data specified by the frame number is transferred from the server to the ultrasound diagnostic device. In the ultrasound diagnostic device, a thumbnail image is generated based on the acquired frame data, and the thumbnail image is displayed.

[0005] Patent Document 1 discloses an ultrasound diagnostic device having a DICOM server. The ultrasound diagnostic device has a function of displaying a current ultrasound image and a past ultrasound image side by side. Patent Document 1 does not disclose a technique for searching for desired frame data from volume data. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2009-22626 A Summary of the Invention [Problem to be solved by the invention]

[0007] From the viewpoint of supporting ultrasound examinations of subjects, it is desirable to make the examiner aware of the existence of past volume data obtained from the subject and stored in a server at the time of the ultrasound examination, thereby promoting the use of the past volume data.

[0008] To meet this demand, if a server were to search for the subject's past volume data and send all of the past volume data to the ultrasound diagnostic device, the load on the network would be large. It is desirable to send only data representing the part of the past volume data that the examiner would like to see to the ultrasound diagnostic device.

[0009] An object of the present disclosure is to enable an examiner to recognize the presence of volume data stored in a server during an ultrasound examination without placing a large burden on a network, or to enable an ultrasound diagnostic device to display an image that the examiner would like to see as an image representing the volume data. [Means for solving the problem]

[0010] The ultrasound diagnostic system according to the present disclosure includes an ultrasound diagnostic device that forms an ultrasound image based on received data obtained from a subject, and an extraction device that, when past volume data obtained from the subject is identified from a group of data stored in a server, extracts matching frame data that matches reference frame data sent from the ultrasound diagnostic device from the past volume data, and is characterized in that the ultrasound diagnostic device displays an image representing the matching frame data together with the ultrasound image during an ultrasound examination of the subject.

[0011] The extraction device according to the present disclosure includes a means for receiving reference frame data sent from an ultrasound diagnostic device, a means for extracting matching frame data that matches the reference frame data from past volume data when past volume data obtained from a subject is identified from a group of data stored in a server, and a means for transmitting the matching frame data to the ultrasound diagnostic device, and is characterized in that an image representing the matching frame data is displayed together with the ultrasound image in the ultrasound diagnostic device during an ultrasound examination of the subject. Effect of the Invention

[0012] According to the present disclosure, during an ultrasound examination, an examiner can recognize the presence of volume data stored in a server without placing a large burden on a network. Alternatively, according to the present disclosure, an image that a user would want to see is displayed as an image representing the volume data in an ultrasound diagnostic device. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram showing an ultrasound diagnostic system according to a first embodiment. [Diagram 2] FIG. 11 is a diagram illustrating an example of the extraction process (secondary extraction process). [Diagram 3] 4 is a flowchart showing the operation of the ultrasound diagnostic system according to the first embodiment. [Figure 4] FIG. 13 is a diagram showing an example of a screen image. [Diagram 5] FIG. 11 is a diagram showing reference frame data. [Figure 6] FIG. 11 is a diagram showing the operation of the ultrasound diagnostic system according to the second embodiment. [Figure 7] FIG. 11 is a diagram showing switching of thumbnail images according to the second embodiment. [Figure 8] FIG. 11 is a block diagram showing an ultrasound diagnostic system according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an embodiment will be described with reference to the drawings.

[0015] (1) Overview of the embodiment An ultrasound diagnostic system according to an embodiment includes an ultrasound diagnostic device and an extraction device. The ultrasound diagnostic device forms an ultrasound image based on received data obtained from a subject. When past volume data obtained from the subject is identified from a data group stored in a server, the extraction device extracts matching frame data that matches reference frame data sent from the ultrasound diagnostic device from the past volume data. The ultrasound diagnostic device displays an image representing the matching frame data together with an ultrasound image during an ultrasound examination of the subject.

[0016] According to the above configuration, an image representing past volume data acquired from the subject is displayed during an ultrasound examination of the subject. Thus, the examiner can recognize that past volume data exists in the server through observing such an image. The image representing the past volume data is an image representing matching frame data that matches the reference frame data. Thus, assuming appropriate selection of the reference frame data, the possibility of displaying an image that can support the current ultrasound examination is increased.

[0017] The image representing the adapted frame data is, for example, a tomographic image or a thumbnail image. If the acquisition of the adapted frame data and the generation of the image representing the applied frame data are performed as background processing during an ultrasound examination of a subject, no burden is placed on the examiner. According to the above configuration, only a part of the past volume data is transferred, not all of it, so that the load on the network is reduced. This advantage is even greater when multiple pieces of past volume data exist in the server. When it becomes necessary to acquire all of the past volume data, the past volume data is transferred from the server to the ultrasound diagnostic device.

[0018] In the embodiment, the extraction device is an information processing device connected to the ultrasound diagnostic device via a network. The extraction device may be incorporated in a server. An external information processing device physically connected to the ultrasound diagnostic device may function as the extraction device. The past volume data is MR volume data, CT volume data, or ultrasound volume data. The past volume data may be other volume data such as X-ray mammography volume data. The configuration according to the embodiment can promote the use of past volume data acquired by a medical device of a type different from the ultrasound diagnostic device.

[0019] In an embodiment, the extraction device compares the reference frame data with a plurality of candidate frame data included in the past volume data, thereby extracting a specific candidate frame data as a suitable frame data. When comparing the two frame data, various known techniques such as correlation calculation may be used. In general, cross sections for extracting the candidate frame data are sequentially set at various positions and angles for the past volume data. When the volume data is composed of a plurality of frame data, only the plurality of frame data may be regarded as a plurality of candidate frame data.

[0020] In an embodiment, the ultrasound diagnostic device has a thumbnail image generating unit that generates a thumbnail image as an image representing the matched frame data based on the matched frame data. In general, the thumbnail image is generated by performing low-resolution processing on the matched frame data. The thumbnail image can be said to be a reduced tomographic image. In general, by selecting a thumbnail image, a tomographic image (a tomographic image not subjected to low-resolution processing) representing the corresponding frame data associated with the thumbnail image is displayed.

[0021] In an embodiment, the ultrasound diagnostic device displays a screen image including an ultrasound image. The thumbnail image is a first thumbnail image. The thumbnail image generating unit further generates a second thumbnail image representing reception data obtained by the ultrasound diagnostic device. The screen image has an external data display area in which the first thumbnail image is displayed, and an internal data display area in which the second thumbnail image is displayed.

[0022] According to the above configuration, the examiner can recognize the local data (internal data) stored in the ultrasound diagnostic device and the remote data (external data) stored in the server. Therefore, the external data can be distinguished from the internal data, and the acquisition, reference, and use of the external data can be promoted.

[0023] In an embodiment, the extraction device is a secondary extraction device. The thumbnail image is a secondary thumbnail image. The ultrasound diagnostic system further includes a primary extraction device that extracts designated frame data from past volume data based on designated frame identification information sent from the ultrasound diagnostic device. The thumbnail image generation unit further generates a primary thumbnail image as an image representing the designated frame data based on the designated frame data. The ultrasound diagnostic device displays the primary thumbnail image and the secondary thumbnail image.

[0024] The designated frame is usually a frame automatically designated by the ultrasound diagnostic device. If it takes time to display the secondary thumbnail image, the primary thumbnail image may be displayed first temporarily. The primary thumbnail image and the secondary thumbnail image may be displayed simultaneously or sequentially.

[0025] In an embodiment, the ultrasound diagnostic apparatus first displays a primary thumbnail image, and then displays a secondary thumbnail image in place of the primary thumbnail image. This configuration allows the examiner to quickly recognize the existence of past volume data, and also makes it possible to provide the examiner with images that the examiner is likely to want to see. When displaying multiple secondary thumbnail images representing multiple volume data, they may be displayed sequentially in the order in which they were generated, or may be displayed simultaneously at a fixed timing.

[0026] In an embodiment, the ultrasound diagnostic device displays identification information for identifying the primary thumbnail image and the secondary thumbnail image. With this configuration, it becomes possible for an examiner to recognize the attributes of the frame data corresponding to the thumbnail image.

[0027] In an embodiment, the extraction device calculates a compatibility score when comparing the reference frame data with each candidate frame data. The ultrasound diagnostic device displays information indicating the compatibility score corresponding to the compatible frame data together with an image representing the compatible frame data. With this configuration, the examiner can recognize the possibility that the cross section corresponding to the compatible frame data is the cross section that the examiner wants to see by referring to the information indicating the compatibility score.

[0028] In an embodiment, the reference frame data is one of past tomographic image data registered in an ultrasound diagnostic device, current tomographic image data acquired in a current ultrasound examination of a subject, and pseudo tomographic image data extracted from a three-dimensional tissue model.

[0029] The reference frame data is automatically designated or designated by the examiner. For example, a plurality of reference frame data associated with a plurality of steps constituting an ultrasound examination protocol may be registered in advance. By adopting such a configuration, the plurality of reference frame data are automatically selected in sequence as the ultrasound examination protocol progresses, and a plurality of thumbnail images are automatically displayed in sequence.

[0030] An extraction device according to an embodiment includes a receiving means, an extracting means, and a transmitting means. The receiving means receives reference frame data sent from an ultrasound diagnostic device. When past volume data obtained from a subject is identified from a data group stored in a server, the extracting means extracts matching frame data that matches the reference frame data from the past volume data. The transmitting means transmits the matching frame data to the ultrasound diagnostic device. In the ultrasound diagnostic device, an image representing the matching frame data is displayed together with an ultrasound image during an ultrasound examination of the subject.

[0031] Each of the above means is realized as a function of hardware or software. In the latter case, a program for executing the above series of processes is installed in the information processing device via a network or a portable storage medium. The information processing device has a non-transitory storage medium in which the program is stored. The information processing device also has a processor for executing the program.

[0032] (2) Details of the embodiment An ultrasound diagnostic system according to the first embodiment is shown in Fig. 1. This ultrasound diagnostic system is installed in a medical institution such as a hospital. The ultrasound diagnostic system is actually a medical system for supporting the examination (and treatment) of a subject.

[0033] The ultrasound diagnostic system includes an ultrasound diagnostic device 10, an image server 12, and an extraction server 14. The ultrasound diagnostic device 10 is used for ultrasound examination of a subject. The image server 12 is, for example, a DICOM server that stores and provides medical images. The extraction server 14 is a device that extracts frame data from volume data, as described later.

[0034] The ultrasound diagnostic system has a network 16. The network 16 is, for example, a LAN (Local Area Network). The network 16 may include the Internet. An ultrasound diagnostic apparatus 10, an image server 12, and an extraction server 14 are connected to the network 16. A CT apparatus 18 and an MR apparatus 20 are also connected to the network 16. In addition, another ultrasound diagnostic apparatus (not shown) is also connected to the network 16.

[0035] The image server 12 is composed of an information processing device such as a computer. The image server 12 has an information processing unit 22 and a storage unit 24. The information processing unit 22 has a processor. The storage unit 24 is composed of a semiconductor memory, a hard disk, etc. The storage unit 24 stores a data group consisting of various data acquired by the ultrasound diagnostic device 10, the CT device 18, the MR device 20, etc. Specifically, the data group includes a plurality of CT volume data, a plurality of MR volume data, and a plurality of ultrasound volume data. Other volume data may also be included in the data group.

[0036] Each volume data is data acquired from a three-dimensional space in a living body. Each volume data is a set type volume data consisting of a plurality of spatially connected frame data (a plurality of slice data), or a continuous type volume data configured as a single data with spatial continuity. Each data constituting the data group is associated with subject information, examination area information, examination date and time information, etc.

[0037] The image server 12 has a search function and an extraction function (primary extraction function). The image server 12 corresponds to a search device and a primary extraction device. The search function is a function for identifying one or more pieces of data that satisfy a search condition in a data set. The extraction function is a function for extracting frame data corresponding to a specified frame number from the volume data. The frame data is cross-sectional data.

[0038] In the image server 12, the extraction function can usually be applied only to collection-type volume data. The frame number specified is usually the frame number corresponding to the central cross section. The image server 12 also has a function of receiving a search request and a transfer request, a function of transmitting specified or extracted data, and the like.

[0039] The extraction server 14 is configured with an information processing device such as a computer. The extraction server 14 has an information processing unit 26 and a storage unit 28. The information processing unit 26 has a processor that executes a program. The storage unit 28 is configured with a semiconductor memory, a hard disk, etc. The storage unit 28 stores reference frame data 29 sent from the ultrasound diagnostic device 10. The storage unit 28 also stores a program executed by the processor.

[0040] The extraction server 14 is a secondary extraction device having an extraction function (secondary extraction function). Specifically, the extraction function is a function to extract frame data (matching frame data) that matches the reference frame data from the volume data sent from the image server 12. This will be described in detail later.

[0041] The extraction server 14 also has a function of receiving reference frame data and volume data, a function of transmitting matching frame data, etc. As will be described later, the extraction server 14 may be provided in the image server 12, or the image server 12 and the extraction server 14 may be integrated. The extraction server 14 and the ultrasound diagnostic apparatus 10 may be connected by a dedicated line.

[0042] Next, the ultrasound diagnostic device 10 will be described. The ultrasound probe 32 has a transducer array. An ultrasound beam is formed by the transducer array, and the ultrasound beam is electronically scanned. Known electronic scanning methods include an electronic linear scanning method and an electronic sector scanning method. A beam scanning plane is formed within the subject by electronically scanning the ultrasound beam. The beam scanning plane is an observation cross section. The position and posture of the beam scanning plane within the subject change with the change in the position and posture of the ultrasound probe 32. A 2D transducer array may be provided in the ultrasound probe 32, and volume data may be acquired using the 2D transducer array.

[0043] The transmission / reception circuit 34 is an electronic circuit that functions as a transmission beamformer and a reception beamformer. During transmission, multiple transmission signals are output in parallel from the transmission / reception circuit 34 to the transducer array. This causes ultrasound to be emitted into the living body, that is, a transmission beam is formed. During reception, when a reflected wave from inside the living body reaches the transducer array, multiple reception signals are output in parallel from the transducer array to the transmission / reception circuit 34. The transmission / reception circuit 34 applies phasing addition to the multiple reception signals, thereby generating reception beam data. Multiple reception beam data aligned in the electronic scanning direction are generated per electronic scan. These constitute reception frame data.

[0044] The beam data processing unit 36 ​​is a module that processes the received beam data sequence output from the transmission / reception circuit 34. The beam data processing unit 36 ​​has a detector, a logarithmic converter, etc. The image forming unit 38 generates tomographic image data (B-mode tomographic image data) based on the received beam data sequence output from the beam data processing unit 36. The image forming unit 38 has a digital scan converter (DSC). The DSC has a coordinate conversion function, a pixel interpolation function, etc. The tomographic image data is sent from the image forming unit 38 to the information processing unit 40. Ultrasound images other than tomographic images may also be formed.

[0045] The information processing unit 40 has a processor (specifically, a CPU) that executes a program. In addition to the display 50, a storage unit 46 and an operation panel 48 are connected to the information processing unit 40. The storage unit 46 is composed of a semiconductor memory, a hard disk, etc. The operation panel 48 is an input device having a plurality of switches, a trackball, a keyboard, etc. The user may specify or select reference frame data by using the operation panel 48. The display 50 is composed of, for example, an organic EL display device, an LCD.

[0046] The storage unit 46 stores, for example, tissue model data 52, a plurality of tomographic image data 54, a plurality of frame data 56, a plurality of volume data 58, and the like.

[0047] The tissue model data 52 is data representing a tissue model. The tissue model is a three-dimensional model that artificially simulates the form and structure of a specific tissue (e.g., heart, liver). A plurality of tissue model data 52 corresponding to a plurality of tissues that can be the subject of an ultrasound examination may be prepared.

[0048] Each of the sectional image data 54 is data acquired and stored by the ultrasound diagnostic device 10. The multiple sectional image data 54 may include current sectional image data acquired in a current ultrasound examination of the subject, and past sectional image data acquired in a past ultrasound examination of the subject. The substance of each of the sectional image data 54 is frame data.

[0049] Each frame of data 56 is a matching frame of data extracted and forwarded by the extraction server 14. The plurality of frames of data 56 may include designated frames of data extracted and forwarded by the image server 12. Each volume data 58 is a volume of data extracted and forwarded by the image server 12.

[0050] The information processing unit 40 controls the operation of each component constituting the ultrasound diagnostic apparatus 10. The information processing unit 40 functions as a background processing control unit 42 and a thumbnail image generating unit 44. The information processing unit 40 also has a function of generating a screen image to be displayed on the display 50. The screen image includes a current tomographic image as well as one or more thumbnail images representing one or more suitable frame data.

[0051] The background processing control unit 42 controls background processing executed during a current ultrasound examination of a subject. The background processing includes a search process and a thumbnail image display process.

[0052] In the search process, past data sets of the subject stored in the image server 12 are searched. The past data sets may include past frame data and past volume data. The past frame data is transferred from the image server 12 to the ultrasound diagnostic device 10. If necessary, specified frame data extracted from the past volume data according to a specified frame number is transferred from the image server 12 to the ultrasound diagnostic device 10.

[0053] The past volume data identified in the image server 12 is transferred from the image server 12 to the extraction server 14. The extraction unit 30 in the extraction server 14 extracts matching frame data that matches the reference frame data 29 from the received past volume data. The extracted matching frame data is transferred from the extraction server 14 to the ultrasound diagnostic device. The thumbnail image generation unit 44 generates a thumbnail image based on the received or stored frame data (designated frame data, matching frame data, or tomographic image data).

[0054] In the thumbnail image display process, thumbnail images representing past data stored in the image server 12 are displayed on the display 50. In this case, the thumbnail images represent past frame data or past volume data obtained from the subject. Note that thumbnail images representing tomographic image data acquired and stored in the current ultrasound examination are also displayed on the display 50.

[0055] Note that the thumbnail image representing the data stored in the image server 12 (external data) is the first thumbnail image, and the thumbnail image representing the data stored in the ultrasound diagnostic apparatus 10 (internal data) is the second thumbnail image. The thumbnail image representing the designated frame data extracted from the volume data stored in the image server 12 is the primary thumbnail image. The thumbnail image representing the matched frame data extracted from the volume data stored in the image server 12 is the secondary thumbnail image. Both the primary thumbnail image and the secondary thumbnail image are first thumbnail images. The screen image displayed on the display 50 includes one or more first thumbnail images and one or more second thumbnail images.

[0056] 2 shows the extraction process of suitable frame data in the extraction server. Typically, a plurality of cutout slices 204 are sequentially set at various positions and angles for the received volume data 202. Reference numeral 206 denotes candidate frame data corresponding to a specific cutout slice 204. Each of the sequentially extracted candidate frame data 206 is compared with the reference frame data 200 (see reference numeral 210). In this case, techniques such as correlation calculation and pattern matching are used.

[0057] A compatibility score is calculated for each comparison of frame data. The compatibility score may be, for example, a correlation value, a matching score, or a similarity score. The best compatibility score is identified from among a plurality of compatibility scores corresponding to a plurality of candidate frame data, and then the candidate frame data corresponding to the best compatibility score is identified as the compatible frame data. This allows the compatible frame data to be extracted from the volume data. The compatible frame data is sent from the extraction server to the ultrasound diagnostic device together with score information indicating the corresponding compatibility score (see reference numeral 212). The compatible frame data and the score information may be sent to the ultrasound diagnostic device 10 via the image server 12. When comparing two frame data, the size or scale of one of the frame data is adjusted as necessary.

[0058] Fig. 3 shows the operation of the ultrasound diagnostic system shown in Fig. 1. More specifically, Fig. 3 shows the operation of the ultrasound diagnostic apparatus 10, the operation of the image server 12, and the operation of the extraction server 14 during background processing.

[0059] In the ultrasound diagnostic device 10, a subject ID is received in S10, and an examination area is received in S12. The examination area is an area to which the tissue to be examined belongs (e.g., abdomen, circulatory system). An ultrasound examination is started in S14. A reference cross section is identified in S16. That is, the reference frame data is identified. The reference frame data may be automatically identified, or the reference frame data may be designated by the examiner.

[0060] In S18, a search request and a transfer request are sent from the ultrasound diagnostic apparatus 10 to the image server 12. The search request may be sent first, and after receiving the search results, a transfer request based on the search results may be sent. The search request and the transfer request may be sent simultaneously. The search request includes search conditions. The search conditions include subject identification information (subject ID), examination area identification information, search period, etc. The transfer request includes reference frame data. The transfer request includes designated frame identification information as necessary. The reference frame data is sent from the ultrasound diagnostic apparatus 10 to the extraction server 14. The reference frame data may be sent from the ultrasound diagnostic apparatus 10 to the extraction server 14 via the image server 12. In S22, the extraction server 14 receives the reference frame data.

[0061] In the image server 12, in S20, a data set that satisfies the search conditions is searched from among the stored data. The data set includes one or more frame data (frame data sets) and / or one or more volume data (volume data sets). All of the data is past data obtained from the subject who is the subject of the current ultrasound examination.

[0062] If a frame data set is specified by the above search, in S24, the frame data set is transferred from the image server 12 to the ultrasound diagnostic device 10. At that time, the designated frame data extracted from each volume data is also transferred as necessary. Also, if a volume data set is specified by the above search, in S26, the volume data set is transferred from the image server 12 to the extraction server 14.

[0063] In S28, the extraction server 14 receives the volume data set. In S30, for each volume data set, candidate frame data matching the reference frame data is searched from the volume data set. In S32, the matching frame data set extracted from the volume data set is transferred from the extraction server 14 to the ultrasound diagnostic device 10. The matching frame data set may be transferred from the extraction server 14 to the ultrasound diagnostic device 10 via the image server 12.

[0064] In the ultrasound diagnostic apparatus 10, in S34, the frame data set sent from the image server 12 is received, and also the adapted frame data set sent from the extraction server 14 is received. As described above, each piece of received data is past data acquired from the subject. In S36, a plurality of thumbnail images (thumbnail image set) is generated based on the plurality of received data. In S38, the thumbnail image set is displayed. Usually, the plurality of thumbnail images are displayed sequentially in the order in which they were generated.

[0065] The set of thumbnail images displayed includes thumbnail images representing matched frame data extracted from the volume data, and the examiner can recognize that past volume data exists in the image server 12 by observing such thumbnail images.

[0066] For example, after the dual-screen display mode is started, a current tomographic image as a real-time tomographic image and a past tomographic image generated from the suitable frame data may be displayed in parallel through a selection operation of a thumbnail image. In this case, it is possible to evaluate the content of the current tomographic image while comparing the contents of the two images. To allow such an image comparison to be performed appropriately, the reference frame data is selected in advance.

[0067] 3, during a current ultrasound examination, a specific mode is started in S40. Then, in S42, a thumbnail image is selected, and a transfer request for the volume data corresponding to the thumbnail image is sent to the image server 12. In S44, the volume data sent from the image server 12 is received by the ultrasound diagnostic device 10.

[0068] The specific mode is, for example, a mode in which a current tomographic image as a real-time tomographic image and a past tomographic image based on past volume data are displayed in parallel. In this case, both the current tomographic image and the past tomographic image are images representing the same observation cross section (beam scanning surface). For example, based on position information obtained by detecting the position and orientation of the ultrasound probe, surface data corresponding to the observation cross section is extracted from the past volume data, and a past tomographic image is generated based on the surface data.

[0069] An example of a screen image displayed on the display is shown in Fig. 4. The screen image 60 has a real-time tomographic image 62, a first thumbnail image display area 64, and a second thumbnail image display area 66.

[0070] The first thumbnail image display area 64 is an area for displaying a plurality of thumbnail images 70 representing a plurality of internal data. Each internal data is data acquired and stored in an ultrasound diagnostic device, and is typically tomographic image data. The second thumbnail image display area 66 is an area for displaying a plurality of thumbnail images 72A to 72E representing a plurality of external data. Each external data is data stored in an image server, and is frame data or volume data.

[0071] The thumbnail image 72A is a thumbnail image representing MR volume data acquired by an MRI device. It includes a label 74 indicating the data type, a mark 76 indicating that it is a thumbnail image representing matching frame data, and a numerical value 78 indicating the matching score. The mark 76 is a simple circular mark, but various display elements may be adopted as the mark 76. The maximum value of the numerical value 78 is, for example, 100(%), and the minimum value is, for example, 0(%). Instead of a numerical value, information such as a symbol or color may be displayed.

[0072] By displaying the mark 76, the examiner can recognize that the thumbnail image 72A is a thumbnail image that represents the suitable frame data. By displaying the numerical value 78, the examiner can be presented with the possibility that the suitable frame data is an image that represents the cross section that the examiner wants to see.

[0073] In reality, a window selected from a plurality of windows is displayed in the second thumbnail image display area 66. A specific tab is selected from a plurality of tabs 84, 86, 88 corresponding to the plurality of windows, and a window corresponding to the selected tab is displayed. Each window includes one or a plurality of second thumbnails. For example, a window may be generated for each examination date or each examination period.

[0074] The screen image shown in FIG. 4 includes a tissue model image 68. The tissue model image 68 is an image that represents a three-dimensional model that simulates the tissue that is the subject of the current ultrasound examination. Together with the tissue model image 68, a frame image 80 that crosses it is also displayed. The examiner adjusts the position and orientation of the frame image 80 relative to the tissue model image 68. This identifies a specific cross section 82 in the tissue model image 68. Based on the specific cross section 82, cross-sectional data is extracted from the tissue model. This is used as reference frame data. As described below, the reference frame data may be defined based on other data.

[0075] 5 shows a method for determining the reference frame data 96. For example, the current tomographic image data may be set as the reference frame data 96. In this case, the current tomographic image data may be specified at a timing designated by the examiner or at a timing determined automatically. The current tomographic image at the time of freezing may be set as the reference frame data.

[0076] Past tomographic image data stored in the ultrasound diagnostic device may be used as the reference frame data 96. The past tomographic image data is past data acquired from a subject undergoing a current ultrasound examination. As described above, the pseudo tomographic image data 94, which is cross-sectional data cut out from a three-dimensional tissue model, may be used as the reference frame data 96.

[0077] Next, an ultrasound diagnostic system according to a second embodiment will be described with reference to Figures 6 and 7. The configuration of the ultrasound diagnostic system according to the second embodiment is basically the same as that shown in Figure 1. In the second embodiment, a primary thumbnail image based on the designated frame data is displayed first, and then a secondary thumbnail image based on the matching frame data is displayed. This will be described in detail below.

[0078] Reference numeral 100 indicates information contained in a search request (and a transfer request) issued from the ultrasound diagnostic apparatus 10. In the search request 100, examiner identification information 102, examination area information 104, and designated frame identification information 106 are sent to the image server 12 (see reference numeral 110). The examiner identification information 102 and the examination area information 104 form search conditions. The search conditions may also include other conditions such as a search period.

[0079] The specified frame identification information 106 specifies the number of the frame to be extracted from the volume data. Usually, a central (center) frame number is specified based on the first frame number and the last frame number, and the central frame number is set as the specified frame identification information 106. Within the search request 100, the reference frame data 108 is sent to the extraction server 14 (see reference numeral 112).

[0080] The image server 12 identifies a data set that satisfies the search conditions from the data group stored therein. From that point of view, the image server 12 is a search unit or a search device. If the identified data set includes one or more volume data, the image server 12 extracts, for each volume data, designated frame data that is specified by designated frame identification information from the volume data. This process is a primary extraction process, and from that point of view, the image server 12 is a primary extraction unit or a primary extraction device. The image server 12 transfers the frame data set to the ultrasound diagnostic device 10 (see reference numeral 114). In the second embodiment, the frame data set includes one or more designated frame data.

[0081] On the other hand, if a volume data set is identified by the search in the image server 12, the volume data set is sent from the image server 12 to the extraction server 14 (see reference numeral 116) in parallel with the above-mentioned designated frame data extraction process. The extraction server 14 extracts matching frame data that matches the reference frame data from each volume data. This process is a secondary extraction process, and from that point of view, the extraction server 14 is a secondary extraction unit or secondary extraction device. The extraction server 14 transmits the matching frame data set extracted from the volume data set to the ultrasound diagnostic device 10 (see reference numeral 118).

[0082] The ultrasound diagnostic apparatus generates a plurality of thumbnail images based on the frame dataset (including the designated frame dataset) sent from the image server 12 and the matching frame dataset sent from the extraction server.

[0083] Usually, it takes a certain amount of time to extract the suitable frame data. On the other hand, the designated frame data can be extracted quickly. Taking this into consideration, when the ultrasound diagnostic device 10 receives the designated frame data extracted from the volume data, it generates a primary thumbnail image based on the designated frame data and displays the primary thumbnail image in advance. Thereafter, when the ultrasound diagnostic device 10 receives the suitable frame data extracted from the same volume data, it generates a secondary thumbnail image based on the suitable frame data and displays the secondary thumbnail image instead of the primary thumbnail image.

[0084] By switching thumbnail images as described above, it is possible to avoid an increase in blank time during which no thumbnail images are displayed, and it is possible to satisfy the need to display thumbnail images that an examiner may wish to observe.

[0085] An example of thumbnail image switching is shown in Figure 7. First, a primary thumbnail image 120 based on designated frame data extracted from a particular volume data is displayed. Then, a secondary thumbnail image 124 based on matching frame data extracted from the same particular volume data is displayed in place of the primary thumbnail image.

[0086] The primary thumbnail image 120 includes information 122 that identifies the number or position of a specified frame. In the illustrated example, the information 122 indicates the center (middle) of the volume data. The primary thumbnail image is displayed over a period from t1 to t2.

[0087] The secondary thumbnail image 124 includes a mark 126 for identifying that the displayed thumbnail image is a secondary thumbnail image. If the mark 126 is not displayed, it may be determined that the displayed thumbnail image is a primary thumbnail image. The numerical value 128 is information representing a matching score. The secondary thumbnail image 124 is displayed in the period from t2 onwards.

[0088] When the generation of a secondary thumbnail image is completed for each volume data, the display of the thumbnail images may be switched individually. In this case, the start of displaying many secondary thumbnail images can be accelerated. On the other hand, when the generation of multiple secondary thumbnail images corresponding to multiple volume data constituting a volume data set is completed, the display of multiple thumbnail images may be switched collectively. In this case, it is possible to prevent the observation from being hindered due to repeated display switching.

[0089] Fig. 8 shows an ultrasound diagnostic system according to the third embodiment. In Fig. 8, the same components as those shown in Fig. 1 are denoted by the same reference numerals.

[0090] In the third embodiment, the image server 12A has an information processing unit 22A. The information processing unit 22A functions as a search unit 130 and an extraction unit 132. The extraction unit 132 is a module that executes a primary extraction process and a secondary extraction process. In other words, the image server 12A is a server that includes the extraction server shown in Fig. 1. In addition to a data group, the memory unit 24A stores reference frame data.

[0091] 1 may be provided in an external information processing device physically connected to the ultrasonic diagnostic device. In that case, the ultrasonic diagnostic device and the external information processing device may be connected by a dedicated line. [Explanation of symbols]

[0092] 10 ultrasound diagnostic device, 12 image server, 14 extraction server, 29 reference frame data, 30 extraction unit, 40 information processing unit, 42 background processing unit, 44 thumbnail image generation unit.

Claims

1. an ultrasonic diagnostic device that forms an ultrasonic image based on reception data obtained from a subject; an extraction device that extracts, when past volume data obtained from the subject is identified from a data group stored in a server, matching frame data that matches the reference frame data sent from the ultrasound diagnostic device from the past volume data; Including, the ultrasound diagnostic device displays an image representing the matching frame data together with the ultrasound image during an ultrasound examination of the subject; 1. An ultrasound diagnostic system comprising:

2. 2. The ultrasound diagnostic system according to claim 1, The extraction device compares the reference frame data with a plurality of candidate frame data included in the past volume data, thereby extracting a specific candidate frame data as the suitable frame data.

1. An ultrasound diagnostic system comprising:

3. 2. The ultrasound diagnostic system according to claim 1, The ultrasound diagnostic apparatus has a thumbnail image generating unit that generates a thumbnail image as an image representing the matched frame data based on the matched frame data.

1. An ultrasound diagnostic system comprising:

4. 4. The ultrasound diagnostic system according to claim 3, the ultrasound diagnostic device displays a screen image including the ultrasound image; the thumbnail image is a first thumbnail image; the thumbnail image generating unit further generates a second thumbnail image representing the reception data obtained by the ultrasound diagnostic device; The screen image is an external data display area in which the first thumbnail image is displayed; an internal data display area in which the second thumbnail image is displayed; having 1. An ultrasound diagnostic system comprising:

5. 4. The ultrasound diagnostic system according to claim 3, the extractor is a secondary extractor; the thumbnail image is a secondary thumbnail image; a primary extraction device is provided for extracting designated frame data from the past volume data based on designated frame identification information sent from the ultrasonic diagnostic device; the thumbnail image generating unit further generates a primary thumbnail image based on the designated frame data as an image representing the designated frame data; the ultrasound diagnostic device displays the primary thumbnail image and the secondary thumbnail image.

1. An ultrasound diagnostic system comprising:

6. 6. The ultrasound diagnostic system according to claim 5, the ultrasound diagnostic device first displays the primary thumbnail image, and then displays the secondary thumbnail image in place of the primary thumbnail image; 1. An ultrasound diagnostic system comprising:

7. 6. The ultrasound diagnostic system according to claim 5, the ultrasound diagnostic device displays identification information for identifying the primary thumbnail image and the secondary thumbnail image.

1. An ultrasound diagnostic system comprising:

8. 3. The ultrasound diagnostic system according to claim 2, The extraction device calculates a match score when comparing the reference frame data with each of the candidate frame data; The ultrasound diagnostic apparatus displays information indicating a match score corresponding to the matched frame data together with an image representing the matched frame data.

1. An ultrasound diagnostic system comprising:

9. 2. The ultrasound diagnostic system according to claim 1, The reference frame data is one of past tomographic image data registered in the ultrasound diagnostic device, current tomographic image data acquired in a current ultrasound examination of the subject, and pseudo tomographic image data extracted from a three-dimensional tissue model.

1. An ultrasound diagnostic system comprising:

10. means for receiving reference frame data sent from an ultrasound diagnostic device; a means for extracting, when past volume data obtained from a subject is identified from a data group stored in a server, matching frame data that matches the reference frame data from the past volume data; means for transmitting the adapted frame data to the ultrasonic diagnostic device; Including, In the ultrasound diagnostic device, an image representing the matching frame data is displayed together with an ultrasound image during an ultrasound examination of the subject. An extraction apparatus characterized by:

11. A program executed in an information processing device, receiving reference frame data sent from an ultrasound diagnostic device; a function of extracting, when past volume data obtained from a subject is identified from a data group stored in a server, matching frame data that matches the reference frame data from the past volume data; a function of transmitting the adapted frame data to the ultrasound diagnostic device; Including, In the ultrasound diagnostic device, an image representing the matching frame data is displayed together with an ultrasound image during an ultrasound examination of the subject. A program characterized by:

Images