Ultrasound diagnostic system, ultrasound diagnostic device, and program product

By introducing AP groups and management departments into the ultrasonic diagnostic system to manage the relationship and actions of multiple APs, the problem that existing systems cannot enable multiple APs to operate simultaneously or in concert is solved, and the ability to provide more valuable information is realized.

CN119587067APending Publication Date: 2025-03-11FUJIFILM CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411263056.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-09-11
Filing Date
2024-09-10
Publication Date
2025-03-11

Smart Images

  • Figure CN119587067A_ABST
    Figure CN119587067A_ABST
Patent Text Reader

Abstract

The present invention provides an ultrasound diagnostic system, an ultrasound diagnostic device, and a program product, and the subject of the present invention is to implement a structure in which a plurality of APs including an external AP (application program) are operated together in an ultrasound diagnostic system. The management table (40) has management information indicating the relationship between a plurality of APs constituting the AP group (54). The AP management unit (28) manages the selection of an AP set from among the AP groups (54) on the basis of the management information, and manages the operation of the AP set. The AP set includes a plurality of APs that act together in ultrasound inspection. The management information includes a plurality of appropriate combination information. Each of the appropriate combination information includes a specification of a parallel action or a specification of a serial action.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic system and an ultrasonic diagnostic device, and more particularly to management of operations with a plurality of APs (application programs). Background Art

[0002] Ultrasonic diagnostic devices are used in ultrasonic examinations. As the functionality of ultrasonic diagnostic devices increases, the information processing load in the ultrasonic diagnostic devices is increasing. Against this background, an ultrasonic diagnostic system including an ultrasonic diagnostic device and an information processing device (hereinafter referred to as an external information processing device) is proposed (for example, refer to Patent Documents 1 and 2).

[0003] The external information processing device has an AP for processing image data generated in the ultrasonic diagnostic device. Specifically, the AP is software that applies specific processing to the image data. The processing result of the AP is displayed in the ultrasonic diagnostic device. Examples of specific processing performed by the AP include analysis of image data, processing of image data, and measurement based on image data. The specific processing may include other processing applicable to the result of processing the image data.

[0004] In the present specification, an AP included in an external information processing device is referred to as an external AP, and an AP included in an ultrasonic diagnostic device is referred to as an internal AP, depending on the situation.

[0005] Patent Document 1: Japanese Patent Application Publication No. 2022-165214

[0006] Patent Document 2: Japanese Patent Application Publication No. 2022-167500

[0007] In order to support ultrasonic examination, it is expected to provide more valuable information to the examiner. For this reason, it is expected to make multiple APs operate simultaneously or cooperate with each other during ultrasonic examination. However, conventional ultrasonic diagnosis systems do not have a structure for making multiple APs including external APs operate together. Summary of the invention

[0008] An object of the present invention is to operate a plurality of APs including an external AP in a coordinated manner in an ultrasonic diagnostic system. Alternatively, an object of the present invention is to operate a plurality of APs including an external AP in a proper manner in an ultrasonic diagnostic system.

[0009] The ultrasonic diagnostic system involved in the present invention is characterized in that it includes: an ultrasonic diagnostic device that generates image data based on received data; and an external information processing device that is connected to the ultrasonic diagnostic device, and the ultrasonic diagnostic system also includes: an AP group that is set in the external information processing device, or is set throughout the ultrasonic diagnostic device and the external information processing device, and is composed of multiple APs (applications) for processing the image data; and a management unit that manages the selection of an AP set from the AP group based on management information indicating the relationship between the multiple APs constituting the AP group, and manages the operation of the AP set, wherein the AP set includes multiple APs that operate together during ultrasonic examination.

[0010] The ultrasonic diagnostic device involved in the present invention is connected to an external information processing device, and is characterized in that it includes: a generation unit that generates image data based on received data; and a management unit that manages an AP group composed of multiple APs (applications) for processing the image data, the AP group is set in the external information processing device, or is set throughout the ultrasonic diagnostic device and the external information processing device, the management unit manages the selection of an AP set from the AP group based on management information indicating the relationship between the multiple APs constituting the AP group, and manages the operation of the AP set, the AP set including multiple APs that operate together during ultrasonic examination.

[0011] The program involved in the present invention is executed in an ultrasonic diagnostic system, and the program is characterized in that the ultrasonic diagnostic system includes: an ultrasonic diagnostic device that generates image data based on received data; and an external information processing device that is connected to the ultrasonic diagnostic device, and an AP group consisting of multiple APs (applications) for processing the image data is set in the external information processing device, or is set throughout the ultrasonic diagnostic device and the external information processing device, and the program includes: a function of managing the selection of an AP set from the AP group based on management information indicating the relationship between the multiple APs constituting the AP group; and a function of managing the operation of the AP set based on the management information, the AP set including multiple APs that operate together during ultrasonic examination.

[0012] Effects of the Invention

[0013] According to the present invention, a plurality of APs including an external AP can be operated together in an ultrasonic diagnostic system. Alternatively, according to the present invention, a plurality of APs including an external AP can be operated appropriately in an ultrasonic diagnostic system. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1It is a diagram showing a configuration example of an ultrasonic diagnostic system according to an embodiment.

[0015] Figure 2 It is a diagram showing a configuration example of an AP management unit.

[0016] Figure 3 This is a diagram showing an example of an AP list.

[0017] Figure 4 It is a diagram showing a structural example of management information.

[0018] Figure 5 This is a diagram showing a first example of the management table.

[0019] Figure 6 This is a diagram showing a second example of the management table.

[0020] Figure 7 This is a diagram showing the initial state of the selected image.

[0021] Figure 8 This is a diagram showing a first state in which an image is selected.

[0022] Fig. 9 This is a diagram showing the second state of the selected image.

[0023] Fig.10 This is a diagram showing the third state of the selected image.

[0024] Fig.11 This is a diagram showing the fourth state of the selected image.

[0025] Fig.12 This is a diagram showing an example of parallel operation of multiple APs.

[0026] Fig.13 This is a diagram showing a first example of serial operation of a plurality of APs.

[0027] Fig.14 This is a diagram showing the second example of the serial operation of a plurality of APs.

[0028] Fig.15 This is a diagram showing the first example of the result image.

[0029] Fig.16 It is a diagram showing a first example of an operation image.

[0030] Fig.17 This is a diagram showing a second example of the result image.

[0031] Fig.18 It is a diagram showing a second example of the operation image.

[0032] Fig.19It is a diagram showing another configuration example of the ultrasonic diagnostic system according to the embodiment.

[0033] Explanation of symbols

[0034] 10-ultrasonic diagnostic device, 12-external information processing device, 24-image generating unit, 26-information processing unit, 28-AP management unit, 29-display processing unit, 30-selection image generator, 32-operation image generator, 34-result image generator, 36-memory, 38-AP list, 40-management table, 42-communication unit, 48-information processing unit, 50-buffer memory, 52-communication unit, 54-AP group. DETAILED DESCRIPTION

[0035] Hereinafter, embodiments will be described with reference to the drawings.

[0036] (1) Overview of implementation methods

[0037] The ultrasonic diagnostic system involved in the embodiment includes an ultrasonic diagnostic device, an external information processing device, an AP group and a management unit. The ultrasonic diagnostic device generates image data based on received data. The external information processing device is connected to the ultrasonic diagnostic device. The AP group is composed of multiple APs for processing image data. The AP group is set in the external information processing device, or is set throughout the ultrasonic diagnostic device and the external information processing device. The management unit manages the selection of an AP set from the AP group based on management information indicating the relationship between the multiple APs constituting the AP group, and manages the execution of the AP set. The management unit can also be called an AP manager. The AP set includes multiple APs that act together in an ultrasonic examination.

[0038] According to the above configuration, the AP set can be accurately selected based on the management information, and the AP set can be accurately operated, so that more information or more valuable information can be provided to the inspector.

[0039] The AP set is composed of multiple APs that can act simultaneously or multiple APs that can act in coordination. Multiple APs can be started simultaneously or in stages. The AP set includes at least one external AP. Alternatively, the AP set is composed of multiple external APs. In an embodiment, the AP set is selected by the user before the ultrasonic examination. This selection can be said to be a set selection of multiple APs. The AP set can also be automatically selected.

[0040] In an embodiment, the management information includes one or more appropriate combination information, each appropriate combination information includes information for determining a plurality of APs acting together. The management information is generated by a user, or automatically generated based on collected information.

[0041] In an embodiment, each appropriate combination information further includes a designation of a parallel action or a designation of a serial action. The management unit causes the multiple APs constituting the AP set to perform parallel actions according to the designation of the parallel action, and causes the multiple APs constituting the AP set to perform serial actions according to the designation of the serial action. According to this structure, the APs constituting the AP set can be appropriately operated according to the mutual relationship between the multiple APs. Parallel action means that the multiple APs do not have a data exchange relationship so that they simultaneously operate in parallel without cooperating with each other. Serial action means that the multiple APs have a data exchange relationship so that they operate in cooperation at the same time or not at the same time.

[0042] In an embodiment, the appropriate combination information including the designation of the serial operation includes information indicating the connection order of the plurality of APs constituting the AP set. The management unit serially connects the plurality of APs constituting the AP set based on the information indicating the connection order. According to this structure, the plurality of APs can be connected accurately.

[0043] In an embodiment, the management information has a matrix structure. The matrix structure includes a plurality of units corresponding to a plurality of AP pairs, wherein the plurality of AP pairs are a plurality of combinations defined according to an AP group. The plurality of units include one or more valid units in which one or more appropriate combination information is associated and one or more invalid units other than the one or more valid units. According to this structure, it is easy to manage various mutual relationships in the AP group. The AP set includes one AP pair, or includes more than three APs determined by a plurality of AP pairs, or is equivalent to a continuation of a plurality of AP pairs.

[0044] In an embodiment, the matrix structure has a first axis to which a plurality of first selected AP candidates are allocated and a second axis to which a plurality of second selected AP candidates are allocated. The management unit identifies a specific unit in the matrix structure based on the first selected AP and the second selected AP, and refers to information associated with the specific unit.

[0045] In the embodiment, the management unit serially connects the APs constituting the AP set in the order following the management information in controlling the serial operation of the APs constituting the AP set, thereby inputting the processing result data output from the i-th AP into the i+1-th AP.

[0046] The processing result data is composed of image data, numerical data, etc. When n represents the number of APs constituting the AP set (where n is an integer greater than 2), i is an integer greater than 1 and less than n-1. For example, when n is 3, i is 1 and 2.

[0047] In an embodiment, an ultrasonic diagnostic apparatus includes a management unit that receives processing result data output from an i-th AP and transmits the processing result data to an (i+1)-th AP.

[0048] In an embodiment, the external information processing device includes a buffer memory. When the i-th AP and the i+1-th AP belong to the external information processing device, the management unit manages the operation of the external information processing device so that the processing result data output from the i-th AP is written into the buffer memory, and the processing result data read from the buffer memory is input into the i+1-th AP. According to this structure, the amount of data transmitted between the ultrasonic diagnostic device and the external information processing device can be reduced.

[0049] The ultrasonic diagnostic system according to the embodiment includes a selection image generating unit, which generates a selection image for selecting an AP set from an AP group based on management information. In the embodiment, the selection image includes one or more display elements representing one or more AP candidates that can be selected at the current time point. In the process of selecting a plurality of APs from the AP group in stages, the content of the selection image changes in stages. By narrowing the range of selectable APs, it is easy to select an AP set.

[0050] The ultrasonic diagnostic system according to the embodiment includes a display control unit that controls the display of a plurality of processing result data output from a plurality of APs constituting an AP set. The display control unit displays the plurality of processing result data in parallel when the parallel display mode is selected, and displays the plurality of processing result data in a composite display mode when the composite display mode is selected. According to this structure, the plurality of processing results can be displayed in a display format desired by the user.

[0051] (2) Details of implementation method

[0052] Figure 1 , an ultrasonic diagnostic system according to an embodiment of the present invention is shown. The ultrasonic diagnostic system is a medical system that is installed in a medical institution such as a hospital and is used for ultrasonic examination of a living body. The ultrasonic diagnostic system is composed of an ultrasonic diagnostic device 10 and an external information processing device 12. The external information processing device 12 is connected to the ultrasonic diagnostic device 10 via a dedicated cable 43. The external information processing device 12 can also be connected to the ultrasonic diagnostic device 10 via a network such as a LAN (Local Area Network) or the Internet.

[0053] First, the structure of the ultrasonic diagnostic apparatus 10 is described. The ultrasonic probe 13 is a device that transmits ultrasonic waves into a living body and receives reflected waves from the living body. The ultrasonic probe 13 has a transducer array including a plurality of transducers. The transducer array forms an ultrasonic beam 14. The ultrasonic beam 14 is electronically scanned to form a beam scanning surface 15.

[0054] Electronic linear scanning, electronic sector scanning, etc. are known as electronic scanning methods of the ultrasonic beam 14. A two-dimensional transducer array may be provided as the transducer array. By two-dimensionally scanning the ultrasonic beam using the two-dimensional transducer array, volume data can be acquired from the three-dimensional space in the living body.

[0055] The transmission circuit 16 is a circuit that functions as a transmission beamformer, and outputs a plurality of transmission signals in parallel to the transducer array during transmission, thereby forming a transmission beam.

[0056] The receiving circuit 18 is a circuit that functions as a receiving beam former. When receiving, it applies phase alignment and addition to a plurality of receiving signals output in parallel from the transducer array, thereby generating receiving beam data. As the electronic scanning of the ultrasonic beam is repeated, a receiving frame data column is output from the receiving circuit 18. Each receiving frame data is composed of a plurality of receiving beam data arranged along the electronic scanning direction. Each receiving beam data is composed of a plurality of echo data arranged along the depth direction.

[0057] The data processing circuit 20 is a circuit for processing each received frame data. The data processing circuit 20 includes a detection circuit, a logarithmic conversion circuit, a filter, etc. In addition, the data processing circuit 20 also includes a circuit for extracting and processing Doppler information included in each received beam data.

[0058] The image generation unit 24 has a digital scan converter (DSC). The DSC has a coordinate transformation function, a pixel interpolation function, etc. Through the DSC, a display frame data column is generated from a received frame data column. In more detail, for example, when the B mode is selected, a tomographic image data column is generated in the image generation unit 24 as a display frame data column. When the CFM (color flow mapping) mode is selected, a tomographic image data column and a blood flow image data column are generated in the image generation unit 24 as a display frame data column. An operation mode other than the B mode and the CFM mode can also be selected.

[0059] An image memory (not shown) is provided at the rear stage of the image generation unit 24. The image memory has a ring buffer structure. The image memory temporarily stores a tomographic image data column and / or a blood flow image data column. The image data column (the tomographic image data column and / or the blood flow image data column) read out from the image memory is sent to the information processing unit 26.

[0060] The image data sequence is sent from the information processing unit 26 to the main display 44. The main display 44 displays an ultrasonic image. When the B mode is selected, the main display 44 displays a tomographic image, and when the CFM mode is selected, the main display 44 displays a CFM image. The CFM image is generated by synthesizing the tomographic image data sequence and the blood flow image data sequence. In the real-time operation state, the tomographic image and the CFM image are dynamic images. In the frozen state (suspended state of transmission and reception), the tomographic image and the CFM image are still images. Other ultrasonic images can also be displayed on the main display 44.

[0061] The information processing unit 26 is composed of a processor that executes a program. Specifically, the processor is a CPU (Central Processing Unit). The information processing unit 26 according to the embodiment functions as a control unit that controls the operations of a plurality of elements constituting the ultrasonic diagnostic apparatus 10 . Figure 1 , a plurality of functional blocks represent a plurality of representative functions performed by the information processing unit 26. Specifically, the information processing unit 26 performs the functions of the AP management unit 28, the selection image generator 30, the operation image generator 32, and the result image generator 34.

[0062] The ultrasonic diagnostic system according to the embodiment has an AP group 54 including a plurality of APs (applications) for processing image data generated in the ultrasonic diagnostic apparatus 10. In the embodiment, the AP group 54 includes a plurality of external APs (AP11 to AP15 described later) and one internal AP (AP01). A plurality of internal APs may be provided in the ultrasonic diagnostic apparatus 10.

[0063] The following describes the configuration and operation of the ultrasonic diagnostic system on the premise that multiple APs including at least one external AP are operated together when performing ultrasonic examination. Of course, in the ultrasonic diagnostic system, only a single AP may be activated when performing ultrasonic examination.

[0064] The AP management unit 28 is a module for managing the AP group 54, and more specifically, a module for managing the selection of an AP set from the AP group 54 and the operation of the AP set. Here, as described above, the AP set includes a plurality of APs that operate together in an ultrasonic examination. In an embodiment, the AP set includes at least one external AP. The AP set may also be referred to as a software set. The AP management unit 28 is equivalent to a main interface module for the AP group 54.

[0065] The AP management unit 28 also has functions of collecting information required for managing the AP group, managing the operation of external information processing devices, managing data transmission, etc. The selection image generator 30, the operation image generator 32, and the result image generator 34 correspond to the display processing unit 29. The information processing unit 26 may also function as a test report creation unit.

[0066] exist Figure 1 In the figure, for convenience, the memory 36 connected to the information processing unit 26 is shown as a part of the information processing unit 26. The memory 36 stores an AP list 38 and a management table 40. The AP list 38 is used to manage the AP group, and the management table 40 has management information indicating the relationship between the multiple APs constituting the AP group.

[0067] The information processing unit 26 is connected to a main display 44 and a touch screen panel 46. The main display 44 is composed of an organic EL display device, a liquid crystal display, etc. The touch screen panel 46 is provided on an operation panel not shown. The touch screen panel 46 is composed of a screen panel and a touch panel. In the embodiment, the main display 44 displays an ultrasonic image and a result image, and the touch screen panel 46 displays an operation image and a selection image. The information processing unit 26 is connected to a communication unit 42. The information processing unit 26 can also play the role of the communication unit 42.

[0068] exist Figure 1 In the example of the structure shown, AP01 is connected to the information processing unit 26. AP01 is an internal AP. It is software executed in the processor. Figure 1 In FIG. 1 , AP01 is shown outside the information processing unit 26 .

[0069] Next, the configuration of the external information processing device 12 will be described. The external information processing device 12 is a general-purpose information processing device or a dedicated information processing device.

[0070] The external information processing device 12 has an information processing unit 48. The information processing unit 48 is composed of a processor that executes a program, and the processor is, for example, a CPU. A plurality of APs are connected to the information processing unit 48, specifically, AP11, AP12, AP13, AP14, and AP15. These APs are executed by the processor. Figure 1 In FIG. 4 , these APs are shown outside the information processing unit 48. From the perspective of AP11, AP12, AP13, AP14, and AP15, the information processing unit 48 is equivalent to a sub-interface module.

[0071] The information processing unit 48 is connected to a buffer memory 50. Figure 1 In FIG. 4 , a buffer memory 50 is depicted in the information processing unit 48. The buffer memory 50 is a memory for temporarily storing image data or processing result data.

[0072] The information processing unit 48 is connected to a communication unit 52. The information processing unit 48 can also perform the function of the communication unit 52. The communication unit 42 and the communication unit 52 are connected to each other via a cable 43. As described above, the ultrasonic diagnostic device 10 and the external information processing device 12 can also be connected via a network such as a wired LAN or a wireless LAN. When communicating between the ultrasonic diagnostic device 10 and the external information processing device 12, a general communication protocol can be used. When transmitting a dynamic image data column, a streaming technology can be used. Data that complies with DICOM (Digital Imaging and Communications in Medicine) can also be transmitted. Electrocardiographic information or three-dimensional position information, etc. can also be sent from the ultrasonic diagnostic device 10 to the external information processing device 12. In the illustrated structural example, the external information processing device 12 does not have a display device or an input device. Of course, these devices can also be set in the external information processing device 12.

[0073] Figure 2 In the figure, multiple representative functions performed by the AP management unit 28 are represented by multiple function blocks 56 to 66. The AP information collection unit 56 collects information required for managing each AP (for example, analysis type, input specification, output specification, etc.). The AP list creation unit 58 creates an AP list based on the collected information. The management table creation unit 60 creates a management table with management information. The management information is information indicating the relationship between multiple APs constituting the AP group, and in particular, information indicating whether they can be combined and the combination method.

[0074] The selection management unit 62 manages the selection of the AP set based on the AP list and the management table. The operation management unit 64 manages the operation of the AP set based on the AP list and the management table. Of course, a single AP can also be selected and started. The transmission management unit 66 manages the data transmission from the ultrasonic diagnostic device 10 to the external information processing device 12 and the data transmission from the external information processing device 12 to the ultrasonic diagnostic device 10. The AP management unit 28 also has the function of collecting parameter information and status information required when operating the AP set.

[0075] Figure 3 An example of an AP list is shown in FIG. The AP list 38 is composed of a plurality of rows 68 corresponding to a plurality of APs. Each row 68 includes an AP identifier 70, location information 72, a start command 74, and the like. The location information 72 is information for determining the location of the AP, specifically, information indicating an external information processing device or information indicating an ultrasonic diagnostic device. By referring to the location information 72, an external AP and an internal AP can be identified. The start command 74 is a start command used when instructing the AP to start. An end command is also managed for each AP, but Figure 3 The illustration is omitted.

[0076] Each row 68 also includes information 76 indicating input specifications, information 78 indicating an inspection area, and information 80 indicating an analysis type. By referring to the information 76, the form or type of data input to the AP can be determined. By referring to the information 78, the inspection area in which the AP can be used can be determined. Instead of the inspection area, an inspection part can be registered. By referring to the information 80, the function of the AP can be determined. Figure 3 Various information other than the information shown can be registered in the AP list 38. For example, information related to probes suitable for the AP can be managed for each AP.

[0077] Figure 4 An example of the structure of the management information registered in the management table is shown in FIG. The management information is information indicating the relationship between multiple APs constituting an AP group. Specifically, multiple combinations (AP combinations) are defined based on the AP group. The multiple combinations include multiple appropriate combinations A1, A2, A3 and multiple inappropriate combinations B1, ...

[0078] An appropriate combination is a combination that can be established, and an inappropriate combination is a combination that cannot be established. For example, an AP used only in ultrasound examination of the heart and an AP used only in ultrasound examination of the abdomen are inappropriate combinations.

[0079] The management information includes appropriate combination information A11, A12, A13 corresponding to the plurality of appropriate combinations A1, A2, A3. The appropriate combination information A11, A12, A13 includes information identifying the plurality of APs constituting the appropriate combination. The inappropriate combination information B11 includes information identifying the plurality of APs constituting the inappropriate combination.

[0080] In an embodiment, the appropriate combination information A11, A12, A13 includes the designation A11p, A12p of parallel operation or the designation A13s of serial operation, respectively. The appropriate combination information A13 including the designation A13s of serial operation also includes the designation A13ss of the connection order of multiple APs.

[0081] By preparing the above-mentioned management information, it is possible to quickly determine whether each combination is appropriate by referring to the management information, and it is possible to quickly determine the attributes of the appropriate combination. Furthermore, when a serial action is specified as an attribute, the connection order of the APs can be quickly determined. The management information is composed of information input by the user. The management information can also be automatically generated based on the AP list.

[0082] according to Figure 5 and Figure 6 , a specific example of the management table is explained. Figure 54 shows a first example of a management table. The management table 40 has a matrix structure having a vertical axis 82 and a horizontal axis 84. The matrix structure includes a plurality of cells 90 arranged along the vertical axis 82 and the horizontal axis 84. More specifically, a plurality of AP candidates 86 selected first are allocated on the vertical axis 82, and a plurality of AP candidates 88 selected later are allocated on the horizontal axis 84. Among the plurality of AP candidates 86 and 88, AP11 to AP15 are all external APs (reference symbol 86A), and AP01 is an internal AP (reference symbol 86B).

[0083] The matrix structure has a plurality of cells 90 corresponding to a plurality of AP pairs. The plurality of AP pairs are a plurality of AP combinations defined according to an AP group. When defining a plurality of APs, the selection order is also considered. Cell information is associated with each cell 90. The cell information includes information for determining the first selected AP and information for determining the later selected AP. Furthermore, the cell information includes information indicating whether the AP pair is an appropriate pair. In addition, the cell 90 corresponding to an appropriate pair may be referred to as a valid cell, and the cell 90 corresponding to an inappropriate pair may be referred to as an invalid cell.

[0084] "P" (reference symbol 92) registered in the unit 90 indicates that the two APs corresponding thereto are an appropriate AP pair and indicate the designation of parallel action. "S" (reference symbol 94) registered in the unit 90 indicates that it is an appropriate AP pair and indicates the designation of serial action. In the serial action, the AP selected first is the AP that acts first, and the AP selected later is the AP that acts later. "N / A" registered in the unit 90 indicates an inappropriate AP pair.

[0085] For example, in Figure 5 If the management table 40 shown is used as a premise, if AP12 is selected first and AP13 is selected next, AP14 can also be selected. In this case, AP12, AP13, and AP14 operate in parallel. On the other hand, if AP14 is selected first and AP15 is selected next, AP01 can also be selected. In this case, the processing result of AP14 is given to AP15, and the processing result of AP15 is given to AP01. That is, AP14-AP15-AP01 operate in series in this arrangement order.

[0086] according to Figure 5 The management table 40 shown can easily narrow down the selectable range by stepwise selection of multiple APs. Furthermore, since complex AP combinations are managed in the form of a series of multiple AP pairs, the size of the management table 40 can be reduced.

[0087] Figure 61 shows a second example of a management table. The management table 100 has a plurality of records 102 corresponding to a plurality of AP combinations. Each record 102 has an identifier 104 of an AP set, a designation of a parallel action or a designation 106 of a serial action, information 108 indicating a plurality of APs constituting the AP set, and information 110 indicating a selection condition / action condition. By referring to the information 110, a special condition to be satisfied when a combination corresponding to the information 110 is selected is determined, and a special action condition when a combination corresponding to the information 110 is selected is determined.

[0088] Symbol 106a indicates a compound designation. The compound designation includes the designation of serial action and the designation of parallel action. Specifically, as shown by symbol 108a, AP14 and AP15 act serially in the order of arrangement, and AP14 and AP01 act serially in the order of arrangement. When focusing on AP15 and AP01, they act in parallel.

[0089] Next, Figure 5 Based on the contents of the management table shown, selection of an AP set is described. Figure 7 2 shows an initial state 112 of a selected image according to an embodiment.

[0090] The selection image has a plurality of display elements 116 representing selectable AP11 to AP01. The selection image is displayed on, for example, a touch screen panel. Each display element 116 is a virtual button. Display element 118 is a start button that is operated after one or more APs are selected.

[0091] Figure 8 The first state of selecting an image is shown in FIG. Figure 7 In the initial state 112 shown, when AP12 is selected, according to Figure 5 The contents of the management table shown are used to generate Figure 8 In the first state 112A, the display element 120 is highlighted, and two display elements corresponding to selectable AP13 and AP14 are displayed at high brightness (reference symbol 122). On the other hand, three display elements corresponding to unselectable AP11, AP15, and AP01 are displayed at low brightness (reference symbol 124).

[0092] Fig. 9 The second state 112B of the selected image is shown in FIG. Figure 8 When the display element 126 corresponding to AP14 is further selected in the first state 112A shown in FIG. Figure 5 The contents of the management table shown are as follows: Fig. 9As shown, the display element 128 corresponding to AP13 is displayed with high brightness (actually, the display is maintained with high brightness). Thus, the user can recognize that AP13 can be selected. After selecting the display element 128 corresponding to AP13 (the display element 128 is highlighted), if the display element 118 is operated, Figure 5 According to the content of the management table shown, AP12, AP13, and AP14 operate in parallel.

[0093] On the other hand, Figure 7 When the display element corresponding to AP14 is selected in the initial state 112 shown, Figure 5 The contents of the management table shown are used to generate Fig.10 In the third state 112C, the display element 130 corresponding to AP14 is highlighted, four display elements (reference numeral 132) corresponding to AP12, AP13, AP15, and AP01 are displayed at high brightness, and the display element 134 corresponding to AP11 is displayed at low brightness.

[0094] When a display element corresponding to AP15 is further selected in the third state 112C, Figure 5 The contents of the management table shown are as follows: Fig.11 As shown, only the display element 138 corresponding to AP01 is displayed at high brightness, and the other three display elements (reference numeral 140) are displayed at low brightness. If the display element 118 is operated at this point in time, AP14 and AP15 operate in series in the selected order.

[0095] As described above, in the embodiment, the content of the selection image changes in stages according to the staged selection of the AP, so that the user's AP selection can be assisted and the selection of an appropriate combination can be ensured.

[0096] Next, Figure 5 Based on the contents of the management table shown, use Figure 12 to Figure 14 An example of the operation of the AP set is described below.

[0097] Fig.12 Indicates the parallel operation of AP12 and AP13. As described above, the ultrasonic diagnostic apparatus 10 includes the information processing unit 26, and the information processing unit 26 includes the AP management unit. Reference numeral 36 indicates a memory managed by the AP management unit. The information processing unit 26 includes the result image generator 34. On the other hand, the external information processing apparatus 12 includes the information processing unit 48. The buffer memory 50 is managed by the information processing unit 48. The communication unit 42 in the ultrasonic diagnostic apparatus 10 and the communication unit 52 in the external information processing apparatus 12 communicate with each other.

[0098] AP12 is an AP that performs analysis based on a tomographic image data column and a blood flow image data column. For example, AP12 generates a two-dimensional vector image based on each image data pair (tomographic image data and blood flow image data). The two-dimensional vector image is composed of multiple two-dimensional vectors that represent the movement of blood flow in the heart. AP13 is an AP that performs analysis based on a tomographic image data column. For example, AP13 tracks multiple points set in the myocardium based on the tomographic image data column and generates a dynamic image representing the movement of the myocardium. Unlike the case of serial action, AP12 and AP13 act independently without cooperating with each other, that is, no data exchange is performed.

[0099] like Fig.12 As shown, the tomographic image data column B is temporarily stored in the memory 36. The blood flow image data column C is also temporarily stored in the memory 36. The tomographic image data column B and the blood flow image data column C read out from the memory 36 are sent to the buffer memory 50 via the communication unit 42 and the communication unit 52, and are temporarily stored in the buffer memory 50. The tomographic image data column B and the blood flow image data column C read out from the buffer memory 50 are supplied to the AP 12. In addition, each AP can also access the buffer memory 50 to obtain the data required by each AP.

[0100] On the other hand, the tomographic image data sequence B separately read out from the memory 36 is transmitted to the buffer memory 50 via the communication unit 42 and the communication unit 52, and is temporarily stored in the buffer memory 50. The tomographic image data sequence B read out from the buffer memory 50 is supplied to the AP 13. In addition, instead of transmitting the tomographic image data sequence B twice, the tomographic image data sequence B read out from the buffer memory 50 may be supplied to the AP 12 and the AP 13 in parallel.

[0101] The AP 12 performs analysis based on the tomographic image data sequence B and the blood flow image data sequence C, and generates an analysis result data sequence R12. The analysis result data sequence R12 includes a plurality of analysis result data arranged in time sequence, and each analysis result data is image data.

[0102] The analysis result data sequence R12 is temporarily stored in the buffer memory 50 . The analysis result data sequence R12 read out from the buffer memory 50 is sent to the memory 36 via the communication units 52 and 42 and stored therein. The analysis result data sequence R12 read out from the memory 36 is sent to the result image generator 34 .

[0103] The AP 13 performs analysis based on the tomographic image data sequence B, and generates an analysis result data sequence R13. The analysis result data sequence R13 includes a plurality of analysis result data arranged in time sequence, and each analysis result data is image data.

[0104] The analysis result data sequence R13 is temporarily stored in the buffer memory 50 . The analysis result data sequence R13 read out from the buffer memory 50 is sent to the memory 36 via the communication units 52 and 42 and stored therein. The analysis result data sequence R13 read out from the memory 36 is sent to the result image generator 34 .

[0105] The result image generator 34 generates a result image data column based on the analysis result data column R12 and the analysis result data column R13. The result image data column is sent to the main display. The result image data column is composed of a plurality of result image data arranged in time sequence. Each result image data includes the first image data representing the analysis result of AP12 and the second image data representing the analysis result of AP13.

[0106] The result image sequence is displayed in the form of a dynamic image on the main display. When the parallel display mode is selected as the display mode, each result image includes the first image and the second image arranged in parallel. When the composite display mode is selected as the display mode, each result image includes a composite image generated by composite the first image and the second image.

[0107] In addition, when an image data column is transmitted from the ultrasonic diagnostic device 10 to the external information processing device 12, a parameter group required for the analysis of the image data column is also transmitted. The parameter group includes, for example, a frame rate, a diagnostic depth range, a gain, a focal depth, etc. The image data column before coordinate transformation may also be transmitted from the ultrasonic diagnostic device 10 to the external information processing device. In addition, image data equivalent to a still image may be transmitted instead of an image data column equivalent to a dynamic image. For example, a plurality of image data sequentially selected from the stored image data column may also be transmitted in sequence. In this case, an external AP is used to perform analysis on each transmitted image data.

[0108] Fig.13 The first example of the serial operation of AP14 and AP15 is shown in FIG. Fig.13 In, with Fig.12 The same elements as those shown are denoted by the same reference numerals, and description thereof will be omitted.

[0109] AP14 and AP15 operate in series in this order. AP14 performs analysis based on the tomographic image data sequence B. AP15 performs analysis based on the analysis result data sequence R14 of AP14. In this way, there is a data exchange relationship between AP14 and AP15, and AP14 and AP15 operate in coordination.

[0110] For example, AP14 detects the lesion included in each tomographic image, and AP15 evaluates the detected lesion. In the case of adopting such a structure, the lesion information (position information, size information) as the analysis result of AP14 is sent to AP15 for each tomographic image. AP15 evaluates the partial image specified by the lesion information, and calculates a plurality of scores corresponding to a plurality of evaluation items. AP15 outputs analysis result data including numerical information for each tomographic image.

[0111] Specifically, the tomographic image data sequence B is transmitted to the AP 14 via the memory 36, the communication unit 42, the communication unit 52, and the buffer memory 50. If necessary, the tomographic image data sequence B is also transmitted to the AP 15. In this case, the tomographic image data sequence B temporarily stored in the buffer memory 50 is transmitted to the AP 14 and the AP 15 in parallel (reference symbol 143).

[0112] Through the analysis of the tomographic image data sequence B in AP14, an analysis result data sequence R14 is output from AP14. Fig.13 In the first example shown, the analysis result data sequence R14 is temporarily stored in the memory 36 via the buffer memory 50, the communication unit 52, and the communication unit 42 (reference symbol 144). The analysis result data sequence R14 read out from the memory 36 is transmitted to the AP 15 via the communication unit 42, the communication unit 52, and the buffer memory 50 (reference symbols 146 and 148). The analysis result data sequence R14 read out separately from the memory 36 is transmitted to the result image generator 34.

[0113] The analysis based on the analysis result data sequence R14 is performed in the AP15. At this time, the tomographic image data sequence B is referred to as needed. The analysis result data sequence R15 output from the AP15 is temporarily stored in the memory 36 via the buffer memory 50, the communication unit 52, and the communication unit 42. The analysis result data sequence R15 read from the memory 36 is sent to the result image generator 34.

[0114] The result image generator 34 generates a result image data sequence based on the analysis result data sequence R14 and the analysis result data sequence R15, and outputs it to the main display. The result image data sequence is generated according to the display mode selected by the user.

[0115] Fig.14 The second example of the serial operation of AP14 and AP15 is shown in FIG. Fig.14 In, with Fig.12 The same elements as those shown are denoted by the same reference numerals, and description thereof will be omitted.

[0116] The tomographic image data sequence B is transmitted to the AP 14 via the memory 36, the communication unit 42, the communication unit 52, and the buffer memory 50. The tomographic image data sequence B is also transmitted to the AP 15 as necessary.

[0117] Through the analysis of the tomographic image data sequence B in AP14, an analysis result data sequence R14 is output from AP14. Fig.14 In the second example shown, the analysis result data sequence R14 is directly sent to the AP 15 (reference symbol 150) via the buffer memory 50. If necessary, the analysis result data sequence R14 is temporarily stored in the memory 36 via the buffer memory 50, the communication unit 52, and the communication unit 42. In this case, the analysis result data sequence R14 read from the memory 36 is sent to the result image generator 34 (reference symbol 152).

[0118] The analysis based on the analysis result data sequence R14 is performed in the AP15. At this time, the tomographic image data sequence B is referred to as needed. The analysis result data sequence R15 output from the AP15 is temporarily stored in the memory 36 via the buffer memory 50, the communication unit 52, and the communication unit 42. The analysis result data sequence R15 read from the memory 36 is sent to the result image generator 34.

[0119] exist Fig.14 In the second example shown, it is not necessary to transmit the analysis result data sequence R14 from the ultrasonic diagnostic apparatus 10 to the external information processing apparatus 12. Therefore, there is an advantage that the amount of data to be transmitted can be reduced.

[0120] Fig.15 1 shows a first example of a result image generated by the result image generator. According to the selection of the parallel display mode, the result image 154 includes an image 156 representing the first analysis result and an image 158 representing the second analysis result. The image 156 and the image 158 are arranged in the horizontal direction. In more detail, the image 156 represents the analysis result of AP12, and includes a plurality of vectors 168. The image 158 represents the analysis result of AP13, and includes a band-shaped colored portion 170 representing the myocardial motion.

[0121] The display mode selection column 160 includes a button 162 for selecting a single display mode for displaying a single analysis result, a button 164 for selecting a parallel display mode for displaying a plurality of analysis results in parallel, and a button 166 for selecting a composite display mode for displaying a plurality of analysis results in composite (overlap) form. Fig.15 , button 164 is selected.

[0122] Fig.161 shows a first example of an operation image generated by the operation image generator. As the content of the operation image 172, either the first page 174 or the second page 176 is selected. In the example shown in the figure, the first page 174 includes a plurality of buttons 178 for instructing AP12. The second page 176 also includes a plurality of buttons for instructing AP13.

[0123] Fig.17 1 shows a second example of a result image generated by the result image generator. According to the selection of the composite display mode, a composite image showing the first analysis result and the second analysis result is generated and displayed as the result image 180. The button 166 corresponding to the composite display mode is selected.

[0124] The result image 180 includes a tomographic image 182 and two graphics 184 and 186 representing two ROIs. The two graphics 184 and 186 surround two lesions determined by image analysis. The graphics 184 and 186 or the information generating them are equivalent to the analysis result of AP14. The analysis result of AP14 may also include the tomographic image 182.

[0125] The result image 180 includes first numerical information 188 and second numerical information 190. The first numerical information 188 indicates the result of analyzing the first lesion surrounded by the graph 184, and specifically includes a plurality of scores corresponding to a plurality of evaluation items. The second numerical information 190 indicates the result of analyzing the second lesion surrounded by the graph 186, and specifically includes a plurality of scores corresponding to a plurality of evaluation items.

[0126] Fig.18 1 shows a second example of an operation image generated by the operation image generator. The operation image 192 includes a single page 194, and the page 194 includes a plurality of buttons 196. In the illustrated example, the plurality of buttons 196 are used to indicate AP14 and AP15. The plurality of buttons 196 may include a common button for indicating both AP14 and AP15.

[0127] Fig.19 FIG. 4 shows an ultrasonic diagnostic system according to another embodiment. Fig.19 In, with Figure 1 The same elements as those shown in the figure are denoted by the same reference numerals, and their descriptions are omitted. Fig.19 In the figure, the ultrasonic probe, the transmitting circuit, the receiving circuit, the data processing circuit and the image generating unit are omitted.

[0128] The ultrasonic diagnostic system is composed of an ultrasonic diagnostic device 10, a first external information processing device 12A, and a second external information processing device 12B. They are connected to each other via a cable 43. The first external information processing device 12A has an information processing unit 48A, a communication unit 52A, AP11, AP12, and a buffer memory 50A. The second external information processing device 12B has an information processing unit 48B, a communication unit 52B, AP13, AP14, and a buffer memory 50B. The AP group 54A is composed of a plurality of external APs (AP11 to AP14) and one internal AP (AP01).

[0129] In adopting Fig.19 In the case of the structure shown in the figure, the AP management unit 28 also Figures 4 to 6 The ultrasonic diagnostic apparatus 10, the first external information processing apparatus 12A, and the second external information processing apparatus 12B may be connected to a server via a network such as a LAN.

[0130] In the above description, the AP set is composed of a plurality of external APs, but the AP set may also be composed of external APs and internal APs. In this case, the AP management unit 28 also manages the APs according to the APs. Figures 4 to 6 The management information shown is used to manage the selection and operation of the AP set.

Claims

1. An ultrasonic diagnostic system, characterized in that: include: an ultrasonic diagnostic device that generates image data based on received data; and an external information processing device connected to the ultrasonic diagnostic device, The ultrasonic diagnostic system also includes: An AP group is provided in the external information processing device, or is provided throughout the ultrasonic diagnostic device and the external information processing device, and is composed of a plurality of APs, i.e., application programs, for processing the image data; and a management unit that manages selection of an AP set from the AP group based on management information indicating a relationship between the plurality of APs constituting the AP group, and manages an operation of the AP set, The AP set includes a plurality of APs that act together during ultrasound examination.

2. The ultrasonic diagnostic system according to claim 1, characterized in that: The management information includes one or more appropriately combined information. Each of the appropriate combination information includes information identifying a plurality of APs that act together.

3. The ultrasonic diagnostic system according to claim 2, characterized in that: Each of the appropriate combination information further includes the designation of parallel actions or the designation of serial actions, The management unit causes the plurality of APs constituting the AP set to perform parallel operation according to the designation of the parallel operation. According to the designation of the serial operation, the plurality of APs constituting the AP set are caused to perform the serial operation.

4. The ultrasonic diagnostic system according to claim 3, characterized in that: The specified appropriate combination information including the serial action includes information indicating the connection order of the plurality of APs constituting the AP set, The management unit serially connects the plurality of APs constituting the AP set based on the information indicating the connection order.

5. The ultrasonic diagnostic system according to claim 2, characterized in that: The management information has a matrix structure, The matrix structure includes a plurality of units corresponding to a plurality of AP pairs as a plurality of combinations defined according to the AP group, The plurality of cells include one or more valid cells to which the one or more appropriate combination information are associated and one or more invalid cells other than the one or more valid cells.

6. The ultrasonic diagnostic system according to claim 5, characterized in that: The matrix structure has a first axis and a second axis, the first axis is allocated with a plurality of AP candidates selected first, and the second axis is allocated with a plurality of AP candidates selected later, The management unit identifies a specific unit in the matrix structure based on the AP selected first and the AP selected later, and refers to information associated with the specific unit.

7. The ultrasonic diagnostic system according to claim 1, characterized in that: The management unit serially connects the plurality of APs constituting the AP set in an order following the management information in controlling the serial operation of the plurality of APs constituting the AP set, thereby inputting a processing result output from the i-th AP into the (i+1)-th AP.

8. The ultrasonic diagnostic system according to claim 7, characterized in that: The ultrasonic diagnostic apparatus includes the management unit, The management unit receives the processing result data output from the i-th AP, and transmits the processing result data to the (i+1)-th AP.

9. The ultrasonic diagnostic system according to claim 7, characterized in that: The external information processing device includes a buffer memory, When the i-th AP and the i+1-th AP belong to the external information processing device, the management unit manages the operation of the external information processing device so that the processing result data output from the i-th AP is written into the buffer memory, and the processing result data read from the buffer memory is input into the i+1-th AP.

10. The ultrasonic diagnostic system according to claim 1, characterized in that: A selection image generating unit is included, and the selection image generating unit generates a selection image for selecting the AP set from the AP group based on the management information.

11. The ultrasonic diagnostic system according to claim 10, characterized in that: The selection image includes one or more display elements representing one or more AP candidates that can be selected at the current time point, In the process of selecting a plurality of APs from the AP group in stages, the content of the selection image changes in stages.

12. The ultrasonic diagnostic system according to claim 1, characterized in that: A display control unit is included, the display control unit controls the display of a plurality of processing result data output from the plurality of APs constituting the AP set, The display control unit displays the plurality of processing result data in parallel when the parallel display mode is selected, The plurality of processing result data are compositely displayed when the composite display mode is selected.

13. An ultrasonic diagnostic device connected to an external information processing device, the ultrasonic diagnostic device comprising: a generating unit, generating image data according to the received data; and a management unit that manages an AP group consisting of a plurality of APs, i.e., applications, for processing the image data; The AP group is provided in the external information processing device, or is provided throughout the ultrasonic diagnostic device and the external information processing device. The management unit manages selection of an AP set from the AP group based on management information indicating a relationship between the plurality of APs constituting the AP group, and manages an operation of the AP set. The AP set includes a plurality of APs that act together during ultrasound examination.

14. A program product comprising a program, the program being executed in an ultrasonic diagnostic system, wherein the program product is characterized in that: The ultrasonic diagnostic system comprises: an ultrasonic diagnostic device that generates image data based on received data; and an external information processing device that is connected to the ultrasonic diagnostic device, An AP group consisting of a plurality of APs, i.e., application programs, for processing the image data is provided in the external information processing device, or is provided throughout the ultrasonic diagnostic device and the external information processing device. The procedures include: a function of managing selection of an AP set from the AP group based on management information indicating mutual relationships of the plurality of APs constituting the AP group; and A function of managing the actions of the AP set according to the management information, The AP set includes a plurality of APs that act together during ultrasound examination.

Citation Information

Patent Citations

  • Ultrasonic diagnostic system, ultrasonic diagnostic device and diagnosis support server

    JP2022165214A

  • Ultrasonic diagnostic system and ultrasonic diagnostic device

    JP2022167500A