Ultrasonic diagnostic device, ultrasonic diagnostic system, and program product

Abstract

The invention provides an ultrasonic diagnostic device, an ultrasonic diagnostic system, and a program product, and the subject of the invention is to realize a structure for displaying an external image generated by an external information processing device on a display of the ultrasonic diagnostic device. An external image, which is an image generated by processing an ultrasonic image, and a display condition for displaying the external image are transmitted from an external information processing device (12) to an ultrasonic diagnostic device (10). The display condition includes a designation of a specific display area in the selected specific screen layout. The display processing unit (34) calculates an actual display position at which the external image is displayed on the basis of a specific screen layout and display conditions, thereby generating, as an image to be displayed on the display (30), a composite image including the external image.

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic device and an ultrasonic diagnostic system, and in particular to an image display technology. Background Art

[0002] An ultrasonic diagnostic system including an ultrasonic diagnostic apparatus and an external information processing apparatus is known. In the ultrasonic diagnostic system, an ultrasonic image generated by the ultrasonic diagnostic apparatus is processed in the external information processing apparatus. Specifically, the external information processing apparatus has an application program (hereinafter referred to as an external AP program or external AP) for processing the ultrasonic image. The external AP program generates an image (hereinafter referred to as an external image) indicating the result of the processing of the ultrasonic image.

[0003] When an external image is displayed on an external information processing device, a display for the external information processing device must be provided separately from the display of the ultrasonic diagnostic device, so the physical mass of the ultrasonic diagnostic system increases. In addition, in this case, the user has to observe two displays, which increases the burden on the user. It is expected that the external image can be displayed on the display of the ultrasonic diagnostic device together with or instead of the ultrasonic image.

[0004] Patent Documents 1 and 2 disclose an ultrasonic diagnostic system including an ultrasonic diagnostic apparatus and an external information processing apparatus. Patent Document 3 discloses an ultrasonic diagnostic apparatus that performs display control according to a display layout. However, none of the patent documents discloses the cooperation between an external information processing apparatus and an ultrasonic diagnostic apparatus for the purpose of displaying an external image in the ultrasonic diagnostic apparatus.

[0005] Patent Document 1: Japanese Patent Application Publication No. 2022-160214

[0006] Patent Document 2: Japanese Patent Application Publication No. 2022-167500

[0007] Patent Document 3: Japanese Patent Application Publication No. 2009-160233

[0008] If all display conditions of the external image generated by the external information processing device are determined by the ultrasonic diagnostic device when the external image generated by the external information processing device is displayed on the display of the ultrasonic diagnostic device, the ultrasonic diagnostic device has to manage all information required for the display processing of the external image for each external AP program. In this case, if the external AP program is added or changed, the information managed by the ultrasonic diagnostic device needs to be added or changed. In other words, the ultrasonic diagnostic system cannot be constructed flexibly. The external AP program is of course aware of the function or property of the image (external image) generated by itself, so it is reasonable to let the external AP program specify the basic display conditions. Summary of the invention

[0009] An object of the present invention is to realize a new structure for displaying an external image on a display of an ultrasonic diagnostic apparatus.

[0010] The ultrasonic diagnostic apparatus of the present invention includes a processor and a display. The processor performs the following processing: selecting a specific screen layout from a plurality of screen layouts; sending an ultrasonic image generated by transmitting and receiving ultrasonic waves to an external information processing device; receiving an external image as an image generated by processing the ultrasonic image and a specified display condition for displaying the external image and including a specific display area in the specific screen layout from the external information processing device; and calculating an actual display position for displaying the external image based on the specific screen layout and the display condition, thereby generating a composite image including the external image as an image displayed on the display.

[0011] The ultrasonic diagnostic system of the present invention includes: an ultrasonic diagnostic device including a processor and a display; and an external information processing device connected to the ultrasonic diagnostic device. The processor performs the following processing: selecting a specific screen layout from a plurality of screen layouts; sending an ultrasonic image generated by transmitting and receiving ultrasonic waves to the external information processing device; receiving an external image as an image generated by processing the ultrasonic image and a specified display condition for displaying the external image and including a specific display area in the specific screen layout from the external information processing device; and calculating an actual display position for displaying the external image based on the specific screen layout and the display condition, thereby generating a composite image including the external image as an image displayed on the display.

[0012] The program involved in the present invention is executed in an ultrasonic diagnostic device with a display, and the program includes the following functions: selecting a specific screen layout from multiple screen layouts; sending an ultrasonic image generated by transmitting and receiving ultrasonic waves to an external information processing device; receiving an external image as an image generated by processing the ultrasonic image and a specified display condition for displaying the external image and including a specific display area in the specific screen layout from the external information processing device; and calculating the actual display position of the external image based on the specific screen layout and the display condition, thereby generating a composite image including the external image as an image displayed on the display.

[0013] Effects of the Invention

[0014] According to the present invention, it is possible to provide a new configuration for displaying an external image on a display of an ultrasonic diagnostic apparatus. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a block diagram showing an ultrasonic diagnostic system according to an embodiment.

[0016] Figure 2 This is a diagram showing an example of a screen layout management table.

[0017] Figure 3 This is a diagram showing an example of a coordinate table.

[0018] Figure 4 This is a diagram showing an example of screen layout.

[0019] Figure 5 This is a diagram showing an example of an external AP management table.

[0020] Figure 6 This is a diagram showing an example of display conditions.

[0021] Figure 7 This is a diagram showing an example of a code list.

[0022] Figure 8 This is a flowchart showing an example of the operation at the time of system startup.

[0023] Fig. 9 This is a flowchart showing an example of the operation when an external image is displayed.

[0024] Fig.10 It is a diagram showing a first example of a composite image including an external image.

[0025] Fig.11 It is a diagram showing a second example of a synthesized image including an external image.

[0026] Fig.12 It is a diagram showing a third example of a composite image including an external image.

[0027] Fig.13 This is a timing diagram showing an operation example according to the synchronous method.

[0028] Fig.14 This is a timing diagram showing an operation example according to the asynchronous method.

[0029] Explanation of symbols

[0030] 10-ultrasonic diagnostic device, 12-external information processing device, 24-information processing unit (processor), 26-storage unit, 32-layout management unit, 33-selection unit, 34-display processing unit, 36-size adjuster, 38-coordinate operator, 40-image configurator, 41-update controller, 48-information processing unit (processor), 54-external AP. DETAILED DESCRIPTION

[0031] Hereinafter, embodiments will be described with reference to the drawings.

[0032] (1) Overview of implementation methods

[0033] The ultrasonic diagnostic apparatus according to the embodiment includes a processor and a display. The processor selects a specific screen layout from a plurality of screen layouts. The processor sends an ultrasonic image generated by transmitting and receiving ultrasonic waves to an external information processing device, and receives an external image as an image generated by processing the ultrasonic image and a display condition for displaying the external image and a specified display condition including a specific display area in a specific screen layout from the external information processing device. The processor calculates an actual display position of the external image according to the specific screen layout and the display condition, thereby generating a composite image including the external image as an image displayed on the display.

[0034] In the above structure, a specific screen layout forms a common basis for specifying printing conditions in an external information processing device and for display processing in an ultrasonic diagnostic device. That is, the external information processing device specifies display conditions based on a specific screen layout. On the other hand, the ultrasonic diagnostic device calculates the actual display position of an external image based on the display conditions based on a specific screen layout. With this structure, when an external image is displayed on the display of the ultrasonic diagnostic device, the external information processing device and the ultrasonic diagnostic device can cooperate reasonably. According to the above structure, even if the structure of the external information processing device changes, there is no need to change the display processing in the ultrasonic diagnostic device, or the amount of change in the display processing can be reduced.

[0035] The processor may be composed of one or more physical processors. A specific screen layout may be selected in the ultrasonic diagnostic device according to the designation of the screen layout by the external information processing device. In the ultrasonic diagnostic device, the screen layout may be automatically designated or may be designated by the user. Information indicating the selected specific screen layout may be provided from the ultrasonic diagnostic device to the external information processing device as required. Typically, each screen layout includes a plurality of display areas. The actual display position is the display coordinate on the display coordinate system of the display.

[0036] In an embodiment, the display condition further includes specifying a display position within a specific display area. The display position is a relative position relative to the specific display area. According to this structure, the position where the external image should be displayed within the specific display area can be specified in the external information processing device as needed.

[0037] In an embodiment, the display condition further includes specifying a display size of the external image. The display size is a size relative to a specific display area. The processor calculates the actual display size of the external image according to the specified display size. According to this structure, the display size or display form of the external image can be specified in the external information processing device as needed.

[0038] In an embodiment, the display condition further includes direct or indirect designation of a specific screen layout. The processor selects a specific screen layout according to the direct or indirect designation of the specific screen layout. According to this structure, the selection of a specific screen layout can be controlled in an external information processing device. In the external information processing device, the attributes of the specific screen layout can also be specified instead of the specific screen layout itself. For example, as an attribute, the number of image display areas included in the screen layout can be specified.

[0039] In an embodiment, the display condition further includes an update condition. The processor controls the update time of the external image displayed on the display according to the update condition. According to this structure, the time to update the external image can be specified in the external information processing device as needed.

[0040] In an embodiment, when a synchronous method is specified as an update condition and a plurality of external images are generated by a plurality of image processing in an external information processing device, the processor updates the plurality of external images displayed on the display simultaneously. On the other hand, when an asynchronous method is specified as an update condition and a plurality of external images are generated by a plurality of image processing in an external information processing device, the processor updates the plurality of external images displayed on the display independently.

[0041] The ultrasonic diagnostic system involved in the embodiment includes: an ultrasonic diagnostic device including a processor and a display; and an external information processing device connected to the ultrasonic diagnostic device. The processor selects a specific screen layout from multiple screen layouts. The processor sends an ultrasonic image generated by transmitting and receiving ultrasonic waves to the external information processing device, and receives an external image as an image generated by processing the ultrasonic image and a display condition for displaying the external image and a specified display condition including a specific display area in a specific screen layout from the external information processing device. The processor calculates the actual display position of the external image according to the specific screen layout and the display condition, thereby generating a composite image including the external image as an image displayed on the display.

[0042] The program involved in the embodiment is executed in an ultrasonic diagnostic device having a display. The program involved in the present embodiment includes: a selection function for selecting a specific screen layout from a plurality of screen layouts; a sending function for sending an ultrasonic image generated by ultrasonic transmission and reception to an external information processing device; a receiving function for receiving an external image as an image generated by processing an ultrasonic image and a specified display condition for displaying the external image and including a specific display area in a specific screen layout from an external information processing device; and a generation function for calculating an actual display position for displaying the external image according to the specific screen layout and the display condition, thereby generating a composite image including the external image as an image displayed on the display.

[0043] The non-transitory storage medium according to the embodiment is a storage medium storing a program for causing an ultrasonic diagnostic apparatus as an information processing apparatus to perform a selection step, a transmission step, a reception step, and a generation step.

[0044] (2) Details of implementation method

[0045] Figure 1 , an ultrasonic diagnostic system according to an embodiment of the present invention is shown. The ultrasonic diagnostic system is a medical system that is installed in a medical institution such as a hospital and is used for ultrasonic examination of a living body. The ultrasonic diagnostic system is composed of an ultrasonic diagnostic device 10 and an external information processing device 12. The external information processing device 12 is connected to the ultrasonic diagnostic device 10 via a dedicated cable 43. The external information processing device 12 can also be connected to the ultrasonic diagnostic device 10 via a network such as a LAN (Local Area Network) or the Internet.

[0046] The ultrasonic probe 13 is a device that transmits ultrasonic waves into a living body and receives reflected waves from the living body. The ultrasonic probe 13 has a transducer array including a plurality of transducers. The transducer array forms an ultrasonic beam 14. The ultrasonic beam 14 is electronically scanned to form a beam scanning surface 15.

[0047] Electronic linear scanning and electronic sector scanning are known as electronic scanning methods of the ultrasonic beam 14. A two-dimensional transducer array can be provided as the transducer array. By two-dimensionally scanning the ultrasonic beam using the two-dimensional transducer array, volume data can be acquired from the three-dimensional space in the living body.

[0048] The transmission circuit 16 is a circuit that functions as a transmission beamformer, and outputs a plurality of transmission signals in parallel to the transducer array during transmission, thereby forming a transmission beam.

[0049] The receiving circuit 18 is a circuit that functions as a receiving beam former. When receiving, it applies phase alignment and addition to a plurality of receiving signals output in parallel from the transducer array, thereby generating receiving beam data. As the electronic scanning of the ultrasonic beam is repeated, a receiving frame data column is output from the receiving circuit 18. Each receiving frame data is composed of a plurality of receiving beam data arranged along the electronic scanning direction. Each receiving beam data is composed of a plurality of echo data arranged along the depth direction.

[0050] The data processing circuit 20 is a circuit for processing each reception beam data. The data processing circuit 20 includes a detection circuit, a logarithmic conversion circuit, a filter, etc. In addition, the data processing circuit 20 also includes a circuit for extracting and processing Doppler information included in each reception beam data.

[0051] The image generating unit 22 is a circuit for generating a display frame data column (ultrasound image) based on the received frame data column output from the data processing circuit 20. The image generating unit 22 has a digital scan converter (DSC). The DSC has a coordinate conversion function, a pixel interpolation function, etc. In more detail, for example, when the B mode is selected, a tomographic image data column is generated in the image generating unit 22 as a display frame data column. When the CFM (color flow mapping) mode is selected, a tomographic image data column and a blood flow image data column are generated in the image generating unit 22 as a display frame data column. An operation mode other than the B mode and the CFM mode can also be selected.

[0052] An image memory (not shown) is provided at the rear stage of the image generating unit 22. The image memory has a ring buffer structure. The image memory temporarily stores a tomographic image data column and / or a blood flow image data column. The image data column (the tomographic image data column and / or the blood flow image data column) read out from the image memory is sent to the information processing unit 24.

[0053] In the following, both a single image data and an image data sequence generated by the ultrasonic diagnostic apparatus 10 are simply collectively referred to as an ultrasonic image. Similarly, both a single image data and an image data sequence generated by the external information processing apparatus 12 are simply collectively referred to as an external image.

[0054] The information processing unit 24 is connected to a storage unit 26, an operation panel 28, a display 30, and a communication unit 42. The storage unit 26 is composed of, for example, a semiconductor memory. The operation panel 28 has a plurality of switches, a trackball, a keyboard, etc. The display 30 is composed of an organic EL display device, a liquid crystal display, etc.

[0055] The storage unit 26 stores a screen layout management table for managing a plurality of screen layouts. The screen layout management table will be described later. Figure 2In addition, the storage unit 26 stores a plurality of coordinate tables for realizing a plurality of screen layouts. The coordinate tables will be described later. Figure 3 Furthermore, the storage unit 26 stores an external AP management table for managing a plurality of external APs. The external AP management table will be described later. Figure 5 Provide explanation.

[0056] The information processing unit 24 is composed of a processor that executes a program. Specifically, the processor is a CPU (Central Processing Unit). The information processing unit 24 functions as a control unit that controls the actions of multiple elements that constitute the ultrasonic diagnostic device 10. In addition, the information processing unit 24 functions as a calculation unit that performs various calculations and a processing unit that performs various processes.

[0057] Figure 1 In FIG. 1 , a plurality of functional blocks represent a plurality of representative functions performed by the information processing unit 24. Specifically, the information processing unit 24 includes a layout management unit 32, a selection unit 33, and a display processing unit 34.

[0058] The layout management unit 32 manages multiple selectable screen layouts. Each screen layout includes multiple display areas. Each display area is, for example, an image display area, an information display area, a message display area, or a status display area. However, these area types are not strict, but are set for convenience.

[0059] The selection unit 33 selects a specific screen layout from a plurality of screen layouts according to the designation of the screen layout by the external information processing device 12, the designation of the screen layout by the ultrasonic diagnostic device 10, or the designation of the screen layout by the user. The selection unit 33 changes the screen layout as needed. For example, when a plurality of external images are displayed simultaneously, a specific screen layout suitable for all of the plurality of external images is selected.

[0060] The display processing unit 34 generates a composite image according to the selected specific screen layout. The composite image is an image displayed on the screen of the display 30, which includes, for example, an ultrasonic image generated by the image generating unit 22 and an image (external image) generated by the external information processing device 12. In addition, it may also include text information, a thumbnail image column, an icon column, etc. The display processing unit 34 will be described in detail later.

[0061] The information processing unit 24 transmits the ultrasonic image to the external information processing device through the communication unit 42, and receives the external image and display conditions transmitted from the external information processing device through the communication unit 42. In addition, when transmitting the image data sequence, the streaming technology can be used. The received frame data or the received frame data sequence before the coordinate transformation can also be transmitted from the ultrasonic diagnostic apparatus 10 to the external information processing device 12.

[0062] The external information processing device 12 is constituted by, for example, a computer. The external information processing device 12 has an information processing unit 48 and a communication unit 52. The information processing unit 48 includes a processor that executes a program. The processor is, for example, a CPU. The program includes a plurality of AP programs (a plurality of external APs) 54. Each external AP 54 is an image processing unit that processes an ultrasonic image to generate an image (i.e., an external image) representing the processing result. One or more external APs 54 selected by a user or automatically selected from the plurality of external APs 54 operate.

[0063] The external image and display conditions (reference symbol 43A) are transmitted from the operating external AP 54 to the information processing unit 24 via the communication unit 52 and the communication unit 42. As described later, the display conditions include the designation of a specific display area in a specific screen layout, the designation of a display position in a specific display area, and an update condition. The display conditions may also include direct or indirect designation of the screen layout. The designation of the display position may also include the designation of the display size.

[0064] Multiple external AP54 include, for example, an AP program for detecting lesions in a tomographic image, an AP program for evaluating and analyzing the detected lesions, an AP program for analyzing blood flow images or tissue movement, an AP program for measuring the size or area of ​​tissue, an AP program for constructing a three-dimensional image, etc.

[0065] In the ultrasonic diagnostic apparatus 10, the display processing unit 34 processes the external image sent from the external information processing device 12 based on the selected specific screen layout according to the display conditions sent from the external information processing device 12. The display processing unit 34 includes a resizer 36, a coordinate calculator 38, an image arranger 40, and an update controller 41.

[0066] The size adjuster 36 calculates the actual display size of the external image according to the designation of the specific display area. More specifically, the size adjuster 36 calculates the actual display size, for example, so that the external image falls within the specific display area. The actual display size is the display size on the display coordinate system of the display 30. When the display conditions include the designation of the display size, the size adjuster 36 adjusts the actual display size of the external image according to the designation. Specifically, the actual display size is defined by the coordinate range in the horizontal direction and the coordinate range in the vertical direction.

[0067] The coordinate calculator 38 calculates the actual display position of the external image according to the designation of the display position within the specific display area. The actual display position is the display coordinate on the display coordinate system of the display 30. In more detail, the coordinate calculator 38 calculates the display coordinates of each pixel constituting the external image. However, the display coordinates of one representative point in the external image may be calculated, or the display coordinates of multiple representative points in the external image may be calculated. In addition, the actual display position may be calculated after the actual display size is calculated, or the actual display position may be calculated before the actual display size is calculated, or the actual display size and the actual display position may be calculated simultaneously.

[0068] The image configurator 40 configures an external image having a calculated actual display size at the calculated actual display position on the display coordinate system. According to the selected specific screen layout, the ultrasonic image or other information (text information, thumbnail image column, icon column, etc.) generated in the ultrasonic diagnostic device is also configured on the display coordinate system. Thus, a composite image including the external image is generated. The composite image is displayed on the display 30. A composite image including multiple generated external images can also be displayed side by side. In the case where important information is covered when configuring the external image, the display position of the external image can also be changed to avoid such a problem.

[0069] The update controller 41 controls the update timing of the external image displayed on the display 30 according to the update condition included in the display condition. This will be described in detail later.

[0070] Figure 2 An example of a screen layout management table is shown in FIG. A display format 58, a type 60, and a coordinate table 62 are managed for each screen layout ID 56. The display format 58 and the type 60 are equivalent to the attributes of the screen layout. As the display format 58, 1-image display, 2-image display, 4-image display, etc. can be cited. In the case where multiple screen layouts belong to one display format 58, these screen layouts are identified by type. The coordinate table 62 includes coordinate information of each display area that constitutes the screen layout. When managing multiple screen layouts, it is also possible to construct Figure 2 Tables other than the screen layout management table shown.

[0071] Figure 3 An example of a coordinate table is shown in FIG. Each screen layout includes a plurality of display areas. In the coordinate table, coordinate information 68 and attributes 70 are managed for each display area ID 66. Coordinate information 68 is information for determining the coordinates of the display area in the display coordinate system, and attribute 70 is information for indicating the type of the display area. Examples of display areas include image display areas, information display areas, message display areas, and status display areas. The coordinate table may also have Figure 3Structures other than those shown.

[0072] Figure 4 An example of screen layout is shown in FIG. Figure 4 The screen layout 72 shown has multiple display areas E1 to E4. Display area E1 is, for example, an image display area for displaying an ultrasonic image. Display area E2 is, for example, an image display area for displaying an external image. Display area E2 has a width W1 in the horizontal direction and a width W2 in the vertical direction. These widths W1 and W2 change according to the display magnification, etc. Multiple representative points are defined for display area E2. The multiple representative points include, for example, the upper left corner point 78 and the center point 80. The external image is configured based on any representative point. Display area E3 and display area E4 display, for example, text information, icon columns, etc.

[0073] Figure 5 . The external AP management table 82 has a plurality of records 84 corresponding to a plurality of APs. Each record 84 includes information 86 for identifying an external AP, a display format 88 for displaying an image (external image) generated by the external AP, control information 90 for controlling the external AP, and the like. Information for determining the screen layout may be managed instead of the display format 88 or together with it. The control information 90 is referenced, for example, when an image for selecting an external AP is generated, and is referenced when an instruction or command is sent to an external AP. In an embodiment, when the display processing of the external image is performed, it is not necessary to refer to the control information 90.

[0074] Figure 6 An example of information transmitted from an external information processing device to an ultrasonic diagnostic device is shown in . The information 92 shown in the figure includes an external image 94 and a display condition 96. The display condition 96 may be added to each external image 94, or to an external image sequence.

[0075] Symbol 96A indicates the content of display condition 96. Based on a specific screen layout, display condition 96 includes designation of display area 98, designation of display position 100, and update condition 102. The designated display area is any display area in the specific screen layout. The designated display position is a relative position relative to the specific display area. Depending on the situation, designation of display position 100 includes designation of display size. The designated display size is a relative size relative to the specific display area. In fact, designation of display position 100 is the designation of code described later.

[0076] The update condition 102 indicates a method of updating the external image. As described later, in the present embodiment, as the update condition 102, any one of a synchronous method (synchronous mode) and an asynchronous method (asynchronous mode) can be selected. When the synchronous method is selected, a plurality of external images displayed in parallel are updated simultaneously. When the asynchronous method is selected, a plurality of external images displayed in parallel are updated independently.

[0077] The display condition 96 may include the display format 104. In this case, the selection unit in the ultrasonic diagnostic apparatus may select a specific screen layout according to the display format 104. The display condition 96 may include information that determines the screen layout. In this way, if the display condition 96 includes information that directly or indirectly determines the screen layout, a screen layout suitable for the external AP in operation can be naturally selected.

[0078] When multiple external APs operate in parallel, the external information processing device provides display conditions for each external image to the ultrasonic diagnostic device. In this case, a screen layout with the largest image display area can be selected from multiple screen layouts suitable for multiple display conditions. That is, a screen layout that allows the display of multiple external images can be selected.

[0079] Figure 7 An example of a code list is shown in FIG. The illustrated code list 106 includes a plurality of codes corresponding to a plurality of display methods. A specific display position is specified by specifying a specific code. The display position is a relative position relative to a specific display area. Usually, the display position is determined by a relative position in the vertical direction and a relative position in the horizontal direction.

[0080] For example, if you want to make the upper left corner of the external image coincide with the upper left corner of the display area, specify code 0. In this case, for example, the external image is displayed in the upper left corner area in the display area. The size can also be specified by specifying the code. For example, if code 3 is specified, the external image is displayed in such a way that the upper side of the display area coincides with the upper side of the external image. In this case, the size (scaling ratio) of the external image is adjusted in such a way that the width in the horizontal direction (horizontal width) of the display area coincides with the width in the horizontal direction (horizontal width) of the external image.

[0081] Basically, the size of the external image is adjusted so that the entire external image falls within the display area, that is, so that the external image does not overflow from the display area. According to the specified code, a part of the external image (the overflowing part) is cropped.

[0082] Figure 8 An example of the operation when the system starts is shown in Figure 8The left side of the diagram shows the operation of the ultrasonic diagnostic apparatus (especially, the operation of the information processing unit). Figure 8 The right side of shows the operation of the external information processing device (especially, the operation of the information processing unit).

[0083] If the power of the ultrasonic diagnostic device is turned on in S10, the power of the external information processing device is turned on in S12. That is, the two power supplies operate in conjunction with each other. In S14, the control software in the ultrasonic diagnostic device is started, and in S16, the control software in the external information processing device is started.

[0084] In S18, the ultrasound diagnostic device queries the external information processing device for AP information. In S20, the external information processing device provides the ultrasound diagnostic device with AP information. An external AP management table is generated based on the AP information. That is, in S22, the AP information is registered in the ultrasound diagnostic device. In S24, when the external information processing device has two or more external APs, the AP information is repeatedly acquired. In S26, an AP selection image (UI image) is generated based on the external AP management table.

[0085] Fig. 9 An example of display operation is shown in FIG. Fig. 9 The left side of the diagram shows the operation of the ultrasonic diagnostic apparatus (especially, the operation of the information processing unit). Fig. 9 The right side of shows the operation of the external information processing device (especially, the operation of the information processing unit).

[0086] In S30, a specific external AP is selected by the user. In S32, a specific screen layout corresponding to the specific external AP is selected. In this case, for example, the specific screen layout is selected by referring to the display form in the external AP management table. The specific screen layout may also be selected according to the display condition at the time of acquiring the display condition in the subsequent S40.

[0087] In S34, the ultrasonic diagnostic apparatus requests the external information processing apparatus to start a specific external AP. In S36, the ultrasonic diagnostic apparatus starts transmitting an ultrasonic image to the external information processing apparatus. In S38, the ultrasonic image is processed by the specific external AP. Thus, an external image representing the processing result is generated. In S40, the external image and display conditions are transmitted from the external information processing apparatus to the ultrasonic diagnostic apparatus. The display conditions are generated by the specific external AP. The display conditions may also be generated by other modules in the external information processing apparatus.

[0088] In S42, the actual display position (display coordinates) of the external image is calculated according to the display conditions based on the selected specific screen layout, and the actual display size of the external image is calculated. On the display coordinate system, the external image with the actual display size is arranged at the actual display position in the specific display area. Thus, a composite image including the external image is generated, and the composite image is displayed on the screen. S44 represents the repetitive action when the external image is a dynamic image, that is, the repetition of the generation and display of the composite image.

[0089] Fig.10 1 shows a first display example. A composite image 120 generated according to a specific screen layout is displayed on the screen. The specific screen layout includes a plurality of display areas E1 to E4. Display area E1 is an image display area, where an ultrasonic image is displayed. The ultrasonic image is, for example, a tomographic image that changes in real time, that is, a dynamic image.

[0090] The display area E2 is an image display area, where an external image 124 is displayed. In the illustrated example, the external image 124 is displayed in such a manner that the central point of the external image 124 coincides with the central point 126 of the display area E2. The lateral width Wa of the external image 124 coincides with the lateral width W1 of the display area E2. In addition, the external image 124 has a rectangular mark 128 surrounding the detected lesion. In the illustrated example, the external image 124 is also a tomographic image that changes in real time, that is, a dynamic image. Of course, a static image can also be displayed as an external image.

[0091] Fig.11 2 shows a second display example. A composite image 130 generated based on a specific screen layout is displayed on the screen. The specific screen layout includes a plurality of display areas E1 to E8. The display area E2 is an image display area, where an ultrasonic image is displayed.

[0092] The display area E6 is an information display area, where an external image 132 is displayed. In the example shown in the figure, the upper right corner point of the external image 132 coincides with the upper right corner point 134 of the display area E6. The external image 132 includes a text image.

[0093] Fig.12 A composite image 136 generated according to a specific screen layout is displayed in FIG. The specific screen layout includes a plurality of display areas E1 to E6. Display area E2 is an image display area, where an ultrasonic image is displayed.

[0094] The display area E3 is also an image display area, where the first external image 140 is displayed. The first external image 140 includes a rectangular mark 142 surrounding the detected lesion. In addition, the second external image 144 is also displayed in the display area E3. Specifically, the second external image 144 is displayed in an overlapping manner to cover the lower right corner of the first external image. In the case where important information is covered when the second external image 144 is displayed, the actual display position of the second external image can also be automatically changed. Alternatively, the second external image 144 can also be displayed semi-transparently.

[0095] Next, use Fig.13 and Fig.14 Display update control will be described. Fig.13 The following shows an example of the operation when the synchronous mode is selected. Fig.14 2 shows an operation example when the asynchronous method is selected.

[0096] exist Fig.13 In the figure, (a) shows the storage of the synthesized image in the secondary buffer memory in the ultrasonic diagnostic device. (b1) shows the storage of the ultrasonic image USi in the primary buffer memory in the ultrasonic diagnostic device. (b2) shows the storage of the first external image Ai in the primary buffer memory, and (b3) shows the storage of the second external image Bi in the primary buffer memory. (c1) shows the processing A of the first external AP in the external information processing device and the generation of the first external image Ai. (c2) shows the processing B of the second external AP in the external information processing device and the generation of the second external image Bi.

[0097] At time t1, the first external AP and the second external AP start processing A and B of the ultrasonic image USi. At time t2, the first external image Ai is transferred to the primary buffer memory. At time t3, the second external image Bi is transferred to the primary buffer memory.

[0098] Then, after the storage of the second external image Bi is completed (reference symbol 150), at time t4, the ultrasonic image USi, the first external image Ai, and the second external image Bi are collectively transferred from the primary buffer memory to the secondary buffer memory (reference symbol 148). Thus, the entire composite image on the secondary buffer memory is updated. As shown by symbol 152, the composite image read from the secondary buffer memory is displayed on the display at a constant display rate.

[0099] As described above, when the synchronization mode is selected, the plurality of main images constituting the composite image are updated simultaneously. In particular, when the first external image Ai and the second external image Bi are generated in parallel by an external information processing device, the two external images Ai and Bi to be displayed are updated simultaneously based on the later generation time. For example, when the content of the first external image Ai and the time relationship of the second external image Bi are emphasized, the synchronization mode is selected.

[0100] exist Fig.14 In, (a) to (c2) are as described above. Fig.14 At time t1, the first external AP and the second external AP start processing A and B of the ultrasonic image USi. At time t2, the ultrasonic image USi is updated and its completion is waited (reference symbol 154). At time t3, the new ultrasonic image is transferred from the primary buffer memory to the secondary buffer memory. Reference symbol 160 indicates a local update of the synthesized image.

[0101] At time t4, the first external image Ai is transferred to the primary buffer memory. After waiting for its completion (reference symbol 156), at time t5, the first external image Ai is transferred from the primary buffer memory to the secondary buffer memory. At this point, the synthesized image on the secondary buffer memory is also partially updated.

[0102] At time t6, the second external image Bi is transferred to the primary buffer memory. After waiting for its completion (reference symbol 158), at time t7, the second external image Bi is transferred from the primary buffer memory to the secondary buffer memory. At this point, the synthesized image on the secondary buffer memory is also partially updated.

[0103] Just before time t7, the ultrasonic image USi in the primary buffer memory is updated, and after the update, the new ultrasonic image USi is transferred from the primary buffer memory to the secondary buffer memory. As shown by reference numeral 162, the synthesized image read from the secondary buffer memory is displayed on the display at a constant display rate.

[0104] As described above, when the asynchronous method is selected, the multiple images constituting the composite image are updated independently. In particular, the first external image Ai and the second external image Bi generated by the external information processing device are updated independently at an early stage. For example, when the time relationship between the content of the first external image Ai and the second external image Bi is not a problem and real-time display is important, the asynchronous method is selected.

[0105] In the case that two external APs specify two different modes, the user may select a mode or may give priority to any mode.

[0106] In the ultrasonic diagnostic system involved in the embodiment, a specific screen layout forms a common basis for specifying printing conditions in an external information processing device and for display processing in the ultrasonic diagnostic device. That is, the display conditions are specified by the external information processing device based on the specific screen layout. On the other hand, the actual display position of the external image is calculated by the ultrasonic diagnostic device based on the display conditions based on the specific screen layout. Through this structure, when the external image is displayed on the display of the ultrasonic diagnostic device, the external information processing device and the ultrasonic diagnostic device can cooperate reasonably. Furthermore, according to the ultrasonic diagnostic system involved in the embodiment, since the update conditions can be specified by the external AP, update control suitable for the function or nature of the external image can be applied.

Claims

1. An ultrasonic diagnostic device, characterized in that: Including processor and display, The processor performs the following processing: Select a specific screen layout from multiple screen layouts; transmitting an ultrasonic image generated by transmitting and receiving ultrasonic waves to an external information processing device; receiving, from the external information processing device, an external image that is an image generated by processing the ultrasonic image and a specified display condition for displaying the external image and including a specific display area in the specific screen layout; and An actual display position of the external image is calculated based on the specific screen layout and the display condition, thereby generating a composite image including the external image as an image to be displayed on the display.

2. The ultrasonic diagnostic apparatus according to claim 1, wherein: The display condition also includes designation of a display position within the specific display area. The display position is a relative position relative to the specific display area.

3. The ultrasonic diagnostic apparatus according to claim 1, wherein: The display conditions also include designation of a display size of the external image, The display size is a relative size relative to the specific display area. The processor calculates an actual display size of the external image according to the designation of the display size.

4. The ultrasonic diagnostic apparatus according to claim 1, wherein: The display condition also includes direct or indirect designation of the specific screen layout. The processor selects the specific screen layout according to direct or indirect designation of the specific screen layout.

5. The ultrasonic diagnostic apparatus according to claim 1, wherein: The display condition also includes an update condition. The processor controls an update timing of the external image displayed on the display according to the update condition.

6. The ultrasonic diagnostic apparatus according to claim 5, characterized in that: When a synchronization method is specified as the update condition and a plurality of external images are generated by a plurality of image processing in the external information processing device, the processor updates the plurality of external images displayed on the display simultaneously. When an asynchronous method is designated as the update condition and the plurality of external images are generated by the plurality of image processes in the external information processing device, the processor updates the plurality of external images displayed on the display independently.

7. An ultrasonic diagnostic system, characterized in that: include: Ultrasound diagnostic equipment, including a processor and a display; and an external information processing device connected to the ultrasonic diagnostic device, The processor performs the following processing: Select a specific screen layout from multiple screen layouts; sending an ultrasonic image generated by transmitting and receiving ultrasonic waves to the external information processing device; receiving, from the external information processing device, an external image that is an image generated by processing the ultrasonic image and a specified display condition for displaying the external image and including a specific display area in the specific screen layout; and An actual display position of the external image is calculated based on the specific screen layout and the display condition, thereby generating a composite image including the external image as an image to be displayed on the display.

8. A program product, characterized in that The invention comprises a program, which is executed in an ultrasonic diagnostic apparatus having a display, and comprises the following functions: Select a specific screen layout from multiple screen layouts; transmitting an ultrasonic image generated by transmitting and receiving ultrasonic waves to an external information processing device; receiving, from the external information processing device, an external image that is an image generated by processing the ultrasonic image and a specified display condition for displaying the external image and including a specific display area in the specific screen layout; and An actual display position of the external image is calculated based on the specific screen layout and the display condition, thereby generating a composite image including the external image as an image to be displayed on the display.

Images