Ultrasonic diagnostic apparatus and ultrasonic diagnostic system

Abstract

To provide a mechanism to display an external image generated by an external information processing device in a display unit of an ultrasonic diagnostic apparatus.SOLUTION: An external image, which is generated by the processing of an ultrasonic image, and a display condition for displaying the external image are transferred from an external information processing device 12 to an ultrasonic diagnostic apparatus 10. The display condition includes designation of a specific display area in a selected specific screen layout. A display processing unit 34 calculates an actual display position for displaying the external image on the basis of the specific screen layout and the display condition, thereby generating a composite image including the external image as the image displayed in a display unit 30.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an ultrasound diagnostic device and an ultrasound diagnostic system, and in particular to an image display technique. [Background technology]

[0002] There is known an ultrasonic diagnostic system consisting of an ultrasonic diagnostic device and an external information processing device. In such an ultrasonic diagnostic system, an ultrasonic image generated by the ultrasonic diagnostic device is processed in the external information processing device. Specifically, the external information processing device has an application program (hereinafter referred to as an external AP program or external AP) for processing ultrasonic images. The external AP program generates an image (hereinafter referred to as an external image) representing the result of processing the ultrasonic image.

[0003] When an external image is displayed on an external information processing device, a display for the external information processing device must be provided in addition to the display of the ultrasound diagnostic device, which increases the amount of material in the ultrasound diagnostic system. In addition, in this case, the user must observe two displays, which increases the burden on the user. It is desirable to display an external image on the display of the ultrasound diagnostic device together with or instead of an ultrasound image.

[0004] Patent Documents 1 and 2 disclose an ultrasonic diagnostic system consisting of an ultrasonic diagnostic device and an external information processing device. Patent Document 3 discloses an ultrasonic diagnostic device that executes display control according to a display layout. However, neither of the patent documents discloses cooperation between an external information processing device and the ultrasonic diagnostic device for the purpose of displaying an external image on the ultrasonic diagnostic device. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2022-160214 A [Patent Document 2] Patent Publication No. 2022-167500 [Patent Document 3] JP 2009-160233 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the case where an external image generated by an external information processing device is displayed on the display of the ultrasound diagnostic device, if the ultrasound diagnostic device determines all of the display conditions of the external image, the ultrasound diagnostic device must manage all of the information required for display processing of the external image for each external AP program. In that case, when an external AP program is added or changed, it becomes necessary to add or change the information managed by the ultrasound diagnostic device. In other words, the ultrasound diagnostic system cannot be flexibly constructed. Since the external AP program naturally knows the functions and properties of the image (external image) that it generates, it is reasonable to have the external AP program specify the basic display conditions.

[0007] An object of the present disclosure is to realize a new mechanism for displaying an external image on a display device of an ultrasound diagnostic device. [Means for solving the problem]

[0008] The ultrasound diagnostic device according to the present disclosure includes a processor and a display device, wherein the processor selects a specific screen layout from among a plurality of screen layouts, transmits an ultrasound image generated by transmitting and receiving ultrasound to an external information processing device, receives from the external information processing device an external image that is an image generated by processing the ultrasound image and a display condition for displaying the external image, the display condition including a designation of a specific display area in the specific screen layout, calculates an actual display position for displaying the external image based on the specific screen layout and the display condition, and thereby generates a composite image including the external image as an image to be displayed on the display device.

[0009] The ultrasound diagnostic system according to the present disclosure includes an ultrasound diagnostic device including a processor and a display, and an external information processing device connected to the ultrasound diagnostic device, the processor selecting a specific screen layout from a plurality of screen layouts, transmitting an ultrasound image generated by transmitting and receiving ultrasound to the external information processing device, receiving from the external information processing device an external image generated by processing the ultrasound image and a display condition for displaying the external image including a designation of a specific display area in the specific screen layout, calculating an actual display position for displaying the external image based on the specific screen layout and the display condition, and thereby generating a composite image including the external image as an image to be displayed on the display.

[0010] The program according to the present disclosure is a program executed in an ultrasound diagnostic device having a display, and includes the following functions: selecting a specific screen layout from a plurality of screen layouts; sending an ultrasound image generated by transmitting and receiving ultrasound to an external information processing device; receiving from the external information processing device an external image, which is an image generated by processing the ultrasound image, and display conditions for displaying the external image, the display conditions including designation of a specific display area in the specific screen layout; and calculating an actual display position at which the external image is displayed based on the specific screen layout and the display conditions, thereby generating a composite image including the external image as an image to be displayed on the display. Effect of the Invention

[0011] According to the present disclosure, a new mechanism for displaying an external image on a display device of an ultrasound diagnostic device can be provided. [Brief description of the drawings]

[0012] [Figure 1] 1 is a block diagram showing an ultrasound diagnostic system according to an embodiment. [Diagram 2] FIG. 13 illustrates an example of a screen layout management table. [Diagram 3]FIG. 11 is a diagram illustrating an example of a coordinate table. [Figure 4] FIG. 13 is a diagram showing an example of a screen layout. [Diagram 5] FIG. 13 illustrates an example of an external AP management table. [Figure 6] FIG. 11 is a diagram illustrating an example of a display condition. [Figure 7] FIG. 13 is a diagram illustrating an example of a code list. [Figure 8] 10 is a flowchart showing an example of an operation at the time of system startup. [Figure 9] 10 is a flowchart showing an example of an operation when an external image is displayed. [Figure 10] FIG. 13 is a diagram showing a first example of a composite image including an external image. [Figure 11] FIG. 13 is a diagram showing a second example of a composite image including an external image. [Figure 12] FIG. 13 is a diagram showing a third example of a composite image including an external image. [Figure 13] 4 is a timing chart showing an example of an operation according to a synchronization method. [Figure 14] 1 is a timing chart showing an example of an operation according to an asynchronous method. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment will be described with reference to the drawings.

[0014] (1) Overview of the embodiment An ultrasound diagnostic device according to an embodiment includes a processor and a display. The processor selects a specific screen layout from a plurality of screen layouts. The processor transmits an ultrasound image generated by transmitting and receiving ultrasound to an external information processing device, and receives from the external information processing device an external image, which is an image generated by processing the ultrasound image, and a display condition for displaying the external image, which includes a designation of a specific display area in the specific screen layout. The processor calculates an actual display position at which the external image is displayed based on the specific screen layout and the display condition, and thereby generates a composite image including the external image as an image to be displayed on the display.

[0015] In the above configuration, the specific screen layout forms a common basis for specifying print conditions in the external information processing device and for display processing in the ultrasound diagnostic device. That is, the external information processing device specifies display conditions on the premise of the specific screen layout. On the other hand, the ultrasound diagnostic device calculates an actual display position for displaying an external image according to the display conditions on the premise of the specific screen layout. With this mechanism, it becomes possible to rationally link the external information processing device and the ultrasound diagnostic device when displaying an external image on the display of the ultrasound diagnostic device. With the above configuration, even if the configuration of the external information processing device changes, there is no need to change the display processing in the ultrasound diagnostic device, or the amount of change in the display processing can be reduced.

[0016] The above processor may be configured with one or more physical processors. A specific screen layout may be selected in the ultrasound diagnostic device based on a screen layout designation by an external information processing device. The screen layout may be automatically designated in the ultrasound diagnostic device, or may be designated by a user. Information representing the selected specific screen layout may be provided from the ultrasound diagnostic device to the external information processing device as necessary. Each screen layout generally includes multiple display areas. The actual display position is a display coordinate on a display coordinate system possessed by the display.

[0017] In an embodiment, the display conditions further include a designation of a display position within a specific display area. The display position is a relative position with respect to the specific display area. With this configuration, if necessary, a position within the specific display area where the external image should be displayed can be designated in the external information processing device.

[0018] In an embodiment, the display conditions further include a designation of a display size of the external image. The display size is a relative size with respect to a specific display area. The processor calculates an actual display size of the external image based on the designation of the display size. With this configuration, the display size or display form of the external image can be designated in the external information processing device as necessary.

[0019] In an embodiment, the display conditions further include a direct or indirect designation of a specific screen layout. The processor selects the specific screen layout based on the direct or indirect designation of the specific screen layout. This configuration makes it possible to control the selection of the specific screen layout in the external information processing device. In the external information processing device, an attribute of the specific screen layout may be specified instead of the specific screen layout itself. For example, the number of image display areas included in the screen layout may be specified as an attribute.

[0020] In an embodiment, the display conditions further include update conditions. The processor controls the update timing of the external image displayed on the display device in accordance with the update conditions. With this configuration, it is possible to specify the timing of updating the external image in the external information processing device as necessary.

[0021] In an embodiment, the processor controls the plurality of external images displayed on the display to be updated simultaneously when a synchronous method is specified as the update condition and a plurality of external images are generated by a plurality of image processes in the external information processing device, whereas the processor controls the plurality of external images displayed on the display to be updated independently when an asynchronous method is specified as the update condition and a plurality of external images are generated by a plurality of image processes in the external information processing device.

[0022] An ultrasound diagnostic system according to an embodiment includes an ultrasound diagnostic device including a processor and a display, and an external information processing device connected to the ultrasound diagnostic device. The processor selects a specific screen layout from a plurality of screen layouts. The processor transmits an ultrasound image generated by transmitting and receiving ultrasound to the external information processing device, and receives from the external information processing device an external image, which is an image generated by processing the ultrasound image, and a display condition for displaying the external image, which includes a designation of a specific display area in the specific screen layout. The processor calculates an actual display position at which the external image is displayed based on the specific screen layout and the display condition, and thereby generates a composite image including the external image as an image to be displayed on the display.

[0023] The program according to the embodiment is a program executed in an ultrasound diagnostic device having a display. The program according to the embodiment includes a selection function for selecting a specific screen layout from a plurality of screen layouts, a transmission function for sending an ultrasound image generated by transmitting and receiving ultrasound to an external information processing device, a reception function for receiving from the external information processing device an external image which is an image generated by processing the ultrasound image, and a display condition for displaying the external image, the display condition including a specification of a specific display area in the specific screen layout, and a generation function for calculating an actual display position for displaying the external image based on the specific screen layout and the display condition, thereby generating a composite image including the external image as an image to be displayed on the display.

[0024] A non-transitory storage medium according to the embodiment is a storage medium that stores a program for causing an ultrasound diagnostic apparatus serving as an information processing apparatus to perform a selection procedure, a transmission procedure, a reception procedure, and a generation procedure.

[0025] (2) Details of the embodiment 1 shows an ultrasound diagnostic system according to an embodiment. This ultrasound diagnostic system is a medical system installed in a medical institution such as a hospital and used in ultrasound examination of a living body. The ultrasound diagnostic system includes an ultrasound diagnostic apparatus 10 and an external information processing device 12. The external information processing device 12 is connected to the ultrasound diagnostic apparatus 10 via a dedicated cable 43. The external information processing device 12 may be connected to the ultrasound diagnostic apparatus 10 via a network such as a LAN (Local Area Network) or the Internet.

[0026] The ultrasonic probe 13 is a device that transmits ultrasonic waves into a living body and receives reflected waves from the living body. The ultrasonic probe 13 has a transducer array consisting of a plurality of transducers. The transducer array forms an ultrasonic beam 14. A beam scan plane 15 is formed by electronically scanning the ultrasonic beam 14.

[0027] Known electronic scanning methods of the ultrasonic beam 14 include an electronic linear scanning method and an electronic sector scanning method. A two-dimensional transducer array may be provided as the transducer array. Volume data can be obtained from a three-dimensional space in a living body by two-dimensionally scanning the ultrasonic beam using the two-dimensional transducer array.

[0028] The transmission circuitry 16 is an electronic circuit that functions as a transmission beamformer, and outputs a plurality of transmission signals in parallel to the transducer array during transmission, thereby forming a transmission beam.

[0029] The receiving circuit 18 is an electronic circuit that functions as a receiving beamformer, and applies phasing addition to multiple receiving signals output in parallel from the transducer array during reception, thereby generating receiving beam data. As electronic scanning of the ultrasound beam is repeated, a receiving frame data string is output from the receiving circuit 18. Each receiving frame data is composed of multiple receiving beam data aligned in the electronic scanning direction. Each receiving beam data is composed of multiple echo data aligned in the depth direction.

[0030] The data processing circuit 20 processes each reception beam data. The data processing circuit 20 includes a detection circuit, a logarithmic conversion circuit, a filter, etc. The data processing circuit 20 also includes a circuit for extracting and processing Doppler information included in each reception beam data.

[0031] The image generating unit 22 is an electronic circuit that generates a display frame data sequence (ultrasound image) based on the received frame data sequence output from the data processing circuit 20. The image generating unit 22 has a digital scan converter (DSC). The DSC has a coordinate conversion function, a pixel interpolation function, and the like. More specifically, for example, when the B mode is selected, the image generating unit 22 generates a tomographic image data sequence as the display frame data sequence. When the CFM (color flow mapping) mode is selected, the image generating unit 22 generates a tomographic image data sequence and a blood flow image data sequence as the display frame data sequence. An operation mode other than the B mode and the CFM mode may be selected.

[0032] A cine memory (not shown) is provided downstream of the image generating unit 22. The cine memory has a ring buffer structure. The cine memory temporarily stores a tomographic image data sequence and / or a blood flow image data sequence. The image data sequence (the tomographic image data sequence and / or the blood flow image data sequence) read out from the cine memory is sent to the information processing unit 24.

[0033] In the following, both the single image data and the image data string generated by the ultrasound diagnostic device 10 are collectively referred to as an ultrasound image. Similarly, both the single image data and the image data string generated by the external information processing device 12 are collectively referred to as an external image.

[0034] A storage unit 26, an operation panel 28, and a display 30 are connected to the information processing unit 24, and further a communication unit 42 is connected. The storage unit 26 is formed of, for example, a semiconductor memory. The operation panel 28 has a plurality of switches, a trackball, a keyboard, etc. The display 30 is formed of, for example, an organic EL display device, a liquid crystal display, etc.

[0035] The storage unit 26 stores a screen layout management table for managing a plurality of screen layouts. The layout management table will be described later with reference to FIG. 2. The storage unit 26 also stores a plurality of coordinate tables for realizing a plurality of screen layouts. The coordinate tables will be described later with reference to FIG. 3. The storage unit 26 also stores an external AP management table for managing a plurality of external APs. The external AP management table will be described later with reference to FIG. 5.

[0036] The information processing unit 24 is configured by a processor that executes a program. Specifically, the processor is a CPU (Central Processing Unit). The information processing unit 24 functions as a control unit that controls the operations of multiple elements that configure the ultrasound diagnostic device 10. The information processing unit 24 also functions as a calculation unit that executes various calculations, and a processing unit that executes various processes.

[0037] 1, a number of blocks are used to represent a number of representative functions performed by the information processing unit 24. Specifically, the information processing unit 24 includes a layout management unit 32, a selection unit 33, and a display processing unit .

[0038] The layout management unit 32 manages a plurality of selectable screen layouts. Each screen layout includes a plurality of display areas. Each display area is, for example, an image display area, an information display area, a message display area, or a status display area. However, these area types are not strict but are for convenience.

[0039] The selection unit 33 selects a specific screen layout from among multiple screen layouts based on a screen layout designated by the external information processing device 12, a screen layout designated by the ultrasound diagnostic device 10, or a screen layout designated by a user. If necessary, the selection unit 33 changes the screen layout. For example, when multiple external images are displayed simultaneously, a specific screen layout that is suitable for all of the multiple external images is selected.

[0040] The display processing unit 34 generates a composite image according to the selected specific screen layout. The composite image is an image displayed on the screen of the display 30, and includes, for example, an ultrasound image generated by the image generating unit 22 and an image (external image) generated by the external information processing device 12. In addition, text information, a string of thumbnail images, a string of icons, etc. may be included. The display processing unit 34 will be described in detail later.

[0041] The information processing unit 24 transmits ultrasound images to an external information processing device through the communication unit 42, and also receives external images and display conditions sent from the external information processing device through the communication unit 42. Note that streaming technology may be used when transferring image data strings. Received frame data or a received frame data string before coordinate conversion may be transferred from the ultrasound diagnostic device 10 to the external information processing device 12.

[0042] The external information processing device 12 is configured, for example, by a computer. The external information processing device 12 has an information processing unit 48 and a communication unit 52. The information processing unit 48 includes a processor that executes a program. The processor is, for example, a CPU. The program includes a plurality of AP programs (a plurality of external APs) 54. Each external AP 54 is an image processing unit that processes an ultrasound image and generates an image (i.e., an external image) showing the processing result. One or a plurality of external APs 54 selected by a user or automatically selected from the plurality of external APs 54 operates.

[0043] An external image and display conditions are transferred from the operating external AP 54 to the information processing unit 24 via the communication unit 52 and the communication unit 42 (see reference numeral 43A). As described below, the display conditions include the specification of a specific display area in a specific screen layout, the specification of a display position within the specific display area, and update conditions. The display conditions may also include a direct or indirect specification of a screen layout. The specification of the display position may also include a specification of a display size.

[0044] The multiple external APs 54 include, for example, an AP program that detects lesions in cross-sectional images, an AP program that evaluates and analyzes the detected lesions, an AP program that analyzes blood flow images or tissue movement, an AP program that measures the size and area of ​​tissue, an AP program that constructs three-dimensional images, and the like.

[0045] In the ultrasound diagnostic device 10, the display processing unit 34 processes the external image sent from the external information processing device 12 in accordance with the display conditions sent from the external information processing device 12, assuming a specific selected screen layout. The display processing unit 34 has a size adjuster 36, a coordinate calculator 38, an image layout unit 40, and an update controller 41.

[0046] The size adjuster 36 calculates the actual display size of the external image based on the designation of the specific display area. More specifically, the size adjuster 36 calculates the actual display size so that the external image fits within the specific display area. The actual display size is the display size on the display coordinate system possessed by the display 30. When the display conditions include a designation of the display size, the size adjuster 36 adjusts the actual display size of the external image according to the designation. The actual display size is specifically defined by a horizontal coordinate range and a vertical coordinate range.

[0047] The coordinate calculator 38 calculates an actual display position at which the external image is to be displayed based on the designation of the display position within a specific display area. The actual display position is a display coordinate on the display coordinate system of the display 30. More specifically, the coordinate calculator 38 calculates the display coordinates of each pixel constituting the external image. However, the display coordinates of one representative point in the external image may be calculated, or the display coordinates of multiple representative points in the external image may be calculated. Note that the actual display position may be calculated after the calculation of the actual display size, the actual display position may be calculated before the calculation of the actual display size, or the actual display size and the actual display position may be calculated simultaneously.

[0048] The image arranger 40 arranges an external image having the calculated actual display size at the calculated actual display position on the display coordinate system. According to the selected specific image layout, ultrasound images generated in the ultrasound diagnostic device and other information (text information, a row of thumbnail images, a row of icons, etc.) are also arranged on the display coordinate system. This generates a composite image including the external image. The composite image is displayed on the display 30. A composite image including multiple external images generated in parallel may also be displayed. If important information is hidden when arranging the external image, the display position of the external image may be changed to prevent such a problem from occurring.

[0049] The update controller 41 controls the update timing of the external image displayed on the display 30 in accordance with the update conditions included in the display conditions, as will be described in detail later.

[0050] FIG. 2 shows an example of a screen layout management table. For each screen layout ID 56, a display format 58, a type 60, and a coordinate table 62 are managed. The display format 58 and the type 60 correspond to attributes of the screen layout. Examples of the display format 58 include one image display, two image display, and four image display. When multiple screen layouts belong to one display format 58, the screen layouts are identified by their types. The coordinate table 62 includes coordinate information of each display area that constitutes the screen layout. When multiple screen layouts are managed, a table other than the screen layout management table shown in FIG. 2 may be constructed.

[0051] FIG. 3 shows an example of a coordinate table. Each screen layout includes a plurality of display areas. In the coordinate table, coordinate information 68 and attributes 70 are managed for each display area ID 66. The coordinate information 68 is information that specifies the coordinates of the display area in the display coordinate system, and the attributes 70 is information that indicates the type of the display area. Examples of the display area include an image display area, an information display area, a message display area, and a status display area. The coordinate table may have a structure other than that shown in FIG. 3.

[0052] FIG. 4 shows an example of a screen layout. The screen layout 72 shown in FIG. 4 has a plurality of display areas E1 to E4. The display area E1 is, for example, an image display area for displaying an ultrasound image. The display area E2 is, for example, an image display area for displaying an external image. The display area E2 has a horizontal width W1 and a vertical width W2. The widths W1 and W2 vary depending on the display magnification and the like. A plurality of representative points are defined for the display area E2. The representative points include, for example, an upper left corner point 78 and a center point 80. An external image is arranged based on one of the representative points. For example, text information, a row of icons, and the like are displayed in the display area E3 and the display area E4.

[0053] 5 shows an example of an external AP management table. The external AP management table 82 has a plurality of records 84 corresponding to a plurality of APs. Each record 84 includes information 86 for identifying the external AP, a display format 88 for displaying an image (external image) generated by the external AP, control information 90 for controlling the external AP, and the like. Instead of or together with the display format 88, information for specifying a screen layout may be managed. The control information 90 is referred to, for example, when an image for selecting an external AP is generated, and is referred to when instructions or commands are sent to the external AP. In the embodiment, it is not necessary to refer to the control information 90 when processing the display of an external image.

[0054] 6 shows an example of information transferred from an external information processing device to an ultrasonic diagnostic device. The illustrated information 92 includes an external image 94 and a display condition 96. The display condition 96 may be added to each external image 94, or the display condition may be added to a sequence of external images.

[0055] Reference numeral 96A indicates the contents of the display conditions 96. Assuming a specific screen layout, the display conditions 96 include a display area specification 98, a display position specification 100, and update conditions 102. The specified display area is any display area in the specific screen layout. The specified display position is a relative position to the specific display area. The display position specification 100 may include a display size specification. The specified display size is a relative size to the specific display area. The display position specification 100 is actually a code specification, which will be described later.

[0056] The update condition 102 means a method for updating the external image. As will be described later, in this embodiment, either a synchronous method (synchronous mode) or an asynchronous method (asynchronous mode) can be selected as the update condition 102. When the synchronous method is selected, multiple external images displayed in parallel are updated simultaneously. When the asynchronous method is selected, multiple external images displayed in parallel are updated independently of each other.

[0057] The display conditions 96 may include a display format 104. In this case, a selection unit in the ultrasound diagnostic device may select a specific screen layout based on the display format 104. Information specifying the screen layout may be included in the display conditions 96. In this way, if the display conditions 96 include information that directly or indirectly specifies the screen layout, a screen layout that is compatible with the external AP in operation is naturally selected.

[0058] When multiple external APs are operating in parallel, the external information processing device provides the ultrasound diagnostic device with display conditions for each external image. In this case, the screen layout having the largest image display area may be selected from multiple screen layouts that meet the multiple display conditions. In other words, the screen layout that can allow the display of multiple external images may be selected.

[0059] An example of a code list is shown in Figure 7. The illustrated code list 106 includes a number of codes corresponding to a number of display methods. A specific display position is specified by specifying a specific code. The display position is a relative position to a specific display area. Typically, the display position is specified by a relative vertical position and a relative horizontal position.

[0060] For example, if it is desired to match the upper left corner of the external image with the upper left corner of the display area, code 0 is specified. In that case, for example, the external image is displayed in the upper left corner area of ​​the display area. The size can also be specified by specifying the code. For example, when code 3 is specified, the external image is displayed so that the top edge of the display area and the top edge of the external image match. In that case, the size (scale) of the external image is adjusted so that the horizontal width (width) of the display area and the horizontal width (width) of the external image match.

[0061] Basically, the size of the external image is adjusted so that the entire external image fits within the display area, that is, so that the external image does not protrude from the display area. Depending on the specified code, a part of the external image (the protruding part) may be cut off.

[0062] An example of the operation at the time of system startup is shown in Fig. 8. The left side of Fig. 8 shows the operation of the ultrasound diagnostic device (particularly the operation of the information processing unit), and the right side of Fig. 8 shows the operation of the external information processing device (particularly the operation of the information processing unit).

[0063] When the power supply of the ultrasonic diagnostic device is turned on in S10, the power supply of the external information processing device is turned on in S12. That is, the two power supplies operate in conjunction with each other. In S14, the control software in the ultrasonic diagnostic device is started, and in S16, the control software in the external information processing device is started.

[0064] In S18, the ultrasound diagnostic device inquires of the external information processing device about AP information. In S20, the AP information is provided from the external information processing device to the ultrasound diagnostic device. An external AP management table is generated based on the AP information. That is, in S22, the AP information is registered in the ultrasound diagnostic device. In S24, if the external information processing device is equipped with two or more external APs, acquisition of AP information is repeated. In S26, an AP selection image (UI image) is generated based on the external AP management table.

[0065] An example of a display operation is shown in Fig. 9. The left side of Fig. 9 shows the operation of the ultrasound diagnostic device (particularly, the operation of the information processing unit), and the right side of Fig. 9 shows the operation of the external information processing device (particularly, the operation of the information processing unit).

[0066] In S30, a specific external AP is selected by the user. In S32, a specific screen layout corresponding to the specific external AP is selected. In this case, for example, the specific screen layout is selected by referring to the display format in the external AP management table. Later, at the point in time when the display conditions are acquired in S40, the specific screen layout may be selected based on the display conditions.

[0067] In S34, the ultrasound diagnostic device requests the external information processing device to start a specific external AP. In S36, transfer of an ultrasound image is started from the ultrasound diagnostic device to the external information processing device. In S38, the ultrasound image is processed by the specific external AP. As a result, an external image representing the processing result is generated. In S40, the external image and display conditions are transferred from the external information processing device to the ultrasound diagnostic device. The display conditions are generated by the specific external AP. The display conditions may be generated by another module in the external information processing device.

[0068] In S42, assuming the selected specific screen layout, the actual display position (display coordinates) at which the external image is displayed is calculated based on the display conditions, and the actual display size of the external image is also calculated. In the display coordinate system, the external image having the actual display size is placed at the actual display position within the specific display area. As a result, a composite image including the external image is generated, and the composite image is displayed on the screen. S44 shows a repeating operation when the external image is a moving image, that is, the repeated generation and display of the composite image.

[0069] 10 shows a first display example. A composite image 120 generated according to a specific screen layout is displayed on the screen. The specific screen layout includes a plurality of display areas E1 to E4. Display area E1 is an image display area in which an ultrasound image is displayed. The ultrasound image is, for example, a cross-sectional image that changes in real time, that is, a moving image.

[0070] The display area E2 is an image display area, in which an external image 124 is displayed. In the illustrated example, the external image 124 is displayed so that the center point of the external image 124 coincides with the center point 126 of the display area E2. The width Wa of the external image 124 coincides with the width W1 of the display area E2. The external image 124 has a rectangular mark 128 surrounding the detected lesion. In the illustrated example, the external image 124 is also a cross-sectional image that changes in real time, that is, a moving image. Of course, a still image may be displayed as the external image.

[0071] 11 shows a second display example. A composite image 130 generated according to a specific screen layout is displayed on the screen. The specific screen layout includes a plurality of display areas E1 to E8. Display area E2 is an image display area, in which an ultrasound image is displayed.

[0072] The display area E6 is an information display area, and displays an external image 132. In the illustrated example, an upper right corner point 134 of the display area E6 coincides with an upper right corner point of the external image 132. The external image 134 includes a text image.

[0073] 12 shows a composite image 136 generated according to a specific screen layout. The specific screen layout includes a plurality of display areas E1 to E6. Display area E2 is an image display area in which an ultrasound image is displayed.

[0074] The display area E3 is also an image display area, and a first external image 140 is displayed therein. The first external image 140 includes a rectangular mark 142 surrounding the detected lesion. In addition, a second external image 144 is also displayed in the display area E3. Specifically, the second external image 144 is superimposed and displayed so as to cover the lower right corner of the first external image. When important information is hidden when the second external image 144 is displayed, the actual display position of the second external image may be automatically changed. Alternatively, the second external image 144 may be displayed semi-transparently.

[0075] Next, display update control will be described with reference to Fig. 13 and Fig. 14. Fig. 13 shows an example of operation when the synchronous method is selected, and Fig. 14 shows an example of operation when the asynchronous method is selected.

[0076] In FIG. 13, (a) shows storage of a composite image in a secondary buffer memory in the ultrasound diagnostic device. (b1) shows storage of an ultrasound image USi in a primary buffer memory in the ultrasound diagnostic device. (b2) shows storage of a first external image Ai in the primary buffer memory, and (b3) shows storage of a second external image Bi in the primary buffer memory. (c1) shows processing A of a first external AP and generation of a first external image Ai in an external information processing device. (c2) shows processing B of a second external AP and generation of a second external image Bi in an external information processing device.

[0077] At timing t1, the first and second external APs start processing A and B of the ultrasound image USi. At timing t2, the first external image Ai is transferred to the primary buffer memory. At timing t3, the second external image Bi is transferred to the primary buffer memory.

[0078] After that, when the second external image Bi is completely stored (see reference numeral 150), at timing t4, the ultrasound image USi, the first external image Ai, and the second external image Bi are transferred from the primary buffer memory to the secondary buffer memory all at once (see reference numeral 148). This updates the entire composite image on the secondary buffer memory. As indicated by reference numeral 152, the composite image read out from the secondary buffer memory is displayed on the display at a constant display rate.

[0079] As described above, when the synchronous method is selected, the multiple main images constituting the composite image are updated simultaneously. In particular, when the first external image Ai and the second external image Bi are generated in parallel in the external information processing device, the two displayed external images Ai and Bi are updated together based on the later generation timing. For example, when the temporal relationship between the contents of the first external image Ai and the second external image Bi is important, the synchronous method is selected.

[0080] In Fig. 14, (a) to (c2) have already been described. In Fig. 14, at timing t1, the first and second external APs start processing A and B of the ultrasound image USi. At timing t2, the ultrasound image USi is updated, and upon completion (see reference numeral 154), at timing t3, a new ultrasound image is transferred from the primary buffer memory to the secondary buffer memory. Reference numeral 160 indicates a partial update of the composite image.

[0081] At timing t4, the first external image Ai is transferred to the primary buffer memory. After completion of the transfer (see reference numeral 156), at timing t5, the first external image Ai is transferred from the primary buffer memory to the secondary buffer memory. At this time, the composite image in the secondary buffer memory is partially updated.

[0082] At timing t6, the second external image Bi is transferred to the primary buffer memory. After completion of the transfer (see reference numeral 158), at timing t7, the second external image Bi is transferred from the primary buffer memory to the secondary buffer memory. At this time, the composite image on the secondary buffer memory is partially updated.

[0083] Just before timing t7, the ultrasound image USi in the primary buffer memory is updated, and after the update, the new ultrasound image USi is transferred from the primary buffer memory to the secondary buffer memory. As indicated by reference numeral 162, the composite image read from the secondary buffer memory is displayed on the display at a constant display rate.

[0084] As described above, when the asynchronous method is selected, the images constituting the composite image are updated independently. In particular, the first external image Ai and the second external image Bi generated by the external information processing device are updated independently and early. For example, the asynchronous method is selected when the temporal relationship between the contents of the first external image Ai and the second external image Bi is not an issue and real-time display is important.

[0085] When two external APs specify two different methods, the user may be allowed to select the method, or one of the methods may be preferentially selected.

[0086] In the ultrasound diagnostic system according to the embodiment, a specific screen layout serves as a common basis for specifying print conditions in an external information processing device and for display processing in an ultrasound diagnostic device. That is, the external information processing device specifies display conditions on the premise of a specific screen layout. Meanwhile, the ultrasound diagnostic device calculates an actual display position for displaying an external image according to the display conditions on the premise of a specific screen layout. With this mechanism, when an external image is displayed on a display device of the ultrasound diagnostic device, it is possible to rationally link the external information processing device and the ultrasound diagnostic device. Furthermore, according to the ultrasound diagnostic system according to the embodiment, since the update conditions can be specified by an external AP, update control suited to the function and nature of the external image is applied. [Explanation of symbols]

[0087] 10 ultrasound diagnostic device, 12 external information processing device, 24 information processing unit (processor), 26 memory unit, 32 layout management unit, 33 selection unit, 34 display processing unit, 36 size adjuster, 38 coordinate calculator, 40 image layout unit, 41 update controller, 48 information processing unit (processor), 54 external AP.

Claims

1. A processor and a display, The processor, Select a specific screen layout from multiple screen layouts, Sending an ultrasonic image generated by transmitting and receiving ultrasonic waves to an external information processing device; receiving, from the external information processing device, an external image which is an image generated by processing the ultrasound image, and a display condition for displaying the external image, the display condition including designation of a specific display area in the specific screen layout; calculating an actual display position for displaying the external image based on the specific screen layout and the display conditions, thereby generating a composite image including the external image as an image to be displayed on the display device; 1. An ultrasonic diagnostic apparatus comprising:

2. 2. The ultrasonic diagnostic apparatus according to claim 1, the display conditions further include a designation of a display position within the specific display area; The display position is a relative position with respect to the specific display area.

1. An ultrasonic diagnostic apparatus comprising:

3. 2. The ultrasonic diagnostic apparatus according to claim 1, the display conditions further include a designation of a display size of the external image; the display size is a relative size with respect to the particular display area; The processor calculates an actual display size of the external image based on the designated display size.

1. An ultrasonic diagnostic apparatus comprising:

4. 2. The ultrasonic diagnostic apparatus according to claim 1, The display conditions further include a direct or indirect designation of the specific screen layout; the processor selects the particular screen layout based on a direct or indirect specification of the particular screen layout.

1. An ultrasonic diagnostic apparatus comprising:

5. 2. The ultrasonic diagnostic apparatus according to claim 1, The display conditions further include update conditions, The processor controls an update timing of the external image displayed on the display device according to the update condition.

1. An ultrasonic diagnostic apparatus comprising:

6. 6. The ultrasonic diagnostic apparatus according to claim 5, The processor, When a synchronization method is specified as the update condition and a plurality of external images are generated by a plurality of image processes in the external information processing device, the plurality of external images displayed on the display device are updated simultaneously; When an asynchronous method is specified as the update condition and the plurality of external images are generated by the plurality of image processes in the external information processing device, the plurality of external images displayed on the display device are updated independently of each other.

1. An ultrasonic diagnostic apparatus comprising:

7. an ultrasound diagnostic device including a processor and a display; an external information processing device connected to the ultrasonic diagnostic device; Including, The processor, Select a specific screen layout from multiple screen layouts, Sending an ultrasonic image generated by transmitting and receiving ultrasonic waves to the external information processing device; receiving, from the external information processing device, an external image which is an image generated by processing the ultrasound image, and a display condition for displaying the external image, the display condition including designation of a specific display area in the specific screen layout; calculating an actual display position for displaying the external image based on the specific screen layout and the display conditions, thereby generating a composite image including the external image as an image to be displayed on the display device; 1. An ultrasound diagnostic system comprising:

8. A program executed in an ultrasound diagnostic device having a display, The ability to select a specific screen layout from multiple screen layouts; A function of transmitting an ultrasound image generated by transmitting and receiving ultrasound to an external information processing device; A function of receiving, from the external information processing device, an external image that is an image generated by processing the ultrasound image, and a display condition for displaying the external image, the display condition including designation of a specific display area in the specific screen layout; a function of calculating an actual display position for displaying the external image based on the specific screen layout and the display conditions, thereby generating a composite image including the external image as an image to be displayed on the display device; A program comprising:

Images