Ultrasound image processing device and ultrasound image processing program

Abstract

One purpose of the present disclosure is to facilitate diagnosis based on the display of a rating value for ultrasound image data. An ultrasound diagnostic device contains a processor. The processor is configured to record a score for each element of ultrasound image data acquired sequentially based on ultrasound transmission and reception; to sequentially update and display a score graph showing the score in each instance where ultrasound images are displayed sequentially based on the acquired ultrasound image data; and to display a memory location for the sequentially acquired ultrasound image data. The memory location specifies a storage location in a memory where each element of the ultrasound image data is stored.

Description

BACKGROUND OF THE INVENTION 1. Field of the invention

[0001] The present invention relates to an ultrasound image processing device and an ultrasound image processing program and, in particular, a technique for displaying an evaluation value for ultrasound image data. 2. Description of the state of the art

[0002] An ultrasound diagnostic device was widely used as a device for observing a subject under examination. The ultrasound diagnostic device generates ultrasound image data of the subject over time by transmitting and receiving ultrasound and displays images based on the ultrasound image data sequentially on a screen.

[0003] In general, the ultrasound diagnostic device includes a cine memory that stores ultrasound image data generated sequentially over time. The images (ultrasound images) based on the ultrasound image data are displayed sequentially, and the ultrasound image data is stored in the cine memory. Consequently, the cine memory stores a series of ultrasound image data generated over a specific period in the past. The ultrasound diagnostic device designates the ultrasound image data stored in the cine memory based on user operation and displays an image based on a designated single image on the screen.

[0004] In the ultrasound diagnostic device, a process of sequentially acquiring ultrasound image data over time can be performed while transporting an ultrasound probe. This transport process results in a series of ultrasound image data for a specific area of ​​the patient being stored in the cine memory.

[0005] As part of the processing of displaying a score for the series of ultrasound image data stored in the cine memory, a scrollable graph is displayed. In this display, the ultrasound image data is read sequentially from the cine memory, and as the ultrasound images are displayed sequentially, figures representing the scores are arranged and displayed horizontally in chronological order. For example, bars, as figures extending vertically with lengths corresponding to the scores, are arranged and displayed from left to right in chronological order. Consequently, each score recorded for the area in the subject is visualized on a graph.

[0006] JP2023-90023A discloses, as a graph displayed by means of a scrollable graph, a graph (second reference image) showing a change over time of a lesion partial probability. Here, the lesion partial probability refers to a value that indicates the degree of probability that a specific area appearing in the ultrasound image is a lesion. SUMMARY OF THE INVENTION

[0007] When displaying a scrollable graph, the graph may be displayed in an address range that is narrower than the address range corresponding to the ultrasound image data stored in the cine memory. In this case, it may be difficult for the user to determine which portion of the total address range corresponding to the ultrasound image data stored in the cine memory corresponds to the address range used to display the scrollable graph. Consequently, it may be difficult for the user to determine which area of ​​the patient is represented by the ultrasound image displayed as a scrollable graph.

[0008] One purpose of the present disclosure is to facilitate diagnosis based on the display of a rating value for ultrasound image data.

[0009] An ultrasound image processing device according to the present disclosure comprises: a processor configured to capture a score value for each element of ultrasound image data acquired sequentially based on the transmission and reception of ultrasound; a score graph that sequentially updates and displays the score value in a case where ultrasound images are displayed sequentially based on the sequentially acquired ultrasound image data; and a memory card for the sequentially acquired ultrasound image data based on the transmission and reception of ultrasound, wherein the memory card indicates a storage location in a memory where each element of the ultrasound image data is stored.

[0010] In one embodiment, the memory card is a card that specifies the storage location in the memory with a frame number, the rating graph is a graph in which the rating value is displayed in conjunction with a frame number axis, and the processor is configured to display on the memory card a rating range on the frame number axis, which is provided for display in the rating graph in the form of a figure.

[0011] In one embodiment, the processor is configured to determine a range of individual image numbers from ultrasound image data whose evaluation value fulfills a lesion condition, among the ultrasound image data of multiple individual images stored in the memory, and to display the determined range on the memory card.

[0012] In one embodiment, the processor is configured to determine index ultrasound image data whose score satisfies an index condition among the ultrasound image data of multiple individual images stored in the memory, and displays an index frame point, indicating a memory location in the memory where the index ultrasound image data is stored, along with the memory card.

[0013] In one embodiment, the processor is configured to display a memory card operator figure, which is obtained by superimposing the memory card with an operator figure for designating any of the ultrasound image data from multiple individual images stored in the memory, and to display an image based on the ultrasound image data designated by the operator figure.

[0014] In one embodiment, the evaluation graph is a graph in which elongated figures extending in a first axis direction with lengths corresponding to the evaluation values ​​are displayed in a sequential arrangement in a second axis direction as the ultrasound images, while the ultrasound images are displayed sequentially based on the ultrasound image data.

[0015] In one embodiment, the evaluation value is a value that indicates the degree to which the ultrasound image specified by the ultrasound image data contains an atypical area.

[0016] In one embodiment, the processor is configured to arrange and display several of the rating graphs, which specify several different types of rating values.

[0017] In one embodiment, the different types of evaluation values ​​are at least two values ​​of a tumor category, a degree of ease of detection of a tumor border, a tumor aspect ratio, and a level of reflected ultrasound.

[0018] Furthermore, according to the present disclosure, an ultrasound image processing program causes a processor to execute a process that includes: acquiring a score value for each element of ultrasound image data acquired sequentially based on the transmission and reception of ultrasound; sequentially updating and displaying a score graph showing the score value in a case where ultrasound images are displayed sequentially based on the sequentially acquired ultrasound image data; and displaying a memory card for the sequentially acquired ultrasound image data based on the transmission and reception of ultrasound.

[0019] According to the present disclosure, it is possible to facilitate diagnosis based on the display of an evaluation value for ultrasound image data. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 is a diagram showing a configuration of an ultrasound diagnostic device. Fig. Figure 2 is a diagram showing the processing of B-mode image data acquisition. Fig. Figure 3 is a representation that shows an example of an image displayed on a screen. Fig. Figure 4 is a representation that shows an example of an image displayed on the screen. Fig. Figure 5 is a graph showing a magnified version of a screening graph. Fig. Figures 6A to 6E are diagrams that show a method for dynamically displaying a screening graph. Fig. Figure 7 is a diagram showing an example of a memory card search bar. Fig. Figure 8 is a diagram showing an image displaying a screening graph for each of several different types of rating values. Fig. Figure 9 is a graph that shows an example of a screening graph. Fig. Figure 10 is a graph that shows an image comparing screening graphs with different numbers of individual images. Fig. Figure 11 is a diagram showing B-mode image data and a lesion candidate area. Fig. Figure 12 is a diagram showing an example of a memory card search bar. DESCRIPTION OF PREFERRED EXECUTION FORMS

[0020] One embodiment of the present disclosure is described with reference to the drawings. The same components shown in several drawings are designated by the same reference numerals to simplify their description.

[0021] Fig. Figure 1 shows a configuration of an ultrasound diagnostic device 100 according to an embodiment of the present disclosure. The ultrasound diagnostic device 100 comprises a transmission unit 10, an ultrasound probe 12, a receiving unit 14, an information processing unit 20, a control unit 42, an operating unit 44 and a display 46 (display unit).

[0022] The control unit 44 can include a button, a lever, a keyboard, a mouse, and the like. The control unit 44 can be a touch panel provided on the display 46. One in Fig. The storage unit 40 shown in Figure 1 together with the ultrasound diagnostic device 100 can be a storage medium, such as a hard drive implemented in the ultrasound diagnostic device 100. Furthermore, the storage unit 40 can be a computer's storage medium on a local network or a computer's storage medium on an electrical communication line, such as the Internet.

[0023] The information processing unit 20 comprises a B-mode image generation unit 22, an image combination unit 24, a display processing unit 26, a cine memory 30, a feature analysis unit 32, and a reference image generation unit 34. The information processing unit 20 and the controller 42 can be configured, for example, by one or more computers that execute a program stored in the memory unit 40.

[0024] This means that in the ultrasound diagnostic device 100 according to the present embodiment, each process is executed by any computer. Furthermore, any computer can execute these processes using a processor as hardware, a program as software, or a combination of both. In this case, the processor is configured to execute various processes in conjunction with the program in the present embodiment and can function as any unit or means in the present embodiment. Moreover, the order in which the processes are executed by the processor is not limited to the sequence described above and can be changed as needed. Any computer can be a general-purpose computer, a specialized computer, a workstation, or any other system capable of executing any process.

[0025] The processor can be configured by one or more hardware components, and there is no restriction on the type of hardware. For example, the processor can be configured by a programmable logic device, such as a central processing unit (CPU), a microprocessor unit (MPU), or a field-programmable gate array (FPGA); a dedicated circuit for performing specific processing, such as an application-specific integrated circuit (ASIC); or hardware such as a graphics processing unit (GPU) or a neural processing unit (NPU). Furthermore, the hardware types can be a combination of different hardware types.In a case where multiple hardware components are configured to execute one or more processes of a specific processor, the multiple hardware components may be located in physically separate devices or in the same device. Furthermore, in one embodiment, the sequence of each processing operation performed by the processor is not restricted to the sequence described above and may be modified as appropriate. The hardware is configured by an electrical circuit (circuit) in which circuit elements, such as semiconductor elements, are combined.

[0026] Furthermore, the program can be software, such as firmware or microcode. Additionally, the program can be, for example, a group of program modules, and each function of these modules can be implemented by a processor configured to execute each function. The program can be a single piece of program code or multiple code segments stored on one or more non-volatile, machine-readable media (for example, a storage medium or other data storage device). The program can be divided and stored on multiple non-volatile, machine-readable media located in physically separate devices. The program code or code segment can represent any combination of a sequence of operations, a function, a subroutine, a routine, a subroutine, a module, a software package, a class, a statement, a data structure, or a program instruction.The program code or code segment can be connected to another code segment or hardware circuit by transmitting and receiving information, data, an argument, a parameter, or the contents of a memory.

[0027] The information processing unit 20 executes a program to configure each component (the B-mode image generation unit 22, the image combination unit 24, the display processing unit 26, the cine memory 30, the feature analysis unit 32, and the reference image generation unit 34) and to operate it as an ultrasound imaging device. The controller 42 can acquire information generated by each component in the information processing unit 20. Furthermore, the controller 42 can control the transmission unit 10, the receiving unit 14, and the information processing unit 20 in response to an operation of the control unit 44 by a user.

[0028] The ultrasonic probe 12 comprises several ultrasonic transducers arranged along a contact surface facing one side in the positive y-axis direction. In the present embodiment, several ultrasonic transducers are arranged in one or more columns in a major axis direction (X-axis direction). The ultrasonic transducers are arranged in one or more rows in a minor axis direction (Z-axis direction).

[0029] The transmission unit 10 outputs a transmission signal to each ultrasound transducer, and each ultrasound transducer generates an ultrasound wave in response to the transmission signal output to itself by the transmission unit 10. The transmission unit 10 adjusts a delay time of the transmission signal output to each ultrasound transducer such that the ultrasound waves emitted by the respective ultrasound transducers constructively interfere in a specific transmission beam direction. As a result, a transmission beam is formed in the transmission beam direction. The transmission unit 10 adjusts the delay time of the transmission signal output to each ultrasound transducer to change the direction of the transmission beam and scans an observation area of ​​a test subject 50 with the transmission beam.

[0030] The respective ultrasound transducers receive reflected ultrasound generated by reflection within the subject 50, convert the reflected ultrasound into a received signal (an electrical signal), and output the received signal to the receiver 14. The receiver 14 adjusts the delay time of each received signal output by each ultrasound transducer and performs synthesis processing, such as phase addition, so that multiple received signals, based on ultrasound waves arriving from the same direction as the transmission beam, constructively interfere with each other, thereby generating received beam data. The received beam data is data based on the ultrasound wave reflected from the direction of the transmission beam.As a result, a directivity effect is created for the ultrasound wave arriving from the direction in which the transmission beam is directed, and a receiving beam is formed in the direction in which the transmission beam is directed. In the following description, the transmission beam and the receiving beam are collectively referred to as transmission and receiving beams.

[0031] The receiver unit 14 generates receive beam data corresponding to each direction of the transmit and receive beams scanned over the subject 50 and outputs the receive beam data to the B-mode imaging unit 22. The B-mode imaging unit 22 repeatedly scans the subject's observation area with the transmit and receive beams over time and generates B-mode image data sequentially as the ultrasound image data over time. The B-mode imaging unit 22 outputs the B-mode image data to the image combining unit 24 and the cine memory 30. The B-mode image data is assigned a frame number as information for identifying the B-mode image data and then stored in the cine memory 30.

[0032] The ultrasound diagnostic device 100 according to the present embodiment has operating modes of a real-time display mode and a freeze mode. The real-time display mode is an operating mode in which the B-mode image is displayed in real time on the display 46, the display unit. That is, the real-time display mode is an operating mode in which the B-mode images are displayed sequentially on the display 46 over time, based on the B-mode image data generated sequentially over time.

[0033] The image combination unit 24 performs image quality adjustment processing, such as brightness adjustment, contrast adjustment, and contour enhancement, on the B-mode image data and outputs the B-mode image data to the display processing unit 26 after this processing. The display processing unit 26 sequentially converts the B-mode image data output by the image combination unit 24 into a time-lapse video signal and outputs the video signal to the display 46. The display 46 shows a real-time B-mode image based on the video signal.

[0034] In real-time display mode, the B-mode image data output by the B-mode image generation unit 22 is stored in the cine memory 30 for a specific number of frames in the past, including the most recent B-mode image data. As the most recent B-mode image data is generated, the B-mode image data stored in the cine memory 30 can first be deleted from the cine memory 30.

[0035] Freeze mode is an operating mode in which images based on the B-mode image data of multiple frames stored in the Cine Memory 30 are displayed on the screen 46. In freeze mode, playback can be performed, in which the B-mode image data of a multitude of frames stored in the Cine Memory 30 are selected and displayed individually in chronological order. Additionally, rewind playback can be performed, in which the B-mode image data of multiple frames stored in the Cine Memory 30 are selected and displayed individually in reverse chronological order. Furthermore, one of the B-mode image data from multiple frames stored in the Cine Memory 30 can be selected, and a freeze frame based on the selected B-mode image data of that frame can be displayed.

[0036] Immediately before the operating mode switches from real-time display mode to freeze mode, the user can, for example, move the observation area linearly by manually transporting the ultrasound probe 12 linearly in the direction of the secondary axis (z-axis).

[0037] Fig. Figure 2 conceptually illustrates the processing of B-mode image data acquisition in a case where the ultrasound probe 12 is transported linearly at a constant velocity over the subject 50 in the secondary axis direction during the real-time display mode. The ultrasound probe 12 is transported while an observation area 52, scanned by the transmit and receive beam, is oriented in one direction along an xy-plane. An axis extending in a horizontal direction is a time axis (t-axis) or a z-axis, and the xy-plane is defined perpendicular to the time axis. A plane parallel to the xy-plane is scanned with an ultrasound beam, so that the B-mode image specified by each B-mode image data point is propagated parallel to the xy-plane, and multiple B-mode images are linked together along the time axis.

[0038] In this process, the ultrasound diagnostic device 100 operates in real-time display mode before time t = 0, and a process of setting the operating mode to freeze mode is performed at time t = 0. During time t = 0 back to time t = -(n-1)·Δ, the B-mode image data is acquired in each time interval Δ and stored in the cine memory 30. Each of the rectangles B0 to Bn-1, arranged parallel to the xy-plane with time interval Δ on the time axis, conceptually represents the B-mode image specified by the B-mode image data.

[0039] In freeze mode, the playback display of the B-mode image data of several individual images stored in the Cine memory 30 can be performed by the user by operating the control unit 44.

[0040] Fig. Figure 3 shows an example of an image displayed on the screen 46 during operation of the freeze mode. The image displayed on the screen 46 shows a search bar 60 for designating a single-image number and a B-mode image 54 corresponding to the single-image number designated by the search bar 60. The search bar 60 is a control element for designating any ultrasound image data from one of several single images stored in the cine memory 30. The search bar 60 includes a pointer 64 and a ribbon-shaped Fig. 62, which extends to the left and right to indicate the individual image number. A horizontal position on the ribbon-shaped Fig. 62 specifies a virtual storage location in the Cine memory 30. The storage location is represented by a frame number.

[0041] In the present embodiment, the cine memory stores 30 B-mode images from 100,000 individual frames with frame numbers ranging from 0 to 99999. A left end of the ribbon-shaped Fig. 62 indicates the minimum value 0 of the frame number, and a right end indicates the maximum value 99999 of the frame number. A position of pointer 64 on the band-shaped Fig. 62 indicates the single image number, and the single image number to be designated is changed by moving the pointer 64 to the left and right with a cursor or the like.

[0042] At the in Fig. The search bar 60 shown in Figure 3 indicates that a notation of "12345 / 99999" on the left indicates that a B-mode image corresponding to frame number 12345 is displayed among frame numbers 0 to 99999. Furthermore, a notation of "123.45 / 999.9s" on the right is a frame number converted to time (seconds). In the case of the Fig. In the example shown, frame number 12345 is indicated by pointer 64, and B-mode frame 54, which corresponds to frame number 12345, is displayed.

[0043] Moving pointer 64 from left to right displays the B-mode images 54 from the past to time t = 0, and the playback display is performed. Moving pointer 64 from right to left displays the B-mode images one frame at a time in the past, and the rewind playback display is performed.

[0044] The process performed by the ultrasound diagnostic device 100 for such a display is described below with reference to Fig. As described in section 1, the reference image generation unit 34 generates search bar image data for displaying the search bar 60 and outputs the search bar image data to the image combination unit 24. The image combination unit 24 outputs display image data, which includes at least the search bar 60, to the display processing unit 26. The display processing unit 26 generates a video signal based on the display image data and outputs the video signal to the display 46. The display 46 displays an image containing the search bar 60 based on the video signal.

[0045] The user, referring to the search bar 60, designates a frame number by moving the pointer 64 in the search bar 60. The image combination unit 24 reads B-mode image data corresponding to the designated frame number from the cine memory 30. The image combination unit 24 generates display image data specifying the B-mode image and the search bar 60, based on the B-mode image data and the search bar image data output by the reference image generation unit 34, and outputs the display image data to the display processing unit 26. The display processing unit 26 generates a video signal based on the display image data and outputs the video signal to the display 46. The display 46 shows a display image containing the B-mode image and the search bar 60, based on the video signal.

[0046] When operating in freeze mode, instead of the one in Fig. The image shown in 3 contains the B-mode image 54, a screening graph 72, and a memory card search bar 70, as shown in Fig. As shown in Figure 4, the display will show Figure 46. Screening graph 72 is a scoring graph that uses a frame number on a horizontal axis and a B-mode image score on a vertical axis, with the score represented by a bar chart on the frame number axis. In other words, screening graph 72 is a scoring graph where the score is displayed in conjunction with the frame number axis. The score indicates the degree to which the image, as specified by the B-mode image data, contains an area that indicates a lesion as an atypical region.

[0047] The display of a scrollable graph described above can be performed on the screening graph 72. That is, the screening graph 72, as the evaluation graph, can be a graph in which elongated figures extending in a vertical axis direction (first axis direction) with lengths corresponding to the evaluation values ​​are displayed in a sequential arrangement in a horizontal axis direction (second axis direction), while the images based on the B-mode image data are displayed sequentially.

[0048] On the in Fig. In the screening graphs 72 shown, rod-shaped elements 76 are arranged as elongated figures indicating the evaluation values, in chronological order corresponding to the B-mode images of the multiple frames virtually arranged on the frame number axis. The rod-shaped element 76 is a figure extending in the vertical axis direction.

[0049] The memory card search bar 70 is a memory card control figure obtained by superimposing a memory card with the search bar 60 (control figure) described above. The memory card is a diagram that conceptually shows a storage location of the B-mode image data in the cine memory 30 with a frame number. In the present embodiment, the memory card is displayed on the display 46 as the memory card search bar 70 in such a way that it is superimposed on the search bar 60 (control figure). Since specific B-mode image data is stored in the cine memory 30 or read from it by determining a frame number, it can be conceptually considered that the storage location of the B-mode image data is represented by the frame number. In the present embodiment, a range of frame numbers intended for display on the screening graph 72 is shown on the memory card search bar 70.

[0050] At the in Fig. In the memory card search bar 70 shown in Figure 4, the pointer 64 is indicated by a triangle with its pointer facing upwards to designate the frame number of the B-mode image to be displayed on the screen 46. Details of the functions of the memory card search bar 70 are described below.

[0051] Fig. Figure 5 shows the screening graph 72 in an enlarged view. In the present embodiment, the larger the score, the greater the degree to which the lesion is shown on the B-mode image. A dashed line indicating a threshold Th is shown, based on the score, as a criterion for determining the probability that a tumor appearing on the B-mode image is malignant. In this example, a malignant tumor may appear on the B-mode image corresponding to the frame number where the score exceeds the threshold Th.

[0052] Fig. Figures 6A to 6E schematically illustrate a method for dynamically displaying the screening graph 72. In this display method, in a case where images are displayed sequentially based on B-mode image data acquired sequentially over time, the screening graph 72 is updated and displayed sequentially. Evaluation values ​​for n individual images are displayed on the screening graph 72. In a case where the B-mode image data of N individual images are stored in the cine memory 30, evaluation values ​​for n individual images from the N individual images are displayed on the screening graph 72. Here, N and n are positive integers, and N is greater than n.

[0053] A rating indicator 74, extending vertically, is shown on the screening graph 72. The bar-shaped element 76, onto which the rating indicator 74 overlaps, can be seen through the rating indicator 74. The rating indicated at a position of the rating indicator 74 specifies the rating of the B-mode image 54 displayed on the display 46. Since the B-mode image 54 displayed on the display 46 is designated by the pointer 64 in the memory card search bar 70, the rating indicator 74 indicates the rating of the B-mode image 54 designated by the pointer 64. The rating indicator 74 indicates a j-th rating value, counted from the left, with the leftmost value indexed as 0, and this rating value corresponds to the rating value of the B-mode image 54 displayed on display 46. Here, j is an integer of 0 or more.

[0054] For example, it moves, as in Fig. 6A and Fig. Figure 6B shows a case where playback is initiated by moving pointer 64 in the memory card search bar 70 from frame number 0 to the right, with the rating indicator 74 on the screening graph 72 moving to the right until the frame number n-1 indicated by pointer 64 is reached. The respective rating values ​​corresponding to the B-mode image data for frame numbers 0 to j are shown on the left side of rating indicator 74, including rating indicator 74 itself.

[0055] In a case where the pointer 64 in the memory card search bar 70 is moved to the right, so that the single image number indicated by the pointer 64 becomes n, the rating indicator 74 moves to the leftmost position of the screening graph 72, as shown in Fig. 6C is shown. Then the evaluation value of the single image number n is shown at a left end of the screening graph 72. In a case where the pointer 64 is moved further to the right, as in Fig. As shown in Figure 6D, the rating indicator 74 is also moved to the right, and the respective rating values ​​corresponding to the B-mode image data of frame numbers n to n+j are displayed on the left side of rating indicator 74, including rating indicator 74 itself, in an overridden manner. A state in which the respective rating values ​​corresponding to the B-mode image data of frame numbers j+1 to n-1 are displayed is maintained on the right side of rating indicator 74, except for rating indicator 74 itself.

[0056] In a case where the pointer 64 in the memory card search bar 70 is again moved to the right end, so that the pointer 64 reaches the frame number 2n, the rating indicator 74 moves to the left end of the screening graph 72, as shown in Fig. 6E is shown, and the rating value of frame number 2n is displayed on the far left side of the screening graph 72. In a case where the pointer 64 is moved further to the right, the rating indicator 74 is also moved to the right, and the respective ratings corresponding to the B-mode image data of frames 2n to 2n + j are displayed on the left side of the rating indicator 74, including the rating indicator 74 itself, in an overridden manner. A state in which the respective ratings corresponding to the B-mode image data of frames n + j + 1 to 2n - 1 are displayed is maintained on the right side of the rating indicator 74, except for the rating indicator 74 itself.

[0057] In this way, if pointer 64 in the memory card search bar 70 is moved clockwise, the rating indicator 74 of the screening graph 72 also moves clockwise. Each time pointer 64 moves clockwise and the frame number reaches a multiple of n, the rating indicator 74 returns discontinuously to the left end. If the rating indicator 74 is at an intermediate position on the frame number axis of the screening graph 72, a new rating is displayed on the left side of the rating indicator 74, including the rating indicator 74 itself, in an overwritten manner after the rating indicator 74 returns discontinuously to the left end.The display of the valuation value, before the valuation value indicator 74 discontinuously returns to the left end, is maintained on the right side of the valuation value indicator 74, with the exception of the valuation value indicator 74 itself.

[0058] Here, the display is shown in a case where the pointer 64 of the memory card search bar 70 is moved to the right. In a case where the pointer 64 is moved to the left, that is, in a case of rewind playback, the bar-shaped elements 76, which correspond to frame numbers sequentially designated by the movement of the pointer 64, are displayed in a sequential arrangement from left to right. That is, the bar-shaped elements 76, which correspond to the frame numbers sequentially designated by the pointer 64, are displayed in a sequential arrangement from left to right, regardless of the direction in which the pointer 64 moves.The valuation indicator 74 moves from left to right together with the display of the latest rod-shaped element 76 regardless of the direction in which the pointer 64 moves, and returns discontinuously to the left end each time it reaches the right end.

[0059] The process performed by the ultrasound diagnostic device 100 for displaying the screening graph 72 is described below with reference to Fig. As described in Section 1, the feature analysis unit 32 receives a rating for each element of the B-mode image data of the N individual frames stored in the cine memory 30. The rating can be, for example, a category of tumor appearing in the B-mode image (hereinafter referred to simply as a category), a degree of ease of detection of a tumor margin appearing in the B-mode image (hereinafter referred to as a margin sharpness), an aspect ratio of the tumor appearing in the B-mode image, or a level of reflected ultrasound. The level of reflected ultrasound includes a level of ultrasound directly reflected by the tumor, a level of a posterior echo, and the like. The feature analysis unit 32 can store the rating itself or can store the rating in the memory unit 40 via the controller 42.

[0060] The feature analysis unit 32 outputs the evaluation value corresponding to the single-image number designated by pointer 64 in the memory card search bar 70 to the reference image generation unit 34. The reference image generation unit 34 generates screening image data specifying the screening graph 72, based on the single-image number designated by pointer 64 in the memory card search bar 70 and the evaluation value output by the feature analysis unit 32, and outputs the screening image data to the image combination unit 24. In addition, the reference image generation unit 34 generates search bar image data specifying the memory card search bar 70 and outputs the search bar image data to the image combination unit 24.

[0061] The image combination unit 24 reads the B-mode image data corresponding to the single-frame number designated by the pointer 64 in the memory card search bar 70 from the cine memory 30. Based on the B-mode image data and the search bar and screening image data output by the reference image generation unit 34, the image combination unit 24 generates display image data specifying the B-mode image 54, the memory card search bar 70, and the screening graph 72. The display processing unit 26 generates a video signal based on the display image data and outputs the video signal to the display 46. The display 46 displays an image containing the B-mode image 54, the memory card search bar 70, and the screening graph 72, based on the video signal.

[0062] As described above, the ultrasound diagnostic device 100 displays the evaluation values ​​for n individual frames of the B-mode image data from the B-mode image data of the N individual frames stored in the cine memory 30 on the screening graph 72. With this display, it can be difficult for the user to determine which B-mode image data of the N individual frames of B-mode image data stored in the cine memory 30 corresponds to the evaluation value displayed on the screening graph 72.

[0063] Therefore, according to the present embodiment, the reference image generation unit 34 generates search bar image data for displaying the memory card search bar 70, as shown in Fig. 4 shown, instead of the one in Fig. The search bar 60 shown in Figure 3 outputs the search bar image data to the image combination unit 24. The memory card search bar 70 is obtained by inserting a memory card, which specifies a range of the individual image numbers intended for display on the screening graph 72, onto which in Fig. The search bar 60 shown in Figure 3 is overlaid. In addition to the B-mode image 54 and the screening graph 72, a display image containing the memory image search bar 70 is shown on the display 46.

[0064] Fig. Figure 7 shows an example of the memory card search bar 70. In the memory card search bar 70, a lower limit scale 66L and an upper limit scale 66H are shown on the band-shaped Fig. 62 is marked. The lower limit scale 66L indicates the minimum value of the frame numbers at which the score is shown on the screening graph 72, and the upper limit scale 66H indicates the maximum value of the frame numbers at which the score is shown on the screening graph 72. A range from the frame number indicated by the lower limit scale 66L to the frame number indicated by the upper limit scale 66H is a scoring range within which the score is shown on the screening graph 72. As described above, the lower limit scale 66L and the upper limit scale 66H are numbers that indicate on the memory card the scoring range on the frame number axis intended for display on the screening graph 72.

[0065] In the band-shaped Fig. 62 is an attention area 68 in which the rating value exceeds the threshold Th, shown in an area corresponding to the rating area of ​​the memory card search bar 70. The attention area 68 can be seen in the band-shaped Fig. Attention area 62 may be displayed differently than other areas. For example, attention area 68 may be colored differently from the other areas or may be filled with a pattern that differs from the other areas. The display of attention area 68 indicates that the score for the B-mode image data corresponding to the frame number belonging to attention area 68 exceeds the threshold Th. As in Fig. As shown in Figure 7, 70 different fill patterns can be applied to the attention area 68 within the evaluation area and the attention area 68 outside the evaluation area in the memory card search bar.

[0066] As described above, in the ultrasound diagnostic device 100 according to the present embodiment, a range of frame numbers of the ultrasound image data whose score meets a lesion condition is determined from among the B-mode image data of several frames stored in the cine memory 30. Here, the lesion condition is a condition where the score exceeds the threshold Th. The range of frame numbers of the ultrasound image data whose score exceeds the threshold Th is then displayed as the attention area 68 on the memory card search bar 70.

[0067] Display 46 can show the screening graph 72 for each of several different types of rating values. Fig. Figure 8 shows an example where screening graphs 72 for the category, edge sharpness, and aspect ratio are arranged and displayed vertically on the display 46. Although not shown in the drawing, these screening graphs 72 can be displayed on the display 46 together with the B-mode image designated by the memory card search bar 70.

[0068] In a case where the screening graph 72 is displayed for each of several different types of rating scores, one of the screening graphs 72, in which the lower limit scale 66L, the upper limit scale 66H, and the attention range 68 (hereinafter referred to as a memory card element) are displayed, can be selected by operating the control unit 44 via the memory card search bar 70. Furthermore, the type of rating score (the rating score to be displayed on the memory card) of the screening graph 72 whose memory card is displayed on the memory card search bar 70 can be displayed on the memory card search bar 70. In the case of the Fig. In example 8, the rating value of the display target for memory card is given as a category.

[0069] On the screening graph 72, the bar-shaped element 76 with a rating greater than an attention threshold Tha can be displayed differently than the bar-shaped element 76 with a rating equal to or less than the attention threshold Tha. Here, the attention threshold Tha is a value greater than the threshold Tha. For example, the bar-shaped element 76 with a rating greater than the attention threshold Tha can be displayed in a color or thickness that differs from that of the bar-shaped element 76 with a rating equal to or less than the attention threshold Tha.Furthermore, the brightness of the rod-shaped element 76 can be made greater with a rating value greater than the attention threshold Tha than the brightness of the rod-shaped element 76 with a rating value equal to or less than the attention threshold Tha. Fig. Figure 9 shows part of such a screening graph 72. In the one in Fig. In example 9, the rod-shaped element 76 with a rating greater than the attention threshold Tha is displayed with a different thickness than the rod-shaped element 76 with a rating equal to or less than the attention threshold Tha. The rod-shaped element 76 with a rating greater than the attention threshold Tha can also be displayed with a different brightness or color than the rod-shaped element 76 with a rating equal to or less than the attention threshold Tha.

[0070] The number of individual images or the duration of the individual images to be displayed on the screening graph 72 can be changed by operating the control unit 44. In an upper part and a lower part of Fig. Figure 10 shows screening graphs 72 with different numbers of frames for comparison. The number of frames in the lower part of the screening graph 72 is 1.5 times the number of frames in the upper part. One of the upper and one of the lower screening graphs 72 can be displayed on screen 46. In a case where the B-mode image data is acquired at a frame rate of 100 frames per second, and the upper screening graph 72 has a duration of 10 seconds, the lower screening graph 72 has a duration of 15 seconds.

[0071] The ultrasound diagnostic device 100 according to the present embodiment can have a function of extracting B-mode image data, in which a lesion is likely to appear, from the B-mode image data of several individual images stored in the cine memory 30, and of displaying an image based on the B-mode image data. This function can be implemented by the technique disclosed in JP2021-108842A.

[0072] In a lower part of Fig. Figure 11 shows the B-mode image data from multiple frames stored in the cine memory 30, and candidate lesion areas 90-1 to 90-3 are shown conceptually. Candidate lesion areas 90-1 to 90-3 correspond to areas of tissue in the subject 50 that are likely to be lesions. That is, candidate lesion areas 90-1 to 90-3 are atypical areas where pixel values ​​of pixels forming the B-mode image differ from an average pixel value of surrounding pixels. Candidate lesion areas 90-1 to 90-3 can be defined by a feature recognition process for area detection in the B-mode image, as described below.

[0073] In the lower part of Fig. The B-mode image data stored in the cine memory 30 are conceptually represented by a planar B-mode image. Each B-mode image 86 is acquired in a case where the ultrasound probe 12 is moved linearly over the subject 50 at a constant speed during operation in real-time display mode. An axis extending in the horizontal direction is a time axis (t-axis), and an xy-plane is defined perpendicular to the time axis. A plane parallel to the xy-plane is scanned with an ultrasound beam, so that each B-mode image propagates parallel to the xy-plane, and several of the B-mode images 86 are linked together along the time axis.A B-mode image 86-S on the far left corresponds to the earliest B-mode image data stored in the Cine Memory 30, and a B-mode image 86-E on the far right corresponds to the latest B-mode image data stored in the Cine Memory 30.

[0074] In an upper part of Fig. Figure 11 schematically shows each B-mode image that can be displayed on the display 46 in freeze mode. When the ultrasound diagnostic device 100 is set to freeze mode, an image based on the last B-mode image 86-E stored in the cine memory 30 is displayed on the display 46. When a B-mode image 86-1 is designated by operating the memory card search bar 70, a B-mode image 88-1 is displayed on the display 46. Similarly, when a B-mode image 86-2 or 86-3 is designated, a B-mode image 88-2 or 88-3 is displayed on the display 46.

[0075] The in Fig. 1 Feature analysis unit 32 shown performs a region detection process of detecting a feature region in the B-mode image on each B-mode image data and obtains lesion candidate region data that indicate a lesion candidate region on each B-mode image.

[0076] Feature analysis unit 32 contains the above-described evaluation value in the lesion candidate area data obtained for each B-mode image. Feature analysis unit 32 stores the lesion candidate area data obtained for each B-mode image in storage unit 40 via controller 42.

[0077] Feature analysis unit 32 can define the lesion candidate area from the B-mode image using the following binarization process. Feature analysis unit 32 performs a binarization process of setting a pixel value to 1 in an area where a pixel value exceeds a predetermined binarization threshold, and setting a pixel value to 0 in an area where a pixel value is equal to or less than the binarization threshold. The area where the pixel value is 0 as a result of the binarization process is defined as the lesion candidate area.

[0078] Feature analysis unit 32 can define the lesion candidate area by the following pattern comparison. Feature analysis unit 32 reads reference data from memory unit 40, which specifies patterns of several types of lesion candidate areas exhibiting different pixel values, sizes, shapes, and the like. Feature analysis unit 32 acquires the reference data and obtains a degree of similarity between each of the patterns of the several types of lesion candidate areas and the B-mode image. The degree of similarity can be a correlation value obtained by calculating a correlation between an image showing a pattern of the lesion candidate area and the B-mode image. Feature analysis unit 32 defines the lesion candidate area in the B-mode image based on a pattern where the correlation value exceeds a predetermined value.

[0079] Feature analysis unit 32 can define the lesion candidate area by the following area subdivision. Area subdivision is a process of extracting an area with predetermined features, such as shape, size, and pixel value, from the B-mode image. Feature analysis unit 32 reads the reference data necessary for area subdivision from memory unit 40. Feature analysis unit 32 defines the lesion candidate area in the B-mode image by area subdivision based on the reference data.

[0080] Feature analysis unit 32 receives a lesion candidate single-image number range, which is a range of single-image numbers in which the lesion candidate area appears. A single-image number for which the score is maximized within the lesion candidate single-image number range is retained as an index (representative) single-image number. In the Fig. In the example shown in Figure 11, the feature analysis unit 32 receives a lesion candidate single-image number range for the lesion candidate areas 90-1 to 90-3 and receives an index single-image number for each of the lesion candidate areas 90-1 to 90-3. The obtained index single-image numbers are single-image numbers for the B-mode images 86-1 to 86-3.

[0081] Fig. Figure 12 shows a memory card search bar 70A with a single-frame index point 78. The single-frame index point 78 indicates a position on a single-frame number axis that corresponds to the single-frame index number.

[0082] As described above, B-mode image data whose score meets an index condition are identified as index ultrasound image data among the ultrasound image data of multiple frames stored in Cine Memory 30. Here, the index condition is a condition where the score is maximized within the lesion candidate frame number range. The index frame point 78, which specifies a storage location for the index ultrasound image data in Cine Memory 30 with a frame number, is displayed along with the memory card.

[0083] In a case where the Fig.When the memory card search bar 70A shown in Figure 12 is displayed, the B-mode image corresponding to the index frame number is shown on display 46 by adjusting the pointer 64 to the position of the index frame point 78. Consequently, in a case where there are multiple lesion candidate areas in the subject 50, it is easy to perform an operation of displaying the B-mode image of the frame number, maximizing the score, in each lesion candidate area.

[0084] The present invention can also be applied to a program and a program product. An ultrasound image processing program according to the embodiment of the present invention causes a processor to execute a process comprising: acquiring a rating value for each element of ultrasound image data acquired sequentially based on the transmission and reception of ultrasound; sequentially updating and displaying a rating graph showing the rating value in a case where ultrasound images are displayed sequentially based on the sequentially acquired ultrasound image data; and displaying a memory card for the sequentially acquired ultrasound image data based on the transmission and reception of ultrasound.The ultrasound image processing program can be provided by storing it on a storage medium, such as a memory card, a USB drive, or a CD-ROM. Reference symbol list 10 transmission unit 12 ultrasound probe 14 receiver units 20 Information processing unit 22 B-mode image generation unit 24 image combination unit 26 Display processing unit 30 Cine memory 32 Feature analysis unit 34 Reference image generation unit 40 storage units 42 Control 44 Control unit 46 ads 50 subjects 54, 86-S, 86-1 to 86-3, 86-E, 88-1 to 88-3 B-mode image 60 Search bar 62 ribbon-shaped figure 64 hands 66 lower limit scale 66H upper limit scale 68 Attention area 70 Memory card search bar 72 Screening Graph 74 Assessment Value Indicator 76 rod-shaped element 90-1 to 90-3 lesion candidate area 100 ultrasound diagnostic devices QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] JP 2023-90023

[0006] JP 2021-108842

[0071]

Claims

[1] Ultrasound image processing device comprising: a processor configured to a rating value was recorded for each element of ultrasound image data that was sequentially acquired based on the transmission and reception of ultrasound. a rating graph that sequentially updates and displays the rating value in a case where ultrasound images are displayed sequentially based on the sequentially acquired ultrasound image data, and a memory card displays the ultrasound image data, which was sequentially acquired based on the transmission and reception of the ultrasound, where the memory card specifies a storage location in a memory where each element of the ultrasound image data is stored. [2] Ultrasound image processing device according to claim 1, where the memory card is a card that specifies the storage location in the memory with a single image number, The rating graph is a graph in which the rating value is displayed in conjunction with an axis of individual image numbers, and The processor is configured to display on the memory card a rating area on the frame number axis, which is intended to be displayed in the rating graph in the form of a figure. [3] Ultrasound image processing device according to claim 2, wherein the processor is configured to determine a range of frame numbers of ultrasound image data whose evaluation value satisfies a lesion condition, among the ultrasound image data of multiple frames stored in the memory and to display the determined range on the memory card. [4] Ultrasound image processing device according to claim 2 or 3, wherein the processor is configured such that it: Index ultrasound image data, whose score meets an index condition, is determined among the ultrasound image data of multiple individual images stored in the memory, and an index pixel that indicates a storage location in the memory where the index ultrasound image data is stored, along with the memory card. [5] Ultrasound image processing device according to any one of claims 1 to 4, wherein the processor is configured to display a memory card operator figure obtained by superimposing the memory card with an operator figure for designating arbitrary ultrasound image data of multiple individual images stored in the memory, and to display an image based on the ultrasound image data designated by the operator figure. [6] Ultrasound image processing device according to any one of claims 1 to 5, wherein the evaluation graph is a graph in which elongated figures extending in a first axis direction with lengths corresponding to the evaluation values ​​are displayed in a sequential arrangement in a second axis direction as the ultrasound images, while the ultrasound images are displayed sequentially based on the ultrasound image data. [7] Ultrasound image processing device according to any one of claims 1 to 6, wherein the evaluation value is a value indicating a degree to which the ultrasound image specified by the ultrasound image data contains an atypical area. [8] Ultrasound image processing device according to any one of claims 1 to 7, wherein the processor is configured to arrange and display several of the evaluation graphs that indicate several different types of evaluation values. [9] Ultrasound image processing device according to claim 8, wherein the different types of evaluation values ​​are at least two values ​​of a tumor category, a degree of ease of detection of a tumor border, a tumor aspect ratio and a level of reflected ultrasound. [10] Storage medium that stores an ultrasound image processing program to cause a processor to execute a process comprising: Capturing a rating for each element of ultrasound image data, acquired sequentially based on ultrasound transmission and reception; Sequential updating and display of a rating graph showing the rating value in a case where ultrasound images are displayed sequentially based on the sequentially acquired ultrasound image data; and Displaying a memory card for the ultrasound image data, which was sequentially acquired based on the transmission and reception of the ultrasound.

Images