Ultrasound imaging system and method for controlling an ultrasound imaging system

Abstract

The present disclosure provides an ultrasound imaging system and a method for controlling the ultrasound imaging system, the method comprising: obtaining a cine image comprising a plurality of image frames by aligning an elasticity image and an elasticity reliability image with an ultrasound image; determining an elasticity modulus measurement fitness of each image frame based on elasticity image data and elasticity reliability image data of each image frame; automatically extracting a plurality of image frames for measuring an elasticity modulus based on the elasticity modulus measurement fitness; automatically determining a location of a measurement region of interest (ROI) of each extracted image frame based on the elasticity image data and the elasticity reliability image data of the extracted image frame; and displaying one of the extracted image frames and concurrently displaying at least one of a first indicator indicative of the elasticity modulus measurement fitness of the displayed image frame, a second indicator indicative of the measurement ROI location of the displayed image frame, and a third indicator indicative of a ranking order of the displayed image frame among the extracted image frames.

Description

Technical Field

[0001] This disclosure relates to an ultrasound imaging system and its control method, and more specifically, to an ultrasound imaging system and its control method configured to improve measurement reliability and diagnostic efficiency by calculating and evaluating the elastic modulus measurement fit of multiple image frames and automatically extracting and displaying suitable image frames and measurement regions of interest (ROIs). Background Technology

[0002] In recent years, various medical imaging devices have been widely used in the medical field to obtain visual information about human tissues for the early diagnosis of various diseases or for surgical procedures. Representative examples of these medical imaging devices include ultrasound imaging devices, computed tomography (CT) devices, and magnetic resonance imaging (MRI) devices.

[0003] An ultrasound imaging device is a device that transmits ultrasound signals generated by a transducer in a probe to an object and receives information about the ultrasound signals reflected from the object to non-invasively obtain at least one image of a portion of the object's interior (e.g., soft tissue or blood flow). Ultrasound imaging devices can be used for medical purposes, such as observing the interior of an object, detecting foreign bodies, and measuring damage. Ultrasound imaging devices offer advantages over X-ray-based imaging devices, including greater stability, real-time image display, and safety due to the absence of radiation exposure. Therefore, ultrasound imaging devices are widely used along with other imaging devices.

[0004] Ultrasound imaging devices are widely used for non-invasive examination of tissue structures within the human body or objects. Specifically, shear wave elastography can be used to quantitatively assess the elastic modulus of tissues. However, in clinical practice, the reliability of measurements can be reduced due to various factors, including respiration, heart rate, body shape, tissue inhomogeneity, and probe compression conditions.

[0005] Traditional techniques typically rely on the examiner's experience and subjective judgment to select image frames and regions of interest (ROIs), thus limiting measurement reproducibility and diagnostic standardization. Furthermore, the lack of sufficient technology for effectively comparing, evaluating, and simultaneously displaying multiple image metrics (e.g., resilience and reliability images) makes it difficult for examiners to visually assess measurement quality. Summary of the Invention

[0006] Technical issues This disclosure aims to provide a system capable of consistently assessing measurement quality by calculating and scoring the fitness of elastic modulus measurement for each image frame based on elastic image data and elastic reliability image data, without requiring subjective judgment from the inspector.

[0007] Furthermore, this disclosure aims to provide a system that can automatically determine the optimal location of a region of interest (ROI) by comprehensively analyzing the elastic uniformity and reliability in the extracted image frames, and can display multiple ROIs without mutual interference when multiple ROIs are required.

[0008] Furthermore, this disclosure aims to provide a system that enables inspectors to visually identify quality and location information in real time by simultaneously displaying multiple indicators along with image frames and providing user customization and interactive features.

[0009] Technical solution One aspect of this disclosure provides a control method for an ultrasound imaging system, the control method comprising: obtaining a cinematic image comprising multiple image frames by aligning an elastic image generated based on shear wave tracking signals received from a probe at the same timestamp and an elastic reliability image generated based on parameters obtained from the shear wave tracking signals from the probe with an ultrasound image generated based on echo signals received from the probe; determining a fitness test for elastic modulus measurement for each of the multiple image frames based on elastic image data and elastic reliability image data of each of the multiple image frames; automatically extracting multiple image frames for measuring elastic modulus based on the fitness test for elastic modulus measurement; automatically determining the location of a region of interest (ROI) for measurement of each of the extracted multiple image frames based on the elastic image data and elastic reliability image data of each of the extracted multiple image frames; and displaying one of the extracted multiple image frames, and simultaneously displaying at least one of a first indicator indicating the fitness test for elastic modulus measurement of the displayed image frame, a second indicator indicating the automatically determined location of the measurement ROI of the displayed image frame, and a third indicator indicating the sorting order of the displayed image frame among the extracted multiple image frames.

[0010] The steps for determining the fitness of elastic modulus measurement may include: calculating the standard deviation of elastic uniformity for each unit region based on elastic image data of each of the plurality of image frames, and generating an elastic uniformity STD mapping based on the standard deviation of elastic uniformity for each unit region; generating an average elastic reliability mapping for each unit region based on elastic reliability image data of each of the plurality of image frames; generating a first combined mapping for each of the plurality of image frames by combining the elastic uniformity STD mapping with the average elastic reliability mapping; and determining the fitness of elastic modulus measurement for each of the plurality of image frames by calculating the average value of the first combined mapping.

[0011] In addition, the elastic average value can be calculated based on the elastic image data and divided into STD maps to generate a representative elastic uniformity STD map, and the representative elastic uniformity STD map can be combined with the average elastic reliability map to generate a first combined map for each of the multiple image frames.

[0012] The step of displaying one of the extracted image frames and simultaneously displaying a first indicator may include: determining the color of a first display element included in the first indicator based on a preset score range to which the elastic modulus measurement fit of the displayed image frame belongs.

[0013] The step of displaying one of the extracted image frames and simultaneously displaying a first indicator may include: determining the number of first display elements such that the number of first display elements included in the first indicator increases as the elastic modulus measurement fit of the displayed image frame increases within the same fractional range.

[0014] The step of displaying one of the extracted image frames may include: simultaneously displaying a first ultrasound image in which an elastic image is superimposed on an ultrasound image and a second ultrasound image in which an elastic reliability image is superimposed on an ultrasound image.

[0015] The step of displaying one of the extracted image frames and simultaneously displaying a second indicator may include: simultaneously displaying a second display element for indicating the location of the measurement ROI automatically determined on the first ultrasound image and a third display element for indicating the location of the measurement ROI automatically determined on the second ultrasound image.

[0016] The step of automatically determining the location of the measurement ROI for each image frame in the extracted image frames may include: generating an elasticity uniformity map by calculating the elasticity uniformity of each unit region based on elasticity image data of each image frame in the extracted image frames; generating an average elasticity reliability map for each unit region based on elasticity reliability image data of each image frame in the extracted image frames; calculating a composite score for each unit region by applying a first weight value to the elasticity uniformity map and by applying a second weight value to the average elasticity reliability map, and generating a second combined map reflecting the composite score of each unit region thereon; extracting the unit region based on the composite score from the second combined map; and determining the location of the measurement ROI such that the measurement ROI includes the extracted unit region.

[0017] The steps for generating the second combined mapping may include: determining a first weight value and a second weight value based on a user identifier obtained through a user interface or communication interface.

[0018] The step of extracting a unit region based on the composite score from the second combined mapping may include: extracting a unit region where the composite score is the maximum value. The step of determining the location of the measured ROI such that the measured ROI includes the extracted unit region may include: determining the location of the measured ROI to include a unit region where the composite score is the maximum value.

[0019] The step of extracting unit regions based on composite scores from a second combined mapping may include: further extracting at least one unit region in which the average resilience reliability of each unit region is greater than or equal to a preset threshold. The step of determining the location of the measurement ROI such that the measurement ROI includes the extracted unit regions may include: further determining at least one location of the measurement ROI to include at least one unit region in which the average resilience reliability of each unit region is greater than or equal to a preset threshold.

[0020] The step of displaying one of the extracted image frames and simultaneously displaying a second indicator may include: automatically determining multiple locations based on the measured ROI location, and displaying each location using multiple second indicators of different colors.

[0021] The step of displaying one of the extracted image frames and simultaneously displaying a third indicator may include: displaying a fourth display element configured to display information about a sorting criterion; and, in response to the extracted image frames being sorted according to the sorting criterion, displaying a fifth display element for displaying information about the sorting order of the displayed image frames.

[0022] The sorting criteria may correspond to either chronological order or order based on the fitness of elastic modulus measurement. The control method for the ultrasound imaging system may include determining the sorting criteria based on user input.

[0023] The steps of displaying the fifth display element may include: superimposing and displaying multiple display units corresponding to each of the extracted multiple image frames on the sorted display elements at equal intervals according to the sorting criteria; and highlighting the display unit corresponding to the displayed image frame.

[0024] The steps for displaying the fifth display element include: displaying each of the plurality of display units corresponding to each of the plurality of extracted image frames with a color determined based on a preset score range to which the fitness of the elastic modulus measurement of the corresponding extracted image frame belongs.

[0025] The step of automatically extracting multiple image frames for measuring the elastic modulus based on the elastic modulus measurement fitness may include: automatically extracting image frames as image frames for measuring the elastic modulus based on the elastic modulus measurement fitness of the image frames being greater than or equal to a reference value; and displaying, through a user interface, that none of the multiple image frames included in the movie image were extracted for measuring the elastic modulus based on the elastic modulus measurement fitness of all multiple image frames being less than the reference value.

[0026] The step of automatically extracting multiple image frames for measuring the elastic modulus based on the elastic modulus measurement fitness may include: providing guidance via a user interface to reset the elastic modulus measurement fitness threshold based on the fact that the elastic modulus measurement fitness of multiple image frames included in the movie image is less than a reference value.

[0027] Another aspect of this disclosure provides an ultrasound imaging system comprising: a probe configured to receive an echo signal and a shear wave tracking signal; an image processor configured to generate an ultrasound image based on the echo signal, an elasticity image based on the shear wave tracking signal, an elasticity reliability image based on parameters obtained from the shear wave tracking signal, and configured to generate a cinematic image comprising a plurality of image frames by aligning the ultrasound image, the elasticity image, and the elasticity reliability image; a display for displaying the plurality of image frames; and a processor configured to determine an elastic modulus measurement suitability for each of the plurality of image frames based on elasticity image data and elasticity reliability image data for each of the plurality of image frames. The device is configured to automatically extract multiple image frames for measuring the elastic modulus based on the elastic modulus measurement fitness; to automatically determine the location of the region of interest (ROI) of each image frame in the extracted image frames based on the elastic image data and elastic reliability image data of each image frame in the extracted image frames; and to control the display to display one of the extracted image frames, and simultaneously display at least one of the following: a first indicator for indicating the elastic modulus measurement fitness of the displayed image frame, a second indicator for indicating the automatically determined location of the measurement ROI of the displayed image frame, and a third indicator for indicating the sorting order of the displayed image frame among the extracted image frames.

[0028] The processor is configured to calculate the elastic uniformity standard deviation for each unit region based on the elastic image data of each of the plurality of image frames, and generate an elastic uniformity STD map based on the elastic uniformity standard deviation for each unit region; is configured to generate an average elastic reliability map for each unit region based on the elastic reliability image data of each of the plurality of image frames; is configured to generate a first combined map for each of the plurality of image frames by combining the elastic uniformity STD map and the average elastic reliability map; and is configured to determine the elastic modulus measurement fit for each of the plurality of image frames by calculating the average value of the first combined map.

[0029] In addition, the elastic average value can be calculated based on the elastic image data and divided into STD maps to generate a representative elastic uniformity STD map, and the representative elastic uniformity STD map can be combined with the average elastic reliability map to generate a first combined map for each of the multiple image frames.

[0030] The processor can be configured to determine the color of a first display element included in a first indicator based on a preset score range to which the elastic modulus measurement fit of the displayed image frame belongs.

[0031] The processor may be configured to: determine the number of first display elements such that the number of first display elements included in the first indicator increases as the elastic modulus measurement fit of the displayed image frame increases within the same fractional range.

[0032] Beneficial effects The processes of calculating fitness and extracting regions of interest (ROIs) can be automated, thus enabling measurements of consistent quality regardless of the examiner's skill level and significantly improving the standardization and reproducibility of diagnostic results.

[0033] Furthermore, it can automatically select only high-quality frames and immediately identify low-reliability areas, thereby reducing unnecessary remeasurements and shortening examination time, and improving diagnostic accuracy by reducing false positives and false negatives.

[0034] Furthermore, indicator-based visualization and customization features allow users to visually examine the anatomical structure, elastic properties, and reliability information of the target area for diagnosis on a single screen, thereby simplifying clinical workflows and accelerating decision-making. Attached Figure Description

[0035] This disclosure will be readily understood from the following detailed description and the accompanying drawings, wherein reference numerals indicate structural elements.

[0036] Figure 1Aand Figure 1B This is a block diagram illustrating the configuration of an ultrasound imaging system according to an embodiment of the present disclosure.

[0037] Figure 2A , Figure 2B , Figure 2C and Figure 2D This is a diagram illustrating an ultrasound imaging system according to an embodiment of the present disclosure.

[0038] Figure 3 This is a diagram illustrating the configuration of image frames displayed on a display device of an ultrasound imaging system according to one embodiment.

[0039] Figure 4 This is a flowchart illustrating a control method for an ultrasound imaging system according to one embodiment.

[0040] Figure 5 This is a flowchart illustrating a method for calculating the fitness of elastic modulus measurement for each image frame according to one embodiment.

[0041] Figure 6 This is a block diagram that briefly illustrates the configuration and processing of data inputs and outputs in the process of determining the suitability of the elastic modulus measurement.

[0042] Figure 7 This is a flowchart illustrating a method for automatically determining the location of a measured region of interest (ROI) for each extracted image frame according to one embodiment.

[0043] Figure 8 This is a block diagram that briefly illustrates the configuration and processing of input and output data during the automatic determination of the measurement ROI location.

[0044] Figure 9 This is a diagram illustrating various indicators provided along with image frames displayed on a display of an ultrasound imaging system, according to one embodiment.

[0045] Figure 10 This is a diagram illustrating a method for configuring and displaying a first indicator according to one embodiment.

[0046] Figure 11 This is a diagram illustrating a method for configuring and displaying a second indicator according to one embodiment.

[0047] Figure 12 This is a diagram illustrating a method for configuring and displaying a plurality of second indicators according to another embodiment.

[0048] Figure 13 This is a diagram illustrating the configuration and display method of a third indicator when sorted in chronological order according to one embodiment.

[0049] Figure 14 This is a diagram illustrating the configuration and display method of the third indicator when sorted in order of fit of elastic modulus measurement according to another embodiment.

[0050] Figure 15 This is a reference diagram illustrating a color coding scheme for a fifth display element according to one embodiment.

[0051] Figure 16 This is a diagram illustrating various implementations of the fifth display element when ordered chronologically according to one embodiment.

[0052] Figure 17 This is a diagram illustrating various implementations of the fifth display element when sorted according to the order of measured fitness, according to one embodiment. Detailed Implementation

[0053] This description discloses the principles of this disclosure and provides embodiments thereof, thereby clarifying the scope of this disclosure and enabling those skilled in the art to practice it. The disclosed embodiments may be implemented in various forms.

[0054] Throughout this specification, the same reference numerals indicate the same elements. Well-known functions or constructions are not described in detail, as this would obscure one or more exemplary embodiments with unnecessary detail. Terms such as “module” or “unit” may be implemented by one or more of software, hardware, or firmware. According to embodiments, multiple “modules” or “units” may be implemented as a single element, or a single “module” or “unit” may include multiple elements.

[0055] The singular representation corresponding to an item may include one item or more items, unless otherwise indicated herein or explicitly contradicted by the context.

[0056] The expressions “A or B”, “at least one of A and / or B”, “one or more of A and / or B”, “A, B or C”, “at least one of A, B or / or C”, or “one or more of A, B or / or C”, etc., as used herein, may include any and all combinations of one or more of the relevant listed items.

[0057] The term “and / or” includes a combination of multiple related items or any one of them.

[0058] The expressions “A or B”, “at least one of A and / or B”, or “one or more of A and / or B” as used herein may include any and all combinations of one or more of the related listed items. For example, the terms “A or B”, “at least one of A and B”, or “at least one of A or B” may refer to all of the following cases: (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0059] Here, the terms "first," "second," "firstly," "secondly," etc., may be used only to distinguish an element from other elements, but are not limited to another aspect of the element (importance or order).

[0060] Furthermore, terms such as “front surface,” “rear surface,” “upper surface,” “lower surface,” “side surface,” “left side,” “right side,” “upper part,” and “lower part” used in this disclosure are defined based on the accompanying drawings, and the shape and position of each component are not limited by these terms.

[0061] In this disclosure, the terms “comprising,” “having,” etc., are used to specify features, numbers, steps, operations, elements, components, or combinations thereof, but do not exclude the presence or addition of one or more features, numbers, steps, operations, elements, components, or combinations thereof.

[0062] When an element is described as being “connected,” “joined,” “supported,” or “in contact” with another element, this includes not only when the element is directly connected, joined, supported, or in contact, but also when the element is indirectly connected, joined, supported, or in contact through a third element.

[0063] Throughout the specification, the phrase "when an element is "on" another element" includes not only when an element is in contact with another element, but also when there is another element between the two elements.

[0064] In the following description, an ultrasonic device according to various embodiments will be specifically described with reference to the accompanying drawings. In the description with reference to the drawings, the same or corresponding components are assigned similar reference numerals, and redundant descriptions may be omitted.

[0065] In this disclosure, "object" means the object to be imaged and may include a person, an animal, or a part thereof. For example, an object may include a part of a body (such as an organ or system) or a phantom.

[0066] In this disclosure, the term "ultrasound image" can refer to an image of an object generated or processed based on ultrasound signals (echo signals) sent to and reflected from the object.

[0067] In this disclosure, the expression "robotic arm supporting A" may mean that the robotic arm grasps A, docks to A and / or fixes A, and may include the robotic arm directly or indirectly supporting A.

[0068] In the following, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0069] Figure 1A and Figure 1B This is a block diagram illustrating the configuration of an ultrasound imaging system according to an embodiment of the present disclosure.

[0070] Reference Figure 1A and Figure 1B The ultrasound imaging system 100 may include a probe 20 and an ultrasound imaging device 40.

[0071] The ultrasound imaging device 40 can be implemented not only as a cart-type device but also as a portable device. Examples of portable ultrasound imaging devices include, but are not limited to, smartphones, laptops, personal digital assistants (PDAs), or tablet PCs that include a probe and applications. The ultrasound imaging device 40 can also be implemented integrated with the probe.

[0072] The probe 20 may include: a wired probe that is wired to and communicates with the ultrasound imaging device 40 via a wired connection; a wireless probe that is wirelessly connected to and communicates with the ultrasound imaging device 40 via a wireless connection; and / or a hybrid probe that is wired or wirelessly connected to and communicates with the ultrasound imaging device 40 via a wired or wireless connection.

[0073] According to various embodiments of this disclosure, such as Figure 1A As shown, the ultrasound imaging device 40 may include an ultrasound transceiver module 110, and as... Figure 1B As shown, probe 20 may include an ultrasonic transceiver module 110. According to various embodiments of the present disclosure, ultrasonic imaging device 40 and probe 20 may each include an ultrasonic transceiver module 110.

[0074] According to various embodiments of this disclosure, probe 20 may also include at least one or a combination of image processor 130, display 140, or input interface 170. The descriptions of ultrasound transceiver module 110, image processor 130, display 140, or input interface 170 included in ultrasound imaging apparatus 40 in this disclosure also apply to ultrasound transceiver module 110, image processor 130, display 140, or input interface 170 included in probe 20.

[0075] Figure 1A This is a block diagram showing the configuration of the ultrasound imaging system 100 when probe 20 is a wired probe or a hybrid probe.

[0076] The probe 20 may include multiple transducers. These transducers may be arranged in a predetermined configuration to be implemented as a transducer array. The transducer array may correspond to a one-dimensional (1D) array or a two-dimensional (2D) array. The multiple transducers may transmit ultrasonic signals to the target object (also referred to as the object) 10 according to a transmission signal applied from the transmission module 113. The multiple transducers may receive ultrasonic signals (echo signals) reflected from the target object 10 and form a received signal. Alternatively, the probe 20 may be implemented as integrated with the ultrasound imaging device 40, or as a discrete type with a wired connection to the ultrasound imaging device 40. Furthermore, the ultrasound imaging device 40 may be connected to one or more probes 20, depending on the implementation.

[0077] When probe 20 is a wired probe or a hybrid probe, probe 20 may include a cable and connector capable of being connected to a connector of ultrasound imaging device 40.

[0078] The probe 20 according to this disclosure can be implemented as a two-dimensional probe. When the probe 20 is implemented as a two-dimensional probe, a plurality of transducers included in the probe 20 can be arranged in two dimensions to form a two-dimensional transducer array.

[0079] For example, a two-dimensional transducer array can be in the form of multiple subarrays (including multiple transducers arranged along a first direction) arranged along a second direction different from the first direction.

[0080] Additionally, when the probe 20 according to one embodiment of this disclosure is implemented as a two-dimensional probe, the ultrasonic transceiver module 110 may include at least one of an analog beamformer or a digital beamformer. Furthermore, according to one embodiment of this disclosure, the two-dimensional probe may, depending on the implementation, include at least one or a combination of analog beamformers or digital beamformers.

[0081] The processor 120 controls the transmitting module 113 to generate a transmitting signal to be applied to each transducer 117 by taking into account the position and focus of the multiple transducers included in the probe 20.

[0082] The processor 120 can control the receiving module 115 to generate ultrasound data by performing analog-to-digital conversion on the received signals received from the probe 20 and adding the digital received signals, taking into account the positions and focal points of multiple transducers.

[0083] When probe 20 is implemented as a two-dimensional probe, processor 120 can calculate a time delay value for digital beamforming for each of the multiple subarrays included in the two-dimensional transducer array. Additionally, processor 120 can calculate a time delay value for analog beamforming for each transducer in any one of the multiple subarrays. Processor 120 can control the analog beamformer and digital beamformer based on the time delay values ​​for analog and digital beamforming to form a transmit signal to be applied to each of the multiple transducers. Furthermore, processor 120 can control the analog beamformer based on the time delay value for analog beamforming to add the signals received from the multiple transducers for each subarray. Additionally, processor 120 can control the ultrasonic transceiver module 110 to perform analog-to-digital conversion on the signals added for each subarray. Additionally, processor 120 can control the digital beamformer based on the time delay value for digital beamforming to generate ultrasonic data by adding the digitally converted signals.

[0084] The image processor 130 can generate or process ultrasound images using the generated ultrasound data.

[0085] The display 140 can display generated ultrasound images and various information processed by the ultrasound imaging device 40 or probe 20. The probe 20 or ultrasound imaging device 40 may include one or more displays 140, depending on the implementation. Additionally, the display 140 may include a touch panel or a touchscreen. Alternatively, the display 140 may include a flexible display.

[0086] The processor 120 can control the overall operation of the ultrasound imaging device 40 and the operation of its components. The processor 120 can execute or control various operations or functions of the ultrasound imaging device 40 by executing programs or instructions stored in the memory 150. Additionally, the processor 120 can receive control signals from the input interface 170 or external devices and control the operation of the ultrasound imaging device 40.

[0087] The ultrasound imaging device 40 may include a communication module 160, and can be connected to and communicate with external devices (e.g., probe 20, server, medical device, portable device (smartphone, tablet PC, wearable device, etc.)) via the communication module 160.

[0088] The communication module 160 may include one or more components configured to allow communication with external devices. The communication module 160 may include at least one of a short-range communication module, a wired communication module, or a wireless communication module.

[0089] The communication module 160 can receive control signals or data from an external device. The processor 120 can control the operation of the ultrasound imaging device 40 based on the control signals received through the communication module 160. Additionally, the processor 120 can send control signals to an external device through the communication module 160 and control the external device based on the sent control signals. The external device can operate based on the control signals received from the ultrasound imaging device 40, or process the data received from the ultrasound imaging device 40.

[0090] Programs or applications associated with the ultrasound imaging device 40 may be installed on an external device. These programs or applications installed on the external device may control the ultrasound imaging device 40 or operate it based on control signals or data received from the ultrasound imaging device 40.

[0091] External devices can receive or download programs or applications related to the ultrasound imaging device 40 from the ultrasound imaging device 40, probe 20, or server, and install and execute the programs or applications on the external device. The ultrasound imaging device 40, probe 20, or server providing the programs or applications may include recording media storing instructions, commands, installation files, executable files, or related data of the programs or applications. External devices may also be sold together with the programs or applications installed thereon.

[0092] The memory 150 can store various data or programs, input / output ultrasound data, ultrasound images, etc., used to drive and control the ultrasound imaging device 40.

[0093] Input interface 170 can receive user input for controlling ultrasound imaging device 40. For example, user input may include input for operating buttons, keypad, mouse, trackball, micro switch, knob, etc., input for touching touchpad or touch screen, voice input, motion input, biometric information input (e.g., iris recognition, fingerprint recognition, etc.), but is not limited to these.

[0094] Figure 1B The diagram shows the control block diagram of the ultrasound imaging system 100 when probe 20 is a wireless probe or a hybrid probe.

[0095] According to various embodiments of this disclosure Figure 1B The ultrasound imaging device 40 shown can be used as a reference. Figure 1A The described ultrasound imaging device 40 is used as a replacement.

[0096] According to various embodiments of this disclosure Figure 1A The probe 20 shown can be used as a reference. Figure 1B Replace the described probe 20.

[0097] The probe 20 may include a display, a transmitting module 113, a battery 114, a receiving module 115, a charging module 116, a transducer 117, an input interface 109, a processor 118, and a communication module 119. Figure 1B The diagram shows a probe 20 comprising both a transmitting module 113 and a receiving module 115. However, depending on the implementation, the probe 20 may include only a portion of the configuration of the transmitting module 113 and the receiving module 115, and this portion of the configuration of the transmitting module 113 and the receiving module 115 may be included in the ultrasound imaging apparatus 40. Additionally, according to one embodiment of this disclosure, the probe 20 may also include an image processor 130.

[0098] Transducer 117 may include multiple transducers. The multiple transducers may be arranged in a predetermined configuration to be implemented as a transducer array. The transducer array may correspond to a one-dimensional (1D) array or a two-dimensional (2D) array. The multiple transducers may transmit ultrasonic signals to the target object 10 according to a transmission signal applied from the transmission module 113. Additionally, the multiple transducers may receive ultrasonic signals reflected from the target object 10 and form or generate an electrical receiving signal.

[0099] The charging module 116 can charge the battery 114. The charging module 116 can receive power from an external source. According to one embodiment of this disclosure, the charging module 116 can receive power wirelessly. Furthermore, according to one embodiment of this disclosure, the charging module 116 can also receive power wiredly. The charging module 116 can transfer the received power to the battery 114.

[0100] The processor 118 controls the transmitting module 113 to generate or form a transmitting signal to be applied to each of the multiple transducers by taking into account the position and focus of the multiple transducers.

[0101] Processor 118 can control receiver module 115 by taking into account the position and focus of multiple transducers to generate ultrasound data by performing analog-to-digital conversion on the received signals received from transducer 117 and summing the digital received signals. According to one embodiment of this disclosure, when probe 20 includes image processor 130, ultrasound images can be generated using the generated ultrasound data.

[0102] When probe 20 is implemented as a two-dimensional probe, processor 118 can calculate a time delay value for digital beamforming for each of the multiple subarrays included in the two-dimensional transducer array. Additionally, processor 118 can calculate a time delay value for analog beamforming for each transducer in any one of the multiple subarrays. Processor 118 can control the analog beamformer and digital beamformer based on the time delay values ​​for analog and digital beamforming to form a transmit signal to be applied to each of the multiple transducers. Furthermore, processor 118 can control the analog beamformer based on the time delay value for analog beamforming to add the signals received from the multiple transducers for each subarray. Additionally, processor 118 can control the ultrasonic transceiver module 110 to perform analog-to-digital conversion on the signals added for each subarray. Additionally, processor 118 can control the digital beamformer based on the time delay value for digital beamforming to generate ultrasonic data by adding the digitally converted signals.

[0103] The processor 118 can control the overall operation of the probe 20 and the operation of its components. The processor 118 can execute or control various operations or functions of the probe 20 by executing programs or instructions stored in the memory 111. Additionally, the processor 118 can receive control signals from the input interface 109 or an external device (e.g., the ultrasound imaging device 40) and control the operation of the probe 20. The input interface 109 can receive user input for controlling the probe 20. For example, user input may include input for operating buttons, keypads, mice, trackballs, microswitches, knobs, etc.; input for touchpads or touchscreens; voice input; motion input; biometric information input (e.g., iris recognition, fingerprint recognition, etc.), but is not limited to these.

[0104] The display included in probe 20 can display ultrasound images generated by probe 20, ultrasound images generated by processing ultrasound data generated by probe 20, ultrasound images received from ultrasound imaging device 40, or various information processed by ultrasound imaging system 100. Additionally, the display can also display status information of probe 20. The status information of probe 20 may include at least one of the following: probe 20 device information, probe 20 battery status information, probe 20 frequency band information, probe 20 output information, information regarding whether probe 20 is malfunctioning, probe 20 setting information, or probe 20 temperature information.

[0105] Depending on the implementation, probe 20 may include one or more displays. Furthermore, the displays may include touch panels or touchscreens. Additionally, the displays may include flexible displays.

[0106] The communication module 119 can wirelessly transmit the generated ultrasound data or ultrasound images to the ultrasound imaging device 40 via a wireless network. In addition, the communication module 119 can receive control signals and data from the ultrasound imaging device 40.

[0107] The ultrasound imaging device 40 can receive ultrasound data or ultrasound images from the probe 20.

[0108] According to one embodiment of the present disclosure, when the probe 20 includes an image processor 130 configured to generate an ultrasound image using ultrasound data, the probe 20 can send ultrasound data or an ultrasound image generated by the image processor 130 to an ultrasound imaging device 40.

[0109] According to one embodiment of this disclosure, when the probe 20 does not include an image processor 130 configured to generate an ultrasound image using ultrasound data, the probe 20 may transmit ultrasound data to an ultrasound imaging device 40. The ultrasound data may include raw ultrasound data, and the ultrasound image may represent ultrasound image data.

[0110] The ultrasound imaging device 40 may include a processor 120, an image processor 130, a display 140, a memory 150, a communication module 160, and an input interface 170.

[0111] The image processor 130 uses ultrasound data received from the probe 20 to generate or process ultrasound images.

[0112] The display 140 can display ultrasound images received from the probe 20, ultrasound images generated by processing ultrasound data received from the probe 20, or various information processed in the ultrasound imaging system 100. Depending on the implementation type, the ultrasound imaging apparatus 40 may include one or more displays 140. Additionally, the display 140 may include a touch panel or a touch screen. Furthermore, the display 140 may include a flexible display.

[0113] The processor 120 can control the overall operation of the ultrasound imaging device 40 and the operation of its components. The processor 120 can execute programs or applications stored in the memory 150 to perform or control various operations or functions of the ultrasound imaging device 40. Additionally, the processor 120 can receive control signals from the input interface 170 or external devices and control the operation of the ultrasound imaging device 40.

[0114] The ultrasound imaging device 40 may include a communication module 160, and can be connected to and communicate with external devices (e.g., probe 20, server, medical device, portable device (smartphone, tablet PC, wearable device, etc.)) via the communication module 160.

[0115] The communication module 160 may include one or more components configured to allow communication with external devices. The communication module 160 may include at least one of a short-range communication module, a wired communication module, or a wireless communication module.

[0116] The communication module 160 of the ultrasound imaging device 40 and the communication module 119 of the probe 20 can communicate using a network or short-range wireless communication method. For example, the communication module 160 of the ultrasound imaging device 40 and the communication module 119 of the probe 20 can communicate using any of the following wireless data communication methods: wireless LAN, Wi-Fi, Bluetooth, Zigbee, Wi-Fi Direct (WFD), Infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), Global Microwave Access Interoperability (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), RF communication, or 60 GHz millimeter wave (mmWave) short-range communication.

[0117] For communication purposes, the communication module 160 of the ultrasound imaging device 40 and the communication module 119 of the probe 20 may include at least one of the following: a wireless LAN communication module, a Wi-Fi communication module, a Bluetooth communication module, a Zigbee communication module, a Wi-Fi Direct (WFD) communication module, an Infrared Data Association (IrDA) communication module, a Bluetooth Low Energy (BLE) communication module, a Near Field Communication (NFC) communication module, a Wireless Broadband Internet (Wibro) communication module, a Global Microwave Access Interoperability (WiMAX) communication module, a Shared Wireless Access Protocol (SWAP) communication module, a Wireless Gigabit Alliance (WiGig) communication module, an RF communication module, or a 60 GHz millimeter wave (mmWave) short-range communication module.

[0118] According to one embodiment of this disclosure, probe 20 can transmit device information (e.g., identification (ID) information) of probe 20 to ultrasound imaging device 40 using a first communication method (e.g., BLE), and can wirelessly pair with ultrasound imaging device 40. Additionally, probe 20 can transmit ultrasound data and / or ultrasound images to the paired ultrasound imaging device 40.

[0119] The device information of probe 20 may include various information related to the serial number, model name, or battery status of probe 20.

[0120] The ultrasound imaging device 40 can receive device information (e.g., ID information) from the probe 20 using a first communication method (e.g., BLE) and can wirelessly pair with the probe 20. Additionally, the ultrasound imaging device 40 can send an activation signal to the paired probe 20 and receive ultrasound data and / or ultrasound images from the probe 20. In this case, the activation signal may include a signal for controlling the operation of the probe 20.

[0121] According to one embodiment of this disclosure, probe 20 can use a first communication method (e.g., BLE) to send device information (e.g., ID information) of probe 20 to ultrasound imaging device 40, and can wirelessly pair with ultrasound imaging device 40. Additionally, probe 20 can use a second communication method (e.g., 60 GHz millimeter wave or Wi-Fi) to send ultrasound data and / or ultrasound images to ultrasound imaging device 40 paired via the first communication method.

[0122] The ultrasound imaging device 40 can use a first communication method (e.g., BLE) to receive device information (e.g., ID information) from the probe 20 and can wirelessly pair with the probe 20. Additionally, the ultrasound imaging device 40 can use a second communication method (e.g., 60 GHz millimeter wave or Wi-Fi) to send an activation signal to the paired probe 20 and receive ultrasound data and / or ultrasound images from the probe 20.

[0123] According to one embodiment of this disclosure, a first communication method for pairing the probe 20 and the ultrasound imaging device 40 may have a lower frequency band than a second communication method for transmitting ultrasound data and / or ultrasound images from the probe 20 to the ultrasound imaging device 40.

[0124] The ultrasound imaging device 40 may display a user interface (UI) that indicates device information of the probe 20. For example, the display 140 may display a UI indicating the following: the ID information of the probe 20, a pairing method indicating how to pair with the probe 20, the data communication status between the probe 20 and the ultrasound imaging device 40, the method of performing data communication with the ultrasound imaging device 40, or the battery status of the probe 20.

[0125] When probe 20 includes a display, the display of probe 20 may show a UI indicating device information of probe 20. For example, the display may show a UI indicating the following: ID information of probe 20, a pairing method indicating how to pair with probe 20, data communication status between probe 20 and ultrasound imaging device 40, method of performing data communication with ultrasound imaging device 40, or battery status of probe 20.

[0126] The communication module 160 can receive control signals or data from external devices. The processor 120 can control the operation of the ultrasound imaging device 40 based on the control signals received through the communication module 160.

[0127] Additionally, the processor 120 can send control signals to external devices via the communication module 160 and control the external devices according to the sent control signals. The external devices can operate according to the control signals received from the ultrasound imaging device 40, or process the data received from the ultrasound imaging device 40.

[0128] External devices can receive or download programs or applications related to the ultrasound imaging device 40 from the ultrasound imaging device 40, probe 20, or server, and install and execute the programs or applications on the external device. The ultrasound imaging device 40, probe 20, or server providing the programs or applications may include recording media storing instructions, commands, installation files, executable files, or related data of the programs or applications. External devices may also be sold together with the programs or applications installed thereon.

[0129] The memory 150 can store various data or programs, input / output ultrasound data, ultrasound images, etc., used to drive and control the ultrasound imaging device 40.

[0130] The following will refer to Figure 2A , Figure 2B , Figure 2C and Figure 2D An example of an ultrasound imaging system 100 according to an embodiment of the present disclosure is described.

[0131] Figure 2A , Figure 2B , Figure 2C and Figure 2D This is a diagram illustrating an ultrasound imaging apparatus according to an embodiment of the present disclosure.

[0132] Reference Figure 2A and Figure 2B The ultrasound imaging devices 40a and 40b may include a main display 121 and a sub-display 122. The main display 121 and the sub-display 122 may correspond to... Figure 1A and Figure 1BThe display 140. At least one of the main display 121 or the sub-display 122 may be implemented as a touch screen. At least one of the main display 121 or the sub-display 122 may display ultrasound images or various information processed in the ultrasound imaging apparatus 40a and 40b. In addition, at least one of the main display 121 or the sub-display 122 may be implemented as a touch screen and may provide a graphical user interface (GUI) to receive data from the user for controlling the ultrasound imaging apparatus 40a and 40b. For example, the main display 121 may display ultrasound images, and the sub-display 122 may display a control panel for controlling the display of ultrasound images in the form of a GUI. The sub-display 122 may receive data for controlling the display of images through the control panel displayed in the form of a GUI. For example, a time gain compensation (TGC) button, a lateral gain compensation (LGC) button, a freeze button, a trackball, a microswitch, or a knob may be configured as the GUI on the sub-display 122.

[0133] Ultrasonic imaging devices 40a and 40b can use input control data to control the display of ultrasound images on the main display 121. Ultrasonic imaging devices 40a and 40b can be wired or wirelessly connected to probe 20 to send ultrasound signals to and receive ultrasound signals from the target object.

[0134] Reference Figure 2B In addition to the main display 121 and the sub-display 122, the ultrasound imaging device 40b may also include a control panel 165. The control panel 165 may include buttons, a trackball, microswitches, knobs, etc., and can receive data from the user for controlling the ultrasound imaging device 40b. For example, the control panel 165 may include a TGC button 171, a freeze button 172, etc. The TGC button 171 is used to set the TGC value according to the depth of the ultrasound image. Furthermore, when the ultrasound imaging device 40b detects input to the freeze button 172 while scanning an ultrasound image, the ultrasound imaging device 40b can maintain the display of frame images at the corresponding time, capture frame images at the corresponding time, or store frame images at the corresponding time.

[0135] Furthermore, buttons, trackballs, microswitches, knobs, etc., included in the control panel 165 can be configured as a GUI on the main display 121 or the sub-display 122. Additionally, ultrasound imaging devices 40a and 40b can be connected to probe 20 to send and receive ultrasound signals to and from the target object.

[0136] In addition, ultrasound imaging devices 40a and 40b may include various types of input / output interfaces, such as speakers, light-emitting diodes (LEDs), and vibration devices. For example, ultrasound imaging devices 40a and 40b can output various information in the form of graphics, sound, or vibration through the input / output interfaces. Furthermore, ultrasound imaging devices 40a and 40b can output various notifications or data through the input / output interfaces.

[0137] Reference Figure 2C and Figure 2D The ultrasound imaging devices 40c and 40d can also be implemented in a portable form. Examples of portable ultrasound imaging devices 40c and 40d include, but are not limited to, smartphones, laptops, PDAs, or tablet PCs including probes and applications.

[0138] The ultrasound imaging device 40c may include a main body 41. (See reference...) Figure 2C The probe 20 may be wired to one side of the body 41. For this purpose, the body 41 may include detachable connection terminals for connecting the cable to the probe 20. The probe 20 may include a cable with connection terminals for connecting to the body 41.

[0139] Reference Figure 2D The probe 20 can be wirelessly connected to the ultrasound imaging device 40d. The main body 41 may include an input / output interface (e.g., a touch screen). The input / output interface can display ultrasound images, various information processed by the ultrasound imaging device, or a GUI.

[0140] The ultrasound imaging device 40d and the probe 20 can establish communication or pairing using short-range wireless communication. For example, the ultrasound imaging device 40d and the probe 20 can communicate using Bluetooth, BLE, Wi-Fi, or Wi-Fi Direct.

[0141] Ultrasonic imaging devices 40c and 40d can execute programs or applications related to probe 20, control probe 20, and output information related to probe 20. Ultrasonic imaging devices 40c and 40d can communicate with a predetermined server and perform operations related to probe 20. Probe 20 can be registered with ultrasonic imaging devices 40c and 40d or registered with a predetermined server. Ultrasonic imaging devices 40c and 40d can communicate with registered probe 20 and perform operations related to probe 20.

[0142] In addition, ultrasound imaging devices 40c and 40d may include various types of input / output interfaces, such as speakers, LEDs, and vibration devices. For example, ultrasound imaging devices 40c and 40d can output various information in the form of graphics, sound, or vibration through the input / output interfaces. Furthermore, ultrasound imaging devices 40c and 40d can output various notifications or data through the input / output interfaces.

[0143] According to one embodiment of this disclosure, ultrasound imaging devices 40a, 40b, 40c, or 40d may use an artificial intelligence (AI) model to process ultrasound images or obtain additional information from ultrasound images. According to one embodiment of this disclosure, ultrasound imaging devices 40a, 40b, 40c, or 40d may use an AI model to generate ultrasound images or perform processes such as correction, image quality improvement, encoding, or decoding on ultrasound images. Additionally, according to one embodiment of this disclosure, ultrasound imaging devices 40a, 40b, 40c, or 40d may use an AI model to perform processes such as baseline definition, anatomical information acquisition, lesion information acquisition, surface extraction, boundary definition, length measurement, area measurement, volume measurement, or annotation generation from ultrasound images.

[0144] The AI ​​model can be installed on ultrasound imaging devices 40a, 40b, 40c or 40d or on a server.

[0145] AI models can be implemented using various artificial neural networks or deep neural networks. Furthermore, various machine learning algorithms or deep learning algorithms can be used to train and generate AI models. For example, AI models can be implemented using models such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), generative adversarial networks (GANs), and long short-term memory (LSTM).

[0146] Figure 3 This is a diagram illustrating the configuration of image frames displayed on a display device of an ultrasound imaging system according to one embodiment.

[0147] In one embodiment, the display (e.g., Figure 1A 140 monitors Figure 1B The display included in the display 140 or probe 20, or Figure 2A and Figure 2B The display 121, and the display 140 (described below as an example), can simultaneously display various images generated based on echo signals and shear wave tracking signals received from probe 20 within a single image frame. An image frame corresponds to a complete ultrasound image acquired at a specific point in time. Each image frame is a snapshot representing the tissue state at that point in time, and the B-mode image, elasticity image, and elasticity reliability image can be synchronized in time to form a single frame. For example, refer to... Figure 3 The image frame D1 displayed on the display 140 can simultaneously display the ultrasound image O1, the elasticity image O2, and the elasticity reliability image O3.

[0148] Ultrasound image O1 may correspond to an ultrasound image generated based on the echo signal received from probe 20. For example, ultrasound image O1 may correspond to a B-mode image. A B-mode image can represent the anatomical structure of the target object 10 as black-and-white brightness information. Ultrasound image O1 provides basic image information used in general ultrasound diagnosis and may be generated based on the echo signal caused by the difference in acoustic impedance at tissue boundaries.

[0149] The elastic image O2 can be generated based on the shear wave tracking signal received at the same timestamp as the echo signal from probe 20.

[0150] Specifically, the acoustic radiation force pulse (ARFI) corresponding to the high-intensity focused pulse transmitted from probe 20 can induce a minute mechanical displacement (approximately 10 to 40 micrometers) at a specific depth within the target object 10. During the recovery of this displacement, a shear wave can be generated within the tissue, and the shear wave can propagate laterally perpendicular to the compression direction.

[0151] The generated shear waves can propagate at different speeds depending on the elastic properties of the tissue. The ultrasound imaging system 100 can use ultra-high-speed ultrasound imaging technology (up to 10,000 fps) to track the propagation of the shear waves in real time.

[0152] Ultrasound imaging system 100 can calculate the elastic modulus using measured shear wave velocity (Vs). Ultrasound imaging system 100 can convert the calculated elastic modulus value into color according to a predefined color mapping, thereby generating an elasticity image O2. Typically, in the elasticity image O2, hard tissue (high elastic modulus) can be displayed with a red shading, soft tissue (low elastic modulus) with a blue shading, and moderately hard tissue with a green or yellow shading. However, this disclosure is illustrative, and other colors besides those mentioned can be used to distinguish and display tissues.

[0153] An elastic reliability image O3 can be generated based on various signal quality parameters obtained from shear wave tracking signals.

[0154] The ultrasound imaging system 100 can obtain an elastic reliability image O3 indicating the reliability of an elastic value (i.e., elastic modulus) based on received ultrasound echo signals. For example, the ultrasound imaging system 100 can determine at least one of the size of a shear wave, the signal quality of the shear wave, or the noise level of the shear wave based on the received ultrasound echo signals. The ultrasound imaging system 100 can generate an elastic reliability image O3 indicating the reliability of the elastic modulus indicated by a reference elastic image O2 based on the size of the shear wave, the signal quality of the shear wave, or the noise level of the shear wave. For example, when the size of the induced shear wave is large, the signal quality of the shear wave is high, or the noise level of the shear wave is low, the ultrasound imaging system 100 can determine the reliability of the elastic value to be high.

[0155] The ultrasound imaging system 100 generates a resilient reliability image O3 by converting resilient reliability values ​​into colors based on reliability levels. Typically, high reliability (e.g., resilient reliability > 0.7) areas are displayed in dark green, medium reliability (e.g., 0.4 < resilient reliability < 0.7) areas are displayed in light green or yellow, and low reliability (e.g., resilient reliability < 0.4) areas are displayed in orange or red. However, this disclosure is merely an example, and other colors besides those described above may be used to distinguish and display areas.

[0156] According to one embodiment, the registration of ultrasound images, elasticity images, and elastic reliability images can be performed in various ways.

[0157] For example, overlay methods can be used to perform image registration. The most common overlay method is to superimpose another image (an elastic image or an elastic reliability image) on top of a reference image (an ultrasound image) in a semi-transparent manner. Alpha blending can be used to control transparency. For example, transparency can typically be set from 50% to 70%.

[0158] The display 140 can simultaneously display the first ultrasound image U1 and the second ultrasound image U2. That is, the image frame D1 displayed on the display 140 may include the first ultrasound image U1 and the second ultrasound image U2.

[0159] A first ultrasound image U1 can be generated by aligning the elasticity image O2 with the ultrasound image O1. The anatomical information of the ultrasound image is preserved in grayscale, while the color information of the elasticity image is superimposed with a specific transparency. Therefore, the precise anatomical location and elastic properties of lesions can be identified simultaneously, providing useful information for the diagnosis of liver fibrosis, thyroid nodules, breast tumors, and other conditions.

[0160] A second ultrasound image U2 can be generated by aligning the elasticity reliability image O3 with the ultrasound image O1. The second ultrasound image U2 displays the elasticity measurement reliability and anatomical information in each unit region in real time, thus allowing for immediate assessment of the measurement quality. Specifically, areas with low measurement reliability due to motion or tissue inhomogeneity caused by respiration or heartbeat can be easily identified.

[0161] Simultaneous display of the first ultrasound image U1 and the second ultrasound image U2 significantly enhances the clinical utility of elastography. Users can simultaneously examine the stiffness distribution of lesions in the first ultrasound image on the right and assess the reliability of corresponding measurements in the second ultrasound image on the left. This dual-verification system significantly reduces false positives and false negatives, thus enabling more accurate and reliable diagnoses.

[0162] In addition, the image frame may include multiple indicators I1, I2 and I3.

[0163] For example, the image frame may also include a depth scale I1 that indicates the depth information of the image. The depth scale I1 can typically be located on the left or right side of the ultrasound image and can indicate the distance from the probe surface in centimeters (cm). Therefore, the precise depth of the lesion can be identified, and thus the measurement conditions can be taken into account when measuring elasticity.

[0164] As another example, ultrasound images may include an elastic modulus color index I3 corresponding to the elasticity image O2. The elastic modulus color index I3 indicates the correlation between an elastic modulus value (kilopascals (kPa)) and its corresponding color, and is typically located at the top or side of the image. This color index allows users to immediately identify the precise elastic modulus value represented by the color displayed in the image. The color index can be scaled according to the clinical application. For example, it may be set to a range of 0 to 40 kPa for liver diagnosis and a range of 0 to 200 kPa for breast diagnosis.

[0165] As another example, ultrasound images may include a reliability color index I2 corresponding to the elastic reliability image O3. The reliability color index I2 indicates the correlation between a reliability index (ranging from 0 to 1) and its corresponding color. For example, values ​​from 0 to 0.4 may be displayed with a red shading (low reliability), from 0.4 to 0.7 with a yellow shading (medium reliability), and from 0.7 to 1.0 with a green shading (high reliability). This allows users to quantitatively assess the measurement reliability in each unit area and consider additional measurements or other diagnostic methods in areas with low reliability.

[0166] Within each image frame, ultrasound image O1, elasticity image O2, and elasticity reliability image O3 can be obtained at the same timestamp. This is because the echo signal and shear wave tracking signal are simultaneously received and processed by probe 20. Due to time synchronization, accurate correspondence between images is ensured, and instantaneous changes in tissue state can be precisely captured.

[0167] A cine image corresponds to images acquired sequentially to capture dynamic changes in tissue, such as changes in a patient's respiratory cycle, heart rate, or probe pressure. A cine image may comprise multiple image frames. Individual image frames acquired at each time point, along with metadata (time information, acquisition conditions, etc.), can be stored chronologically to form a cine image.

[0168] Figure 4 This is a flowchart illustrating a control method for an ultrasound imaging system according to one embodiment.

[0169] A control method for an ultrasound imaging system 100 according to one embodiment may include: acquiring a cinematic image (1100).

[0170] The ultrasound imaging system 100 can acquire a cinematic image comprising multiple ultrasound image frames based on echo signals and shear wave tracking signals received from the probe 20. Each ultrasound image frame can be configured as a B-mode image, an elasticity image, and a reliability measurement index (RMI) image aligned at the same timestamp.

[0171] A control method for an ultrasound imaging system 100 according to one embodiment may include: calculating the elastic modulus measurement fit (1200) for each image frame.

[0172] The ultrasound imaging system 100 can determine the suitability of elastic modulus measurement by analyzing the elastic image data and elastic reliability image data of each of the multiple ultrasound image frames constituting a movie image.

[0173] The fit of elastic modulus measurement can be determined and displayed in real time simultaneously with image acquisition.

[0174] Elastic modulus measurement goodness refers to a quantitative index indicating how well it is suitable for measuring the elastic modulus in a specific ultrasound image frame. Elastic modulus measurement goodness can be expressed as a score within a specific range by comprehensively analyzing the homogeneity of the elastic image and the reliability of the elastic reliability image. For example, elastic modulus measurement goodness can be expressed as an index greater than or equal to 1 and less than or equal to 5 for a specific shape. By using the index value, the measurement quality of each image frame can be objectively and consistently evaluated, and optimal measurement conditions can be automatically identified without relying on user subjective judgment.

[0175] In this process, the measurement quality of each frame can be quantitatively evaluated by comprehensively considering elastic uniformity and reliability index.

[0176] A control method for an ultrasound imaging system 100 according to one embodiment may include: automatically extracting image frames (1300) for measuring the elastic modulus.

[0177] The ultrasound imaging system 100 can automatically select image frames with a fit greater than or equal to a reference value based on a calculated fit of elastic modulus measurement. In this case, a threshold for automatically extracting image frames can be preset and stored in memory 150. Furthermore, according to various embodiments, the threshold can be changed based on user input received through input interface 170, and the changed threshold can be stored in memory 150 and immediately applied to extract new suitable frames. Therefore, frames unsuitable for measurement can be excluded, and only frames suitable for measurement can be extracted with high reliability. Thus, consistent examination quality can be guaranteed without relying on the examiner's skill or experience, thereby achieving standardization of diagnostic accuracy and improved reproducibility.

[0178] Specifically, automatically extracting image frames for elastic modulus measurement may include automatically extracting multiple image frames for elastic modulus measurement based on whether the elastic modulus measurement fitness is greater than or equal to a reference value. For example, an ultrasound imaging system 100 may automatically extract image frames for elastic modulus measurement based on whether the elastic modulus measurement fitness of the image frames is greater than or equal to a reference value.

[0179] The ultrasound imaging system 100 can display, via a user interface, multiple image frames that were not extracted for elastic modulus measurement, based on the fact that the fitness for elastic modulus measurement of all image frames is less than a reference value. Information about the absence of multiple image frames for elastic modulus measurement can be displayed in various sensory information formats. Furthermore, the ultrasound imaging system 100 can provide guidance via a user interface for resetting the fitness for elastic modulus measurement threshold based on the fact that the fitness for elastic modulus measurement of all image frames is less than a reference value.

[0180] A control method for an ultrasound imaging system 100 according to one embodiment may include: automatically determining the location of the region of interest (ROI) for each extracted image frame (1400).

[0181] The ultrasound imaging system 100 can automatically determine the optimal ROI location for measurement based on elasticity image data and elasticity reliability image data for each extracted image frame. In this process, the location where the most accurate measurement can be performed can be identified by comprehensively analyzing the elasticity uniformity and reliability of each unit region.

[0182] In this disclosure, ROI can refer to a general area of ​​interest in an ultrasound image for a user or system. ROIs can be set to various sizes and shapes depending on diagnostic purposes and can represent target areas for image analysis, measurement, or processing.

[0183] On the other hand, the measurement ROI can be a specially designated area for measuring the elastic modulus and can represent a specific measurement point for obtaining a quantitative value of the elastic modulus. The measurement ROI can typically be implemented in a circular or rectangular shape, and its size and shape can be automatically optimized to take into account elastic uniformity and reliability. Furthermore, according to various embodiments, the size and shape of the measurement ROI can be changed based on user input received through input interface 170. The elastic modulus value calculated within the measurement ROI can be used as a quantitative index directly for clinical diagnosis.

[0184] A control method for an ultrasound imaging system 100 according to one embodiment may include: displaying an indicator (1500) in the extracted image frames that indicates at least one of the following: the fitness of elastic modulus measurement, the location of the measured ROI, or the sorting order of the extracted image frames.

[0185] When one of the extracted image frames is displayed on the display 140, the ultrasound imaging system 100 can provide various indicators indicating the suitability of the elastic modulus measurement, the location of the measured ROI, or the sorting order. Therefore, the user can check and evaluate the reliability and quality of the measurement results in real time. The indicator used to indicate the suitability of the elastic modulus measurement may be referred to as a first indicator. The indicator used to indicate the location of the measured ROI may be referred to as a second indicator. The indicator used to indicate the sorting order may be referred to as a third indicator. The first, second, and third indicators will be described in detail below.

[0186] Figure 5 This is a flowchart illustrating a method for calculating the fitness of elastic modulus measurement for each image frame according to one embodiment.

[0187] Figure 6 This is a block diagram that briefly illustrates the configuration and processing of data inputs and outputs in the process of determining the suitability of the elastic modulus measurement.

[0188] A method (1200) for calculating the fitness of a modulus of elasticity measurement according to one embodiment may include generating a standard deviation (STD) mapping of elastic uniformity (1201).

[0189] The ultrasound imaging system 100 can calculate the standard deviation of elasticity uniformity for each unit region from elasticity image data 50 for each of multiple image frames. The standard deviation of elasticity uniformity for each unit region can represent an index indicating the degree of uniformity of elasticity coefficient values ​​within a kernel of a predetermined size (e.g., 5×5 pixels or 7×7 pixels) in each image frame.

[0190] The ultrasound imaging system 100 can also calculate the standard deviation of the elastic modulus of the surrounding area at each location when scanning the entire elastic image in a sliding window manner.

[0191] The ultrasound imaging system 100 generates an elastic homogeneity STD mapping M1 by normalizing and inverting the calculated standard deviation values. In this process, regions with small standard deviations (homogeneous regions) are converted to high values, and regions with large standard deviations (non-homogeneous regions) are converted to low values. Normalization can be performed using the formula (homogeneity = 1 - (standard deviation / maximum possible standard deviation)), and the final value can be represented in the range of 0 to 1. The ultrasound imaging system 100 generates the STD mapping M1 by spatially mapping the final values.

[0192] A method (1200) for calculating the fitness of a modulus of elasticity measurement according to one embodiment may include generating an average elastic reliability map (1202) for each unit region M2 from elastic reliability image data 60 of each of a plurality of image frames.

[0193] Elastic reliability image data can consist of values ​​ranging from 0 to 1, representing the elastic measurement reliability at each pixel. The ultrasound imaging system 100 can calculate the average elastic reliability for each unit region by applying a kernel of the same size as the elastic homogeneity STD mapping.

[0194] The ultrasound imaging system 100 can apply morphological operations (opening operations) to the calculated average elastic reliability map M2 to remove noise and mitigate the effects of low reliability regions. Morphological opening operations are performed after erosion, resulting in the removal of isolated noisy pixels and smoothing of boundaries. Therefore, the effects of temporary signal quality degradation or motion artifacts can be minimized.

[0195] A method (1200) for calculating the fitness of a modulus of elasticity measurement according to one embodiment may include: generating a first combined mapping map CM1 (1203).

[0196] The ultrasound imaging system 100 can generate a first combined mapping map by combining the elastic uniformity STD mapping map M1 with the average elastic reliability mapping map M2.

[0197] The ultrasound imaging system 100 can synthesize representative elasticity homogeneity STD maps and average elasticity reliability maps using various methods. For example, a first combined map can be generated by multiplying pixel values ​​at the same location using element-wise multiplication. In another embodiment, a weighted sum method can be used, and in this case, the formula: Combined_Map = α × STD_map + β × elasticity reliability_map (α + β = 1) can be applied. Combined_Map can represent the first combined map, α can represent the weight values ​​of the STD map, β can represent the weight values ​​of the elasticity reliability map, STD_map can represent a representative elasticity homogeneity STD map, and elasticity reliability_map can represent the average map.

[0198] A method (1200) for calculating the fitness of a modulus of elasticity measurement according to one embodiment may include: calculating the average value (1204) of data from a first combined mapping map CM1.

[0199] The ultrasound imaging system 100 can calculate the average value of all pixel values ​​in the generated first combined map CM1. This average value can be used as an index of the overall measurement quality of the corresponding image frame.

[0200] The ultrasound imaging system 100 can apply various methods when calculating the average value of the first combined map. When using an arithmetic mean, the average value can be calculated by summing all pixel values ​​and dividing by the total number of pixels. When using a weighted average, higher weight values ​​can be assigned to the center of the image, or the weight values ​​can be applied only to pixels within the ROI. Additionally, the average value can be calculated by applying a cropped average method to minimize the influence of extreme values. For example, the average value can be calculated by excluding the top 5% and bottom 5% of values.

[0201] A method (1200) for calculating the fitness of elastic modulus measurement according to one embodiment may include: determining the fitness of elastic modulus measurement for each image frame (1205).

[0202] The ultrasound imaging system 100 determines the fit of elastic modulus measurement by assigning an integer score between 1 and 5 to the average value of a first combined mapping. For example, a range from 0.0 to 0.2 can be classified as 1 point, from 0.2 to 0.4 as 2 points, from 0.4 to 0.6 as 3 points, from 0.6 to 0.8 as 4 points, and from 0.8 to 1.0 as 5 points. Through this scoring process, the measurement quality of each image frame can be represented as an intuitively identifiable integer value. (Refer to...) Figure 6 The process of converting the average value of the first combined map into an integer value between 1 and 5 can be visually represented and provided as a visual indicator distinguished by color according to each fitness level.

[0203] The ultrasound imaging system 100 can store the calculated elastic modulus measurement fit in memory 150 and use the calculated elastic modulus measurement fit in subsequent frame selection processing. Furthermore, the parameters of the fit calculation algorithm can be adjusted based on user input received via input interface 170. For example, the user can adjust the weight ratio of the STD map and the elastic reliability map, and the setting values ​​can be stored in memory 150 and applied to subsequent inspections.

[0204] Figure 7 This is a flowchart illustrating a method for automatically determining the location of a measured region of interest (ROI) for each extracted image frame according to one embodiment.

[0205] Figure 8 This is a block diagram that briefly illustrates the configuration and processing of input and output data during the automatic determination of the measurement ROI location.

[0206] A method (1400) for automatically determining the location of a region of interest (ROI) according to one embodiment may include generating an elastic uniformity map M3 (1401) by calculating the elastic uniformity of each unit region from elastic image data 50.

[0207] Elastic uniformity per unit area can refer to an index of the consistency of elastic modulus values ​​within a specific region (e.g., 5×5 pixels, 7×7 pixels, or 9×9 pixels) surrounding each pixel. Unlike the fitness calculations described above that apply to the entire frame, this can refer to the process of evaluating individual uniformity for each measured ROI size.

[0208] For example, the ultrasound imaging system 100 can calculate the average value of the elastic modulus of the core region centered on each pixel using a sliding window method.

[0209] The ultrasound imaging system 100 can generate an elastic uniformity mapping map M3 by spatially mapping the calculated elastic uniformity values.

[0210] A method (1400) for automatically determining the location of a measured ROI according to one embodiment may include: generating an average elastic reliability map M2 for each unit region from elastic reliability image data 60 (1402).

[0211] The average elastic reliability of each unit region can refer to the result of calculating the average elastic reliability value in a kernel region of the same size around each pixel. The ultrasound imaging system 100 can ensure spatial consistency by using the same kernel size as the elasticity uniformity calculation. The elastic reliability value can be a continuous value ranging from 0 to 1 and can represent the elasticity measurement reliability at each location.

[0212] The elastic reliability image data can consist of values ​​ranging from 0 to 1, representing the elastic measurement reliability at each pixel. The ultrasound imaging system 100 can calculate the average elastic reliability for each unit region by applying a kernel of the same size as that used to generate the elastic homogeneity STD mapping.

[0213] The ultrasound imaging system 100 can apply morphological operations (opening operations) to the calculated average elastic reliability map M2 to remove noise and mitigate the effects of low reliability regions. Morphological opening operations are performed after erosion, resulting in the removal of isolated noisy pixels and smoothing of boundaries. Therefore, the effects of temporary signal quality degradation or motion artifacts can be minimized.

[0214] A method (1400) for automatically determining the location of a measured ROI according to one embodiment may include generating a second combined mapping map (1403). The ultrasound imaging system 100 may synthesize an elastic homogeneity STD mapping map and an average elastic reliability mapping map using various methods. For example, the second combined mapping map CM2 may be generated by multiplying pixel values ​​at the same location using element-wise multiplication. Alternatively, the ultrasound imaging system 100 may apply a first weighting value to the elastic homogeneity mapping map M3 and a second weighting value to the average elastic reliability mapping map M2 to calculate a composite score for each unit region and generate a second combined mapping map CM2 reflecting the composite score.

[0215] The ultrasound imaging system 100 can determine a first weighting value and a second weighting value based on a user identifier obtained from the input interface 170 or the communication interface. The weighting values ​​applied to elastic homogeneity and elastic reliability can vary depending on the user. For example, one user may apply a high weight (0.7) to elastic homogeneity, while another user may apply a high weight (0.7) to elastic reliability.

[0216] Composite scores can be calculated in various ways. The most common method is the weighted sum method, which uses the following formula to calculate the composite score: Combined_Score = w1 × Uniformity + w2 × Elasticity Reliability (w1 + w2 = 1). Here, Combined_Score represents the composite score for each pixel, w1 represents the weight value for elasticity uniformity, w2 represents the weight value for elasticity reliability, Uniformity represents the pixel's elasticity uniformity value, and ElasticityReliability represents the pixel's elasticity reliability value.

[0217] The ultrasound imaging system 100 can normalize the calculated composite score to a range from 0 to 1 and spatially map the normalized value for each unit region to generate a second composite map CM2. According to various embodiments, the normalization process can use minimum-maximum scaling, Z-score normalization, or an optimization function based on clinical data, and the selected method can be stored in memory 150 to maintain consistency in the normalization.

[0218] A method (1400) for automatically determining the location of a measurement ROI according to one embodiment may include: extracting a unit region (1404). The ultrasound imaging system 100 may extract the unit region from a second composite map based on a composite fraction.

[0219] For example, the ultrasound imaging system 100 can extract a single unit region with the maximum composite score from the second composite map.

[0220] As another example, the ultrasound imaging system 100 may additionally extract at least one unit region whose average elastic reliability per unit region is greater than or equal to a preset threshold. The threshold can be adjusted by the user, and for example, it can be set to 0.7 or greater. This extraction of multiple candidate regions provides the user with a variety of measurement options.

[0221] The ultrasound imaging system 100 can check whether the extracted candidate region is larger than or equal to the minimum required size (e.g., 5 × 5 mm) and whether the region is kept at a minimum distance from the image boundary (e.g., 1 mm or more). Additionally, the distance to anechoic structures (such as blood vessels or bile ducts) can be calculated, and regions spaced 1 mm or more apart can be selected first.

[0222] The morphological characteristics of the region can also be considered, thus regions in which the spatial distribution of the composite fractions approximates a circle or ellipse can be preferred. Various tools can be used to calculate shape complexity for this purpose, and regions with lower complexity can be selected first.

[0223] A method (1400) for automatically determining the location of a measurement ROI according to one embodiment may include: determining the measurement ROI location as including an extracted unit region (1405). The ultrasound imaging system 100 may determine the location of the measurement ROI as including a unit region having a maximum composite score.

[0224] The ultrasound imaging system 100 can determine the size and shape of the measurement ROI based on the estimated size of the lesion or values ​​set by the user through the input interface 170. For example, a circular measurement ROI with a diameter of 10 mm can be used standardly for liver fibrosis measurement, and a square measurement ROI with a diameter of 20 mm can be used standardly for breast tumor assessment.

[0225] The location of the measured ROI can be determined based on the center of the extracted unit region, but can be finely adjusted to avoid image boundaries or artifacts. The adjustment range can be limited to a specific number of millimeters from the original location. During the adjustment process, optimization algorithms can be applied to maximize the average composite fraction within the measured ROI.

[0226] The ultrasound imaging system 100 can also define at least one measurement ROI location as at least one unit region in which the average resilient reliability of each unit region is greater than or equal to a threshold. When multiple measurement ROIs are defined, a minimum distance can be maintained between each measurement ROI to prevent duplicate measurements. For example, the minimum distance can be set to 0.5 times the diameter of the measurement ROI.

[0227] When the ultrasound imaging system determines the location of the ROI to be measured, an indicator (i.e., a second indicator) used to indicate the location of the ROI can be displayed on the elasticity image and the elasticity reliability image, respectively. When multiple ROIs are determined, each location can be displayed with a different color (e.g., red, blue, green) or size.

[0228] The ultrasound imaging system 100 can store information about the determined ROI location in memory 150 for reference during subsequent follow-up examinations of the same patient. Furthermore, when the user manually adjusts the ROI location via input interface 170, the adjusted location information can be stored and used as learning data. This feedback information can be used to improve future automated ROI determination algorithms.

[0229] Figure 9 This is a diagram illustrating various indicators provided along with image frames displayed on a display of an ultrasound imaging system, according to one embodiment.

[0230] According to one embodiment, a method for controlling an ultrasound imaging system 100 may include displaying one of a plurality of extracted image frames and simultaneously displaying at least one of the following indicators: a first indicator for indicating the elastic modulus measurement fit of the displayed image frame; a second indicator for indicating the automatically determined measurement ROI location of the displayed image frame; and a third indicator for indicating the sorting order of the displayed image frame among the plurality of extracted image frames.

[0231] Reference Figure 9 Image frame D2 may include a first indicator 300, a second indicator 400, and / or a third indicator 500.

[0232] In this disclosure, an indicator can refer to any form of display means used to visually convey specific information to a user. Indicators can include graphic elements, text information, color displays, geometric shapes, animation effects, or combinations thereof. Indicators can be categorized into static display methods and dynamic display methods. A static display method refers to displaying an indicator in a fixed form and at a fixed position, while a dynamic display method refers to changing over time or in response to user input. Furthermore, indicators can employ various visual representation methods, such as two-dimensional planar display, three-dimensional stereoscopic display, semi-transparent overlay display, flashing display, and gradient display.

[0233] An indicator may include at least one display element.

[0234] Display elements refer to individual visual elements that form indicators. Display elements can include icons, text, numbers, lines, dots, surfaces, color blocks, progress bars, buttons, sliders, checkboxes, radio buttons, drop-down menus, pop-ups, tooltips, badges, labels, symbols, shapes, graphics, charts, or combinations thereof. Each display element can have unique visual attributes (including color, size, shape, transparency, position, rotation, texture, border style, shadow effects, glow effects, animation effects, etc.). Display elements can be categorized into active elements that allow user interaction and passive elements that only display information.

[0235] Reference Figure 9 The first indicator 300 can be displayed to indicate the fit of the elastic modulus measurement of the displayed image frame.

[0236] exist Figure 9 In the figure, the first indicator 300 is arranged in the upper right area of ​​the image, but this is only one embodiment. The display position of the first indicator is not limited to the figure. According to various embodiments, the first indicator 300 may be arranged in the upper left, lower left, lower right, upper center, lower center, or a separate area outside the image. In addition, the user can freely set or move the position of the first indicator through the input interface 170, and the set position information can be stored in the memory 150 and applied in the same manner in the next inspection.

[0237] The first indicator 300 may consist of multiple display elements, and may include at least one of the following: numerical display elements, color display elements, graphic display elements, progress bar display elements, or icon display elements. The first indicator 300 may determine the color, quantity, size, or shape of the included display elements based on a preset score range to which the elastic modulus measurement fit belongs. For example, a green shading may be displayed as a higher fit, and a red shading as a lower fit. Furthermore, even within the same score range, the quantity or brightness of the display elements may be adjusted according to the specific fit.

[0238] Reference Figure 9 The second indicator 400 can be displayed to indicate the automatically determined position of the measured ROI of the displayed image frame.

[0239] The second indicator 400 can be displayed directly overlaid on the resilience image and resilience reliability image, allowing users to immediately identify the exact location of the measured ROI.

[0240] like Figure 9 As shown, the second indicator 400 may include display elements that indicate the location of the measured ROI in each of the two images (the resilience image and the resilience reliability image).

[0241] The second indicator 400 can be implemented as a display element of various shapes, and may include circular, rectangular, elliptical, polygonal, crosshair, or combinations thereof. Each display element can be implemented as a solid line, dotted line, dashed line, double line, or gradient line, and the line thickness, color, and transparency can be adjusted to optimize visibility. When multiple locations of a measured ROI are automatically determined, each location can be distinguished by display elements of different colors (e.g., red, blue, green, and yellow), sizes, or shapes.

[0242] Reference Figure 9 The third indicator 500 can be displayed to indicate the sorting order of the displayed image frames among the extracted image frames.

[0243] The third indicator 500 can be arranged in Figure 9 The third indicator is located in the lower right area of ​​the image, but this is only one embodiment. The display position of the third indicator is not limited to the accompanying drawings. According to various embodiments, the third indicator 500 may be arranged at the top, left, and right of the image, or in a separate control panel area outside the image. In addition, the third indicator 500 may be arranged horizontally, vertically, circularly, or in a user-defined shape, and the user can set the arrangement direction and position through the input interface 170.

[0244] The third indicator 500 may consist of multiple display elements, and may include at least one of the following: a progress bar display element, a pagination display element, a label display element, a timeline display element, a slider display element, or a number display element. The third indicator 500 can intuitively express the position of the current frame according to the chronological order or the order of elastic modulus measurement fit, and can provide the relative position of the current frame with respect to the total number of frames, navigation to the previous / next frame, and the function of directly moving to a specific frame.

[0245] In one embodiment, the ultrasound imaging system 100 can provide interaction between a first indicator 300, a second indicator 400, and a third indicator 500. For example, when the ultrasound imaging system 100 moves to another frame via the third indicator 500, the first indicator 300 can immediately update the fit of the corresponding frame, and the second indicator 400 can redisplay the ROI position of the corresponding frame. Additionally, when a specific fit level is selected in the first indicator 300, a filtering function can be provided to allow only frames corresponding to that level to be displayed in the third indicator 500.

[0246] Each indicator can be individually controlled to be displayed / hide according to user settings, and customization features are available (such as size adjustment, transparency adjustment, and color theme change). This setting information can be stored in memory 150 and managed for each user or each diagnostic object, and previous settings can be automatically applied when the same user performs the next check.

[0247] Figure 10 This is a diagram illustrating a method for configuring and displaying a first indicator according to one embodiment.

[0248] Reference Figure 10 The first table T1 represents a reference table used to illustrate the display method of the elastic modulus measurement fit according to the first indicator 300. The first table T1 is not displayed in the actual image frame and is an illustrative diagram demonstrating various display forms of the first indicator. The elastic modulus measurement fit display section 310 is a section used to illustrate the elastic modulus measurement fit value indicated by each first indicator 300 and is not displayed in the actual image frame. This section is intended only as reference information to aid in understanding the accompanying drawings.

[0249] The ultrasound imaging system 100 can determine the color of a first display element included in the first indicator 300 based on a preset score range to which the elastic modulus measurement fit of the displayed image frame belongs. As can be seen in the first table T1, areas with high fit can be displayed in a first color (e.g., a green shading), areas with medium fit can be displayed in a second color (e.g., a yellow shading), and areas with low fit can be displayed in a third color (e.g., a red shading).

[0250] Furthermore, the ultrasound imaging system 100 can determine the number of first display elements such that the number of first display elements included in the first indicator 300 increases as the elastic modulus measurement fit increases within the same fractional range. That is, even within the same fractional range, the number or brightness of display elements can be adjusted according to the specific fit. As can be seen in the first table T1, a larger number (e.g., 5) of first display elements can be activated and displayed in the first indicator 301 with high fit, a medium number (e.g., 4 or 3) of first display elements can be activated and displayed in the first indicator 302 or 303 with medium fit, and a relatively small number (e.g., 2 or 1) of first display elements can be activated and displayed in the first indicator 304 or 305 with low fit.

[0251] The first display element can be arranged in a linear, circular, or user-defined shape, and the size, spacing, and transparency of each display element can be adjusted.

[0252] The ultrasound imaging system 100 allows the user to set the display method of the first indicator via the input interface 170. For example, the color theme, the shape of the display elements (circle, rectangle, rhombus, etc.), the arrangement method, the size, etc., can be adjusted according to the user's preferences, and the setting information can be stored in the memory 150 and applied in the same way to the next examination.

[0253] Figure 11 This is a diagram illustrating a method for configuring and displaying a second indicator according to one embodiment.

[0254] Reference Figure 11 The image frame D3 displayed on the display 140 may include a first ultrasound image (e.g., Figure 3 U1) and second ultrasound images (e.g., Figure 3 The dual-view format (U2) is configured. The ultrasound imaging system 100 can display one of the extracted image frames while simultaneously displaying a second indicator 401 for indicating the location of the measured ROI.

[0255] The second indicator 401 may include: a second display element 401a for indicating the location of the automatically determined measurement ROI in the first ultrasound image; and a third display element 401b for indicating the location of the automatically determined measurement ROI in the second ultrasound image. The second display element 401a and the third display element 401b may have the same color, the same shape, and the same size. This is to visually indicate that the measurement ROI in the first and second ultrasound images is located at the same corresponding anatomical position.

[0256] The second display element 401a and the third display element 401b can be displayed in at least one of the following shapes: circle, rectangle, cross, rhombus, or user-defined shape. Additionally, each display element can be displayed as at least one of the following: solid line, dashed line, double line, or line with a gradient effect.

[0257] The ultrasound imaging system 100 can adjust the transparency of the second indicator 401 to prevent the ultrasound image positioned below the second indicator 401 from being obscured. The ultrasound imaging system 100 can adjust the transparency based on user input received through the input interface 170. For example, the transparency of the second display element 401a and the third display element 401b can be determined to be a value between 30% and 80%.

[0258] A second indicator 401 may be displayed when at least one of the center point, boundary, or entire area of ​​the measured ROI is displayed.

[0259] Figure 12 This is a diagram illustrating a method for configuring and displaying a plurality of second indicators according to another embodiment.

[0260] Reference Figure 12 Image frame D4 displayed on display 140 includes the first ultrasound image (e.g., Figure 3 U1) and second ultrasound images (e.g., Figure 3 The dual-view format (U2) is configured, and the display method is indicated when multiple measurement ROI locations are set. The ultrasound imaging system 100 can simultaneously display multiple second indicators 402 and 403.

[0261] The second indicator 402 may indicate the location of the first measured ROI and may include a second display element 402a displayed on the first ultrasound image and a third display element 402b displayed on the second ultrasound image. Within the second indicator 402, the second display element 402a and the third display element 402b may have the same color, shape, and size to indicate the corresponding location.

[0262] The second indicator 403 may indicate the location of the second measured ROI and may include a second display element 403a displayed on the first ultrasound image and a third display element 403b displayed on the second ultrasound image. Within the second indicator 403, the second display element 403a and the third display element 403b may have the same color, shape, and size to indicate the corresponding location.

[0263] When multiple second indicators 402 and 403 are displayed in a single image frame, each indicator can be distinguished by at least one visual attribute, such as a different color, shape, size, line style, or pattern. For example, second indicator 402 can be displayed as a yellow circle, and second indicator 403 can be displayed as a red circle. This visual distinction allows users to clearly differentiate and track multiple measured ROIs.

[0264] The ultrasound imaging system 100 can display measurement values ​​or identification information corresponding to each of the second indicators 402 and 403. For example, at least one of the following can be displayed in text or graphic form near each indicator: the measurement ROI number, the measured elastic modulus value, the measurement time, or the measurement depth information.

[0265] When multiple second indicators are displayed, the ultrasound imaging system 100 can emphasize and display a specific second indicator based on user input received through the input interface 170. Emphasis can be achieved by increasing the brightness of the selected indicator, emphasizing its borders, or applying animation effects. The ultrasound imaging system 100 can determine the indicator to be emphasized based on user input received through the input interface 170.

[0266] According to various embodiments, the ultrasound imaging system 100 allows a user to customize the display method of the second indicators 400, 401, 402, and 403. The user can set the indicator's color palette, shape library, size range, transparency level (e.g., 30% to 80%), line style, animation attributes, etc., and the settings can be stored in memory 150 and applied to subsequent examinations.

[0267] According to various embodiments, the ultrasound imaging system 100 can detect mouse hover, touch, or hover gestures on the second indicator 400, thereby displaying additional information in the form of pop-ups, tooltips, or side panels. The additional information may include detailed measurements of the corresponding ROI, measurement parameters, measurement reliability, measurement time, or relevant clinical information.

[0268] According to various embodiments, the ultrasound imaging system 100 can adjust the position of the second indicator 400 using a drag-and-drop method, and the adjusted position information can be stored in memory 150 in real time and applied to the measurement algorithm. This allows the user to manually fine-tune the automatically determined measurement ROI position. When adjusting the position, the ultrasound imaging system 100 can calculate and display the expected measurement value or measurement fit at the adjusted position in real time.

[0269] According to various embodiments, the ultrasound imaging system 100 can provide a variety of display modes for the second indicator 400. For example, the display mode can be selected from a "always display" mode, a "display only when selected" mode, a "display only during measurement" mode, or an "auto-hide" mode. Each mode can be selected based on clinical workflow and user preferences.

[0270] According to various embodiments, the ultrasound imaging system 100 can set the display priority of the second indicator 400. When multiple indicators overlap, the indicator with higher priority can be displayed in front or more clearly. The priority can be determined based on the magnitude of the measurement, measurement time, measurement reliability, or user-specified criteria.

[0271] Figure 13 This is a diagram illustrating the configuration and display method of a third indicator when ordered chronologically according to one embodiment.

[0272] Reference Figure 13 The ultrasound imaging system 100 may display a third indicator 500a to indicate the sorting order of the image frames when displaying one of the extracted image frames. The third indicator 500a can visually indicate which position among the multiple image frames sorted in chronological order the currently displayed image frame corresponds to.

[0273] The third indicator 500a may include a fourth display element 501a that displays information about the sorting criteria. For example, such as Figure 13As shown, the fourth display element 501a can use the text "Time" to indicate the application's chronological order. According to various embodiments, the fourth display element 501a can be displayed as a clock icon, a timeline symbol, or various other graphic elements that allow users to visually identify the concept of time.

[0274] The third indicator 500a may include a fifth display element 502a, which displays information about the sorting order of the image frames displayed when sorting multiple extracted image frames according to a sorting criterion. The fifth display element 502a may be configured as multiple display units arranged in equally spaced color blocks, and each display unit may correspond to one extracted image frame. The display unit corresponding to the currently displayed image frame may be highlighted. For example, the display unit corresponding to the currently displayed image frame may be emphasized in yellow or a bright color, enlarged in size, or may be given a flashing effect.

[0275] The third indicator 500a may include a sixth display element 503a that indicates the sequential position of the currently displayed frame within the extracted image frames. For example, as Figure 13 As shown, the sixth display element 503a, displayed as "#7 / 13", indicates that the 7th frame out of 13 extracted image frames is currently being displayed. According to various embodiments, the sixth display element 503a can be modified to various formats, such as "the 7th out of 13", "7-13", "[7 / 13]", or a progress bar.

[0276] The third indicator 500a may include a seventh display element 504a that indicates the position of the displayed image frame within the entire movie image. For example, as Figure 13 As shown, the portion displayed as "#69 / 115" indicates that it is the 69th frame out of 115 frames in the entire movie image.

[0277] The third indicator 500a may include an eighth display element 505a that displays time information. For example, as Figure 13 As shown, the portion displayed as "10s / 13s" indicates that the current frame is displayed at the 10-second mark during the playback of the movie image, and the total playback time is 13 seconds. According to various embodiments, the eighth display element 505a can be represented in various ways, such as in timecode format (00:10 / 00:13), percentage display (77%), or analog clock format.

[0278] Figure 14 This is a diagram illustrating the configuration and display method of a third indicator when ordered according to the fit of elastic modulus measurements, according to another embodiment.

[0279] Reference Figure 14The ultrasound imaging system 100 can display one of multiple extracted image frames, and simultaneously display a third indicator 500b indicating the sorting order of the image frames. The third indicator 500b visually indicates which position among the multiple image frames, sorted according to the fit of the elastic modulus measurement, the currently displayed image frame corresponds to.

[0280] The third indicator 500b may include a fourth display element 501b that displays information about the sorting criteria. For example, as Figure 14 As shown, the fourth display element 501b can indicate the order of applications by fit using the text "fit". According to various embodiments, the fourth display element 501b can be displayed as a quality index icon, a star symbol, a check mark, a rating badge, a reliability meter, or other visual elements indicating the quality of the measurement.

[0281] The third indicator 500b may include a fifth display element 502b, which displays information about the sorting order of the image frames when the extracted multiple image frames are sorted according to a sorting criterion. Figure 13 Similar to the fifth display element 502a, the fifth display element 502b can be configured as multiple display units arranged in equally spaced color blocks, and each display unit can correspond to an extracted image frame.

[0282] Specifically, in Figure 14 In the fifth display element 502b, the color of each display unit can be displayed differently based on the fitness level measured by the elastic modulus of the corresponding image frame. For example, display units corresponding to frames with high fitness can be displayed in green, those corresponding to frames with medium fitness in yellow, and those corresponding to frames with low fitness in red. Through this color coding, the user can clearly grasp the fitness distribution of all extracted frames at a glance. Display units corresponding to the currently displayed image frame can be highlighted, and for example, borders can be emphasized, sizes can be enlarged, or flashing effects can be applied.

[0283] The third indicator 500b may include a sixth display element 503b that indicates the sequential position of the currently displayed frame within the extracted image frames. For example, as Figure 14 As shown, the sixth display element 503b, displayed as "#6 / 13", indicates that the current frame ranks 6th out of 13 extracted frames when sorted by fit. This can indicate a different order than chronological sorting and allows the user to prioritize viewing frames with good quality. According to various embodiments, the sixth display element 503b can be modified in various formats, such as "6th out of 13", "6 / 13", "[Fitness Rank: 6 / 13]", or as a ranking badge.

[0284] The third indicator 500b may include a seventh indicator element 504b that indicates the position of the displayed image frame within the entire movie image. For example, as Figure 14 As shown, the portion displayed as "#69 / 115" indicates that the current frame is the 69th frame out of 115 frames in the entire movie image. This indicates the time position within the original movie image, regardless of the order in which it is sorted by fit.

[0285] The third indicator 500b may include an eighth display element 505b that displays time information. For example, as Figure 14 As shown, the portion displayed as "10s / 13s" indicates that the current frame is displayed at the 10-second mark during movie image playback, and the total playback time is 13 seconds. This allows the user to grasp the temporal context of the original image even when sorted by fit. According to various embodiments, the eighth display element 505b can be represented in various ways, such as in a timestamp format (10.0s), frame rate display (300 / 390 frames), or time bar graph format.

[0286] According to various embodiments, the ultrasound imaging system 100 may selectively display or combine components of the third indicators 500, 500a, and 500b. For example, in a simple view mode, only the fourth display elements 501a and 501b and the sixth display elements 503a and 503b may be displayed to provide only key information, while in a detailed view mode, all the fourth display elements 501 to the eighth display element 505 may be displayed to provide comprehensive information.

[0287] According to various embodiments, the ultrasound imaging system 100 can change the sorting criteria in real time based on user input received through the input interface 170. When the sorting criteria change, the process of rearranging the display units of the fifth display elements 502a and 502b can be displayed as a smooth transition animation, so that the user can intuitively understand the change in the order position due to the change in the sorting criteria.

[0288] According to various embodiments, the ultrasound imaging system 100 may support additional sorting criteria for the third indicator 500. For example, the criteria may include "sorting by measurement size," "sorting by reliability," "sorting by coefficient of variation," "sorting by measurement depth," "sorting by ROI size," "sorting by pressure uniformity," or user-defined criteria. Each sorting criterion can be selected via drop-down menus, radio buttons, toggle switches, or gesture recognition.

[0289] According to various embodiments, the fifth display elements 502a and 502b can be represented in various visualizations other than bar shapes. The fifth display elements 502a and 502b can be implemented as circular dials, spiral timelines, matrix grids, thumbnail bars, 3D cubes, radial plots, or heatmaps. Each display unit can be represented not only as a simple color block, but also as a mini-thumbnail, a number, an icon, a pattern, a gradient, or an animation effect.

[0290] According to various embodiments, the ultrasound imaging system 100 may include interactive functionality in the third indicator. When a user clicks, touches, or hovers over a specific display unit of the fifth display element 502a or 502b, detailed information about the corresponding frame can be displayed as a tooltip, and double-clicking or long-pressing allows immediate movement to the corresponding frame. Additionally, navigation between frames can be performed via mouse wheel, swipe gestures, or keyboard shortcuts.

[0291] According to various embodiments, the ultrasound imaging system 100 allows users to customize the display position, size, transparency, color theme, etc. of the third indicator 500. The settings can be stored in the memory 150 and managed for each user profile, and optimized settings can be automatically applied based on the examination type or clinical situation.

[0292] Figure 15 This is a reference diagram illustrating a color coding scheme for a fifth display element according to one embodiment.

[0293] Reference Figure 15 The fifth display element 502 may include a progress bar L1 and multiple display units representing multiple extracted image frames. For example, the fifth display element 502 may include a first display unit F1, a second display unit F2, a third display unit F3, a fourth display unit F4, a fifth display unit F5, and a sixth display unit F6. Each display unit may be displayed as a color block superimposed on the progress bar L1. The color of each color block may represent the score range to which the elastic modulus measurement fit of the corresponding image frame belongs.

[0294] exist Figure 15 In this display unit, the numbers 1, 2, 3, 4, 5, and 6 represent frame indices, which indicate the time position when each frame was acquired within the movie image. For example, F1 is the first acquired frame, and F6 is the sixth acquired frame. These frame indices are used only as unique identifiers (as the basis for chronological ordering) and may not be displayed on the actual display 140.

[0295] The "Measurement Fit" value displayed at the top of each image frame indicates the elastic modulus measurement fit score calculated by the ultrasound imaging system 100 for the corresponding frame. For example, refer to... Figure 15The image frame corresponding to the first display unit F1 can correspond to a fitness level of 5, the image frame corresponding to the second display unit F2 can correspond to a fitness level of 3, the image frame corresponding to the third display unit F3 can correspond to a fitness level of 1, the image frame corresponding to the fourth display unit F4 can correspond to a fitness level of 3, the image frame corresponding to the fifth display unit F5 can correspond to a fitness level of 4, and the image frame corresponding to the sixth display unit F6 can correspond to a fitness level of 2.

[0296] The ultrasound imaging system 100 can define a preset fraction range based on the fit of the elastic modulus measurement and assign a specific color to the display unit according to each range.

[0297] For example, when the fitness test result of the elastic modulus measurement of an image frame is greater than or equal to 3 and less than or equal to 5, the display unit corresponding to the image frame can be displayed in green. (See reference...) Figure 15 The first display unit F1, the second display unit F2, the fourth display unit F4, and the fifth display unit F5 can be displayed as green blocks.

[0298] As another example, when the fitness of measurement for the elastic modulus of an image frame is 2, the display unit corresponding to the image frame can be displayed in yellow. (See reference...) Figure 15 The sixth display unit, F6, can be displayed as a yellow block.

[0299] As another example, when the fitness of the elastic modulus measurement of an image frame is 1, the display unit corresponding to the image frame can be displayed in red. (See reference...) Figure 15 The third display unit F3 can be displayed as a red block.

[0300] According to one embodiment, the ultrasound imaging system 100 allows a user to intuitively understand the measurement quality of each frame through color coding. The color range and threshold can be customized by the user through the input interface 170 and automatically adjusted according to the examination type or clinical protocol.

[0301] According to one embodiment, the ultrasound imaging system 100 may arrange multiple display units at equal intervals on the progress bar L1 in the fifth display element 502. When the display units are displayed too densely or overlapped, the user's visibility will be reduced; therefore, the ultrasound imaging system 100 may arrange the display units to allow maintaining a constant interval between each display unit.

[0302] According to one embodiment, the ultrasound imaging system 100 can dynamically adjust the spacing between display units based on the number of extracted frames. For example, when only one extracted frame exists, as in the first row of the third table T3 described below, only a single display unit can be displayed. When two extracted frames exist, as in the second row, the spacing between display units can be set to wide. When six extracted frames exist, as in the fifth row, the spacing can be set to relatively narrow.

[0303] According to one embodiment, the ultrasound imaging system 100 can display each display unit as a color block by overlaying each display unit onto a progress bar L1. The color of each display unit can be determined based on the fitness of the elastic modulus of the corresponding frame, and a consistent color coding can be applied regardless of the sorting criteria (time or fitness).

[0304] According to one embodiment, when frames with the same fitness score exist, the ultrasound imaging system 100 may apply a two-level sorting criterion. For example, when sorting by fitness score, frames with the same fitness score may be further sorted by frame index (in chronological order). In forward sorting, frames with lower frame indices may be displayed first, and in reverse sorting, frames with higher frame indices may be displayed first.

[0305] According to various embodiments, the ultrasound imaging system 100 can highlight the display unit corresponding to the currently displayed image frame. Highlighting can be achieved through methods such as border emphasis, size magnification, flashing effects, increased brightness, or arrow display.

[0306] Figure 16 This is a diagram illustrating various implementations of the fifth display element when ordered chronologically according to one embodiment.

[0307] Reference Figure 16 Table T2 includes various display formats of the fifth display element 502, which automatically extracts thresholds and sorting directions based on frames when the sorting criterion is time. Table T2 is an illustrative reference table that is not displayed on the actual screen and systematically organizes various implementation examples of the fifth display element 502.

[0308] The ultrasound imaging system 100 can automatically extract image frames whose elastic modulus measurement fit is greater than or equal to a preset threshold. Figure 16 In Table T2, the “Measurement fitness threshold” column indicates the fitness threshold used for image frame extraction, and the “Sort direction” column indicates the sorting direction (forward or reverse) by time.

[0309] For example, when the threshold is set to 5 and reverse sorting is applied, frames with a fitness level of 5 or greater can be extracted, as shown in the first row and first column of Table T2 in the second table. (See reference...) Figure 15 The first display unit F1 (fit 5) can be extracted, and only the first display unit F1 (fit 5) can be displayed on the progress bar L1.

[0310] For example, when the threshold is set to 5 and positive sorting is applied, frames with a fitness level of 5 or greater can be extracted, as shown in the first row and second column of Table T2. (See reference...) Figure 15The first display unit F1 (fit 5) can be extracted, and only the first display unit F1 (fit 5) can be displayed on the progress bar L1.

[0311] As another example, when the threshold is set to 4 and reverse sorting is applied, as shown in the second row, first column of Table T2, frames with a fitness level of 4 or greater for the elastic modulus measurement can be extracted. (See also...) Figure 15 The first display unit F1 (fit 5) and the fifth display unit F5 (fit 4) can be extracted, and these display units can be arranged from left to right in reverse frame index order (5→1). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0312] As another example, when the threshold is set to 4 and positive sorting is applied, as shown in the second row and second column of Table T2, frames with a fitness level of 4 or greater for the elastic modulus measurement can be extracted. (See also...) Figure 15 The first display unit F1 (fit 5) and the fifth display unit F5 (fit 4) can be extracted, and these display units can be arranged from left to right in a forward frame index order (1→5). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0313] As another example, when the threshold is set to 3 and reverse sorting is applied, as shown in the third row, first column of Table T2, frames with a fitness level of 3 or greater for the elastic modulus measurement can be extracted. (See reference...) Figure 15 The first display unit F1 (fit 5), the second display unit F2 (fit 3), the fourth display unit F4 (fit 3), and the fifth display unit F5 (fit 4) can be extracted, and these display units can be arranged from left to right in reverse frame index order (5→4→2→1). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0314] As another example, when the threshold is set to 3 and positive sorting is applied, as shown in the third row, second column of Table T2, frames with a fitness level of 3 or greater for the elastic modulus measurement can be extracted. (See reference...) Figure 15 Extract the first display unit F1 (fit 5), the second display unit F2 (fit 3), the fourth display unit F4 (fit 3), and the fifth display unit F5 (fit 4), and these display units can be arranged from left to right in a forward frame index order (1→2→4→5). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0315] As another example, when the threshold is set to 2 and reverse sorting is applied, as shown in the fourth row, first column of Table T2, frames with a fitness level of 2 or greater for the elastic modulus measurement can be extracted. (See reference...) Figure 15 The system can extract the first display unit F1 (fit 5), the second display unit F2 (fit 3), the fourth display unit F4 (fit 3), the fifth display unit F5 (fit 4), and the sixth display unit F6 (fit 2), and these display units can be arranged from left to right in reverse frame index order (6→5→4→2→1). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0316] As another example, when the threshold is set to 2 and positive sorting is applied, as shown in the fourth row, second column of Table T2, frames with a fitness level of 2 or greater for the elastic modulus measurement can be extracted. (See reference...) Figure 15 The system can extract the first display unit F1 (fit 5), the second display unit F2 (fit 3), the fourth display unit F4 (fit 3), the fifth display unit F5 (fit 4), and the sixth display unit F6 (fit 2), and these displays can be arranged from left to right in a forward frame index order (1→2→4→5→6). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0317] As another example, when the threshold is set to 1 and reverse sorting is applied, as shown in the fifth row, first column of Table T2, frames with a fitness level of 1 or greater for the elastic modulus measurement can be extracted. (See reference...) Figure 15 The system can extract the first display unit F1 (fit 5), the second display unit F2 (fit 3), the third display unit F3 (fit 1), the fourth display unit F4 (fit 3), the fifth display unit F5 (fit 4), and the sixth display unit F6 (fit 2), and these display units can be arranged from left to right in reverse frame index order (6→5→4→3→2→1). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0318] As another example, when the threshold is set to 1 and positive sorting is applied, as shown in the fifth row, second column of Table T2, frames with a fitness level of 1 or greater than or equal to 1 for the elastic modulus measurement can be extracted. (See reference...) Figure 15 The system can extract the first display unit F1 (fit 5), the second display unit F2 (fit 3), the third display unit F3 (fit 1), the fourth display unit F4 (fit 3), the fifth display unit F5 (fit 4), and the sixth display unit F6 (fit 2), and these display units can be arranged from left to right in a forward frame index order (1→2→3→4→5→6). The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0319] According to various embodiments, when the number of extracted frames is small, the ultrasound imaging system 100 can improve visual clarity by setting the spacing between display units to be wider.

[0320] Figure 17 This is a diagram illustrating various implementations of the fifth display element when sorted according to the order of measured fitness, according to one embodiment.

[0321] Reference Figure 17 Table T3 includes various display forms of the fifth display element 502, which automatically extracts reference values ​​and sorting directions based on frames when the sorting criterion is the fitness of the elastic modulus measurement. Table T3 is an illustrative reference table that is not displayed on the actual screen and systematically organizes various implementation examples of the fifth display element 502.

[0322] The ultrasound imaging system 100 can sort the extracted frames in descending order according to the fitness value of the elastic modulus measurement. Therefore, the ultrasound imaging system 100 can preferentially display image frames with high fitness values ​​for elastic modulus measurement. Figure 17 In Table T3, the “Measurement fitness threshold” column indicates the elastic modulus measurement fitness threshold used for image frame extraction, and the “sorting criteria” column indicates the elastic modulus measurement fitness.

[0323] For example, when the threshold is set to 5, as in the first row and first column of Table T3, frames with a fitness level of 5 or greater for the elastic modulus measurement can be extracted. (See reference...) Figure 15 It is possible to extract only the first display unit F1 (fit 5) and display only the first display unit F1 on the progress bar L1.

[0324] As another example, when the threshold is set to 4, as shown in the second row, first column of Table T3, frames with a fitness level of 4 or greater for the elastic modulus measurement can be extracted. (See also...) Figure 15 The first display unit F1 (fit 5) and the fifth display unit F5 (fit 4) can be extracted, and these display units can be arranged from left to right in descending order of fit (5→4). That is, F1 can be displayed first, and then F5 can be displayed. The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0325] As another example, when the threshold is set to 3, as shown in the first column of the third row of table T3, frames with a fitness measurement score greater than or equal to 3 can be extracted. (See reference...) Figure 15The system can extract the first display unit F1 (fit 5), the second display unit F2 (fit 3), the fourth display unit F4 (fit 3), and the fifth display unit F5 (fit 4), and these display units can be arranged from left to right in descending order of their flexibly measured fit (5→4→3(F2)→3(F4)). If F2 and F4 have the same fit, F2 can be displayed before F4 by using chronological order as a secondary sorting criterion. The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0326] As another example, when the threshold is set to 2 and reverse sorting (descending order) is applied, frames with a fitness level greater than or equal to 2 in the fourth row and first column of table T3 can be extracted. (See reference...) Figure 15 The system can extract the first display unit F1 (fit 5), the second display unit F2 (fit 3), the fourth display unit F4 (fit 3), the fifth display unit F5 (fit 4), and the sixth display unit F6 (fit 2), and these display units can be arranged from left to right in descending order of fit measured by elastic modulus (5→4→3(F2)→3(F4)→2). If F2 and F4 have the same fit, F2 can be displayed before F4 by using time order as a secondary sorting criterion. The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0327] As another example, when the threshold is set to 1 and reverse sorting (descending order) is applied, as in the fifth row, first column of table T3, all frames with a fitness level greater than or equal to 1 in the elastic modulus measurement can be extracted. (See reference...) Figure 15 All display units can be extracted: the first display unit F1 (fit 5), the second display unit F2 (fit 3), the third display unit F3 (fit 1), the fourth display unit F4 (fit 3), the fifth display unit F5 (fit 4), and the sixth display unit F6 (fit 2). These display units can be arranged from left to right in descending order of fit measured by elastic modulus (5→4→F2(3)→F4(3)→2→1). In the case where F2 and F4 have the same fit, F2 can be displayed before F4 by using time order as a secondary sorting criterion. The fifth display element 502 can arrange these display units at equal intervals on the progress bar L1.

[0328] As can be readily understood from the above description, a system can be provided that is configured to calculate the elastic modulus measurement fit of each image frame based on elastic image data and elastic reliability image data, and to score the elastic modulus measurement fit of each image frame, thereby consistently assessing measurement quality without the need for subjective judgment by the inspector.

[0329] In addition, a system may be provided that is configured to automatically determine the optimal ROI location by comprehensively analyzing the elastic uniformity and elastic reliability in the extracted image frames, and is configured to display multiple ROIs without mutual interference when multiple ROIs are required.

[0330] In addition, a system can be provided that is configured to enable users to intuitively identify quality and location information in real time by simultaneously displaying multiple indicators with image frames and providing user customization and interactive functions.

[0331] A control method for an ultrasound imaging system according to one embodiment may include: obtaining a cinematic image comprising a plurality of image frames by aligning an elastic image generated based on an elastic image based on shear wave tracking signals received from a probe at the same timestamp and an elastic reliability image generated based on parameters obtained from the shear wave tracking signals from the probe with an ultrasound image generated based on echo signals received from the probe; determining a fitness test for elastic modulus measurement for each of the plurality of image frames based on elastic image data and elastic reliability image data for each of the plurality of image frames; automatically extracting a plurality of image frames for measuring elastic modulus based on the fitness test for elastic modulus measurement; automatically determining the location of a region of interest (ROI) for measurement for each of the extracted image frames based on the elastic image data and elastic reliability image data for each of the extracted image frames; displaying one of the extracted image frames and simultaneously displaying at least one of a first indicator indicating the fitness test for elastic modulus measurement of the displayed image frame, a second indicator indicating the location of the automatically determined measurement ROI of the displayed image frame, and a third indicator indicating the sorting order of the displayed image frame among the extracted image frames.

[0332] The steps for determining the fitness of elastic modulus measurement may include: calculating the standard deviation of elastic uniformity for each unit region based on elastic image data of each image frame in a plurality of image frames, and generating an elastic uniformity STD map based on the standard deviation of elastic uniformity for each unit region; generating an average elastic reliability map for each unit region based on elastic reliability image data of each image frame in a plurality of image frames; generating a first combined map for each image frame in a plurality of image frames by combining the elastic uniformity STD map with the average elastic reliability map; and determining the fitness of elastic modulus measurement for each image frame in a plurality of image frames by calculating the average value of the first combined map.

[0333] In addition, the elastic average value can be calculated based on the elastic image data and divided into STD maps to generate a representative elastic uniformity STD map, and the representative elastic uniformity STD map can be combined with the average elastic reliability map to generate a first combined map for each of the multiple image frames.

[0334] The step of displaying one of the extracted image frames and simultaneously displaying a first indicator may include: determining the color of a first display element included in the first indicator based on a preset score range to which the elastic modulus measurement fit of the displayed image frame belongs.

[0335] The step of displaying one of the extracted image frames and simultaneously displaying a first indicator may include: determining the number of first display elements such that the number of first display elements included in the first indicator increases as the elastic modulus measurement fit of the displayed image frame increases within the same fractional range.

[0336] The step of displaying one of the extracted image frames may include: simultaneously displaying a first ultrasound image in which an elastic image is superimposed on an ultrasound image and a second ultrasound image in which an elastic reliability image is superimposed on an ultrasound image.

[0337] The step of displaying one of the extracted image frames and simultaneously displaying a second indicator may include: simultaneously displaying a second display element for indicating the location of the measurement ROI automatically determined on the first ultrasound image and a third display element for indicating the location of the measurement ROI automatically determined on the second ultrasound image.

[0338] The step of automatically determining the location of the measurement ROI for each image frame in the extracted image frames may include: generating an elasticity uniformity map by calculating the elasticity uniformity of each unit region based on elasticity image data of each image frame in the extracted image frames; generating an average elasticity reliability map for each unit region based on elasticity reliability image data of each image frame in the extracted image frames; calculating a composite score for each unit region by applying a first weight value to the elasticity uniformity map and by applying a second weight value to the average elasticity reliability map, and generating a second combined map reflecting the composite score of each unit region thereon; extracting the unit region based on the composite score from the second combined map; and determining the location of the measurement ROI such that the measurement ROI includes the extracted unit region.

[0339] The steps for generating the second combined mapping may include: determining a first weight value and a second weight value based on a user identifier obtained through a user interface or communication interface.

[0340] The step of extracting a unit region based on the composite score from the second combined mapping may include: extracting a unit region where the composite score is the maximum. The step of determining the location of the measured ROI such that the measured ROI includes the extracted unit region may include: determining the location of the measured ROI to include a unit region where the composite score is the maximum.

[0341] The step of extracting unit regions based on composite scores from a second combined mapping may include: further extracting at least one unit region in which the average resilience reliability of each unit region is greater than or equal to a preset threshold. The step of determining the location of the measurement ROI such that the measurement ROI includes the extracted unit regions may include: further determining at least one location of the measurement ROI to include at least one unit region in which the average resilience reliability of each unit region is greater than or equal to a preset threshold.

[0342] The step of displaying one of the extracted image frames and simultaneously displaying a second indicator may include: automatically determining multiple locations based on the measured ROI location, and displaying each location using multiple second indicators of different colors.

[0343] The step of displaying one of the extracted image frames and simultaneously displaying a third indicator may include: displaying a fourth display element provided for displaying information about a sorting criterion; and, in response to the extracted image frames being sorted according to the sorting criterion, displaying a fifth display element for displaying information about the sorting order of the displayed image frames.

[0344] The sorting criteria can correspond to either chronological order or order based on the fitness of elastic modulus measurement. Control methods for the ultrasound imaging system may include determining the sorting criteria based on user input.

[0345] The steps of displaying the fifth display element may include: superimposing and displaying multiple display units corresponding to each of the extracted multiple image frames on the sorted display elements at equal intervals according to the sorting criteria; and highlighting the display units corresponding to the displayed image frames.

[0346] The step of displaying the fifth display element may include: displaying each of the plurality of display units corresponding to each of the plurality of image frames using a color determined based on a preset score range to which the elastic modulus measurement fit of the corresponding extracted image frame belongs.

[0347] The step of automatically extracting multiple image frames for measuring the elastic modulus based on the elastic modulus measurement fitness may include: automatically extracting image frames as image frames for measuring the elastic modulus based on the elastic modulus measurement fitness of the image frames being greater than or equal to a reference value; and displaying through a user interface that no image frames among the multiple image frames included in the movie image have been extracted for measuring the elastic modulus based on the elastic modulus measurement fitness of the multiple image frames being less than the reference value.

[0348] The step of automatically extracting multiple image frames for measuring the elastic modulus based on the elastic modulus measurement fitness may include: providing guidance via a user interface to reset the elastic modulus measurement fitness threshold based on the fact that the elastic modulus measurement fitness of multiple image frames included in the movie image is less than a reference value.

[0349] An ultrasound imaging system according to one embodiment may include: a probe configured to receive an echo signal and a shear wave tracking signal; an image processor configured to generate an ultrasound image based on the echo signal, an elasticity image based on the shear wave tracking signal, an elasticity reliability image based on parameters obtained from the shear wave tracking signal, and configured to generate a cinematic image comprising a plurality of image frames by aligning the ultrasound image, the elasticity image, and the elasticity reliability image; a display for displaying the plurality of image frames; and a processor configured to determine the elastic modulus measurement fit of each of the plurality of image frames based on elasticity image data and elasticity reliability image data of each of the plurality of image frames, and configured to based on The elastic modulus measurement fitness feature automatically extracts multiple image frames for measuring the elastic modulus. It is configured to automatically determine the location of the region of interest (ROI) of each image frame in the extracted image frames based on the elastic image data and elastic reliability image data of each image frame. It is also configured to control a display to display one of the extracted image frames and simultaneously display at least one of the following: a first indicator for indicating the elastic modulus measurement fitness of the displayed image frame; a second indicator for indicating the location of the automatically determined measurement ROI of the displayed image frame; and a third indicator for indicating the sorting order of the displayed image frame among the extracted image frames.

[0350] The processor can be configured to: calculate the elastic uniformity standard deviation for each unit region based on elastic image data of each image frame in a plurality of image frames, and generate an elastic uniformity STD map based on the elastic uniformity standard deviation for each unit region; be configured to generate an average elastic reliability map for each unit region based on elastic reliability image data of each image frame in a plurality of image frames; be configured to generate a first combined map for each image frame in a plurality of image frames by combining the elastic uniformity STD map with the average elastic reliability map; and be configured to determine the elastic modulus measurement fit for each image frame in a plurality of image frames by calculating the average value of the first combined map.

[0351] In addition, the elastic average value can be calculated based on the elastic image data and divided into STD maps to generate a representative elastic uniformity STD map, and the representative elastic uniformity STD map can be combined with the average elastic reliability map to generate a first combined map for each of the multiple image frames.

[0352] The processor can be configured to determine the color of the first display element included in the first indicator based on a preset score range to which the elastic modulus measurement fit of the displayed image frame belongs.

[0353] The processor can be configured to determine the number of first display elements such that the number of first display elements included in the first indicator increases as the elastic modulus measurement fit of the displayed image frame increases within the same fractional range.

[0354] As can be readily understood from the above description, the processes of calculating fitness and extracting regions of interest (ROIs) can be automated, thus enabling measurements to be taken with consistent quality regardless of the examiner's skill level, and significantly improving the standardization and reproducibility of diagnostic results.

[0355] Furthermore, it can automatically select only high-quality frames and immediately identify low-reliability areas, thereby reducing unnecessary remeasurements and shortening examination time, and improving diagnostic accuracy by reducing false positives and false negatives.

[0356] Furthermore, indicator-based visualization and customization features allow users to visually examine the anatomical structure, elastic properties, and reliability information of the target area for diagnosis on a single screen, thereby simplifying clinical workflows and accelerating decision-making.

[0357] Furthermore, the disclosed embodiments can be implemented in the form of a recording medium storing computer-executable instructions. The instructions can be stored as program code, and when executed by a processor, can generate program modules to perform the operations of the disclosed embodiments. The recording medium can be implemented as a computer-readable recording medium.

[0358] Computer-readable recording media include all kinds of recording media in which instructions that can be decoded by a computer are stored. For example, read-only memory (ROM), random access memory (RAM), magnetic tape, magnetic disk, flash memory, and optical data storage devices may exist.

[0359] Machine-readable storage media may be provided in the form of non-transitory storage media. "Non-transitory storage media" means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term includes both cases where data is stored semi-permanently in the storage medium and cases where data is temporarily stored in the storage medium. For example, "non-transitory storage media" may include a cache for temporarily storing data.

[0360] Methods according to various disclosed embodiments can be provided by being included in a computer program product. The computer program product can be traded as a commodity between a seller and a buyer. The computer program product is distributed in the form of a device-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)) or through an app store (e.g., the Play Store). TM The computer program product (e.g., a downloadable application) may be distributed directly between two user devices (e.g., smartphones) or distributed online (e.g., downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) may be temporarily stored or temporarily created in a device-readable storage medium such as the memory of a manufacturer's server, an app store's server, or a relay server.

[0361] Other aspects of this disclosure will be readily understood in part by description, or may be learned through practice of this disclosure.

[0362] Although this disclosure has been specifically described with reference to exemplary embodiments, those skilled in the art will understand that various changes in form and detail may be made without departing from the spirit and scope of this disclosure.

Claims

1. A control method for an ultrasound imaging system, comprising: A cinematic image comprising multiple image frames is obtained by aligning an elastic image generated based on shear wave tracking signals received from the probe at the same timestamp and an elastic reliability image generated based on parameters obtained from the shear wave tracking signals from the probe with an ultrasound image generated based on echo signals received from the probe. Based on the elastic image data and elastic reliability image data of each of the plurality of image frames, the fitness of elastic modulus measurement for each of the plurality of image frames is determined; Automatically extract multiple image frames for measuring elastic modulus based on elastic modulus measurement fitness; Based on the elasticity image data and elasticity reliability image data of each of the extracted multiple image frames, the location of the measurement region of interest for each of the extracted image frames is automatically determined; as well as Display one of the extracted image frames, and simultaneously display at least one of the following: a first indicator indicating the suitability of the elastic modulus measurement of the displayed image frame; a second indicator indicating the automatically determined measurement region of interest location of the displayed image frame; and a third indicator indicating the sorting order of the displayed image frame among the extracted image frames.

2. The control method for the ultrasound imaging system according to claim 1, wherein, The steps to determine the suitability of elastic modulus measurement include: The elastic uniformity standard deviation of each unit region is calculated based on the elastic image data of each of the multiple image frames, and an elastic uniformity standard deviation (STD) mapping map is generated based on the elastic uniformity standard deviation of each unit region. An average elastic reliability mapping map for each unit region is generated based on the elastic reliability image data of each of the multiple image frames. A first combined mapping map for each of the plurality of image frames is generated by synthesizing the elasticity uniformity standard deviation (STD) mapping map with the average elasticity reliability mapping map; and The fitness of elastic modulus measurement for each of the plurality of image frames is determined by calculating the average value of the first combined mapping.

3. The control method for the ultrasound imaging system according to claim 1, wherein, The steps of displaying one of the extracted image frames and simultaneously displaying the first indicator include: The color of the first display element included in the first indicator is determined based on a preset score range to which the elastic modulus measurement fit of the displayed image frame belongs.

4. The control method for the ultrasound imaging system according to claim 3, wherein, The steps of displaying one of the extracted image frames and simultaneously displaying the first indicator include: The number of first display elements is determined such that the number of first display elements included in the first indicator increases as the elastic modulus measurement fit of the displayed image frame increases within the same fractional range.

5. The control method for the ultrasound imaging system according to claim 1, wherein, The steps for displaying one of the extracted image frames include: Simultaneously displaying a first ultrasound image in which an elastic image is superimposed on an ultrasound image and a second ultrasound image in which an elastic reliability image is superimposed on an ultrasound image.

6. The control method for the ultrasound imaging system according to claim 5, wherein, The steps of displaying one of the extracted image frames and simultaneously displaying the second indicator include: Simultaneously, a second display element is displayed to indicate the location of the measurement region of interest automatically determined on the first ultrasound image, and a third display element is displayed to indicate the location of the measurement region of interest automatically determined on the second ultrasound image.

7. The control method for the ultrasound imaging system according to claim 1, wherein, The steps for automatically determining the location of the region of interest (ROI) in each of the extracted image frames include: An elastic uniformity map is generated by calculating the elastic uniformity of each unit region based on the elastic image data of each image frame extracted from the image frames. An average elastic reliability map for each unit region is generated based on the elastic reliability image data of each image frame extracted from the image frames. The composite score for each unit region is calculated by applying a first weight value to the elasticity uniformity map and a second weight value to the average elasticity reliability map, and a second combined map reflecting the composite score for each unit region is generated thereon. Unit regions are extracted based on composite fractions from the second combined mapping map; and Determine the location of the region of interest to be measured so that the region of interest includes the extracted unit region.

8. The control method for the ultrasound imaging system according to claim 7, wherein, The steps for generating the second combined mapping graph include: The first weight value and the second weight value are determined based on the user identifier obtained through the user interface or communication interface.

9. The control method for the ultrasound imaging system according to claim 7, wherein, The step of extracting unit regions based on composite scores from the second combined mapping map includes: extracting a unit region where the composite score is the maximum value. The step of determining the location of the region of interest to include the extracted unit region includes: determining the location of the region of interest to include a unit region with a composite score of maximum value.

10. The control method for the ultrasound imaging system according to claim 9, wherein, The step of extracting unit regions based on composite scores from the second combined mapping map includes: further extracting at least one unit region in which the average resilience reliability of each unit region is greater than or equal to a preset threshold. The step of determining the location of the region of interest to include the extracted unit region includes: further determining at least one location of the region of interest to include at least one unit region in which the average elastic reliability of each unit region is greater than or equal to a preset threshold.

11. The control method for the ultrasound imaging system according to claim 10, wherein, The steps of displaying one of the extracted image frames and simultaneously displaying the second indicator include: The location of the region of interest is automatically determined as multiple locations based on the measurement, and each location is displayed using multiple secondary indicators of different colors.

12. The control method for the ultrasound imaging system according to claim 1, wherein, The steps of displaying one of the extracted image frames and simultaneously displaying the third indicator include: The display is set to show a fourth display element that displays information about the sorting criteria; and In response to the extracted multiple image frames being sorted according to the sorting criteria, a fifth display element is displayed to show information about the sorting order of the displayed image frames.

13. The control method for the ultrasound imaging system according to claim 12, wherein, The sorting criteria correspond to either chronological order or order based on the fitness of elastic modulus measurement. The control method of the ultrasound imaging system includes: The sorting criteria are determined based on user input.

14. The control method for the ultrasound imaging system according to claim 12, wherein, The steps to display the fifth display element include: Multiple display units corresponding to each image frame in the extracted image frames are stacked and displayed at equal intervals on the sorted elements according to the sorting criteria; and Highlight the display unit corresponding to the displayed image frame.

15. The control method for the ultrasound imaging system according to claim 14, wherein, The steps to display the fifth display element include: Each of the multiple display units corresponding to each of the multiple extracted image frames is displayed using a color determined based on a preset score range to which the elastic modulus measurement fit of the corresponding extracted image frame belongs.

16. The control method for the ultrasound imaging system according to claim 1, wherein, The steps for automatically extracting multiple image frames for measuring the elastic modulus based on the fitness of elastic modulus measurement include: Based on the elastic modulus measurement goodness of the image frame being greater than or equal to the reference value, image frames are automatically extracted as image frames for measuring the elastic modulus; and Based on the fact that the elastic modulus measurement goodness of multiple image frames included in the movie image is less than the reference value, the user interface shows that none of the multiple image frames were extracted for measuring the elastic modulus.

17. The control method for the ultrasound imaging system according to claim 15, wherein, The steps for automatically extracting multiple image frames for measuring the elastic modulus based on the fitness of elastic modulus measurement include: Based on the fact that the elastic modulus measurement fitness values ​​of multiple image frames included in the movie image are all less than the reference value, a user interface is provided to guide the user in resetting the elastic modulus measurement fitness threshold.

18. An ultrasound imaging system, comprising: The probe is configured to receive echo signals and shear wave tracking signals; The image processor is configured to generate an ultrasound image based on an echo signal, to generate an elastic image based on a shear wave tracking signal, to generate an elastic reliability image based on parameters obtained from the shear wave tracking signal, and to generate a movie image comprising multiple image frames by aligning the ultrasound image, the elastic image, and the elastic reliability image. The display shows the plurality of image frames; as well as The processor is configured to determine the elastic modulus measurement fit of each of the plurality of image frames based on elastic image data and elastic reliability image data of each of the plurality of image frames; It is configured to automatically extract multiple image frames for measuring the elastic modulus based on the elastic modulus measurement fitness. It is configured to automatically determine the location of the measurement region of interest for each of the extracted image frames based on the elasticity image data and elasticity reliability image data of each of the extracted image frames; and is configured to control a display to display one of the extracted image frames, and simultaneously display at least one of the following: a first indicator for indicating the elastic modulus measurement suitability of the displayed image frame, a second indicator for indicating the location of the automatically determined measurement region of interest of the displayed image frame, and a third indicator for indicating the sorting order of the displayed image frame among the extracted image frames.

19. The ultrasound imaging system according to claim 18, wherein, The processor is configured to: Based on the elastic image data of each of the multiple image frames, the standard deviation of elastic uniformity for each unit region is calculated, and an elastic uniformity standard deviation (STD) mapping map is generated based on the standard deviation of elastic uniformity for each unit region. Based on the elastic reliability image data of each of the multiple image frames, an average elastic reliability mapping map for each unit region is generated. A first combined mapping map for each of the plurality of image frames is generated by combining the elasticity uniformity standard deviation (STD) mapping map with the average elasticity reliability mapping map. as well as The fitness of elastic modulus measurement for each of the plurality of image frames is determined by calculating the average value of the first combined mapping.

20. The ultrasound imaging system according to claim 18, wherein, The processor is configured to determine the color of a first display element included in a first indicator based on a preset score range to which the elastic modulus measurement fit of the displayed image frame belongs.

Images